Sample records for brain reward processes

  1. The endocannabinoid system in brain reward processes.

    PubMed

    Solinas, M; Goldberg, S R; Piomelli, D

    2008-05-01

    Food, drugs and brain stimulation can serve as strong rewarding stimuli and are all believed to activate common brain circuits that evolved in mammals to favour fitness and survival. For decades, endogenous dopaminergic and opioid systems have been considered the most important systems in mediating brain reward processes. Recent evidence suggests that the endogenous cannabinoid (endocannabinoid) system also has an important role in signalling of rewarding events. First, CB(1) receptors are found in brain areas involved in reward processes, such as the dopaminergic mesolimbic system. Second, activation of CB(1) receptors by plant-derived, synthetic or endogenous CB(1) receptor agonists stimulates dopaminergic neurotransmission, produces rewarding effects and increases rewarding effects of abused drugs and food. Third, pharmacological or genetic blockade of CB(1) receptors prevents activation of dopaminergic neurotransmission by several addictive drugs and reduces rewarding effects of food and these drugs. Fourth, brain levels of the endocannabinoids anandamide and 2-arachidonoylglycerol are altered by activation of reward processes. However, the intrinsic activity of the endocannabinoid system does not appear to play a facilitatory role in brain stimulation reward and some evidence suggests it may even oppose it. The influence of the endocannabinoid system on brain reward processes may depend on the degree of activation of the different brain areas involved and might represent a mechanism for fine-tuning dopaminergic activity. Although involvement of the various components of the endocannabinoid system may differ depending on the type of rewarding event investigated, this system appears to play a major role in modulating reward processes.

  2. Reward sensitivity is associated with brain activity during erotic stimulus processing.

    PubMed

    Costumero, Victor; Barrós-Loscertales, Alfonso; Bustamante, Juan Carlos; Ventura-Campos, Noelia; Fuentes, Paola; Rosell-Negre, Patricia; Ávila, César

    2013-01-01

    The behavioral approach system (BAS) from Gray's reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray's theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men completed the Sensitivity to Reward scale (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire) to measure BAS-related traits. Results showed that Sensitivity to Reward scores correlated positively with brain activity during reactivity to erotic pictures in the left orbitofrontal cortex, left insula, and right ventral striatum. These results demonstrated a relationship between the BAS and reward sensitivity during the processing of erotic stimuli, filling the gap of previous reports that identified the dopaminergic system as a neural substrate for the BAS during the processing of other rewarding stimuli such as money and food.

  3. Reward Sensitivity Is Associated with Brain Activity during Erotic Stimulus Processing

    PubMed Central

    Costumero, Victor; Barrós-Loscertales, Alfonso; Bustamante, Juan Carlos; Ventura-Campos, Noelia; Fuentes, Paola; Rosell-Negre, Patricia; Ávila, César

    2013-01-01

    The behavioral approach system (BAS) from Gray’s reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray’s theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men completed the Sensitivity to Reward scale (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire) to measure BAS-related traits. Results showed that Sensitivity to Reward scores correlated positively with brain activity during reactivity to erotic pictures in the left orbitofrontal cortex, left insula, and right ventral striatum. These results demonstrated a relationship between the BAS and reward sensitivity during the processing of erotic stimuli, filling the gap of previous reports that identified the dopaminergic system as a neural substrate for the BAS during the processing of other rewarding stimuli such as money and food. PMID:23840558

  4. Involvement of the endocannabinoid system in reward processing in the human brain.

    PubMed

    van Hell, Hendrika H; Jager, Gerry; Bossong, Matthijs G; Brouwer, Annelies; Jansma, J Martijn; Zuurman, Lineke; van Gerven, Joop; Kahn, René S; Ramsey, Nick F

    2012-02-01

    Disturbed reward processing in humans has been associated with a number of disorders, such as depression, addiction, and attention-deficit hyperactivity disorder. The endocannabinoid (eCB) system has been implicated in reward processing in animals, but in humans, the relation between eCB functioning and reward is less clear. The current study uses functional magnetic resonance imaging (fMRI) to investigate the role of the eCB system in reward processing in humans by examining the effect of the eCB agonist Δ(9)-tetrahydrocannabinol (THC) on reward-related brain activity. Eleven healthy males participated in a randomized placebo-controlled pharmacological fMRI study with administration of THC to challenge the eCB system. We compared anticipatory and feedback-related brain activity after placebo and THC, using a monetary incentive delay task. In this task, subjects are notified before each trial whether a correct response is rewarded ("reward trial") or not ("neutral trial"). Subjects showed faster reaction times during reward trials compared to neutral trials, and this effect was not altered by THC. THC induced a widespread attenuation of the brain response to feedback in reward trials but not in neutral trials. Anticipatory brain activity was not affected. These results suggest a role for the eCB system in the appreciation of rewards. The involvement of the eCB system in feedback processing may be relevant for disorders in which appreciation of natural rewards may be affected such as addiction.

  5. Regulation of brain reward by the endocannabinoid system: a critical review of behavioral studies in animals.

    PubMed

    Vlachou, S; Panagis, G

    2014-01-01

    The endocannabinoid system has been implicated in the regulation of a variety of physiological processes, including a crucial involvement in brain reward systems and the regulation of motivational processes. Behavioral studies have shown that cannabinoid reward may involve the same brain circuits and similar brain mechanisms with other drugs of abuse, such as nicotine, cocaine, alcohol and heroin, as well as natural rewards, such as food, water and sucrose, although the conditions under which cannabinoids exert their rewarding effects may be more limited. The purpose of the present review is to briefly describe and evaluate the behavioral and pharmacological research concerning the major components of the endocannabinoid system and reward processes. Special emphasis is placed on data received from four procedures used to test the effects of the endocannabinoid system on brain reward in animals; namely, the intracranial self-stimulation paradigm, the self-administration procedure, the conditioned place preference procedure and the drug-discrimination procedure. The effects of cannabinoid 1 (CB1) and cannabinoid 2 (CB2) receptor agonists, antagonists and endocannabinoid modulators in these procedures are examined. Further, the involvement of CB1 and CB2 receptors, as well the fatty acid amid hydrolase (FAAH) enzyme in reward processes is investigated through presentation of respective genetic ablation studies in mice. We suggest that the endocannabinoid system plays a major role in modulating motivation and reward processes. Further research will provide us with a better understanding of these processes and, thus, could lead to the development of potential therapeutic compounds for the treatment of reward-related disorders.

  6. Common and distinct networks underlying reward valence and processing stages: A meta-analysis of functional neuroimaging studies

    PubMed Central

    Liu, Xun; Hairston, Jacqueline; Schrier, Madeleine; Fan, Jin

    2011-01-01

    To better understand the reward circuitry in human brain, we conducted activation likelihood estimation (ALE) and parametric voxel-based meta-analyses (PVM) on 142 neuroimaging studies that examined brain activation in reward-related tasks in healthy adults. We observed several core brain areas that participated in reward-related decision making, including the nucleus accumbens (NAcc), caudate, putamen, thalamus, orbitofrontal cortex (OFC), bilateral anterior insula, anterior (ACC) and posterior (PCC) cingulate cortex, as well as cognitive control regions in the inferior parietal lobule and prefrontal cortex (PFC). The NAcc was commonly activated by both positive and negative rewards across various stages of reward processing (e.g., anticipation, outcome, and evaluation). In addition, the medial OFC and PCC preferentially responded to positive rewards, whereas the ACC, bilateral anterior insula, and lateral PFC selectively responded to negative rewards. Reward anticipation activated the ACC, bilateral anterior insula, and brain stem, whereas reward outcome more significantly activated the NAcc, medial OFC, and amygdala. Neurobiological theories of reward-related decision making should therefore distributed and interrelated representations of reward valuation and valence assessment into account. PMID:21185861

  7. Neural processing of reward in adolescent rodents.

    PubMed

    Simon, Nicholas W; Moghaddam, Bita

    2015-02-01

    Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

  8. The anticipation and outcome phases of reward and loss processing: A neuroimaging meta-analysis of the monetary incentive delay task.

    PubMed

    Oldham, Stuart; Murawski, Carsten; Fornito, Alex; Youssef, George; Yücel, Murat; Lorenzetti, Valentina

    2018-04-25

    The processing of rewards and losses are crucial to everyday functioning. Considerable interest has been attached to investigating the anticipation and outcome phases of reward and loss processing, but results to date have been inconsistent. It is unclear if anticipation and outcome of a reward or loss recruit similar or distinct brain regions. In particular, while the striatum has widely been found to be active when anticipating a reward, whether it activates in response to the anticipation of losses as well remains ambiguous. Furthermore, concerning the orbitofrontal/ventromedial prefrontal regions, activation is often observed during reward receipt. However, it is unclear if this area is active during reward anticipation as well. We ran an Activation Likelihood Estimation meta-analysis of 50 fMRI studies, which used the Monetary Incentive Delay Task (MIDT), to identify which brain regions are implicated in the anticipation of rewards, anticipation of losses, and the receipt of reward. Anticipating rewards and losses recruits overlapping areas including the striatum, insula, amygdala and thalamus, suggesting that a generalised neural system initiates motivational processes independent of valence. The orbitofrontal/ventromedial prefrontal regions were recruited only during the reward outcome, likely representing the value of the reward received. Our findings help to clarify the neural substrates of the different phases of reward and loss processing, and advance neurobiological models of these processes. © 2018 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

  9. Altered striatal activation predicting real-world positive affect in adolescent major depressive disorder.

    PubMed

    Forbes, Erika E; Hariri, Ahmad R; Martin, Samantha L; Silk, Jennifer S; Moyles, Donna L; Fisher, Patrick M; Brown, Sarah M; Ryan, Neal D; Birmaher, Boris; Axelson, David A; Dahl, Ronald E

    2009-01-01

    Alterations in reward-related brain function and phenomenological aspects of positive affect are increasingly examined in the development of major depressive disorder. The authors tested differences in reward-related brain function in healthy and depressed adolescents, and the authors examined direct links between reward-related brain function and positive mood that occurred in real-world contexts. Fifteen adolescents with major depressive disorder and 28 adolescents with no history of psychiatric disorder, ages 8-17 years, completed a functional magnetic resonance imaging guessing task involving monetary reward. Participants also reported their subjective positive affect in natural environments during a 4-day cell-phone-based ecological momentary assessment. Adolescents with major depressive disorder exhibited less striatal response than healthy comparison adolescents during reward anticipation and reward outcome, but more response in dorsolateral and medial prefrontal cortex. Diminished activation in a caudate region associated with this depression group difference was correlated with lower subjective positive affect in natural environments, particularly within the depressed group. Results support models of altered reward processing and related positive affect in young people with major depressive disorder and indicate that depressed adolescents' brain response to monetary reward is related to their affective experience in natural environments. Additionally, these results suggest that reward-processing paradigms capture brain function relevant to real-world positive affect.

  10. Impaired Feedback Processing for Symbolic Reward in Individuals with Internet Game Overuse

    PubMed Central

    Kim, Jinhee; Kim, Hackjin; Kang, Eunjoo

    2017-01-01

    Reward processing, which plays a critical role in adaptive behavior, is impaired in addiction disorders, which are accompanied by functional abnormalities in brain reward circuits. Internet gaming disorder, like substance addiction, is thought to be associated with impaired reward processing, but little is known about how it affects learning, especially when feedback is conveyed by less-salient motivational events. Here, using both monetary (±500 KRW) and symbolic (Chinese characters “right” or “wrong”) rewards and penalties, we investigated whether behavioral performance and feedback-related neural responses are altered in Internet game overuse (IGO) group. Using functional MRI, brain responses for these two types of reward/penalty feedback were compared between young males with problems of IGO (IGOs, n = 18, mean age = 22.2 ± 2.0 years) and age-matched control subjects (Controls, n = 20, mean age = 21.2 ± 2.1) during a visuomotor association task where associations were learned between English letters and one of four responses. No group difference was found in adjustment of error responses following the penalty or in brain responses to penalty, for either monetary or symbolic penalties. The IGO individuals, however, were more likely to fail to choose the response previously reinforced by symbolic (but not monetary) reward. A whole brain two-way ANOVA analysis for reward revealed reduced activations in the IGO group in the rostral anterior cingulate cortex/ventromedial prefrontal cortex (vmPFC) in response to both reward types, suggesting impaired reward processing. However, the responses to reward in the inferior parietal region and medial orbitofrontal cortex/vmPFC were affected by the types of reward in the IGO group. Unlike the control group, in the IGO group the reward response was reduced only for symbolic reward, suggesting lower attentional and value processing specific to symbolic reward. Furthermore, the more severe the Internet gaming overuse symptoms in the IGO group, the greater the activations of the ventral striatum for monetary relative to symbolic reward. These findings suggest that IGO is associated with bias toward motivationally salient reward, which would lead to poor goal-directed behavior in everyday life. PMID:29051739

  11. Quantifying familial influences on brain activation during the monetary incentive delay task: an adolescent monozygotic twin study.

    PubMed

    Silverman, Merav H; Krueger, Robert F; Iacono, William G; Malone, Stephen M; Hunt, Ruskin H; Thomas, Kathleen M

    2014-12-01

    Although altered brain activation during reward tasks has been found in a number of heritable psychiatric disorders and health outcomes, the familial nature of reward-related brain activation remains unexplored. In this study, we investigated the degree to which the magnitude of mesocorticolimbic reward system signal intensities in anticipation of reward during the monetary incentive delay (MID) task was similar within 46 pairs of adolescent, monozygotic twins. Significant within-pair correlations in brain activation during anticipation of gain were found in one third of the 18 reward-related regions investigated. These regions were the right nucleus accumbens, left and right posterior caudate, right anterior caudate, left insula, and anterior cingulate cortex. This serves as evidence for a shared familial contribution to individual differences in reward related brain activity in certain key reward processing regions. Copyright © 2014 Elsevier B.V. All rights reserved.

  12. Enhanced neural responsiveness to reward associated with obesity in the absence of food-related stimuli.

    PubMed

    Opel, Nils; Redlich, Ronny; Grotegerd, Dominik; Dohm, Katharina; Haupenthal, Cordula; Heindel, Walter; Kugel, Harald; Arolt, Volker; Dannlowski, Udo

    2015-06-01

    Obesity has been characterized by alterations in brain structure and function associated with emotion processing and regulation. Particularly, aberrations in food-related reward processing have been frequently demonstrated in obese subjects. However, it remains unclear whether reward-associated functional aberrations in obesity are specific for food-related stimuli or represent a general deficit in reward processing, extending to other stimulus domains. Given the crucial role of rewarding effects in the development of obesity and the ongoing discussion on overlapping neurobiological traits of obesity and psychiatric disorders such as depression and substance-related disorders, this study aimed to investigate the possibility of altered reward processing in obese subjects to occur in the absence of food-related stimuli during a monetary reward condition. Twenty-nine healthy obese subjects (body mass index >30) and 29 healthy, age-, and sex-matched control subjects of normal weight underwent functional MRI during a frequently used card guessing paradigm. A Group × Condition (win vs. loss) ANOVA was conducted to investigate differences between obese and normal-weight subjects. We found significant Group × Condition interaction effects in brain areas involved in emotion regulation and reward processing including the insula, the striatum, and the orbitofrontal cortex (OFC). This interaction was predominantly driven by a significant increase in blood oxygenation level dependent (BOLD) response in obese individuals while experiencing reward. Enhanced neural activation in obesity during reward processing seems to be apparent even in the absence of food-related stimuli and, thus, might point to generalized dysfunctions in reward-related brain circuits in obese individuals. © 2015 Wiley Periodicals, Inc.

  13. Neural correlates of reward processing in healthy siblings of patients with schizophrenia

    PubMed Central

    Hanssen, Esther; van der Velde, Jorien; Gromann, Paula M.; Shergill, Sukhi S.; de Haan, Lieuwe; Bruggeman, Richard; Krabbendam, Lydia; Aleman, André; van Atteveldt, Nienke

    2015-01-01

    Deficits in motivational behavior and psychotic symptoms often observed in schizophrenia (SZ) may be driven by dysfunctional reward processing (RP). RP can be divided in two different stages; reward anticipation and reward consumption. Aberrant processing during reward anticipation seems to be related to SZ. Studies in patients with SZ have found less activation in the ventral striatum (VS) during anticipation of reward, but these findings do not provide information on effect of the genetic load on reward processing. Therefore, this study investigated RP in healthy first-degree relatives of SZ patients. The sample consisted of 94 healthy siblings of SZ patients and 57 healthy controls. Participants completed a classic RP task, the Monetary Incentive Delay task, during functional magnetic resonance imaging (fMRI). As expected, there were no behavioral differences between groups. In contrast to our expectations, we found no differences in any of the anticipatory reward related brain areas (region of interest analyses). Whole-brain analyses did reveal group differences during both reward anticipation and reward consumption; during reward anticipation siblings showed less deactivation in the insula, posterior cingulate cortex (PCC) and medial frontal gyrus (MFG) than controls. During reward consumption siblings showed less deactivation in the PCC and the right MFG compared to controls and activation in contrast to deactivation in controls in the precuneus and the left MFG. Exclusively in siblings, MFG activity correlated positively with subclinical negative symptoms. These regions are typically associated with the default mode network (DMN), which normally shows decreases in activation during task-related cognitive processes. Thus, in contrast to prior literature in patients with SZ, the results do not point to altered brain activity in classical RP brain areas, such as the VS. However, the weaker deactivation found outside the reward-related network in siblings could indicate reduced task-related suppression (i.e., hyperactivation) of the DMN. The presence of DMN hyperactivation during reward anticipation and reward consumption might indicate that siblings of patients with SZ have a higher baseline level of DMN activation and possible abnormal network functioning. PMID:26441601

  14. Effects of alexithymia and empathy on the neural processing of social and monetary rewards.

    PubMed

    Goerlich, Katharina Sophia; Votinov, Mikhail; Lammertz, Sarah E; Winkler, Lina; Spreckelmeyer, Katja N; Habel, Ute; Gründer, Gerhard; Gossen, Anna

    2017-07-01

    Empathy has been found to affect the neural processing of social and monetary rewards. Alexithymia, a subclinical condition showing a close inverse relationship with empathy is linked to dysfunctions of socio-emotional processing in the brain. Whether alexithymia alters the neural processing of rewards, which is currently unknown. Here, we investigated the influence of both alexithymia and empathy on reward processing using a social incentive delay (SID) task and a monetary incentive delay (MID) task in 45 healthy men undergoing functional magnetic resonance imaging. Controlling for temperament-character dimensions and rejection sensitivity, the relationship of alexithymia and empathy with neural activity in several a priori regions of interest (ROIs) was examined by means of partial correlations, while participants anticipated and received social and monetary rewards. Results were considered significant if they survived Holm-Bonferroni correction for multiple comparisons. Alexithymia modulated neural activity in several ROIs of the emotion and reward network, both during the anticipation of social and monetary rewards and in response to the receipt of monetary rewards. In contrast, empathy did not affect reward anticipation and modulated ROI activity only in response to the receipt of social rewards. These results indicate a significant influence of alexithymia on the processing of social and monetary rewards in the healthy brain.

  15. Cannabinoid Regulation of Brain Reward Processing with an Emphasis on the Role of CB1 Receptors: A Step Back into the Future.

    PubMed

    Panagis, George; Mackey, Brian; Vlachou, Styliani

    2014-01-01

    Over the last decades, the endocannabinoid system has been implicated in a large variety of functions, including a crucial modulation of brain-reward circuits and the regulation of motivational processes. Importantly, behavioral studies have shown that cannabinoid compounds activate brain reward mechanisms and circuits in a similar manner to other drugs of abuse, such as nicotine, alcohol, cocaine, and heroin, although the conditions under which cannabinoids exert their rewarding effects may be more limited. Furthermore, there is evidence on the involvement of the endocannabinoid system in the regulation of cue- and drug-induced relapsing phenomena in animal models. The aim of this review is to briefly present the available data obtained using diverse behavioral experimental approaches in experimental animals, namely, the intracranial self-stimulation paradigm, the self-administration procedure, the conditioned place preference procedure, and the reinstatement of drug-seeking behavior procedure, to provide a comprehensive picture of the current status of what is known about the endocannabinoid system mechanisms that underlie modification of brain-reward processes. Emphasis is placed on the effects of cannabinoid 1 (CB1) receptor agonists, antagonists, and endocannabinoid modulators. Further, the role of CB1 receptors in reward processes is investigated through presentation of respective genetic ablation studies in mice. The vast majority of studies in the existing literature suggest that the endocannabinoid system plays a major role in modulating motivation and reward processes. However, much remains to be done before we fully understand these interactions. Further research in the future will shed more light on these processes and, thus, could lead to the development of potential pharmacotherapies designed to treat reward-dysfunction-related disorders.

  16. Neural Networks Involved in Adolescent Reward Processing: An Activation Likelihood Estimation Meta-Analysis of Functional Neuroimaging Studies

    PubMed Central

    Silverman, Merav H.; Jedd, Kelly; Luciana, Monica

    2015-01-01

    Behavioral responses to, and the neural processing of, rewards change dramatically during adolescence and may contribute to observed increases in risk-taking during this developmental period. Functional MRI (fMRI) studies suggest differences between adolescents and adults in neural activation during reward processing, but findings are contradictory, and effects have been found in non-predicted directions. The current study uses an activation likelihood estimation (ALE) approach for quantitative meta-analysis of functional neuroimaging studies to: 1) confirm the network of brain regions involved in adolescents’ reward processing, 2) identify regions involved in specific stages (anticipation, outcome) and valence (positive, negative) of reward processing, and 3) identify differences in activation likelihood between adolescent and adult reward-related brain activation. Results reveal a subcortical network of brain regions involved in adolescent reward processing similar to that found in adults with major hubs including the ventral and dorsal striatum, insula, and posterior cingulate cortex (PCC). Contrast analyses find that adolescents exhibit greater likelihood of activation in the insula while processing anticipation relative to outcome and greater likelihood of activation in the putamen and amygdala during outcome relative to anticipation. While processing positive compared to negative valence, adolescents show increased likelihood for activation in the posterior cingulate cortex (PCC) and ventral striatum. Contrasting adolescent reward processing with the existing ALE of adult reward processing (Liu et al., 2011) reveals increased likelihood for activation in limbic, frontolimbic, and striatal regions in adolescents compared with adults. Unlike adolescents, adults also activate executive control regions of the frontal and parietal lobes. These findings support hypothesized elevations in motivated activity during adolescence. PMID:26254587

  17. Pervasive competition between threat and reward in the brain

    PubMed Central

    Choi, Jong Moon; Padmala, Srikanth; Spechler, Philip

    2014-01-01

    In the current functional MRI study, we investigated interactions between reward and threat processing. Visual cues at the start of each trial informed participants about the chance of winning monetary reward and/or receiving a mild aversive shock. We tested two competing hypothesis: according to the ‘salience hypothesis’, in the condition involving both reward and threat, enhanced activation would be observed because of increased salience; according to the ‘competition hypothesis’, the processing of reward and threat would trade-off against each other, leading to reduced activation. Analysis of skin conductance data during a delay phase revealed an interaction between reward and threat processing, such that the effect of reward was reduced during threat and the effect of threat was reduced during reward. Analysis of imaging data during the same task phase revealed interactions between reward and threat processing in several regions, including the midbrain/ventral tegmental area, caudate, putamen, bed nucleus of the stria terminalis, anterior insula, middle frontal gyrus and dorsal anterior cingulate cortex. Taken together, our findings reveal conditions during which reward and threat trade-off against each other across multiple sites. Such interactions are suggestive of competitive processes and may reflect the organization of opponent systems in the brain. PMID:23547242

  18. Winning and losing: differences in reward and punishment sensitivity between smokers and nonsmokers.

    PubMed

    Martin, Laura E; Cox, Lisa S; Brooks, William M; Savage, Cary R

    2014-01-01

    Smokers show increased brain activation in reward processing regions in response to smoking-related cues, yet few studies have examined secondary rewards not associated with smoking (i.e., money). Inconsistencies exist in the studies that do examine secondary rewards with some studies showing increased brain activation in reward processing brain regions, while others show decreased activation or no difference in activation between smokers and nonsmokers. The goal of the current study is to see if smokers process the evaluation and delivery of equally salient real world rewards similarly or differently than nonsmokers. The current study employed functional magnetic resonance imaging (fMRI) to examine brain responses in smokers and nonsmokers during the evaluation and delivery of monetary gains and losses. In comparison to nonsmokers, smokers showed increased activation in the ventromedial prefrontal cortex to the evaluation of anticipated monetary losses and the brain response. Moreover, smokers compared to nonsmokers showed decreased activation in the inferior frontal gyrus to the delivery of expected monetary gains. Brain activations to both the evaluation of anticipated monetary losses and the delivery of expected monetary gains correlated with increased self-reported smoking craving to relieve negative withdrawal symptoms and craving related to positive aspects of smoking, respectively. Together these results indicate that smokers are hyperresponsive to the evaluation of anticipated punishment and hyporesponsive to the delivery of expected rewards. Although further research is needed, this hypersensitivity to punishments coupled with increased craving may negatively impact quit attempts as smokers anticipate the negative withdrawal symptoms associated with quitting.

  19. Marijuana and cannabinoid regulation of brain reward circuits.

    PubMed

    Lupica, Carl R; Riegel, Arthur C; Hoffman, Alexander F

    2004-09-01

    The reward circuitry of the brain consists of neurons that synaptically connect a wide variety of nuclei. Of these brain regions, the ventral tegmental area (VTA) and the nucleus accumbens (NAc) play central roles in the processing of rewarding environmental stimuli and in drug addiction. The psychoactive properties of marijuana are mediated by the active constituent, Delta(9)-THC, interacting primarily with CB1 cannabinoid receptors in a large number of brain areas. However, it is the activation of these receptors located within the central brain reward circuits that is thought to play an important role in sustaining the self-administration of marijuana in humans, and in mediating the anxiolytic and pleasurable effects of the drug. Here we describe the cellular circuitry of the VTA and the NAc, define the sites within these areas at which cannabinoids alter synaptic processes, and discuss the relevance of these actions to the regulation of reinforcement and reward. In addition, we compare the effects of Delta(9)-THC with those of other commonly abused drugs on these reward circuits, and we discuss the roles that endogenous cannabinoids may play within these brain pathways, and their possible involvement in regulating ongoing brain function, independently of marijuana consumption. We conclude that, whereas Delta(9)-THC alters the activity of these central reward pathways in a manner that is consistent with other abused drugs, the cellular mechanism through which this occurs is likely different, relying upon the combined regulation of several afferent pathways to the VTA.

  20. Neuroimaging Studies of Factors Related to Exercise: Rationale and design of a 9 month trial

    PubMed Central

    Herrmann, Stephen D.; Martin, Laura E.; Breslin, Florence J.; Honas, Jeffery J.; Willis, Erik A.; Lepping, Rebecca J.; Gibson, Cheryl A.; Befort, Christie A.; Lambourne, Kate; Burns, Jeffrey M.; Smith, Bryan K.; Sullivan, Debra K.; Washburn, Richard A.; Yeh, Hung-Wen; Donnelly, Joseph E.; Savage, Cary R.

    2014-01-01

    The prevalence of obesity is high resulting from chronic imbalances between energy intake and expenditure. On the expenditure side, regular exercise is associated with health benefits, including enhanced brain function. The benefits of exercise are not immediate and require persistence to be realized. Brain regions associated with health-related decisions, such as whether or not to exercise or controlling the impulse to engage in immediately rewarding activities (e.g., sedentary behavior), include reward processing and cognitive control regions. A 9 month aerobic exercise study will be conducted in 180 sedentary adults (n = 90 healthy weight [BMI= 18.5 to 26.0 kg/m2]; n = 90 obese [BMI=29.0 to 41.0 kg/m2) to examine the brain processes underlying reward processing and impulse control that may affect adherence in a new exercise regimen. The primary aim is to use functional magnetic resonance imaging (fMRI) to examine reward processing and impulse control among participants that adhere (exercise >80% of sessions) and those that do not adhere to a nine-month exercise intervention with secondary analyses comparing sedentary obese and sedentary healthy weight participants. Our results will provide valuable information characterizing brain activation underlying reward processing and impulse control in sedentary obese and healthy weight individuals. In addition, our results may identify brain activation predictors of adherence and success in the exercise program along with measuring the effects of exercise and improved fitness on brain activation. PMID:24291150

  1. Brain structural correlates of reward sensitivity and impulsivity in adolescents with normal and excess weight.

    PubMed

    Moreno-López, Laura; Soriano-Mas, Carles; Delgado-Rico, Elena; Rio-Valle, Jacqueline S; Verdejo-García, Antonio

    2012-01-01

    Neuroscience evidence suggests that adolescent obesity is linked to brain dysfunctions associated with enhanced reward and somatosensory processing and reduced impulse control during food processing. Comparatively less is known about the role of more stable brain structural measures and their link to personality traits and neuropsychological factors on the presentation of adolescent obesity. Here we aimed to investigate regional brain anatomy in adolescents with excess weight vs. lean controls. We also aimed to contrast the associations between brain structure and personality and cognitive measures in both groups. Fifty-two adolescents (16 with normal weight and 36 with excess weight) were scanned using magnetic resonance imaging and completed the Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ), the UPPS-P scale, and the Stroop task. Voxel-based morphometry (VBM) was used to assess possible between-group differences in regional gray matter (GM) and to measure the putative differences in the way reward and punishment sensitivity, impulsivity and inhibitory control relate to regional GM volumes, which were analyzed using both region of interest (ROI) and whole brain analyses. The ROIs included areas involved in reward/somatosensory processing (striatum, somatosensory cortices) and motivation/impulse control (hippocampus, prefrontal cortex). Excess weight adolescents showed increased GM volume in the right hippocampus. Voxel-wise volumes of the second somatosensory cortex (SII) were correlated with reward sensitivity and positive urgency in lean controls, but this association was missed in excess weight adolescents. Moreover, Stroop performance correlated with dorsolateral prefrontal cortex volumes in controls but not in excess weight adolescents. Adolescents with excess weight have structural abnormalities in brain regions associated with somatosensory processing and motivation.

  2. Pubertal status associations with reward and threat sensitivities and subcortical brain volumes during adolescence.

    PubMed

    Urošević, Snežana; Collins, Paul; Muetzel, Ryan; Lim, Kelvin O; Luciana, Monica

    2014-08-01

    Adolescence is characterized by complex developmental processes that impact behavior, biology, and social functioning. Two such adolescence-specific processes are puberty and increases in reward sensitivity. Relations between these processes are poorly understood. The present study focused on examining unique effects of puberty, age, and sex on reward and threat sensitivities and volumes of subcortical brain structures relevant for reward/threat processing in a healthy sample of 9-18year-olds. Unlike age, pubertal status had a significant unique positive relationship with reward sensitivity. In addition, there was a trend for adolescent females to exhibit higher threat sensitivity with more advanced pubertal development and higher reward and threat sensitivity with older age. Similarly, there were significant puberty by sex interaction effects on striatal volumes, i.e., left nucleus accumbens and right pallidum. The present pattern of results suggests that pubertal development, independent of chronological age, is uniquely associated with reward hypersensitivity and with structural differences in striatal regions implicated in reward processing. Copyright © 2014 Elsevier Inc. All rights reserved.

  3. Neural basis of reward anticipation and its genetic determinants.

    PubMed

    Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J; Bokde, Arun L W; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J; Dove, Rachel; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Smolka, Michael N; Müller, Christian P; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

    2016-04-05

    Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature.

  4. Neural basis of reward anticipation and its genetic determinants

    PubMed Central

    Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A.; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J.; Bokde, Arun L. W.; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J.; Dove, Rachel; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A.; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Müller, Christian P.; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

    2016-01-01

    Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila. Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature. PMID:27001827

  5. A target sample of adolescents and reward processing: same neural and behavioral correlates engaged in common paradigms?

    PubMed

    Nees, Frauke; Vollstädt-Klein, Sabine; Fauth-Bühler, Mira; Steiner, Sabina; Mann, Karl; Poustka, Luise; Banaschewski, Tobias; Büchel, Christian; Conrod, Patricia J; Garavan, Hugh; Heinz, Andreas; Ittermann, Bernd; Artiges, Eric; Paus, Tomas; Pausova, Zdenka; Rietschel, Marcella; Smolka, Michael N; Struve, Maren; Loth, Eva; Schumann, Gunter; Flor, Herta

    2012-11-01

    Adolescence is a transition period that is assumed to be characterized by increased sensitivity to reward. While there is growing research on reward processing in adolescents, investigations into the engagement of brain regions under different reward-related conditions in one sample of healthy adolescents, especially in a target age group, are missing. We aimed to identify brain regions preferentially activated in a reaction time task (monetary incentive delay (MID) task) and a simple guessing task (SGT) in a sample of 14-year-old adolescents (N = 54) using two commonly used reward paradigms. Functional magnetic resonance imaging was employed during the MID with big versus small versus no win conditions and the SGT with big versus small win and big versus small loss conditions. Analyses focused on changes in blood oxygen level-dependent contrasts during reward and punishment processing in anticipation and feedback phases. We found clear magnitude-sensitive response in reward-related brain regions such as the ventral striatum during anticipation in the MID task, but not in the SGT. This was also true for reaction times. The feedback phase showed clear reward-related, but magnitude-independent, response patterns, for example in the anterior cingulate cortex, in both tasks. Our findings highlight neural and behavioral response patterns engaged in two different reward paradigms in one sample of 14-year-old healthy adolescents and might be important for reference in future studies investigating reward and punishment processing in a target age group.

  6. Brain substrates of reward processing and the μ-opioid receptor: a pathway into pain?

    PubMed

    Nees, Frauke; Becker, Susanne; Millenet, Sabina; Banaschewski, Tobias; Poustka, Luise; Bokde, Arun; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J; Desrivières, Sylvane; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Heinz, Andreas; Ittermann, Bernd; Martinot, Jean-Luc; Papadopoulos Orfanos, Dimitri; Paus, Tomáš; Smolka, Michael N; Walter, Henrik; Whelan, Rob; Schumann, Gunter; Flor, Herta

    2017-02-01

    The processing of reward and reinforcement learning seems to be important determinants of pain chronicity. However, reward processing is already altered early in life and if this is related to the development of pain symptoms later on is not known. The aim of this study was first to examine whether behavioural and brain-related indicators of reward processing at the age of 14 to 15 years are significant predictors of pain complaints 2 years later, at 16 to 17 years. Second, we investigated the contribution of genetic variations in the opioidergic system, which is linked to the processing of both, reward and pain, to this prediction. We used the monetary incentive delay task to assess reward processing, the Children's Somatization Inventory as measure of pain complaints and tested the effects of 2 single nucleotide polymorphisms (rs1799971/rs563649) of the human μ-opioid receptor gene. We found a significant prediction of pain complaints by responses in the dorsal striatum during reward feedback, independent of genetic predisposition. The relationship of pain complaints and activation in the periaqueductal gray and ventral striatum depended on the T-allele of rs563649. Carriers of this allele also showed more pain complaints than CC-allele carriers. Therefore, brain responses to reward outcomes and higher sensitivity to pain might be related already early in life and may thus set the course for pain complaints later in life, partly depending on a specific opioidergic genetic predisposition.

  7. Immaturities in Reward Processing and Its Influence on Inhibitory Control in Adolescence

    PubMed Central

    Terwilliger, R.; Teslovich, T.; Velanova, K.; Luna, B.

    2010-01-01

    The nature of immature reward processing and the influence of rewards on basic elements of cognitive control during adolescence are currently not well understood. Here, during functional magnetic resonance imaging, healthy adolescents and adults performed a modified antisaccade task in which trial-by-trial reward contingencies were manipulated. The use of a novel fast, event-related design enabled developmental differences in brain function underlying temporally distinct stages of reward processing and response inhibition to be assessed. Reward trials compared with neutral trials resulted in faster correct inhibitory responses across ages and in fewer inhibitory errors in adolescents. During reward trials, the blood oxygen level–dependent signal was attenuated in the ventral striatum in adolescents during cue assessment, then overactive during response preparation, suggesting limitations during adolescence in reward assessment and heightened reactivity in anticipation of reward compared with adults. Importantly, heightened activity in the frontal cortex along the precentral sulcus was also observed in adolescents during reward-trial response preparation, suggesting reward modulation of oculomotor control regions supporting correct inhibitory responding. Collectively, this work characterizes specific immaturities in adolescent brain systems that support reward processing and describes the influence of reward on inhibitory control. In sum, our findings suggest mechanisms that may underlie adolescents’ vulnerability to poor decision-making and risk-taking behavior. PMID:19875675

  8. Medial prefrontal brain activation to anticipated reward and loss in obsessive–compulsive disorder☆

    PubMed Central

    Kaufmann, C.; Beucke, J.C.; Preuße, F.; Endrass, T.; Schlagenhauf, F.; Heinz, A.; Juckel, G.; Kathmann, N.

    2013-01-01

    Obsessive–compulsive disorder (OCD) is associated with dysfunctional brain activity in several regions which are also involved in the processing of motivational stimuli. Processing of reward and punishment appears to be of special importance to understand clinical symptoms. There is evidence for higher sensitivity to punishment in patients with OCD which raises the question how avoidance of punishment relates to activity within the brain's reward circuitry. We employed the monetary incentive delay task paradigm optimized for modeling the anticipation phase of immediate reward and punishment, in the context of a cross-sectional event-related FMRI study comparing OCD patients and healthy control participants (n = 19 in each group). While overall behavioral performance was similar in both groups, patients showed increased activation upon anticipated losses in a medial and superior frontal cortex region extending into the cingulate cortex, and decreased activation upon anticipated rewards. No evidence was found for altered activation of dorsal or ventral striatal regions. Patients also showed more delayed responses for anticipated rewards than for anticipated losses whereas the reverse was true in healthy participants. The medial prefrontal cortex has been shown to implement a domain-general process comprising negative affect, pain and cognitive control. This process uses information about punishment to control aversively motivated actions by integrating signals arriving from subcortical regions. Our results support the notion that OCD is associated with altered sensitivity to anticipated rewards and losses in a medial prefrontal region whereas there is no significant aberrant activation in ventral or dorsal striatal brain regions during processing of reinforcement anticipation. PMID:24179774

  9. Medial prefrontal brain activation to anticipated reward and loss in obsessive-compulsive disorder.

    PubMed

    Kaufmann, C; Beucke, J C; Preuße, F; Endrass, T; Schlagenhauf, F; Heinz, A; Juckel, G; Kathmann, N

    2013-01-01

    Obsessive-compulsive disorder (OCD) is associated with dysfunctional brain activity in several regions which are also involved in the processing of motivational stimuli. Processing of reward and punishment appears to be of special importance to understand clinical symptoms. There is evidence for higher sensitivity to punishment in patients with OCD which raises the question how avoidance of punishment relates to activity within the brain's reward circuitry. We employed the monetary incentive delay task paradigm optimized for modeling the anticipation phase of immediate reward and punishment, in the context of a cross-sectional event-related FMRI study comparing OCD patients and healthy control participants (n = 19 in each group). While overall behavioral performance was similar in both groups, patients showed increased activation upon anticipated losses in a medial and superior frontal cortex region extending into the cingulate cortex, and decreased activation upon anticipated rewards. No evidence was found for altered activation of dorsal or ventral striatal regions. Patients also showed more delayed responses for anticipated rewards than for anticipated losses whereas the reverse was true in healthy participants. The medial prefrontal cortex has been shown to implement a domain-general process comprising negative affect, pain and cognitive control. This process uses information about punishment to control aversively motivated actions by integrating signals arriving from subcortical regions. Our results support the notion that OCD is associated with altered sensitivity to anticipated rewards and losses in a medial prefrontal region whereas there is no significant aberrant activation in ventral or dorsal striatal brain regions during processing of reinforcement anticipation.

  10. Pervasive competition between threat and reward in the brain.

    PubMed

    Choi, Jong Moon; Padmala, Srikanth; Spechler, Philip; Pessoa, Luiz

    2014-06-01

    In the current functional MRI study, we investigated interactions between reward and threat processing. Visual cues at the start of each trial informed participants about the chance of winning monetary reward and/or receiving a mild aversive shock. We tested two competing hypothesis: according to the 'salience hypothesis', in the condition involving both reward and threat, enhanced activation would be observed because of increased salience; according to the 'competition hypothesis', the processing of reward and threat would trade-off against each other, leading to reduced activation. Analysis of skin conductance data during a delay phase revealed an interaction between reward and threat processing, such that the effect of reward was reduced during threat and the effect of threat was reduced during reward. Analysis of imaging data during the same task phase revealed interactions between reward and threat processing in several regions, including the midbrain/ventral tegmental area, caudate, putamen, bed nucleus of the stria terminalis, anterior insula, middle frontal gyrus and dorsal anterior cingulate cortex. Taken together, our findings reveal conditions during which reward and threat trade-off against each other across multiple sites. Such interactions are suggestive of competitive processes and may reflect the organization of opponent systems in the brain. © The Author (2013). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  11. Independent functional connectivity networks underpin food and monetary reward sensitivity in excess weight.

    PubMed

    Verdejo-Román, Juan; Fornito, Alex; Soriano-Mas, Carles; Vilar-López, Raquel; Verdejo-García, Antonio

    2017-02-01

    Overvaluation of palatable food is a primary driver of obesity, and is associated with brain regions of the reward system. However, it remains unclear if this network is specialized in food reward, or generally involved in reward processing. We used functional magnetic resonance imaging (fMRI) to characterize functional connectivity during processing of food and monetary rewards. Thirty-nine adults with excess weight and 37 adults with normal weight performed the Willingness to Pay for Food task and the Monetary Incentive Delay task in the fMRI scanner. A data-driven graph approach was applied to compare whole-brain, task-related functional connectivity between groups. Excess weight was associated with decreased functional connectivity during the processing of food rewards in a network involving primarily frontal and striatal areas, and increased functional connectivity during the processing of monetary rewards in a network involving principally frontal and parietal areas. These two networks were topologically and anatomically distinct, and were independently associated with BMI. The processing of food and monetary rewards involve segregated neural networks, and both are altered in individuals with excess weight. Copyright © 2016 Elsevier Inc. All rights reserved.

  12. Cerebral interactions of pain and reward and their relevance for chronic pain.

    PubMed

    Becker, Susanne; Gandhi, Wiebke; Schweinhardt, Petra

    2012-06-29

    Pain and reward are opponent, interacting processes. Such interactions are enabled by neuroanatomical and neurochemical overlaps of brain systems that process pain and reward. Cerebral processing of hedonic ('liking') and motivational ('wanting') aspects of reward can be separated: the orbitofrontal cortex and opioids play an important role for the hedonic experience, and the ventral striatum and dopamine predominantly process motivation for reward. Supported by neuroimaging studies, we present here the hypothesis that the orbitofrontal cortex and opioids are responsible for pain modulation by hedonic experience, while the ventral striatum and dopamine mediate motivational effects on pain. A rewarding stimulus that appears to be particularly important in the context of pain is pain relief. Further, reward, including pain relief, leads to operant learning, which can affect pain sensitivity. Indirect evidence points at brain mechanisms that might underlie pain relief as a reward and related operant learning but studies are scarce. Investigating the cerebral systems underlying pain-reward interactions as well as related operant learning holds the potential of better understanding mechanisms that contribute to the development and maintenance of chronic pain, as detailed in the last section of this review. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

  13. Encoding of Vicarious Reward Prediction in Anterior Cingulate Cortex and Relationship with Trait Empathy

    PubMed Central

    Apps, Matthew A.J.; Roiser, Jonathan P.; Viding, Essi

    2015-01-01

    Empathy—the capacity to understand and resonate with the experiences of others—can depend on the ability to predict when others are likely to receive rewards. However, although a plethora of research has examined the neural basis of predictions about the likelihood of receiving rewards ourselves, very little is known about the mechanisms that underpin variability in vicarious reward prediction. Human neuroimaging and nonhuman primate studies suggest that a subregion of the anterior cingulate cortex in the gyrus (ACCg) is engaged when others receive rewards. Does the ACCg show specialization for processing predictions about others' rewards and not one's own and does this specialization vary with empathic abilities? We examined hemodynamic responses in the human brain time-locked to cues that were predictive of a high or low probability of a reward either for the subject themselves or another person. We found that the ACCg robustly signaled the likelihood of a reward being delivered to another. In addition, ACCg response significantly covaried with trait emotion contagion, a necessary foundation for empathizing with other individuals. In individuals high in emotion contagion, the ACCg was specialized for processing others' rewards exclusively, but for those low in emotion contagion, this region also responded to information about the subject's own rewards. Our results are the first to show that the ACCg signals probabilistic predictions about rewards for other people and that the substantial individual variability in the degree to which the ACCg is specialized for processing others' rewards is related to trait empathy. SIGNIFICANCE STATEMENT Successfully cooperating, competing, or empathizing with others can depend on our ability to predict when others are going to get something rewarding. Although many studies have examined how the brain processes rewards we will get ourselves, very little is known about vicarious reward processing. Here, we show that a subregion of the anterior cingulate cortex in the gyrus (ACCg) shows a degree of specialization for processing others' versus one's own rewards. However, the degree to which the ACCg is specialized varies with people's ability to empathize with others. This new insight into how vicarious rewards are processed in the brain and vary with empathy may be key for understanding disorders of social behavior, including psychopathy and autism. PMID:26446224

  14. Elevated cognitive control over reward processing in recovered female patients with anorexia nervosa.

    PubMed

    Ehrlich, Stefan; Geisler, Daniel; Ritschel, Franziska; King, Joseph A; Seidel, Maria; Boehm, Ilka; Breier, Marion; Clas, Sabine; Weiss, Jessika; Marxen, Michael; Smolka, Michael N; Roessner, Veit; Kroemer, Nils B

    2015-09-01

    Individuals with anorexia nervosa are thought to exert excessive self-control to inhibit primary drives. This study used functional MRI (fMRI) to interrogate interactions between the neural correlates of cognitive control and motivational processes in the brain reward system during the anticipation of monetary reward and reward-related feedback. In order to avoid confounding effects of undernutrition, we studied female participants recovered from anorexia nervosa and closely matched healthy female controls. The fMRI analysis (including node-to-node functional connectivity) followed a region of interest approach based on models of the brain reward system and cognitive control regions implicated in anorexia nervosa: the ventral striatum, medial orbitofrontal cortex (mOFC) and dorsolateral prefrontal cortex (DLPFC). We included 30 recovered patients and 30 controls in our study. There were no behavioural differences and no differences in hemodynamic responses of the ventral striatum and the mOFC in the 2 phases of the task. However, relative to controls, recovered patients showed elevated DLPFC activity during the anticipation phase, failed to deactivate this region during the feedback phase and displayed greater functional coupling between the DLPFC and mOFC. Recovered patients also had stronger associations than controls between anticipation-related DLPFC responses and instrumental responding. The results we obtained using monetary stimuli might not generalize to other forms of reward. Unaltered neural responses in ventral limbic reward networks but increased recruitment of and connectivity with lateral-frontal brain circuitry in recovered patients suggests an elevated degree of selfregulatory processes in response to rewarding stimuli. An imbalance between brain systems subserving bottom-up and top-down processes may be a trait marker of the disorder.

  15. Monetary reward magnitude effects on behavior and brain function during goal-directed behavior.

    PubMed

    Rosell-Negre, P; Bustamante, J C; Fuentes-Claramonte, P; Costumero, V; Benabarre, S; Barrós-Loscertales, A

    2017-08-01

    Reward may modulate the cognitive processes required for goal achievement, while individual differences in personality may affect reward modulation. Our aim was to test how different monetary reward magnitudes modulate brain activation and performance during goal-directed behavior, and whether individual differences in reward sensitivity affect this modulation. For this purpose, we scanned 37 subjects with a parametric design in which we varied the magnitude of monetary rewards (€0, €0.01, €0.5, €1 or €1.5) in a blocked fashion while participants performed an interference counting-Stroop condition. The results showed that the brain activity of left dorsolateral prefrontal cortex (DLPFC) and the striatum were modulated by increasing and decreasing reward magnitudes, respectively. Behavioral performance improved as the magnitude of monetary reward increased while comparing the non reward (€0) condition to any other reward condition, or the lower €0.01 to any other reward condition, and this improvement was related with individual differences in reward sensitivity. In conclusion, the locus of influence of monetary incentives overlaps the activity of the regions commonly involved in cognitive control.

  16. Tentative Evidence for Striatal Hyperactivity in Adolescent Cannabis Using Boys: A Cross-Sectional Multicenter fMRI Study

    PubMed Central

    Jager, Gerry; Block, Robert I.; Luijten, Maartje; Ramsey, Nick F.

    2013-01-01

    Adolescents' risk-taking behavior has been linked to a maturational imbalance between reward (“go”) and inhibitory-control (“stop”) related brain circuitry. This may drive adolescent drug-taking, such as cannabis use. In this study we assessed the non-acute effects of adolescent cannabis use on reward-related brain function. We performed a two-site (United States and Netherlands; pooled data) functional magnetic resonance imaging (fMRI) study with a cross-sectional design. Twenty-one abstinent but frequent cannabis-using boys were compared with 24 non-using peers on reward-related brain function, using a monetary incentive delay task with fMRI. Focus was on anticipatory and response stages of reward and brain areas critically involved in reward processing like the striatum. Performance in users was normal. Region-of-interest analysis indicated striatal hyperactivity during anticipatory stages of reward in users. Intriguingly, this effect was most pronounced during non-rewarding events. Striatal hyperactivity in adolescent cannabis users may signify an overly sensitive motivational brain circuitry. Frequent cannabis use during adolescence may induce diminished ability to disengage the motivational circuit when no reward can be obtained. This could strengthen the search for reinforcements like drugs of abuse, even when facing the negative (non-rewarding) consequences. PMID:23909003

  17. Tentative evidence for striatal hyperactivity in adolescent cannabis-using boys: a cross-sectional multicenter fMRI study.

    PubMed

    Jager, Gerry; Block, Robert I; Luijten, Maartje; Ramsey, Nick F

    2013-01-01

    Adolescents' risk-taking behavior has been linked to a maturational imbalance between reward ("go") and inhibitory-control ("stop")-related brain circuitry. This may drive adolescent drug-taking, such as cannabis use. In this study, we assessed the non-acute effects of adolescent cannabis use on reward-related brain function. We performed a two-site (United States and Netherlands; pooled data) functional magnetic resonance imaging (fMRI) study with a cross-sectional design. Twenty-one abstinent but frequent cannabis-using boys were compared with 24 non-using peers on reward-related brain function, using a monetary incentive delay task with fMRI. Focus was on anticipatory and response stages of reward and brain areas critically involved in reward processing like the striatum. Performance in users was normal. Region-of-interest analysis indicated striatal hyperactivity during anticipatory stages of reward in users. Intriguingly, this effect was most pronounced during non-rewarding events. Striatal hyperactivity in adolescent cannabis users may signify an overly sensitive motivational brain circuitry. Frequent cannabis use during adolescence may induce diminished ability to disengage the motivational circuit when no reward can be obtained. This could strengthen the search for reinforcements like drugs of abuse, even when facing the negative (non-rewarding) consequences.

  18. ADHD Related Behaviors Are Associated with Brain Activation in the Reward System

    ERIC Educational Resources Information Center

    Stark, R.; Bauer, E.; Merz, C. J.; Zimmermann, M.; Reuter, M.; Plichta, M. M.; Kirsch, P.; Lesch, K. P.; Fallgatter, A. J.; Vaitl, D.; Herrmann, M. J.

    2011-01-01

    Neuroimaging studies on attention-deficit/hyperactivity disorder (ADHD) suggest dysfunctional reward processing, with hypo-responsiveness during reward anticipation in the reward system including the nucleus accumbens (NAcc). In this study, we investigated the association between ADHD related behaviors and the reward system using functional…

  19. Oxytocin curbs calorie intake via food-specific increases in the activity of brain areas that process reward and establish cognitive control.

    PubMed

    Spetter, Maartje S; Feld, Gordon B; Thienel, Matthias; Preissl, Hubert; Hege, Maike A; Hallschmid, Manfred

    2018-02-09

    The hypothalamic neurohormone oxytocin decreases food intake via largely unexplored mechanisms. We investigated the central nervous mediation of oxytocin's hypophagic effect in comparison to its impact on the processing of generalized rewards. Fifteen fasted normal-weight, young men received intranasal oxytocin (24 IU) or placebo before functional magnetic resonance imaging (fMRI) measurements of brain activity during exposure to food stimuli and a monetary incentive delay task (MID). Subsequently, ad-libitum breakfast intake was assessed. Oxytocin compared to placebo increased activity in the ventromedial prefrontal cortex, supplementary motor area, anterior cingulate, and ventrolateral prefrontal cortices in response to high- vs. low-calorie food images in the fasted state, and reduced calorie intake by 12%. During anticipation of monetary rewards, oxytocin compared to placebo augmented striatal, orbitofrontal and insular activity without altering MID performance. We conclude that during the anticipation of generalized rewards, oxytocin stimulates dopaminergic reward-processing circuits. In contrast, oxytocin restrains food intake by enhancing the activity of brain regions that exert cognitive control, while concomitantly increasing the activity of structures that process food reward value. This pattern points towards a specific role of oxytocin in the regulation of eating behaviour in humans that might be of relevance for potential clinical applications.

  20. Goal-Directed and Habit-Like Modulations of Stimulus Processing during Reinforcement Learning.

    PubMed

    Luque, David; Beesley, Tom; Morris, Richard W; Jack, Bradley N; Griffiths, Oren; Whitford, Thomas J; Le Pelley, Mike E

    2017-03-15

    Recent research has shown that perceptual processing of stimuli previously associated with high-value rewards is automatically prioritized even when rewards are no longer available. It has been hypothesized that such reward-related modulation of stimulus salience is conceptually similar to an "attentional habit." Recording event-related potentials in humans during a reinforcement learning task, we show strong evidence in favor of this hypothesis. Resistance to outcome devaluation (the defining feature of a habit) was shown by the stimulus-locked P1 component, reflecting activity in the extrastriate visual cortex. Analysis at longer latencies revealed a positive component (corresponding to the P3b, from 550-700 ms) sensitive to outcome devaluation. Therefore, distinct spatiotemporal patterns of brain activity were observed corresponding to habitual and goal-directed processes. These results demonstrate that reinforcement learning engages both attentional habits and goal-directed processes in parallel. Consequences for brain and computational models of reinforcement learning are discussed. SIGNIFICANCE STATEMENT The human attentional network adapts to detect stimuli that predict important rewards. A recent hypothesis suggests that the visual cortex automatically prioritizes reward-related stimuli, driven by cached representations of reward value; that is, stimulus-response habits. Alternatively, the neural system may track the current value of the predicted outcome. Our results demonstrate for the first time that visual cortex activity is increased for reward-related stimuli even when the rewarding event is temporarily devalued. In contrast, longer-latency brain activity was specifically sensitive to transient changes in reward value. Therefore, we show that both habit-like attention and goal-directed processes occur in the same learning episode at different latencies. This result has important consequences for computational models of reinforcement learning. Copyright © 2017 the authors 0270-6474/17/373009-09$15.00/0.

  1. Influence of ventral tegmental area input on cortico-subcortical networks underlying action control and decision making.

    PubMed

    Richter, Anja; Gruber, Oliver

    2018-02-01

    It is argued that the mesolimbic system has a more general function in processing all salient events, including and extending beyond rewards. Saliency was defined as an event that is unexpected due to its frequency of occurrence and elicits an attentional-behavioral switch. Using functional magnetic resonance imaging (fMRI), signals were measured in response to the modulation of salience of rewarding and nonrewarding events during a reward-based decision making task, the so called desire-reason dilemma paradigm (DRD). Replicating previous findings, both frequent and infrequent, and therefore salient, reward stimuli elicited reliable activation of the ventral tegmental area (VTA) and ventral striatum (vStr). When immediate reward desiring contradicted the superordinate task-goal, we found an increased activation of the VTA and vStr when the salient reward stimuli were presented compared to the nonsalient reward stimuli, indicating a boosting of activation in these brain regions. Furthermore, we found a significantly increased functional connectivity between the VTA and vStr, confirming the boosting of vStr activation via VTA input. Moreover, saliency per se without a reward association led to an increased activation of brain regions in the mesolimbic reward system as well as the orbitofrontal cortex (OFC), inferior frontal gyrus (IFG), and anterior cingulate cortex (ACC). Finally, findings uncovered multiple increased functional interactions between cortical saliency-processing brain areas and the VTA and vStr underlying detection and processing of salient events and adaptive decision making. © 2017 Wiley Periodicals, Inc.

  2. Reward skewness coding in the insula independent of probability and loss

    PubMed Central

    Tobler, Philippe N.

    2011-01-01

    Rewards in the natural environment are rarely predicted with complete certainty. Uncertainty relating to future rewards has typically been defined as the variance of the potential outcomes. However, the asymmetry of predicted reward distributions, known as skewness, constitutes a distinct but neuroscientifically underexplored risk term that may also have an impact on preference. By changing only reward magnitudes, we study skewness processing in equiprobable ternary lotteries involving only gains and constant probabilities, thus excluding probability distortion or loss aversion as mechanisms for skewness preference formation. We show that individual preferences are sensitive to not only the mean and variance but also to the skewness of predicted reward distributions. Using neuroimaging, we show that the insula, a structure previously implicated in the processing of reward-related uncertainty, responds to the skewness of predicted reward distributions. Some insula responses increased in a monotonic fashion with skewness (irrespective of individual skewness preferences), whereas others were similarly elevated to both negative and positive as opposed to no reward skew. These data support the notion that the asymmetry of reward distributions is processed in the brain and, taken together with replicated findings of mean coding in the striatum and variance coding in the cingulate, suggest that the brain codes distinct aspects of reward distributions in a distributed fashion. PMID:21849610

  3. Music and the nucleus accumbens.

    PubMed

    Mavridis, Ioannis N

    2015-03-01

    Music is a universal feature of human societies over time, mainly because it allows expression and regulation of strong emotions, thus influencing moods and evoking pleasure. The nucleus accumbens (NA), the most important pleasure center of the human brain (dominates the reward system), is the 'king of neurosciences' and dopamine (DA) can be rightfully considered as its 'crown' due to the fundamental role that this neurotransmitter plays in the brain's reward system. Purpose of this article was to review the existing literature regarding the relation between music and the NA. Studies have shown that reward value for music can be coded by activity levels in the NA, whose functional connectivity with auditory and frontal areas increases as a function of increasing musical reward. Listening to music strongly modulates activity in a network of mesolimbic structures involved in reward processing including the NA. The functional connectivity between brain regions mediating reward, autonomic and cognitive processing provides insight into understanding why listening to music is one of the most rewarding and pleasurable human experiences. Musical stimuli can significantly increase extracellular DA levels in the NA. NA DA and serotonin were found significantly higher in animals exposed to music. Finally, passive listening to unfamiliar although liked music showed activations in the NA.

  4. The impact of junk foods on the adolescent brain.

    PubMed

    Reichelt, Amy C; Rank, Michelle M

    2017-12-01

    Adolescence is a significant period of physical, social, and emotional development, and is characterized by prominent neurobiological changes in the brain. The maturational processes that occur in brain regions responsible for cognitive control and reward seeking may underpin excessive consumption of palatable high fat and high sugar "junk" foods during adolescence. Recent studies have highlighted the negative impact of these foods on brain function, resulting in cognitive impairments and altered reward processing. The increased neuroplasticity during adolescence may render the brain vulnerable to the negative effects of these foods on cognition and behavior. In this review, we describe the mechanisms by which junk food diets influence neurodevelopment during adolescence. Diet can lead to alterations in dopamine-mediated reward signaling, and inhibitory neurotransmission controlled by γ-aminobutyric acid (GABA), two major neurotransmitter systems that are under construction across adolescence. We propose that poor dietary choices may derail the normal adolescent maturation process and influence neurodevelopmental trajectories, which can predispose individuals to dysregulated eating and impulsive behaviors. © 2017 Wiley Periodicals, Inc.

  5. Brain reward system's alterations in response to food and monetary stimuli in overweight and obese individuals.

    PubMed

    Verdejo-Román, Juan; Vilar-López, Raquel; Navas, Juan F; Soriano-Mas, Carles; Verdejo-García, Antonio

    2017-02-01

    The brain's reward system is crucial to understand obesity in modern society, as increased neural responsivity to reward can fuel the unhealthy food choices that are driving the growing obesity epidemic. Brain's reward system responsivity to food and monetary rewards in individuals with excessive weight (overweight and obese) versus normal weight controls, along with the relationship between this responsivity and body mass index (BMI) were tested. The sample comprised 21 adults with obesity (BMI > 30), 21 with overweight (BMI between 25 and 30), and 39 with normal weight (BMI < 25). Participants underwent a functional magnetic resonance imaging (fMRI) session while performing two tasks that involve the processing of food (Willing to Pay) and monetary rewards (Monetary Incentive Delay). Neural activations within the brain reward system were compared across the three groups. Curve fit analyses were conducted to establish the association between BMI and brain reward system's response. Individuals with obesity had greater food-evoked responsivity in the dorsal and ventral striatum compared with overweight and normal weight groups. There was an inverted U-shape association between BMI and monetary-evoked responsivity in the ventral striatum, medial frontal cortex, and amygdala; that is, individuals with BMIs between 27 and 32 had greater responsivity to monetary stimuli. Obesity is associated with greater food-evoked responsivity in the ventral and dorsal striatum, and overweight is associated with greater monetary-evoked responsivity in the ventral striatum, the amygdala, and the medial frontal cortex. Findings suggest differential reactivity of the brain's reward system to food versus monetary rewards in obesity and overweight. Hum Brain Mapp 38:666-677, 2017. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

  6. Reduced cerebellar brain activity during reward processing in adolescent binge drinkers

    PubMed Central

    Cservenka, Anita; Jonesb, Scott A.; Nagel, Bonnie J.

    2015-01-01

    Due to ongoing development, adolescence may be a period of heightened vulnerability to the neurotoxic effects of alcohol. Binge drinking may alter reward-driven behavior and neurocircuitry, thereby increasing risk for escalating alcohol use. Therefore, we compared reward processing in adolescents with and without a history of recent binge drinking. At their baseline study visit, all participants (age = 14.86 ± 0.88) were free of heavy alcohol use and completed a modified version of the Wheel of Fortune (WOF) functional magnetic resonance imaging task. Following this visit, 17 youth reported binge drinking on ≥3 occasions within a 90 day period and were matched to 17 youth who remained alcohol and substance-naïve. All participants repeated the WOF task during a second visit (age = 16.83 ± 1.22). No significant effects were found in a region of interest analysis of the ventral striatum, but whole-brain analyses showed significant group differences in reward response at the second study visit in the left cerebellum, controlling for baseline visit brain activity (p/α<0.05), which was negatively correlated with mean number of drinks consumed/drinking day in the last 90 days. These findings suggest that binge drinking during adolescence may alter brain activity during reward processing in a dose-dependent manner. PMID:26190276

  7. Hemispheric dissociation of reward processing in humans: insights from deep brain stimulation.

    PubMed

    Palminteri, Stefano; Serra, Giulia; Buot, Anne; Schmidt, Liane; Welter, Marie-Laure; Pessiglione, Mathias

    2013-01-01

    Rewards have various effects on human behavior and multiple representations in the human brain. Behaviorally, rewards notably enhance response vigor in incentive motivation paradigms and bias subsequent choices in instrumental learning paradigms. Neurally, rewards affect activity in different fronto-striatal regions attached to different motor effectors, for instance in left and right hemispheres for the two hands. Here we address the question of whether manipulating reward-related brain activity has local or general effects, with respect to behavioral paradigms and motor effectors. Neuronal activity was manipulated in a single hemisphere using unilateral deep brain stimulation (DBS) in patients with Parkinson's disease. Results suggest that DBS amplifies the representation of reward magnitude within the targeted hemisphere, so as to affect the behavior of the contralateral hand specifically. These unilateral DBS effects on behavior include both boosting incentive motivation and biasing instrumental choices. Furthermore, using computational modeling we show that DBS effects on incentive motivation can predict DBS effects on instrumental learning (or vice versa). Thus, we demonstrate the feasibility of causally manipulating reward-related neuronal activity in humans, in a manner that is specific to a class of motor effectors but that generalizes to different computational processes. As these findings proved independent from therapeutic effects on parkinsonian motor symptoms, they might provide insight into DBS impact on non-motor disorders, such as apathy or hypomania. Copyright © 2013 Elsevier Ltd. All rights reserved.

  8. Neuronal and oscillatory activity during reward processing in the human ventral striatum.

    PubMed

    Lega, Bradley C; Kahana, Michael J; Jaggi, Jurg; Baltuch, Gordon H; Zaghloul, Kareem

    2011-11-16

    Accumulated evidence from animal studies implicates the ventral striatum in the processing of reward information. Recently, deep brain stimulation (DBS) surgery has enabled researchers to analyze neurophysiological recordings from humans engaged in reward tasks. We present data recorded from the human ventral striatum during deep brain stimulation surgery as a participant played a video game coupled to the receipt of visual reward images. To our knowledge, we identify the first instances of reward-sensitive single unit activity in the human ventral striatum. Local field potential data suggest that alpha oscillations are sensitive to positive feedback, whereas beta oscillations exhibit significantly higher power during unrewarded trials. We report evidence of alpha-gamma cross-frequency coupling that differentiates between positive and negative feedback. © 2011 Wolters Kluwer Health | Lippincott Williams & Wilkins.

  9. Addiction and the brain antireward system.

    PubMed

    Koob, George F; Le Moal, Michel

    2008-01-01

    A neurobiological model of the brain emotional systems has been proposed to explain the persistent changes in motivation that are associated with vulnerability to relapse in addiction, and this model may generalize to other psychopathology associated with dysregulated motivational systems. In this framework, addiction is conceptualized as a cycle of decreased function of brain reward systems and recruitment of antireward systems that progressively worsen, resulting in the compulsive use of drugs. Counteradaptive processes, such as opponent process, that are part of the normal homeostatic limitation of reward function fail to return within the normal homeostatic range and are hypothesized to repeatedly drive the allostatic state. Excessive drug taking thus results in not only the short-term amelioration of the reward deficit but also suppression of the antireward system. However, in the long term, there is worsening of the underlying neurochemical dysregulations that ultimately form an allostatic state (decreased dopamine and opioid peptide function, increased corticotropin-releasing factor activity). This allostatic state is hypothesized to be reflected in a chronic deviation of reward set point that is fueled not only by dysregulation of reward circuits per se but also by recruitment of brain and hormonal stress responses. Vulnerability to addiction may involve genetic comorbidity and developmental factors at the molecular, cellular, or neurocircuitry levels that sensitize the brain antireward systems.

  10. Neural markers of social and monetary rewards in children with Attention-Deficit/Hyperactivity Disorder and Autism Spectrum Disorder.

    PubMed

    Gonzalez-Gadea, Maria Luz; Sigman, Mariano; Rattazzi, Alexia; Lavin, Claudio; Rivera-Rei, Alvaro; Marino, Julian; Manes, Facundo; Ibanez, Agustin

    2016-07-28

    Recent theories of decision making propose a shared value-related brain mechanism for encoding monetary and social rewards. We tested this model in children with Attention-Deficit/Hyperactivity Disorder (ADHD), children with Autism Spectrum Disorder (ASD) and control children. We monitored participants' brain dynamics using high density-electroencephalography while they played a monetary and social reward tasks. Control children exhibited a feedback Error-Related Negativity (fERN) modulation and Anterior Cingulate Cortex (ACC) source activation during both tasks. Remarkably, although cooperation resulted in greater losses for the participants, the betrayal options generated greater fERN responses. ADHD subjects exhibited an absence of fERN modulation and reduced ACC activation during both tasks. ASD subjects exhibited normal fERN modulation during monetary choices and inverted fERN/ACC responses in social options than did controls. These results suggest that in neurotypicals, monetary losses and observed disloyal social decisions induced similar activity in the brain value system. In ADHD children, difficulties in reward processing affected early brain signatures of monetary and social decisions. Conversely, ASD children showed intact neural markers of value-related monetary mechanisms, but no brain modulation by prosociality in the social task. These results offer insight into the typical and atypical developments of neural correlates of monetary and social reward processing.

  11. Time-of-day differences and short-term stability of the neural response to monetary reward: a pilot study.

    PubMed

    Hasler, Brant P; Forbes, Erika E; Franzen, Peter L

    2014-10-30

    Human and animal studies indicate that reward function is modulated by the circadian clock that governs our daily sleep/wake rhythm. For example, a robust circadian rhythm exists in positive affect, which is lower in the morning hours and peaks in the afternoon. A handful of functional neuroimaging studies suggest that systematic diurnal variation exists in brain activity related to other functions, but no published human studies have examined daily variation in the neural processing of reward. In the present study, we attempt to advance this literature by using functional neuroimaging methods to examine time-of-day changes in the responsivity of the reward circuit. Using a within-person design and a functional magnetic resonance imaging (fMRI) monetary reward task, we compared morning and afternoon reward-related brain activation in a sample of healthy young adults within 24h. Region of interest analyses focused on the striatum, and we hypothesized greater reward activation in the afternoon, concordant with the circadian peak in positive affect. Results were consistent with our hypothesis. In addition, we counterbalanced the order of morning and afternoon scans in order to explore the short-term stability of the neural response. Whole-brain analyses showed a markedly higher reactivity to reward throughout the brain in the first scan relative to the second scan, consistent with habituation to the monetary reward stimuli. However, these effects did not appear to explain the time-of-day findings. In summary, we report the first preliminary evidence of circadian variation in the neural processing of reward. These findings have both methodological and theoretical implications. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

  12. How feedback, motor imagery, and reward influence brain self-regulation using real-time fMRI.

    PubMed

    Sepulveda, Pradyumna; Sitaram, Ranganatha; Rana, Mohit; Montalba, Cristian; Tejos, Cristian; Ruiz, Sergio

    2016-09-01

    The learning process involved in achieving brain self-regulation is presumed to be related to several factors, such as type of feedback, reward, mental imagery, duration of training, among others. Explicitly instructing participants to use mental imagery and monetary reward are common practices in real-time fMRI (rtfMRI) neurofeedback (NF), under the assumption that they will enhance and accelerate the learning process. However, it is still not clear what the optimal strategy is for improving volitional control. We investigated the differential effect of feedback, explicit instructions and monetary reward while training healthy individuals to up-regulate the blood-oxygen-level dependent (BOLD) signal in the supplementary motor area (SMA). Four groups were trained in a two-day rtfMRI-NF protocol: GF with NF only, GF,I with NF + explicit instructions (motor imagery), GF,R with NF + monetary reward, and GF,I,R with NF + explicit instructions (motor imagery) + monetary reward. Our results showed that GF increased significantly their BOLD self-regulation from day-1 to day-2 and GF,R showed the highest BOLD signal amplitude in SMA during the training. The two groups who were instructed to use motor imagery did not show a significant learning effect over the 2 days. The additional factors, namely motor imagery and reward, tended to increase the intersubject variability in the SMA during the course of training. Whole brain univariate and functional connectivity analyses showed common as well as distinct patterns in the four groups, representing the varied influences of feedback, reward, and instructions on the brain. Hum Brain Mapp 37:3153-3171, 2016. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

  13. Neural dissociation of food- and money-related reward processing using an abstract incentive delay task.

    PubMed

    Simon, Joe J; Skunde, Mandy; Wu, Mudan; Schnell, Knut; Herpertz, Sabine C; Bendszus, Martin; Herzog, Wolfgang; Friederich, Hans-Christoph

    2015-08-01

    Food is an innate reward stimulus related to energy homeostasis and survival, whereas money is considered a more general reward stimulus that gains a rewarding value through learning experiences. Although the underlying neural processing for both modalities of reward has been investigated independently from one another, a more detailed investigation of neural similarities and/or differences between food and monetary reward is still missing. Here, we investigated the neural processing of food compared with monetary-related rewards in 27 healthy, normal-weight women using functional magnetic resonance imaging. We developed a task distinguishing between the anticipation and the receipt of either abstract food or monetary reward. Both tasks activated the ventral striatum during the expectation of a reward. Compared with money, greater food-related activations were observed in prefrontal, parietal and central midline structures during the anticipation and lateral orbitofrontal cortex (lOFC) during the receipt of food reward. Furthermore, during the receipt of food reward, brain activation in the secondary taste cortex was positively related to the body mass index. These results indicate that food-dependent activations encompass to a greater extent brain regions involved in self-control and self-reflection during the anticipation and phylogenetically older parts of the lOFC during the receipt of reward. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  14. Natural Rewards, Neuroplasticity, and Non-Drug Addictions

    PubMed Central

    Olsen, Christopher M.

    2011-01-01

    There is a high degree of overlap between brain regions involved in processing natural rewards and drugs of abuse. “Non-drug” or “behavioral” addictions have become increasingly documented in the clinic, and pathologies include compulsive activities such as shopping, eating, exercising, sexual behavior, and gambling. Like drug addiction, non-drug addictions manifest in symptoms including craving, impaired control over the behavior, tolerance, withdrawal, and high rates of relapse. These alterations in behavior suggest that plasticity may be occurring in brain regions associated with drug addiction. In this review, I summarize data demonstrating that exposure to non-drug rewards can alter neural plasticity in regions of the brain that are affected by drugs of abuse. Research suggests that there are several similarities between neuroplasticity induced by natural and drug rewards and that, depending on the reward, repeated exposure to natural rewards might induce neuroplasticity that either promotes or counteracts addictive behavior. PMID:21459101

  15. High temporal discounters overvalue immediate rewards rather than undervalue future rewards: an event-related brain potential study.

    PubMed

    Cherniawsky, Avital S; Holroyd, Clay B

    2013-03-01

    Impulsivity is characterized in part by heightened sensitivity to immediate relative to future rewards. Although previous research has suggested that "high discounters" in intertemporal choice tasks tend to prefer immediate over future rewards because they devalue the latter, it remains possible that they instead overvalue immediate rewards. To investigate this question, we recorded the reward positivity, a component of the event-related brain potential (ERP) associated with reward processing, with participants engaged in a task in which they received both immediate and future rewards and nonrewards. The participants also completed a temporal discounting task without ERP recording. We found that immediate but not future rewards elicited the reward positivity. High discounters also produced larger reward positivities to immediate rewards than did low discounters, indicating that high discounters relatively overvalued immediate rewards. These findings suggest that high discounters may be more motivated than low discounters to work for monetary rewards, irrespective of the time of arrival of the incentives.

  16. The effects of intranasal oxytocin on reward circuitry responses in children with autism spectrum disorder.

    PubMed

    Greene, R K; Spanos, M; Alderman, C; Walsh, E; Bizzell, J; Mosner, M G; Kinard, J L; Stuber, G D; Chandrasekhar, T; Politte, L C; Sikich, L; Dichter, G S

    2018-03-27

    Intranasal oxytocin (OT) has been shown to improve social communication functioning of individuals with autism spectrum disorder (ASD) and, thus, has received considerable interest as a potential ASD therapeutic agent. Although preclinical research indicates that OT modulates the functional output of the mesocorticolimbic dopamine system that processes rewards, no clinical brain imaging study to date has examined the effects of OT on this system using a reward processing paradigm. To address this, we used an incentive delay task to examine the effects of a single dose of intranasal OT, versus placebo (PLC), on neural responses to social and nonsocial rewards in children with ASD. In this placebo-controlled double-blind study, 28 children and adolescents with ASD (age: M = 13.43 years, SD = 2.36) completed two fMRI scans, one after intranasal OT administration and one after PLC administration. During both scanning sessions, participants completed social and nonsocial incentive delay tasks. Task-based neural activation and connectivity were examined to assess the impact of OT relative to PLC on mesocorticolimbic brain responses to social and nonsocial reward anticipation and outcomes. Central analyses compared the OT and PLC conditions. During nonsocial reward anticipation, there was greater activation in the right nucleus accumbens (NAcc), left anterior cingulate cortex (ACC), bilateral orbital frontal cortex (OFC), left superior frontal cortex, and right frontal pole (FP) during the OT condition relative to PLC. Alternatively, during social reward anticipation and outcomes, there were no significant increases in brain activation during the OT condition relative to PLC. A Treatment Group × Reward Condition interaction revealed relatively greater activation in the right NAcc, right caudate nucleus, left ACC, and right OFC during nonsocial relative to social reward anticipation during the OT condition relative to PLC. Additionally, these analyses revealed greater activation during nonsocial reward outcomes during the OT condition relative to PLC in the right OFC and left FP. Finally, functional connectivity analyses generally revealed changes in frontostriatal connections during the OT condition relative to PLC in response to nonsocial, but not social, rewards. The effects of intranasal OT administration on mesocorticolimbic brain systems that process rewards in ASD were observable primarily during the processing of nonsocial incentive salience stimuli. These findings have implications for understanding the effects of OT on neural systems that process rewards, as well as for experimental trials of novel ASD treatments developed to ameliorate social communication impairments in ASD.

  17. Sex-Steroid Hormone Manipulation Reduces Brain Response to Reward.

    PubMed

    Macoveanu, Julian; Henningsson, Susanne; Pinborg, Anja; Jensen, Peter; Knudsen, Gitte M; Frokjaer, Vibe G; Siebner, Hartwig R

    2016-03-01

    Mood disorders are twice as frequent in women than in men. Risk mechanisms for major depression include adverse responses to acute changes in sex-steroid hormone levels, eg, postpartum in women. Such adverse responses may involve an altered processing of rewards. Here, we examine how women's vulnerability for mood disorders is linked to sex-steroid dynamics by investigating the effects of a pharmacologically induced fluctuation in ovarian sex steroids on the brain response to monetary rewards. In a double-blinded placebo controlled study, healthy women were randomized to receive either placebo or the gonadotropin-releasing hormone agonist (GnRHa) goserelin, which causes a net decrease in sex-steroid levels. Fifty-eight women performed a gambling task while undergoing functional MRI at baseline, during the mid-follicular phase, and again following the intervention. The gambling task enabled us to map regional brain activity related to the magnitude of risk during choice and to monetary reward. The GnRHa intervention caused a net reduction in ovarian sex steroids (estradiol and testosterone) and increased depression symptoms. Compared with placebo, GnRHa reduced amygdala's reactivity to high monetary rewards. There was a positive association between the individual changes in testosterone and changes in bilateral insula response to monetary rewards. Our data provide evidence for the involvement of sex-steroid hormones in reward processing. A blunted amygdala response to rewarding stimuli following a rapid decline in sex-steroid hormones may reflect a reduced engagement in positive experiences. Abnormal reward processing may constitute a neurobiological mechanism by which sex-steroid fluctuations provoke mood disorders in susceptible women.

  18. Dopamine modulates reward system activity during subconscious processing of sexual stimuli.

    PubMed

    Oei, Nicole Y L; Rombouts, Serge Arb; Soeter, Roelof P; van Gerven, Joop M; Both, Stephanie

    2012-06-01

    Dopaminergic medication influences conscious processing of rewarding stimuli, and is associated with impulsive-compulsive behaviors, such as hypersexuality. Previous studies have shown that subconscious subliminal presentation of sexual stimuli activates brain areas known to be part of the 'reward system'. In this study, it was hypothesized that dopamine modulates activation in key areas of the reward system, such as the nucleus accumbens, during subconscious processing of sexual stimuli. Young healthy males (n=53) were randomly assigned to two experimental groups or a control group, and were administered a dopamine antagonist (haloperidol), a dopamine agonist (levodopa), or placebo. Brain activation was assessed during a backward-masking task with subliminally presented sexual stimuli. Results showed that levodopa significantly enhanced the activation in the nucleus accumbens and dorsal anterior cingulate when subliminal sexual stimuli were shown, whereas haloperidol decreased activations in those areas. Dopamine thus enhances activations in regions thought to regulate 'wanting' in response to potentially rewarding sexual stimuli that are not consciously perceived. This running start of the reward system might explain the pull of rewards in individuals with compulsive reward-seeking behaviors such as hypersexuality and patients who receive dopaminergic medication.

  19. Hunger does not motivate reward in women remitted from anorexia nervosa

    PubMed Central

    Wierenga, Christina E.; Bischoff-Grethe, Amanda; Melrose, A. James; Irvine, Zoe; Torres, Laura; Bailer, Ursula F.; Simmons, Alan; Fudge, Julie L.; McClure, Samuel M.; Ely, Alice; Kaye, Walter H.

    2014-01-01

    Background Hunger enhances sensitivity to reward, yet individuals with anorexia nervosa (AN) are not motivated to eat when starved. This study examined whether diminished response to reward could underlie food restriction in AN by investigating brain response to rewards during hunger and satiated states. Methods Using a delay discounting monetary decision task known to discriminate brain regions contributing to processing of immediate rewards and cognitive control important for decision making regarding future rewards, we compared 23 adults remitted from AN (to reduce the confounding effects of starvation [RAN]) to 17 healthy women (CW). Monetary rewards were used because the rewarding value of food may be confounded by anxiety in AN. Results Interactions of group (RAN, CW) × visit (hunger, satiety) revealed that, for CW, hunger significantly increased activation in reward salience circuitry (ventral striatum, dorsal caudate, anterior cingulate cortex) during processing of immediate reward, whereas satiety increased activation in cognitive control circuitry (ventrolateral prefrontal cortex, insula) during decision-making. In contrast, brain response in reward and cognitive neurocircuitry did not differ during hunger and satiety in RAN. A main effect of group revealed elevated response in the middle frontal gyrus for RAN. Conclusions RAN failed to increase activation of reward valuation circuitry when hungry and showed elevated response in cognitive control circuitry independent of metabolic state. Decreased sensitivity to hunger’s motivational drive may explain AN individuals’ ability to restrict food when emaciated. Moreover, difficulties in valuating emotional salience may contribute to inabilities to appreciate the risks inherent in this deadly disorder. PMID:25481622

  20. Ventral striatal activity links adversity and reward processing in children.

    PubMed

    Kamkar, Niki H; Lewis, Daniel J; van den Bos, Wouter; Morton, J Bruce

    2017-08-01

    Adversity impacts many aspects of psychological and physical development including reward-based learning and decision-making. Mechanisms relating adversity and reward processing in children, however, remain unclear. Here, we show that adversity is associated with potentiated learning from positive outcomes and impulsive decision-making, but unrelated to learning from negative outcomes. We then show via functional magnetic resonance imaging that the link between adversity and reward processing is partially mediated by differences in ventral striatal response to rewards. The findings suggest that early-life adversity is associated with alterations in the brain's sensitivity to rewards accounting, in part, for the link between adversity and altered reward processing in children. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

  1. Insula and striatum activity in effort-related monetary reward processing in gambling disorder: the role of depressive symptomatology.

    PubMed

    Fauth-Bühler, Mira; Zois, Evangelos; Vollstädt-Klein, Sabine; Lemenager, Tagrid; Beutel, Martin; Mann, Karl

    2014-01-01

    The neurobiological underpinnings of effort-related monetary reward processing of gambling disorder have not been previously studied. To date neuroimaging studies lack in large sample sizes and as a consequence less attention has been given to brain reward processing that could potentially be attributed to comorbid conditions such as depressive mood state. We assessed monetary reward processing using an effort-dependent task during 3 tesla functional magnetic resonance imaging. We investigated a large sample of male, right-handed, slot-machine-playing disordered gamblers (DGs; N = 80) as well as age- and smoking-matched male healthy controls (HCs; N = 89). Depressive symptoms were assessed using the Beck Depression Inventory (BDI). DGs and HCs were divided into subgroups ("high" and "low") based on their BDI scores. Effort-related monetary reward processing did not differ between the complete groups of HCs and DGs. Brain activation during receipt of monetary reward though revealed a significant Group × BDI interaction: DGs with higher BDI scores compared to DGs with lower BDI scores showed greater brain activity in the right insula cortex and dorsal striatum while no differences were observed for HCs with higher versus lower BDI scores. Our results suggest that effort-related aspects of monetary motivation, i.e. when monetary output is tied to performance, are not altered in DG. Additionally, our findings strengthen the need for subgroup comparisons in future investigations of the disorder as part of a personalized medicine approach.

  2. Neural Sensitivity to Absolute and Relative Anticipated Reward in Adolescents

    PubMed Central

    Vaidya, Jatin G.; Knutson, Brian; O'Leary, Daniel S.; Block, Robert I.; Magnotta, Vincent

    2013-01-01

    Adolescence is associated with a dramatic increase in risky and impulsive behaviors that have been attributed to developmental differences in neural processing of rewards. In the present study, we sought to identify age differences in anticipation of absolute and relative rewards. To do so, we modified a commonly used monetary incentive delay (MID) task in order to examine brain activity to relative anticipated reward value (neural sensitivity to the value of a reward as a function of other available rewards). This design also made it possible to examine developmental differences in brain activation to absolute anticipated reward magnitude (the degree to which neural activity increases with increasing reward magnitude). While undergoing fMRI, 18 adolescents and 18 adult participants were presented with cues associated with different reward magnitudes. After the cue, participants responded to a target to win money on that trial. Presentation of cues was blocked such that two reward cues associated with $.20, $1.00, or $5.00 were in play on a given block. Thus, the relative value of the $1.00 reward varied depending on whether it was paired with a smaller or larger reward. Reflecting age differences in neural responses to relative anticipated reward (i.e., reference dependent processing), adults, but not adolescents, demonstrated greater activity to a $1 reward when it was the larger of the two available rewards. Adults also demonstrated a more linear increase in ventral striatal activity as a function of increasing absolute reward magnitude compared to adolescents. Additionally, reduced ventral striatal sensitivity to absolute anticipated reward (i.e., the difference in activity to medium versus small rewards) correlated with higher levels of trait Impulsivity. Thus, ventral striatal activity in anticipation of absolute and relative rewards develops with age. Absolute reward processing is also linked to individual differences in Impulsivity. PMID:23544046

  3. Functional magnetic resonance imaging in awake transgenic fragile X rats: evidence of dysregulation in reward processing in the mesolimbic/habenular neural circuit.

    PubMed

    Kenkel, W M; Yee, J R; Moore, K; Madularu, D; Kulkarni, P; Gamber, K; Nedelman, M; Ferris, C F

    2016-03-22

    Anxiety and social deficits, often involving communication impairment, are fundamental clinical features of fragile X syndrome. There is growing evidence that dysregulation in reward processing is a contributing factor to the social deficits observed in many psychiatric disorders. Hence, we hypothesized that transgenic fragile X mental retardation 1 gene (fmr1) KO (FX) rats would display alterations in reward processing. To this end, awake control and FX rats were imaged for changes in blood oxygen level dependent (BOLD) signal intensity in response to the odor of almond, a stimulus to elicit the innate reward response. Subjects were 'odor naive' to this evolutionarily conserved stimulus. The resulting changes in brain activity were registered to a three-dimensional segmented, annotated rat atlas delineating 171 brain regions. Both wild-type (WT) and FX rats showed robust brain activation to a rewarding almond odor, though FX rats showed an altered temporal pattern and tended to have a higher number of voxels with negative BOLD signal change from baseline. This pattern of greater negative BOLD was especially apparent in the Papez circuit, critical to emotional processing and the mesolimbic/habenular reward circuit. WT rats showed greater positive BOLD response in the supramammillary area, whereas FX rats showed greater positive BOLD response in the dorsal lateral striatum, and greater negative BOLD response in the retrosplenial cortices, the core of the accumbens and the lateral preoptic area. When tested in a freely behaving odor-investigation paradigm, FX rats failed to show the preference for almond odor which typifies WT rats. However, FX rats showed investigation profiles similar to WT when presented with social odors. These data speak to an altered processing of this highly salient novel odor in the FX phenotype and lend further support to the notion that altered reward systems in the brain may contribute to fragile X syndrome symptomology.

  4. Addiction is a Reward Deficit and Stress Surfeit Disorder

    PubMed Central

    Koob, George F.

    2013-01-01

    Drug addiction can be defined by a three-stage cycle – binge/intoxication, withdrawal/negative affect, and preoccupation/anticipation – that involves allostatic changes in the brain reward and stress systems. Two primary sources of reinforcement, positive and negative reinforcement, have been hypothesized to play a role in this allostatic process. The negative emotional state that drives negative reinforcement is hypothesized to derive from dysregulation of key neurochemical elements involved in the brain reward and stress systems. Specific neurochemical elements in these structures include not only decreases in reward system function (within-system opponent processes) but also recruitment of the brain stress systems mediated by corticotropin-releasing factor (CRF) and dynorphin-κ opioid systems in the ventral striatum, extended amygdala, and frontal cortex (both between-system opponent processes). CRF antagonists block anxiety-like responses associated with withdrawal, block increases in reward thresholds produced by withdrawal from drugs of abuse, and block compulsive-like drug taking during extended access. Excessive drug taking also engages the activation of CRF in the medial prefrontal cortex, paralleled by deficits in executive function that may facilitate the transition to compulsive-like responding. Neuropeptide Y, a powerful anti-stress neurotransmitter, has a profile of action on compulsive-like responding for ethanol similar to a CRF1 antagonist. Blockade of the κ opioid system can also block dysphoric-like effects associated with withdrawal from drugs of abuse and block the development of compulsive-like responding during extended access to drugs of abuse, suggesting another powerful brain stress system that contributes to compulsive drug seeking. The loss of reward function and recruitment of brain systems provide a powerful neurochemical basis that drives the compulsivity of addiction. PMID:23914176

  5. Précis of The brain and emotion.

    PubMed

    Rolls, E T

    2000-04-01

    The topics treated in The brain and emotion include the definition, nature, and functions of emotion (Ch. 3); the neural bases of emotion (Ch. 4); reward, punishment, and emotion in brain design (Ch. 10); a theory of consciousness and its application to understanding emotion and pleasure (Ch. 9); and neural networks and emotion-related learning (Appendix). The approach is that emotions can be considered as states elicited by reinforcers (rewards and punishers). This approach helps with understanding the functions of emotion, with classifying different emotions, and in understanding what information-processing systems in the brain are involved in emotion, and how they are involved. The hypothesis is developed that brains are designed around reward- and punishment-evaluation systems, because this is the way that genes can build a complex system that will produce appropriate but flexible behavior to increase fitness (Ch. 10). By specifying goals rather than particular behavioral patterns of responses, genes leave much more open the possible behavioral strategies that might be required to increase fitness. The importance of reward and punishment systems in brain design also provides a basis for understanding the brain mechanisms of motivation, as described in Chapters 2 for appetite and feeding, 5 for brain-stimulation reward, 6 for addiction, 7 for thirst, and 8 for sexual behavior.

  6. Electrophysiological Evidence of Atypical Motivation and Reward Processing in Children with Attention-Deficit Hyperactivity Disorder

    ERIC Educational Resources Information Center

    Holroyd, Clay B.; Baker, Travis E.; Kerns, Kimberly A.; Muller, Ulrich

    2008-01-01

    Behavioral and neurophysiological evidence suggest that attention-deficit hyperactivity disorder (ADHD) is characterized by the impact of abnormal reward prediction error signals carried by the midbrain dopamine system on frontal brain areas that implement cognitive control. To investigate this issue, we recorded the event-related brain potential…

  7. The "highs and lows" of the human brain on dopaminergics: Evidence from neuropharmacology.

    PubMed

    Martins, Daniel; Mehta, Mitul A; Prata, Diana

    2017-09-01

    Rewards are appetitive events that elicit approach. Ground-breaking findings from neurophysiological experiments in animals, alongside neuropharmacology and neuroimaging research in human samples have identified dopamine as the main neurochemical messenger of global reward processing in the brain. However, dopamine's contribution to the different components of reward processing remains to be precisely defined. To facilitate the informed design and interpretation of reward studies in humans, we have systematically reviewed all existing human pharmacological studies investigating how drug manipulation of the dopamine system affects reward-related behaviour and its neural correlates. Pharmacological experiments in humans face methodological challenges in terms of the: 1) specificity and safety of the available drugs for administration in humans, 2) uncertainties about pre- or post-synaptic modes of action, and 3) possible interactions with inter-individual neuropsychological or genotypic variables. In order to circumvent some of these limitations, future research should rely on the combination of different levels of observation, in integrative pharmaco-genetics-neurobehavioral approaches, to more completely characterize dopamine's role in both general and modality-specific processing of reward. Copyright © 2017 Elsevier Ltd. All rights reserved.

  8. Diminished fronto-striatal activity during processing of monetary rewards and losses in pathological gambling

    PubMed Central

    Balodis, Iris M.; Kober, Hedy; Worhunsky, Patrick D.; Stevens, Michael C.; Pearlson, Godfrey D.; Potenza, Marc N.

    2012-01-01

    Background Mesocorticolimbic neurocircuitry and impulsivity have both been implicated in pathological gambling (PG) and in reward processing. However, the neural underpinnings of specific phases of reward and loss processing in PG and their relationships to impulsivity remain only partially understood. The present functional magnetic resonance imaging study examined brain activity associated with different phases of reward and loss processing in PG. Given an inverse relationship between ventral striatal recruitment during anticipation of monetary rewards and impulsivity in alcohol dependence, the current study explored whether a similar association might also be present in PG. Methods Fourteen adults with PG and 14 control comparison (CC) participants performed the Monetary Incentive Delay Task (MIDT) to identify brain activation changes associated with reward/loss prospect, reward/loss anticipation and reward/loss notification. Impulsivity was assessed separately using the Barratt Impulsiveness Scale. Results Relative to the CC group, the PG group exhibited significantly reduced activity in the ventromedial prefrontal cortex, insula and ventral striatum during several phases, including the prospect and anticipation phases of both gain and losses. Activity in the ventral striatum correlated inversely with levels of impulsivity in PG participants, consistent with prior findings in alcohol dependence. Conclusions Relatively decreased activity in cortico-striatal neurocircuitry during multiple phases of reward processing suggests consistent alterations in neurocircuitry underlying incentive valuation and loss prediction. Together with findings in alcohol dependence, these results suggest that impulsive tendencies in addictions may be reflected in diminished ventral striatal activations to reward anticipation and may represent targets for treatment development in addictions. PMID:22336565

  9. Diminished frontostriatal activity during processing of monetary rewards and losses in pathological gambling.

    PubMed

    Balodis, Iris M; Kober, Hedy; Worhunsky, Patrick D; Stevens, Michael C; Pearlson, Godfrey D; Potenza, Marc N

    2012-04-15

    Mesocorticolimbic neurocircuitry and impulsivity have both been implicated in pathological gambling (PG) and in reward processing. However, the neural underpinnings of specific phases of reward and loss processing in PG and their relationships to impulsivity remain only partially understood. The present functional magnetic resonance imaging study examined brain activity associated with different phases of reward and loss processing in PG. Given an inverse relationship between ventral striatal recruitment during anticipation of monetary rewards and impulsivity in alcohol dependence, the current study explored whether a similar association might also be present in PG. Fourteen adults with PG and 14 control comparison participants performed the Monetary Incentive Delay Task to identify brain activation changes associated with reward/loss prospect, reward/loss anticipation, and reward/loss notification. Impulsivity was assessed separately using the Barratt Impulsiveness Scale. Relative to the control comparison group, the PG group exhibited significantly reduced activity in the ventromedial prefrontal cortex, insula, and ventral striatum during several phases, including the prospect and anticipation phases of both gains and losses. Activity in the ventral striatum correlated inversely with levels of impulsivity in PG participants, consistent with prior findings in alcohol dependence. Relatively decreased activity in corticostriatal neurocircuitry during multiple phases of reward processing suggests consistent alterations in neurocircuitry underlying incentive valuation and loss prediction. Together with findings in alcohol dependence, these results suggest that impulsive tendencies in addictions may be reflected in diminished ventral striatal activations to reward anticipation and may represent targets for treatment development in addictions. Copyright © 2012 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

  10. Neural markers of social and monetary rewards in children with Attention-Deficit/Hyperactivity Disorder and Autism Spectrum Disorder

    PubMed Central

    Gonzalez-Gadea, Maria Luz; Sigman, Mariano; Rattazzi, Alexia; Lavin, Claudio; Rivera-Rei, Alvaro; Marino, Julian; Manes, Facundo; Ibanez, Agustin

    2016-01-01

    Recent theories of decision making propose a shared value-related brain mechanism for encoding monetary and social rewards. We tested this model in children with Attention-Deficit/Hyperactivity Disorder (ADHD), children with Autism Spectrum Disorder (ASD) and control children. We monitored participants’ brain dynamics using high density-electroencephalography while they played a monetary and social reward tasks. Control children exhibited a feedback Error-Related Negativity (fERN) modulation and Anterior Cingulate Cortex (ACC) source activation during both tasks. Remarkably, although cooperation resulted in greater losses for the participants, the betrayal options generated greater fERN responses. ADHD subjects exhibited an absence of fERN modulation and reduced ACC activation during both tasks. ASD subjects exhibited normal fERN modulation during monetary choices and inverted fERN/ACC responses in social options than did controls. These results suggest that in neurotypicals, monetary losses and observed disloyal social decisions induced similar activity in the brain value system. In ADHD children, difficulties in reward processing affected early brain signatures of monetary and social decisions. Conversely, ASD children showed intact neural markers of value-related monetary mechanisms, but no brain modulation by prosociality in the social task. These results offer insight into the typical and atypical developments of neural correlates of monetary and social reward processing. PMID:27464551

  11. Dopamine Depletion Reduces Food-Related Reward Activity Independent of BMI

    PubMed Central

    Frank, Sabine; Veit, Ralf; Sauer, Helene; Enck, Paul; Friederich, Hans-Christoph; Unholzer, Theresa; Bauer, Ute-Maria; Linder, Katarzyna; Heni, Martin; Fritsche, Andreas; Preissl, Hubert

    2016-01-01

    Reward sensitivity and possible alterations in the dopaminergic-reward system are associated with obesity. We therefore aimed to investigate the influence of dopamine depletion on food-reward processing. We investigated 34 female subjects in a randomized placebo-controlled, within-subject design (body mass index (BMI)=27.0 kg/m2 ±4.79 SD; age=28 years ±4.97 SD) using an acute phenylalanine/tyrosine depletion drink representing dopamine depletion and a balanced amino acid drink as the control condition. Brain activity was measured with functional magnetic resonance imaging during a ‘wanting' and ‘liking' rating of food items. Eating behavior-related traits and states were assessed on the basis of questionnaires. Dopamine depletion resulted in reduced activation in the striatum and higher activation in the superior frontal gyrus independent of BMI. Brain activity during the wanting task activated a more distributed network than during the liking task. This network included gustatory, memory, visual, reward, and frontal regions. An interaction effect of dopamine depletion and the wanting/liking task was observed in the hippocampus. The interaction with the covariate BMI was significant in motor and control regions but not in the striatum. Our results support the notion of altered brain activity in the reward and prefrontal network with blunted dopaminergic action during food-reward processing. This effect is, however, independent of BMI, which contradicts the reward-deficiency hypothesis. This hints to the hypothesis suggesting a different or more complex mechanism underlying the dopaminergic reward function in obesity. PMID:26450814

  12. A decade of decoding reward-related fMRI signals and where we go from here.

    PubMed

    Kahnt, Thorsten

    2017-06-04

    Information about potential rewards in the environment is essential for guiding adaptive behavior, and understanding neural reward processes may provide insights into neuropsychiatric dysfunctions. Over the past 10 years, multivoxel pattern analysis (MVPA) techniques have been used to study brain areas encoding information about expected and experienced outcomes. These studies have identified reward signals throughout the brain, including the striatum, medial prefrontal cortex, orbitofrontal cortex, dorsolateral prefrontal cortex, and parietal cortex. This review article discusses some of the assumptions and models that are used to interpret results from these studies, and how they relate to findings from animal electrophysiology. The article reviews and summarizes some of the key findings from MVPA studies on reward. In particular, it first focuses on studies that, in addition to mapping out the brain areas that process rewards, have provided novel insights into the coding mechanisms of value and reward. Then, it discusses examples of how multivariate imaging approaches are being used more recently to decode features of expected rewards that go beyond value, such as the identity of an expected outcome or the action required to obtain it. The study of such complex and multifaceted reward representations highlights the key advantage of using representational methods, which are uniquely able to reveal these signals and may narrow the gap between animal and human research. Applied in a clinical context, MVPA may advance our understanding of neuropsychiatric disorders and the development of novel treatment strategies. Copyright © 2017 Elsevier Inc. All rights reserved.

  13. Advances in studying phasic dopamine signaling in brain reward mechanisms

    PubMed Central

    Wickham, Robert J.; Solecki, Wojciech; Rathbun, Liza R.; Neugebauer, Nichole M.; Wightman, R. Mark; Addy, Nii A.

    2013-01-01

    The last sixty years of research have provided extraordinary advances of our knowledge of the reward system. Since its initial discovery as a neurotransmitter by Carlsson and colleagues (Carlsson et al., 1957), dopamine (DA) has emerged as an important mediator of reward processing. As a result, a number of electrochemical techniques have been developed to directly measure DA levels in the brain using various preparations. Many of these techniques and preparations differ in the types of questions that they can address. Together, these techniques have begun to elucidate the complex roles of tonic and phasic DA signaling in reward processing and in addiction. In this review, we will first provide a guide for the most commonly used electrochemical methods for DA detection and describe their utility in furthering our knowledge about DA's role in reward and addiction. Second, we will review the value of common in vitro and in vivo preparations and describe their ability to address different types of questions. Last, we will review recent data that has provided new insight of the mechanisms of in vivo phasic DA signaling and its role in reward processing and reward-mediated behavior. PMID:23747914

  14. Hunger does not motivate reward in women remitted from anorexia nervosa.

    PubMed

    Wierenga, Christina E; Bischoff-Grethe, Amanda; Melrose, A James; Irvine, Zoe; Torres, Laura; Bailer, Ursula F; Simmons, Alan; Fudge, Julie L; McClure, Samuel M; Ely, Alice; Kaye, Walter H

    2015-04-01

    Hunger enhances sensitivity to reward, yet individuals with anorexia nervosa (AN) are not motivated to eat when starved. This study investigated brain response to rewards during hunger and satiated states to examine whether diminished response to reward could underlie food restriction in AN. Using a delay discounting monetary decision task known to discriminate brain regions contributing to processing of immediate rewards and cognitive control important for decision making regarding future rewards, we compared 23 women remitted from AN (RAN group; to reduce the confounding effects of starvation) with 17 healthy comparison women (CW group). Monetary rewards were used because the rewarding value of food may be confounded by anxiety in AN. Interactions of Group (RAN, CW) × Visit (hunger, satiety) revealed that, for the CW group, hunger significantly increased activation in reward salience circuitry (ventral striatum, dorsal caudate, anterior cingulate cortex) during processing of immediate reward, whereas satiety increased activation in cognitive control circuitry (ventrolateral prefrontal cortex, insula) during decision making. In contrast, brain response in reward and cognitive neurocircuitry did not differ during hunger and satiety in the RAN group. A main effect of group revealed elevated response in the middle frontal gyrus for the RAN group compared with the CW group. Women remitted from AN failed to increase activation of reward valuation circuitry when hungry and showed elevated response in cognitive control circuitry independent of metabolic state. Decreased sensitivity to the motivational drive of hunger may explain the ability of individuals with AN to restrict food when emaciated. Difficulties in valuating emotional salience may contribute to inabilities to appreciate the risks inherent in this disorder. Copyright © 2015 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

  15. Insula and striatum activity in effort-related monetary reward processing in gambling disorder: The role of depressive symptomatology

    PubMed Central

    Fauth-Bühler, Mira; Zois, Evangelos; Vollstädt-Klein, Sabine; Lemenager, Tagrid; Beutel, Martin; Mann, Karl

    2014-01-01

    The neurobiological underpinnings of effort-related monetary reward processing of gambling disorder have not been previously studied. To date neuroimaging studies lack in large sample sizes and as a consequence less attention has been given to brain reward processing that could potentially be attributed to comorbid conditions such as depressive mood state. We assessed monetary reward processing using an effort-dependent task during 3 tesla functional magnetic resonance imaging. We investigated a large sample of male, right-handed, slot-machine-playing disordered gamblers (DGs; N = 80) as well as age- and smoking-matched male healthy controls (HCs; N = 89). Depressive symptoms were assessed using the Beck Depression Inventory (BDI). DGs and HCs were divided into subgroups (“high” and “low”) based on their BDI scores. Effort-related monetary reward processing did not differ between the complete groups of HCs and DGs. Brain activation during receipt of monetary reward though revealed a significant Group × BDI interaction: DGs with higher BDI scores compared to DGs with lower BDI scores showed greater brain activity in the right insula cortex and dorsal striatum while no differences were observed for HCs with higher versus lower BDI scores. Our results suggest that effort-related aspects of monetary motivation, i.e. when monetary output is tied to performance, are not altered in DG. Additionally, our findings strengthen the need for subgroup comparisons in future investigations of the disorder as part of a personalized medicine approach. PMID:25379437

  16. Optimal waist-to-hip ratios in women activate neural reward centers in men.

    PubMed

    Platek, Steven M; Singh, Devendra

    2010-02-05

    Secondary sexual characteristics convey information about reproductive potential. In the same way that facial symmetry and masculinity, and shoulder-to-hip ratio convey information about reproductive/genetic quality in males, waist-to-hip-ratio (WHR) is a phenotypic cue to fertility, fecundity, neurodevelopmental resources in offspring, and overall health, and is indicative of "good genes" in women. Here, using fMRI, we found that males show activation in brain reward centers in response to naked female bodies when surgically altered to express an optimal (approximately 0.7) WHR with redistributed body fat, but relatively unaffected body mass index (BMI). Relative to presurgical bodies, brain activation to postsurgical bodies was observed in bilateral orbital frontal cortex. While changes in BMI only revealed activation in visual brain substrates, changes in WHR revealed activation in the anterior cingulate cortex, an area associated with reward processing and decision-making. When regressing ratings of attractiveness on brain activation, we observed activation in forebrain substrates, notably the nucleus accumbens, a forebrain nucleus highly involved in reward processes. These findings suggest that an hourglass figure (i.e., an optimal WHR) activates brain centers that drive appetitive sociality/attention toward females that represent the highest-quality reproductive partners. This is the first description of a neural correlate implicating WHR as a putative honest biological signal of female reproductive viability and its effects on men's neurological processing.

  17. Neurocircuitry of drug reward

    PubMed Central

    Ikemoto, Satoshi; Bonci, Antonello

    2013-01-01

    In recent years, neuroscientists have produced profound conceptual and mechanistic advances on the neurocircuitry of reward and substance use disorders. Here, we will provide a brief review of intracranial drug self-administration and optogenetic self-stimulation studies that identified brain regions and neurotransmitter systems involved in drug- and reward-related behaviors. Also discussed is a theoretical framework that helps to understand the functional properties of the circuitry involved in these behaviors. The circuitry appears to be homeostatically regulated and mediate anticipatory processes that regulate behavioral interaction with the environment in response to salient stimuli. That is, abused drugs or, at least, some may act on basic motivation and mood processes, regulating behavior-environment interaction. Optogenetics and related technologies have begun to uncover detailed circuit mechanisms linking key brain regions in which abused drugs act for rewarding effects. PMID:23664810

  18. fMRI of alterations in reward selection, anticipation, and feedback in major depressive disorder.

    PubMed

    Smoski, Moria J; Felder, Jennifer; Bizzell, Joshua; Green, Steven R; Ernst, Monique; Lynch, Thomas R; Dichter, Gabriel S

    2009-11-01

    The purpose of the present investigation was to evaluate reward processing in unipolar major depressive disorder (MDD). Specifically, we investigated whether adults with MDD demonstrated hyporesponsivity in striatal brain regions and/or hyperresponsivity in cortical brain regions involved in conflict monitoring using a Wheel of Fortune task designed to probe responses during reward selection, reward anticipation, and reward feedback. Functional magnetic resonance imaging (fMRI) data indicated that the MDD group was characterized by reduced activation of striatal reward regions during reward selection, reward anticipation, and reward feedback, supporting previous data indicating hyporesponsivity of reward systems in MDD. Support was not found for hyperresponsivity of cognitive control regions during reward selection or reward anticipation. Instead, MDD participants showed hyperresponsivity in orbitofrontal cortex, a region associated with assessment of risk and reward, during reward selection, as well as decreased activation of the middle frontal gyrus and the rostral cingulate gyrus during reward selection and anticipation. Finally, depression severity was predicted by activation in bilateral midfrontal gyrus during reward selection. Results indicate that MDD is characterized by striatal hyporesponsivity, and that future studies of MDD treatments that seek to improve responses to rewarding stimuli should assess striatal functioning.

  19. Reward circuitry in resilience to severe trauma: An fMRI investigation of resilient special forces soldiers

    PubMed Central

    Vythilingam, Meena; Nelson, Eric E.; Scaramozza, Matthew; Waldeck, Tracy; Hazlett, Gary; Southwick, Steven M.; Pine, Daniel S.; Drevets, Wayne; Charney, Dennis S.; Ernst, Monique

    2008-01-01

    Enhanced brain reward function could contribute to resilience to trauma. Reward circuitry in active duty, resilient special forces (SF) soldiers was evaluated using fMRI during a monetary incentive delay task. Findings in this group of resilient individuals revealed unique patterns of activation during expectation of reward in the subgenual prefrontal cortex and nucleus accumbens area; regions pivotal to reward processes. PMID:19243926

  20. Serotonergic modulation of reward and punishment: evidence from pharmacological fMRI studies.

    PubMed

    Macoveanu, Julian

    2014-03-27

    Until recently, the bulk of research on the human reward system was focused on studying the dopaminergic and opioid neurotransmitter systems. However, extending the initial data from animal studies on reward, recent pharmacological brain imaging studies on human participants bring a new line of evidence on the key role serotonin plays in reward processing. The reviewed research has revealed how central serotonin availability and receptor specific transmission modulates the neural response to both appetitive (rewarding) and aversive (punishing) stimuli in putative reward-related brain regions. Thus, serotonin is suggested to be involved in behavioral control when there is a prospect of reward or punishment. The new findings may have implications in understanding psychiatric disorders such as major depression which is characterized by abnormal serotonergic function and reward-related processing and may also provide a neural correlated for the emotional blunting observed in the clinical treatment of psychiatric disorders with selective serotonin reuptake inhibitors. Given the unique profile of action of each serotonergic receptor subtype, future pharmacological studies may favor receptor specific investigations to complement present research mainly focused on global serotonergic manipulations. Copyright © 2014 Elsevier B.V. All rights reserved.

  1. Addictive drugs and brain stimulation reward.

    PubMed

    Wise, R A

    1996-01-01

    Direct electrical or chemical stimulation of specific brain regions can establish response habits similar to those established by natural rewards such as food or sexual contact. Cocaine, mu and delta opiates, nicotine, phencyclidine, and cannabis each have actions that summate with rewarding electrical stimulation of the medial forebrain bundle (MFB). The reward-potentiating effects of amphetamine and opiates are associated with central sites of action where these drugs also have their direct rewarding effects, suggesting common mechanisms for drug reward per se and for drug potentiation of brain stimulation reward. The central sites at which these and perhaps other drugs of abuse potentiate brain stimulation reward and are rewarding in their own right are consistent with the hypothesis that the laboratory reward of brain stimulation and the pharmacological rewards of addictive drugs are habit forming because they act in the brain circuits that subserve more natural and biologically significant rewards.

  2. Neuroendocrinology and brain imaging of reward in eating disorders: A possible key to the treatment of anorexia nervosa and bulimia nervosa.

    PubMed

    Monteleone, Alessio Maria; Castellini, Giovanni; Volpe, Umberto; Ricca, Valdo; Lelli, Lorenzo; Monteleone, Palmiero; Maj, Mario

    2018-01-03

    Anorexia nervosa and bulimia nervosa are severe eating disorders whose etiopathogenesis is still unknown. Clinical features suggest that eating disorders may develop as reward-dependent syndromes, since eating less food is perceived as rewarding in anorexia nervosa while consumption of large amounts of food during binge episodes in bulimia nervosa aims at reducing the patient's negative emotional states. Therefore, brain reward mechanisms have been a major focus of research in the attempt to contribute to the comprehension of the pathophysiology of these disorders. Structural brain imaging data provided the evidence that brain reward circuits may be altered in patients with anorexia or bulimia nervosa. Similarly, functional brain imaging studies exploring the activation of brain reward circuits by food stimuli as well as by stimuli recognized to be potentially rewarding for eating disordered patients, such as body image cues or stimuli related to food deprivation and physical hyperactivity, showed several dysfunctions in ED patients. Moreover, very recently, it has been demonstrated that some of the biochemical homeostatic modulators of eating behavior are also implicated in the regulation of food-related and non-food-related reward, representing a possible link between the aberrant behaviors of ED subjects and their hypothesized deranged reward processes. In particular, changes in leptin and ghrelin occur in patients with anorexia or bulimia nervosa and have been suggested to represent not only homeostatic adaptations to an altered energy balance but to contribute also to the acquisition and/or maintenance of persistent starvation, binge eating and physical hyperactivity, which are potentially rewarding for ED patients. On the basis of such findings new pathogenetic models of EDs have been proposed, and these models may provide new theoretical basis for the development of innovative treatment strategies, either psychological and pharmacological, with the aim to improve the outcomes of so severe disabling disorders. Copyright © 2017 Elsevier Inc. All rights reserved.

  3. ILLICIT DOPAMINE TRANSIENTS: RECONCILING ACTIONS OF ABUSED DRUGS

    PubMed Central

    Covey, Dan P.; Roitman, Mitchell F.; Garris, Paul A.

    2014-01-01

    Phasic increases in brain dopamine are required for cue-directed reward seeking. While compelling within the framework of appetitive behavior, the view that illicit drugs hijack reward circuits by hyper-activating these dopamine transients is inconsistent with established psychostimulant pharmacology. However, recent work reclassifying amphetamine (AMPH), cocaine, and other addictive dopamine-transporter inhibitors (DAT-Is) supports transient hyper-activation as a unifying hypothesis of abused drugs. We argue here that reclassification also identifies generating burst firing by dopamine neurons as a keystone action. Unlike natural rewards, which are processed by sensory systems, drugs act directly on the brain. Consequently, to mimic natural reward and exploit reward circuits, dopamine transients must be elicited de novo. Of available drug targets, only burst firing achieves this essential outcome. PMID:24656971

  4. Neural signature of reward-modulated unconscious inhibitory control.

    PubMed

    Diao, Liuting; Qi, Senqing; Xu, Mengsi; Li, Zhiai; Ding, Cody; Chen, Antao; Zheng, Yan; Yang, Dong

    2016-09-01

    Consciously initiated cognitive control is generally determined by motivational incentives (e.g., monetary reward). Recent studies have revealed that human cognitive control processes can nevertheless operate without awareness. However, whether monetary reward can impinge on unconscious cognitive control remains unclear. To clarify this issue, a task consisting of several runs was designed to combine a modified version of the reward-priming paradigm with an unconscious version of the Go/No-Go task. At the beginning of each run, participants were exposed to a high- or low-value coin, followed by the modified Go/No-Go task. Participants could earn the coin only if they responded correctly to each trial of the run. Event-related potential (ERP) results indicated that high-value rewards (vs. low-value rewards) induced a greater centro-parietal P3 component associated with conscious and unconscious inhibitory control. Moreover, the P3 amplitude correlated positively with the magnitude of reaction time slowing reflecting the intensity of activation of unconscious inhibitory control in the brain. These findings suggest that high-value reward may facilitate human higher-order inhibitory processes that are independent of conscious awareness, which provides insights into the brain processes that underpin motivational modulation of cognitive control. Copyright © 2016 Elsevier B.V. All rights reserved.

  5. Activity of striatal neurons reflects social action and own reward.

    PubMed

    Báez-Mendoza, Raymundo; Harris, Christopher J; Schultz, Wolfram

    2013-10-08

    Social interactions provide agents with the opportunity to earn higher benefits than when acting alone and contribute to evolutionary stable strategies. A basic requirement for engaging in beneficial social interactions is to recognize the actor whose movement results in reward. Despite the recent interest in the neural basis of social interactions, the neurophysiological mechanisms identifying the actor in social reward situations are unknown. A brain structure well suited for exploring this issue is the striatum, which plays a role in movement, reward, and goal-directed behavior. In humans, the striatum is involved in social processes related to reward inequity, donations to charity, and observational learning. We studied the neurophysiology of social action for reward in rhesus monkeys performing a reward-giving task. The behavioral data showed that the animals distinguished between their own and the conspecific's reward and knew which individual acted. Striatal neurons coded primarily own reward but rarely other's reward. Importantly, the activations occurred preferentially, and in approximately similar fractions, when either the own or the conspecific's action was followed by own reward. Other striatal neurons showed social action coding without reward. Some of the social action coding disappeared when the conspecific's role was simulated by a computer, confirming a social rather than observational relationship. These findings demonstrate a role of striatal neurons in identifying the social actor and own reward in a social setting. These processes may provide basic building blocks underlying the brain's function in social interactions.

  6. Motivational orientation modulates the neural response to reward.

    PubMed

    Linke, Julia; Kirsch, Peter; King, Andrea V; Gass, Achim; Hennerici, Michael G; Bongers, André; Wessa, Michèle

    2010-02-01

    Motivational orientation defines the source of motivation for an individual to perform a particular action and can either originate from internal desires (e.g., interest) or external compensation (e.g., money). To this end, motivational orientation should influence the way positive or negative feedback is processed during learning situations and this might in turn have an impact on the learning process. In the present study, we thus investigated whether motivational orientation, i.e., extrinsic and intrinsic motivation modulates the neural response to reward and punishment as well as learning from reward and punishment in 33 healthy individuals. To assess neural responses to reward, punishment and learning of reward contingencies we employed a probabilistic reversal learning task during functional magnetic resonance imaging. Extrinsic and intrinsic motivation were assessed with a self-report questionnaire. Rewarding trials fostered activation in the medial orbitofrontal cortex and anterior cingulate gyrus (ACC) as well as the amygdala and nucleus accumbens, whereas for punishment an increased neural response was observed in the medial and inferior prefrontal cortex, the superior parietal cortex and the insula. High extrinsic motivation was positively correlated to increased neural responses to reward in the ACC, amygdala and putamen, whereas a negative relationship between intrinsic motivation and brain activation in these brain regions was observed. These findings show that motivational orientation indeed modulates the responsiveness to reward delivery in major components of the human reward system and therefore extends previous results showing a significant influence of individual differences in reward-related personality traits on the neural processing of reward. Copyright (c) 2009 Elsevier Inc. All rights reserved.

  7. Sleep and Circadian Contributions to Adolescent Alcohol Use Disorder

    PubMed Central

    Hasler, Brant P.; Soehner, Adriane M.; Clark, Duncan B.

    2014-01-01

    Adolescence is a time of marked changes across sleep, circadian rhythms, brain function, and alcohol use. Starting at puberty, adolescents’ endogenous circadian rhythms and preferred sleep times shift later, often leading to a mismatch with the schedules imposed by secondary education. This mismatch induces circadian misalignment and sleep loss, which have been associated with affect dysregulation, increased drug and alcohol use, and other risk-taking behaviors in adolescents and adults. In parallel to developmental changes in sleep, adolescent brains are undergoing structural and functional changes in the circuits subserving the pursuit and processing of rewards. These developmental changes in reward processing likely contribute to the initiation of alcohol use during adolescence. Abundant evidence indicates that sleep and circadian rhythms modulate reward function, suggesting that adolescent sleep and circadian disturbance may contribute to altered reward function, and in turn, alcohol involvement. In this review, we summarize the relevant evidence and propose that these parallel developmental changes in sleep, circadian rhythms, and neural processing of reward interact to increase risk for alcohol use disorder (AUD). PMID:25442171

  8. Gustatory and reward brain circuits in the control of food intake

    PubMed Central

    Oliveira-Maia, Albino J.; Roberts, Craig D.; Simon, Sidney A.; Nicolelis, Miguel A.L.

    2012-01-01

    Gustation is a multisensory process allowing for the selection of nutrients and the rejection of irritating and/or toxic compounds. Since obesity is a highly prevalent condition that is critically dependent on food intake and energy expenditure, a deeper understanding of gustatory processing is an important objective in biomedical research. Recent findings have provided evidence that central gustatory processes are distributed across several cortical and sub-cortical brain areas. Furthermore, these gustatory sensory circuits are closely related to the circuits that process reward. Here, we present an overview of the activation and connectivity between central gustatory and reward areas. Moreover, and given the limitations in number and effectiveness of treatments currently available for overweight patients, we discuss the possibility of modulating neuronal activity in these circuits as an alternative in the treatment of obesity. PMID:21197607

  9. A Novel Perspective on Dopaminergic Processing of Human Addiction.

    PubMed

    Badgaiyan, Rajendra D

    2013-01-01

    Converging evidence from clinical, animal, and neuroimaging experiments suggests that the addictive behavior is associated with dysregulated dopamine neurotransmission. The precise role of dopamine in establishment and maintenance of addiction however is unclear. In this context animal studies on the brain reward system and the associative memory processing provide a novel insight. It was shown that both processing involve dopamine neurotransmission and both are disrupted in addiction. These findings indicate that dysregulated dopamine neurotransmission alters the brain processing of not only the reward system but also that of the memory of association between an addictive substance and reward. These alterations lead to maladaptive motivational behavior leading to chemical dependency. This concept however is based mostly on the data obtained in laboratory animals because of the paucity of human data. Due to lack of a reliable technique to study neurotransmission in the live human brain, it has been a problem to study the role of dopamine in human volunteers. A recently developed dynamic molecular imaging technique however, provides an opportunity to study these concepts in human volunteers because the technique allows detection, mapping and measurement of dopamine released in the live human brain during task performance.

  10. Anticipatory Reward Processing in Addicted Populations: A Focus on the Monetary Incentive Delay Task

    PubMed Central

    Balodis, Iris M.; Potenza, Marc N.

    2014-01-01

    Advances in brain imaging techniques have allowed neurobiological research to temporally analyze signals coding for the anticipation of rewards. In addicted populations, both hypo- and hyper-responsiveness of brain regions (e.g., ventral striatum) implicated in drug effects and reward system processing have been reported during anticipation of generalized reward. Here, we discuss the current state of knowledge of reward processing in addictive disorders from a widely used and validated task: the Monetary Incentive Delay Task (MIDT). The current paper constrains review to those studies applying the MIDT in addicted and at-risk adult populations, with a focus on anticipatory processing and striatal regions activated during task performance, as well as the relationship of these regions with individual difference (e.g., impulsivity) and treatment outcome variables. We further review drug influences in challenge studies as a means to examine acute influences on reward processing in abstinent, recreationally using and addicted populations. Here, we discuss that generalized reward processing in addicted and at-risk populations is often characterized by divergent anticipatory signaling in the ventral striatum. Although methodological/task variations may underlie some discrepant findings, anticipatory signaling in the ventral striatum may also be influenced by smoking status, drug metabolites and treatment status in addicted populations. Divergent results across abstinent, recreationally using and addicted populations demonstrate complexities in interpreting findings. Future studies will benefit from focusing on characterizing how impulsivity and other addiction-related features relate to anticipatory striatal signaling over time. Additionally, identifying how anticipatory signals recover/adjust following protracted abstinence will be important in understanding recovery processes. PMID:25481621

  11. Is brain response to food rewards related to overeating? A test of the reward surfeit model of overeating in children.

    PubMed

    Adise, Shana; Geier, Charles F; Roberts, Nicole J; White, Corey N; Keller, Kathleen L

    2018-06-08

    The reward surfeit model of overeating suggests that heightened brain response to rewards contributes to overeating and subsequent weight gain. However, previous studies have not tested whether brain response to reward is associated with food intake, particularly during childhood, a period of dynamic development in reward and inhibitory control neurocircuitry. We conducted functional magnetic resonance imaging (fMRI) with 7-11-year-old children (n = 59; healthy weight, n = 31; overweight, n = 28; 54% female) while they played a modified card-guessing paradigm to examine blood-oxygen-level-dependent (BOLD) response to anticipating and winning rewards (food, money, neutral). Food intake was assessed at three separate meals that measured different facets of eating behavior: 1) typical consumption (baseline), 2) overindulgence (palatable buffet), and 3) eating in the absence of hunger (EAH). A priori regions of interest included regions implicated in both reward processing and inhibitory control. Multiple stepwise regressions were conducted to examine the relationship between intake and BOLD response to rewards. Corrected results showed that a greater BOLD response in the medial prefrontal cortex for anticipating food compared to money positively correlated with how much children ate at the baseline and palatable buffet meals. BOLD response in the dorsolateral prefrontal cortex for winning food compared to money was positively correlated with intake at the palatable buffet meal and EAH. All aforementioned relationships were independent of child weight status. Findings support the reward surfeit model by showing that increased brain response to food compared to money rewards positively correlates with laboratory measures of food intake in children. Copyright © 2018. Published by Elsevier Ltd.

  12. Reward Processing by the Dorsal Raphe Nucleus: 5-HT and Beyond

    ERIC Educational Resources Information Center

    Luo, Minmin; Zhou, Jingfeng; Liu, Zhixiang

    2015-01-01

    The dorsal raphe nucleus (DRN) represents one of the most sensitive reward sites in the brain. However, the exact relationship between DRN neuronal activity and reward signaling has been elusive. In this review, we will summarize anatomical, pharmacological, optogenetics, and electrophysiological studies on the functions and circuit mechanisms of…

  13. Comparing the effects of food restriction and overeating on brain reward systems

    PubMed Central

    Avena, Nicole M.; Murray, Susan; Gold, Mark S.

    2014-01-01

    Both caloric restriction and overeating have been shown to affect neural processes associated with reinforcement. Both preclinical and some clinical studies have provided evidence that food restriction may increase reward sensitivity, and while there are mixed findings regarding the effects of overeating on reward sensitivity, there is strong evidence linking this behavior with changes in reward-related brain regions. Evidence of these changes comes in part from findings that show that such eating patterns are associated with increased drug use. The data discussed here regarding the differential effects of various eating patterns on reward systems may be particularly relevant to the aging population, as this population has been shown to exhibit altered reward sensitivity and decreased caloric consumption. Moreover, members of this population appear to be increasingly affected by the current obesity epidemic. Food, like alcohol or drugs, can stimulate its own consumption and produce similar neurochemical changes in the brain. Age-related loss of appetite, decreased eating, and caloric restriction are hypothesized to be associated with changes in the prevalence of substance misuse, abuse, and dependence seen in this cohort. PMID:23535488

  14. Review. Neurobiological mechanisms for opponent motivational processes in addiction.

    PubMed

    Koob, George F; Le Moal, Michel

    2008-10-12

    The conceptualization of drug addiction as a compulsive disorder with excessive drug intake and loss of control over intake requires motivational mechanisms. Opponent process as a motivational theory for the negative reinforcement of drug dependence has long required a neurobiological explanation. Key neurochemical elements involved in reward and stress within basal forebrain structures involving the ventral striatum and extended amygdala are hypothesized to be dysregulated in addiction to convey the opponent motivational processes that drive dependence. Specific neurochemical elements in these structures include not only decreases in reward neurotransmission such as dopamine and opioid peptides in the ventral striatum, but also recruitment of brain stress systems such as corticotropin-releasing factor (CRF), noradrenaline and dynorphin in the extended amygdala. Acute withdrawal from all major drugs of abuse produces increases in reward thresholds, anxiety-like responses and extracellular levels of CRF in the central nucleus of the amygdala. CRF receptor antagonists block excessive drug intake produced by dependence. A brain stress response system is hypothesized to be activated by acute excessive drug intake, to be sensitized during repeated withdrawal, to persist into protracted abstinence and to contribute to stress-induced relapse. The combination of loss of reward function and recruitment of brain stress systems provides a powerful neurochemical basis for the long hypothesized opponent motivational processes responsible for the negative reinforcement driving addiction.

  15. Illicit dopamine transients: reconciling actions of abused drugs.

    PubMed

    Covey, Dan P; Roitman, Mitchell F; Garris, Paul A

    2014-04-01

    Phasic increases in brain dopamine are required for cue-directed reward seeking. Although compelling within the framework of appetitive behavior, the view that illicit drugs hijack reward circuits by hyperactivating these dopamine transients is inconsistent with established psychostimulant pharmacology. However, recent work reclassifying amphetamine (AMPH), cocaine, and other addictive dopamine-transporter inhibitors (DAT-Is) supports transient hyperactivation as a unifying hypothesis of abused drugs. We argue here that reclassification also identifies generating burst firing by dopamine neurons as a keystone action. Unlike natural rewards, which are processed by sensory systems, drugs act directly on the brain. Consequently, to mimic natural rewards and exploit reward circuits, dopamine transients must be elicited de novo. Of available drug targets, only burst firing achieves this essential outcome. Copyright © 2014 Elsevier Ltd. All rights reserved.

  16. Somatostatin-28 modulates prepulse inhibition of the acoustic startle response, reward processes and spontaneous locomotor activity in rats

    PubMed Central

    Semenova, Svetlana; Hoyer, Daniel; Geyer, Mark A.; Markou, Athina

    2011-01-01

    Somatostatins have been shown to be involved in the pathophysiology of motor and affective disorders, as well as psychiatry disorders, including schizophrenia. We hypothesized that in addition to motor function, somatostatin may be involved in somatosensory gating and reward processes that have been shown to be dysregulated in schizophrenia. Accordingly, we evaluated the effects of intracerebroventricular administration of somatostatin-28 on spontaneous locomotor and exploratory behavior measured in a behavioral pattern monitor, sensorimotor gating, prepulse inhibition (PPI) of the acoustic startle reflex, and brain reward function (measured in a discrete trial intracranial self-stimulation procedure) in rats. Somatostatin-28 decreased spontaneous locomotor activity during the first 10 min of a 60 min testing session with no apparent changes in the exploratory activity of rats. The highest somatostatin-28 dose (10 μg/5 μl/side) induced PPI deficits with no effect on the acoustic startle response or startle response habituation. The somatostatin-induced PPI deficit was partially reversed by administration of SRA-880, a selective somatostatin 1 (sst1) receptor antagonist. Somatostatin-28 also induced elevations in brain reward thresholds, reflecting an anhedonic-like state. SRA-880 had no effect on brain reward function under baseline conditions. Altogether these findings suggest that somatostatin-28 modulates PPI and brain reward function but does not have a robust effect on spontaneous exploratory activity. Thus, increases in somatostatin transmission may represent one of the neurochemical mechanisms underlying anhedonia, one of the negative symptoms of schizophrenia, and sensorimotor gating deficits associated with cognitive impairments in schizophrenia patients. PMID:20537385

  17. Shared neural coding for social hierarchy and reward value in primate amygdala.

    PubMed

    Munuera, Jérôme; Rigotti, Mattia; Salzman, C Daniel

    2018-03-01

    The social brain hypothesis posits that dedicated neural systems process social information. In support of this, neurophysiological data have shown that some brain regions are specialized for representing faces. It remains unknown, however, whether distinct anatomical substrates also represent more complex social variables, such as the hierarchical rank of individuals within a social group. Here we show that the primate amygdala encodes the hierarchical rank of individuals in the same neuronal ensembles that encode the rewards associated with nonsocial stimuli. By contrast, orbitofrontal and anterior cingulate cortices lack strong representations of hierarchical rank while still representing reward values. These results challenge the conventional view that dedicated neural systems process social information. Instead, information about hierarchical rank-which contributes to the assessment of the social value of individuals within a group-is linked in the amygdala to representations of rewards associated with nonsocial stimuli.

  18. The role of high-frequency oscillatory activity in reward processing and learning.

    PubMed

    Marco-Pallarés, Josep; Münte, Thomas F; Rodríguez-Fornells, Antoni

    2015-02-01

    Oscillatory activity has been proposed as a key mechanism in the integration of brain activity of distant structures. Particularly, high frequency brain oscillatory activity in the beta and gamma range has received increasing interest in the domains of attention and memory. In addition, a number of recent studies have revealed an increase of beta-gamma activity (20-35 Hz) after unexpected or relevant positive reward outcomes. In the present manuscript we review the literature on this phenomenon and we propose that this activity is a brain signature elicited by unexpected positive outcomes in order to transmit a fast motivational value signal to the reward network. In addition, we hypothesize that beta-gamma oscillatory activity indexes the interaction between attentional and emotional systems, and that it directly reflects the appearance of unexpected positive rewards in learning-related contexts. Copyright © 2014 Elsevier Ltd. All rights reserved.

  19. Abnormal Reward System Activation in Mania

    PubMed Central

    Abler, Birgit; Greenhouse, Ian; Ongur, Dost; Walter, Henrik; Heckers, Stephan

    2008-01-01

    Transmission of reward signals is a function of dopamine, a neurotransmitter known to be involved in the mechanism of psychosis. Using functional magnetic resonance imaging (fMRI), we investigated how expectation and receipt of monetary rewards modulate brain activation in patients with bipolar mania and schizophrenia. We studied 12 acutely manic patients with a history of bipolar disorder, 12 patients with a current episode of schizoaffective disorder or schizophrenia and 12 healthy subjects. All patients were treated with dopamine antagonists at the time of the study. Subjects performed a delayed incentive paradigm with monetary reward in the scanner that allowed for investigating effects of expectation, receipt, and omission of rewards. Patients with schizophrenia and healthy control subjects showed the expected activation of dopaminergic brain areas, that is, ventral tegmentum activation upon expectation of monetary rewards and nucleus accumbens activation during receipt vs omission of rewards. In manic patients, however, we did not find a similar pattern of brain activation and the differential signal in the nucleus accumbens upon receipt vs omission of rewards was significantly lower compared to the healthy control subjects. Our findings provide evidence for abnormal function of the dopamine system during receipt or omission of expected rewards in bipolar disorder. These deficits in prediction error processing in acute mania may help to explain symptoms of disinhibition and abnormal goal pursuit regulation. PMID:17987058

  20. Regional brain activation supporting cognitive control in the context of reward is associated with treated adolescents’ marijuana problem severity at follow-up: A Preliminary Study

    PubMed Central

    Chung, Tammy; Paulsen, David J.; Geier, Charles F.; Luna, Beatriz; Clark, Duncan B.

    2015-01-01

    This preliminary study examined the extent to which regional brain activation during a reward cue antisaccade (AS) task was associated with 6-month treatment outcome in adolescent substance users. Antisaccade performance provides a sensitive measure of executive function and cognitive control, and generally improves with reward cues. We hypothesized that when preparing to execute an AS, greater activation in regions associated with cognitive and oculomotor control supporting AS, particularly during reward cue trials, would be associated with lower substance use severity at 6-month follow-up. Adolescents (n=14, ages 14-18) recruited from community-based outpatient treatment completed an fMRI reward cue AS task (reward and neutral conditions), and provided follow-up data. Results indicated that AS errors decreased in reward, compared to neutral, trials. AS behavioral performance, however, was not associated with treatment outcome. As hypothesized, activation in regions of interest (ROIs) associated with cognitive (e.g., ventrolateral prefrontal cortex) and oculomotor control (e.g., supplementary eye field) during reward trials were inversely correlated with marijuana problem severity at 6-months. ROI activation during neutral trials was not associated with outcomes. Results support the role of motivational (reward cue) factors to enhance cognitive control processes, and suggest a potential brain-based correlate of youth treatment outcome. PMID:26026506

  1. Dopamine reward prediction-error signalling: a two-component response

    PubMed Central

    Schultz, Wolfram

    2017-01-01

    Environmental stimuli and objects, including rewards, are often processed sequentially in the brain. Recent work suggests that the phasic dopamine reward prediction-error response follows a similar sequential pattern. An initial brief, unselective and highly sensitive increase in activity unspecifically detects a wide range of environmental stimuli, then quickly evolves into the main response component, which reflects subjective reward value and utility. This temporal evolution allows the dopamine reward prediction-error signal to optimally combine speed and accuracy. PMID:26865020

  2. Differential patterns of nucleus accumbens activation during anticipation of monetary and social reward in young and older adults

    PubMed Central

    Salama, Aallaa; Gründer, Gerhard; Spreckelmeyer, Katja N.

    2014-01-01

    Recent studies have reported inconsistent results regarding the loss of reward sensitivity in the aging brain. Although such an age effect might be due to a decline of physiological processes, it may also be a consequence of age-related changes in motivational preference for different rewards. Here, we examined whether the age effects on neural correlates of reward anticipation are modulated by the type of expected reward. Functional magnetic resonance images were acquired in 24 older (60–78 years) and 24 young participants (20–28 years) while they performed an incentive delay task offering monetary or social rewards. Anticipation of either reward type recruited brain structures associated with reward, including the nucleus accumbens (NAcc). Region of interest analysis revealed an interaction effect of reward type and age group in the right NAcc: enhanced activation to cues of social reward was detected in the older subsample while enhanced activation to cues of monetary reward was detected in the younger subsample. Our results suggest that neural sensitivity to reward-predicting cues does not generally decrease with age. Rather, neural responses in the NAcc appear to be modulated by the type of reward, presumably reflecting age-related changes in motivational value attributed to different types of reward. PMID:23547243

  3. Differential Effects of Acute Stress on Anticipatory and Consummatory Phases of Reward Processing

    PubMed Central

    Kumar, Poornima; Berghorst, Lisa H.; Nickerson, Lisa D.; Dutra, Sunny J.; Goer, Franziska; Greve, Douglas; Pizzagalli, Diego A.

    2014-01-01

    Anhedonia is one of the core symptoms of depression and has been linked to blunted responses to rewarding stimuli in striatal regions. Stress, a key vulnerability factor for depression, has been shown to induce anhedonic behavior, including reduced reward responsiveness in both animals and humans, but the brain processes associated with these effects remain largely unknown in humans. Emerging evidence suggests that stress has dissociable effects on distinct components of reward processing, as it has been found to potentiate motivation/‘wanting’ during the anticipatory phase but reduce reward responsiveness/‘liking’ during the consummatory phase. To examine the impact of stress on reward processing, we used a monetary incentive delay (MID) task and an acute stress manipulation (negative performance feedback) in conjunction with functional magnetic resonance imaging (fMRI). Fifteen healthy participants performed the MID task under no-stress and stress conditions. We hypothesized that stress would have dissociable effects on the anticipatory and consummatory phases in reward-related brain regions. Specifically, we expected reduced striatal responsiveness during reward consumption (mirroring patterns previously observed in clinical depression) and increased striatal activation during reward anticipation consistent with non-human findings. Supporting our hypotheses, significant Phase (Anticipation/Consumption) x Stress (Stress/No-stress) interactions emerged in the putamen, nucleus accumbens, caudate and amygdala. Post-hoc tests revealed that stress increased striatal and amygdalar activation during anticipation but decreased striatal activation during consumption. Importantly, stress-induced striatal blunting was similar to the profile observed in clinical depression under baseline (no-stress) conditions in prior studies. Given that stress is a pivotal vulnerability factor for depression, these results offer insight to better understand the etiology of this prevalent disorder. PMID:24508744

  4. Brain activity and infant attachment history in young men during loss and reward processing.

    PubMed

    Quevedo, Karina; Waters, Theodore E A; Scott, Hannah; Roisman, Glenn I; Shaw, Daniel S; Forbes, Erika E

    2017-05-01

    There is now ample evidence that the quality of early attachment experiences shapes expectations for supportive and responsive care and ultimately serves to scaffold adaptation to the salient tasks of development. Nonetheless, few studies have identified neural mechanisms that might give rise to these associations. Using a moderately large sample of low-income male participants recruited during infancy (N = 171), we studied the predictive significance of attachment insecurity and disorganization at age 18 months (as measured in the Strange Situation Procedure) for patterns of neural activation to reward and loss at age 20 years (assessed during a reward-based task as part of a functional magnetic resonance imaging scan). Results indicated that individuals with a history of insecure attachment showed hyperactivity in (a) reward- and emotion-related (e.g., basal ganglia and amygdala) structures and (b) emotion regulation and self-referential processing (cortical midline structures) in response to positive and negative outcomes (and anticipation of those outcomes). Further, the neural activation of individuals with a history of disorganized attachment suggested that they had greater emotional reactivity in anticipation of reward and employed greater cognitive control when negative outcomes were encountered. Overall, results suggest that the quality of early attachments has lasting impacts on brain function and reward processing.

  5. A distributed, hierarchical and recurrent framework for reward-based choice

    PubMed Central

    Hunt, Laurence T.; Hayden, Benjamin Y.

    2017-01-01

    Many accounts of reward-based choice argue for distinct component processes that are serial and functionally localized. In this article, we argue for an alternative viewpoint, in which choices emerge from repeated computations that are distributed across many brain regions. We emphasize how several features of neuroanatomy may support the implementation of choice, including mutual inhibition in recurrent neural networks and the hierarchical organisation of timescales for information processing across the cortex. This account also suggests that certain correlates of value may be emergent rather than represented explicitly in the brain. PMID:28209978

  6. Anticipatory reward processing in addicted populations: a focus on the monetary incentive delay task.

    PubMed

    Balodis, Iris M; Potenza, Marc N

    2015-03-01

    Advances in brain imaging techniques have allowed neurobiological research to temporally analyze signals coding for the anticipation of reward. In addicted populations, both hyporesponsiveness and hyperresponsiveness of brain regions (e.g., ventral striatum) implicated in drug effects and reward system processing have been reported during anticipation of generalized reward. We discuss the current state of knowledge of reward processing in addictive disorders from a widely used and validated task: the monetary incentive delay task. Only studies applying the monetary incentive delay task in addicted and at-risk adult populations are reviewed, with a focus on anticipatory processing and striatal regions activated during task performance as well as the relationship of these regions with individual difference (e.g., impulsivity) and treatment outcome variables. We further review drug influences in challenge studies as a means to examine acute influences on reward processing in abstinent, recreationally using, and addicted populations. Generalized reward processing in addicted and at-risk populations is often characterized by divergent anticipatory signaling in the ventral striatum. Although methodologic and task variations may underlie some discrepant findings, anticipatory signaling in the ventral striatum may also be influenced by smoking status, drug metabolites, and treatment status in addicted populations. Divergent results across abstinent, recreationally using, and addicted populations demonstrate complexities in interpreting findings. Future studies would benefit from focusing on characterizing how impulsivity and other addiction-related features relate to anticipatory striatal signaling over time. Additionally, identifying how anticipatory signals recover or adjust after protracted abstinence will be important in understanding recovery processes. Copyright © 2015 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

  7. Neural Processing of Calories in Brain Reward Areas Can be Modulated by Reward Sensitivity

    PubMed Central

    van Rijn, Inge; Griffioen-Roose, Sanne; de Graaf, Cees; Smeets, Paul A. M.

    2016-01-01

    A food's reward value is dependent on its caloric content. Furthermore, a food's acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity), however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015), in which participants (n = 30) tasted simple solutions of a non-caloric sweetener with or without a non-sweet carbohydrate (maltodextrin) during hunger and satiety. Secondly, we expanded these analyses to regular drinks by assessing the same relationship in data from a study in which soft drinks sweetened with either sucrose or a non-caloric sweetener were administered during hunger (n = 18) (Griffioen-Roose et al., 2013). First, taste activation by the non-caloric solution/soft drink was subtracted from that by the caloric solution/soft drink to eliminate sweetness effects and retain activation induced by calories. Subsequently, this difference in taste activation was correlated with reward sensitivity as measured with the BAS drive subscale of the Behavioral Activation System (BAS) questionnaire. When participants were hungry and tasted calories from the simple solution, brain activation in the right ventral striatum (caudate), right amygdala and anterior cingulate cortex (bilaterally) correlated negatively with BAS drive scores. In contrast, when participants were satiated, taste responses correlated positively with BAS drive scores in the left caudate. These results were not replicated for soft drinks. Thus, neural responses to oral calories from maltodextrin were modulated by reward sensitivity in reward-related brain areas. This was not the case for sucrose. This may be due to the direct detection of maltodextrin, but not sucrose in the oral cavity. Also, in a familiar beverage, detection of calories per se may be overruled by a conditioned response to its flavor. In conclusion, the brain reward response to calories from a long chain starch sugar (maltodextrin) varies with trait reward sensitivity. The absence of this effect in a familiar beverage warrants further research into its relevance for real life ingestive behavior. PMID:26834598

  8. BAS-drive trait modulates dorsomedial striatum activity during reward response-outcome associations.

    PubMed

    Costumero, Víctor; Barrós-Loscertales, Alfonso; Fuentes, Paola; Rosell-Negre, Patricia; Bustamante, Juan Carlos; Ávila, César

    2016-09-01

    According to the Reinforcement Sensitivity Theory, behavioral studies have found that individuals with stronger reward sensitivity easily detect cues of reward and establish faster associations between instrumental responses and reward. Neuroimaging studies have shown that processing anticipatory cues of reward is accompanied by stronger ventral striatum activity in individuals with stronger reward sensitivity. Even though establishing response-outcome contingencies has been consistently associated with dorsal striatum, individual differences in this process are poorly understood. Here, we aimed to study the relation between reward sensitivity and brain activity while processing response-reward contingencies. Forty-five participants completed the BIS/BAS questionnaire and performed a gambling task paradigm in which they received monetary rewards or punishments. Overall, our task replicated previous results that have related processing high reward outcomes with activation of striatum and medial frontal areas, whereas processing high punishment outcomes was associated with stronger activity in insula and middle cingulate. As expected, the individual differences in the activity of dorsomedial striatum correlated positively with BAS-Drive. Our results agree with previous studies that have related the dorsomedial striatum with instrumental performance, and suggest that the individual differences in this area may form part of the neural substrate responsible for modulating instrumental conditioning by reward sensitivity.

  9. Immediate early gene expression reveals interactions between social and nicotine rewards on brain activity in adolescent male rats

    PubMed Central

    Goenaga, Julianna; Hatch, Kayla N.; Henricks, Angela; Scott, Samantha; Hood, Lauren E.; Neisewander, Janet L.

    2016-01-01

    Smoking initiation predominantly occurs during adolescence, often in the presence of peers. Therefore, understanding the neural mechanisms underlying the rewarding effects of nicotine and social stimuli is vital. Using the conditioned place preference (CPP) procedure, we measured immediate early gene (IEG) expression in animals following exposure either to a reward-conditioned environment or to the unconditioned stimuli (US). Adolescent, male rats were assigned to the following CPP US conditions: (1) Saline + Isolated, (2) Nicotine + Isolated, (3) Saline + Social, or (4) Nicotine + Social. For Experiment 1, brain tissue was collected 90 min following the CPP expression test and processed for Fos immunohistochemistry. We found that rats conditioned with nicotine with or without a social partner exhibited CPP; however, we found no group differences in Fos expression in any brain region analyzed, with the exception of the nucleus accumbens core that exhibited a social-induced attenuation in Fos expression. For Experiment 2, brain tissue was collected 90 min following US exposure during the last conditioning session. We found social reward-induced increases in IEG expression in striatal and amydalar subregions. In contrast, nicotine reduced IEG expression in prefrontal and striatal subregions. Reward interactions were also found in the dorsolateral striatum, basolateral amygdala, and ventral tegmental area where nicotine alone attenuated IEG expression and social reward reversed this effect. These results suggest that in general social rewards enhance, whereas nicotine attenuates, activation of mesocorticolimbic regions; however, the rewards given together interact to enhance activation in some regions. The findings contribute to knowledge of how a social environment influences nicotine effects. PMID:27435419

  10. Distinct Reward Properties are Encoded via Corticostriatal Interactions

    PubMed Central

    Smith, David V.; Rigney, Anastasia E.; Delgado, Mauricio R.

    2016-01-01

    The striatum serves as a critical brain region for reward processing. Yet, understanding the link between striatum and reward presents a challenge because rewards are composed of multiple properties. Notably, affective properties modulate emotion while informative properties help obtain future rewards. We approached this problem by emphasizing affective and informative reward properties within two independent guessing games. We found that both reward properties evoked activation within the nucleus accumbens, a subregion of the striatum. Striatal responses to informative, but not affective, reward properties predicted subsequent utilization of information for obtaining monetary reward. We hypothesized that activation of the striatum may be necessary but not sufficient to encode distinct reward properties. To investigate this possibility, we examined whether affective and informative reward properties were differentially encoded in corticostriatal interactions. Strikingly, we found that the striatum exhibited dissociable connectivity patterns with the ventrolateral prefrontal cortex, with increasing connectivity for affective reward properties and decreasing connectivity for informative reward properties. Our results demonstrate that affective and informative reward properties are encoded via corticostriatal interactions. These findings highlight how corticostriatal systems contribute to reward processing, potentially advancing models linking striatal activation to behavior. PMID:26831208

  11. Distinct Reward Properties are Encoded via Corticostriatal Interactions.

    PubMed

    Smith, David V; Rigney, Anastasia E; Delgado, Mauricio R

    2016-02-02

    The striatum serves as a critical brain region for reward processing. Yet, understanding the link between striatum and reward presents a challenge because rewards are composed of multiple properties. Notably, affective properties modulate emotion while informative properties help obtain future rewards. We approached this problem by emphasizing affective and informative reward properties within two independent guessing games. We found that both reward properties evoked activation within the nucleus accumbens, a subregion of the striatum. Striatal responses to informative, but not affective, reward properties predicted subsequent utilization of information for obtaining monetary reward. We hypothesized that activation of the striatum may be necessary but not sufficient to encode distinct reward properties. To investigate this possibility, we examined whether affective and informative reward properties were differentially encoded in corticostriatal interactions. Strikingly, we found that the striatum exhibited dissociable connectivity patterns with the ventrolateral prefrontal cortex, with increasing connectivity for affective reward properties and decreasing connectivity for informative reward properties. Our results demonstrate that affective and informative reward properties are encoded via corticostriatal interactions. These findings highlight how corticostriatal systems contribute to reward processing, potentially advancing models linking striatal activation to behavior.

  12. Event-related brain potentials and the study of reward processing: Methodological considerations.

    PubMed

    Krigolson, Olave E

    2017-11-14

    There is growing interest in using electroencephalography and specifically the event-related brain potential (ERP) methodology to study human reward processing. Since the discovery of the feedback related negativity (Miltner et al., 1997) and the development of theories associating the feedback related negativity and more recently the reward positivity with reinforcement learning, midbrain dopamine function, and the anterior cingulate cortex (i.e., Holroyd and Coles, 2002) researchers have used the ERP methodology to probe the neural basis of reward learning in humans. However, examination of the feedback related negativity and the reward positivity cannot be done without an understanding of some key methodological issues that must be taken into account when using ERPs and examining these ERP components. For example, even the component name - the feedback related negativity - is a source of debate within the research community as some now strongly feel that the component should be named the reward positivity (Proudfit, 2015). Here, ten key methodological issues are discussed - confusion in component naming, the reward positivity, component identification, peak quantification and the use of difference waveforms, frequency (the N200) and component contamination (the P300), the impact of feedback timing, action, and task learnability, and how learning results in changes in the amplitude of the feedback-related negativity/reward positivity. The hope here is to not provide a definitive approach for examining the feedback related negativity/reward positivity, but instead to outline the key issues that must be taken into account when examining this component to assist researchers in their study of human reward processing with the ERP methodology. Copyright © 2017 Elsevier B.V. All rights reserved.

  13. Mutual Influence of Reward Anticipation and Emotion on Brain Activity during Memory Retrieval.

    PubMed

    Yan, Chunping; Liu, Fang; Li, Yunyun; Zhang, Qin; Cui, Lixia

    2017-01-01

    Previous studies on the joint effect of reward motivation and emotion on memory retrieval have obtained inconsistent results. Furthermore, whether and how any such joint effect might vary over time remains unclear too. Accordingly, using the event-related potential (ERP) measurement of high temporal resolution, our study investigates the cognitive and brain mechanisms of monetary reward and emotion affecting the retrieval processes of episodic memory. Twenty undergraduate and graduate students participated in the research, and our study's behavioral results indicated that reward (relative to no reward) and negative emotion (relative to positive and neutral emotion) significantly improved recognition performance. The ERP results showed that there were significant interactions between monetary reward and emotion on memory retrieval, and the reward effects of positive, neutral, and negative memory occurred at varied intervals in mean amplitude. The reward effect of positive memory appeared relatively early, at 260-330 ms after the stimulus onset in the frontal-frontocentral area, at 260-500 ms in the centroparietal-parietal area and at 500-700 ms in the frontocentral area. However, the reward effects of neutral and negative memory occurred relatively later, and that of negative memory appeared at 500-700 ms in the frontocentral and centroparietal area and that of neutral memory was at 500-700 ms in the frontocentral and centroparietal-parietal area. Meanwhile, significant FN400 old/new effects were observed in the negative and rewarded positive items, and the old/new effects of negative items appeared earlier at FN400 than positive items. Also, significant late positive component (LPC) old/new effects were found in the positive, negative, and rewarded neutral items. These results suggest that, monetary reward and negative emotion significantly improved recognition performance, and there was a mutual influence between reward and emotion on brain activity during memory retrieval.

  14. Comparing the effects of food restriction and overeating on brain reward systems.

    PubMed

    Avena, Nicole M; Murray, Susan; Gold, Mark S

    2013-10-01

    Both caloric restriction and overeating have been shown to affect neural processes associated with reinforcement. Both preclinical and some clinical studies have provided evidence that food restriction may increase reward sensitivity, and while there are mixed findings regarding the effects of overeating on reward sensitivity, there is strong evidence linking this behavior with changes in reward-related brain regions. Evidence of these changes comes in part from findings that show that such eating patterns are associated with increased drug use. The data discussed here regarding the differential effects of various eating patterns on reward systems may be particularly relevant to the aging population, as this population has been shown to exhibit altered reward sensitivity and decreased caloric consumption. Moreover, members of this population appear to be increasingly affected by the current obesity epidemic. Food, like alcohol or drugs, can stimulate its own consumption and produce similar neurochemical changes in the brain. Age-related loss of appetite, decreased eating, and caloric restriction are hypothesized to be associated with changes in the prevalence of substance misuse, abuse, and dependence seen in this cohort. Copyright © 2013 Elsevier Inc. All rights reserved.

  15. Longitudinal Changes in Behavioral Approach System Sensitivity and Brain Structures Involved in Reward Processing during Adolescence

    ERIC Educational Resources Information Center

    Urosevic, Snezana; Collins, Paul; Muetzel, Ryan; Lim, Kelvin; Luciana, Monica

    2012-01-01

    Adolescence is a period of radical normative changes and increased risk for substance use, mood disorders, and physical injury. Researchers have proposed that increases in reward sensitivity (i.e., sensitivity of the behavioral approach system [BAS]) and/or increases in reactivity to all emotional stimuli (i.e., reward and threat sensitivities)…

  16. Abnormal Frontostriatal Activity During Unexpected Reward Receipt in Depression and Schizophrenia: Relationship to Anhedonia.

    PubMed

    Segarra, Nuria; Metastasio, Antonio; Ziauddeen, Hisham; Spencer, Jennifer; Reinders, Niels R; Dudas, Robert B; Arrondo, Gonzalo; Robbins, Trevor W; Clark, Luke; Fletcher, Paul C; Murray, Graham K

    2016-07-01

    Alterations in reward processes may underlie motivational and anhedonic symptoms in depression and schizophrenia. However it remains unclear whether these alterations are disorder-specific or shared, and whether they clearly relate to symptom generation or not. We studied brain responses to unexpected rewards during a simulated slot-machine game in 24 patients with depression, 21 patients with schizophrenia, and 21 healthy controls using functional magnetic resonance imaging. We investigated relationships between brain activation, task-related motivation, and questionnaire rated anhedonia. There was reduced activation in the orbitofrontal cortex, ventral striatum, inferior temporal gyrus, and occipital cortex in both depression and schizophrenia in comparison with healthy participants during receipt of unexpected reward. In the medial prefrontal cortex both patient groups showed reduced activation, with activation significantly more abnormal in schizophrenia than depression. Anterior cingulate and medial frontal cortical activation predicted task-related motivation, which in turn predicted anhedonia severity in schizophrenia. Our findings provide evidence for overlapping hypofunction in ventral striatal and orbitofrontal regions in depression and schizophrenia during unexpected reward receipt, and for a relationship between unexpected reward processing in the medial prefrontal cortex and the generation of motivational states.

  17. Abnormal Frontostriatal Activity During Unexpected Reward Receipt in Depression and Schizophrenia: Relationship to Anhedonia

    PubMed Central

    Segarra, Nuria; Metastasio, Antonio; Ziauddeen, Hisham; Spencer, Jennifer; Reinders, Niels R; Dudas, Robert B; Arrondo, Gonzalo; Robbins, Trevor W; Clark, Luke; Fletcher, Paul C; Murray, Graham K

    2016-01-01

    Alterations in reward processes may underlie motivational and anhedonic symptoms in depression and schizophrenia. However it remains unclear whether these alterations are disorder-specific or shared, and whether they clearly relate to symptom generation or not. We studied brain responses to unexpected rewards during a simulated slot-machine game in 24 patients with depression, 21 patients with schizophrenia, and 21 healthy controls using functional magnetic resonance imaging. We investigated relationships between brain activation, task-related motivation, and questionnaire rated anhedonia. There was reduced activation in the orbitofrontal cortex, ventral striatum, inferior temporal gyrus, and occipital cortex in both depression and schizophrenia in comparison with healthy participants during receipt of unexpected reward. In the medial prefrontal cortex both patient groups showed reduced activation, with activation significantly more abnormal in schizophrenia than depression. Anterior cingulate and medial frontal cortical activation predicted task-related motivation, which in turn predicted anhedonia severity in schizophrenia. Our findings provide evidence for overlapping hypofunction in ventral striatal and orbitofrontal regions in depression and schizophrenia during unexpected reward receipt, and for a relationship between unexpected reward processing in the medial prefrontal cortex and the generation of motivational states. PMID:26708106

  18. Effects of emotional preferences on value-based decision making are mediated by mentalizing not reward networks

    PubMed Central

    Evans, Simon; Fleming, Stephen M.; Dolan, Raymond J.; Averbeck, Bruno B.

    2012-01-01

    Real-world decision-making often involves social considerations. Consequently, the social value of stimuli can induce preferences in choice behavior. However, it is unknown how financial and social values are integrated in the brain. Here, we investigated how smiling and angry face stimuli interacted with financial reward feedback in a stochastically-rewarded decision-making task. Subjects reliably preferred the smiling faces despite equivalent reward feedback, demonstrating a socially driven bias. We fit a Bayesian reinforcement learning model to factor the effects of financial rewards and emotion preferences in individual subjects, and regressed model predictions on the trial-by-trial fMRI signal. Activity in the sub-callosal cingulate and the ventral striatum, both involved in reward learning, correlated with financial reward feedback, whereas the differential contribution of social value activated dorsal temporo-parietal junction and dorsal anterior cingulate cortex, previously proposed as components of a mentalizing network. We conclude that the impact of social stimuli on value-based decision processes is mediated by effects in brain regions partially separable from classical reward circuitry. PMID:20946058

  19. Goal or gold: overlapping reward processes in soccer players upon scoring and winning money.

    PubMed

    Häusler, Alexander Niklas; Becker, Benjamin; Bartling, Marcel; Weber, Bernd

    2015-01-01

    Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning, i.e., reward probability (RP), reward reception (RR) and reward prediction errors (RPE) showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes.

  20. Goal or Gold: Overlapping Reward Processes in Soccer Players upon Scoring and Winning Money

    PubMed Central

    Häusler, Alexander Niklas; Becker, Benjamin; Bartling, Marcel; Weber, Bernd

    2015-01-01

    Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning i.e. reward probability (RP), reward reception (RR) and reward prediction errors (RPE) showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes. PMID:25875594

  1. Diminished social reward anticipation in the broad autism phenotype as revealed by event-related brain potentials

    PubMed Central

    Cox, Anthony; Kohls, Gregor; Naples, Adam J.; Mukerji, Cora E.; Coffman, Marika C.; Rutherford, Helena J. V.; Mayes, Linda C.

    2015-01-01

    Diminished responsivity to reward incentives is a key contributor to the social-communication problems seen in autism spectrum disorders (ASDs). Social motivation theories suggest that individuals with ASD do not experience social interactions as rewarding, leading to negative consequences for the development of brain circuitry subserving social information. In this study, we examined neural responses to social and non-social reward anticipation in 35 typically developing young adults, examining modulation of reward sensitivity by level of autistic traits. Using an Event-related potential incentive-delay task incorporating novel, more ecologically valid forms of reward, higher expression of autistic traits was associated with an attenuated P3 response to the anticipation of social (simulated real-time video feedback from an observer), but not non-social (candy), rewards. Exploratory analyses revealed that this was unrelated to mentalizing ability. The P3 component reflects motivated attention to reward signals, suggesting attenuated motivation allocation specific to social incentives. The study extends prior findings of atypical reward anticipation in ASD, demonstrating that attenuated social reward responsiveness extends to autistic traits in the range of typical functioning. Results support the development of innovative paradigms for investigating social and non-social reward responsiveness. Insight into vulnerabilities in reward processing is critical for understanding social function in ASD. PMID:25752905

  2. EEG to Primary Rewards: Predictive Utility and Malleability by Brain Stimulation

    PubMed Central

    Prause, Nicole; Siegle, Greg J.; Deblieck, Choi; Wu, Allan; Iacoboni, Marco

    2016-01-01

    Theta burst stimulation (TBS) is thought to affect reward processing mechanisms, which may increase and decrease reward sensitivity. To test the ability of TBS to modulate response to strong primary rewards, participants hypersensitive to primary rewards were recruited. Twenty men and women with at least two opposite-sex, sexual partners in the last year received two forms of TBS. Stimulations were randomized to avoid order effects and separated by 2 hours to reduce carryover. The two TBS forms have been demonstrated to inhibit (continuous) or excite (intermittent) the left dorsolateral prefrontal cortex using different pulse patterns, which links to brain areas associated with reward conditioning. After each TBS, participants completed tasks assessing their reward responsiveness to monetary and sexual rewards. Electroencephalography (EEG) was recorded. They also reported their number of orgasms in the weekend following stimulation. This signal was malleable by TBS, where excitatory TBS resulted in lower EEG alpha relative to inhibitory TBS to primary rewards. EEG responses to sexual rewards in the lab (following both forms of TBS) predicted the number of orgasms experienced over the forthcoming weekend. TBS may be useful in modifying hypersensitivity or hyposensitivity to primary rewards that predict sexual behaviors. Since TBS altered the anticipation of a sexual reward, TBS may offer a novel treatment for sexual desire problems. PMID:27902711

  3. EEG to Primary Rewards: Predictive Utility and Malleability by Brain Stimulation.

    PubMed

    Prause, Nicole; Siegle, Greg J; Deblieck, Choi; Wu, Allan; Iacoboni, Marco

    2016-01-01

    Theta burst stimulation (TBS) is thought to affect reward processing mechanisms, which may increase and decrease reward sensitivity. To test the ability of TBS to modulate response to strong primary rewards, participants hypersensitive to primary rewards were recruited. Twenty men and women with at least two opposite-sex, sexual partners in the last year received two forms of TBS. Stimulations were randomized to avoid order effects and separated by 2 hours to reduce carryover. The two TBS forms have been demonstrated to inhibit (continuous) or excite (intermittent) the left dorsolateral prefrontal cortex using different pulse patterns, which links to brain areas associated with reward conditioning. After each TBS, participants completed tasks assessing their reward responsiveness to monetary and sexual rewards. Electroencephalography (EEG) was recorded. They also reported their number of orgasms in the weekend following stimulation. This signal was malleable by TBS, where excitatory TBS resulted in lower EEG alpha relative to inhibitory TBS to primary rewards. EEG responses to sexual rewards in the lab (following both forms of TBS) predicted the number of orgasms experienced over the forthcoming weekend. TBS may be useful in modifying hypersensitivity or hyposensitivity to primary rewards that predict sexual behaviors. Since TBS altered the anticipation of a sexual reward, TBS may offer a novel treatment for sexual desire problems.

  4. [Cognitive Functions in the Prefrontal Association Cortex; Transitive Inference and the Lateral Prefrontal Cortex].

    PubMed

    Tanaka, Shingo; Oguchi, Mineki; Sakagami, Masamichi

    2016-11-01

    To behave appropriately in a complex and uncertain world, the brain makes use of several distinct learning systems. One such system is called the "model-free process", via which conditioning allows the association between a stimulus or response and a given reward to be learned. Another system is called the "model-based process". Via this process, the state transition between a stimulus and a response is learned so that the brain is able to plan actions prior to their execution. Several studies have tried to relate the difference between model-based and model-free processes to the difference in functions of the lateral prefrontal cortex (LPFC) and the striatum. Here, we describe a series of studies that demonstrate the ability of LPFC neurons to categorize visual stimuli by their associated behavioral responses and to generate abstract information. If LPFC neurons utilize abstract code to associate a stimulus with a reward, they should be able to infer similar relationships between other stimuli of the same category and their rewards without direct experience of these stimulus-reward contingencies. We propose that this ability of LPFC neurons to utilize abstract information can contribute to the model-based learning process.

  5. Differences in neural responses to reward and punishment processing between anorexia nervosa subtypes: An fMRI study.

    PubMed

    Murao, Ema; Sugihara, Genichi; Isobe, Masanori; Noda, Tomomi; Kawabata, Michiko; Matsukawa, Noriko; Takahashi, Hidehiko; Murai, Toshiya; Noma, Shun'ichi

    2017-09-01

    Anorexia nervosa (AN) includes the restricting (AN-r) and binge-eating/purging (AN-bp) subtypes, which have been reported to differ regarding their underlying pathophysiologies as well as their behavioral patterns. However, the differences in neural mechanisms of reward systems between AN subtypes remain unclear. The aim of the present study was to explore differences in the neural processing of reward and punishment between AN subtypes. Twenty-three female patients with AN (11 AN-r and 12 AN-bp) and 20 healthy women underwent functional magnetic resonance imaging while performing a monetary incentive delay task. Whole-brain one-way analysis of variance was conducted to test between-group differences. There were significant group differences in brain activation in the rostral anterior cingulate cortex and right posterior insula during loss anticipation, with increased brain activation in the AN-bp group relative to the AN-r and healthy women groups. No significant differences were found during gain anticipation. AN-bp patients showed altered neural responses to punishment in brain regions implicated in emotional arousal. Our findings suggest that individuals with AN-bp are more sensitive to potential punishment than individuals with AN-r and healthy individuals at the neural level. The present study provides preliminary evidence that there are neurobiological differences between AN subtypes with regard to the reward system, especially punishment processing. © 2017 The Authors. Psychiatry and Clinical Neurosciences © 2017 Japanese Society of Psychiatry and Neurology.

  6. Maternal interpersonal affiliation is associated with adolescents' brain structure and reward processing

    PubMed Central

    Schneider, S; Brassen, S; Bromberg, U; Banaschewski, T; Conrod, P; Flor, H; Gallinat, J; Garavan, Hugh; Heinz, A; Martinot, J-L; Nees, F; Rietschel, M; Smolka, M N; Ströhle, A; Struve, M; Schumann, G; Büchel, C

    2012-01-01

    Considerable animal and human research has been dedicated to the effects of parenting on structural brain development, focusing on hippocampal and prefrontal areas. Conversely, although functional imaging studies suggest that the neural reward circuitry is involved in parental affection, little is known about mothers' interpersonal qualities in relation to their children's brain structure and function. Moreover, gender differences concerning the effect of maternal qualities have rarely been investigated systematically. In 63 adolescents, we assessed structural and functional magnetic resonance imaging as well as interpersonal affiliation in their mothers. This allowed us to associate maternal affiliation with gray matter density and neural responses during different phases of the well-established Monetary Incentive Delay task. Maternal affiliation was positively associated with hippocampal and orbitofrontal gray matter density. Moreover, in the feedback of reward hit as compared with reward miss, an association with caudate activation was found. Although no significant gender effects were observed in these associations, during reward feedback as compared with baseline, maternal affiliation was significantly associated with ventral striatal and caudate activation only in females. Our findings demonstrate that maternal interpersonal affiliation is related to alterations in both the brain structure and reward-related activation in healthy adolescents. Importantly, the pattern is in line with typical findings in depression and post-traumatic stress disorder, suggesting that a lack of maternal affiliation might have a role in the genesis of mental disorders. PMID:23149446

  7. Hyporesponsive reward anticipation in the basal ganglia following severe institutional deprivation early in life.

    PubMed

    Mehta, Mitul A; Gore-Langton, Emma; Golembo, Nicole; Colvert, Emma; Williams, Steven C R; Sonuga-Barke, Edmund

    2010-10-01

    Severe deprivation in the first few years of life is associated with multiple difficulties in cognition and behavior. However, the brain basis for these difficulties is poorly understood. Structural and functional neuroimaging studies have implicated limbic system structures as dysfunctional, and one functional imaging study in a heterogeneous group of maltreated individuals has confirmed the presence of abnormalities in the basal ganglia. Based on these studies and known dopaminergic abnormalities from studies in experimental animals using social isolation, we used a task of monetary reward anticipation to examine the functional integrity of brain regions previously shown to be implicated in reward processing. Our sample included a group of adolescents (n = 12) who had experienced global deprivation early in their lives in Romania prior to adoption into UK families. In contrast to a nonadopted comparison group (n = 11), the adoptees did not recruit the striatum during reward anticipation despite comparable performance accuracy and latency. These results show, for the first time, an association between early institutional deprivation and brain reward systems in humans and highlight potential neural vulnerabilities resulting from such exposures.

  8. Deficits in context-dependent adaptive coding of reward in schizophrenia

    PubMed Central

    Kirschner, Matthias; Hager, Oliver M; Bischof, Martin; Hartmann-Riemer, Matthias N; Kluge, Agne; Seifritz, Erich; Tobler, Philippe N; Kaiser, Stefan

    2016-01-01

    Theoretical principles of information processing and empirical findings suggest that to efficiently represent all possible rewards in the natural environment, reward-sensitive neurons have to adapt their coding range dynamically to the current reward context. Adaptation ensures that the reward system is most sensitive for the most likely rewards, enabling the system to efficiently represent a potentially infinite range of reward information. A deficit in neural adaptation would prevent precise representation of rewards and could have detrimental effects for an organism’s ability to optimally engage with its environment. In schizophrenia, reward processing is known to be impaired and has been linked to different symptom dimensions. However, despite the fundamental significance of coding reward adaptively, no study has elucidated whether adaptive reward processing is impaired in schizophrenia. We therefore studied patients with schizophrenia (n=27) and healthy controls (n=25), using functional magnetic resonance imaging in combination with a variant of the monetary incentive delay task. Compared with healthy controls, patients with schizophrenia showed less efficient neural adaptation to the current reward context, which leads to imprecise neural representation of reward. Importantly, the deficit correlated with total symptom severity. Our results suggest that some of the deficits in reward processing in schizophrenia might be due to inefficient neural adaptation to the current reward context. Furthermore, because adaptive coding is a ubiquitous feature of the brain, we believe that our findings provide an avenue in defining a general impairment in neural information processing underlying this debilitating disorder. PMID:27430009

  9. Reward sensitivity modulates brain activity in the prefrontal cortex, ACC and striatum during task switching.

    PubMed

    Fuentes-Claramonte, Paola; Ávila, César; Rodríguez-Pujadas, Aina; Ventura-Campos, Noelia; Bustamante, Juan C; Costumero, Víctor; Rosell-Negre, Patricia; Barrós-Loscertales, Alfonso

    2015-01-01

    Current perspectives on cognitive control acknowledge that individual differences in motivational dispositions may modulate cognitive processes in the absence of reward contingencies. This work aimed to study the relationship between individual differences in Behavioral Activation System (BAS) sensitivity and the neural underpinnings involved in processing a switching cue in a task-switching paradigm. BAS sensitivity was hypothesized to modulate brain activity in frontal regions, ACC and the striatum. Twenty-eight healthy participants underwent fMRI while performing a switching task, which elicited activity in fronto-striatal regions during the processing of the switch cue. BAS sensitivity was negatively associated with activity in the lateral prefrontal cortex, anterior cingulate cortex and the ventral striatum. Combined with previous results, our data indicate that BAS sensitivity modulates the neurocognitive processes involved in task switching in a complex manner depending on task demands. Therefore, individual differences in motivational dispositions may influence cognitive processing in the absence of reward contingencies.

  10. Reward Sensitivity Modulates Brain Activity in the Prefrontal Cortex, ACC and Striatum during Task Switching

    PubMed Central

    Fuentes-Claramonte, Paola; Ávila, César; Rodríguez-Pujadas, Aina; Ventura-Campos, Noelia; Bustamante, Juan C.; Costumero, Víctor; Rosell-Negre, Patricia; Barrós-Loscertales, Alfonso

    2015-01-01

    Current perspectives on cognitive control acknowledge that individual differences in motivational dispositions may modulate cognitive processes in the absence of reward contingencies. This work aimed to study the relationship between individual differences in Behavioral Activation System (BAS) sensitivity and the neural underpinnings involved in processing a switching cue in a task-switching paradigm. BAS sensitivity was hypothesized to modulate brain activity in frontal regions, ACC and the striatum. Twenty-eight healthy participants underwent fMRI while performing a switching task, which elicited activity in fronto-striatal regions during the processing of the switch cue. BAS sensitivity was negatively associated with activity in the lateral prefrontal cortex, anterior cingulate cortex and the ventral striatum. Combined with previous results, our data indicate that BAS sensitivity modulates the neurocognitive processes involved in task switching in a complex manner depending on task demands. Therefore, individual differences in motivational dispositions may influence cognitive processing in the absence of reward contingencies. PMID:25875640

  11. A longitudinal examination of event-related potentials sensitive to monetary reward and loss feedback from late childhood to middle adolescence.

    PubMed

    Kujawa, Autumn; Carroll, Ashley; Mumper, Emma; Mukherjee, Dahlia; Kessel, Ellen M; Olino, Thomas; Hajcak, Greg; Klein, Daniel N

    2017-11-04

    Brain regions involved in reward processing undergo developmental changes from childhood to adolescence, and alterations in reward-related brain function are thought to contribute to the development of psychopathology. Event-related potentials (ERPs), such as the reward positivity (RewP) component, are valid measures of reward responsiveness that are easily assessed across development and provide insight into temporal dynamics of reward processing. Little work has systematically examined developmental changes in ERPs sensitive to reward. In this longitudinal study of 75 youth assessed 3 times across 6years, we used principal components analyses (PCA) to differentiate ERPs sensitive to monetary reward and loss feedback in late childhood, early adolescence, and middle adolescence. We then tested reliability of, and developmental changes in, ERPs. A greater number of ERP components differentiated reward and loss feedback in late childhood compared to adolescence, but components in childhood accounted for only a small proportion of variance. A component consistent with RewP was the only one to consistently emerge at each of the 3 assessments. RewP demonstrated acceptable reliability, particularly from early to middle adolescence, though reliability estimates varied depending on scoring approach and developmental period. The magnitude of the RewP component did not significantly change across time. Results provide insight into developmental changes in the structure of ERPs sensitive to reward, and indicate that RewP is a consistently observed and relatively stable measure of reward responsiveness, particularly across adolescence. Copyright © 2017. Published by Elsevier B.V.

  12. Reward Promotes Self-Face Processing: An Event-Related Potential Study

    PubMed Central

    Zhan, Youlong; Chen, Jie; Xiao, Xiao; Li, Jin; Yang, Zilu; Fan, Wei; Zhong, Yiping

    2016-01-01

    The present study adopted a reward-priming paradigm to investigate whether and how monetary reward cues affected self-face processing. Event-related potentials were recorded during judgments of head orientation of target faces (self, friend, and stranger), with performance associated with a monetary reward. The results showed self-faces elicited larger N2 mean amplitudes than other-faces, and mean N2 amplitudes increased after monetary reward as compared with no reward cue. Moreover, an interaction effect between cue type and face type was observed for the P3 component, suggesting that both self-faces and friend-faces elicited larger P3 mean amplitudes than stranger-faces after no reward cue, with no significant difference between self-faces and friend-faces under this condition. However, self-faces elicited larger P3 mean amplitudes than friend-faces when monetary reward cues were provided. Interestingly, the enhancement of reward on friend-faces processing was observed at late positive potentials (LPP; 450–600 ms), suggesting that the LPP difference between friend-faces and stranger-faces was enhanced with monetary reward cues. Thus, we found that the enhancement effect of reward on self-relevant processing occurred at the later stages, but not at the early stage. These findings suggest that the activation of the reward expectations can enhance self-face processing, yielding a robust and sustained modulation over their overlapped brain areas where reward and self-relevant processing mechanisms may operate together. PMID:27242637

  13. Differential patterns of nucleus accumbens activation during anticipation of monetary and social reward in young and older adults.

    PubMed

    Rademacher, Lena; Salama, Aallaa; Gründer, Gerhard; Spreckelmeyer, Katja N

    2014-06-01

    Recent studies have reported inconsistent results regarding the loss of reward sensitivity in the aging brain. Although such an age effect might be due to a decline of physiological processes, it may also be a consequence of age-related changes in motivational preference for different rewards. Here, we examined whether the age effects on neural correlates of reward anticipation are modulated by the type of expected reward. Functional magnetic resonance images were acquired in 24 older (60-78 years) and 24 young participants (20-28 years) while they performed an incentive delay task offering monetary or social rewards. Anticipation of either reward type recruited brain structures associated with reward, including the nucleus accumbens (NAcc). Region of interest analysis revealed an interaction effect of reward type and age group in the right NAcc: enhanced activation to cues of social reward was detected in the older subsample while enhanced activation to cues of monetary reward was detected in the younger subsample. Our results suggest that neural sensitivity to reward-predicting cues does not generally decrease with age. Rather, neural responses in the NAcc appear to be modulated by the type of reward, presumably reflecting age-related changes in motivational value attributed to different types of reward. © The Author (2013). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  14. Further support for association between GWAS variant for positive emotion and reward systems.

    PubMed

    Lancaster, T M; Ihssen, N; Brindley, L M; Linden, D E J

    2017-01-31

    A recent genome-wide association study (GWAS) identified a significant single-nucleotide polymorphism (SNP) for trait-positive emotion at rs322931 on chromosome 1, which was also associated with brain activation in the reward system of healthy individuals when observing positive stimuli in a functional magnetic resonance imaging (fMRI) study. In the current study, we aimed to further validate the role of variation at rs322931 in reward processing. Using a similar fMRI approach, we use two paradigms that elicit a strong ventral striatum (VS) blood oxygen-level dependency (BOLD) response in a sample of young, healthy individuals (N=82). In the first study we use a similar picture-viewing task to the discovery sample (positive>neutral stimuli) to replicate an effect of the variant on emotion processing. In the second study we use a probabilistic reversal learning procedure to identify reward processing during decision-making under uncertainly (reward>punishment). In a region of interest (ROI) analysis of the bilateral VS, we show that the rs322931 genotype was associated with BOLD in the left VS during the positive>neutral contrast (P ROI-CORRECTED =0.045) and during the reward>punishment contrast (P ROI-CORRECTED =0.018), although the effect of passive picture viewing was in the opposite direction from that reported in the discovery sample. These findings suggest that the recently identified GWAS hit may influence positive emotion via individual differences in activity in the key hubs of the brain's reward system. Furthermore, these effects may not be limited to the passive viewing of positive emotional scenes, but may also be observed during dynamic decision-making. This study suggests that future studies of this GWAS locus may yield further insight into the biological mechanisms of psychopathologies characterised by deficits in reward processing and positive emotion.

  15. Running is rewarding and antidepressive.

    PubMed

    Brené, Stefan; Bjørnebekk, Astrid; Aberg, Elin; Mathé, Aleksander A; Olson, Lars; Werme, Martin

    2007-09-10

    Natural behaviors such as eating, drinking, reproduction and exercise activate brain reward pathways and consequently the individual engages in these behaviors to receive the reward. However, drugs of abuse are even more potent in activating the reward pathways. Rewarding behaviors and addictive drugs also affect other parts of the brain not directly involved in the mediation of reward. For instance, running increases neurogenesis in hippocampus and is beneficial as an antidepressant in a genetic animal model of depression and in depressed humans. Here we discuss and compare neurochemical and functional changes in the brain after addictive drugs and exercise with a focus on brain reward pathways and hippocampus.

  16. Running is rewarding and antidepressive

    PubMed Central

    Brené, Stefan; Bjørnebekk, Astrid; Åberg, Elin; Mathé, Aleksander A; Olson, Lars; Werme, Martin

    2007-01-01

    Natural behaviors such as eating, drinking, reproduction and exercise activate brain reward pathways and consequently the individual engages in these behaviors to receive the reward. However, drugs of abuse are even more potent to activate the reward pathways. Rewarding behaviors and addictive drugs also affect other parts of the brain not directly involved in the mediation of reward. For instance, running increases neurogenesis in hippocampus and is beneficial as an antidepressant in a genetic animal model of depression and in depressed humans. Here we discuss and compare neurochemical and functional changes in the brain after addictive drugs and exercise with a focus on brain reward pathways and hippocampus. PMID:17561174

  17. The roles of valuation and reward processing in cognitive function and psychiatric disorders

    PubMed Central

    Hélie, Sébastien; Shamloo, Farzin; Novak, Keisha; Foti, Dan

    2017-01-01

    In neuroeconomics, valuation refers to the process of assigning values to states and actions based on the animal’s current representation of the environment while reward processing corresponds to processing the feedback received from the environment to update the values of states and actions. In this article, we review the brain circuits associated with valuation and reward processing and argue that these are fundamental processes critical in many cognitive functions. Specifically, we focus on the role of valuation and reward processing in attention, memory, decision–making, and learning. Next, the extant neuroimaging literature on a number of psychiatric disorders is reviewed (i.e., addiction, pathological gambling, schizophrenia, and mood disorders), and an argument is made that associated deficits in cognitive functions can be explained in terms of abnormal valuation and reward processing. The review concludes with the impact of this framework in clinical settings and prescriptions for future research, in particular with regards to the conversions of qualitatively different valuation systems into a system of common currency. PMID:28415138

  18. Perceived ownership impacts reward evaluation within medial-frontal cortex.

    PubMed

    Krigolson, Olave E; Hassall, Cameron D; Balcom, Lynsey; Turk, David

    2013-06-01

    Ownership is a powerful construct. Indeed, in a series of recent studies, perceived ownership has been shown to increase attentional capacity, facilitate a memorial advantage, and elicit positive attitudes. Here, we sought to determine whether self-relevance would bias reward evaluation systems within the brain. To accomplish this, we had participants complete a simple gambling task during which they could "win" or "lose" prizes for themselves or for someone else, while electroencephalographic data were recorded. Our results indicated that the amplitude of the feedback error-related negativity, a component of the event-related brain potential sensitive to reward evaluation, was diminished when participants were not gambling for themselves. Furthermore, our data suggest that the ownership cues that indicated who would win or lose a given gamble either were processed as a potential for an increase in utility (i.e., gain: self-gambles) or were processed in a nonutilitarian manner (other-gambles). Importantly, our results suggest that the medial-frontal reward system is sensitive to perceived ownership, to the extent that it may not process changes in utility when they are not directly relevant to self.

  19. Methylphenidate and brain activity in a reward/conflict paradigm: role of the insula in task performance.

    PubMed

    Ivanov, Iliyan; Liu, Xun; Clerkin, Suzanne; Schulz, Kurt; Fan, Jin; Friston, Karl; London, Edythe D; Schwartz, Jeffrey; Newcorn, Jeffrey H

    2014-06-01

    Psychostimulants, such as methylphenidate, are thought to improve information processing in motivation-reward and attention-activation networks by enhancing the effects of more relevant signals and suppressing those of less relevant ones; however the nature of such reciprocal influences remains poorly understood. To explore this question, we tested the effect of methylphenidate on performance and associated brain activity in the Anticipation, Conflict, Reward (ACR) task. Sixteen healthy adult volunteers, ages 21-45, were scanned twice using functional magnetic resonance imaging (fMRI) as they performed the ACR task under placebo and methylphenidate conditions. A three-way repeated measures analysis of variance, with cue (reward vs. non-reward), target (congruent vs. incongruent) and medication condition (methylphenidate vs. placebo) as the factors, was used to analyze behaviors on the task. Blood oxygen level dependent (BOLD) signals, reflecting task-related neural activity, were evaluated using linear contrasts. Participants exhibited significantly greater accuracy in the methylphenidate condition than the placebo condition. Compared with placebo, the methylphenidate condition also was associated with lesser task-related activity in components of attention-activation systems irrespective of the reward cue, and less task-related activity in components of the reward-motivation system, particularly the insula, during reward trials irrespective of target difficulty. These results suggest that methylphenidate enhances task performance by improving efficiency of information processing in both reward-motivation and in attention-activation systems. Published by Elsevier B.V.

  20. Abnormal Social Reward Responses in Anorexia Nervosa: An fMRI Study.

    PubMed

    Via, Esther; Soriano-Mas, Carles; Sánchez, Isabel; Forcano, Laura; Harrison, Ben J; Davey, Christopher G; Pujol, Jesús; Martínez-Zalacaín, Ignacio; Menchón, José M; Fernández-Aranda, Fernando; Cardoner, Narcís

    2015-01-01

    Patients with anorexia nervosa (AN) display impaired social interactions, implicated in the development and prognosis of the disorder. Importantly, social behavior is modulated by reward-based processes, and dysfunctional at-brain-level reward responses have been involved in AN neurobiological models. However, no prior evidence exists of whether these neural alterations would be equally present in social contexts. In this study, we conducted a cross-sectional social-judgment functional magnetic resonance imaging (fMRI) study of 20 restrictive-subtype AN patients and 20 matched healthy controls. Brain activity during acceptance and rejection was investigated and correlated with severity measures (Eating Disorder Inventory -EDI-2) and with personality traits of interest known to modulate social behavior (The Sensitivity to Punishment and Sensitivity to Reward Questionnaire). Patients showed hypoactivation of the dorsomedial prefrontal cortex (DMPFC) during social acceptance and hyperactivation of visual areas during social rejection. Ventral striatum activation during rejection was positively correlated in patients with clinical severity scores. During acceptance, activation of the frontal opercula-anterior insula and dorsomedial/dorsolateral prefrontal cortices was differentially associated with reward sensitivity between groups. These results suggest an abnormal motivational drive for social stimuli, and involve overlapping social cognition and reward systems leading to a disruption of adaptive responses in the processing of social reward. The specific association of reward-related regions with clinical and psychometric measures suggests the putative involvement of reward structures in the maintenance of pathological behaviors in AN.

  1. Using fMRI to study reward processing in humans: past, present, and future

    PubMed Central

    Wang, Kainan S.; Smith, David V.

    2016-01-01

    Functional magnetic resonance imaging (fMRI) is a noninvasive tool used to probe cognitive and affective processes. Although fMRI provides indirect measures of neural activity, the advent of fMRI has allowed for 1) the corroboration of significant animal findings in the human brain, and 2) the expansion of models to include more common human attributes that inform behavior. In this review, we briefly consider the neural basis of the blood oxygenation level dependent signal to set up a discussion of how fMRI studies have applied it in examining cognitive models in humans and the promise of using fMRI to advance such models. Specifically, we illustrate the contribution that fMRI has made to the study of reward processing, focusing on the role of the striatum in encoding reward-related learning signals that drive anticipatory and consummatory behaviors. For instance, we discuss how fMRI can be used to link neural signals (e.g., striatal responses to rewards) to individual differences in behavior and traits. While this functional segregation approach has been constructive to our understanding of reward-related functions, many fMRI studies have also benefitted from a functional integration approach that takes into account how interconnected regions (e.g., corticostriatal circuits) contribute to reward processing. We contend that future work using fMRI will profit from using a multimodal approach, such as combining fMRI with noninvasive brain stimulation tools (e.g., transcranial electrical stimulation), that can identify causal mechanisms underlying reward processing. Consequently, advancements in implementing fMRI will promise new translational opportunities to inform our understanding of psychopathologies. PMID:26740530

  2. Evaluation of the Social Motivation Hypothesis of Autism: A Systematic Review and Meta-analysis.

    PubMed

    Clements, Caitlin C; Zoltowski, Alisa R; Yankowitz, Lisa D; Yerys, Benjamin E; Schultz, Robert T; Herrington, John D

    2018-06-13

    The social motivation hypothesis posits that individuals with autism spectrum disorder (ASD) find social stimuli less rewarding than do people with neurotypical activity. However, functional magnetic resonance imaging (fMRI) studies of reward processing have yielded mixed results. To examine whether individuals with ASD process rewarding stimuli differently than typically developing individuals (controls), whether differences are limited to social rewards, and whether contradictory findings in the literature might be due to sample characteristics. Articles were identified in PubMed, Embase, and PsycINFO from database inception until June 1, 2017. Functional MRI data from these articles were provided by most authors. Publications were included that provided brain activation contrasts between a sample with ASD and controls on a reward task, determined by multiple reviewer consensus. When fMRI data were not provided by authors, multiple reviewers extracted peak coordinates and effect sizes from articles to recreate statistical maps using seed-based d mapping software. Random-effects meta-analyses of responses to social, nonsocial, and restricted interest stimuli, as well as all of these domains together, were performed. Secondary analyses included meta-analyses of wanting and liking, meta-regression with age, and correlations with ASD severity. All procedures were conducted in accordance with Meta-analysis of Observational Studies in Epidemiology guidelines. Brain activation differences between groups with ASD and typically developing controls while processing rewards. All analyses except the domain-general meta-analysis were planned before data collection. The meta-analysis included 13 studies (30 total fMRI contrasts) from 259 individuals with ASD and 246 controls. Autism spectrum disorder was associated with aberrant processing of both social and nonsocial rewards in striatal regions and increased activation in response to restricted interests (social reward, caudate cluster: d = -0.25 [95% CI, -0.41 to -0.08]; nonsocial reward, caudate and anterior cingulate cluster: d = -0.22 [95% CI, -0.42 to -0.02]; restricted interests, caudate and nucleus accumbens cluster: d = 0.42 [95% CI, 0.07 to 0.78]). Individuals with ASD show atypical processing of social and nonsocial rewards. Findings support a broader interpretation of the social motivation hypothesis of ASD whereby general atypical reward processing encompasses social reward, nonsocial reward, and perhaps restricted interests. This meta-analysis also suggests that prior mixed results could be driven by sample age differences, warranting further study of the developmental trajectory for reward processing in ASD.

  3. The impact of Parkinson's disease and subthalamic deep brain stimulation on reward processing.

    PubMed

    Evens, Ricarda; Stankevich, Yuliya; Dshemuchadse, Maja; Storch, Alexander; Wolz, Martin; Reichmann, Heinz; Schlaepfer, Thomas E; Goschke, Thomas; Lueken, Ulrike

    2015-08-01

    Due to its position in cortico-subthalamic and cortico-striatal pathways, the subthalamic nucleus (STN) is considered to play a crucial role not only in motor, but also in cognitive and motivational functions. In the present study we aimed to characterize how different aspects of reward processing are affected by disease and deep brain stimulation of the STN (DBS-STN) in patients with idiopathic Parkinson's disease (PD). We compared 33 PD patients treated with DBS-STN under best medical treatment (DBS-on, medication-on) to 33 PD patients without DBS, but optimized pharmacological treatment and 34 age-matched healthy controls. We then investigated DBS-STN effects using a postoperative stimulation-on/ -off design. The task set included a delay discounting task, a task to assess changes in incentive salience attribution, and the Iowa Gambling Task. The presence of PD was associated with increased incentive salience attribution and devaluation of delayed rewards. Acute DBS-STN increased risky choices in the Iowa Gambling Task under DBS-on condition, but did not further affect incentive salience attribution or the evaluation of delayed rewards. Findings indicate that acute DBS-STN affects specific aspects of reward processing, including the weighting of gains and losses, while larger-scale effects of disease or medication are predominant in others reward-related functions. Copyright © 2015 Elsevier Ltd. All rights reserved.

  4. The Nucleus Accumbens and Pavlovian Reward Learning

    PubMed Central

    Day, Jeremy J.

    2011-01-01

    The ability to form associations between predictive environmental events and rewarding outcomes is a fundamental aspect of learned behavior. This apparently simple ability likely requires complex neural processing evolved to identify, seek, and utilize natural rewards and redirect these activities based on updated sensory information. Emerging evidence from both animal and human research suggests that this type of processing is mediated in part by the nucleus accumbens and a closely associated network of brain structures. The nucleus accumbens is required for a number of reward-related behaviors, and processes specific information about reward availability, value, and context. Additionally, this structure is critical for the acquisition and expression of most Pavlovian stimulus-reward relationships, and cues that predict rewards produce robust changes in neural activity in the nucleus accumbens. While processing within the nucleus accumbens may enable or promote Pavlovian reward learning in natural situations, it has also been implicated in aspects of human drug addiction, including the ability of drug-paired cues to control behavior. This article will provide a critical review of the existing animal and human literature concerning the role of the NAc in Pavlovian learning with non-drug rewards and consider some clinical implications of these findings. PMID:17404375

  5. Fuel not fun: Reinterpreting attenuated brain responses to reward in obesity.

    PubMed

    Kroemer, Nils B; Small, Dana M

    2016-08-01

    There is a well-established literature linking obesity to altered dopamine signaling and brain response to food-related stimuli. Neuroimaging studies frequently report enhanced responses in dopaminergic regions during food anticipation and decreased responses during reward receipt. This has been interpreted as reflecting anticipatory "reward surfeit", and consummatory "reward deficiency". In particular, attenuated response in the dorsal striatum to primary food rewards is proposed to reflect anhedonia, which leads to overeating in an attempt to compensate for the reward deficit. In this paper, we propose an alternative view. We consider brain response to food-related stimuli in a reinforcement-learning framework, which can be employed to separate the contributions of reward sensitivity and reward-related learning that are typically entangled in the brain response to reward. Consequently, we posit that decreased striatal responses to milkshake receipt reflect reduced reward-related learning rather than reward deficiency or anhedonia because reduced reward sensitivity would translate uniformly into reduced anticipatory and consummatory responses to reward. By re-conceptualizing reward deficiency as a shift in learning about subjective value of rewards, we attempt to reconcile neuroimaging findings with the putative role of dopamine in effort, energy expenditure and exploration and suggest that attenuated brain responses to energy dense foods reflect the "fuel", not the fun entailed by the reward. Copyright © 2016 Elsevier Inc. All rights reserved.

  6. Deep brain stimulation of nucleus accumbens region in alcoholism affects reward processing.

    PubMed

    Heldmann, Marcus; Berding, Georg; Voges, Jürgen; Bogerts, Bernhard; Galazky, Imke; Müller, Ulf; Baillot, Gunther; Heinze, Hans-Jochen; Münte, Thomas F

    2012-01-01

    The influence of bilateral deep brain stimulation (DBS) of the nucleus nucleus (NAcc) on the processing of reward in a gambling paradigm was investigated using H(2)[(15)O]-PET (positron emission tomography) in a 38-year-old man treated for severe alcohol addiction. Behavioral data analysis revealed a less risky, more careful choice behavior under active DBS compared to DBS switched off. PET showed win- and loss-related activations in the paracingulate cortex, temporal poles, precuneus and hippocampus under active DBS, brain areas that have been implicated in action monitoring and behavioral control. Except for the temporal pole these activations were not seen when DBS was deactivated. These findings suggest that DBS of the NAcc may act partially by improving behavioral control.

  7. The Brain's Reward Response Occurs Even Without Actual Reward!

    PubMed

    Fielding, A; Fu, Y; Franz, E A

    2018-06-01

    What if the brain's response to reward occurs even when there is no reward? Wouldn't that be a further concern for people prone to problem gambling and other forms of addiction, like those related to eating? Electroencephalography was employed to investigate this possibility using probabilistic feedback manipulations and measures of known event-related potentials (ERPs) related to reward processing. We tested the hypothesis-that reward-based ERPs would occur even in the absence of a tangible reward and when manipulations on expectation are implicit. The well-known P300 response potential was a key focus, and was assessed in non-gambling volunteer undergraduates on a task involving experimentally-manipulated probabilities of positive or negative feedback comprising three trial types-80, 50, or 20% positive feedback. A feedback stimulus (F1) followed a guess response between two possible outcomes (implicit win/loss), and then a second feedback stimulus (F2) was presented to confirm an alleged 'win' or 'loss' (explicit win/loss). Results revealed that amplitude of the P300 in F1-locked data (implicit manipulation) was larger (more positive) on average for feedback outcomes that were manipulated to be less likely than expected. The effect is pronounced after increased time on task (later trials), even though the majority of participants were not explicitly aware of our probability manipulations. For the explicit effects in F2-locked data, no meaningful or significant effects were observed. These findings point to the existence of proposed success-response mechanisms that operate not only explicitly but also with implicit manipulations that do not involve any direct indication of a win or loss, and are not associated with tangible rewards. Thus, there seems to be a non-explicit form of perception (we call 'implicit') associated with an internal experience of wins/losses (in the absence of actual rewards or losses) that can be measured in associated brain processes. The potential significance of these findings is discussed in terms of implications for problem gambling.

  8. Immediate early gene expression reveals interactions between social and nicotine rewards on brain activity in adolescent male rats.

    PubMed

    Bastle, Ryan M; Peartree, Natalie A; Goenaga, Julianna; Hatch, Kayla N; Henricks, Angela; Scott, Samantha; Hood, Lauren E; Neisewander, Janet L

    2016-10-15

    Smoking initiation predominantly occurs during adolescence, often in the presence of peers. Therefore, understanding the neural mechanisms underlying the rewarding effects of nicotine and social stimuli is vital. Using the conditioned place preference (CPP) procedure, we measured immediate early gene (IEG) expression in animals following exposure either to a reward-conditioned environment or to the unconditioned stimuli (US). Adolescent, male rats were assigned to the following CPP US conditions: (1) Saline+Isolated, (2) Nicotine+Isolated, (3) Saline+Social, or (4) Nicotine+Social. For Experiment 1, brain tissue was collected 90min following the CPP expression test and processed for Fos immunohistochemistry. We found that rats conditioned with nicotine with or without a social partner exhibited CPP; however, we found no group differences in Fos expression in any brain region analyzed, with the exception of the nucleus accumbens core that exhibited a social-induced attenuation in Fos expression. For Experiment 2, brain tissue was collected 90min following US exposure during the last conditioning session. We found social reward-induced increases in IEG expression in striatal and amydalar subregions. In contrast, nicotine reduced IEG expression in prefrontal and striatal subregions. Reward interactions were also found in the dorsolateral striatum, basolateral amygdala, and ventral tegmental area where nicotine alone attenuated IEG expression and social reward reversed this effect. These results suggest that in general social rewards enhance, whereas nicotine attenuates, activation of mesocorticolimbic regions; however, the rewards given together interact to enhance activation in some regions. The findings contribute to knowledge of how a social environment influences nicotine effects. Copyright © 2016 Elsevier B.V. All rights reserved.

  9. Adaptive neural reward processing during anticipation and receipt of monetary rewards in mindfulness meditators.

    PubMed

    Kirk, Ulrich; Brown, Kirk Warren; Downar, Jonathan

    2015-05-01

    Reward seeking is ubiquitous and adaptive in humans. But excessive reward seeking behavior, such as chasing monetary rewards, may lead to diminished subjective well-being. This study examined whether individuals trained in mindfulness meditation show neural evidence of lower susceptibility to monetary rewards. Seventy-eight participants (34 meditators, 44 matched controls) completed the monetary incentive delay task while undergoing functional magnetic resonance imaging. The groups performed equally on the task, but meditators showed lower neural activations in the caudate nucleus during reward anticipation, and elevated bilateral posterior insula activation during reward anticipation. Meditators also evidenced reduced activations in the ventromedial prefrontal cortex during reward receipt compared with controls. Connectivity parameters between the right caudate and bilateral anterior insula were attenuated in meditators during incentive anticipation. In summary, brain regions involved in reward processing-both during reward anticipation and receipt of reward-responded differently in mindfulness meditators than in nonmeditators, indicating that the former are less susceptible to monetary incentives. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  10. Sex differences in the influence of body mass index on anatomical architecture of brain networks.

    PubMed

    Gupta, A; Mayer, E A; Hamadani, K; Bhatt, R; Fling, C; Alaverdyan, M; Torgerson, C; Ashe-McNalley, C; Van Horn, J D; Naliboff, B; Tillisch, K; Sanmiguel, C P; Labus, J S

    2017-08-01

    The brain has a central role in regulating ingestive behavior in obesity. Analogous to addiction behaviors, an imbalance in the processing of rewarding and salient stimuli results in maladaptive eating behaviors that override homeostatic needs. We performed network analysis based on graph theory to examine the association between body mass index (BMI) and network measures of integrity, information flow and global communication (centrality) in reward, salience and sensorimotor regions and to identify sex-related differences in these parameters. Structural and diffusion tensor imaging were obtained in a sample of 124 individuals (61 males and 63 females). Graph theory was applied to calculate anatomical network properties (centrality) for regions of the reward, salience and sensorimotor networks. General linear models with linear contrasts were performed to test for BMI and sex-related differences in measures of centrality, while controlling for age. In both males and females, individuals with high BMI (obese and overweight) had greater anatomical centrality (greater connectivity) of reward (putamen) and salience (anterior insula) network regions. Sex differences were observed both in individuals with normal and elevated BMI. In individuals with high BMI, females compared to males showed greater centrality in reward (amygdala, hippocampus and nucleus accumbens) and salience (anterior mid-cingulate cortex) regions, while males compared to females had greater centrality in reward (putamen) and sensorimotor (posterior insula) regions. In individuals with increased BMI, reward, salience and sensorimotor network regions are susceptible to topological restructuring in a sex-related manner. These findings highlight the influence of these regions on integrative processing of food-related stimuli and increased ingestive behavior in obesity, or in the influence of hedonic ingestion on brain topological restructuring. The observed sex differences emphasize the importance of considering sex differences in obesity pathophysiology.

  11. Sex Differences in the Influence of Body Mass Index on Anatomical Architecture of Brain Networks

    PubMed Central

    Gupta, Arpana; Mayer, Emeran A.; Hamadani, Kareem; Bhatt, Ravi; Fling, Connor; Alaverdyan, Mher; Torgenson, Carinna; Ashe-McNalley, Cody; Van Horn, John D; Naliboff, Bruce; Tillisch, Kirsten; Sanmiguel, Claudia P.; Labus, Jennifer S.

    2017-01-01

    Background/Objective The brain plays a central role in regulating ingestive behavior in obesity. Analogous to addiction behaviors, an imbalance in the processing of rewarding and salient stimuli results in maladaptive eating behaviors that override homeostatic needs. We performed network analysis based on graph theory to examine the association between body mass index (BMI) and network measures of integrity, information flow, and global communication (centrality) in reward, salience and sensorimotor regions, and to identify sex-related differences in these parameters. Subjects/Methods Structural and diffusion tensor imaging were obtained in a sample of 124 individuals (61 males and 63 females). Graph theory was applied to calculate anatomical network properties (centrality) for regions of the reward, salience, and sensorimotor networks. General linear models with linear contrasts were performed to test for BMI and sex-related differences in measures of centrality, while controlling for age. Results In both males and females, individuals with high BMI (obese and overweight) had greater anatomical centrality (greater connectivity) of reward (putamen) and salience (anterior insula) network regions. Sex differences were observed both in individuals with normal and elevated BMI. In individuals with high BMI, females compared to males showed greater centrality in reward (amygdala, hippocampus, nucleus accumbens) and salience (anterior mid cingulate cortex) regions, while males compared to females had greater centrality in reward (putamen) and sensorimotor (posterior insula) regions. Conclusions In individuals with increased BMI, reward, salience, and sensorimotor network regions are susceptible to topological restructuring in a sex related manner. These findings highlight the influence of these regions on integrative processing of food-related stimuli and increased ingestive behavior in obesity, or in the influence of hedonic ingestion on brain topological restructuring. The observed sex differences emphasize the importance of considering sex differences in obesity pathophysiology. PMID:28360430

  12. Reward processing by the lateral habenula in normal and depressive behaviors

    PubMed Central

    Proulx, Christophe D.; Hikosaka, Okihide; Malinow, Roberto

    2015-01-01

    The brain reward circuit has a central role in reinforcing behaviors that are rewarding and preventing behaviors that lead to punishment. Recent work has shown that the lateral habenula is an important part of the reward circuit by providing ‘negative value’ signals to the dopaminergic and serotonergic systems. Studies also suggest that dysfunction of the lateral habenula is associated with psychiatric disorders including major depression. In this review, we first discuss insights gained from neuronal recordings in monkeys regarding how the lateral habenula processes reward-related information. We next highlight recent optogenetic experiments in rodents addressing normal and abnormal functions of the habenula. Finally, we discuss how deregulation of the lateral habenula may play a role in depressive behaviors. PMID:25157511

  13. Circadian misalignment, reward-related brain function, and adolescent alcohol involvement.

    PubMed

    Hasler, Brant P; Clark, Duncan B

    2013-04-01

    Developmental changes in sleep and circadian rhythms that occur during adolescence may contribute to reward-related brain dysfunction, and consequently increase the risk of alcohol use disorders (AUDs). This review (i) describes marked changes in circadian rhythms, reward-related behavior and brain function, and alcohol involvement that occur during adolescence, (ii) offers evidence that these parallel developmental changes are associated, and (iii) posits a conceptual model by which misalignment between sleep-wake timing and endogenous circadian timing may increase the risk of adolescent AUDs by altering reward-related brain function. The timing of sleep shifts later throughout adolescence, in part due to developmental changes in endogenous circadian rhythms, which tend to become more delayed. This tendency for delayed sleep and circadian rhythms is at odds with early school start times during secondary education, leading to misalignment between many adolescents' sleep-wake schedules and their internal circadian timing. Circadian misalignment is associated with increased alcohol use and other risk-taking behaviors, as well as sleep loss and sleep disturbance. Growing evidence indicates that circadian rhythms modulate the reward system, suggesting that circadian misalignment may impact adolescent alcohol involvement by altering reward-related brain function. Neurocognitive function is also subject to sleep and circadian influence, and thus circadian misalignment may also impair inhibitory control and other cognitive processes relevant to alcohol use. Specifically, circadian misalignment may further exacerbate the cortical-subcortical imbalance within the reward circuit, an imbalance thought to explain increased risk-taking and sensation-seeking during adolescence. Adolescent alcohol use is highly contextualized, however, and thus studies testing this model will also need to consider factors that may influence both circadian misalignment and alcohol use. This review highlights growing evidence supporting a path by which circadian misalignment may disrupt reward mechanisms, which may in turn accelerate the transition from alcohol use to AUDs in vulnerable adolescents. Copyright © 2013 by the Research Society on Alcoholism.

  14. Diminished social reward anticipation in the broad autism phenotype as revealed by event-related brain potentials.

    PubMed

    Cox, Anthony; Kohls, Gregor; Naples, Adam J; Mukerji, Cora E; Coffman, Marika C; Rutherford, Helena J V; Mayes, Linda C; McPartland, James C

    2015-10-01

    Diminished responsivity to reward incentives is a key contributor to the social-communication problems seen in autism spectrum disorders (ASDs). Social motivation theories suggest that individuals with ASD do not experience social interactions as rewarding, leading to negative consequences for the development of brain circuitry subserving social information. In this study, we examined neural responses to social and non-social reward anticipation in 35 typically developing young adults, examining modulation of reward sensitivity by level of autistic traits. Using an Event-related potential incentive-delay task incorporating novel, more ecologically valid forms of reward, higher expression of autistic traits was associated with an attenuated P3 response to the anticipation of social (simulated real-time video feedback from an observer), but not non-social (candy), rewards. Exploratory analyses revealed that this was unrelated to mentalizing ability. The P3 component reflects motivated attention to reward signals, suggesting attenuated motivation allocation specific to social incentives. The study extends prior findings of atypical reward anticipation in ASD, demonstrating that attenuated social reward responsiveness extends to autistic traits in the range of typical functioning. Results support the development of innovative paradigms for investigating social and non-social reward responsiveness. Insight into vulnerabilities in reward processing is critical for understanding social function in ASD. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  15. Striatal response to favorite brands as a function of neuroticism and extraversion.

    PubMed

    Schaefer, Michael; Knuth, Michael; Rumpel, Franziska

    2011-11-24

    Recent research has demonstrated that the perception of favorite brands involves similar brain networks than artificially associated reward stimuli. This has been explained by the association of brands with appetitive stimuli due to marketing efforts. Thereby, strong emotional bonds between the brand and the customer may be established. Furthermore, previous studies have shown that the personality dimension extraversion can be linked with the dopaminergic system and reward-sensitive brain areas. The current study aimed to examine if personality traits are associated with the perception of brands as rewarding stimuli. In order to test this hypothesis we conducted an fMRI study in which we presented pictures of chocolate brands, which participants had to rate according to their personal attraction. The personality traits were assessed according to the Five-Factor-Model. Results revealed that favorite brands engaged reward-related brain areas (ventral striatum). This activation was significantly correlated with the degree of extraversion and neuroticism of the participants. Thus, the results demonstrate that personality traits are closely associated with the perception of brands as rewarding stimuli. We discuss the results with recent studies on the neuronal substrates of reward related processing of cultural objects and the role of personality in brand loyalty. Copyright © 2011 Elsevier B.V. All rights reserved.

  16. Reward, salience, and attentional networks are activated by religious experience in devout Mormons

    PubMed Central

    Ferguson, Michael A.; Nielsen, Jared A.; King, Jace B.; Dai, Li; Giangrasso, Danielle M.; Holman, Rachel; Korenberg, Julie R.; Anderson, Jeffrey S.

    2017-01-01

    High-level cognitive and emotional experience arises from brain activity, but the specific brain substrates for religious and spiritual euphoria remain unclear. We demonstrate using functional magnetic resonance imaging scans in 19 devout Mormons that a recognizable feeling central to their devotional practice was reproducibly associated with activation in nucleus accumbens, ventromedial prefrontal cortex, and frontal attentional regions. Nucleus accumbens activation preceded peak spiritual feelings by 1–3 s and was replicated in four separate tasks. Attentional activation in the anterior cingulate and frontal eye fields was greater in the right hemisphere. The association of abstract ideas and brain reward circuitry may interact with frontal attentional and emotive salience processing, suggesting a mechanism whereby doctrinal concepts may come to be intrinsically rewarding and motivate behavior in religious individuals. PMID:27834117

  17. Changes in reward-induced brain activation in opiate addicts.

    PubMed

    Martin-Soelch, C; Chevalley, A F; Künig, G; Missimer, J; Magyar, S; Mino, A; Schultz, W; Leenders, K L

    2001-10-01

    Many studies indicate a role of the cerebral dopaminergic reward system in addiction. Motivated by these findings, we examined in opiate addicts whether brain regions involved in the reward circuitry also react to human prototypical rewards. We measured regional cerebral blood flow (rCBF) with H(2)(15)O positron emission tomography (PET) during a visuo-spatial recognition task with delayed response in control subjects and in opiate addicts participating in a methadone program. Three conditions were defined by the types of feedback: nonsense feedback; nonmonetary reinforcement; or monetary reward, received by the subjects for a correct response. We found in the control subjects rCBF increases in regions associated with the meso-striatal and meso-corticolimbic circuits in response to both monetary reward and nonmonetary reinforcement. In opiate addicts, these regions were activated only in response to monetary reward. Furthermore, nonmonetary reinforcement elicited rCBF increases in limbic regions of the opiate addicts that were not activated in the control subjects. Because psychoactive drugs serve as rewards and directly affect regions of the dopaminergic system like the striatum, we conclude that the differences in rCBF increases between controls and addicts can be attributed to an adaptive consequence of the addiction process.

  18. The amygdala and basal forebrain as a pathway for motivationally guided attention.

    PubMed

    Peck, Christopher J; Salzman, C Daniel

    2014-10-08

    Visual stimuli associated with rewards attract spatial attention. Neurophysiological mechanisms that mediate this process must register both the motivational significance and location of visual stimuli. Recent neurophysiological evidence indicates that the amygdala encodes information about both of these parameters. Furthermore, the firing rate of amygdala neurons predicts the allocation of spatial attention. One neural pathway through which the amygdala might influence attention involves the intimate and bidirectional connections between the amygdala and basal forebrain (BF), a brain area long implicated in attention. Neurons in the rhesus monkey amygdala and BF were therefore recorded simultaneously while subjects performed a detection task in which the stimulus-reward associations of visual stimuli modulated spatial attention. Neurons in BF were spatially selective for reward-predictive stimuli, much like the amygdala. The onset of reward-predictive signals in each brain area suggested different routes of processing for reward-predictive stimuli appearing in the ipsilateral and contralateral fields. Moreover, neurons in the amygdala, but not BF, tracked trial-to-trial fluctuations in spatial attention. These results suggest that the amygdala and BF could play distinct yet inter-related roles in influencing attention elicited by reward-predictive stimuli. Copyright © 2014 the authors 0270-6474/14/3413757-11$15.00/0.

  19. A Systematic Review of fMRI Reward Paradigms in Adolescents versus Adults: The Impact of Task Design and Implications for Understanding Neurodevelopment

    PubMed Central

    Richards, Jessica M.; Plate, Rista C.; Ernst, Monique

    2013-01-01

    The neural systems underlying reward-related behaviors across development have recently generated a great amount of interest. Yet, the neurodevelopmental literature on reward processing is marked by inconsistencies due to the heterogeneity of the reward paradigms used, the complexity of the behaviors being studied, and the developing brain itself as a moving target. The present review will examine task design as one source of variability across findings by compiling this literature along three dimensions: (1) task structures, (2) cognitive processes, and (3) neural systems. We start with the presentation of a heuristic neural systems model, the Triadic Model, as a way to provide a theoretical framework for the neuroscience research on motivated behaviors. We then discuss the principles guiding reward task development. Finally, we review the extant developmental neuroimaging literature on reward-related processing, organized by reward task type. We hope that this approach will help to clarify the literature on the functional neurodevelopment of reward-related neural systems, and to identify the role of the experimental parameters that significantly influence these findings. PMID:23518270

  20. Differential effects of fructose versus glucose on brain and appetitive responses to food cues and decisions for food rewards.

    PubMed

    Luo, Shan; Monterosso, John R; Sarpelleh, Kayan; Page, Kathleen A

    2015-05-19

    Prior studies suggest that fructose compared with glucose may be a weaker suppressor of appetite, and neuroimaging research shows that food cues trigger greater brain reward responses in a fasted relative to a fed state. We sought to determine the effects of ingesting fructose versus glucose on brain, hormone, and appetitive responses to food cues and food-approach behavior. Twenty-four healthy volunteers underwent two functional magnetic resonance imaging (fMRI) sessions with ingestion of either fructose or glucose in a double-blinded, random-order cross-over design. fMRI was performed while participants viewed images of high-calorie foods and nonfood items using a block design. After each block, participants rated hunger and desire for food. Participants also performed a decision task in which they chose between immediate food rewards and delayed monetary bonuses. Hormones were measured at baseline and 30 and 60 min after drink ingestion. Ingestion of fructose relative to glucose resulted in smaller increases in plasma insulin levels and greater brain reactivity to food cues in the visual cortex (in whole-brain analysis) and left orbital frontal cortex (in region-of-interest analysis). Parallel to the neuroimaging findings, fructose versus glucose led to greater hunger and desire for food and a greater willingness to give up long-term monetary rewards to obtain immediate high-calorie foods. These findings suggest that ingestion of fructose relative to glucose results in greater activation of brain regions involved in attention and reward processing and may promote feeding behavior.

  1. Differential effects of fructose versus glucose on brain and appetitive responses to food cues and decisions for food rewards

    PubMed Central

    Luo, Shan; Monterosso, John R.; Sarpelleh, Kayan; Page, Kathleen A.

    2015-01-01

    Prior studies suggest that fructose compared with glucose may be a weaker suppressor of appetite, and neuroimaging research shows that food cues trigger greater brain reward responses in a fasted relative to a fed state. We sought to determine the effects of ingesting fructose versus glucose on brain, hormone, and appetitive responses to food cues and food-approach behavior. Twenty-four healthy volunteers underwent two functional magnetic resonance imaging (fMRI) sessions with ingestion of either fructose or glucose in a double-blinded, random-order cross-over design. fMRI was performed while participants viewed images of high-calorie foods and nonfood items using a block design. After each block, participants rated hunger and desire for food. Participants also performed a decision task in which they chose between immediate food rewards and delayed monetary bonuses. Hormones were measured at baseline and 30 and 60 min after drink ingestion. Ingestion of fructose relative to glucose resulted in smaller increases in plasma insulin levels and greater brain reactivity to food cues in the visual cortex (in whole-brain analysis) and left orbital frontal cortex (in region-of-interest analysis). Parallel to the neuroimaging findings, fructose versus glucose led to greater hunger and desire for food and a greater willingness to give up long-term monetary rewards to obtain immediate high-calorie foods. These findings suggest that ingestion of fructose relative to glucose results in greater activation of brain regions involved in attention and reward processing and may promote feeding behavior. PMID:25941364

  2. Reward-related brain function and sleep in pre/early pubertal and mid/late pubertal adolescents.

    PubMed

    Holm, Stephanie M; Forbes, Erika E; Ryan, Neal D; Phillips, Mary L; Tarr, Jill A; Dahl, Ronald E

    2009-10-01

    The onset of adolescence is a time of dramatic changes, including changes in sleep, and a time of new health concerns related to increases in risk-taking, sensation seeking, depression, substance use, and accidents. As part of a larger study examining puberty-specific changes in adolescents' reward-related brain function, the current article focuses on the relationship between functional neuroimaging measures of reward and measures of sleep. A total of 58 healthy participants 11-13 years of age completed a functional magnetic resonance imaging scan using a guessing task with monetary rewards and 4 days of at-home actigraphy and self-reported sleep ratings. Sleep variables included actigraph measures of mean weekend minutes asleep, sleep onset time, and sleep offset time, as well as self-reported sleep quality. During reward anticipation, less activation in the caudate (part of the ventral striatum) was associated with fewer minutes asleep, later sleep onset time, and lower sleep quality. During reward outcome, less caudate activation was associated with later sleep onset time, earlier sleep offset time, and lower sleep quality. It has been hypothesized that adolescents' low reactivity in reward-related brain areas could lead to compensatory increases in reward-driven behavior. This study's findings suggest that sleep could contribute to such behavior. Because decreased sleep has been associated with risky behavior and negative mood, these findings raise concerns about a negative spiral whereby the effects of puberty and sleep deprivation may have synergistic effects on reward processing, contributing to adolescent behavioral and emotional health problems.

  3. Neural correlates of reward processing in adults with 22q11 deletion syndrome.

    PubMed

    van Duin, Esther D A; Goossens, Liesbet; Hernaus, Dennis; da Silva Alves, Fabiana; Schmitz, Nicole; Schruers, Koen; van Amelsvoort, Therese

    2016-01-01

    22q11.2 deletion syndrome (22q11DS) is caused by a microdeletion on chromosome 22q11.2 and associated with an increased risk to develop psychosis. The gene coding for catechol-O-methyl-transferase (COMT) is located at the deleted region, resulting in disrupted dopaminergic neurotransmission in 22q11DS, which may contribute to the increased vulnerability for psychosis. A dysfunctional motivational reward system is considered one of the salient features in psychosis and thought to be related to abnormal dopaminergic neurotransmission. The functional anatomy of the brain reward circuitry has not yet been investigated in 22q11DS. This study aims to investigate neural activity during anticipation of reward and loss in adult patients with 22q11DS. We measured blood-oxygen-level dependent (BOLD) activity in 16 patients with 22q11DS and 12 healthy controls during a monetary incentive delay task using a 3T Philips Intera MRI system. Data were analysed using SPM8. During anticipation of reward, the 22q11DS group alone displayed significant activation in bilateral middle frontal and temporal brain regions. Compared to healthy controls, significantly less activation in bilateral cingulate gyrus extending to premotor, primary motor and somatosensory areas was found. During anticipation of loss, the 22q11DS group displayed activity in the left middle frontal gyrus and anterior cingulate cortex, and relative to controls, they showed reduced brain activation in bilateral (pre)cuneus and left posterior cingulate. Within the 22q11DS group, COMT Val hemizygotes displayed more activation compared to Met hemizygotes in right posterior cingulate and bilateral parietal regions during anticipation of reward. During anticipation of loss, COMT Met hemizygotes compared to Val hemizygotes showed more activation in bilateral insula, striatum and left anterior cingulate. This is the first study to investigate reward processing in 22q11DS. Our preliminary results suggest that people with 22q11DS engage a fronto-temporal neural network. Compared to healthy controls, people with 22q11DS primarily displayed reduced activity in medial frontal regions during reward anticipation. COMT hemizygosity affects responsivity of the reward system in this condition. Alterations in reward processing partly underlain by the dopamine system may play a role in susceptibility for psychosis in 22q11DS.

  4. Brain Systems for Assessing Facial Attractiveness

    ERIC Educational Resources Information Center

    Winston, Joel S.; O'Doherty, John; Kilner, James M.; Perrett, David I.; Dolan, Raymond J.

    2007-01-01

    Attractiveness is a facial attribute that shapes human affiliative behaviours. In a previous study we reported a linear response to facial attractiveness in orbitofrontal cortex (OFC), a region involved in reward processing. There are strong theoretical grounds for the hypothesis that coding stimulus reward value also involves the amygdala. The…

  5. Just watching the game ain't enough: striatal fMRI reward responses to successes and failures in a video game during active and vicarious playing

    PubMed Central

    Kätsyri, Jari; Hari, Riitta; Ravaja, Niklas; Nummenmaa, Lauri

    2013-01-01

    Although the multimodal stimulation provided by modern audiovisual video games is pleasing by itself, the rewarding nature of video game playing depends critically also on the players' active engagement in the gameplay. The extent to which active engagement influences dopaminergic brain reward circuit responses remains unsettled. Here we show that striatal reward circuit responses elicited by successes (wins) and failures (losses) in a video game are stronger during active than vicarious gameplay. Eleven healthy males both played a competitive first-person tank shooter game (active playing) and watched a pre-recorded gameplay video (vicarious playing) while their hemodynamic brain activation was measured with 3-tesla functional magnetic resonance imaging (fMRI). Wins and losses were paired with symmetrical monetary rewards and punishments during active and vicarious playing so that the external reward context remained identical during both conditions. Brain activation was stronger in the orbitomedial prefrontal cortex (omPFC) during winning than losing, both during active and vicarious playing. In contrast, both wins and losses suppressed activations in the midbrain and striatum during active playing; however, the striatal suppression, particularly in the anterior putamen, was more pronounced during loss than win events. Sensorimotor confounds related to joystick movements did not account for the results. Self-ratings indicated losing to be more unpleasant during active than vicarious playing. Our findings demonstrate striatum to be selectively sensitive to self-acquired rewards, in contrast to frontal components of the reward circuit that process both self-acquired and passively received rewards. We propose that the striatal responses to repeated acquisition of rewards that are contingent on game related successes contribute to the motivational pull of video-game playing. PMID:23781195

  6. Just watching the game ain't enough: striatal fMRI reward responses to successes and failures in a video game during active and vicarious playing.

    PubMed

    Kätsyri, Jari; Hari, Riitta; Ravaja, Niklas; Nummenmaa, Lauri

    2013-01-01

    Although the multimodal stimulation provided by modern audiovisual video games is pleasing by itself, the rewarding nature of video game playing depends critically also on the players' active engagement in the gameplay. The extent to which active engagement influences dopaminergic brain reward circuit responses remains unsettled. Here we show that striatal reward circuit responses elicited by successes (wins) and failures (losses) in a video game are stronger during active than vicarious gameplay. Eleven healthy males both played a competitive first-person tank shooter game (active playing) and watched a pre-recorded gameplay video (vicarious playing) while their hemodynamic brain activation was measured with 3-tesla functional magnetic resonance imaging (fMRI). Wins and losses were paired with symmetrical monetary rewards and punishments during active and vicarious playing so that the external reward context remained identical during both conditions. Brain activation was stronger in the orbitomedial prefrontal cortex (omPFC) during winning than losing, both during active and vicarious playing. In contrast, both wins and losses suppressed activations in the midbrain and striatum during active playing; however, the striatal suppression, particularly in the anterior putamen, was more pronounced during loss than win events. Sensorimotor confounds related to joystick movements did not account for the results. Self-ratings indicated losing to be more unpleasant during active than vicarious playing. Our findings demonstrate striatum to be selectively sensitive to self-acquired rewards, in contrast to frontal components of the reward circuit that process both self-acquired and passively received rewards. We propose that the striatal responses to repeated acquisition of rewards that are contingent on game related successes contribute to the motivational pull of video-game playing.

  7. Deep brain stimulation in the central nucleus of the amygdala decreases 'wanting' and 'liking' of food rewards.

    PubMed

    Ross, Shani E; Lehmann Levin, Emily; Itoga, Christy A; Schoen, Chelsea B; Selmane, Romeissa; Aldridge, J Wayne

    2016-10-01

    We investigated the potential of deep brain stimulation (DBS) in the central nucleus of the amygdala (CeA) in rats to modulate functional reward mechanisms. The CeA is the major output of the amygdala with direct connections to the hypothalamus and gustatory brainstem, and indirect connections with the nucleus accumbens. Further, the CeA has been shown to be involved in learning, emotional integration, reward processing, and regulation of feeding. We hypothesized that DBS, which is used to treat movement disorders and other brain dysfunctions, might block reward motivation. In rats performing a lever-pressing task to obtain sugar pellet rewards, we stimulated the CeA and control structures, and compared stimulation parameters. During CeA stimulation, animals stopped working for rewards and rejected freely available rewards. Taste reactivity testing during DBS exposed aversive reactions to normally liked sucrose tastes and even more aversive taste reactions to normally disliked quinine tastes. Interestingly, given the opportunity, animals implanted in the CeA would self-stimulate with 500 ms trains of stimulation at the same frequency and current parameters as continuous stimulation that would stop reward acquisition. Neural recordings during DBS showed that CeA neurons were still active and uncovered inhibitory-excitatory patterns after each stimulus pulse indicating possible entrainment of the neural firing with DBS. In summary, DBS modulation of CeA may effectively usurp normal neural activity patterns to create an 'information lesion' that not only decreased motivational 'wanting' of food rewards, but also blocked 'liking' of rewards. © 2016 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

  8. Altered prefrontal correlates of monetary anticipation and outcome in chronic pain.

    PubMed

    Martucci, Katherine T; Borg, Nicholas; MacNiven, Kelly H; Knutson, Brian; Mackey, Sean C

    2018-04-04

    Chronic pain may alter both affect- and value-related behaviors, which represents a potentially treatable aspect of chronic pain experience. Current understanding of how chronic pain influences the function of brain reward systems, however, is limited. Using a monetary incentive delay task and functional magnetic resonance imaging (fMRI), we measured neural correlates of reward anticipation and outcomes in female participants with the chronic pain condition of fibromyalgia (N = 17) and age-matched, pain-free, female controls (N = 15). We hypothesized that patients would demonstrate lower positive arousal, as well as altered reward anticipation and outcome activity within corticostriatal circuits implicated in reward processing. Patients demonstrated lower arousal ratings as compared with controls, but no group differences were observed for valence, positive arousal, or negative arousal ratings. Group fMRI analyses were conducted to determine predetermined region of interest, nucleus accumbens (NAcc) and medial prefrontal cortex (mPFC), responses to potential gains, potential losses, reward outcomes, and punishment outcomes. Compared with controls, patients demonstrated similar, although slightly reduced, NAcc activity during gain anticipation. Conversely, patients demonstrated dramatically reduced mPFC activity during gain anticipation-possibly related to lower estimated reward probabilities. Further, patients demonstrated normal mPFC activity to reward outcomes, but dramatically heightened mPFC activity to no-loss (nonpunishment) outcomes. In parallel to NAcc and mPFC responses, patients demonstrated slightly reduced activity during reward anticipation in other brain regions, which included the ventral tegmental area, anterior cingulate cortex, and anterior insular cortex. Together, these results implicate altered corticostriatal processing of monetary rewards in chronic pain.

  9. The influence of motherhood on neural systems for reward processing in low income, minority, young women.

    PubMed

    Moses-Kolko, Eydie L; Forbes, Erika E; Stepp, Stephanie; Fraser, David; Keenan, Kate E; Guyer, Amanda E; Chase, Henry W; Phillips, Mary L; Zevallos, Carlos R; Guo, Chaohui; Hipwell, Alison E

    2016-04-01

    Given the association between maternal caregiving behavior and heightened neural reward activity in experimental animal studies, the present study examined whether motherhood in humans positively modulates reward-processing neural circuits, even among mothers exposed to various life stressors and depression. Subjects were 77 first-time mothers and 126 nulliparous young women from the Pittsburgh Girls Study, a longitudinal study beginning in childhood. Subjects underwent a monetary reward task during functional magnetic resonance imaging in addition to assessment of current depressive symptoms. Life stress was measured by averaging data collected between ages 8-15 years. Using a region-of-interest approach, we conducted hierarchical regression to examine the relationship of psychosocial factors (life stress and current depression) and motherhood with extracted ventral striatal (VST) response to reward anticipation. Whole-brain regression analyses were performed post-hoc to explore non-striatal regions associated with reward anticipation in mothers vs nulliparous women. Anticipation of monetary reward was associated with increased neural activity in expected regions including caudate, orbitofrontal, occipital, superior and middle frontal cortices. There was no main effect of motherhood nor motherhood-by-psychosocial factor interaction effect on VST response during reward anticipation. Depressive symptoms were associated with increased VST activity across the entire sample. In exploratory whole brain analysis, motherhood was associated with increased somatosensory cortex activity to reward (FWE cluster forming threshold p<0.001). These findings indicate that motherhood is not associated with reward anticipation-related VST activity nor does motherhood modulate the impact of depression or life stress on VST activity. Future studies are needed to evaluate whether earlier postpartum assessment of reward function, inclusion of mothers with more severe depressive symptoms, and use of reward tasks specific for social reward might reveal an impact of motherhood on reward system activity. Copyright © 2016 Elsevier Ltd. All rights reserved.

  10. Individualized relapse prediction: Personality measures and striatal and insular activity during reward-processing robustly predict relapse.

    PubMed

    Gowin, Joshua L; Ball, Tali M; Wittmann, Marc; Tapert, Susan F; Paulus, Martin P

    2015-07-01

    Nearly half of individuals with substance use disorders relapse in the year after treatment. A diagnostic tool to help clinicians make decisions regarding treatment does not exist for psychiatric conditions. Identifying individuals with high risk for relapse to substance use following abstinence has profound clinical consequences. This study aimed to develop neuroimaging as a robust tool to predict relapse. 68 methamphetamine-dependent adults (15 female) were recruited from 28-day inpatient treatment. During treatment, participants completed a functional MRI scan that examined brain activation during reward processing. Patients were followed 1 year later to assess abstinence. We examined brain activation during reward processing between relapsing and abstaining individuals and employed three random forest prediction models (clinical and personality measures, neuroimaging measures, a combined model) to generate predictions for each participant regarding their relapse likelihood. 18 individuals relapsed. There were significant group by reward-size interactions for neural activation in the left insula and right striatum for rewards. Abstaining individuals showed increased activation for large, risky relative to small, safe rewards, whereas relapsing individuals failed to show differential activation between reward types. All three random forest models yielded good test characteristics such that a positive test for relapse yielded a likelihood ratio 2.63, whereas a negative test had a likelihood ratio of 0.48. These findings suggest that neuroimaging can be developed in combination with other measures as an instrument to predict relapse, advancing tools providers can use to make decisions about individualized treatment of substance use disorders. Published by Elsevier Ireland Ltd.

  11. Mutual Influence of Reward Anticipation and Emotion on Brain Activity during Memory Retrieval

    PubMed Central

    Yan, Chunping; Liu, Fang; Li, Yunyun; Zhang, Qin; Cui, Lixia

    2017-01-01

    Previous studies on the joint effect of reward motivation and emotion on memory retrieval have obtained inconsistent results. Furthermore, whether and how any such joint effect might vary over time remains unclear too. Accordingly, using the event-related potential (ERP) measurement of high temporal resolution, our study investigates the cognitive and brain mechanisms of monetary reward and emotion affecting the retrieval processes of episodic memory. Twenty undergraduate and graduate students participated in the research, and our study’s behavioral results indicated that reward (relative to no reward) and negative emotion (relative to positive and neutral emotion) significantly improved recognition performance. The ERP results showed that there were significant interactions between monetary reward and emotion on memory retrieval, and the reward effects of positive, neutral, and negative memory occurred at varied intervals in mean amplitude. The reward effect of positive memory appeared relatively early, at 260–330 ms after the stimulus onset in the frontal-frontocentral area, at 260–500 ms in the centroparietal-parietal area and at 500–700 ms in the frontocentral area. However, the reward effects of neutral and negative memory occurred relatively later, and that of negative memory appeared at 500–700 ms in the frontocentral and centroparietal area and that of neutral memory was at 500–700 ms in the frontocentral and centroparietal-parietal area. Meanwhile, significant FN400 old/new effects were observed in the negative and rewarded positive items, and the old/new effects of negative items appeared earlier at FN400 than positive items. Also, significant late positive component (LPC) old/new effects were found in the positive, negative, and rewarded neutral items. These results suggest that, monetary reward and negative emotion significantly improved recognition performance, and there was a mutual influence between reward and emotion on brain activity during memory retrieval. PMID:29118728

  12. Dopaminergic modulation of the human reward system: a placebo-controlled dopamine depletion fMRI study.

    PubMed

    da Silva Alves, Fabiana; Schmitz, Nicole; Figee, Martijn; Abeling, Nico; Hasler, Gregor; van der Meer, Johan; Nederveen, Aart; de Haan, Lieuwe; Linszen, Don; van Amelsvoort, Therese

    2011-04-01

    Reward related behaviour is linked to dopaminergic neurotransmission. Our aim was to gain insight into dopaminergic involvement in the human reward system. Combining functional magnetic resonance imaging with dopaminergic depletion by α-methylparatyrosine we measured dopamine-related brain activity in 10 healthy volunteers. In addition to blood-oxygen-level-dependent (BOLD) contrast we assessed the effect of dopaminergic depletion on prolactin response, peripheral markers for dopamine and norepinephrine. In the placebo condition we found increased activation in the left caudate and left cingulate gyrus during anticipation of reward. In the α-methylparatyrosine condition there was no significant brain activation during anticipation of reward or loss. In α-methylparatyrosine, anticipation of reward vs. loss increased activation in the right insula, left frontal, right parietal cortices and right cingulate gyrus. Comparing placebo versus α-methylparatyrosine showed increased activation in the left cingulate gyrus during anticipation of reward and the left medial frontal gyrus during anticipation of loss. α-methylparatyrosine reduced levels of dopamine in urine and homovanillic acid in plasma and increased prolactin. No significant effect of α-methylparatyrosine was found on norepinephrine markers. Our findings implicate distinct patterns of BOLD underlying reward processing following dopamine depletion, suggesting a role of dopaminergic neurotransmission for anticipation of monetary reward.

  13. Neuroimaging meta-analysis of cannabis use studies reveals convergent functional alterations in brain regions supporting cognitive control and reward processing.

    PubMed

    Yanes, Julio A; Riedel, Michael C; Ray, Kimberly L; Kirkland, Anna E; Bird, Ryan T; Boeving, Emily R; Reid, Meredith A; Gonzalez, Raul; Robinson, Jennifer L; Laird, Angela R; Sutherland, Matthew T

    2018-03-01

    Lagging behind rapid changes to state laws, societal views, and medical practice is the scientific investigation of cannabis's impact on the human brain. While several brain imaging studies have contributed important insight into neurobiological alterations linked with cannabis use, our understanding remains limited. Here, we sought to delineate those brain regions that consistently demonstrate functional alterations among cannabis users versus non-users across neuroimaging studies using the activation likelihood estimation meta-analysis framework. In ancillary analyses, we characterized task-related brain networks that co-activate with cannabis-affected regions using data archived in a large neuroimaging repository, and then determined which psychological processes may be disrupted via functional decoding techniques. When considering convergent alterations among users, decreased activation was observed in the anterior cingulate cortex, which co-activated with frontal, parietal, and limbic areas and was linked with cognitive control processes. Similarly, decreased activation was observed in the dorsolateral prefrontal cortex, which co-activated with frontal and occipital areas and linked with attention-related processes. Conversely, increased activation among users was observed in the striatum, which co-activated with frontal, parietal, and other limbic areas and linked with reward processing. These meta-analytic outcomes indicate that cannabis use is linked with differential, region-specific effects across the brain.

  14. Reward Sensitivity for a Palatable Food Reward Peaks During Pubertal Developmental in Rats

    PubMed Central

    Friemel, Chris M.; Spanagel, Rainer; Schneider, Miriam

    2010-01-01

    Puberty is a critical period for the initiation of drug use and abuse. Because early drug use onset often accounts for a more severe progression of addiction, it is of importance to understand the underlying mechanisms and neurodevelopmental changes during puberty that are contributing to enhanced reward processing in teenagers. The present study investigated the progression of reward sensitivity toward a natural food reward over the whole course of adolescence in male rats (postnatal days 30–90) by monitoring consummatory, motivational behavior and neurobiological correlates of reward. Using a limited-free intake paradigm, consumption of sweetened condensed milk (SCM) was measured repeatedly in adolescent and adult rats. Additionally, early- and mid-pubertal animals were tested in Progressive Ratio responding for SCM and c-fos protein expression in reward-associated brain structures was examined after odor conditioning for SCM. We found a transient increase in SCM consumption and motivational incentive for SCM during puberty. This increased reward sensitivity was most pronounced around mid-puberty. The behavioral findings are paralleled by enhanced c-fos staining in reward-related structures revealing an intensified neuronal response after reward-cue presentation, distinctive for pubertal animals. Taken together, these data indicate an increase in reward sensitivity during adolescence accompanied by enhanced responsiveness of reward-associated brain structures to incentive stimuli, and it seems that both is strongly pronounced around mid-puberty. Therefore, higher reward sensitivity during pubertal maturation might contribute to the enhanced vulnerability of teenagers for the initiation of experimental drug use. PMID:20700386

  15. Do brain responses to emotional images and cigarette cues differ? An fMRI study in smokers

    PubMed Central

    Versace, Francesco; Engelmann, Jeffrey M.; Jackson, Edward F.; Costa, Vincent D.; Robinson, Jason D.; Lam, Cho Y.; Minnix, Jennifer A.; Brown, Victoria L.; Cinciripini, Paul M.

    2011-01-01

    Chronic smoking is thought to cause changes in brain reward systems that result in overvaluation of cigarette-related stimuli and undervaluation of natural rewards. We tested the hypotheses that, in smokers, brain circuits involved in emotional processing 1) would be more active during exposure to cigarette-related than neutral pictures, and 2) would be less active to pleasant compared to cigarette-related pictures, suggesting a devaluation of intrinsically pleasant stimuli. We obtained whole brain blood-oxygenation-level-dependent functional magnetic resonance imaging (BOLD fMRI) data from 35 smokers during the presentation of pleasant (erotica and romance), unpleasant (mutilations and sad), neutral, and cigarette-related pictures. Whole brain analyses showed significantly larger BOLD responses during presentation of cigarette-related pictures relative to neutral ones within the secondary visual areas, the cingulate gyrus, the frontal gyrus, the dorsal striatum, and the left insula. BOLD responses to erotic pictures exceeded responses to cigarette-related pictures in all clusters except the insula. Within the left insula we observed larger BOLD responses to cigarette-related pictures than to all other picture categories. By including intrinsically pleasant and unpleasant pictures in addition to neutral ones, we were able to conclude that the presentation of cigarette-related pictures activates brain areas supporting emotional processes, but we did not find evidence of overall reduced activation of the brain reward systems in the presence of intrinsically pleasant stimuli. PMID:22097928

  16. Modafinil augments brain activation associated with reward anticipation in the nucleus accumbens.

    PubMed

    Funayama, Takuya; Ikeda, Yumiko; Tateno, Amane; Takahashi, Hidehiko; Okubo, Yoshiro; Fukayama, Haruhisa; Suzuki, Hidenori

    2014-08-01

    The nucleus accumbens (NAc) works as a key brain structure of the reward system, in which reward-related neural activity is well correlated with dopamine release from mesolimbic dopaminergic neurons. Since modafinil can modulate dopaminergic transmission through re-uptake inhibition of dopamine, we investigated whether modafinil affects the reward-related brain activity in the NAc in healthy subjects. Twenty healthy participants underwent two series of functional magnetic resonance imaging while performing monetary incentive delay task in which they were cued to anticipate and respond to a rapidly presented target to gain or avoid losing varying amounts of money, under modafinil or placebo condition. Blood oxygenation-level dependent (BOLD) activation signals during gain and loss anticipations were analyzed in the NAc as an a priori region of interest as well as the whole brain. Modafinil significantly changed subjective feelings toward positive ones. The activation of BOLD signals was observed during gain anticipation under the placebo and modafinil conditions in the left and bilateral NAc, respectively. The modafinil condition showed significantly higher BOLD signal change at the highest gain (+¥500) cue compared to the placebo condition. The present study showed that modafinil affects reward processing in the NAc in healthy subjects through enhancing more positive anticipation, and it may provide a basis for the use of this drug for treating anhedonia observed in psychiatric disorders.

  17. Opponent appetitive-aversive neural processes underlie predictive learning of pain relief.

    PubMed

    Seymour, Ben; O'Doherty, John P; Koltzenburg, Martin; Wiech, Katja; Frackowiak, Richard; Friston, Karl; Dolan, Raymond

    2005-09-01

    Termination of a painful or unpleasant event can be rewarding. However, whether the brain treats relief in a similar way as it treats natural reward is unclear, and the neural processes that underlie its representation as a motivational goal remain poorly understood. We used fMRI (functional magnetic resonance imaging) to investigate how humans learn to generate expectations of pain relief. Using a pavlovian conditioning procedure, we show that subjects experiencing prolonged experimentally induced pain can be conditioned to predict pain relief. This proceeds in a manner consistent with contemporary reward-learning theory (average reward/loss reinforcement learning), reflected by neural activity in the amygdala and midbrain. Furthermore, these reward-like learning signals are mirrored by opposite aversion-like signals in lateral orbitofrontal cortex and anterior cingulate cortex. This dual coding has parallels to 'opponent process' theories in psychology and promotes a formal account of prediction and expectation during pain.

  18. Abnormal activity in reward brain circuits in human narcolepsy with cataplexy.

    PubMed

    Ponz, Aurélie; Khatami, Ramin; Poryazova, Rositsa; Werth, Esther; Boesiger, Peter; Bassetti, Claudio L; Schwartz, Sophie

    2010-02-01

    Hypothalamic hypocretins (or orexins) regulate energy metabolism and arousal maintenance. Recent animal research suggests that hypocretins may also influence reward-related behaviors. In humans, the loss of hypocretin-containing neurons results in a major sleep-wake disorder called narcolepsy-cataplexy, which is associated with emotional disturbances. Here, we aim to test whether narcoleptic patients show an abnormal pattern of brain activity during reward processing. We used functional magnetic resonance imaging in 12 unmedicated patients with narcolepsy-cataplexy to measure the neural responses to expectancy and experience of monetary gains and losses. We statistically compared the patients' data with those obtained in a group of 12 healthy matched controls. Our results reveal that activity in the dopaminergic ventral midbrain (ventral tegmental area) was not modulated in narcolepsy-cataplexy patients during high reward expectancy (unlike controls), and that ventral striatum activity was reduced during winning. By contrast, the patients showed abnormal activity increases in the amygdala and in dorsal striatum for positive outcomes. In addition, we found that activity in the nucleus accumbens and the ventral-medial prefrontal cortex correlated with disease duration, suggesting that an alternate neural circuit could be privileged over the years to control affective responses to emotional challenges and compensate for the lack of influence from ventral midbrain regions. Our study offers a detailed picture of the distributed brain network involved during distinct stages of reward processing and shows for the first time, to our knowledge, how this network is affected in hypocretin-deficient narcoleptic patients.

  19. Reward processing and mood-related symptoms: An RDoC and translational neuroscience perspective.

    PubMed

    Nusslock, Robin; Alloy, Lauren B

    2017-07-01

    Two objectives of the NIMH Research Domain Criteria (RDoC) initiative are to identify (a) mechanisms that are common to multiple psychiatric disorders, and (b) mechanisms that are unique to specific psychiatric symptoms, and that reflect markers of differential risk for these symptoms. With respect to these objectives, a brain-behavior dimension that has received considerable attention and that is directly relevant to the Positive Valence Systems domain of the RDoC initiative involves reward processing. The present review paper first examines the relationship between reward processing and mood-related symptoms from an RDoC perspective. We then place this work in a larger context by examining the relationship between reward processing abnormalities and psychiatric symptoms defined broadly, including mood-related symptoms, schizophrenia, and addiction. Our review suggests that reward hyposensitivity relates to a subtype of anhedonia characterized by motivational deficits in unipolar depression, and reward hypersensitivity relates to a cluster of hypo/manic symptoms characterized by excessive approach motivation in the context of bipolar disorder. Integrating this perspective with research on reward processing abnormalities in schizophrenia and addiction, we further argue that the principles of equifinality and multifinality may be preferable to a transdiagnostic perspective for conceptualizing the relationship between reward processing and psychiatric symptoms defined broadly. We propose that vulnerability to either motivational anhedonia or approach-related hypo/manic symptoms involve extreme and opposite profiles of reward processing. We further propose that an equifinality and multifinality perspective may serve as a useful framework for future research on reward processing abnormalities and psychiatric symptoms. Copyright © 2017. Published by Elsevier B.V.

  20. Dietary triglycerides act on mesolimbic structures to regulate the rewarding and motivational aspects of feeding

    PubMed Central

    Cansell, Céline; Castel, Julien; Denis, Raphaël G. P.; Rouch, Claude; Delbes, Anne-Sophie; Martinez, Sarah; Mestivier, Denis; Finan, Brian; Maldonado-Aviles, Jaime G.; Rijnsburger, Merel; Tschöp, Matthias H.; DiLeone, Ralph J.; Eckel, Robert H.; la Fleur, Susanne E.; Magnan, Christophe; Hnasko, Thomas S.; Luquet, Serge

    2014-01-01

    Circulating triglycerides (TG) normally increase after a meal but are altered in pathophysiological conditions such as obesity. Although TG metabolism in the brain remains poorly understood, several brain structures express enzymes that process TG-enriched particles, including mesolimbic structures. For this reason, and because consumption of high fat diet alters dopamine signaling, we tested the hypothesis that TG might directly target mesolimbic reward circuits to control reward-seeking behaviors. We found that the delivery of small amounts of TG to the brain through the carotid artery rapidly reduced both spontaneous and amphetamine-induced locomotion, abolished preference for palatable food, and reduced the motivation to engage in food-seeking behavior. Conversely, targeted disruption of the TG-hydrolyzing enzyme lipoprotein lipase specifically in the nucleus accumbens increased palatable food preference and food seeking behavior. Finally, prolonged TG perfusion resulted in a return to normal palatable food preference despite continued locomotor suppression, suggesting that adaptive mechanisms occur. These findings reveal new mechanisms by which dietary fat may alter mesolimbic circuit function and reward seeking. PMID:24732670

  1. Mood, food, and obesity.

    PubMed

    Singh, Minati

    2014-01-01

    Food is a potent natural reward and food intake is a complex process. Reward and gratification associated with food consumption leads to dopamine (DA) production, which in turn activates reward and pleasure centers in the brain. An individual will repeatedly eat a particular food to experience this positive feeling of gratification. This type of repetitive behavior of food intake leads to the activation of brain reward pathways that eventually overrides other signals of satiety and hunger. Thus, a gratification habit through a favorable food leads to overeating and morbid obesity. Overeating and obesity stems from many biological factors engaging both central and peripheral systems in a bi-directional manner involving mood and emotions. Emotional eating and altered mood can also lead to altered food choice and intake leading to overeating and obesity. Research findings from human and animal studies support a two-way link between three concepts, mood, food, and obesity. The focus of this article is to provide an overview of complex nature of food intake where various biological factors link mood, food intake, and brain signaling that engages both peripheral and central nervous system signaling pathways in a bi-directional manner in obesity.

  2. fMRI study of neural sensitization to hedonic stimuli in long-term, daily cannabis users.

    PubMed

    Filbey, Francesca M; Dunlop, Joseph; Ketcherside, Ariel; Baine, Jessica; Rhinehardt, Tyler; Kuhn, Brittany; DeWitt, Sam; Alvi, Talha

    2016-10-01

    Although there is emergent evidence illustrating neural sensitivity to cannabis cues in cannabis users, the specificity of this effect to cannabis cues as opposed to a generalized hyper-sensitivity to hedonic stimuli has not yet been directly tested. Using fMRI, we presented 53 daily, long-term cannabis users and 68 non-using controls visual and tactile cues for cannabis, a natural reward, and, a sensory-perceptual control object to evaluate brain response to hedonic stimuli in cannabis users. The results showed an interaction between group and reward type such that the users had greater response during cannabis cues relative to natural reward cues (i.e., fruit) in the orbitofrontal cortex, striatum, anterior cingulate gyrus, and ventral tegmental area compared to non-users (cluster-threshold z = 2.3, P < 0.05). In the users, there were positive brain-behavior correlations between neural response to cannabis cues in fronto-striatal-temporal regions and subjective craving, marijuana-related problems, withdrawal symptoms, and levels of THC metabolites (cluster-threshold z = 2.3, P < 0.05). These findings demonstrate hyper-responsivity, and, specificity of brain response to cannabis cues in long-term cannabis users that are above that of response to natural reward cues. These observations are concordant with incentive sensitization models suggesting sensitization of mesocorticolimbic regions and disruption of natural reward processes following drug use. Although the cross-sectional nature of this study does not provide information on causality, the positive correlations between neural response and indicators of cannabis use (i.e., THC levels) suggest that alterations in the reward system are, in part, related to cannabis use. Hum Brain Mapp 37:3431-3443, 2016. © 2016 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc. © 2016 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

  3. Missing motoric manipulations: rethinking the imaging of the ventral striatum and dopamine in human reward.

    PubMed

    Kareken, David A

    2018-01-26

    Human neuroimaging studies of natural rewards and drugs of abuse frequently assay the brain's response to stimuli that, through Pavlovian learning, have come to be associated with a drug's rewarding properties. This might be characterized as a 'sensorial' view of the brain's reward system, insofar as the paradigms are designed to elicit responses to a reward's (drug's) sight, aroma, or flavor. A different field of research nevertheless suggests that the mesolimbic dopamine system may also be critically involved in the motor behaviors provoked by such stimuli. This brief review and commentary surveys some of the preclinical data supporting this more "efferent" (motoric) view of the brain's reward system, and discusses what such findings might mean for how human brain imaging studies of natural rewards and drugs of abuse are designed.

  4. Offspring neuroimmune consequences of maternal malnutrition: Potential mechanism for behavioral impairments that underlie metabolic and neurodevelopmental disorders.

    PubMed

    Smith, B L; Reyes, T M

    2017-10-01

    Maternal malnutrition significantly increases offspring risk for both metabolic and neurodevelopmental disorders. Animal models of maternal malnutrition have identified behavioral changes in the adult offspring related to executive function and reward processing. Together, these changes in executive and reward-based behaviors likely contribute to the etiology of both metabolic and neurodevelopmental disorders associated with maternal malnutrition. Concomitant with the behavioral effects, maternal malnutrition alters offspring expression of reward-related molecules and inflammatory signals in brain pathways that control executive function and reward. Neuroimmune pathways and microglial interactions in these specific brain circuits, either in early development or later in adulthood, could directly contribute to the maternal malnutrition-induced behavioral phenotypes. Understanding these mechanisms will help advance treatment strategies for metabolic and neurodevelopmental disorders, especially noninvasive dietary supplementation interventions. Copyright © 2017 Elsevier Inc. All rights reserved.

  5. Examination of Rapid Dopamine Dynamics with Fast Scan Cyclic Voltammetry During Intra-oral Tastant Administration in Awake Rats.

    PubMed

    Wickham, Robert J; Park, Jinwoo; Nunes, Eric J; Addy, Nii A

    2015-08-12

    Rapid, phasic dopamine (DA) release in the mammalian brain plays a critical role in reward processing, reinforcement learning, and motivational control. Fast scan cyclic voltammetry (FSCV) is an electrochemical technique with high spatial and temporal (sub-second) resolution that has been utilized to examine phasic DA release in several types of preparations. In vitro experiments in single-cells and brain slices and in vivo experiments in anesthetized rodents have been used to identify mechanisms that mediate dopamine release and uptake under normal conditions and in disease models. Over the last 20 years, in vivo FSCV experiments in awake, freely moving rodents have also provided insight of dopaminergic mechanisms in reward processing and reward learning. One major advantage of the awake, freely moving preparation is the ability to examine rapid DA fluctuations that are time-locked to specific behavioral events or to reward or cue presentation. However, one limitation of combined behavior and voltammetry experiments is the difficulty of dissociating DA effects that are specific to primary rewarding or aversive stimuli from co-occurring DA fluctuations that mediate reward-directed or other motor behaviors. Here, we describe a combined method using in vivo FSCV and intra-oral infusion in an awake rat to directly investigate DA responses to oral tastants. In these experiments, oral tastants are infused directly to the palate of the rat--bypassing reward-directed behavior and voluntary drinking behavior--allowing for direct examination of DA responses to tastant stimuli.

  6. The scarcity heuristic impacts reward processing within the medial-frontal cortex.

    PubMed

    Williams, Chad C; Saffer, Boaz Y; McCulloch, Robert B; Krigolson, Olave E

    2016-05-04

    Objects that are rare are often perceived to be inherently more valuable than objects that are abundant - a bias brought about in part by the scarcity heuristic. In the present study, we sought to test whether perception of rarity impacted reward evaluation within the human medial-frontal cortex. Here, participants played a gambling game in which they flipped rare and abundant 'cards' on a computer screen to win financial rewards while electroencephalographic data were recorded. Unbeknownst to participants, reward outcome and frequency was random and equivalent for both rare and abundant cards; thus, only a perception of scarcity was true. Analysis of the electroencephalographic data indicated that the P300 component of the event-related brain potential differed in amplitude for wins and losses following the selection of rare cards, but not following the selection of abundant cards. Importantly, then, we found that the perception of card rarity impacted reward processing even though reward feedback was independent of and subsequent to card selection. Our data indicate a top-down influence of the scarcity heuristic on reward evaluation, and specifically the processing of reward magnitude, within the human medial-frontal cortex.

  7. A systematic review of fMRI reward paradigms used in studies of adolescents vs. adults: the impact of task design and implications for understanding neurodevelopment.

    PubMed

    Richards, Jessica M; Plate, Rista C; Ernst, Monique

    2013-06-01

    The neural systems underlying reward-related behaviors across development have recently generated a great amount of interest. Yet, the neurodevelopmental literature on reward processing is marked by inconsistencies due to the heterogeneity of the reward paradigms used, the complexity of the behaviors being studied, and the developing brain itself as a moving target. The present review will examine task design as one source of variability across findings by compiling this literature along three dimensions: (1) task structures, (2) cognitive processes, and (3) neural systems. We start with the presentation of a heuristic neural systems model, the Triadic Model, as a way to provide a theoretical framework for the neuroscience research on motivated behaviors. We then discuss the principles guiding reward task development. Finally, we review the extant developmental neuroimaging literature on reward-related processing, organized by reward task type. We hope that this approach will help to clarify the literature on the functional neurodevelopment of reward-related neural systems, and to identify the role of the experimental parameters that significantly influence these findings. Published by Elsevier Ltd.

  8. A Tribute to Charlie Chaplin: Induced Positive Affect Improves Reward-Based Decision-Learning in Parkinson’s Disease

    PubMed Central

    Ridderinkhof, K. Richard; van Wouwe, Nelleke C.; Band, Guido P. H.; Wylie, Scott A.; Van der Stigchel, Stefan; van Hees, Pieter; Buitenweg, Jessika; van de Vijver, Irene; van den Wildenberg, Wery P. M.

    2012-01-01

    Reward-based decision-learning refers to the process of learning to select those actions that lead to rewards while avoiding actions that lead to punishments. This process, known to rely on dopaminergic activity in striatal brain regions, is compromised in Parkinson’s disease (PD). We hypothesized that such decision-learning deficits are alleviated by induced positive affect, which is thought to incur transient boosts in midbrain and striatal dopaminergic activity. Computational measures of probabilistic reward-based decision-learning were determined for 51 patients diagnosed with PD. Previous work has shown these measures to rely on the nucleus caudatus (outcome evaluation during the early phases of learning) and the putamen (reward prediction during later phases of learning). We observed that induced positive affect facilitated learning, through its effects on reward prediction rather than outcome evaluation. Viewing a few minutes of comedy clips served to remedy dopamine-related problems associated with frontostriatal circuitry and, consequently, learning to predict which actions will yield reward. PMID:22707944

  9. Investigating the Impact of a Genome-Wide Supported Bipolar Risk Variant of MAD1L1 on the Human Reward System.

    PubMed

    Trost, Sarah; Diekhof, Esther K; Mohr, Holger; Vieker, Henning; Krämer, Bernd; Wolf, Claudia; Keil, Maria; Dechent, Peter; Binder, Elisabeth B; Gruber, Oliver

    2016-10-01

    Recent genome-wide association studies have identified MAD1L1 (mitotic arrest deficient-like 1) as a susceptibility gene for bipolar disorder and schizophrenia. The minor allele of the single-nucleotide polymorphism (SNP) rs11764590 in MAD1L1 was associated with bipolar disorder. Both diseases, bipolar disorder and schizophrenia, are linked to functional alterations in the reward system. We aimed at investigating possible effects of the MAD1L1 rs11764590 risk allele on reward systems functioning in healthy adults. A large homogenous sample of 224 young (aged 18-31 years) participants was genotyped and underwent functional magnetic resonance imaging (fMRI). All participants performed the 'Desire-Reason Dilemma' paradigm investigating the neural correlates that underlie reward processing and active reward dismissal in favor of a long-term goal. We found significant hypoactivations of the ventral tegmental area (VTA), the bilateral striatum and bilateral frontal and parietal cortices in response to conditioned reward stimuli in the risk allele carriers compared with major allele carriers. In the dilemma situation, functional connectivity between prefrontal brain regions and the ventral striatum was significantly diminished in the risk allele carriers. Healthy risk allele carriers showed a significant deficit of their bottom-up response to conditioned reward stimuli in the bilateral VTA and striatum. Furthermore, functional connectivity between the ventral striatum and prefrontal areas exerting top-down control on the mesolimbic reward system was reduced in this group. Similar alterations in reward processing and disturbances of prefrontal control mechanisms on mesolimbic brain circuits have also been reported in bipolar disorder and schizophrenia. Together, these findings suggest the existence of an intermediate phenotype associated with MAD1L1.

  10. The brain correlates of the effects of monetary and verbal rewards on intrinsic motivation.

    PubMed

    Albrecht, Konstanze; Abeler, Johannes; Weber, Bernd; Falk, Armin

    2014-01-01

    Apart from everyday duties, such as doing the laundry or cleaning the house, there are tasks we do for pleasure and enjoyment. We do such tasks, like solving crossword puzzles or reading novels, without any external pressure or force; instead, we are intrinsically motivated: we do the tasks because we enjoy doing them. Previous studies suggest that external rewards, i.e., rewards from the outside, affect the intrinsic motivation to engage in a task: while performance-based monetary rewards are perceived as controlling and induce a business-contract framing, verbal rewards praising one's competence can enhance the perceived self-determination. Accordingly, the former have been shown to decrease intrinsic motivation, whereas the latter have been shown to increase intrinsic motivation. The present study investigated the neural processes underlying the effects of monetary and verbal rewards on intrinsic motivation in a group of 64 subjects applying functional magnetic resonance imaging (fMRI). We found that, when participants received positive performance feedback, activation in the anterior striatum and midbrain was affected by the nature of the reward; compared to a non-rewarded control group, activation was higher while monetary rewards were administered. However, we did not find a decrease in activation after reward withdrawal. In contrast, we found an increase in activation for verbal rewards: after verbal rewards had been withdrawn, participants showed a higher activation in the aforementioned brain areas when they received success compared to failure feedback. We further found that, while participants worked on the task, activation in the lateral prefrontal cortex was enhanced after the verbal rewards were administered and withdrawn.

  11. The brain correlates of the effects of monetary and verbal rewards on intrinsic motivation

    PubMed Central

    Albrecht, Konstanze; Abeler, Johannes; Weber, Bernd; Falk, Armin

    2014-01-01

    Apart from everyday duties, such as doing the laundry or cleaning the house, there are tasks we do for pleasure and enjoyment. We do such tasks, like solving crossword puzzles or reading novels, without any external pressure or force; instead, we are intrinsically motivated: we do the tasks because we enjoy doing them. Previous studies suggest that external rewards, i.e., rewards from the outside, affect the intrinsic motivation to engage in a task: while performance-based monetary rewards are perceived as controlling and induce a business-contract framing, verbal rewards praising one's competence can enhance the perceived self-determination. Accordingly, the former have been shown to decrease intrinsic motivation, whereas the latter have been shown to increase intrinsic motivation. The present study investigated the neural processes underlying the effects of monetary and verbal rewards on intrinsic motivation in a group of 64 subjects applying functional magnetic resonance imaging (fMRI). We found that, when participants received positive performance feedback, activation in the anterior striatum and midbrain was affected by the nature of the reward; compared to a non-rewarded control group, activation was higher while monetary rewards were administered. However, we did not find a decrease in activation after reward withdrawal. In contrast, we found an increase in activation for verbal rewards: after verbal rewards had been withdrawn, participants showed a higher activation in the aforementioned brain areas when they received success compared to failure feedback. We further found that, while participants worked on the task, activation in the lateral prefrontal cortex was enhanced after the verbal rewards were administered and withdrawn. PMID:25278834

  12. Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology.

    PubMed

    Schultz, Wolfram

    2004-04-01

    Neurons in a small number of brain structures detect rewards and reward-predicting stimuli and are active during the expectation of predictable food and liquid rewards. These neurons code the reward information according to basic terms of various behavioural theories that seek to explain reward-directed learning, approach behaviour and decision-making. The involved brain structures include groups of dopamine neurons, the striatum including the nucleus accumbens, the orbitofrontal cortex and the amygdala. The reward information is fed to brain structures involved in decision-making and organisation of behaviour, such as the dorsolateral prefrontal cortex and possibly the parietal cortex. The neural coding of basic reward terms derived from formal theories puts the neurophysiological investigation of reward mechanisms on firm conceptual grounds and provides neural correlates for the function of rewards in learning, approach behaviour and decision-making.

  13. Deep brain stimulation of the subthalamic nucleus modulates sensitivity to decision outcome value in Parkinson’s disease

    NASA Astrophysics Data System (ADS)

    Seymour, Ben; Barbe, Michael; Dayan, Peter; Shiner, Tamara; Dolan, Ray; Fink, Gereon R.

    2016-09-01

    Deep brain stimulation (DBS) of the subthalamic nucleus in Parkinson’s disease is known to cause a subtle but important adverse impact on behaviour, with impulsivity its most widely reported manifestation. However, precisely which computational components of the decision process are modulated is not fully understood. Here we probe a number of distinct subprocesses, including temporal discount, outcome utility, instrumental learning rate, instrumental outcome sensitivity, reward-loss trade-offs, and perseveration. We tested 22 Parkinson’s Disease patients both on and off subthalamic nucleus deep brain stimulation (STN-DBS), while they performed an instrumental learning task involving financial rewards and losses, and an inter-temporal choice task for financial rewards. We found that instrumental learning performance was significantly worse following stimulation, due to modulation of instrumental outcome sensitivity. Specifically, patients became less sensitive to decision values for both rewards and losses, but without any change to the learning rate or reward-loss trade-offs. However, we found no evidence that DBS modulated different components of temporal impulsivity. In conclusion, our results implicate the subthalamic nucleus in a modulation of outcome value in experience-based learning and decision-making in Parkinson’s disease, suggesting a more pervasive role of the subthalamic nucleus in the control of human decision-making than previously thought.

  14. Deep brain stimulation of the subthalamic nucleus modulates sensitivity to decision outcome value in Parkinson’s disease

    PubMed Central

    Seymour, Ben; Barbe, Michael; Dayan, Peter; Shiner, Tamara; Dolan, Ray; Fink, Gereon R.

    2016-01-01

    Deep brain stimulation (DBS) of the subthalamic nucleus in Parkinson’s disease is known to cause a subtle but important adverse impact on behaviour, with impulsivity its most widely reported manifestation. However, precisely which computational components of the decision process are modulated is not fully understood. Here we probe a number of distinct subprocesses, including temporal discount, outcome utility, instrumental learning rate, instrumental outcome sensitivity, reward-loss trade-offs, and perseveration. We tested 22 Parkinson’s Disease patients both on and off subthalamic nucleus deep brain stimulation (STN-DBS), while they performed an instrumental learning task involving financial rewards and losses, and an inter-temporal choice task for financial rewards. We found that instrumental learning performance was significantly worse following stimulation, due to modulation of instrumental outcome sensitivity. Specifically, patients became less sensitive to decision values for both rewards and losses, but without any change to the learning rate or reward-loss trade-offs. However, we found no evidence that DBS modulated different components of temporal impulsivity. In conclusion, our results implicate the subthalamic nucleus in a modulation of outcome value in experience-based learning and decision-making in Parkinson’s disease, suggesting a more pervasive role of the subthalamic nucleus in the control of human decision-making than previously thought. PMID:27624437

  15. Abstinent adult daily smokers show reduced anticipatory but elevated saccade-related brain responses during a rewarded antisaccade task.

    PubMed

    Geier, Charles F; Sweitzer, Maggie M; Denlinger, Rachel; Sparacino, Gina; Donny, Eric C

    2014-08-30

    Chronic smoking may result in reduced sensitivity to non-drug rewards (e.g., money), a phenomenon particularly salient during abstinence. During a quit attempt, this effect may contribute to biased decision-making (smoking>alternative reinforcers) and relapse. Although relevant for quitting, characterization of reduced reward function in abstinent smokers remains limited. Moreover, how attenuated reward function affects other brain systems supporting decision-making has not been established. Here, we use a rewarded antisaccade (rAS) task to characterize non-drug reward processing and its influence on inhibitory control, key elements underlying decision-making, in abstinent smokers vs. non-smokers. Abstinent (12-hours) adult daily smokers (N=23) and non-smokers (N=11) underwent fMRI while performing the rAS. Behavioral performances improved on reward vs. neutral trials. Smokers showed attenuated activation in ventral striatum during the reward cue and in superior precentral sulcus and posterior parietal cortex during response preparation, but greater responses during the saccade response in posterior cingulate and parietal cortices. Smokers' attenuated anticipatory responses suggest reduced motivation from monetary reward, while heightened activation during the saccade response suggests that additional circuitry may be engaged later to enhance inhibitory task performance. Overall, this preliminary study highlights group differences in decision-making components and the utility of the rAS to characterize these effects. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

  16. Cognitive strategies regulate fictive, but not reward prediction error signals in a sequential investment task.

    PubMed

    Gu, Xiaosi; Kirk, Ulrich; Lohrenz, Terry M; Montague, P Read

    2014-08-01

    Computational models of reward processing suggest that foregone or fictive outcomes serve as important information sources for learning and augment those generated by experienced rewards (e.g. reward prediction errors). An outstanding question is how these learning signals interact with top-down cognitive influences, such as cognitive reappraisal strategies. Using a sequential investment task and functional magnetic resonance imaging, we show that the reappraisal strategy selectively attenuates the influence of fictive, but not reward prediction error signals on investment behavior; such behavioral effect is accompanied by changes in neural activity and connectivity in the anterior insular cortex, a brain region thought to integrate subjective feelings with high-order cognition. Furthermore, individuals differ in the extent to which their behaviors are driven by fictive errors versus reward prediction errors, and the reappraisal strategy interacts with such individual differences; a finding also accompanied by distinct underlying neural mechanisms. These findings suggest that the variable interaction of cognitive strategies with two important classes of computational learning signals (fictive, reward prediction error) represent one contributing substrate for the variable capacity of individuals to control their behavior based on foregone rewards. These findings also expose important possibilities for understanding the lack of control in addiction based on possibly foregone rewarding outcomes. Copyright © 2013 The Authors. Human Brain Mapping Published by Wiley Periodicals, Inc.

  17. Ventral pallidum roles in reward and motivation.

    PubMed

    Smith, Kyle S; Tindell, Amy J; Aldridge, J Wayne; Berridge, Kent C

    2009-01-23

    In recent years the ventral pallidum has become a focus of great research interest as a mechanism of reward and incentive motivation. As a major output for limbic signals, the ventral pallidum was once associated primarily with motor functions rather than regarded as a reward structure in its own right. However, ample evidence now suggests that ventral pallidum function is a major mechanism of reward in the brain. We review data indicating that (1) an intact ventral pallidum is necessary for normal reward and motivation, (2) stimulated activation of ventral pallidum is sufficient to cause reward and motivation enhancements, and (3) activation patterns in ventral pallidum neurons specifically encode reward and motivation signals via phasic bursts of excitation to incentive and hedonic stimuli. We conclude that the ventral pallidum may serve as an important 'limbic final common pathway' for mesocorticolimbic processing of many rewards.

  18. Fronto-striatal Dysfunction During Reward Processing in Unaffected Siblings of Schizophrenia Patients

    PubMed Central

    de Leeuw, Max; Kahn, René S.; Vink, Matthijs

    2015-01-01

    Schizophrenia is a psychiatric disorder that is associated with impaired functioning of the fronto-striatal network, in particular during reward processing. However, it is unclear whether this dysfunction is related to the illness itself or whether it reflects a genetic vulnerability to develop schizophrenia. Here, we examined reward processing in unaffected siblings of schizophrenia patients using functional magnetic resonance imaging. Brain activity was measured during reward anticipation and reward outcome in 27 unaffected siblings of schizophrenia patients and 29 healthy volunteers using a modified monetary incentive delay task. Task performance was manipulated online so that all subjects won the same amount of money. Despite equal performance, siblings showed reduced activation in the ventral striatum, insula, and supplementary motor area (SMA) during reward anticipation compared to controls. Decreased ventral striatal activation in siblings was correlated with sub-clinical negative symptoms. During the outcome of reward, siblings showed increased activation in the ventral striatum and orbitofrontal cortex compared to controls. Our finding of decreased activity in the ventral striatum during reward anticipation and increased activity in this region during receiving reward may indicate impaired cue processing in siblings. This is consistent with the notion of dopamine dysfunction typically associated with schizophrenia. Since unaffected siblings share on average 50% of their genes with their ill relatives, these deficits may be related to the genetic vulnerability for schizophrenia. PMID:25368371

  19. Dissociable effects of reward and expectancy during evaluative feedback processing revealed by topographic ERP mapping analysis.

    PubMed

    Gheza, Davide; Paul, Katharina; Pourtois, Gilles

    2017-11-24

    Evaluative feedback provided during performance monitoring (PM) elicits either a positive or negative deflection ~250-300ms after its onset in the event-related potential (ERP) depending on whether the outcome is reward-related or not, as well as expected or not. However, it remains currently unclear whether these two deflections reflect a unitary process, or rather dissociable effects arising from non-overlapping brain networks. To address this question, we recorded 64-channel EEG in healthy adult participants performing a standard gambling task where valence and expectancy were manipulated in a factorial design. We analyzed the feedback-locked ERP data using a conventional ERP analysis, as well as an advanced topographic ERP mapping analysis supplemented with distributed source localization. Results reveal two main topographies showing opposing valence effects, and being differently modulated by expectancy. The first one was short-lived and sensitive to no-reward irrespective of expectancy. Source-estimation associated with this topographic map comprised mainly regions of the dorsal anterior cingulate cortex. The second one was primarily driven by reward, had a prolonged time-course and was monotonically influenced by expectancy. Moreover, this reward-related topographical map was best accounted for by intracranial generators estimated in the posterior cingulate cortex. These new findings suggest the existence of dissociable brain systems depending on feedback valence and expectancy. More generally, they inform about the added value of using topographic ERP mapping methods, besides conventional ERP measurements, to characterize qualitative changes occurring in the spatio-temporal dynamic of reward processing during PM. Copyright © 2017 Elsevier B.V. All rights reserved.

  20. Monetary incentives at retrieval promote recognition of involuntarily learned emotional information.

    PubMed

    Yan, Chunping; Li, Yunyun; Zhang, Qin; Cui, Lixia

    2018-03-07

    Previous studies have suggested that the effects of reward on memory processes are affected by certain factors, but it remains unclear whether the effects of reward at retrieval on recognition processes are influenced by emotion. The event-related potential was used to investigate the combined effect of reward and emotion on memory retrieval and its neural mechanism. The behavioral results indicated that the reward at retrieval improved recognition performance under positive and negative emotional conditions. The event-related potential results indicated that there were significant interactions between the reward and emotion in the average amplitude during recognition, and the significant reward effects from the frontal to parietal brain areas appeared at 130-800 ms for positive pictures and at 190-800 ms for negative pictures, but there were no significant reward effects of neutral pictures; the reward effect of positive items appeared relatively earlier, starting at 130 ms, and that of negative pictures began at 190 ms. These results indicate that monetary incentives at retrieval promote recognition of involuntarily learned emotional information.

  1. Individual variation in the neural processes of motor decisions in the stop signal task: the influence of novelty seeking and harm avoidance personality traits.

    PubMed

    Hu, Jianping; Lee, Dianne; Hu, Sien; Zhang, Sheng; Chao, Herta; Li, Chiang-Shan R

    2016-06-01

    Personality traits contribute to variation in human behavior, including the propensity to take risk. Extant work targeted risk-taking processes with an explicit manipulation of reward, but it remains unclear whether personality traits influence simple decisions such as speeded versus delayed responses during cognitive control. We explored this issue in an fMRI study of the stop signal task, in which participants varied in response time trial by trial, speeding up and risking a stop error or slowing down to avoid errors. Regional brain activations to speeded versus delayed motor responses (risk-taking) were correlated to novelty seeking (NS), harm avoidance (HA) and reward dependence (RD), with age and gender as covariates, in a whole brain regression. At a corrected threshold, the results showed a positive correlation between NS and risk-taking responses in the dorsomedial prefrontal, bilateral orbitofrontal, and frontopolar cortex, and between HA and risk-taking responses in the parahippocampal gyrus and putamen. No regional activations varied with RD. These findings demonstrate that personality traits influence the neural processes of executive control beyond behavioral tasks that involve explicit monetary reward. The results also speak broadly to the importance of characterizing inter-subject variation in studies of cognition and brain functions.

  2. Integration of homeostatic signaling and food reward processing in the human brain.

    PubMed

    Simon, Joe J; Wetzel, Anne; Sinno, Maria Hamze; Skunde, Mandy; Bendszus, Martin; Preissl, Hubert; Enck, Paul; Herzog, Wolfgang; Friederich, Hans-Christoph

    2017-08-03

    Food intake is guided by homeostatic needs and by the reward value of food, yet the exact relation between the two remains unclear. The aim of this study was to investigate the influence of different metabolic states and hormonal satiety signaling on responses in neural reward networks. Twenty-three healthy participants underwent functional magnetic resonance imaging while performing a task distinguishing between the anticipation and the receipt of either food- or monetary-related reward. Every participant was scanned twice in a counterbalanced fashion, both during a fasted state (after 24 hours fasting) and satiety. A functional connectivity analysis was performed to investigate the influence of satiety signaling on activation in neural reward networks. Blood samples were collected to assess hormonal satiety signaling. Fasting was associated with sensitization of the striatal reward system to the anticipation of food reward irrespective of reward magnitude. Furthermore, during satiety, individual ghrelin levels were associated with increased neural processing during the expectation of food-related reward. Our findings show that physiological hunger stimulates food consumption by specifically increasing neural processing during the expectation (i.e., incentive salience) but not the receipt of food-related reward. In addition, these findings suggest that ghrelin signaling influences hedonic-driven food intake by increasing neural reactivity during the expectation of food-related reward. These results provide insights into the neurobiological underpinnings of motivational processing and hedonic evaluation of food reward. ClinicalTrials.gov NCT03081585. This work was supported by the German Competence Network on Obesity, which is funded by the German Federal Ministry of Education and Research (FKZ 01GI1122E).

  3. Hyperresponsivity and impaired prefrontal control of the mesolimbic reward system in schizophrenia.

    PubMed

    Richter, Anja; Petrovic, Aleksandra; Diekhof, Esther K; Trost, Sarah; Wolter, Sarah; Gruber, Oliver

    2015-12-01

    Schizophrenia is characterized by substantial dysfunctions of reward processing, leading to detrimental consequences for decision-making. The neurotransmitter dopamine is responsible for the transmission of reward signals and also known to be involved in the mechanism of psychosis. Using functional magnetic resonance imaging (fMRI), sixteen medicated patients with schizophrenia and sixteen healthy controls performed the 'desire-reason dilemma' (DRD) paradigm. This paradigm allowed us to directly investigate reward-related brain activations depending on the interaction of bottom-up and top-down mechanisms, when a previously conditioned reward stimulus had to be rejected to achieve a superordinate long-term goal. Both patients and controls showed significant activations in the mesolimbic reward system. In patients with schizophrenia, however, we found a significant hyperactivation of the left ventral striatum (vStr) when they were allowed to accept the conditioned reward stimuli, and a reduced top-down regulation of activation in the ventral striatum (vStr) and ventral tegmental area (VTA) while having to reject the immediate reward to pursue the superordinate task-goal. Moreover, while healthy subjects exhibited a negative functional coupling of the vStr with both the anteroventral prefrontal cortex (avPFC) and the ventromedial prefrontal cortex (VMPFC) in the dilemma situation, this functional coupling was significantly impaired in the patient group. These findings provide evidence for an increased ventral striatal activation to reward stimuli and an impaired top-down control of reward signals by prefrontal brain regions in schizophrenia. Copyright © 2015 Elsevier Ltd. All rights reserved.

  4. Self-reflection modulates the outcome evaluation process: Evidence from an ERP study.

    PubMed

    Zhu, Xiangru; Gu, Ruolei; Wu, Haiyan; Luo, Yuejia

    2015-12-01

    Recent research demonstrated structural overlap between reward and self processing, but the functional relationship that explains how self processing influences reward processing remains unclear. The present study used an experimentally constrained reflection task to investigate whether individuals' outcome evaluations in a gambling task are modulated by task-unrelated self- and other-reflection processes. The self- and other-reflection task contained descriptions of the self or others, and brain event-related potentials (ERPs) were recorded while 16 normal adults performed a gambling task. The ERP analysis focused on the feedback-related negativity (FRN) component. We found that the difference wave of FRN increased in the self-reflection condition compared with the other-reflection condition. The present findings provide direct evidence that self processing can influence reward processing. Copyright © 2015 Elsevier B.V. All rights reserved.

  5. Where is the comfort in comfort foods? Mechanisms linking fat signaling, reward, and emotion.

    PubMed

    Weltens, N; Zhao, D; Van Oudenhove, L

    2014-03-01

    Food in general, and fatty foods in particular, have obtained intrinsic reward value throughout evolution. This reward value results from an interaction between exteroceptive signals from different sensory modalities, interoceptive hunger/satiety signals from the gastrointestinal tract to the brain, as well as ongoing affective and cognitive processes. Further evidence linking food to emotions stems from folk psychology ('comfort foods') and epidemiological studies demonstrating high comorbidity rates between disorders of food intake, including obesity, and mood disorders such as depression. This review paper aims to give an overview of current knowledge on the neurophysiological mechanisms underlying the link between (fatty) foods, their reward value, and emotional responses to (anticipation of) their intake in humans. Firstly, the influence of exteroceptive sensory signals, including visual, olfactory ('anticipatory food reward'), and gustatory ('consummatory food reward'), on the encoding of reward value in the (ventral) striatum and of subjective pleasantness in the cingulate and orbitofrontal cortex will be discussed. Differences in these pathways and mechanisms between lean and obese subjects will be highlighted. Secondly, recent studies elucidating the mechanisms of purely interoceptive fatty acid-induced signaling from the gastrointestinal tract to the brain, including the role of gut peptides, will be presented. These studies have demonstrated that such subliminal interoceptive stimuli may impact on hedonic circuits in the brain, and thereby influence the subjective and neural responses to negative emotion induction. This suggests that the effect of foods on mood may even occur independently from their exteroceptive sensory properties. © 2014 John Wiley & Sons Ltd.

  6. Temporal dynamics of reward anticipation in the human brain.

    PubMed

    Zhang, Yuanyuan; Li, Qi; Wang, Zhao; Liu, Xun; Zheng, Ya

    2017-09-01

    Reward anticipation is a complex process including cue evaluation, motor preparation, and feedback anticipation. The present study investigated whether these psychological processes were dissociable on neural dynamics in terms of incentive valence and approach motivation. We recorded EEG when participants were performing a monetary incentive delay task, and found a cue-P3 during the cue-evaluation stage, a contingent negative variation (CNV) during the motor-preparation stage, and a stimulus-preceding negativity (SPN) during the feedback-anticipation stage. Critically, both the cue-P3 and SPN exhibited an enhanced sensitivity to gain versus loss anticipation, which was not observed for the CNV. Moreover, both the cue-P3 and SPN, instead of the CNV, for gain anticipation selectively predicted the participants' approach motivation as measured in a following effort expenditure for rewards task, particularly when reward uncertainty was maximal. Together, these results indicate that reward anticipation consists of several sub-stages, each with distinct functional significance, thus providing implications for neuropsychiatric diseases characterized by dysfunction in anticipatory reward processing. Copyright © 2017 Elsevier B.V. All rights reserved.

  7. Reward reduces conflict by enhancing attentional control and biasing visual cortical processing.

    PubMed

    Padmala, Srikanth; Pessoa, Luiz

    2011-11-01

    How does motivation interact with cognitive control during challenging behavioral conditions? Here, we investigated the interactions between motivation and cognition during a response conflict task and tested a specific model of the effect of reward on cognitive processing. Behaviorally, participants exhibited reduced conflict during the reward versus no-reward condition. Brain imaging results revealed that a group of subcortical and fronto-parietal regions was robustly influenced by reward at cue processing and, importantly, that cue-related responses in fronto-parietal attentional regions were predictive of reduced conflict-related signals in the medial pFC (MPFC)/ACC during the upcoming target phase. Path analysis revealed that the relationship between cue responses in the right intraparietal sulcus (IPS) and interference-related responses in the MPFC during the subsequent target phase was mediated via signals in the left fusiform gyrus, which we linked to distractor-related processing. Finally, reward increased functional connectivity between the right IPS and both bilateral putamen and bilateral nucleus accumbens during the cue phase, a relationship that covaried with across-individual sensitivity to reward in the case of the right nucleus accumbens. Taken together, our findings are consistent with a model in which motivationally salient cues are employed to upregulate top-down control processes that bias the selection of visual information, thereby leading to more efficient stimulus processing during conflict conditions.

  8. fMRI study of neural sensitization to hedonic stimuli in long‐term, daily cannabis users

    PubMed Central

    Dunlop, Joseph; Ketcherside, Ariel; Baine, Jessica; Rhinehardt, Tyler; Kuhn, Brittany; DeWitt, Sam; Alvi, Talha

    2016-01-01

    Abstract Although there is emergent evidence illustrating neural sensitivity to cannabis cues in cannabis users, the specificity of this effect to cannabis cues as opposed to a generalized hyper‐sensitivity to hedonic stimuli has not yet been directly tested. Using fMRI, we presented 53 daily, long‐term cannabis users and 68 non‐using controls visual and tactile cues for cannabis, a natural reward, and, a sensory‐perceptual control object to evaluate brain response to hedonic stimuli in cannabis users. The results showed an interaction between group and reward type such that the users had greater response during cannabis cues relative to natural reward cues (i.e., fruit) in the orbitofrontal cortex, striatum, anterior cingulate gyrus, and ventral tegmental area compared to non‐users (cluster‐threshold z = 2.3, P < 0.05). In the users, there were positive brain‐behavior correlations between neural response to cannabis cues in fronto‐striatal‐temporal regions and subjective craving, marijuana‐related problems, withdrawal symptoms, and levels of THC metabolites (cluster‐threshold z = 2.3, P < 0.05). These findings demonstrate hyper‐responsivity, and, specificity of brain response to cannabis cues in long‐term cannabis users that are above that of response to natural reward cues. These observations are concordant with incentive sensitization models suggesting sensitization of mesocorticolimbic regions and disruption of natural reward processes following drug use. Although the cross‐sectional nature of this study does not provide information on causality, the positive correlations between neural response and indicators of cannabis use (i.e., THC levels) suggest that alterations in the reward system are, in part, related to cannabis use. Hum Brain Mapp 37:3431–3443, 2016. © 2016 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc. PMID:27168331

  9. Brain connectivity reflects human aesthetic responses to music

    PubMed Central

    Sachs, Matthew E.; Ellis, Robert J.; Schlaug, Gottfried

    2016-01-01

    Abstract Humans uniquely appreciate aesthetics, experiencing pleasurable responses to complex stimuli that confer no clear intrinsic value for survival. However, substantial variability exists in the frequency and specificity of aesthetic responses. While pleasure from aesthetics is attributed to the neural circuitry for reward, what accounts for individual differences in aesthetic reward sensitivity remains unclear. Using a combination of survey data, behavioral and psychophysiological measures and diffusion tensor imaging, we found that white matter connectivity between sensory processing areas in the superior temporal gyrus and emotional and social processing areas in the insula and medial prefrontal cortex explains individual differences in reward sensitivity to music. Our findings provide the first evidence for a neural basis of individual differences in sensory access to the reward system, and suggest that social–emotional communication through the auditory channel may offer an evolutionary basis for music making as an aesthetically rewarding function in humans. PMID:26966157

  10. Neural responses to various rewards and feedback in the brains of adolescent Internet addicts detected by functional magnetic resonance imaging.

    PubMed

    Kim, Ji-Eun; Son, Jung-Woo; Choi, Won-Hee; Kim, Yeoung-Rang; Oh, Jong-Hyun; Lee, Seungbok; Kim, Jang-Kyu

    2014-06-01

    This study aimed to examine differences in brain activation for various types of reward and feedback in adolescent Internet addicts (AIA) and normal adolescents (NA) using functional magnetic resonance imaging (fMRI). AIA (n = 15) and NA (n = 15) underwent fMRI while performing easy tasks for which performance feedback (PF), social reward (SR) (such as compliments), or monetary reward (MR) was given. Using the no reward (NR) condition, three types of contrasts (PF-NR, SR-NR, and MR-NR) were analyzed. In NA, we observed activation in the reward-related subcortical system, self-related brain region, and other brain areas for the three contrasts, but these brain areas showed almost no activation in AIA. Instead, AIA showed significant activation in the dorsolateral prefrontal cortex for the PF-NR contrast and the negative correlation was found between the level of activation in the left superior temporal gyrus (BA 22) and the duration of Internet game use per day in AIA. These findings suggest that AIA show reduced levels of self-related brain activation and decreased reward sensitivity irrespective of the type of reward and feedback. AIA may be only sensitive to error monitoring regardless of positive feelings, such as sense of satisfaction or achievement. © 2014 The Authors. Psychiatry and Clinical Neurosciences © 2014 Japanese Society of Psychiatry and Neurology.

  11. Brain reward circuitry beyond the mesolimbic dopamine system: a neurobiological theory.

    PubMed

    Ikemoto, Satoshi

    2010-11-01

    Reductionist attempts to dissect complex mechanisms into simpler elements are necessary, but not sufficient for understanding how biological properties like reward emerge out of neuronal activity. Recent studies on intracranial self-administration of neurochemicals (drugs) found that rats learn to self-administer various drugs into the mesolimbic dopamine structures-the posterior ventral tegmental area, medial shell nucleus accumbens and medial olfactory tubercle. In addition, studies found roles of non-dopaminergic mechanisms of the supramammillary, rostromedial tegmental and midbrain raphe nuclei in reward. To explain intracranial self-administration and related effects of various drug manipulations, I outlined a neurobiological theory claiming that there is an intrinsic central process that coordinates various selective functions (including perceptual, visceral, and reinforcement processes) into a global function of approach. Further, this coordinating process for approach arises from interactions between brain structures including those structures mentioned above and their closely linked regions: the medial prefrontal cortex, septal area, ventral pallidum, bed nucleus of stria terminalis, preoptic area, lateral hypothalamic areas, lateral habenula, periaqueductal gray, laterodorsal tegmental nucleus and parabrachical area. Published by Elsevier Ltd.

  12. Divergent Relationship of Depression Severity to Social Reward Responses Among Patients with Bipolar Versus Unipolar Depression

    PubMed Central

    Sharma, Anup; Satterthwaite, Theodore D.; Vandekar, Lillie; Katchmar, Natalie; Daldal, Aylin; Ruparel, Kosha; A.Elliott, Mark; Baldassano, Claudia; Thase, Michael E.; Gur, Raquel E.; Kable, Joseph W.; Wolf, Daniel H.

    2016-01-01

    Neuroimaging studies of mood disorders demonstrate abnormalities in brain regions implicated in reward processing. However, there is a paucity of research investigating how social rewards affect reward circuit activity in these disorders. Here, we evaluated the relationship of both diagnostic category and dimensional depression severity to reward system function in bipolar and unipolar depression. In total, 86 adults were included, including 24 patients with bipolar depression, 24 patients with unipolar depression, and 38 healthy comparison subjects. Participants completed a social reward task during 3T BOLD fMRI. On average, diagnostic groups did not differ in activation to social reward. However, greater depression severity significantly correlated with reduced bilateral ventral striatum activation to social reward in the bipolar depressed group, but not the unipolar depressed group. In addition, decreased left orbitofrontal cortical activation correlated with more severe symptoms in bipolar depression, but not unipolar depression. These differential dimensional effects resulted in a significant voxelwise group by depression severity interaction. Taken together, these results provide initial evidence that deficits in social reward processing are differentially related to depression severity in the two disorders. PMID:27295401

  13. Anatomical correlates of reward-seeking behaviours in behavioural variant frontotemporal dementia

    PubMed Central

    Sturm, Virginia E.; Seeley, William W.; Miller, Bruce L.; Kramer, Joel H.; Rosen, Howard J.

    2014-01-01

    Behavioural variant frontotemporal dementia is characterized by abnormal responses to primary reward stimuli such as food, sex and intoxicants, suggesting abnormal functioning of brain circuitry mediating reward processing. The goal of this analysis was to determine whether abnormalities in reward-seeking behaviour in behavioural variant frontotemporal dementia are correlated with atrophy in regions known to mediate reward processing. Review of case histories in 103 patients with behavioural variant frontotemporal dementia identified overeating or increased sweet food preference in 80 (78%), new or increased alcohol or drug use in 27 (26%), and hypersexuality in 17 (17%). For each patient, a primary reward-seeking score of 0–3 was created with 1 point given for each target behaviour (increased seeking of food, drugs, or sex). Voxel-based morphometry performed in 91 patients with available imaging revealed that right ventral putamen and pallidum atrophy correlated with higher reward-seeking scores. Each of the reward-related behaviours involved partially overlapping right hemisphere reward circuit regions including putamen, globus pallidus, insula and thalamus. These findings indicate that in some patients with behavioural variant frontotemporal dementia, low volume of subcortical reward-related structures is associated with increased pursuit of primary rewards, which may be a product of increased thalamocortical feedback. PMID:24740987

  14. Ventral Pallidum Roles in Reward and Motivation

    PubMed Central

    Smith, Kyle S.; Tindell, Amy J.; Aldridge, J. Wayne; Berridge, Kent C.

    2008-01-01

    In recent years the ventral pallidum has become a focus of great research interest as a mechanism of reward and incentive motivation. As a major output for limbic signals, the ventral pallidum was once associated primarily with motor functions rather than regarded as a reward structure in its own right. However, ample evidence now suggests that ventral pallidum function is a major mechanism of reward in the brain. We review data indicating that 1) an intact ventral pallidum is necessary for normal reward and motivation, 2) stimulated activation of ventral pallidum is sufficient to cause reward and motivation enhancements, and 3) activation patterns in ventral pallidum neurons specifically encode reward and motivation signals via phasic bursts of excitation to incentive and hedonic stimuli. We conclude that the ventral pallidum may serve as an important ‘limbic final common pathway’ for mesocorticolimbic processing of many rewards. PMID:18955088

  15. The effects of oxytocin on social reward learning in humans.

    PubMed

    Clark-Elford, Rebecca; Nathan, Pradeep J; Auyeung, Bonnie; Voon, Valerie; Sule, Akeem; Müller, Ulrich; Dudas, Robert; Sahakian, Barbara J; Phan, K Luan; Baron-Cohen, Simon

    2014-02-01

    It has been hypothesised that the mechanisms modulating social affiliation are regulated by reward circuitry. Oxytocin, previously shown to support affiliative behaviour and the processing of socio-emotional stimuli, is expressed in areas of the brain involved in reward and motivation. However, limited data are available that test if oxytocin is directly involved in reward learning, or whether oxytocin can modulate the effect of emotion on reward learning. In a double-blind, randomised, placebo-controlled, within-group study design, 24 typical male volunteers were administered 24 IU of oxytocin or placebo and subsequently completed an affective reward learning task. Oxytocin selectively reduced performance of learning rewards, but not losses, from happy faces. The mechanism by which oxytocin may be exerting this effect is discussed in terms of whether oxytocin is affecting identity recognition via affecting the salience of happy faces. We conclude that oxytocin detrimentally affects learning rewards from happy faces in certain contexts.

  16. Brain Reward Circuits in Morphine Addiction

    PubMed Central

    Kim, Juhwan; Ham, Suji; Hong, Heeok; Moon, Changjong; Im, Heh-In

    2016-01-01

    Morphine is the most potent analgesic for chronic pain, but its clinical use has been limited by the opiate’s innate tendency to produce tolerance, severe withdrawal symptoms and rewarding properties with a high risk of relapse. To understand the addictive properties of morphine, past studies have focused on relevant molecular and cellular changes in the brain, highlighting the functional roles of reward-related brain regions. Given the accumulated findings, a recent, emerging trend in morphine research is that of examining the dynamics of neuronal interactions in brain reward circuits under the influence of morphine action. In this review, we highlight recent findings on the roles of several reward circuits involved in morphine addiction based on pharmacological, molecular and physiological evidences. PMID:27506251

  17. Value and probability coding in a feedback-based learning task utilizing food rewards.

    PubMed

    Tricomi, Elizabeth; Lempert, Karolina M

    2015-01-01

    For the consequences of our actions to guide behavior, the brain must represent different types of outcome-related information. For example, an outcome can be construed as negative because an expected reward was not delivered or because an outcome of low value was delivered. Thus behavioral consequences can differ in terms of the information they provide about outcome probability and value. We investigated the role of the striatum in processing probability-based and value-based negative feedback by training participants to associate cues with food rewards and then employing a selective satiety procedure to devalue one food outcome. Using functional magnetic resonance imaging, we examined brain activity related to receipt of expected rewards, receipt of devalued outcomes, omission of expected rewards, omission of devalued outcomes, and expected omissions of an outcome. Nucleus accumbens activation was greater for rewarding outcomes than devalued outcomes, but activity in this region did not correlate with the probability of reward receipt. Activation of the right caudate and putamen, however, was largest in response to rewarding outcomes relative to expected omissions of reward. The dorsal striatum (caudate and putamen) at the time of feedback also showed a parametric increase correlating with the trialwise probability of reward receipt. Our results suggest that the ventral striatum is sensitive to the motivational relevance, or subjective value, of the outcome, while the dorsal striatum codes for a more complex signal that incorporates reward probability. Value and probability information may be integrated in the dorsal striatum, to facilitate action planning and allocation of effort. Copyright © 2015 the American Physiological Society.

  18. Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feedback error-related negativity and N200.

    PubMed

    Baker, Travis E; Holroyd, Clay B

    2011-04-01

    The reinforcement learning theory of the error-related negativity (ERN) holds that the impact of reward signals carried by the midbrain dopamine system modulates activity of the anterior cingulate cortex (ACC), alternatively disinhibiting and inhibiting the ACC following unpredicted error and reward events, respectively. According to a recent formulation of the theory, activity that is intrinsic to the ACC produces a component of the event-related brain potential (ERP) called the N200, and following unpredicted rewards, the N200 is suppressed by extrinsically applied positive dopamine reward signals, resulting in an ERP component called the feedback-ERN (fERN). Here we demonstrate that, despite extensive spatial and temporal overlap between the two ERP components, the functional processes indexed by the N200 (conflict) and the fERN (reward) are dissociable. These results point toward avenues for future investigation. Copyright © 2011 Elsevier B.V. All rights reserved.

  19. Mood, food, and obesity

    PubMed Central

    Singh, Minati

    2014-01-01

    Food is a potent natural reward and food intake is a complex process. Reward and gratification associated with food consumption leads to dopamine (DA) production, which in turn activates reward and pleasure centers in the brain. An individual will repeatedly eat a particular food to experience this positive feeling of gratification. This type of repetitive behavior of food intake leads to the activation of brain reward pathways that eventually overrides other signals of satiety and hunger. Thus, a gratification habit through a favorable food leads to overeating and morbid obesity. Overeating and obesity stems from many biological factors engaging both central and peripheral systems in a bi-directional manner involving mood and emotions. Emotional eating and altered mood can also lead to altered food choice and intake leading to overeating and obesity. Research findings from human and animal studies support a two-way link between three concepts, mood, food, and obesity. The focus of this article is to provide an overview of complex nature of food intake where various biological factors link mood, food intake, and brain signaling that engages both peripheral and central nervous system signaling pathways in a bi-directional manner in obesity. PMID:25225489

  20. Bidirectional synaptic structural plasticity after chronic cocaine administration occurs through Rap1 small GTPase signaling

    PubMed Central

    Cahill, Michael E.; Bagot, Rosemary C.; Gancarz, Amy M.; Walker, Deena M.; Sun, HaoSheng; Wang, Zi-Jun; Heller, Elizabeth A.; Feng, Jian; Kennedy, Pamela J.; Koo, Ja Wook; Cates, Hannah M.; Neve, Rachael L.; Shen, Li; Dietz, David M.

    2016-01-01

    Summary Dendritic spines are the sites of most excitatory synapses in the CNS, and opposing alterations in the synaptic structure of medium spiny neurons (MSNs) of the nucleus accumbens, a primary brain reward region, are seen at early vs. late time points after cocaine administration. Here we investigate the time-dependent molecular and biochemical processes that regulate this bidirectional synaptic structural plasticity of NAc MSNs and associated changes in cocaine reward in response to chronic cocaine exposure. Our findings reveal key roles for the bidirectional synaptic expression of the Rap1b small GTPase and an associated local-synaptic protein translation network in this process. The transcriptional mechanisms and pathway-specific inputs to NAc that regulate Rap1b expression are also characterized. Collectively, these findings provide a precise mechanism by which nuclear to synaptic interactions induce “metaplasticity” in NAc MSNs, and we reveal the specific effects of this plasticity on reward behavior in a brain circuit-specific manner. PMID:26844834

  1. Increased neural responses to reward in adolescents and young adults with attention-deficit/hyperactivity disorder and their unaffected siblings.

    PubMed

    von Rhein, Daniel; Cools, Roshan; Zwiers, Marcel P; van der Schaaf, Marieke; Franke, Barbara; Luman, Marjolein; Oosterlaan, Jaap; Heslenfeld, Dirk J; Hoekstra, Pieter J; Hartman, Catharina A; Faraone, Stephen V; van Rooij, Daan; van Dongen, Eelco V; Lojowska, Maria; Mennes, Maarten; Buitelaar, Jan

    2015-05-01

    Attention-deficit/hyperactivity disorder (ADHD) is a heritable neuropsychiatric disorder associated with abnormal reward processing. Limited and inconsistent data exist about the neural mechanisms underlying this abnormality. Furthermore, it is not known whether reward processing is abnormal in unaffected siblings of participants with ADHD. We used event-related functional magnetic resonance imaging (fMRI) to investigate brain responses during reward anticipation and receipt with an adapted monetary incentive delay task in a large sample of adolescents and young adults with ADHD (n = 150), their unaffected siblings (n = 92), and control participants (n = 108), all of the same age. Participants with ADHD showed, relative to control participants, increased responses in the anterior cingulate, anterior frontal cortex, and cerebellum during reward anticipation, and in the orbitofrontal, occipital cortex and ventral striatum. Responses of unaffected siblings were increased in these regions as well, except for the cerebellum during anticipation and ventral striatum during receipt. ADHD in adolescents and young adults is associated with enhanced neural responses in frontostriatal circuitry to anticipation and receipt of reward. The findings support models emphasizing aberrant reward processing in ADHD, and suggest that processing of reward is subject to familial influences. Future studies using standard monetary incentive delay task parameters are needed to replicate our findings. Copyright © 2015 American Academy of Child and Adolescent Psychiatry. Published by Elsevier Inc. All rights reserved.

  2. Variability in Reward Responsivity and Obesity: Evidence from Brain Imaging Studies

    PubMed Central

    Burger, Kyle S.; Stice, Eric

    2012-01-01

    Advances in neuroimaging techniques have provided insight into the role of the brain in the regulation of food intake and weight. Growing evidence demonstrate that energy dense, palatable foods elicit similar responses in reward-related brain regions that mimic those of addictive substances. Currently, various models of obesity’s relation to reward from food have been theorized. There is evidence to support a theory of hypo-responsivity of reward regions to food, where individuals consume excess amounts to overcome this reward deficit. There is also data to support a theory of hyper-responsivity of reward regions, where individuals who experience greater reward from food intake are at risk for overeating. However, these seemingly discordant theories are static in nature and do not account for the possible effects of repeated overeating on brain responsivity to food and initial vulnerability factors. Here we review data that support these theories and propose a dynamic vulnerability model of obesity that appears to offer a parsimonious theory that accommodates extant findings. PMID:21999692

  3. Gender Dimorphism of Brain Reward System Volumes in Alcoholism

    PubMed Central

    Sawyer, Kayle S.; Oscar-Berman, Marlene; Barthelemy, Olivier J.; Papadimitriou, George M.; Harris, Gordon J.; Makris, Nikos

    2017-01-01

    The brain's reward network has been reported to be smaller in alcoholic men compared to nonalcoholic men, but little is known about the volumes of reward regions in alcoholic women. Morphometric analyses were performed on magnetic resonance brain scans of 60 long-term chronic alcoholics (ALC; 30 men) and 60 nonalcoholic controls (NC; 29 men). We derived volumes of total brain, and cortical and subcortical reward-related structures including the dorsolateral prefrontal (DLPFC), orbitofrontal, and cingulate cortices, and the temporal pole, insula, amygdala, hippocampus, nucleus accumbens septi (NAc), and ventral diencephalon (VDC). We examined the relationships of the volumetric findings to drinking history. Analyses revealed a significant gender interaction for the association between alcoholism and total reward network volumes, with ALC men having smaller reward volumes than NC men and ALC women having larger reward volumes than NC women. Analyses of a priori subregions revealed a similar pattern of reward volume differences with significant gender interactions for DLPFC and VDC. Overall, the volume of the cerebral ventricles in ALC participants was negatively associated with duration of abstinence, suggesting decline in atrophy over time. PMID:28285206

  4. Cortisol alters reward processing in the human brain.

    PubMed

    Kinner, Valerie L; Wolf, Oliver T; Merz, Christian J

    2016-08-01

    Dysfunctional reward processing is known to play a central role for the development of psychiatric disorders. Glucocorticoids that are secreted in response to stress have been shown to attenuate reward sensitivity and thereby might promote the onset of psychopathology. However, the underlying neurobiological mechanisms mediating stress hormone effects on reward processing as well as potential sex differences remain elusive. In this neuroimaging study, we administered 30mg cortisol or a placebo to 30 men and 30 women and subsequently tested them in the Monetary Incentive Delay Task. Cortisol attenuated anticipatory neural responses to a verbal and a monetary reward in the left pallidum and the right anterior parahippocampal gyrus. Furthermore, in men, activation in the amygdala, the precuneus, the anterior cingulate, and in hippocampal regions was reduced under cortisol, whereas in cortisol-treated women a signal increase was observed in these regions. Behavioral performance also indicated that reward learning in men is impaired under high cortisol concentrations, while it is augmented in women. These findings illustrate that the stress hormone cortisol substantially diminishes reward anticipation and provide first evidence that cortisol effects on the neural reward system are sensitive to sex differences, which might translate into different vulnerabilities for psychiatric disorders. Copyright © 2016 Elsevier Inc. All rights reserved.

  5. Imbalanced functional link between executive control network and reward network explain the online-game seeking behaviors in Internet gaming disorder.

    PubMed

    Dong, Guangheng; Lin, Xiao; Hu, Yanbo; Xie, Chunming; Du, Xiaoxia

    2015-03-17

    Literatures have shown that Internet gaming disorder (IGD) subjects show impaired executive control and enhanced reward sensitivities than healthy controls. However, how these two networks jointly affect the valuation process and drive IGD subjects' online-game-seeking behaviors remains unknown. Thirty-five IGD and 36 healthy controls underwent a resting-states scan in the MRI scanner. Functional connectivity (FC) was examined within control and reward network seeds regions, respectively. Nucleus accumbens (NAcc) was selected as the node to find the interactions between these two networks. IGD subjects show decreased FC in the executive control network and increased FC in the reward network when comparing with the healthy controls. When examining the correlations between the NAcc and the executive control/reward networks, the link between the NAcc - executive control network is negatively related with the link between NAcc - reward network. The changes (decrease/increase) in IGD subjects' brain synchrony in control/reward networks suggest the inefficient/overly processing within neural circuitry underlying these processes. The inverse proportion between control network and reward network in IGD suggest that impairments in executive control lead to inefficient inhibition of enhanced cravings to excessive online game playing. This might shed light on the mechanistic understanding of IGD.

  6. Entrepreneurial and parental love—are they the same?

    PubMed Central

    Lahti, Tom; Hytönen, Kaisa; Jääskeläinen, Iiro P.

    2017-01-01

    Abstract Here we tested the hypothesis that entrepreneurs' emotional experience and brain responses toward their own firm resemble those of parents toward their own children. Using fMRI, we measured the brain activity while male entrepreneurs viewed pictures of their own and of a familiar firm, and while fathers viewed pictures of their own and of a familiar child. The entrepreneurs who self‐rated as being very closely attached with their venture showed a similar suppression of activity in the posterior cingulate cortex, temporoparietal junction, and dorsomedial prefrontal cortex as fathers during viewing pictures of their own children versus familiar children. In addition, individual differences in the confidence trait influenced the neural encoding of both paternal and entrepreneurial processing. For underconfident fathers, a picture of one's own child was associated with stronger activation and for overconfident fathers with weaker activation in the amygdala and in caudate nucleus, a brain structure associated with processing of rewards. Similar association with activation, yet more widespread in the emotional processing network, was observed in entrepreneurs suggesting a similar neural basis for increased sensitivity to threats and potential risks concerning one's venture and child. In conclusion, both entrepreneurial and parental love seem to be supported by brain structures associated with reward and emotional processing as well as social understanding. Hum Brain Mapp 38:2923–2938, 2017. © 2017 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc. PMID:28295978

  7. Neural substrates of updating the prediction through prediction error during decision making.

    PubMed

    Wang, Ying; Ma, Ning; He, Xiaosong; Li, Nan; Wei, Zhengde; Yang, Lizhuang; Zha, Rujing; Han, Long; Li, Xiaoming; Zhang, Daren; Liu, Ying; Zhang, Xiaochu

    2017-08-15

    Learning of prediction error (PE), including reward PE and risk PE, is crucial for updating the prediction in reinforcement learning (RL). Neurobiological and computational models of RL have reported extensive brain activations related to PE. However, the occurrence of PE does not necessarily predict updating the prediction, e.g., in a probability-known event. Therefore, the brain regions specifically engaged in updating the prediction remain unknown. Here, we conducted two functional magnetic resonance imaging (fMRI) experiments, the probability-unknown Iowa Gambling Task (IGT) and the probability-known risk decision task (RDT). Behavioral analyses confirmed that PEs occurred in both tasks but were only used for updating the prediction in the IGT. By comparing PE-related brain activations between the two tasks, we found that the rostral anterior cingulate cortex/ventral medial prefrontal cortex (rACC/vmPFC) and the posterior cingulate cortex (PCC) activated only during the IGT and were related to both reward and risk PE. Moreover, the responses in the rACC/vmPFC and the PCC were modulated by uncertainty and were associated with reward prediction-related brain regions. Electric brain stimulation over these regions lowered the performance in the IGT but not in the RDT. Our findings of a distributed neural circuit of PE processing suggest that the rACC/vmPFC and the PCC play a key role in updating the prediction through PE processing during decision making. Copyright © 2017 Elsevier Inc. All rights reserved.

  8. Motivational effects on the processing of delayed intentions in the anterior prefrontal cortex.

    PubMed

    Bruening, Jovita; Ludwig, Vera U; Paschke, Lena M; Walter, Henrik; Stelzel, Christine

    2018-05-15

    Delaying intentions bears the risk of interference from distracting activities during the delay interval. Motivation can increase intention retrieval success but little is known about the underlying brain mechanisms. Here, we investigated whether motivational incentives (monetary reward) modulate the processing of delayed intentions in the anterior prefrontal cortex (aPFC), known to be crucial for intention processing. Using a mixed blocked and event-related functional Magnetic Resonance Imaging design, we specifically tested whether reward affects intention processing in the aPFC in a transient or in a sustained manner and whether this is related to individual differences in retrieval success. We found a generalized effect of reward on both correct intention retrieval and ongoing task performance. Fronto-parietal regions including bilateral lateral aPFC showed sustained activity increases in rewarded compared to non-rewarded blocks as well as transient reward-related activity during the storage phase. Additionally, individual differences in reward-related performance benefits were related to the degree of transient signal increases in right lateral aPFC, specifically during intention encoding. This suggests that the ability to integrate motivational relevance into the encoding of future intentions is crucial for successful intention retrieval in addition to general increases in processing effort. Bilateral aPFC is central to these motivation-cognition interactions. Copyright © 2018 Elsevier Inc. All rights reserved.

  9. A Dynamic Connectome Supports the Emergence of Stable Computational Function of Neural Circuits through Reward-Based Learning.

    PubMed

    Kappel, David; Legenstein, Robert; Habenschuss, Stefan; Hsieh, Michael; Maass, Wolfgang

    2018-01-01

    Synaptic connections between neurons in the brain are dynamic because of continuously ongoing spine dynamics, axonal sprouting, and other processes. In fact, it was recently shown that the spontaneous synapse-autonomous component of spine dynamics is at least as large as the component that depends on the history of pre- and postsynaptic neural activity. These data are inconsistent with common models for network plasticity and raise the following questions: how can neural circuits maintain a stable computational function in spite of these continuously ongoing processes, and what could be functional uses of these ongoing processes? Here, we present a rigorous theoretical framework for these seemingly stochastic spine dynamics and rewiring processes in the context of reward-based learning tasks. We show that spontaneous synapse-autonomous processes, in combination with reward signals such as dopamine, can explain the capability of networks of neurons in the brain to configure themselves for specific computational tasks, and to compensate automatically for later changes in the network or task. Furthermore, we show theoretically and through computer simulations that stable computational performance is compatible with continuously ongoing synapse-autonomous changes. After reaching good computational performance it causes primarily a slow drift of network architecture and dynamics in task-irrelevant dimensions, as observed for neural activity in motor cortex and other areas. On the more abstract level of reinforcement learning the resulting model gives rise to an understanding of reward-driven network plasticity as continuous sampling of network configurations.

  10. A Dynamic Connectome Supports the Emergence of Stable Computational Function of Neural Circuits through Reward-Based Learning

    PubMed Central

    Habenschuss, Stefan; Hsieh, Michael

    2018-01-01

    Synaptic connections between neurons in the brain are dynamic because of continuously ongoing spine dynamics, axonal sprouting, and other processes. In fact, it was recently shown that the spontaneous synapse-autonomous component of spine dynamics is at least as large as the component that depends on the history of pre- and postsynaptic neural activity. These data are inconsistent with common models for network plasticity and raise the following questions: how can neural circuits maintain a stable computational function in spite of these continuously ongoing processes, and what could be functional uses of these ongoing processes? Here, we present a rigorous theoretical framework for these seemingly stochastic spine dynamics and rewiring processes in the context of reward-based learning tasks. We show that spontaneous synapse-autonomous processes, in combination with reward signals such as dopamine, can explain the capability of networks of neurons in the brain to configure themselves for specific computational tasks, and to compensate automatically for later changes in the network or task. Furthermore, we show theoretically and through computer simulations that stable computational performance is compatible with continuously ongoing synapse-autonomous changes. After reaching good computational performance it causes primarily a slow drift of network architecture and dynamics in task-irrelevant dimensions, as observed for neural activity in motor cortex and other areas. On the more abstract level of reinforcement learning the resulting model gives rise to an understanding of reward-driven network plasticity as continuous sampling of network configurations. PMID:29696150

  11. Amphetamine sensitization alters reward processing in the human striatum and amygdala.

    PubMed

    O'Daly, Owen G; Joyce, Daniel; Tracy, Derek K; Azim, Adnan; Stephan, Klaas E; Murray, Robin M; Shergill, Sukhwinder S

    2014-01-01

    Dysregulation of mesolimbic dopamine transmission is implicated in a number of psychiatric illnesses characterised by disruption of reward processing and goal-directed behaviour, including schizophrenia, drug addiction and impulse control disorders associated with chronic use of dopamine agonists. Amphetamine sensitization (AS) has been proposed to model the development of this aberrant dopamine signalling and the subsequent dysregulation of incentive motivational processes. However, in humans the effects of AS on the dopamine-sensitive neural circuitry associated with reward processing remains unclear. Here we describe the effects of acute amphetamine administration, following a sensitising dosage regime, on blood oxygen level dependent (BOLD) signal in dopaminoceptive brain regions during a rewarded gambling task performed by healthy volunteers. Using a randomised, double-blind, parallel-groups design, we found clear evidence for sensitization to the subjective effects of the drug, while rewarded reaction times were unchanged. Repeated amphetamine exposure was associated with reduced dorsal striatal BOLD signal during decision making, but enhanced ventromedial caudate activity during reward anticipation. The amygdala BOLD response to reward outcomes was blunted following repeated amphetamine exposure. Positive correlations between subjective sensitization and changes in anticipation- and outcome-related BOLD signal were seen for the caudate nucleus and amygdala, respectively. These data show for the first time in humans that AS changes the functional impact of acute stimulant exposure on the processing of reward-related information within dopaminoceptive regions. Our findings accord with pathophysiological models which implicate aberrant dopaminergic modulation of striatal and amygdala activity in psychosis and drug-related compulsive disorders.

  12. Integration of homeostatic signaling and food reward processing in the human brain

    PubMed Central

    Simon, Joe J.; Wetzel, Anne; Sinno, Maria Hamze; Skunde, Mandy; Bendszus, Martin; Enck, Paul; Herzog, Wolfgang; Friederich, Hans-Christoph

    2017-01-01

    BACKGROUND. Food intake is guided by homeostatic needs and by the reward value of food, yet the exact relation between the two remains unclear. The aim of this study was to investigate the influence of different metabolic states and hormonal satiety signaling on responses in neural reward networks. METHODS. Twenty-three healthy participants underwent functional magnetic resonance imaging while performing a task distinguishing between the anticipation and the receipt of either food- or monetary-related reward. Every participant was scanned twice in a counterbalanced fashion, both during a fasted state (after 24 hours fasting) and satiety. A functional connectivity analysis was performed to investigate the influence of satiety signaling on activation in neural reward networks. Blood samples were collected to assess hormonal satiety signaling. RESULTS. Fasting was associated with sensitization of the striatal reward system to the anticipation of food reward irrespective of reward magnitude. Furthermore, during satiety, individual ghrelin levels were associated with increased neural processing during the expectation of food-related reward. CONCLUSIONS. Our findings show that physiological hunger stimulates food consumption by specifically increasing neural processing during the expectation (i.e., incentive salience) but not the receipt of food-related reward. In addition, these findings suggest that ghrelin signaling influences hedonic-driven food intake by increasing neural reactivity during the expectation of food-related reward. These results provide insights into the neurobiological underpinnings of motivational processing and hedonic evaluation of food reward. TRIAL REGISTRATION. ClinicalTrials.gov NCT03081585. FUNDING. This work was supported by the German Competence Network on Obesity, which is funded by the German Federal Ministry of Education and Research (FKZ 01GI1122E). PMID:28768906

  13. In the eye of the beholder: individual differences in reward-drive modulate early frontocentral ERPs to angry faces.

    PubMed

    Bediou, Benoit; Eimer, Martin; d'Amato, Thierry; Hauk, Olaf; Calder, Andrew J

    2009-02-01

    Individual differences in reward-drive have been associated with increased attention toward facial signals of aggression, heightened experience of anger and vulnerability to display aggressive behaviour. Recent fMRI research suggests that these effects rely on reduced ventromedial prefrontal (and increased amygdala) response to aggressive facial displays compared with neutral and sad expressions in subjects scoring high on reward-drive. However, nothing is known about the timing of this modulation. Using event-related potentials (ERPs), we provide the first evidence that greater proneness to display hostile and aggressive behaviour (measured by high scores on the reward-drive) is associated with a reduced midline frontocentral response to aggressive faces within 200-300ms. In addition to confirming a particular interaction between anger processing and aggression related personality traits in ventromedial prefrontal brain regions, our study brings a first indication of when their interaction occurs in the brain, strengthening results from previous classical as well as functional connectivity fMRI studies.

  14. Fifty Years in the Development of a Glutaminergic-Dopaminergic Optimization Complex (KB220) to Balance Brain Reward Circuitry in Reward Deficiency Syndrome: A Pictorial

    PubMed Central

    Blum, K; Febo, M; Badgaiyan, RD

    2016-01-01

    Dopamine along with other chemical messengers like serotonin, cannabinoids, endorphins and glutamine, play significant roles in brain reward processing. There is a devastating opiate/opioid epidemicin the United States. According to the Centers for Disease Control and Prevention (CDC), at least 127 people, young and old, are dying every day due to narcotic overdose and alarmingly heroin overdose is on the rise. The Food and Drug Administration (FDA) has approved some Medication-Assisted Treatments (MATs) for alcoholism, opiate and nicotine dependence, but nothing for psychostimulant and cannabis abuse. While these pharmaceuticals are essential for the short-term induction of “psychological extinction,” in the long-term caution is necessary because their use favors blocking dopaminergic function indispensable for achieving normal satisfaction in life. The two institutions devoted to alcoholism and drug dependence (NIAAA & NIDA) realize that MATs are not optimal and continue to seek better treatment options. We review, herein, the history of the development of a glutaminergic-dopaminergic optimization complex called KB220 to provide for the possible eventual balancing of the brain reward system and the induction of “dopamine homeostasis.” This complex may provide substantial clinical benefit to the victims of Reward Deficiency Syndrome (RDS) and assist in recovery from iatrogenically induced addiction to unwanted opiates/opioids and other addictive behaviors. PMID:27840857

  15. Reward-Based Spatial Learning in Teens With Bulimia Nervosa

    PubMed Central

    Cyr, Marilyn; Wang, Zhishun; Tau, Gregory Z.; Zhao, Guihu; Friedl, Eve; Stefan, Mihaela; Terranova, Kate; Marsh, Rachel

    2016-01-01

    Objective To assess the functioning of mesolimbic and fronto-striatal areas involved in reward-based spatial learning in teenaged girls with bulimia nervosa (BN) that might be involved in the development and maintenance of maladaptive behaviors characteristic of the disorder. Method We compared functional magnetic resonance imaging blood oxygen level dependent response in 27 adolescent girls with BN to that of 27 healthy, age-matched control participants during a reward-based learning task that required learning to use extra-maze cues to navigate a virtual 8-arm radial maze to find hidden rewards. We compared groups in their patterns of brain activation associated with reward-based spatial learning versus a control condition in which rewards were unexpected because they were allotted pseudo-randomly to experimentally prevent learning. Results Both groups learned to navigate the maze to find hidden rewards, but group differences in brain activity associated with maze navigation and reward processing were detected in fronto-striatal regions and right anterior hippocampus. Unlike healthy adolescents, those with BN did not engage right inferior frontal gyrus during maze navigation, activated right anterior hippocampus during the receipt of unexpected rewards (control condition), and deactivated left superior frontal gyrus and right anterior hippocampus during expected reward receipt (learning condition). These patterns of hippocampal activation in the control condition were significantly associated with the frequency of binge-eating episodes. Conclusion Adolescents with BN displayed abnormal functioning of anterior hippocampus and fronto-striatal regions during reward-based spatial learning. These findings suggest that an imbalance in control and reward circuits may arise early in the course of BN. Clinical trial registration information An fMRI Study of Self-regulation in Adolescents With Bulimia Nervosa; https://clinicaltrials.gov/ct2/show/NCT00345943; NCT00345943. PMID:27806864

  16. Cigarette smoking modulates medication-associated deficits in a monetary reward task in patients with schizophrenia.

    PubMed

    Lernbass, Birgit; Grön, Georg; Wolf, Nadine D; Abler, Birgit

    2013-09-01

    Imaging studies of reward processing have demonstrated a mesolimbic-mesocortical dopaminergic dysfunction in schizophrenia. Such studies on reward processing in patients and also in healthy controls showed that differential activations of dopaminergic brain areas are associated with adaptive changes in response speed related to different reward values. Given this relationship, we investigated reward processing on the behavioural level in a larger sample of 49 medicated patients with a diagnosis of schizophrenia (ICD-10 F20) and 49 healthy controls. Subjects were instructed to react by button press upon two different stimuli in order to retain a 60 % chance winning a previously announced high (1$) or low (20¢) amount of money paid to participants after the experiment. Concordant with previous reports on deficits in reward processing, acceleration of reaction times in patients upon low rewards differed significantly (p < 0.05) from healthy controls in our present behavioural study. This effect was pronounced in the non-smoking subgroup of patients (n = 24). In this subgroup, we also observed a significant (p < 0.05) positive correlation with medication type (relatively high vs. low D2 receptor affinity) and with the PANSS score, the latter with a trend to significance (p = 0.08). Our study demonstrates that reaction time measures in a monetary reward task might constitute a feasible behavioural proxy for dopaminergic dysfunction and its different dimensions regarding psychopathology but also medication in patients with schizophrenia. In line with clinical observations, our findings support the notion that smoking modulates medication-associated side effects on reward processing in patients with schizophrenia.

  17. Entrepreneurial and parental love-are they the same?

    PubMed

    Halko, Marja-Liisa; Lahti, Tom; Hytönen, Kaisa; Jääskeläinen, Iiro P

    2017-06-01

    Here we tested the hypothesis that entrepreneurs' emotional experience and brain responses toward their own firm resemble those of parents toward their own children. Using fMRI, we measured the brain activity while male entrepreneurs viewed pictures of their own and of a familiar firm, and while fathers viewed pictures of their own and of a familiar child. The entrepreneurs who self-rated as being very closely attached with their venture showed a similar suppression of activity in the posterior cingulate cortex, temporoparietal junction, and dorsomedial prefrontal cortex as fathers during viewing pictures of their own children versus familiar children. In addition, individual differences in the confidence trait influenced the neural encoding of both paternal and entrepreneurial processing. For underconfident fathers, a picture of one's own child was associated with stronger activation and for overconfident fathers with weaker activation in the amygdala and in caudate nucleus, a brain structure associated with processing of rewards. Similar association with activation, yet more widespread in the emotional processing network, was observed in entrepreneurs suggesting a similar neural basis for increased sensitivity to threats and potential risks concerning one's venture and child. In conclusion, both entrepreneurial and parental love seem to be supported by brain structures associated with reward and emotional processing as well as social understanding. Hum Brain Mapp 38:2923-2938, 2017. © 2017 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc. © 2017 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

  18. Dopamine and reward: comment on Hernandez et al. (2006).

    PubMed

    Gallistel, C R

    2006-08-01

    Many lines of evidence suggest that the dopaminergic projection from the midbrain tegmentum to the forebrain must play a critical role in mediating the behavioral effects of natural and artificial rewards, with brain stimulation reward and addictive drugs included in the latter category. However, a closer look reveals many incongruities. The work of G. Hernandez et al. (2006) resolves several puzzles. It implies that the dopaminergic projection does not carry the signal that encodes the magnitude of a brain stimulation reward. It suggests that the elevation in the tonic levels of dopamine consequent on brain stimulation reward modulates the registration of the magnitude of the reward. This reconciles the psychophysical evidence with the pharmacological, electrophysiological, and anatomical evidence. However, some serious puzzles do remain.

  19. Abstinence duration modulates striatal functioning during monetary reward processing in cocaine patients.

    PubMed

    Bustamante, Juan-Carlos; Barrós-Loscertales, Alfonso; Costumero, Víctor; Fuentes-Claramonte, Paola; Rosell-Negre, Patricia; Ventura-Campos, Noelia; Llopis, Juan-José; Ávila, César

    2014-09-01

    Pre-clinical and clinical studies in cocaine addiction highlight alterations in the striatal dopaminergic reward system that subserve maintenance of cocaine use. Using an instrumental conditioning paradigm with monetary reinforcement, we studied striatal functional alterations in long-term abstinent cocaine-dependent patients and striatal functioning as a function of abstinence and treatment duration. Eighteen patients and 20 controls underwent functional magnetic resonance imaging during a Monetary Incentive Delay task. Region of interest analyses based on masks of the dorsal and ventral striatum were conducted to test between-group differences and the functional effects in the cocaine group of time (in months) with no more than two lapses from the first time patients visited the clinical service to seek treatment at the scanning time (duration of treatment), and the functional effects of the number of months with no lapses or relapses at the scanning session time (length of abstinence). We applied a voxel-wise and a cluster-wise FWE-corrected level (pFWE) at a threshold of P < 0.05. The patient group showed lower activation in the right caudate during reward anticipation than the control group. The regression analyses in the patients group revealed a positive correlation between duration of treatment and brain activity in the left caudate during reward anticipation. Likewise, length of abstinence negatively correlated with brain activity in the bilateral nucleus accumbens during monetary outcome processing. In conclusion, caudate and nucleus accumbens show a different brain response pattern to non-drug rewards during cocaine addiction, which can be modulated by treatment success. © 2013 The Authors, Addiction Biology © 2013 Society for the Study of Addiction.

  20. A neuronal reward inequity signal in primate striatum

    PubMed Central

    van Coeverden, Charlotte R.; Schultz, Wolfram

    2015-01-01

    Primates are social animals, and their survival depends on social interactions with others. Especially important for social interactions and welfare is the observation of rewards obtained by other individuals and the comparison with own reward. The fundamental social decision variable for the comparison process is reward inequity, defined by an asymmetric reward distribution among individuals. An important brain structure for coding reward inequity may be the striatum, a component of the basal ganglia involved in goal-directed behavior. Two rhesus monkeys were seated opposite each other and contacted a touch-sensitive table placed between them to obtain specific magnitudes of reward that were equally or unequally distributed among them. Response times in one of the animals demonstrated differential behavioral sensitivity to reward inequity. A group of neurons in the striatum showed distinct signals reflecting disadvantageous and advantageous reward inequity. These neuronal signals occurred irrespective of, or in conjunction with, own reward coding. These data demonstrate that striatal neurons of macaque monkeys sense the differences between other's and own reward. The neuronal activities are likely to contribute crucial reward information to neuronal mechanisms involved in social interactions. PMID:26378202

  1. No Effect of Commercial Cognitive Training on Brain Activity, Choice Behavior, or Cognitive Performance.

    PubMed

    Kable, Joseph W; Caulfield, M Kathleen; Falcone, Mary; McConnell, Mairead; Bernardo, Leah; Parthasarathi, Trishala; Cooper, Nicole; Ashare, Rebecca; Audrain-McGovern, Janet; Hornik, Robert; Diefenbach, Paul; Lee, Frank J; Lerman, Caryn

    2017-08-02

    Increased preference for immediate over delayed rewards and for risky over certain rewards has been associated with unhealthy behavioral choices. Motivated by evidence that enhanced cognitive control can shift choice behavior away from immediate and risky rewards, we tested whether training executive cognitive function could influence choice behavior and brain responses. In this randomized controlled trial, 128 young adults (71 male, 57 female) participated in 10 weeks of training with either a commercial web-based cognitive training program or web-based video games that do not specifically target executive function or adapt the level of difficulty throughout training. Pretraining and post-training, participants completed cognitive assessments and functional magnetic resonance imaging during performance of the following validated decision-making tasks: delay discounting (choices between smaller rewards now vs larger rewards in the future) and risk sensitivity (choices between larger riskier rewards vs smaller certain rewards). Contrary to our hypothesis, we found no evidence that cognitive training influences neural activity during decision-making; nor did we find effects of cognitive training on measures of delay discounting or risk sensitivity. Participants in the commercial training condition improved with practice on the specific tasks they performed during training, but participants in both conditions showed similar improvement on standardized cognitive measures over time. Moreover, the degree of improvement was comparable to that observed in individuals who were reassessed without any training whatsoever. Commercial adaptive cognitive training appears to have no benefits in healthy young adults above those of standard video games for measures of brain activity, choice behavior, or cognitive performance. SIGNIFICANCE STATEMENT Engagement of neural regions and circuits important in executive cognitive function can bias behavioral choices away from immediate rewards. Activity in these regions may be enhanced through adaptive cognitive training. Commercial brain training programs claim to improve a broad range of mental processes; however, evidence for transfer beyond trained tasks is mixed. We undertook the first randomized controlled trial of the effects of commercial adaptive cognitive training (Lumosity) on neural activity and decision-making in young adults ( N = 128) compared with an active control (playing on-line video games). We found no evidence for relative benefits of cognitive training with respect to changes in decision-making behavior or brain response, or for cognitive task performance beyond those specifically trained. Copyright © 2017 the authors 0270-6474/17/377390-13$15.00/0.

  2. No Effect of Commercial Cognitive Training on Brain Activity, Choice Behavior, or Cognitive Performance

    PubMed Central

    Caulfield, M. Kathleen; McConnell, Mairead; Bernardo, Leah; Parthasarathi, Trishala; Cooper, Nicole; Ashare, Rebecca; Audrain-McGovern, Janet; Lee, Frank J.; Lerman, Caryn

    2017-01-01

    Increased preference for immediate over delayed rewards and for risky over certain rewards has been associated with unhealthy behavioral choices. Motivated by evidence that enhanced cognitive control can shift choice behavior away from immediate and risky rewards, we tested whether training executive cognitive function could influence choice behavior and brain responses. In this randomized controlled trial, 128 young adults (71 male, 57 female) participated in 10 weeks of training with either a commercial web-based cognitive training program or web-based video games that do not specifically target executive function or adapt the level of difficulty throughout training. Pretraining and post-training, participants completed cognitive assessments and functional magnetic resonance imaging during performance of the following validated decision-making tasks: delay discounting (choices between smaller rewards now vs larger rewards in the future) and risk sensitivity (choices between larger riskier rewards vs smaller certain rewards). Contrary to our hypothesis, we found no evidence that cognitive training influences neural activity during decision-making; nor did we find effects of cognitive training on measures of delay discounting or risk sensitivity. Participants in the commercial training condition improved with practice on the specific tasks they performed during training, but participants in both conditions showed similar improvement on standardized cognitive measures over time. Moreover, the degree of improvement was comparable to that observed in individuals who were reassessed without any training whatsoever. Commercial adaptive cognitive training appears to have no benefits in healthy young adults above those of standard video games for measures of brain activity, choice behavior, or cognitive performance. SIGNIFICANCE STATEMENT Engagement of neural regions and circuits important in executive cognitive function can bias behavioral choices away from immediate rewards. Activity in these regions may be enhanced through adaptive cognitive training. Commercial brain training programs claim to improve a broad range of mental processes; however, evidence for transfer beyond trained tasks is mixed. We undertook the first randomized controlled trial of the effects of commercial adaptive cognitive training (Lumosity) on neural activity and decision-making in young adults (N = 128) compared with an active control (playing on-line video games). We found no evidence for relative benefits of cognitive training with respect to changes in decision-making behavior or brain response, or for cognitive task performance beyond those specifically trained. PMID:28694338

  3. The Neurodynamics of Affect in the Laboratory Predicts Persistence of Real-World Emotional Responses.

    PubMed

    Heller, Aaron S; Fox, Andrew S; Wing, Erik K; McQuisition, Kaitlyn M; Vack, Nathan J; Davidson, Richard J

    2015-07-22

    Failure to sustain positive affect over time is a hallmark of depression and other psychopathologies, but the mechanisms supporting the ability to sustain positive emotional responses are poorly understood. Here, we investigated the neural correlates associated with the persistence of positive affect in the real world by conducting two experiments in humans: an fMRI task of reward responses and an experience-sampling task measuring emotional responses to a reward obtained in the field. The magnitude of DLPFC engagement to rewards administered in the laboratory predicted reactivity of real-world positive emotion following a reward administered in the field. Sustained ventral striatum engagement in the laboratory positively predicted the duration of real-world positive emotional responses. These results suggest that common pathways are associated with the unfolding of neural processes over seconds and with the dynamics of emotions experienced over minutes. Examining such dynamics may facilitate a better understanding of the brain-behavior associations underlying emotion. Significance statement: How real-world emotion, experienced over seconds, minutes, and hours, is instantiated in the brain over the course of milliseconds and seconds is unknown. We combined a novel, real-world experience-sampling task with fMRI to examine how individual differences in real-world emotion, experienced over minutes and hours, is subserved by affective neurodynamics of brain activity over the course of seconds. When winning money in the real world, individuals sustaining positive emotion the longest were those with the most prolonged ventral striatal activity. These results suggest that common pathways are associated with the unfolding of neural processes over seconds and with the dynamics of emotions experienced over minutes. Examining such dynamics may facilitate a better understanding of the brain-behavior associations underlying emotion. Copyright © 2015 the authors 0270-6474/15/3510503-07$15.00/0.

  4. Adolescent Maturational Transitions in the Prefrontal Cortex and Dopamine Signaling as a Risk Factor for the Development of Obesity and High Fat/High Sugar Diet Induced Cognitive Deficits

    PubMed Central

    Reichelt, Amy C.

    2016-01-01

    Adolescence poses as both a transitional period in neurodevelopment and lifestyle practices. In particular, the developmental trajectory of the prefrontal cortex (PFC), a critical region for behavioral control and self-regulation, is enduring, not reaching functional maturity until the early 20 s in humans. Furthermore, the neurotransmitter dopamine is particularly abundant during adolescence, tuning the brain to rapidly learn about rewards and regulating aspects of neuroplasticity. Thus, adolescence is proposed to represent a period of vulnerability towards reward-driven behaviors such as the consumption of palatable high fat and high sugar diets. This is reflected in the increasing prevalence of obesity in children and adolescents as they are the greatest consumers of “junk foods”. Excessive consumption of diets laden in saturated fat and refined sugars not only leads to weight gain and the development of obesity, but experimental studies with rodents indicate they evoke cognitive deficits in learning and memory process by disrupting neuroplasticity and altering reward processing neurocircuitry. Consumption of these high fat and high sugar diets have been reported to have a particularly pronounced impact on cognition when consumed during adolescence, demonstrating a susceptibility of the adolescent brain to enduring cognitive deficits. The adolescent brain, with heightened reward sensitivity and diminished behavioral control compared to the mature adult brain, appears to be a risk for aberrant eating behaviors that may underpin the development of obesity. This review explores the neurodevelopmental changes in the PFC and mesocortical dopamine signaling that occur during adolescence, and how these potentially underpin the overconsumption of palatable food and development of obesogenic diet-induced cognitive deficits. PMID:27790098

  5. Resting state hypothalamic response to glucose predicts glucose-induced attenuation in the ventral striatal response to food cues.

    PubMed

    Luo, Shan; Melrose, A James; Dorton, Hilary; Alves, Jasmin; Monterosso, John R; Page, Kathleen A

    2017-09-01

    Feeding behavior is regulated by a complex interaction of central nervous system responses to metabolic signals that reflect nutrient availability and to food cues that trigger appetitive responses. Prior work has shown that the hypothalamus is a key brain area that senses and responds to changes in metabolic signals, and exposure to food cues induces the activation of brain areas involved in reward processing. However, it is not known how the hypothalamic responses to changes in metabolic state are related to reward responses to food cues. This study aimed to understand whether changes in hypothalamic activity in response to glucose-induced metabolic signals are linked to food-cue reactivity within brain areas involved in reward processing. We combined two neuroimaging modalities (Arterial Spin Labeling and Blood Oxygen Level Dependent) to measure glucose-induced changes in hypothalamic cerebral blood flow (CBF) and food-cue task induced changes in brain activity within reward-related regions. Twenty-five participants underwent a MRI session following glucose ingestion and a subset of twenty individuals underwent an additional water session on a separate day as a control condition (drink order randomized). Hunger was assessed before and after drink consumption. We observed that individuals who had a greater reduction in hypothalamic CBF exhibited a greater reduction in left ventral striatum food cue reactivity (Spearman's rho = 0.46, P = 0.048) following glucose vs. water ingestion. These results are the first to use multimodal imaging to demonstrate a link between hypothalamic metabolic signaling and ventral striatal food cue reactivity. Copyright © 2017 Elsevier Ltd. All rights reserved.

  6. Trait Rumination Influences Neural Correlates of the Anticipation but Not the Consumption Phase of Reward Processing

    PubMed Central

    Kocsel, Natália; Szabó, Edina; Galambos, Attila; Édes, Andrea; Pap, Dorottya; Elliott, Rebecca; Kozák, Lajos R.; Bagdy, György; Juhász, Gabriella; Kökönyei, Gyöngyi

    2017-01-01

    Cumulative evidence suggests that trait rumination can be defined as an abstract information processing mode, which leads people to constantly anticipate the likely impact of present events on future events and experiences. A previous study with remitted depressed patients suggested that enhanced rumination tendencies distort brain mechanisms of anticipatory processes associated with reward and loss cues. In the present study, we explored the impact of trait rumination on neural activity during reward and loss anticipation among never-depressed people. We analyzed the data of 37 healthy controls, who performed the monetary incentive delay (MID) task which was designed for the simultaneous measurement of the anticipation (motivational) and consumption (hedonic) phase of reward processing, during functional magnetic resonance imaging (fMRI). Our results show that rumination—after controlling for age, gender, and current mood—significantly influenced neural responses to reward (win) cues compared to loss cues. Blood-oxygenation-level-dependent (BOLD) activity in the left inferior frontal gyrus (IFG) triangularis, left anterior insula, and left rolandic operculum was positively related to Ruminative Response Scale (RRS) scores. We did not detect any significant rumination-related activations associated with win-neutral or loss-neutral cues and with reward or loss consumption. Our results highlight the influence of trait rumination on reward anticipation in a non-depressed sample. They also suggest that for never-depressed ruminators rewarding cues are more salient than loss cues. BOLD response during reward consumption did not relate to rumination, suggesting that rumination mainly relates to processing of the motivational (wanting) aspect of reward rather than the hedonic (liking) aspect, at least in the absence of pathological mood. PMID:28539875

  7. Real and hypothetical monetary rewards modulate risk taking in the brain.

    PubMed

    Xu, Sihua; Pan, Yu; Wang, You; Spaeth, Andrea M; Qu, Zhe; Rao, Hengyi

    2016-07-07

    Both real and hypothetical monetary rewards are widely used as reinforcers in risk taking and decision making studies. However, whether real and hypothetical monetary rewards modulate risk taking and decision making in the same manner remains controversial. In this study, we used event-related potentials (ERP) with a balloon analogue risk task (BART) paradigm to examine the effects of real and hypothetical monetary rewards on risk taking in the brain. Behavioral data showed reduced risk taking after negative feedback (money loss) during the BART with real rewards compared to those with hypothetical rewards, suggesting increased loss aversion with real monetary rewards. The ERP data demonstrated a larger feedback-related negativity (FRN) in response to money loss during risk taking with real rewards compared to those with hypothetical rewards, which may reflect greater prediction error or regret emotion after real monetary losses. These findings demonstrate differential effects of real versus hypothetical monetary rewards on risk taking behavior and brain activity, suggesting a caution when drawing conclusions about real choices from hypothetical studies of intended behavior, especially when large rewards are used. The results have implications for future utility of real and hypothetical monetary rewards in studies of risk taking and decision making.

  8. Orbitofrontal reward sensitivity and impulsivity in adult attention deficit hyperactivity disorder.

    PubMed

    Wilbertz, Gregor; van Elst, Ludger Tebartz; Delgado, Mauricio R; Maier, Simon; Feige, Bernd; Philipsen, Alexandra; Blechert, Jens

    2012-03-01

    Impulsivity symptoms of adult attention deficit hyperactivity disorder (ADHD) such as increased risk taking have been linked with impaired reward processing. Previous studies have focused on reward anticipation or on rewarded executive functioning tasks and have described a striatal hyporesponsiveness and orbitofrontal alterations in adult and adolescent ADHD. Passive reward delivery and its link to behavioral impulsivity are less well understood. To study this crucial aspect of reward processing we used functional magnetic resonance imaging (fMRI) combined with electrodermal assessment in male and female adult ADHD patients (N=28) and matched healthy control participants (N=28) during delivery of monetary and non-monetary rewards. Further, two behavioral tasks assessed risky decision making (game of dice task) and delay discounting. Results indicated that both groups activated ventral and dorsal striatum and the medial orbitofrontal cortex (mOFC) in response to high-incentive (i.e. monetary) rewards. A similar, albeit less strong activation pattern was found for low-incentive (i.e. non-monetary) rewards. Group differences emerged when comparing high and low incentive rewards directly: activation in the mOFC coded for the motivational change in reward delivery in healthy controls, but not ADHD patients. Additionally, this dysfunctional mOFC activity in patients correlated with risky decision making and delay discounting and was paralleled by physiological arousal. Together, these results suggest that the mOFC codes reward value and type in healthy individuals whereas this function is deficient in ADHD. The brain-behavior correlations suggest that this deficit might be related to behavioral impulsivity. Reward value processing difficulties in ADHD should be considered when assessing reward anticipation and emotional learning in research and applied settings. Copyright © 2011 Elsevier Inc. All rights reserved.

  9. Processing of social and monetary rewards in the human striatum.

    PubMed

    Izuma, Keise; Saito, Daisuke N; Sadato, Norihiro

    2008-04-24

    Despite an increasing focus on the neural basis of human decision making in neuroscience, relatively little attention has been paid to decision making in social settings. Moreover, although human social decision making has been explored in a social psychology context, few neural explanations for the observed findings have been considered. To bridge this gap and improve models of human social decision making, we investigated whether acquiring a good reputation, which is an important incentive in human social behaviors, activates the same reward circuitry as monetary rewards. In total, 19 subjects participated in functional magnetic resonance imaging (fMRI) experiments involving monetary and social rewards. The acquisition of one's good reputation robustly activated reward-related brain areas, notably the striatum, and these overlapped with the areas activated by monetary rewards. Our findings support the idea of a "common neural currency" for rewards and represent an important first step toward a neural explanation for complex human social behaviors.

  10. The effect of graded monetary reward on cognitive event-related potentials and behavior in young healthy adults

    PubMed Central

    Goldstein, Rita Z.; Cottone, Lisa A.; Jia, Zhiru; Maloney, Thomas; Volkow, Nora D.; Squires, Nancy K.

    2008-01-01

    Temporal correlates of the brain circuit underlying reward processing in healthy adults remain unclear. The current study investigated the P3 and contingent negative variation (CNV) as putative reward-related temporal markers. The effect of sustained monetary reward on these event-related potentials and on behavior was assessed using a warned reaction-time paradigm in 16 young healthy subjects. Monetary reward (0, 1 and 45 cents) varied across blocks of trials. While the CNV was unaffected by money, P3 amplitude was significantly larger for 45 than the 1 and 0 cent conditions. This effect corresponded to the monotonically positive subjective ratings of interest and excitement on the task (45>1>0). These findings suggest a difference between the P3 and CNV; the P3 is sensitive to the sustained effect of relative reward value while the CNV does not vary with reward magnitude. PMID:16876894

  11. Altered reward processing in adolescents with prenatal exposure to maternal cigarette smoking.

    PubMed

    Müller, Kathrin U; Mennigen, Eva; Ripke, Stephan; Banaschewski, Tobias; Barker, Gareth J; Büchel, Christian; Conrod, Patricia; Fauth-Bühler, Mira; Flor, Herta; Garavan, Hugh; Heinz, Andreas; Lawrence, Claire; Loth, Eva; Mann, Karl; Martinot, Jean-Luc; Pausova, Zdenka; Rietschel, Marcella; Ströhle, Andreas; Struve, Maren; Walaszek, Bernadeta; Schumann, Gunter; Paus, Tomáš; Smolka, Michael N

    2013-08-01

    Higher rates of substance use and dependence have been observed in the offspring of mothers who smoked during pregnancy. Animal studies indicate that prenatal exposure to nicotine alters the development of brain areas related to reward processing, which might be a risk factor for substance use and addiction later in life. However, no study has examined the effect of maternal smoking on the offspring's brain response during reward processing. To determine whether adolescents with prenatal exposure to maternal cigarette smoking differ from their nonexposed peers in the response of the ventral striatum to the anticipation or the receipt of a reward. An observational case-control study. Data were obtained from the IMAGEN Study, a European multicenter study of impulsivity, reinforcement sensitivity, and emotional reactivity in adolescents. The IMAGEN sample consists of 2078 healthy adolescents (age range, 13-15 years) recruited from March 1, 2008, through December 31, 2011, in local schools. We assessed an IMAGEN subsample of 177 adolescents with prenatal exposure to maternal cigarette smoking and 177 nonexposed peers (age range, 13-15 years) matched by sex, maternal educational level, and imaging site. Response to reward in the ventral striatum measured with functional magnetic resonance imaging. In prenatally exposed adolescents, we observed a weaker response in the ventral striatum during reward anticipation (left side, F = 14.98 [P < .001]; right side, F = 15.95 [P < .001]) compared with their nonexposed peers. No differences were found regarding the responsivity of the ventral striatum to the receipt of a reward (left side, F = 0.21 [P = .65]; right side, F = 0.47 [P = .49]). The weaker responsivity of the ventral striatum to reward anticipation in prenatally exposed adolescents may represent a risk factor for substance use and development of addiction later in life. This result highlights the need for education and preventive measures to reduce smoking during pregnancy. Future analyses should assess whether prenatally exposed adolescents develop an increased risk for substance use and addiction and which role the reported neuronal differences during reward anticipation plays in this development.

  12. Association of Elevated Reward Prediction Error Response With Weight Gain in Adolescent Anorexia Nervosa.

    PubMed

    DeGuzman, Marisa; Shott, Megan E; Yang, Tony T; Riederer, Justin; Frank, Guido K W

    2017-06-01

    Anorexia nervosa is a psychiatric disorder of unknown etiology. Understanding associations between behavior and neurobiology is important in treatment development. Using a novel monetary reward task during functional magnetic resonance brain imaging, the authors tested how brain reward learning in adolescent anorexia nervosa changes with weight restoration. Female adolescents with anorexia nervosa (N=21; mean age, 16.4 years [SD=1.9]) underwent functional MRI (fMRI) before and after treatment; similarly, healthy female control adolescents (N=21; mean age, 15.2 years [SD=2.4]) underwent fMRI on two occasions. Brain function was tested using the reward prediction error construct, a computational model for reward receipt and omission related to motivation and neural dopamine responsiveness. Compared with the control group, the anorexia nervosa group exhibited greater brain response 1) for prediction error regression within the caudate, ventral caudate/nucleus accumbens, and anterior and posterior insula, 2) to unexpected reward receipt in the anterior and posterior insula, and 3) to unexpected reward omission in the caudate body. Prediction error and unexpected reward omission response tended to normalize with treatment, while unexpected reward receipt response remained significantly elevated. Greater caudate prediction error response when underweight was associated with lower weight gain during treatment. Punishment sensitivity correlated positively with ventral caudate prediction error response. Reward system responsiveness is elevated in adolescent anorexia nervosa when underweight and after weight restoration. Heightened prediction error activity in brain reward regions may represent a phenotype of adolescent anorexia nervosa that does not respond well to treatment. Prediction error response could be a neurobiological marker of illness severity that can indicate individual treatment needs.

  13. Association of Elevated Reward Prediction Error Response With Weight Gain in Adolescent Anorexia Nervosa

    PubMed Central

    DeGuzman, Marisa; Shott, Megan E.; Yang, Tony T.; Riederer, Justin; Frank, Guido K.W.

    2017-01-01

    Objective Anorexia nervosa is a psychiatric disorder of unknown etiology. Understanding associations between behavior and neurobiology is important in treatment development. Using a novel monetary reward task during functional magnetic resonance brain imaging, the authors tested how brain reward learning in adolescent anorexia nervosa changes with weight restoration. Method Female adolescents with anorexia nervosa (N=21; mean age, 15.2 years [SD=2.4]) underwent functional MRI (fMRI) before and after treatment; similarly, healthy female control adolescents (N=21; mean age, 16.4 years [SD=1.9]) underwent fMRI on two occasions. Brain function was tested using the reward prediction error construct, a computational model for reward receipt and omission related to motivation and neural dopamine responsiveness. Results Compared with the control group, the anorexia nervosa group exhibited greater brain response 1) for prediction error regression within the caudate, ventral caudate/nucleus accumbens, and anterior and posterior insula, 2) to unexpected reward receipt in the anterior and posterior insula, and 3) to unexpected reward omission in the caudate body. Prediction error and unexpected reward omission response tended to normalize with treatment, while unexpected reward receipt response remained significantly elevated. Greater caudate prediction error response when underweight was associated with lower weight gain during treatment. Punishment sensitivity correlated positively with ventral caudate prediction error response. Conclusions Reward system responsiveness is elevated in adolescent anorexia nervosa when underweight and after weight restoration. Heightened prediction error activity in brain reward regions may represent a phenotype of adolescent anorexia nervosa that does not respond well to treatment. Prediction error response could be a neurobiological marker of illness severity that can indicate individual treatment needs. PMID:28231717

  14. Affective neuroscience of pleasure: reward in humans and animals

    PubMed Central

    2010-01-01

    Introduction Pleasure and reward are generated by brain circuits that are largely shared between humans and other animals. Discussion Here, we survey some fundamental topics regarding pleasure mechanisms and explicitly compare humans and animals. Conclusion Topics surveyed include liking, wanting, and learning components of reward; brain coding versus brain causing of reward; subjective pleasure versus objective hedonic reactions; roles of orbitofrontal cortex and related cortex regions; subcortical hedonic hotspots for pleasure generation; reappraisals of dopamine and pleasure-electrode controversies; and the relation of pleasure to happiness. PMID:18311558

  15. Gender dimorphism of brain reward system volumes in alcoholism.

    PubMed

    Sawyer, Kayle S; Oscar-Berman, Marlene; Barthelemy, Olivier J; Papadimitriou, George M; Harris, Gordon J; Makris, Nikos

    2017-05-30

    The brain's reward network has been reported to be smaller in alcoholic men compared to nonalcoholic men, but little is known about the volumes of reward regions in alcoholic women. Morphometric analyses were performed on magnetic resonance brain scans of 60 long-term chronic alcoholics (ALC; 30 men) and 60 nonalcoholic controls (NC; 29 men). We derived volumes of total brain, and cortical and subcortical reward-related structures including the dorsolateral prefrontal (DLPFC), orbitofrontal, and cingulate cortices, and the temporal pole, insula, amygdala, hippocampus, nucleus accumbens septi (NAc), and ventral diencephalon (VDC). We examined the relationships of the volumetric findings to drinking history. Analyses revealed a significant gender interaction for the association between alcoholism and total reward network volumes, with ALC men having smaller reward volumes than NC men and ALC women having larger reward volumes than NC women. Analyses of a priori subregions revealed a similar pattern of reward volume differences with significant gender interactions for DLPFC and VDC. Overall, the volume of the cerebral ventricles in ALC participants was negatively associated with duration of abstinence, suggesting decline in atrophy with greater length of sobriety. Copyright © 2017 Elsevier Ireland Ltd. All rights reserved.

  16. What Do I Want and When Do I Want It: Brain Correlates of Decisions Made for Self and Other

    PubMed Central

    Albrecht, Konstanze; Volz, Kirsten G.; Sutter, Matthias; von Cramon, D. Yves

    2013-01-01

    A number of recent functional Magnetic Resonance Imaging (fMRI) studies on intertemporal choice behavior have demonstrated that so-called emotion- and reward-related brain areas are preferentially activated by decisions involving immediately available (but smaller) rewards as compared to (larger) delayed rewards. This pattern of activation was not seen, however, when intertemporal choices were made for another (unknown) individual, which speaks to that activation having been triggered by self-relatedness. In the present fMRI study, we investigated the brain correlates of individuals who passively observed intertemporal choices being made either for themselves or for an unknown person. We found higher activation within the ventral striatum, medial prefrontal and orbitofrontal cortex, pregenual anterior cingulate cortex, and posterior cingulate cortex when an immediate reward was possible for the observer herself, which is in line with findings from studies in which individuals actively chose immediately available rewards. Additionally, activation in the dorsal anterior cingulate cortex, posterior cingulate cortex, and precuneus was higher for choices that included immediate options than for choices that offered only delayed options, irrespective of who was to be the beneficiary. These results indicate that (1) the activations found in active intertemporal decision making are also present when the same decisions are merely observed, thus supporting the assumption that a robust brain network is engaged in immediate gratification; and (2) with immediate rewards, certain brain areas are activated irrespective of whether the observer or another person is the beneficiary of a decision, suggesting that immediacy plays a more general role for neural activation. An explorative analysis of participants’ brain activation corresponding to chosen rewards, further indicates that activation in the aforementioned brain areas depends on the mere presence, availability, or actual reception of immediate rewards. PMID:23991196

  17. The Rewarding and Locomotor-Sensitizing Effects of Repeated Cocaine Administration are Distinct and Separable in Mice

    PubMed Central

    Riday, Thorfinn T.; Kosofsky, Barry E.; Malanga, C.J.

    2011-01-01

    Repeated psychostimulant exposure progressively increases their potency to stimulate motor activity in rodents. This behavioral or locomotor sensitization is considered a model for some aspects of drug addiction in humans, particularly drug craving during abstinence. However, the role of increased motor behavior in drug reward remains incompletely understood. Intracranial self-stimulation (ICSS) was measured concurrently with locomotor activity to determine if acute intermittent cocaine administration had distinguishable effects on motor behavior and perception of brain stimulation-reward (BSR) in the same mice. Sensitization is associated with changes in neuronal activity and glutamatergic neurotransmission in brain reward circuitry. Expression of AMPA receptor subunits (GluR1 and GluR2) and CRE binding protein (CREB) was measured in the ventral tegmental area (VTA), dorsolateral striatum (STR) and nucleus accumbens (NAc) before and after a sensitizing regimen of cocaine, with and without ICSS. Repeated cocaine administration sensitized mice to its locomotor stimulating effects but not its ability to potentiate BSR. ICSS increased GluR1 in the VTA but not NAc or STR, demonstrating selective changes in protein expression with electrical stimulation of discrete brain structures. Repeated cocaine reduced GluR1, GluR2 and CREB expression in the NAc, and reductions of GluR1 and GluR2 but not CREB were further enhanced by ICSS. These data suggest that the effects of repeated cocaine exposure on reward and motor processes are dissociable in mice, and that reduction of excitatory neurotransmission in the NAc may predict altered motor function independently from changes in reward perception. PMID:22197517

  18. Reward System Activation in Response to Alcohol Advertisements Predicts College Drinking.

    PubMed

    Courtney, Andrea L; Rapuano, Kristina M; Sargent, James D; Heatherton, Todd F; Kelley, William M

    2018-01-01

    In this study, we assess whether activation of the brain's reward system in response to alcohol advertisements is associated with college drinking. Previous research has established a relationship between exposure to alcohol marketing and underage drinking. Within other appetitive domains, the relationship between cue exposure and behavioral enactment is known to rely on activation of the brain's reward system. However, the relationship between neural activation to alcohol advertisements and alcohol consumption has not been studied in a nondisordered population. In this cross-sectional study, 53 college students (32 women) completed a functional magnetic resonance imaging scan while viewing alcohol, food, and control (car and technology) advertisements. Afterward, they completed a survey about their alcohol consumption (including frequency of drinking, typical number of drinks consumed, and frequency of binge drinking) over the previous month. In 43 participants (24 women) meeting inclusion criteria, viewing alcohol advertisements elicited activation in the left orbitofrontal cortex and bilateral ventral striatum-regions of the reward system that typically activate to other appetitive rewards and relate to consumption behaviors. Moreover, the level of self-reported drinking correlated with the magnitude of activation in the left orbitofrontal cortex. Results suggest that alcohol cues are processed within the reward system in a way that may motivate drinking behavior.

  19. Mood congruent tuning of reward expectation in positive mood: evidence from FRN and theta modulations

    PubMed Central

    Pourtois, Gilles

    2017-01-01

    Abstract Positive mood broadens attention and builds additional mental resources. However, its effect on performance monitoring and reward prediction errors remain unclear. To examine this issue, we used a standard mood induction procedure (based on guided imagery) and asked 45 participants to complete a gambling task suited to study reward prediction errors by means of the feedback-related negativity (FRN) and mid-frontal theta band power. Results showed a larger FRN for negative feedback as well as a lack of reward expectation modulation for positive feedback at the theta level with positive mood, relative to a neutral mood condition. A control analysis showed that this latter result could not be explained by the mere superposition of the event-related brain potential component on the theta oscillations. Moreover, these neurophysiological effects were evidenced in the absence of impairments at the behavioral level or increase in autonomic arousal with positive mood, suggesting that this mood state reliably altered brain mechanisms of reward prediction errors during performance monitoring. We interpret these new results as reflecting a genuine mood congruency effect, whereby reward is anticipated as the default outcome with positive mood and therefore processed as unsurprising (even when it is unlikely), while negative feedback is perceived as unexpected. PMID:28199707

  20. Neural responses during the anticipation and receipt of olfactory reward and punishment in human.

    PubMed

    Zou, Lai-Quan; Zhou, Han-Yu; Zhuang, Yuan; van Hartevelt, Tim J; Lui, Simon S Y; Cheung, Eric F C; Møller, Arne; Kringelbach, Morten L; Chan, Raymond C K

    2018-03-01

    Pleasure experience is an important part of normal healthy life and is essential for general and mental well-being. Many neuroimaging studies have investigated the underlying neural processing of verbal and visual modalities of reward. However, how the brain processes rewards in the olfactory modality is not fully understood. This study aimed to examine the neural basis of olfactory rewards in 25 healthy participants using functional magnetic resonance imaging (fMRI). We developed an Olfactory Incentive Delay (OLID) imaging task distinguishing between the anticipation and receipt of olfactory rewards and punishments. We found that the pallidum was activated during the anticipation of both olfactory rewards and punishments. The bilateral insula was activated independently from the odours' hedonic valence during the receipt phase. In addition, right caudate activation during the anticipation of unpleasant odours was correlated with self-reported anticipatory hedonic traits, whereas bilateral insular activation during the receipt of pleasant odours was correlated with self-reported consummatory hedonic traits. These findings suggest that activity in the insula and the caudate may be biomarkers of anhedonia. These findings also highlight a useful and valid paradigm to study the neural circuitry underlying reward processing in people with anhedonia. Copyright © 2018 Elsevier Ltd. All rights reserved.

  1. Extracting an evaluative feedback from the brain for adaptation of motor neuroprosthetic decoders.

    PubMed

    Mahmoudi, Babak; Principe, Jose C; Sanchez, Justin C

    2010-01-01

    The design of Brain-Machine Interface (BMI) neural decoders that have robust performance in changing environments encountered in daily life activity is a challenging problem. One solution to this problem is the design of neural decoders that are able to assist and adapt to the user by participating in their perception-action-reward cycle (PARC). Using inspiration both from artificial intelligence and neurobiology reinforcement learning theories, we have designed a novel decoding architecture that enables a symbiotic relationship between the user and an Intelligent Assistant (IA). By tapping into the motor and reward centers in the brain, the IA adapts the process of decoding neural motor commands into prosthetic actions based on the user's goals. The focus of this paper is on extraction of goal information directly from the brain and making it accessible to the IA as an evaluative feedback for adaptation. We have recorded the neural activity of the Nucleus Accumbens in behaving rats during a reaching task. The peri-event time histograms demonstrate a rich representation of the reward prediction in this subcortical structure that can be modeled on a single trial basis as a scalar evaluative feedback with high precision.

  2. Spared internal but impaired external reward prediction error signals in major depressive disorder during reinforcement learning.

    PubMed

    Bakic, Jasmina; Pourtois, Gilles; Jepma, Marieke; Duprat, Romain; De Raedt, Rudi; Baeken, Chris

    2017-01-01

    Major depressive disorder (MDD) creates debilitating effects on a wide range of cognitive functions, including reinforcement learning (RL). In this study, we sought to assess whether reward processing as such, or alternatively the complex interplay between motivation and reward might potentially account for the abnormal reward-based learning in MDD. A total of 35 treatment resistant MDD patients and 44 age matched healthy controls (HCs) performed a standard probabilistic learning task. RL was titrated using behavioral, computational modeling and event-related brain potentials (ERPs) data. MDD patients showed comparable learning rate compared to HCs. However, they showed decreased lose-shift responses as well as blunted subjective evaluations of the reinforcers used during the task, relative to HCs. Moreover, MDD patients showed normal internal (at the level of error-related negativity, ERN) but abnormal external (at the level of feedback-related negativity, FRN) reward prediction error (RPE) signals during RL, selectively when additional efforts had to be made to establish learning. Collectively, these results lend support to the assumption that MDD does not impair reward processing per se during RL. Instead, it seems to alter the processing of the emotional value of (external) reinforcers during RL, when additional intrinsic motivational processes have to be engaged. © 2016 Wiley Periodicals, Inc.

  3. Lighting up the brain's reward circuitry.

    PubMed

    Lobo, Mary Kay

    2012-07-01

    The brain's reward circuit is critical for mediating natural reward behaviors including food, sex, and social interaction. Drugs of abuse take over this circuit and produce persistent molecular and cellular alterations in the brain regions and their neural circuitry that make up the reward pathway. Recent use of optogenetic technologies has provided novel insights into the functional and molecular role of the circuitry and cell subtypes within these circuits that constitute this pathway. This perspective will address the current and future use of light-activated proteins, including those involved in modulating neuronal activity, cellular signaling, and molecular properties in the neural circuitry mediating rewarding stimuli and maladaptive responses to drugs of abuse. © 2012 New York Academy of Sciences.

  4. Exposure to bright light biases effort-based decisions.

    PubMed

    Bijleveld, Erik; Knufinke, Melanie

    2018-06-01

    Secreted in the evening and the night, melatonin suppresses activity of the mesolimbic dopamine pathway, a brain pathway involved in reward processing. However, exposure to bright light diminishes-or even prevents-melatonin secretion. Thus, we hypothesized that reward processing, in the evening, is more pronounced in bright light (vs. dim light). Healthy human participants carried out three tasks that tapped into various aspects of reward processing (effort expenditure for rewards task [EEfRT]; two-armed bandit task [2ABT]; balloon analogue risk task [BART). Brightness was manipulated within-subjects (bright vs. dim light), in separate evening sessions. During the EEfRT, participants used reward-value information more strongly when they were exposed to bright light (vs. dim light). This finding supported our hypothesis. However, exposure to bright light did not significantly affect task behavior on the 2ABT and the BART. While future research is necessary (e.g., to zoom in on working mechanisms), these findings have potential implications for the design of physical work environments. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

  5. Enhanced functional connectivity and volume between cognitive and reward centers of naïve rodent brain produced by pro-dopaminergic agent KB220Z

    PubMed Central

    Badgaiyan, Rajendra D.; Thanos, Panayotis K.; Kulkarni, Praveen; Giordano, John; Baron, David; Gold, Mark S.

    2017-01-01

    Dopaminergic reward dysfunction in addictive behaviors is well supported in the literature. There is evidence that alterations in synchronous neural activity between brain regions subserving reward and various cognitive functions may significantly contribute to substance-related disorders. This study presents the first evidence showing that a pro-dopaminergic nutraceutical (KB220Z) significantly enhances, above placebo, functional connectivity between reward and cognitive brain areas in the rat. These include the nucleus accumbens, anterior cingulate gyrus, anterior thalamic nuclei, hippocampus, prelimbic and infralimbic loci. Significant functional connectivity, increased brain connectivity volume recruitment (potentially neuroplasticity), and dopaminergic functionality were found across the brain reward circuitry. Increases in functional connectivity were specific to these regions and were not broadly distributed across the brain. While these initial findings have been observed in drug naïve rodents, this robust, yet selective response implies clinical relevance for addicted individuals at risk for relapse, who show reductions in functional connectivity after protracted withdrawal. Future studies will evaluate KB220Z in animal models of addiction. PMID:28445527

  6. Influence of subthalamic deep-brain stimulation on cognitive action control in incentive context.

    PubMed

    Houvenaghel, Jean-François; Duprez, Joan; Argaud, Soizic; Naudet, Florian; Dondaine, Thibaut; Robert, Gabriel Hadrien; Drapier, Sophie; Haegelen, Claire; Jannin, Pierre; Drapier, Dominique; Vérin, Marc; Sauleau, Paul

    2016-10-01

    Subthalamic nucleus deep-brain stimulation (STN-DBS) is an effective treatment in Parkinson's disease (PD), but can have cognitive side effects, such as increasing the difficulty of producing appropriate responses when a habitual but inappropriate responses represent strong alternatives. STN-DBS also appears to modulate representations of incentives such as monetary rewards. Furthermore, conflict resolution can be modulated by incentive context. We therefore used a rewarded Simon Task to assess the influence of promised rewards on cognitive action control in 50 patients with PD, half of whom were being treated with STN-DBS. Results were analyzed according to the activation-suppression model. We showed that STN-DBS (i) favored the expression of motor impulsivity, as measured with the Barratt Impulsiveness Scale, (ii) facilitated the expression of incentive actions as observed with a greater increase in speed according to promised reward in patients with versus without DBS and (iii) may increase impulsive action selection in an incentive context. In addition, analysis of subgroups of implanted patients suggested that those who exhibited the most impulsive action selection had the least severe disease. This may indicate that patients with less marked disease are more at risk of developing impulsivity postoperatively. Finally, in these patients, incentive context increased the difficulty of resolving conflict situations. As a whole, the current study revealed that in patients with PD, STN-DBS affects the cognitive processes involved in conflict resolution, reward processing and the influence of promised rewards on conflict resolution. Copyright © 2016 Elsevier Ltd. All rights reserved.

  7. Preliminary evidence for genetic overlap between body mass index and striatal reward response.

    PubMed

    Lancaster, T M; Ihssen, I; Brindley, L M; Linden, D E

    2018-01-10

    The reward-processing network is implicated in the aetiology of obesity. Several lines of evidence suggest obesity-linked genetic risk loci (such as DRD2 and FTO) may influence individual variation in body mass index (BMI) through neuropsychological processes reflected in alterations in activation of the striatum during reward processing. However, no study has tested the broader hypotheses that (a) the relationship between BMI and reward-related brain activation (measured through the blood oxygenation-dependent (BOLD) signal) may be observed in a large population study and (b) the overall genetic architecture of these phenotypes overlap, an assumption critical for the progression of imaging genetic studies in obesity research. Using data from the Human Connectome Project (N = 1055 healthy, young individuals: average BMI = 26.4), we first establish a phenotypic relationship between BMI and ventral striatal (VS) BOLD during the processing of rewarding (monetary) stimuli (β = 0.44, P = 0.013), accounting for potential confounds. BMI and VS BOLD were both significantly influenced by additive genetic factors (H2r = 0.57; 0.12, respectively). Further decomposition of this variance suggested that the relationship was driven by shared genetic (ρ g  = 0.47, P = 0.011), but not environmental (ρ E  = -0.07, P = 0.29) factors. To validate the assumption of genetic pleiotropy between BMI and VS BOLD, we further show that polygenic risk for higher BMI is also associated with increased VS BOLD response to appetitive stimuli (calorically high food images), in an independent sample (N = 81; P FWE-ROI  < 0.005). Together, these observations suggest that the genetic factors link risk to obesity to alterations within key nodes of the brain's reward circuity. These observations provide a basis for future work exploring the mechanistic role of genetic loci that confer risk for obesity using the imaging genetics approach.

  8. Brain mechanisms of social comparison and their influence on the reward system.

    PubMed

    Kedia, Gayannée; Mussweiler, Thomas; Linden, David E J

    2014-11-12

    Whenever we interact with others, we judge them and whenever we make such judgments, we compare them with ourselves, other people, or internalized standards. Countless social psychological experiments have shown that comparative thinking plays a ubiquitous role in person perception and social cognition as a whole. The topic of social comparison has recently aroused the interest of social neuroscientists, who have begun to investigate its neural underpinnings. The present article provides an overview of these neuroimaging and electrophysiological studies. We discuss recent findings on the consequences of social comparison on the brain processing of outcomes and highlight the role of the brain's reward system. Moreover, we analyze the relationship between the brain networks involved in social comparisons and those active during other forms of cognitive and perceptual comparison. Finally, we discuss potential future questions that research on the neural correlates of social comparison could address.

  9. The CB1 Receptor as an Important Mediator of Hedonic Reward Processing

    PubMed Central

    Friemel, Chris M; Zimmer, Andreas; Schneider, Miriam

    2014-01-01

    The endocannabinoid (ECB) system has emerged recently as a key mediator for reward processing. It is well known that cannabinoids affect appetitive learning processes and can induce reinforcing and rewarding effects. However, the involvement of the ECB system in hedonic aspects of reward-related behavior is not completely understood. With the present study, we investigated the modulatory role of the ECB system on hedonic perception, measured by the pleasure attenuated startle (PAS) paradigm for a palatable food reward. Here, a conditioned odor is thought to induce a pleasant affective state that attenuates an aversive reflex—the acoustic startle response. Modulatory effects of the CB1 receptor antagonist/inverse agonist SR1411716 and the cannabinoid agonist WIN 55 212-2 on PAS were examined in rats. PAS was also measured in CB1 receptor knockout (KO) and wild-type (WT) mice. Pharmacological inhibition as well as the absence of CB1 receptors was found to reduce PAS, whereas WIN 55 212-2 administration increased PAS. Finally, presentation of a conditioned reward cue was found to induce striatal FosB/ΔFosB expression in WT mice, but not in KO mice, indicating a reduced stimulation of reward-related brain regions in conditioned KO mice by odor presentation. We here show that in addition to our previous studies in rats, PAS may also serve as a valuable and suitable measure to assess hedonic processing in mice. Our data further indicate that the ECB system, and in particular CB1 receptor signaling, appears to be highly important for the mediation of hedonic aspects of reward processing. PMID:24718372

  10. Corticotropin-releasing factor-1 receptor activation mediates nicotine withdrawal-induced deficit in brain reward function and stress-induced relapse.

    PubMed

    Bruijnzeel, Adrie W; Prado, Melissa; Isaac, Shani

    2009-07-15

    Tobacco addiction is a chronic brain disorder that is characterized by a negative affective state upon smoking cessation and relapse after periods of abstinence. Previous research has shown that blockade of corticotropin-releasing factor (CRF) receptors with a nonspecific CRF1/CRF2 receptor antagonist prevents the deficit in brain reward function associated with nicotine withdrawal and stress-induced reinstatement of extinguished nicotine-seeking in rats. The aim of these studies was to investigate the role of CRF1 and CRF2 receptors in the deficit in brain reward function associated with precipitated nicotine withdrawal and stress-induced reinstatement of nicotine-seeking. The intracranial self-stimulation (ICSS) procedure was used to assess the negative affective state of nicotine withdrawal. Elevations in brain reward thresholds are indicative of a deficit in brain reward function. Stress-induced reinstatement of nicotine-seeking was investigated in animals in which responding for intravenously infused nicotine was extinguished by substituting saline for nicotine. In the ICSS experiments, the nicotinic receptor antagonist mecamylamine elevated the brain reward thresholds of the nicotine-dependent rats but not those of the control rats. The CRF1 receptor antagonist R278995/CRA0450 but not the CRF2 receptor antagonist astressin-2B prevented the elevations in brain reward thresholds associated with precipitated nicotine withdrawal. Furthermore, R278995/CRA0450 but not astressin-2B prevented stress-induced reinstatement of extinguished nicotine-seeking. Neither R278995/CRA0450 nor astressin-2B affected operant responding for chocolate-flavored food pellets. These studies indicate that CRF(1) receptors but not CRF(2) receptors play an important role in the anhedonic-state associated with acute nicotine withdrawal and stress-induced reinstatement of nicotine-seeking.

  11. CRF1 receptor activation mediates nicotine withdrawal-induced deficit in brain reward function and stress-induced relapse

    PubMed Central

    Bruijnzeel, Adrie W.; Prado, Melissa; Isaac, Shani

    2010-01-01

    Background Tobacco addiction is a chronic brain disorder that is characterized by a negative affective state upon smoking cessation and relapse after periods of abstinence. Previous research has shown that blockade of CRF receptors with a non-specific CRF1/CRF2 receptor antagonist prevents the deficit in brain reward function associated with nicotine withdrawal and stress-induced reinstatement of extinguished nicotine seeking in rats. The aim of these studies was to investigate the role of CRF1 and CRF2 receptors in the deficit in brain reward function associated with precipitated nicotine withdrawal and stress-induced reinstatement of nicotine seeking. Methods The intracranial self-stimulation (ICSS) procedure was used to assess the negative affective state of nicotine withdrawal. Elevations in brain reward thresholds are indicative of a deficit in brain reward function. Stress-induced reinstatement of nicotine seeking was investigated in animals in which responding for intravenously infused nicotine was extinguished by substituting saline for nicotine. Results In the ICSS experiments, the nicotinic receptor antagonist mecamylamine elevated the brain reward thresholds of the nicotine dependent rats but not those of the control rats. The CRF1 receptor antagonist R278995/CRA0450, but not the CRF2 receptor antagonist astressin-2B, prevented the elevations in brain reward thresholds associated with precipitated nicotine withdrawal. Furthermore, R278995/CRA0450, but not astressin-2B, prevented stress-induced reinstatement of extinguished nicotine seeking. Neither R278995/CRA0450 nor astressin-2B affected operant responding for chocolate-flavored food pellets. Conclusions These studies indicate that CRF1 receptors, but not CRF2 receptors, play an important role in the anhedonic-state associated with acute nicotine withdrawal and stress-induced reinstatement of nicotine seeking. PMID:19217073

  12. Neural Reward Processing Mediates the Relationship between Insomnia Symptoms and Depression in Adolescence

    PubMed Central

    Casement, Melynda D.; Keenan, Kate E.; Hipwell, Alison E.; Guyer, Amanda E.; Forbes, Erika E.

    2016-01-01

    Study Objectives: Emerging evidence suggests that insomnia may disrupt reward-related brain function—a potentially important factor in the development of depressive disorder. Adolescence may be a period during which such disruption is especially problematic given the rise in the incidence of insomnia and ongoing development of neural systems that support reward processing. The present study uses longitudinal data to test the hypothesis that disruption of neural reward processing is a mechanism by which insomnia symptoms—including nocturnal insomnia symptoms (NIS) and nonrestorative sleep (NRS)—contribute to depressive symptoms in adolescent girls. Method: Participants were 123 adolescent girls and their caregivers from an ongoing longitudinal study of precursors to depression across adolescent development. NIS and NRS were assessed annually from ages 9 to 13 years. Girls completed a monetary reward task during a functional MRI scan at age 16 years. Depressive symptoms were assessed at ages 16 and 17 years. Multivariable regression tested the prospective associations between NIS and NRS, neural response during reward anticipation, and the mean number of depressive symptoms (omitting sleep problems). Results: NRS, but not NIS, during early adolescence was positively associated with late adolescent dorsal medial prefrontal cortex (dmPFC) response to reward anticipation and depressive symptoms. DMPFC response mediated the relationship between early adolescent NRS and late adolescent depressive symptoms. Conclusions: These results suggest that NRS may contribute to depression by disrupting reward processing via altered activity in a region of prefrontal cortex involved in affective control. The results also support the mechanistic differentiation of NIS and NRS. Citation: Casement MD, Keenan KE, Hipwell AE, Guyer AE, Forbes EE. Neural reward processing mediates the relationship between insomnia symptoms and depression in adolescence. SLEEP 2016;39(2):439–447. PMID:26350468

  13. Cognitive control and reward/loss processing in Internet gaming disorder: Results from a comparison with recreational Internet game-users.

    PubMed

    Dong, G; Li, H; Wang, L; Potenza, M N

    2017-07-01

    Although playing of Internet games may lead to Internet gaming disorder (IGD), most game-users do not develop problems and only a relatively small subset experiences IGD. Game playing may have positive health associations, whereas IGD has been repeatedly associated with negative health measures, and it is thus important to understand differences between individuals with IGD, recreational (non-problematic) game use (RGU) and non-/low-frequency game use (NLFGU). Individuals with IGD have shown differences in neural activations from non-gamers, yet few studies have examined neural differences between individuals with IGD, RGU and NLFGU. Eighteen individuals with IGD, 21 with RGU and 19 with NFLGU performed a color-word Stroop task and a guessing task assessing reward/loss processing. Behavioral and functional imaging data were collected and compared between groups. RGU and NLFGU subjects showed lower Stroop effects as compared with those with IGD. RGU subjects as compared to those with IGD demonstrated less frontal cortical activation brain activation during Stroop performance. During the guessing task, RGU subjects showed greater cortico-striatal activations than IGD subjects during processing of winning outcomes and greater frontal brain during processing of losing outcomes. Findings suggest that RGU as compared with IGD subjects show greater executive control and greater activations of brain regions implicated in motivational processes during reward processing and greater cortical activations during loss processing. These findings suggest neural and behavioral features distinguishing RGU from IGD and mechanisms by which RGU may be motivated to play online games frequently yet avoid developing IGD. Copyright © 2017 Elsevier Masson SAS. All rights reserved.

  14. Brain connectivity reflects human aesthetic responses to music.

    PubMed

    Sachs, Matthew E; Ellis, Robert J; Schlaug, Gottfried; Loui, Psyche

    2016-06-01

    Humans uniquely appreciate aesthetics, experiencing pleasurable responses to complex stimuli that confer no clear intrinsic value for survival. However, substantial variability exists in the frequency and specificity of aesthetic responses. While pleasure from aesthetics is attributed to the neural circuitry for reward, what accounts for individual differences in aesthetic reward sensitivity remains unclear. Using a combination of survey data, behavioral and psychophysiological measures and diffusion tensor imaging, we found that white matter connectivity between sensory processing areas in the superior temporal gyrus and emotional and social processing areas in the insula and medial prefrontal cortex explains individual differences in reward sensitivity to music. Our findings provide the first evidence for a neural basis of individual differences in sensory access to the reward system, and suggest that social-emotional communication through the auditory channel may offer an evolutionary basis for music making as an aesthetically rewarding function in humans. © The Author (2016). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  15. Reward sensitivity, decisional bias, and metacognitive deficits in cocaine drug addiction.

    PubMed

    Balconi, Michela; Finocchiaro, Roberta; Campanella, Salvatore

    2014-01-01

    The present research explored the effect of reward sensitivity bias and metacognitive deficits on substance use disorder (SUD) in the decision-making process. The behavioral activation system (BAS) was used as a predictive marker of dysfunctional behavior during the Iowa gambling task (IGT). We also tried to relate this motivational system bias to self-reported metacognitive measures (self-knowledge, strategic planning, flexibility, and efficacy) in the decision processes. Thirty-four SUD participants (cocaine dependent) and 39 participants in the control group underwent the IGT. The SUD group was associated with a poorer performance on the IGT and a dysfunctional metacognition ability (unrealistic representation). An increase in the reward sensitivity (higher BAS, BAS reward responsiveness, and BAS reward) was observed in the SUD group compared with the control group and explained (through a regression analysis) the main behavioral deficits. More generally, an increase in the BAS reward responsiveness may be considered a predictive measure of risk-taking and dysfunctional behavior, not only in pathological (SUD) individuals, but also in subclinical individuals (controls). We discuss the likely cognitive, brain, and neurotransmitter contributions to this phenomenon.

  16. Reward processing deficits and impulsivity in high-risk offspring of alcoholics: A study of event-related potentials during a monetary gambling task.

    PubMed

    Kamarajan, Chella; Pandey, Ashwini K; Chorlian, David B; Manz, Niklas; Stimus, Arthur T; Bauer, Lance O; Hesselbrock, Victor M; Schuckit, Marc A; Kuperman, Samuel; Kramer, John; Porjesz, Bernice

    2015-11-01

    Individuals at high risk to develop alcoholism often manifest neurocognitive deficits as well as increased impulsivity. The goal of the present study is to elucidate reward processing deficits, externalizing disorders, and impulsivity as elicited by electrophysiological, clinical and behavioral measures in subjects at high risk for alcoholism from families densely affected by alcoholism in the context of brain maturation across age groups and gender. Event-related potentials (ERPs) and current source density (CSD) during a monetary gambling task (MGT) were measured in 12-25 year old offspring (N=1864) of families in the Collaborative Study on the Genetics of Alcoholism (COGA) Prospective study; the high risk (HR, N=1569) subjects were from families densely affected with alcoholism and the low risk (LR, N=295) subjects were from community families. Externalizing disorders and impulsivity scores were also compared between LR and HR groups. HR offspring from older (16-25 years) male and younger (12-15 years) female subgroups showed lower P3 amplitude than LR subjects. The amplitude decrement was most prominent in HR males during the loss condition. Overall, P3 amplitude increase at anterior sites and decrease at posterior areas were seen in older compared to younger subjects, suggesting frontalization during brain maturation. The HR subgroups also exhibited hypofrontality manifested as weaker CSD activity during both loss and gain conditions at frontal regions. Further, the HR subjects had higher impulsivity scores and increased prevalence of externalizing disorders. P3 amplitudes during the gain condition were negatively correlated with impulsivity scores. Older male and younger female HR offspring, compared to their LR counterparts, manifested reward processing deficits as indexed by lower P3 amplitude and weaker CSD activity, along with higher prevalence of externalizing disorders and higher impulsivity scores. Reward related P3 is a valuable measure reflecting neurocognitive dysfunction in subjects at risk for alcoholism, as well as to characterize reward processing and brain maturation across gender and age group. Copyright © 2015 Elsevier B.V. All rights reserved.

  17. The contribution of brain reward circuits to the obesity epidemic

    PubMed Central

    Stice, Eric; Figlewicz, Dianne P.; Gosnell, Blake A.; Levine, Allen S.; Pratt, Wayne E.

    2012-01-01

    One of the defining characteristics of the research of Ann E. Kelley was her recognition that the neuroscience underlying basic learning and motivation processes also shed significant light upon mechanisms underlying drug addiction and maladaptive eating patterns. In this review, we examine the parallels that exist in the neural pathways that process both food and drug reward, as determined by recent studies in animal models and human neuroimaging experiments. We discuss contemporary research that suggests that hyperphagia leading to obesity is associated with substantial neurochemical changes in the brain. These findings verify the relevance of reward pathways for promoting consumption of palatable, calorically dense foods, and lead to the important question of whether changes in reward circuitry in response to intake of such foods serve a causal role in the development and maintenance of some cases of obesity. Finally, we discuss the potential value for future studies at the intersection of the obesity epidemic and the neuroscience of motivation, as well as the potential concerns that arise from viewing excessive food intake as an “addiction”. We suggest that it might be more useful to focus on overeating that results in frank obesity, and multiple health, interpersonal, and occupational negative consequences as a form of food “abuse”. PMID:23237885

  18. Impact of a Common Genetic Variation Associated With Putamen Volume on Neural Mechanisms of Attention-Deficit/Hyperactivity Disorder.

    PubMed

    Xu, Bing; Jia, Tianye; Macare, Christine; Banaschewski, Tobias; Bokde, Arun L W; Bromberg, Uli; Büchel, Christian; Cattrell, Anna; Conrod, Patricia J; Flor, Herta; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny; Heinz, Andreas; Ittermann, Bernd; Martinot, Jean-Luc; Paillère Martinot, Marie-Laure; Nees, Frauke; Orfanos, Dimitri Papadopoulos; Paus, Tomáš; Poustka, Luise; Smolka, Michael N; Walter, Henrik; Whelan, Robert; Schumann, Gunter; Desrivières, Sylvane

    2017-05-01

    In a recent genomewide association study of subcortical brain volumes, a common genetic variation at rs945270 was identified as having the strongest effect on putamen volume, a brain measurement linked to familial risk for attention-deficit/hyperactivity disorder (ADHD). To determine whether rs945270 might be a genetic determinant of ADHD, its effects on ADHD-related symptoms and neural mechanisms of ADHD, such as response inhibition and reward sensitivity, were explored. A large population sample of 1,834 14-year-old adolescents was used to test the effects of rs945270 on ADHD symptoms assessed through the Strengths and Difficulties Questionnaire and region-of-interest analyses of putamen activation by functional magnetic resonance imaging using the stop signal and monetary incentive delay tasks, assessing response inhibition and reward sensitivity, respectively. There was a significant link between rs945270 and ADHD symptom scores, with the C allele associated with lower symptom scores, most notably hyperactivity. In addition, there were sex-specific effects of this variant on the brain. In boys, the C allele was associated with lower putamen activity during successful response inhibition, a brain response that was not associated with ADHD symptoms. In girls, putamen activation during reward anticipation increased with the number of C alleles, most significantly in the right putamen. Remarkably, right putamen activation during reward anticipation tended to negatively correlate with ADHD symptoms. These results indicate that rs945270 might contribute to the genetic risk of ADHD partly through its effects on hyperactivity and reward processing in girls. Copyright © 2017 American Academy of Child and Adolescent Psychiatry. All rights reserved.

  19. Waiting to win: elevated striatal and orbitofrontal cortical activity during reward anticipation in euthymic bipolar disorder adults

    PubMed Central

    Nusslock, Robin; Almeida, Jorge RC; Forbes, Erika E; Versace, Amelia; Frank, Ellen; LaBarbara, Edmund J; Klein, Crystal R; Phillips, Mary L

    2012-01-01

    Objective Bipolar disorder may be characterized by a hypersensitivity to reward-relevant stimuli, potentially underlying the emotional lability and dysregulation that characterizes the illness. In parallel, research highlights the predominant role of striatal and orbitofrontal cortical (OFC) regions in reward-processing and approach-related affect. We aimed to examine whether bipolar disorder, relative to healthy, participants displayed elevated activity in these regions during reward processing. Methods Twenty-one euthymic bipolar I disorder and 20 healthy control participants with no lifetime history of psychiatric disorder underwent functional magnetic resonance imaging (fMRI) scanning during a card-guessing paradigm designed to examine reward-related brain function to anticipation and receipt of monetary reward and loss. Data were collected using a 3T Siemens Trio scanner. Results Region-of-interest analyses revealed that bipolar disorder participants displayed greater ventral striatal and right-sided orbitofrontal [Brodmann area (BA) 11] activity during anticipation, but not outcome, of monetary reward, relative to healthy controls (p < 0.05, corrected). Wholebrain analyses indicated that bipolar disorder, relative to healthy, participants also displayed elevated left-lateral OFC activity (BA 47) activity during reward anticipation (p < 0.05, corrected). Conclusions Elevated ventral striatal and OFC activity during reward anticipation may represent a neural mechanism for predisposition to expansive mood and hypo/mania in response to reward-relevant cues that characterizes bipolar disorder. Our findings contrast with research reporting blunted activity in the ventral striatum during reward processing in unipolar depressed individuals, relative to healthy controls. Examination of reward-related neural activity in bipolar disorder is a promising research focus to facilitate identification of biological markers of the illness. PMID:22548898

  20. Impact of Early Life Adversity on Reward Processing in Young Adults: EEG-fMRI Results from a Prospective Study over 25 Years

    PubMed Central

    Boecker, Regina; Holz, Nathalie E.; Buchmann, Arlette F.; Blomeyer, Dorothea; Plichta, Michael M.; Wolf, Isabella; Baumeister, Sarah; Meyer-Lindenberg, Andreas; Banaschewski, Tobias

    2014-01-01

    Several lines of evidence have implicated the mesolimbic dopamine reward pathway in altered brain function resulting from exposure to early adversity. The present study examined the impact of early life adversity on different stages of neuronal reward processing later in life and their association with a related behavioral phenotype, i.e. attention deficit/hyperactivity disorder (ADHD). 162 healthy young adults (mean age = 24.4 years; 58% female) from an epidemiological cohort study followed since birth participated in a simultaneous EEG-fMRI study using a monetary incentive delay task. Early life adversity according to an early family adversity index (EFA) and lifetime ADHD symptoms were assessed using standardized parent interviews conducted at the offspring's age of 3 months and between 2 and 15 years, respectively. fMRI region-of-interest analysis revealed a significant effect of EFA during reward anticipation in reward-related areas (i.e. ventral striatum, putamen, thalamus), indicating decreased activation when EFA increased. EEG analysis demonstrated a similar effect for the contingent negative variation (CNV), with the CNV decreasing with the level of EFA. In contrast, during reward delivery, activation of the bilateral insula, right pallidum and bilateral putamen increased with EFA. There was a significant association of lifetime ADHD symptoms with lower activation in the left ventral striatum during reward anticipation and higher activation in the right insula during reward delivery. The present findings indicate a differential long-term impact of early life adversity on reward processing, implicating hyporesponsiveness during reward anticipation and hyperresponsiveness when receiving a reward. Moreover, a similar activation pattern related to lifetime ADHD suggests that the impact of early life stress on ADHD may possibly be mediated by a dysfunctional reward pathway. PMID:25118701

  1. Reward processing in the value-driven attention network: reward signals tracking cue identity and location.

    PubMed

    Anderson, Brian A

    2017-03-01

    Through associative reward learning, arbitrary cues acquire the ability to automatically capture visual attention. Previous studies have examined the neural correlates of value-driven attentional orienting, revealing elevated activity within a network of brain regions encompassing the visual corticostriatal loop [caudate tail, lateral occipital complex (LOC) and early visual cortex] and intraparietal sulcus (IPS). Such attentional priority signals raise a broader question concerning how visual signals are combined with reward signals during learning to create a representation that is sensitive to the confluence of the two. This study examines reward signals during the cued reward training phase commonly used to generate value-driven attentional biases. High, compared with low, reward feedback preferentially activated the value-driven attention network, in addition to regions typically implicated in reward processing. Further examination of these reward signals within the visual system revealed information about the identity of the preceding cue in the caudate tail and LOC, and information about the location of the preceding cue in IPS, while early visual cortex represented both location and identity. The results reveal teaching signals within the value-driven attention network during associative reward learning, and further suggest functional specialization within different regions of this network during the acquisition of an integrated representation of stimulus value. © The Author (2016). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  2. Reward-related neural responses are dependent on the beneficiary

    PubMed Central

    Güroğlu, Berna; de Water, Erik; Meuwese, Rosa; Koolschijn, P. Cédric; Peper, Jiska S.; Crone, Eveline A.

    2014-01-01

    Prior studies have suggested that positive social interactions are experienced as rewarding. Yet, it is not well understood how social relationships influence neural responses to other persons’ gains. In this study, we investigated neural responses during a gambling task in which healthy participants (N = 31; 18 females) could win or lose money for themselves, their best friend or a disliked other (antagonist). At the moment of receiving outcome, person-related activity was observed in the dorsal medial prefrontal cortex (dmPFC), precuneus and temporal parietal junction (TPJ), showing higher activity for friends and antagonists than for self, and this activity was independent of outcome. The only region showing an interaction between the person-participants played for and outcome was the ventral striatum. Specifically, the striatum was more active following gains than losses for self and friends, whereas for the antagonist this pattern was reversed. Together, these results show that, in a context with social and reward information, social aspects are processed in brain regions associated with social cognition (mPFC, TPJ), and reward aspects are processed in primary reward areas (striatum). Furthermore, there is an interaction of social and reward information in the striatum, such that reward-related activity was dependent on social relationship. PMID:23720575

  3. Reward priming eliminates color-driven affect in perception.

    PubMed

    Hu, Kesong

    2018-01-03

    Brain and behavior evidence suggests that colors have distinct affective properties. Here, we investigated how reward influences color-driven affect in perception. In Experiment 1, we assessed competition between blue and red patches during a temporal-order judgment (TOJ) across a range of stimulus onset asynchronies (SOAs). During the value reinforcement, reward was linked to either blue (version 1) or red (version 2) in the experiment. The same stimuli then served as test ones in the following unrewarded, unspeeded TOJ task. Our analysis showed that blue patches were consistently seen as occurring first, even when objectively appearing 2nd at short SOAs. This accelerated perception of blue over red was disrupted by prior primes related to reward (vs. neutral) but not perceptional (blue vs. red) priming. Experiment 2 replicated the findings of Experiment 1 while uncoupling action and stimulus values. These results are consistent with the blue-approach and red-avoidance motivation hypothesis and highlight an active nature of the association of reward priming and color processing. Together, the present study implies a link between reward and color affect and contributes to the understanding of how reward influences color affect in visual processing.

  4. Topography, power, and current source density of θ oscillations during reward processing as markers for alcohol dependence.

    PubMed

    Kamarajan, Chella; Rangaswamy, Madhavi; Manz, Niklas; Chorlian, David B; Pandey, Ashwini K; Roopesh, Bangalore N; Porjesz, Bernice

    2012-05-01

    Recent studies have linked alcoholism with a dysfunctional neural reward system. Although several electrophysiological studies have explored reward processing in healthy individuals, such studies in alcohol-dependent individuals are quite rare. The present study examines theta oscillations during reward processing in abstinent alcoholics. The electroencephalogram (EEG) was recorded in 38 abstinent alcoholics and 38 healthy controls as they performed a single outcome gambling task, which involved outcomes of either loss or gain of an amount (10 or 50¢) that was bet. Event-related theta band (3.0-7.0 Hz) power following each outcome stimulus was computed using the S-transform method. Theta power at the time window of the outcome-related negativity (ORN) and positivity (ORP) (200-500 ms) was compared across groups and outcome conditions. Additionally, behavioral data of impulsivity and task performance were analyzed. The alcoholic group showed significantly decreased theta power during reward processing compared to controls. Current source density (CSD) maps of alcoholics revealed weaker and diffuse source activity for all conditions and weaker bilateral prefrontal sources during the Loss 50 condition when compared with controls who manifested stronger and focused midline sources. Furthermore, alcoholics exhibited increased impulsivity and risk-taking on the behavioral measures. A strong association between reduced anterior theta power and impulsive task-performance was observed. It is suggested that decreased power and weaker and diffuse CSD in alcoholics may be due to dysfunctional neural reward circuitry. The relationship among alcoholism, theta oscillations, reward processing, and impulsivity could offer clues to understand brain circuitries that mediate reward processing and inhibitory control. Copyright © 2011 Wiley-Liss, Inc.

  5. Topography, Power and Current Source Density of Theta Oscillations during Reward Processing as Markers for Alcohol Dependence

    PubMed Central

    Kamarajan, Chella; Rangaswamy, Madhavi; Manz, Niklas; Chorlian, David B.; Pandey, Ashwini K.; Roopesh, Bangalore N.; Porjesz, Bernice

    2013-01-01

    Recent studies have linked alcoholism with a dysfunctional neural reward system. Although several electrophysiological studies have explored reward processing in healthy individuals, such studies in alcohol dependent individuals are quite rare. The present study examines theta oscillations during reward processing in abstinent alcoholics. The electroencephalogram (EEG) was recorded in 38 abstinent alcoholics and 38 healthy controls as they performed a single outcome gambling task which involved outcomes of either loss or gain of an amount (10¢ or 50¢) that was bet. Event-related theta band (3.0–7.0 Hz) power following each outcome stimulus was computed using the S-transform method. Theta power at the time window of the outcome-related negativity (ORN) and positivity (ORP) (200–500 ms) was compared across groups and outcome conditions. Additionally, behavioral data of impulsivity and task performance were analyzed. The alcoholic group showed significantly decreased theta power during reward processing compared to controls. Current Source Density (CSD) maps of alcoholics revealed weaker and diffuse source activity for all conditions and weaker bilateral prefrontal sources during the Loss 50 condition as compared to controls who manifested stronger and focused midline sources. Further, alcoholics exhibited increased impulsivity and risk-taking on the behavioral measures. A strong association between reduced anterior theta power and impulsive task-performance was observed. It is suggested that decreased power and weaker and diffuse CSD in alcoholics may be due to dysfunctional neural reward circuitry. The relationship among alcoholism, theta oscillations, reward processing and impulsivity could offer clues to understand brain circuitries that mediate reward processing and inhibitory control. PMID:21520344

  6. Chronic wheel running affects cocaine-induced c-Fos expression in brain reward areas in rats.

    PubMed

    Zlebnik, Natalie E; Hedges, Valerie L; Carroll, Marilyn E; Meisel, Robert L

    2014-03-15

    Emerging evidence from human and animal studies suggests that exercise is a highly effective treatment for drug addiction. However, most work has been done in behavioral models, and the effects of exercise on the neurobiological substrates of addiction have not been identified. Specifically, it is unknown whether prior exercise exposure alters neuronal activation of brain reward circuitry in response to drugs of abuse. To investigate this hypothesis, rats were given 21 days of daily access to voluntary wheel running in a locked or unlocked running wheel. Subsequently, they were challenged with a saline or cocaine (15 mg/kg, i.p.) injection and sacrificed for c-Fos immunohistochemistry. The c-Fos transcription factor is a measure of cellular activity and was used to quantify cocaine-induced activation of reward-processing areas of the brain: nucleus accumbens (NAc), caudate putamen (CPu), medial prefrontal cortex (mPFC), and orbitofrontal cortex (OFC). The mean fold change in cocaine-induced c-Fos cell counts relative to saline-induced c-Fos cell counts was significantly higher in exercising compared to control rats in the NAc core, dorsomedial and dorsolateral CPu, the prelimbic area, and the OFC, indicating differential cocaine-specific cellular activation of brain reward circuitry between exercising and control animals. These results suggest neurobiological mechanisms by which voluntary wheel running attenuates cocaine-motivated behaviors and provide support for exercise as a novel treatment for drug addiction. Copyright © 2013 Elsevier B.V. All rights reserved.

  7. Altered resting-state functional connectivity of the frontal-striatal reward system in social anxiety disorder.

    PubMed

    Manning, Joshua; Reynolds, Gretchen; Saygin, Zeynep M; Hofmann, Stefan G; Pollack, Mark; Gabrieli, John D E; Whitfield-Gabrieli, Susan

    2015-01-01

    We investigated differences in the intrinsic functional brain organization (functional connectivity) of the human reward system between healthy control participants and patients with social anxiety disorder. Functional connectivity was measured in the resting-state via functional magnetic resonance imaging (fMRI). 53 patients with social anxiety disorder and 33 healthy control participants underwent a 6-minute resting-state fMRI scan. Functional connectivity of the reward system was analyzed by calculating whole-brain temporal correlations with a bilateral nucleus accumbens seed and a ventromedial prefrontal cortex seed. Patients with social anxiety disorder, relative to the control group, had (1) decreased functional connectivity between the nucleus accumbens seed and other regions associated with reward, including ventromedial prefrontal cortex; (2) decreased functional connectivity between the ventromedial prefrontal cortex seed and lateral prefrontal regions, including the anterior and dorsolateral prefrontal cortices; and (3) increased functional connectivity between both the nucleus accumbens seed and the ventromedial prefrontal cortex seed with more posterior brain regions, including anterior cingulate cortex. Social anxiety disorder appears to be associated with widespread differences in the functional connectivity of the reward system, including markedly decreased functional connectivity between reward regions and between reward regions and lateral prefrontal cortices, and markedly increased functional connectivity between reward regions and posterior brain regions.

  8. Reward and aversion in a heterogeneous midbrain dopamine system.

    PubMed

    Lammel, Stephan; Lim, Byung Kook; Malenka, Robert C

    2014-01-01

    The ventral tegmental area (VTA) is a heterogeneous brain structure that serves a central role in motivation and reward processing. Abnormalities in the function of VTA dopamine (DA) neurons and the targets they influence are implicated in several prominent neuropsychiatric disorders including addiction and depression. Recent studies suggest that the midbrain DA system is composed of anatomically and functionally heterogeneous DA subpopulations with different axonal projections. These findings may explain a number of previously confusing observations that suggested a role for DA in processing both rewarding as well as aversive events. Here we will focus on recent advances in understanding the neural circuits mediating reward and aversion in the VTA and how stress as well as drugs of abuse, in particular cocaine, alter circuit function within a heterogeneous midbrain DA system. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'. Copyright © 2013 Elsevier Ltd. All rights reserved.

  9. The rat approximates an ideal detector of changes in rates of reward: implications for the law of effect.

    PubMed

    Gallistel, C R; Mark, T A; King, A P; Latham, P E

    2001-10-01

    Rats responded on 2 levers delivering brain stimulation reward on concurrent variable interval schedules. Following many successive sessions with unchanging relative rates of reward, subjects adjusted to an eventual change slowly and showed spontaneous reversions at the beginning of subsequent sessions. When changes in rates of reward occurred between and within every session, subjects adjusted to them about as rapidly as they could in principle do so, as shown by comparison to a Bayesian model of an ideal detector. This and other features of the adjustments to frequent changes imply that the behavioral effect of reinforcement depends on the subject's perception of incomes and changes in incomes rather than on the strengthening and weakening of behaviors in accord with their past effects or expected results. Models for the process by which perceived incomes determine stay durations and for the process that detects changes in rates are developed.

  10. Patterns of Brain Activation when Mothers View Their Own Child and Dog: An fMRI Study

    PubMed Central

    Gollub, Randy L.; Niemi, Steven M.; Evins, Anne Eden

    2014-01-01

    Neural substrates underlying the human-pet relationship are largely unknown. We examined fMRI brain activation patterns as mothers viewed images of their own child and dog and an unfamiliar child and dog. There was a common network of brain regions involved in emotion, reward, affiliation, visual processing and social cognition when mothers viewed images of both their child and dog. Viewing images of their child resulted in brain activity in the midbrain (ventral tegmental area/substantia nigra involved in reward/affiliation), while a more posterior cortical brain activation pattern involving fusiform gyrus (visual processing of faces and social cognition) characterized a mother's response to her dog. Mothers also rated images of their child and dog as eliciting similar levels of excitement (arousal) and pleasantness (valence), although the difference in the own vs. unfamiliar child comparison was larger than the own vs. unfamiliar dog comparison for arousal. Valence ratings of their dog were also positively correlated with ratings of the attachment to their dog. Although there are similarities in the perceived emotional experience and brain function associated with the mother-child and mother-dog bond, there are also key differences that may reflect variance in the evolutionary course and function of these relationships. PMID:25279788

  11. Patterns of brain activation when mothers view their own child and dog: an fMRI study.

    PubMed

    Stoeckel, Luke E; Palley, Lori S; Gollub, Randy L; Niemi, Steven M; Evins, Anne Eden

    2014-01-01

    Neural substrates underlying the human-pet relationship are largely unknown. We examined fMRI brain activation patterns as mothers viewed images of their own child and dog and an unfamiliar child and dog. There was a common network of brain regions involved in emotion, reward, affiliation, visual processing and social cognition when mothers viewed images of both their child and dog. Viewing images of their child resulted in brain activity in the midbrain (ventral tegmental area/substantia nigra involved in reward/affiliation), while a more posterior cortical brain activation pattern involving fusiform gyrus (visual processing of faces and social cognition) characterized a mother's response to her dog. Mothers also rated images of their child and dog as eliciting similar levels of excitement (arousal) and pleasantness (valence), although the difference in the own vs. unfamiliar child comparison was larger than the own vs. unfamiliar dog comparison for arousal. Valence ratings of their dog were also positively correlated with ratings of the attachment to their dog. Although there are similarities in the perceived emotional experience and brain function associated with the mother-child and mother-dog bond, there are also key differences that may reflect variance in the evolutionary course and function of these relationships.

  12. Acute stress-induced cortisol elevations mediate reward system activity during subconscious processing of sexual stimuli.

    PubMed

    Oei, Nicole Y L; Both, Stephanie; van Heemst, Diana; van der Grond, Jeroen

    2014-01-01

    Stress is thought to alter motivational processes by increasing dopamine (DA) secretion in the brain's "reward system", and its key region, the nucleus accumbens (NAcc). However, stress studies using functional magnetic resonance imaging (fMRI), mainly found evidence for stress-induced decreases in NAcc responsiveness toward reward cues. Results from both animal and human PET studies indicate that the stress hormone cortisol may be crucial in the interaction between stress and dopaminergic actions. In the present study we therefore investigated whether cortisol mediated the effect of stress on DA-related responses to -subliminal-presentation of reward cues using the Trier Social Stress Test (TSST), which is known to reliably enhance cortisol levels. Young healthy males (n = 37) were randomly assigned to the TSST or control condition. After stress induction, brain activation was assessed using fMRI during a backward-masking paradigm in which potentially rewarding (sexual), emotionally negative and neutral stimuli were presented subliminally, masked by pictures of inanimate objects. A region of interest analysis showed that stress decreased activation in the NAcc in response to masked sexual cues (voxel-corrected, p<05). Furthermore, with mediation analysis it was found that high cortisol levels were related to stronger NAcc activation, showing that cortisol acted as a suppressor variable in the negative relation between stress and NAcc activation. The present findings indicate that cortisol is crucially involved in the relation between stress and the responsiveness of the reward system. Although generally stress decreases activation in the NAcc in response to rewarding stimuli, high stress-induced cortisol levels suppress this relation, and are associated with stronger NAcc activation. Individuals with a high cortisol response to stress might on one hand be protected against reductions in reward sensitivity, which has been linked to anhedonia and depression, but they may ultimately be more vulnerable to increased reward sensitivity, and addictions. Future studies investigating effects of stress on reward sensitivity should take into account the severity of the stressor and the individual cortisol response to stress. Copyright © 2013 Elsevier Ltd. All rights reserved.

  13. Histidine-decarboxylase knockout mice show deficient nonreinforced episodic object memory, improved negatively reinforced water-maze performance, and increased neo- and ventro-striatal dopamine turnover.

    PubMed

    Dere, Ekrem; De Souza-Silva, Maria A; Topic, Bianca; Spieler, Richard E; Haas, Helmut L; Huston, Joseph P

    2003-01-01

    The brain's histaminergic system has been implicated in hippocampal synaptic plasticity, learning, and memory, as well as brain reward and reinforcement. Our past pharmacological and lesion studies indicated that the brain's histamine system exerts inhibitory effects on the brain's reinforcement respective reward system reciprocal to mesolimbic dopamine systems, thereby modulating learning and memory performance. Given the close functional relationship between brain reinforcement and memory processes, the total disruption of brain histamine synthesis via genetic disruption of its synthesizing enzyme, histidine decarboxylase (HDC), in the mouse might have differential effects on learning dependent on the task-inherent reinforcement contingencies. Here, we investigated the effects of an HDC gene disruption in the mouse in a nonreinforced object exploration task and a negatively reinforced water-maze task as well as on neo- and ventro-striatal dopamine systems known to be involved in brain reward and reinforcement. Histidine decarboxylase knockout (HDC-KO) mice had higher dihydrophenylacetic acid concentrations and a higher dihydrophenylacetic acid/dopamine ratio in the neostriatum. In the ventral striatum, dihydrophenylacetic acid/dopamine and 3-methoxytyramine/dopamine ratios were higher in HDC-KO mice. Furthermore, the HDC-KO mice showed improved water-maze performance during both hidden and cued platform tasks, but deficient object discrimination based on temporal relationships. Our data imply that disruption of brain histamine synthesis can have both memory promoting and suppressive effects via distinct and independent mechanisms and further indicate that these opposed effects are related to the task-inherent reinforcement contingencies.

  14. Self-administration of the synthetic cathinone MPDV enhances reward function via a nicotinic receptor dependent mechanism.

    PubMed

    Geste, Jean R; Pompilus, Marjory; Febo, Marcelo; Bruijnzeel, Adriaan W

    2018-05-09

    Methylenedioxypyrovalerone (MDPV) is an addictive synthetic drug with severe side effects. Previous studies have shown that MDPV has positive reinforcing properties. However, little is known about the effect of MDPV self-administration on the state of the brain reward system and the neuronal mechanisms by which MDPV mediates its effects. The goal of the present studies was to determine the effect of MDPV self-administration on reward function and the role of cholinergic neurotransmission in the reinforcing effects of MDPV. To study the effect of MDPV self-administration on the brain reward system, rats were prepared with intravenous catheters and intracranial self-stimulation electrodes (ICSS). For 10 days, the reward thresholds were assessed immediately before (23 h post prior session) and after 1 h of MDPV self-administration. The reward thresholds were decreased immediately after MDPV self-administration, which is indicative of a potentiation of brain reward function. The reward thresholds 23 h after MDPV intake gradually increased over time, which is indicative of anhedonia. Pretreatment with the nicotinic acetylcholine receptor (nAChR) antagonist mecamylamine decreased the self-administration of MDPV and completely prevented the decrease in reward thresholds. A control study with palatable chocolate pellets showed that responding for a natural reinforcer does not affect the state of the brain reward system. Furthermore, mecamylamine did not affect responding for food pellets. In conclusion, the self-administration of MDPV potentiates reward function and nAChR blockade prevents the reward enhancing effects of MDPV self-administration. Preventing the MDPV-induced increase in cholinergic neurotransmission might be a safe approach to diminish MDPV abuse. Copyright © 2018. Published by Elsevier Ltd.

  15. Fluctuations in nucleus accumbens extracellular glutamate and glucose during motivated glucose-drinking behavior: dissecting the neurochemistry of reward.

    PubMed

    Wakabayashi, Ken T; Myal, Stephanie E; Kiyatkin, Eugene A

    2015-02-01

    While motivated behavior involves multiple neurochemical systems, few studies have focused on the role of glutamate, the brain's excitatory neurotransmitter, and glucose, the energetic substrate of neural activity in reward-related neural processes. Here, we used high-speed amperometry with enzyme-based substrate-sensitive and control, enzyme-free biosensors to examine second-scale fluctuations in the extracellular levels of these substances in the nucleus accumbens shell during glucose-drinking behavior in trained rats. Glutamate rose rapidly after the presentation of a glucose-containing cup and before the initiation of drinking (reward seeking), decreased more slowly to levels below baseline during consumption (sensory reward), and returned to baseline when the ingested glucose reached the brain (metabolic reward). When water was substituted for glucose, glutamate rapidly increased with cup presentation and in contrast to glucose drinking, increased above baseline after rats tasted the water and refused to drink further. Therefore, extracellular glutamate show distinct changes associated with key events of motivated drinking behavior and opposite dynamics during sensory and metabolic components of reward. In contrast to glutamate, glucose increased at each stimulus and behavioral event, showing a sustained elevation during the entire behavior and a robust post-ingestion rise that correlated with the gradual return of glutamate levels to their baseline. By comparing active drinking with passive intra-gastric glucose delivery, we revealed that fluctuations in extracellular glucose are highly dynamic, reflecting a balance between rapid delivery because of neural activity, intense metabolism, and the influence of ingested glucose reaching the brain. Published 2014. This article is a U.S. Government work and is in the public domain in the USA.

  16. Regulatory processes of hunger motivated behavior.

    PubMed

    Lénárd, L; Karádi, Z

    2012-01-01

    While food intake and body weight are under homeostatic regulation, eating is a highly motivated and reinforced behavior that induces feelings of gratification and pleasure. The chemical senses (taste and odor) and their evaluation are essential to these functions. Brainstem and limbic glucose-monitoring (GM) neurons receiving neurochemical information from the periphery and from the local brain milieu are important controlling hunger motivation, and brain gut peptides have a modulatory role on this function. The hypothalamic and limbic forebrain areas are responsible for evaluation of reward quality and related emotions. They are innervated by the mesolimbic dopaminergic system (MLDS) and majority of GM neurons are also influenced by dopamine. Via dopamine release, the MLDS plays an essential role in rewarding-reinforcing processes of feeding and addiction. The GM network and the MLDS in the limbic system represent essential elements in the neural substrate of motivation.

  17. Reward-based plasticity of spatial priority maps: Exploiting inter-subject variability to probe the underlying neurobiology.

    PubMed

    Della Libera, Chiara; Calletti, Riccardo; Eštočinová, Jana; Chelazzi, Leonardo; Santandrea, Elisa

    2017-04-01

    Recent evidence indicates that the attentional priority of objects and locations is altered by the controlled delivery of reward, reflecting reward-based attentional learning. Here, we take an approach hinging on intersubject variability to probe the neurobiological bases of the reward-driven plasticity of spatial priority maps. Specifically, we ask whether an individual's susceptibility to the reward-based treatment can be accounted for by specific predictors, notably personality traits that are linked to reward processing (along with more general personality traits), but also gender. Using a visual search protocol, we show that when different target locations are associated with unequal reward probability, different priorities are acquired by the more rewarded relative to the less rewarded locations. However, while males exhibit the expected pattern of results, with greater priority for locations associated with higher reward, females show an opposite trend. Critically, both the extent and the direction of reward-based adjustments are further predicted by personality traits indexing reward sensitivity, indicating that not only male and female brains are differentially sensitive to reward, but also that specific personality traits further contribute to shaping their learning-dependent attentional plasticity. These results contribute to a better understanding of the neurobiology underlying reward-dependent attentional learning and cross-subject variability in this domain.

  18. Reward inference by primate prefrontal and striatal neurons.

    PubMed

    Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru; Sakagami, Masamichi

    2014-01-22

    The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus-reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning.

  19. Reward Inference by Primate Prefrontal and Striatal Neurons

    PubMed Central

    Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru

    2014-01-01

    The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus–reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning. PMID:24453328

  20. Neural Reward Processing Mediates the Relationship between Insomnia Symptoms and Depression in Adolescence.

    PubMed

    Casement, Melynda D; Keenan, Kate E; Hipwell, Alison E; Guyer, Amanda E; Forbes, Erika E

    2016-02-01

    Emerging evidence suggests that insomnia may disrupt reward-related brain function-a potentially important factor in the development of depressive disorder. Adolescence may be a period during which such disruption is especially problematic given the rise in the incidence of insomnia and ongoing development of neural systems that support reward processing. The present study uses longitudinal data to test the hypothesis that disruption of neural reward processing is a mechanism by which insomnia symptoms-including nocturnal insomnia symptoms (NIS) and nonrestorative sleep (NRS)-contribute to depressive symptoms in adolescent girls. Participants were 123 adolescent girls and their caregivers from an ongoing longitudinal study of precursors to depression across adolescent development. NIS and NRS were assessed annually from ages 9 to 13 years. Girls completed a monetary reward task during a functional MRI scan at age 16 years. Depressive symptoms were assessed at ages 16 and 17 years. Multivariable regression tested the prospective associations between NIS and NRS, neural response during reward anticipation, and the mean number of depressive symptoms (omitting sleep problems). NRS, but not NIS, during early adolescence was positively associated with late adolescent dorsal medial prefrontal cortex (dmPFC) response to reward anticipation and depressive symptoms. DMPFC response mediated the relationship between early adolescent NRS and late adolescent depressive symptoms. These results suggest that NRS may contribute to depression by disrupting reward processing via altered activity in a region of prefrontal cortex involved in affective control. The results also support the mechanistic differentiation of NIS and NRS. © 2016 Associated Professional Sleep Societies, LLC.

  1. Dampening Positive Affect and Neural Reward Responding in Healthy Children: Implications for Affective Inflexibility

    PubMed Central

    Gilbert, Kirsten; Luking, Katherine; Pagliaccio, David; Luby, Joan L.; Barch, Deanna M.

    2017-01-01

    OBJECTIVE Blunted reward processing is evident in and may contribute to the onset of major depressive disorder. However, it is unclear what mechanisms contribute to the development of blunted reward-response prior to depression onset. METHOD The current study examined how individual differences in the tendency to dampen positive affect, an affect regulation strategy that decreases positive affect, are associated with reward responding and related brain activation in 39 healthy children (age 7–10; 51% female; 79% white). To do this, we examined neural responses to winning a reward (candy) within the context of a previous loss, win, or neutral outcome. RESULTS Whole brain regression analyses revealed that self-reported tendencies to engage in dampening were associated with blunted striatum and thalamic activation during a winning outcome when following a previous loss outcome, as compared to when following a neutral outcome. This finding was above and beyond the influence of current depressive symptoms. However, tendencies to dampen positive affect were not associated with neural activity during the second of two consecutive win outcomes, and thus did not support the notion that dampening is associated with an inability to maintain reward responding. CONCLUSIONS In youth, tendencies to dampen positive affect may be associated with less ability to flexibly upregulate neural reward responding following a loss, possibly leading to the development of affective inflexibility and increased vulnerability to depression. Dampening positive affect may be one mechanism that contributes to aberrant neural reward responding via affective inflexibility and may be a target for prevention in youth. PMID:27819484

  2. Reward-Based Spatial Learning in Teens With Bulimia Nervosa.

    PubMed

    Cyr, Marilyn; Wang, Zhishun; Tau, Gregory Z; Zhao, Guihu; Friedl, Eve; Stefan, Mihaela; Terranova, Kate; Marsh, Rachel

    2016-11-01

    To assess the functioning of mesolimbic and fronto-striatal areas involved in reward-based spatial learning in teenaged girls with bulimia nervosa (BN) that might be involved in the development and maintenance of maladaptive behaviors characteristic of the disorder. We compared functional magnetic resonance imaging blood oxygen level-dependent response in 27 adolescent girls with BN to that of 27 healthy, age-matched control participants during a reward-based learning task that required learning to use extra-maze cues to navigate a virtual 8-arm radial maze to find hidden rewards. We compared groups in their patterns of brain activation associated with reward-based spatial learning versus a control condition in which rewards were unexpected because they were allotted pseudo-randomly to experimentally prevent learning. Both groups learned to navigate the maze to find hidden rewards, but group differences in brain activity associated with maze navigation and reward processing were detected in the fronto-striatal regions and right anterior hippocampus. Unlike healthy adolescents, those with BN did not engage the right inferior frontal gyrus during maze navigation, activated the right anterior hippocampus during the receipt of unexpected rewards (control condition), and deactivated the left superior frontal gyrus and right anterior hippocampus during expected reward receipt (learning condition). These patterns of hippocampal activation in the control condition were significantly associated with the frequency of binge-eating episodes. Adolescents with BN displayed abnormal functioning of the anterior hippocampus and fronto-striatal regions during reward-based spatial learning. These findings suggest that an imbalance in control and reward circuits may arise early in the course of BN. Clinical trial registration information-An fMRI Study of Self-Regulation in Adolescents With Bulimia Nervosa; https://clinicaltrials.gov/; NCT00345943. Copyright © 2016 American Academy of Child and Adolescent Psychiatry. Published by Elsevier Inc. All rights reserved.

  3. Dramatic decreases in brain reward function during nicotine withdrawal.

    PubMed

    Epping-Jordan, M P; Watkins, S S; Koob, G F; Markou, A

    1998-05-07

    Tobacco smoking is a worldwide public health problem. In the United States alone, over 400,000 deaths and $50 billion in medical costs annually are directly attributed to smoking. Accumulated evidence indicates that nicotine is the component of tobacco smoke that leads to addiction, but the means by which nicotine produces addiction remain unclear. Nicotine is less effective as a positive reinforcer than other drugs of abuse in non-dependent animals. Nevertheless, nicotine-withdrawal symptoms, including depressed mood, anxiety, irritability and craving in dependent subjects may contribute to the addictive liability of nicotine. We show here that spontaneous nicotine withdrawal in rats resulted in a significant decrease in brain reward function, as measured by elevations in brain reward thresholds, which persisted for four days. Further, systemic injections of a competitive nicotinic-receptor antagonist led to a dose-dependent increase in brain reward thresholds in chronic nicotine-treated rats. The decreased function in brain reward systems during nicotine withdrawal is comparable in magnitude and duration to that of other major drugs of abuse, and may constitute an important motivational factor that contributes to craving, relapse and continued tobacco consumption in humans.

  4. Taste, olfactory, and food reward value processing in the brain.

    PubMed

    Rolls, Edmund T

    2015-04-01

    Complementary neuronal recordings in primates, and functional neuroimaging in humans, show that the primary taste cortex in the anterior insula provides separate and combined representations of the taste, temperature, and texture (including fat texture) of food in the mouth independently of hunger and thus of reward value and pleasantness. One synapse on, in a second tier of processing, in the orbitofrontal cortex, these sensory inputs are for some neurons combined by associative learning with olfactory and visual inputs, and these neurons encode food reward value on a continuous scale in that they only respond to food when hungry, and in that activations correlate linearly with subjective pleasantness. Cognitive factors, including word-level descriptions, and selective attention to affective value, modulate the representation of the reward value of taste and olfactory stimuli in the orbitofrontal cortex and a region to which it projects, the anterior cingulate cortex, a tertiary taste cortical area. The food reward representations formed in this way play an important role in the control of appetite, and food intake. Individual differences in these reward representations may contribute to obesity, and there are age-related differences in these value representations that shape the foods that people in different age groups find palatable. In a third tier of processing in medial prefrontal cortex area 10, decisions between stimuli of different reward value are taken, by attractor decision-making networks. Copyright © 2015 Elsevier Ltd. All rights reserved.

  5. Caloric Deprivation Increases Responsivity of Attention and Reward Brain Regions to Intake, Anticipated Intake, and Images of Palatable Foods

    PubMed Central

    Stice, Eric; Burger, Kyle; Yokum, Sonja

    2013-01-01

    Dietary restraint theoretically increases risk for binge eating, but prospective and experimental studies have produced contradictory findings, apparently because dietary restraint scales do not identify individuals who are reducing caloric intake. Yet, experimentally manipulated caloric deprivation increases responsivity of brain regions implicated in attention and reward to food images, which may contribute to binge eating. We tested whether self-imposed acute and longer-term caloric restriction increases responsivity of attention and reward regions to images, anticipated receipt, and receipt of palatable food using functional magnetic resonance imaging among female and male adolescents (Study 1 N = 34; Study 2 N = 51/81). Duration of acute caloric deprivation correlated positively with activation in regions implicated in attention, reward, and motivation in response to images, anticipated receipt, and receipt of palatable food (e.g., anterior cingulate cortex, orbitofrontal cortex, putamen, and precentral gyrus respectively). Youth in a longer-term negative energy balance likewise showed greater activation in attention (anterior cingulate cortex, ventral medial prefrontal cortex), visual processing (superior visual cortex), reward (caudate) and memory (hippocampus) regions in response to receipt and anticipated receipt of palatable food relative to those in neutral or positive energy balance. Results confirm that self-imposed caloric deprivation increases responsivity of attention, reward, and motivation regions to food, which may explain why caloric deprivation weight loss diets typically do not produce lasting weight loss. PMID:23201365

  6. Deep brain stimulation of the subthalamic nucleus modulates reward processing and action selection in Parkinson patients.

    PubMed

    Wagenbreth, Caroline; Zaehle, Tino; Galazky, Imke; Voges, Jürgen; Guitart-Masip, Marc; Heinze, Hans-Jochen; Düzel, Emrah

    2015-06-01

    Deep brain stimulation (DBS) of the subthalamic nucleus (STN) is an effective treatment for motor impairments in Parkinson's disease (PD) but its effect on the motivational regulation of action control is still not fully understood. We investigated whether DBS of the STN influences the ability of PD patients to act for anticipated reward or loss, or whether DBS improves action execution independent of motivational valence. 16 PD patients (12 male, mean age = 58.5 ± 10.17 years) treated with bilateral STN-DBS and an age- and gender-matched group of healthy controls (HC) performed a go/no-go task whose contingencies explicitly decouple valence and action. Patients were tested with (ON) and without (OFF) active STN stimulation. For HC, there was a benefit in performing rewarded actions when compared to actions that avoided punishment. PD patients showed such a benefit reliably only when STN stimulation was ON. In fact, the relative behavioral benefit for go for reward over go to avoid losing was stronger in the PD patients under DBS ON than in HC. In PD patients, rather than generally improving motor functions independent of motivational valence, modulation of the STN by DBS improves action execution specifically when rewards are anticipated. Thus, STN-DBS establishes a reliable congruency between action and reward ("Pavlovian congruency") and remarkably enhances it over the level observed in HC.

  7. Aerobic exercise modulates anticipatory reward processing via the μ-opioid receptor system.

    PubMed

    Saanijoki, Tiina; Nummenmaa, Lauri; Tuulari, Jetro J; Tuominen, Lauri; Arponen, Eveliina; Kalliokoski, Kari K; Hirvonen, Jussi

    2018-06-08

    Physical exercise modulates food reward and helps control body weight. The endogenous µ-opioid receptor (MOR) system is involved in rewarding aspects of both food and physical exercise, yet interaction between endogenous opioid release following exercise and anticipatory food reward remains unresolved. Here we tested whether exercise-induced opioid release correlates with increased anticipatory reward processing in humans. We scanned 24 healthy lean men after rest and after a 1 h session of aerobic exercise with positron emission tomography (PET) using MOR-selective radioligand [ 11 C]carfentanil. After both PET scans, the subjects underwent a functional magnetic resonance imaging (fMRI) experiment where they viewed pictures of palatable versus nonpalatable foods to trigger anticipatory food reward responses. Exercise-induced changes in MOR binding in key regions of reward circuit (amygdala, thalamus, ventral and dorsal striatum, and orbitofrontal and cingulate cortices) were used to predict the changes in anticipatory reward responses in fMRI. Exercise-induced changes in MOR binding correlated negatively with the exercise-induced changes in neural anticipatory food reward responses in orbitofrontal and cingulate cortices, insula, ventral striatum, amygdala, and thalamus: higher exercise-induced opioid release predicted higher brain responses to palatable versus nonpalatable foods. We conclude that MOR activation following exercise may contribute to the considerable interindividual variation in food craving and consumption after exercise, which might promote compensatory eating and compromise weight control. © 2018 Wiley Periodicals, Inc.

  8. Impairments in learning by monetary rewards and alcohol-associated rewards in detoxified alcoholic patients.

    PubMed

    Jokisch, Daniel; Roser, Patrik; Juckel, Georg; Daum, Irene; Bellebaum, Christian

    2014-07-01

    Excessive alcohol consumption has been linked to structural and functional brain changes associated with cognitive, emotional, and behavioral impairments. It has been suggested that neural processing in the reward system is also affected by alcoholism. The present study aimed at further investigating reward-based associative learning and reversal learning in detoxified alcohol-dependent patients. Twenty-one detoxified alcohol-dependent patients and 26 healthy control subjects participated in a probabilistic learning task using monetary and alcohol-associated rewards as feedback stimuli indicating correct responses. Performance during acquisition and reversal learning in the different feedback conditions was analyzed. Alcohol-dependent patients and healthy control subjects showed an increase in learning performance over learning blocks during acquisition, with learning performance being significantly lower in alcohol-dependent patients. After changing the contingencies, alcohol-dependent patients exhibited impaired reversal learning and showed, in contrast to healthy controls, different learning curves for different types of rewards with no increase in performance for high monetary and alcohol-associated feedback. The present findings provide evidence that dysfunctional processing in the reward system in alcohol-dependent patients leads to alterations in reward-based learning resulting in a generally reduced performance. In addition, the results suggest that alcohol-dependent patients are, in particular, more impaired in changing an established behavior originally reinforced by high rewards. Copyright © 2014 by the Research Society on Alcoholism.

  9. Neurophysiology of Reward-Guided Behavior: Correlates Related to Predictions, Value, Motivation, Errors, Attention, and Action.

    PubMed

    Bissonette, Gregory B; Roesch, Matthew R

    2016-01-01

    Many brain areas are activated by the possibility and receipt of reward. Are all of these brain areas reporting the same information about reward? Or are these signals related to other functions that accompany reward-guided learning and decision-making? Through carefully controlled behavioral studies, it has been shown that reward-related activity can represent reward expectations related to future outcomes, errors in those expectations, motivation, and signals related to goal- and habit-driven behaviors. These dissociations have been accomplished by manipulating the predictability of positively and negatively valued events. Here, we review single neuron recordings in behaving animals that have addressed this issue. We describe data showing that several brain areas, including orbitofrontal cortex, anterior cingulate, and basolateral amygdala signal reward prediction. In addition, anterior cingulate, basolateral amygdala, and dopamine neurons also signal errors in reward prediction, but in different ways. For these areas, we will describe how unexpected manipulations of positive and negative value can dissociate signed from unsigned reward prediction errors. All of these signals feed into striatum to modify signals that motivate behavior in ventral striatum and guide responding via associative encoding in dorsolateral striatum.

  10. Neurophysiology of Reward-Guided Behavior: Correlates Related to Predictions, Value, Motivation, Errors, Attention, and Action

    PubMed Central

    Roesch, Matthew R.

    2017-01-01

    Many brain areas are activated by the possibility and receipt of reward. Are all of these brain areas reporting the same information about reward? Or are these signals related to other functions that accompany reward-guided learning and decision-making? Through carefully controlled behavioral studies, it has been shown that reward-related activity can represent reward expectations related to future outcomes, errors in those expectations, motivation, and signals related to goal- and habit-driven behaviors. These dissociations have been accomplished by manipulating the predictability of positively and negatively valued events. Here, we review single neuron recordings in behaving animals that have addressed this issue. We describe data showing that several brain areas, including orbitofrontal cortex, anterior cingulate, and basolateral amygdala signal reward prediction. In addition, anterior cingulate, basolateral amygdala, and dopamine neurons also signal errors in reward prediction, but in different ways. For these areas, we will describe how unexpected manipulations of positive and negative value can dissociate signed from unsigned reward prediction errors. All of these signals feed into striatum to modify signals that motivate behavior in ventral striatum and guide responding via associative encoding in dorsolateral striatum. PMID:26276036

  11. Reward deficiency and anti-reward in pain chronification.

    PubMed

    Borsook, D; Linnman, C; Faria, V; Strassman, A M; Becerra, L; Elman, I

    2016-09-01

    Converging lines of evidence suggest that the pathophysiology of pain is mediated to a substantial degree via allostatic neuroadaptations in reward- and stress-related brain circuits. Thus, reward deficiency (RD) represents a within-system neuroadaptation to pain-induced protracted activation of the reward circuits that leads to depletion-like hypodopaminergia, clinically manifested anhedonia, and diminished motivation for natural reinforcers. Anti-reward (AR) conversely pertains to a between-systems neuroadaptation involving over-recruitment of key limbic structures (e.g., the central and basolateral amygdala nuclei, the bed nucleus of the stria terminalis, the lateral tegmental noradrenergic nuclei of the brain stem, the hippocampus and the habenula) responsible for massive outpouring of stressogenic neurochemicals (e.g., norepinephrine, corticotropin releasing factor, vasopressin, hypocretin, and substance P) giving rise to such negative affective states as anxiety, fear and depression. We propose here the Combined Reward deficiency and Anti-reward Model (CReAM), in which biopsychosocial variables modulating brain reward, motivation and stress functions can interact in a 'downward spiral' fashion to exacerbate the intensity, chronicity and comorbidities of chronic pain syndromes (i.e., pain chronification). Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

  12. High and low sensation seeking adolescents show distinct patterns of brain activity during reward processing

    PubMed Central

    Cservenka, Anita; Herting, Megan M.; Seghete, Kristen L. Mackiewicz; Hudson, Karen A.; Nagel, Bonnie J.

    2012-01-01

    Previous research has shown that personality characteristics, such as sensation seeking (SS), are strong predictors of risk-taking behavior during adolescence. However, the relationship between levels of SS and brain response has not been studied during this time period. Given the prevalence of risky behavior during adolescence, it is important to understand neurobiological differences in reward sensitivity between youth with high and low SS personalities. To this end, we used functional magnetic resonance imaging (fMRI) to examine differences in brain activity in an adolescent sample that included 27 high (HSS) and 27 low sensation seekers (LSS), defined by the Impulsive Sensation Seeking scale of the Zuckerman-Kuhlman Personality Questionnaire (Zuckerman et al., 1993). In the scanner, participants played a modified Wheel of Fortune decision-making task (Cservenka and Nagel, 2012) that resulted in trials with monetary Wins or No Wins. We compared age- and sex-matched adolescent HSS and LSS (mean age = 13.94 ± 1.05) on brain activity by contrasting Win versus No Win trials. Our findings indicate that HSS show greater bilateral insular and prefrontal cortex (PFC) brain response on Win vs. No Win compared to LSS. Analysis of simple effects showed that while LSS showed comparable brain activity in these areas during Wins and No Wins, HSS showed significant differences in brain response to winning (activation) versus not winning (deactivation), with between-group comparison suggesting significant differences in brain response, largely to reward absence. Group differences in insular activation between reward receipt and absence may suggest weak autonomic arousal to negative outcomes in HSS compared with LSS. Additionally, since the PFC is important for goal-directed behavior and attention, the current results may reflect that HSS allocate fewer attentional resources to negative outcomes than LSS. This insensitivity to reward absence in HSS may lead to a greater likelihood of maladaptive choices when negative consequences are not considered, and may be an early neural marker of decreased loss sensitivity that has been seen in addiction. This neurobiological information may ultimately be helpful in establishing prevention strategies aimed at reducing youth risk-taking and suggests value in further examination of neural associations with personality characteristics during adolescence. PMID:23142276

  13. [The endogenous opioid system and drug addiction].

    PubMed

    Maldonado, R

    2010-01-01

    Drug addiction is a chronic brain disorder leading to complex adaptive changes within the brain reward circuits. Several neurotransmitters, including the endogenous opioid system are involved in these changes. The opioid system plays a pivotal role in different aspects of addiction. Thus, opioid receptors and endogenous opioid peptides are largely distributed in the mesolimbic system and modulate dopaminergic activity within the reward circuits. Opioid receptors and peptides are selectively involved in several components of the addictive processes induced by opioids, cannabinoids, psychostimulants, alcohol and nicotine. This review is focused on the contribution of each component of the endogenous opioid system in the addictive properties of the different drugs of abuse. Copyright 2010 Elsevier Masson SAS. All rights reserved.

  14. Leptin Is Associated With Exaggerated Brain Reward and Emotion Responses to Food Images in Adolescent Obesity

    PubMed Central

    Jastreboff, Ania M.; Lacadie, Cheryl; Seo, Dongju; Kubat, Jessica; Van Name, Michelle A.; Giannini, Cosimo; Savoye, Mary; Constable, R. Todd; Sherwin, Robert S.

    2014-01-01

    OBJECTIVE In the U.S., an astonishing 12.5 million children and adolescents are now obese, predisposing 17% of our nation’s youth to metabolic complications of obesity, such as type 2 diabetes (T2D). Adolescent obesity has tripled over the last three decades in the setting of food advertising directed at children. Obese adults exhibit increased brain responses to food images in motivation-reward pathways. These neural alterations may be attributed to obesity-related metabolic changes, which promote food craving and high-calorie food (HCF) consumption. It is not known whether these metabolic changes affect neural responses in the adolescent brain during a crucial period for establishing healthy eating behaviors. RESEARCH DESIGN AND METHODS Twenty-five obese (BMI 34.4 kg/m2, age 15.7 years) and fifteen lean (BMI 20.96 kg/m2, age 15.5 years) adolescents underwent functional MRI during exposure to HCF, low-calorie food (LCF), and nonfood (NF) visual stimuli 2 h after isocaloric meal consumption. RESULTS Brain responses to HCF relative to NF cues increased in obese versus lean adolescents in striatal-limbic regions (i.e., putamen/caudate, insula, amygdala) (P < 0.05, family-wise error [FWE]), involved in motivation-reward and emotion processing. Higher endogenous leptin levels correlated with increased neural activation to HCF images in all subjects (P < 0.05, FWE). CONCLUSIONS This significant association between higher circulating leptin and hyperresponsiveness of brain motivation-reward regions to HCF images suggests that dysfunctional leptin signaling may contribute to the risk of overconsumption of these foods, thus further predisposing adolescents to the development of obesity and T2D. PMID:25139883

  15. Leptin is associated with exaggerated brain reward and emotion responses to food images in adolescent obesity.

    PubMed

    Jastreboff, Ania M; Lacadie, Cheryl; Seo, Dongju; Kubat, Jessica; Van Name, Michelle A; Giannini, Cosimo; Savoye, Mary; Constable, R Todd; Sherwin, Robert S; Caprio, Sonia; Sinha, Rajita

    2014-11-01

    In the U.S., an astonishing 12.5 million children and adolescents are now obese, predisposing 17% of our nation's youth to metabolic complications of obesity, such as type 2 diabetes (T2D). Adolescent obesity has tripled over the last three decades in the setting of food advertising directed at children. Obese adults exhibit increased brain responses to food images in motivation-reward pathways. These neural alterations may be attributed to obesity-related metabolic changes, which promote food craving and high-calorie food (HCF) consumption. It is not known whether these metabolic changes affect neural responses in the adolescent brain during a crucial period for establishing healthy eating behaviors. Twenty-five obese (BMI 34.4 kg/m2, age 15.7 years) and fifteen lean (BMI 20.96 kg/m2, age 15.5 years) adolescents underwent functional MRI during exposure to HCF, low-calorie food (LCF), and nonfood (NF) visual stimuli 2 h after isocaloric meal consumption. Brain responses to HCF relative to NF cues increased in obese versus lean adolescents in striatal-limbic regions (i.e., putamen/caudate, insula, amygdala) (P < 0.05, family-wise error [FWE]), involved in motivation-reward and emotion processing. Higher endogenous leptin levels correlated with increased neural activation to HCF images in all subjects (P < 0.05, FWE). This significant association between higher circulating leptin and hyperresponsiveness of brain motivation-reward regions to HCF images suggests that dysfunctional leptin signaling may contribute to the risk of overconsumption of these foods, thus further predisposing adolescents to the development of obesity and T2D. © 2014 by the American Diabetes Association. Readers may use this article as long as the work is properly cited, the use is educational and not for profit, and the work is not altered.

  16. Neural connectivity during reward expectation dissociates psychopathic criminals from non-criminal individuals with high impulsive/antisocial psychopathic traits

    PubMed Central

    von Borries, Katinka; Volman, Inge; Bulten, Berend Hendrik; Cools, Roshan; Verkes, Robbert-Jan

    2016-01-01

    Criminal behaviour poses a big challenge for society. A thorough understanding of the neurobiological mechanisms underlying criminality could optimize its prevention and management. Specifically,elucidating the neural mechanisms underpinning reward expectation might be pivotal to understanding criminal behaviour. So far no study has assessed reward expectation and its mechanisms in a criminal sample. To fill this gap, we assessed reward expectation in incarcerated, psychopathic criminals. We compared this group to two groups of non-criminal individuals: one with high levels and another with low levels of impulsive/antisocial traits. Functional magnetic resonance imaging was used to quantify neural responses to reward expectancy. Psychophysiological interaction analyses were performed to examine differences in functional connectivity patterns of reward-related regions. The data suggest that overt criminality is characterized, not by abnormal reward expectation per se, but rather by enhanced communication between reward-related striatal regions and frontal brain regions. We establish that incarcerated psychopathic criminals can be dissociated from non-criminal individuals with comparable impulsive/antisocial personality tendencies based on the degree to which reward-related brain regions interact with brain regions that control behaviour. The present results help us understand why some people act according to their impulsive/antisocial personality while others are able to behave adaptively despite reward-related urges. PMID:27217111

  17. Cumulative stress in childhood is associated with blunted reward-related brain activity in adulthood

    PubMed Central

    Albert, Dustin; Iselin, Anne-Marie R.; Carré, Justin M.; Dodge, Kenneth A.; Hariri, Ahmad R.

    2016-01-01

    Early life stress (ELS) is strongly associated with negative outcomes in adulthood, including reduced motivation and increased negative mood. The mechanisms mediating these relations, however, are poorly understood. We examined the relation between exposure to ELS and reward-related brain activity, which is known to predict motivation and mood, at age 26, in a sample followed since kindergarten with annual assessments. Using functional neuroimaging, we assayed individual differences in the activity of the ventral striatum (VS) during the processing of monetary rewards associated with a simple card-guessing task, in a sample of 72 male participants. We examined associations between a cumulative measure of ELS exposure and VS activity in adulthood. We found that greater levels of cumulative stress during childhood and adolescence predicted lower reward-related VS activity in adulthood. Extending this general developmental pattern, we found that exposure to stress early in development (between kindergarten and grade 3) was significantly associated with variability in adult VS activity. Our results provide an important demonstration that cumulative life stress, especially during this childhood period, is associated with blunted reward-related VS activity in adulthood. These differences suggest neurobiological pathways through which a history of ELS may contribute to reduced motivation and increased negative mood. PMID:26443679

  18. Orbitofrontal cortex mediates pain inhibition by monetary reward.

    PubMed

    Becker, Susanne; Gandhi, Wiebke; Pomares, Florence; Wager, Tor D; Schweinhardt, Petra

    2017-04-01

    Pleasurable stimuli, including reward, inhibit pain, but the level of the neuraxis at which they do so and the cerebral processes involved are unknown. Here, we characterized a brain circuitry mediating pain inhibition by reward. Twenty-four healthy participants underwent functional magnetic resonance imaging while playing a wheel of fortune game with simultaneous thermal pain stimuli and monetary wins or losses. As expected, winning decreased pain perception compared to losing. Inter-individual differences in pain modulation by monetary wins relative to losses correlated with activation in the medial orbitofrontal cortex (mOFC). When pain and reward occured simultaneously, mOFCs functional connectivity changed: the signal time course in the mOFC condition-dependent correlated negatively with the signal time courses in the rostral anterior insula, anterior-dorsal cingulate cortex and primary somatosensory cortex, which might signify moment-to-moment down-regulation of these regions by the mOFC. Monetary wins and losses did not change the magnitude of pain-related activation, including in regions that code perceived pain intensity when nociceptive input varies and/or receive direct nociceptive input. Pain inhibition by reward appears to involve brain regions not typically involved in nociceptive intensity coding but likely mediate changes in the significance and/or value of pain. © The Author (2017). Published by Oxford University Press.

  19. Neurogenetics and Nutrigenomics of Neuro-Nutrient Therapy for Reward Deficiency Syndrome (RDS): Clinical Ramifications as a Function of Molecular Neurobiological Mechanisms

    PubMed Central

    Blum, Kenneth; Oscar-Berman, Marlene; Stuller, Elizabeth; Miller, David; Giordano, John; Morse, Siobhan; McCormick, Lee; Downs, William B; Waite, Roger L; Barh, Debmalya; Neal, Dennis; Braverman, Eric R; Lohmann, Raquel; Borsten, Joan; Hauser, Mary; Han, David; Liu, Yijun; Helman, Manya; Simpatico, Thomas

    2013-01-01

    In accord with the new definition of addiction published by American Society of Addiction Medicine (ASAM) it is well-known that individuals who present to a treatment center involved in chemical dependency or other documented reward dependence behaviors have impaired brain reward circuitry. They have hypodopaminergic function due to genetic and/or environmental negative pressures upon the reward neuro-circuitry. This impairment leads to aberrant craving behavior and other behaviors such as Substance Use Disorder (SUD). Neurogenetic research in both animal and humans revealed that there is a well-defined cascade in the reward site of the brain that leads to normal dopamine release. This cascade has been termed the “Brain Reward Cascade” (BRC). Any impairment due to either genetics or environmental influences on this cascade will result in a reduced amount of dopamine release in the brain reward site. Manipulation of the BRC has been successfully achieved with neuro-nutrient therapy utilizing nutrigenomic principles. After over four decades of development, neuro-nutrient therapy has provided important clinical benefits when appropriately utilized. This is a review, with some illustrative case histories from a number of addiction professionals, of certain molecular neurobiological mechanisms which if ignored may lead to clinical complications. PMID:23926462

  20. Underconnectivity between voice-selective cortex and reward circuitry in children with autism.

    PubMed

    Abrams, Daniel A; Lynch, Charles J; Cheng, Katherine M; Phillips, Jennifer; Supekar, Kaustubh; Ryali, Srikanth; Uddin, Lucina Q; Menon, Vinod

    2013-07-16

    Individuals with autism spectrum disorders (ASDs) often show insensitivity to the human voice, a deficit that is thought to play a key role in communication deficits in this population. The social motivation theory of ASD predicts that impaired function of reward and emotional systems impedes children with ASD from actively engaging with speech. Here we explore this theory by investigating distributed brain systems underlying human voice perception in children with ASD. Using resting-state functional MRI data acquired from 20 children with ASD and 19 age- and intelligence quotient-matched typically developing children, we examined intrinsic functional connectivity of voice-selective bilateral posterior superior temporal sulcus (pSTS). Children with ASD showed a striking pattern of underconnectivity between left-hemisphere pSTS and distributed nodes of the dopaminergic reward pathway, including bilateral ventral tegmental areas and nucleus accumbens, left-hemisphere insula, orbitofrontal cortex, and ventromedial prefrontal cortex. Children with ASD also showed underconnectivity between right-hemisphere pSTS, a region known for processing speech prosody, and the orbitofrontal cortex and amygdala, brain regions critical for emotion-related associative learning. The degree of underconnectivity between voice-selective cortex and reward pathways predicted symptom severity for communication deficits in children with ASD. Our results suggest that weak connectivity of voice-selective cortex and brain structures involved in reward and emotion may impair the ability of children with ASD to experience speech as a pleasurable stimulus, thereby impacting language and social skill development in this population. Our study provides support for the social motivation theory of ASD.

  1. Effects of reward and punishment on brain activations associated with inhibitory control in cigarette smokers.

    PubMed

    Luijten, Maartje; O'Connor, David A; Rossiter, Sarah; Franken, Ingmar H A; Hester, Robert

    2013-11-01

    Susceptibility to use of addictive substances may result, in part, from a greater preference for an immediate small reward relative to a larger delayed reward or relative insensitivity to punishment. This functional magnetic resonance imaging (fMRI) study examined the neural basis of inhibiting an immediately rewarding stimulus to obtain a larger delayed reward in smokers. We also investigated whether punishment could modulate inhibitory control. The Monetary Incentive Go/NoGo (MI-Go/NoGo) task was administered that provided three types of reward outcomes contingent upon inhibitory control performance over rewarding stimuli: inhibition failure was either followed by no monetary reward (neutral condition), a small monetary reward with immediate feedback (reward condition) or immediate monetary punishment (punishment condition). In the reward and punishment conditions, successful inhibitory control resulted in larger delayed rewards. Community sample of smokers in the Melbourne (Australia) area. Nineteen smokers were compared with 17 demographically matched non-smoking controls. Accuracy, reaction times and brain activation associated with the MI-Go/NoGo task. Smokers showed hyperactivation in the right insula (P < 0.01), inferior and middle frontal gyrus (P < 0.01), dorsolateral prefrontal cortex (P = 0.001) and inferior parietal lobe (P < 0.01) both during inhibition of an immediately rewarding stimulus to obtain a larger delayed reward, and during inhibition of neutral stimuli. Group differences in brain activity were not significant in the punishment condition in the right insula and dorsolateral prefrontal cortex, most probably as a result of increased activation in non-smoking controls. Compared with non-smokers, smokers showed increased neural activation when resisting immediately rewarding stimuli and may be less sensitive to punishment as a strategy to increase control over rewarding stimuli. © 2013 Society for the Study of Addiction.

  2. A simple solution for model comparison in bold imaging: the special case of reward prediction error and reward outcomes.

    PubMed

    Erdeniz, Burak; Rohe, Tim; Done, John; Seidler, Rachael D

    2013-01-01

    Conventional neuroimaging techniques provide information about condition-related changes of the BOLD (blood-oxygen-level dependent) signal, indicating only where and when the underlying cognitive processes occur. Recently, with the help of a new approach called "model-based" functional neuroimaging (fMRI), researchers are able to visualize changes in the internal variables of a time varying learning process, such as the reward prediction error or the predicted reward value of a conditional stimulus. However, despite being extremely beneficial to the imaging community in understanding the neural correlates of decision variables, a model-based approach to brain imaging data is also methodologically challenging due to the multicollinearity problem in statistical analysis. There are multiple sources of multicollinearity in functional neuroimaging including investigations of closely related variables and/or experimental designs that do not account for this. The source of multicollinearity discussed in this paper occurs due to correlation between different subjective variables that are calculated very close in time. Here, we review methodological approaches to analyzing such data by discussing the special case of separating the reward prediction error signal from reward outcomes.

  3. RM-SORN: a reward-modulated self-organizing recurrent neural network.

    PubMed

    Aswolinskiy, Witali; Pipa, Gordon

    2015-01-01

    Neural plasticity plays an important role in learning and memory. Reward-modulation of plasticity offers an explanation for the ability of the brain to adapt its neural activity to achieve a rewarded goal. Here, we define a neural network model that learns through the interaction of Intrinsic Plasticity (IP) and reward-modulated Spike-Timing-Dependent Plasticity (STDP). IP enables the network to explore possible output sequences and STDP, modulated by reward, reinforces the creation of the rewarded output sequences. The model is tested on tasks for prediction, recall, non-linear computation, pattern recognition, and sequence generation. It achieves performance comparable to networks trained with supervised learning, while using simple, biologically motivated plasticity rules, and rewarding strategies. The results confirm the importance of investigating the interaction of several plasticity rules in the context of reward-modulated learning and whether reward-modulated self-organization can explain the amazing capabilities of the brain.

  4. Chronic Nicotine Exposure Induces a Long-Lasting and Pathway-Specific Facilitation of LTP in the Amygdala

    ERIC Educational Resources Information Center

    Huang, Yan-You; Kandel, Eric R.; Levine, Amir

    2008-01-01

    Nicotine, in the form of tobacco, is the most commonly used drug of abuse. In addition to its rewarding properties, nicotine also affects many cognitive and emotional processes that involve several brain regions, including hippocampus and amygdala. Long-term changes in synaptic strength in these brain regions after drug exposure may be importantly…

  5. The neural signatures of distinct psychopathic traits

    PubMed Central

    Carré, Justin M.; Hyde, Luke W.; Neumann, Craig S.; Viding, Essi; Hariri, Ahmad R.

    2016-01-01

    Recent studies suggest that psychopathy may be associated with dysfunction in the neural circuitry supporting both threat- and reward-related processes. However, these studies have involved small samples and often focused on extreme groups. Thus, it is unclear to what extent current findings may generalize to psychopathic traits in the general population. Furthermore, no studies have systematically and simultaneously assessed associations between distinct psychopathy facets and both threat- and reward-related brain function in the same sample of participants. Here, we examined the relationship between threat-related amygdala reactivity and reward-related ventral striatum (VS) reactivity and variation in four facets of self-reported psychopathy in a sample of 200 young adults. Path models indicated that amygdala reactivity to fearful facial expressions is negatively associated with the interpersonal facet of psychopathy, whereas amygdala reactivity to angry facial expressions is positively associated with the lifestyle facet. Furthermore, these models revealed that differential VS reactivity to positive versus negative feedback is negatively associated with the lifestyle facet. There was suggestive evidence for gender-specific patterns of association between brain function and psychopathy facets. Our findings are the first to document differential associations between both threat- and reward-related neural processes and distinct facets of psychopathy and thus provide a more comprehensive picture of the pattern of neural vulnerabilities that may predispose to maladaptive outcomes associated with psychopathy. PMID:22775289

  6. The neural signatures of distinct psychopathic traits.

    PubMed

    Carré, Justin M; Hyde, Luke W; Neumann, Craig S; Viding, Essi; Hariri, Ahmad R

    2013-01-01

    Recent studies suggest that psychopathy may be associated with dysfunction in the neural circuitry supporting both threat- and reward-related processes. However, these studies have involved small samples and often focused on extreme groups. Thus, it is unclear to what extent current findings may generalize to psychopathic traits in the general population. Furthermore, no studies have systematically and simultaneously assessed associations between distinct psychopathy facets and both threat- and reward-related brain function in the same sample of participants. Here, we examined the relationship between threat-related amygdala reactivity and reward-related ventral striatum (VS) reactivity and variation in four facets of self-reported psychopathy in a sample of 200 young adults. Path models indicated that amygdala reactivity to fearful facial expressions is negatively associated with the interpersonal facet of psychopathy, whereas amygdala reactivity to angry facial expressions is positively associated with the lifestyle facet. Furthermore, these models revealed that differential VS reactivity to positive versus negative feedback is negatively associated with the lifestyle facet. There was suggestive evidence for gender-specific patterns of association between brain function and psychopathy facets. Our findings are the first to document differential associations between both threat- and reward-related neural processes and distinct facets of psychopathy and thus provide a more comprehensive picture of the pattern of neural vulnerabilities that may predispose to maladaptive outcomes associated with psychopathy.

  7. Reward-related neural responses are dependent on the beneficiary.

    PubMed

    Braams, Barbara R; Güroğlu, Berna; de Water, Erik; Meuwese, Rosa; Koolschijn, P Cédric; Peper, Jiska S; Crone, Eveline A

    2014-07-01

    Prior studies have suggested that positive social interactions are experienced as rewarding. Yet, it is not well understood how social relationships influence neural responses to other persons' gains. In this study, we investigated neural responses during a gambling task in which healthy participants (N = 31; 18 females) could win or lose money for themselves, their best friend or a disliked other (antagonist). At the moment of receiving outcome, person-related activity was observed in the dorsal medial prefrontal cortex (dmPFC), precuneus and temporal parietal junction (TPJ), showing higher activity for friends and antagonists than for self, and this activity was independent of outcome. The only region showing an interaction between the person-participants played for and outcome was the ventral striatum. Specifically, the striatum was more active following gains than losses for self and friends, whereas for the antagonist this pattern was reversed. Together, these results show that, in a context with social and reward information, social aspects are processed in brain regions associated with social cognition (mPFC, TPJ), and reward aspects are processed in primary reward areas (striatum). Furthermore, there is an interaction of social and reward information in the striatum, such that reward-related activity was dependent on social relationship. © The Author (2013). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  8. Striatal activation and frontostriatal connectivity during non-drug reward anticipation in alcohol dependence.

    PubMed

    Becker, Alena; Kirsch, Martina; Gerchen, Martin Fungisai; Kiefer, Falk; Kirsch, Peter

    2017-05-01

    According to prevailing neurobiological theories of addiction, altered function in neural reward circuitry is a central mechanism of alcohol dependence. Growing evidence postulates that the ventral striatum (VS), as well as areas of the prefrontal cortex, contribute to the increased incentive salience of alcohol-associated cues, diminished motivation to pursue non-drug rewards and weakened strength of inhibitory cognitive control, which are central to addiction. The present study aims to investigate the neural response and functional connectivity underlying monetary, non-drug reward processing in alcohol dependence. We utilized a reward paradigm to investigate the anticipation of monetary reward in 32 alcohol-dependent inpatients and 35 healthy controls. Functional magnetic resonance imaging was used to measure task-related brain activation and connectivity. Alcohol-dependent patients showed increased activation of the VS during anticipation of monetary gain compared with healthy controls. Generalized psychophysiological interaction analyses revealed decreased functional connectivity between the VS and the dorsolateral prefrontal cortex in alcohol dependent patients relative to controls. Increased activation of the VS and reduced frontostriatal connectivity were associated with increased craving. These findings provide evidence that alcohol dependence is rather associated with disrupted integration of striatal and prefrontal processes than with a global reward anticipation deficit. © 2016 Society for the Study of Addiction.

  9. A balance of activity in brain control and reward systems predicts self-regulatory outcomes

    PubMed Central

    Chen, Pin-Hao A.; Huckins, Jeremy F.; Hofmann, Wilhelm; Kelley, William M.; Heatherton, Todd F.

    2017-01-01

    Abstract Previous neuroimaging work has shown that increased reward-related activity following exposure to food cues is predictive of self-control failure. The balance model suggests that self-regulation failures result from an imbalance in reward and executive control mechanisms. However, an open question is whether the relative balance of activity in brain systems associated with executive control (vs reward) supports self-regulatory outcomes when people encounter tempting cues in daily life. Sixty-nine chronic dieters, a population known for frequent lapses in self-control, completed a food cue-reactivity task during an fMRI scanning session, followed by a weeklong sampling of daily eating behaviors via ecological momentary assessment. We related participants’ food cue activity in brain systems associated with executive control and reward to real-world eating patterns. Specifically, a balance score representing the amount of activity in brain regions associated with self-regulatory control, relative to automatic reward-related activity, predicted dieters’ control over their eating behavior during the following week. This balance measure may reflect individual self-control capacity and be useful for examining self-regulation success in other domains and populations. PMID:28158874

  10. A balance of activity in brain control and reward systems predicts self-regulatory outcomes.

    PubMed

    Lopez, Richard B; Chen, Pin-Hao A; Huckins, Jeremy F; Hofmann, Wilhelm; Kelley, William M; Heatherton, Todd F

    2017-05-01

    Previous neuroimaging work has shown that increased reward-related activity following exposure to food cues is predictive of self-control failure. The balance model suggests that self-regulation failures result from an imbalance in reward and executive control mechanisms. However, an open question is whether the relative balance of activity in brain systems associated with executive control (vs reward) supports self-regulatory outcomes when people encounter tempting cues in daily life. Sixty-nine chronic dieters, a population known for frequent lapses in self-control, completed a food cue-reactivity task during an fMRI scanning session, followed by a weeklong sampling of daily eating behaviors via ecological momentary assessment. We related participants' food cue activity in brain systems associated with executive control and reward to real-world eating patterns. Specifically, a balance score representing the amount of activity in brain regions associated with self-regulatory control, relative to automatic reward-related activity, predicted dieters' control over their eating behavior during the following week. This balance measure may reflect individual self-control capacity and be useful for examining self-regulation success in other domains and populations. © The Author (2017). Published by Oxford University Press.

  11. Addiction: decreased reward sensitivity and increased expectation sensitivity conspire to overwhelm the brain's control circuit.

    PubMed

    Volkow, Nora D; Wang, Gene-Jack; Fowler, Joanna S; Tomasi, Dardo; Telang, Frank; Baler, Ruben

    2010-09-01

    Based on brain imaging findings, we present a model according to which addiction emerges as an imbalance in the information processing and integration among various brain circuits and functions. The dysfunctions reflect (a) decreased sensitivity of reward circuits, (b) enhanced sensitivity of memory circuits to conditioned expectations to drugs and drug cues, stress reactivity, and (c) negative mood, and a weakened control circuit. Although initial experimentation with a drug of abuse is largely a voluntary behavior, continued drug use can eventually impair neuronal circuits in the brain that are involved in free will, turning drug use into an automatic compulsive behavior. The ability of addictive drugs to co-opt neurotransmitter signals between neurons (including dopamine, glutamate, and GABA) modifies the function of different neuronal circuits, which begin to falter at different stages of an addiction trajectory. Upon exposure to the drug, drug cues or stress this results in unrestrained hyperactivation of the motivation/drive circuit that results in the compulsive drug intake that characterizes addiction.

  12. Probabilistic co-adaptive brain-computer interfacing

    NASA Astrophysics Data System (ADS)

    Bryan, Matthew J.; Martin, Stefan A.; Cheung, Willy; Rao, Rajesh P. N.

    2013-12-01

    Objective. Brain-computer interfaces (BCIs) are confronted with two fundamental challenges: (a) the uncertainty associated with decoding noisy brain signals, and (b) the need for co-adaptation between the brain and the interface so as to cooperatively achieve a common goal in a task. We seek to mitigate these challenges. Approach. We introduce a new approach to brain-computer interfacing based on partially observable Markov decision processes (POMDPs). POMDPs provide a principled approach to handling uncertainty and achieving co-adaptation in the following manner: (1) Bayesian inference is used to compute posterior probability distributions (‘beliefs’) over brain and environment state, and (2) actions are selected based on entire belief distributions in order to maximize total expected reward; by employing methods from reinforcement learning, the POMDP’s reward function can be updated over time to allow for co-adaptive behaviour. Main results. We illustrate our approach using a simple non-invasive BCI which optimizes the speed-accuracy trade-off for individual subjects based on the signal-to-noise characteristics of their brain signals. We additionally demonstrate that the POMDP BCI can automatically detect changes in the user’s control strategy and can co-adaptively switch control strategies on-the-fly to maximize expected reward. Significance. Our results suggest that the framework of POMDPs offers a promising approach for designing BCIs that can handle uncertainty in neural signals and co-adapt with the user on an ongoing basis. The fact that the POMDP BCI maintains a probability distribution over the user’s brain state allows a much more powerful form of decision making than traditional BCI approaches, which have typically been based on the output of classifiers or regression techniques. Furthermore, the co-adaptation of the system allows the BCI to make online improvements to its behaviour, adjusting itself automatically to the user’s changing circumstances.

  13. Complexity and Competition in Appetitive and Aversive Neural Circuits

    PubMed Central

    Barberini, Crista L.; Morrison, Sara E.; Saez, Alex; Lau, Brian; Salzman, C. Daniel

    2012-01-01

    Decision-making often involves using sensory cues to predict possible rewarding or punishing reinforcement outcomes before selecting a course of action. Recent work has revealed complexity in how the brain learns to predict rewards and punishments. Analysis of neural signaling during and after learning in the amygdala and orbitofrontal cortex, two brain areas that process appetitive and aversive stimuli, reveals a dynamic relationship between appetitive and aversive circuits. Specifically, the relationship between signaling in appetitive and aversive circuits in these areas shifts as a function of learning. Furthermore, although appetitive and aversive circuits may often drive opposite behaviors – approaching or avoiding reinforcement depending upon its valence – these circuits can also drive similar behaviors, such as enhanced arousal or attention; these processes also may influence choice behavior. These data highlight the formidable challenges ahead in dissecting how appetitive and aversive neural circuits interact to produce a complex and nuanced range of behaviors. PMID:23189037

  14. The neuroscience of investing: fMRI of the reward system.

    PubMed

    Peterson, Richard L

    2005-11-15

    Functional magnetic resonance imaging (fMRI) has proven a useful tool for observing neural BOLD signal changes during complex cognitive and emotional tasks. Yet the meaning and applicability of the fMRI data being gathered is still largely unknown. The brain's reward system underlies the fundamental neural processes of goal evaluation, preference formation, positive motivation, and choice behavior. fMRI technology allows researchers to dynamically visualize reward system processes. Experimenters can then correlate reward system BOLD activations with experimental behavior from carefully controlled experiments. In the SPAN lab at Stanford University, directed by Brian Knutson Ph.D., researchers have been using financial tasks during fMRI scanning to correlate emotion, behavior, and cognition with the reward system's fundamental neural activations. One goal of the SPAN lab is the development of predictive models of behavior. In this paper we extrapolate our fMRI results toward understanding and predicting individual behavior in the uncertain and high-risk environment of the financial markets. The financial market price anomalies of "value versus glamour" and "momentum" may be real-world examples of reward system activation biasing collective behavior. On the individual level, the investor's bias of overconfidence may similarly be related to reward system activation. We attempt to understand selected "irrational" investor behaviors and anomalous financial market price patterns through correlations with findings from fMRI research of the reward system.

  15. When theory and biology differ: The relationship between reward prediction errors and expectancy.

    PubMed

    Williams, Chad C; Hassall, Cameron D; Trska, Robert; Holroyd, Clay B; Krigolson, Olave E

    2017-10-01

    Comparisons between expectations and outcomes are critical for learning. Termed prediction errors, the violations of expectancy that occur when outcomes differ from expectations are used to modify value and shape behaviour. In the present study, we examined how a wide range of expectancy violations impacted neural signals associated with feedback processing. Participants performed a time estimation task in which they had to guess the duration of one second while their electroencephalogram was recorded. In a key manipulation, we varied task difficulty across the experiment to create a range of different feedback expectancies - reward feedback was either very expected, expected, 50/50, unexpected, or very unexpected. As predicted, the amplitude of the reward positivity, a component of the human event-related brain potential associated with feedback processing, scaled inversely with expectancy (e.g., unexpected feedback yielded a larger reward positivity than expected feedback). Interestingly, the scaling of the reward positivity to outcome expectancy was not linear as would be predicted by some theoretical models. Specifically, we found that the amplitude of the reward positivity was about equivalent for very expected and expected feedback, and for very unexpected and unexpected feedback. As such, our results demonstrate a sigmoidal relationship between reward expectancy and the amplitude of the reward positivity, with interesting implications for theories of reinforcement learning. Copyright © 2017 Elsevier B.V. All rights reserved.

  16. Homeostatic reinforcement learning for integrating reward collection and physiological stability.

    PubMed

    Keramati, Mehdi; Gutkin, Boris

    2014-12-02

    Efficient regulation of internal homeostasis and defending it against perturbations requires adaptive behavioral strategies. However, the computational principles mediating the interaction between homeostatic and associative learning processes remain undefined. Here we use a definition of primary rewards, as outcomes fulfilling physiological needs, to build a normative theory showing how learning motivated behaviors may be modulated by internal states. Within this framework, we mathematically prove that seeking rewards is equivalent to the fundamental objective of physiological stability, defining the notion of physiological rationality of behavior. We further suggest a formal basis for temporal discounting of rewards by showing that discounting motivates animals to follow the shortest path in the space of physiological variables toward the desired setpoint. We also explain how animals learn to act predictively to preclude prospective homeostatic challenges, and several other behavioral patterns. Finally, we suggest a computational role for interaction between hypothalamus and the brain reward system.

  17. "Liking" and "wanting" linked to Reward Deficiency Syndrome (RDS): hypothesizing differential responsivity in brain reward circuitry.

    PubMed

    Blum, Kenneth; Gardner, Eliot; Oscar-Berman, Marlene; Gold, Mark

    2012-01-01

    In an attempt to resolve controversy regarding the causal contributions of mesolimbic dopamine (DA) systems to reward, we evaluate the three main competing explanatory categories: "liking,"learning," and "wanting" [1]. That is, DA may mediate (a) the hedonic impact of reward (liking), (b) learned predictions about rewarding effects (learning), or (c) the pursuit of rewards by attributing incentive salience to reward-related stimuli (wanting). We evaluate these hypotheses, especially as they relate to the Reward Deficiency Syndrome (RDS), and we find that the incentive salience or "wanting" hypothesis of DA function is supported by a majority of the evidence. Neuroimaging studies have shown that drugs of abuse, palatable foods, and anticipated behaviors such as sex and gaming affect brain regions involving reward circuitry, and may not be unidirectional. Drugs of abuse enhance DA signaling and sensitize mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Addictive drugs have in common that they are voluntarily selfadministered, they enhance (directly or indirectly) dopaminergic synaptic function in the nucleus accumbens (NAC), and they stimulate the functioning of brain reward circuitry (producing the "high" that drug users seek). Although originally believed simply to encode the set point of hedonic tone, these circuits now are believed to be functionally more complex, also encoding attention, reward expectancy, disconfirmation of reward expectancy, and incentive motivation. Elevated stress levels, together with polymorphisms of dopaminergic genes and other neurotransmitter genetic variants, may have a cumulative effect on vulnerability to addiction. The RDS model of etiology holds very well for a variety of chemical and behavioral addictions.

  18. Baby schema modulates the brain reward system in nulliparous women.

    PubMed

    Glocker, Melanie L; Langleben, Daniel D; Ruparel, Kosha; Loughead, James W; Valdez, Jeffrey N; Griffin, Mark D; Sachser, Norbert; Gur, Ruben C

    2009-06-02

    Ethologist Konrad Lorenz defined the baby schema ("Kindchenschema") as a set of infantile physical features, such as round face and big eyes, that is perceived as cute and motivates caretaking behavior in the human, with the evolutionary function of enhancing offspring survival. The neural basis of this fundamental altruistic instinct is not well understood. Prior studies reported a pattern of brain response to pictures of children, but did not dissociate the brain response to baby schema from the response to children. Using functional magnetic resonance imaging and controlled manipulation of the baby schema in infant faces, we found that baby schema activates the nucleus accumbens, a key structure of the mesocorticolimbic system mediating reward processing and appetitive motivation, in nulliparous women. Our findings suggest that engagement of the mesocorticolimbic system is the neurophysiologic mechanism by which baby schema promotes human caregiving, regardless of kinship.

  19. Impact of socio-emotional context, brain development, and pubertal maturation on adolescent risk-taking.

    PubMed

    Smith, Ashley R; Chein, Jason; Steinberg, Laurence

    2013-07-01

    While there is little doubt that risk-taking is generally more prevalent during adolescence than before or after, the underlying causes of this pattern of age differences have long been investigated and debated. One longstanding popular notion is the belief that risky and reckless behavior in adolescence is tied to the hormonal changes of puberty. However, the interactions between pubertal maturation and adolescent decision making remain largely understudied. In the current review, we discuss changes in decision making during adolescence, focusing on the asynchronous development of the affective, reward-focused processing system and the deliberative, reasoned processing system. As discussed, differential maturation in the structure and function of brain systems associated with these systems leaves adolescents particularly vulnerable to socio-emotional influences and risk-taking behaviors. We argue that this asynchrony may be partially linked to pubertal influences on development and specifically on the maturation of the affective, reward-focused processing system. Copyright © 2013 Elsevier Inc. All rights reserved.

  20. Dysfunctional insular connectivity during reward prediction in patients with first-episode psychosis

    PubMed Central

    Schmidt, André; Palaniyappan, Lena; Smieskova, Renata; Simon, Andor; Riecher-Rössler, Anita; Lang, Undine E.; Fusar-Poli, Paolo; McGuire, Philip; Borgwardt, Stefan J.

    2016-01-01

    Background Increasing evidence indicates that psychosis is associated with abnormal reward processing. Imaging studies in patients with first-episode psychosis (FEP) have revealed reduced activity in diverse brain regions, including the ventral striatum, insula and anterior cingulate cortex (ACC), during reward prediction. However, whether these reductions in local brain activity are due to altered connectivity has rarely been explored. Methods We applied dynamic causal modelling and Bayesian model selection to fMRI data during the Salience Attribution Task to investigate whether patients with FEP showed abnormal modulation of connectivity between the ventral striatum, insula and ACC induced by rewarding cues and whether these changes were related to positive psychotic symptoms and atypical antipsychotic medication. Results The model including reward-induced modulation of insula–ACC connectivity was the best fitting model in each group. Compared with healthy controls (n = 19), patients with FEP (n = 29) revealed reduced right insula–ACC connectivity. After subdividing patients according to current antipsychotic medication, we found that the reduced insula–ACC connectivity relative to healthy controls was observed only in untreated patients (n = 17), not in patients treated with antipsychotics (n = 12), and that it correlated negatively with unusual thought content in untreated patients with FEP. Limitations The modest sample size of untreated patients with FEP was a limitation of our study. Conclusion This study indicates that insula–ACC connectivity during reward prediction is reduced in untreated patients with FEP and related to the formation of positive psychotic symptoms. Our study further suggests that atypical antipsychotics may reverse connectivity between the insula and the ACC during reward prediction. PMID:26854756

  1. Reward Contingencies Improve Goal-Directed Behavior by Enhancing Posterior Brain Attentional Regions and Increasing Corticostriatal Connectivity in Cocaine Addicts.

    PubMed

    Rosell-Negre, Patricia; Bustamante, Juan-Carlos; Fuentes-Claramonte, Paola; Costumero, Víctor; Llopis-Llacer, Juan-José; Barrós-Loscertales, Alfonso

    2016-01-01

    The dopaminergic system provides the basis for the interaction between motivation and cognition. It is triggered by the possibility of obtaining rewards to initiate the neurobehavioral adaptations necessary to achieve them by directing the information from motivational circuits to cognitive and action circuits. In drug addiction, the altered dopamine (DA) modulation of the meso-cortico-limbic reward circuitry, such as the prefrontal cortex (PFC), underlies the disproportionate motivational value of drug use at the expense of other non-drug reinforcers and the user's loss of control over his/her drug intake. We examine how the magnitude of the reward affects goal-directed processes in healthy control (HC) subjects and abstinent cocaine dependent (ACD) patients by using functional magnetic resonance imaging (fMRI) during a counting Stroop task with blocked levels of monetary incentives of different magnitudes (€0, €0.01, €0.5, €1 or €1.5). Our results showed that increasing reward magnitude enhances (1) performance facilitation in both groups; (2) left dorsolateral prefrontal cortex (DLPFC) activity in HC and left superior occipital cortex activity in ACD; and (3) left DLPFC and left putamen connectivity in ACD compared to HC. Moreover, we observed that (4) dorsal striatal and pallidum activity was associated with craving and addiction severity during the parametric increases in the monetary reward. In conclusion, the brain response to gradients in monetary value was different in HC and ACD, but both groups showed improved task performance due to the possibility of obtaining greater monetary rewards.

  2. Reward Contingencies Improve Goal-Directed Behavior by Enhancing Posterior Brain Attentional Regions and Increasing Corticostriatal Connectivity in Cocaine Addicts

    PubMed Central

    Rosell-Negre, Patricia; Bustamante, Juan-Carlos; Fuentes-Claramonte, Paola; Costumero, Víctor; Llopis-Llacer, Juan-José; Barrós-Loscertales, Alfonso

    2016-01-01

    The dopaminergic system provides the basis for the interaction between motivation and cognition. It is triggered by the possibility of obtaining rewards to initiate the neurobehavioral adaptations necessary to achieve them by directing the information from motivational circuits to cognitive and action circuits. In drug addiction, the altered dopamine (DA) modulation of the meso-cortico-limbic reward circuitry, such as the prefrontal cortex (PFC), underlies the disproportionate motivational value of drug use at the expense of other non-drug reinforcers and the user’s loss of control over his/her drug intake. We examine how the magnitude of the reward affects goal-directed processes in healthy control (HC) subjects and abstinent cocaine dependent (ACD) patients by using functional magnetic resonance imaging (fMRI) during a counting Stroop task with blocked levels of monetary incentives of different magnitudes (€0, €0.01, €0.5, €1 or €1.5). Our results showed that increasing reward magnitude enhances (1) performance facilitation in both groups; (2) left dorsolateral prefrontal cortex (DLPFC) activity in HC and left superior occipital cortex activity in ACD; and (3) left DLPFC and left putamen connectivity in ACD compared to HC. Moreover, we observed that (4) dorsal striatal and pallidum activity was associated with craving and addiction severity during the parametric increases in the monetary reward. In conclusion, the brain response to gradients in monetary value was different in HC and ACD, but both groups showed improved task performance due to the possibility of obtaining greater monetary rewards. PMID:27907134

  3. Dopamine modulates striatal response to reward and punishment in patients with Parkinson's disease: a pharmacological challenge fMRI study.

    PubMed

    Argyelan, Miklos; Herzallah, Mohammad; Sako, Wataru; DeLucia, Ivana; Sarpal, Deepak; Vo, An; Fitzpatrick, Toni; Moustafa, Ahmed A; Eidelberg, David; Gluck, Mark

    2018-05-02

    It is well established that Parkinson's disease leads to impaired learning from reward and enhanced learning from punishment. The administration of dopaminergic medications reverses this learning pattern. However, few studies have investigated the neural underpinnings of these cognitive processes. In this study, using fMRI, we tested a group of Parkinson's disease patients on and off dopaminergic medications and matched healthy individuals. All individuals completed an fMRI cognitive task that dissociates feedback learning from reward versus punishment. The administration of dopaminergic medications attenuated blood oxygen level dependent (BOLD) responses to punishment in the bilateral putamen, in bilateral dorsolateral prefrontal cortex and the left premotor cortex. Further, the administration of dopaminergic medications resulted in a higher ratio of BOLD activity between reward and punishment trials in these brain areas. BOLD activity in these brain areas was significantly correlated with learning from punishment, but not from reward trials. Furthermore, the administration of dopaminergic medications altered BOLD activity in the right insula and ventromedial prefrontal cortex when Parkinson's disease patients were anticipating feedback. These findings are in agreement with a large body of literature indicating that Parkinson's disease is associated with enhanced learning from punishment. However, it was surprising that dopaminergic medications modulated punishment learning as opposed to reward learning, although reward learning has been directly linked to dopaminergic function. We argue that these results might be attributed to both a change in the balance between direct and indirect pathway activation in the basal ganglia as well as the differential activity of D1 versus D2 dopamine receptors.

  4. A unified selection signal for attention and reward in primary visual cortex.

    PubMed

    Stănişor, Liviu; van der Togt, Chris; Pennartz, Cyriel M A; Roelfsema, Pieter R

    2013-05-28

    Stimuli associated with high rewards evoke stronger neuronal activity than stimuli associated with lower rewards in many brain regions. It is not well understood how these reward effects influence activity in sensory cortices that represent low-level stimulus features. Here, we investigated the effects of reward information in the primary visual cortex (area V1) of monkeys. We found that the reward value of a stimulus relative to the value of other stimuli is a good predictor of V1 activity. Relative value biases the competition between stimuli, just as has been shown for selective attention. The neuronal latency of this reward value effect in V1 was similar to the latency of attentional influences. Moreover, V1 neurons with a strong value effect also exhibited a strong attention effect, which implies that relative value and top-down attention engage overlapping, if not identical, neuronal selection mechanisms. Our findings demonstrate that the effects of reward value reach down to the earliest sensory processing levels of the cerebral cortex and imply that theories about the effects of reward coding and top-down attention on visual representations should be unified.

  5. Improved memory for reward cues following acute buprenorphine administration in humans.

    PubMed

    Syal, Supriya; Ipser, Jonathan; Terburg, David; Solms, Mark; Panksepp, Jaak; Malcolm-Smith, Susan; Bos, Peter A; Montoya, Estrella R; Stein, Dan J; van Honk, Jack

    2015-03-01

    In rodents, there is abundant evidence for the involvement of the opioid system in the processing of reward cues, but this system has remained understudied in humans. In humans, the happy facial expression is a pivotal reward cue. Happy facial expressions activate the brain's reward system and are disregarded by subjects scoring high on depressive mood who are low in reward drive. We investigated whether a single 0.2mg administration of the mixed mu-opioid agonist/kappa-antagonist, buprenorphine, would influence short-term memory for happy, angry or fearful expressions relative to neutral faces. Healthy human subjects (n38) participated in a randomized placebo-controlled within-subject design, and performed an emotional face relocation task after administration of buprenorphine and placebo. We show that, compared to placebo, buprenorphine administration results in a significant improvement of memory for happy faces. Our data demonstrate that acute manipulation of the opioid system by buprenorphine increases short-term memory for social reward cues. Copyright © 2015. Published by Elsevier Ltd.

  6. The neural basis of cultural differences in delay discounting

    PubMed Central

    Kim, Bokyung; Sung, Young Shin; McClure, Samuel M.

    2012-01-01

    People generally prefer to receive rewarding outcomes sooner rather than later. Such preferences result from delay discounting, or the process by which outcomes are devalued for the expected delay until their receipt. We investigated cultural differences in delay discounting by contrasting behaviour and brain activity in separate cohorts of Western (American) and Eastern (Korean) subjects. Consistent with previous reports, we find a dramatic difference in discounting behaviour, with Americans displaying much greater present bias and elevated discount rates. Recent neuroimaging findings suggest that differences in discounting may arise from differential involvement of either brain reward areas or regions in the prefrontal and parietal cortices associated with cognitive control. We find that the ventral striatum is more greatly recruited in Americans relative to Koreans when discounting future rewards, but there is no difference in prefrontal or parietal activity. This suggests that a cultural difference in emotional responsivity underlies the observed behavioural effect. We discuss the implications of this research for strategic interrelations between Easterners and Westerners. PMID:22271781

  7. Brain Stimulation Over the Frontopolar Cortex Enhances Motivation to Exert Effort for Reward.

    PubMed

    Soutschek, Alexander; Kang, Pyungwon; Ruff, Christian C; Hare, Todd A; Tobler, Philippe N

    2018-07-01

    Loss of motivation is a characteristic feature of several psychiatric and neurological disorders. However, the neural mechanisms underlying human motivation are far from being understood. Here, we investigate the role that the frontopolar cortex (FPC) plays in motivating cognitive and physical effort exertion by computing subjective effort equivalents. We manipulated neural processing with transcranial direct current stimulation targeting the FPC while 141 healthy participants decided whether or not to engage in cognitive or physical effort to obtain rewards. We found that brain stimulation targeting the FPC increased the amount of both types of effort participants were willing to exert for rewards. Our findings provide important insights into the neural mechanisms involved in motivating effortful behavior. Moreover, they suggest that considering the motivation-related activity of the FPC could facilitate the development of treatments for the loss of motivation commonly seen in psychiatric and other neurological disorders. Copyright © 2017 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

  8. The Dopamine Prediction Error: Contributions to Associative Models of Reward Learning

    PubMed Central

    Nasser, Helen M.; Calu, Donna J.; Schoenbaum, Geoffrey; Sharpe, Melissa J.

    2017-01-01

    Phasic activity of midbrain dopamine neurons is currently thought to encapsulate the prediction-error signal described in Sutton and Barto’s (1981) model-free reinforcement learning algorithm. This phasic signal is thought to contain information about the quantitative value of reward, which transfers to the reward-predictive cue after learning. This is argued to endow the reward-predictive cue with the value inherent in the reward, motivating behavior toward cues signaling the presence of reward. Yet theoretical and empirical research has implicated prediction-error signaling in learning that extends far beyond a transfer of quantitative value to a reward-predictive cue. Here, we review the research which demonstrates the complexity of how dopaminergic prediction errors facilitate learning. After briefly discussing the literature demonstrating that phasic dopaminergic signals can act in the manner described by Sutton and Barto (1981), we consider how these signals may also influence attentional processing across multiple attentional systems in distinct brain circuits. Then, we discuss how prediction errors encode and promote the development of context-specific associations between cues and rewards. Finally, we consider recent evidence that shows dopaminergic activity contains information about causal relationships between cues and rewards that reflect information garnered from rich associative models of the world that can be adapted in the absence of direct experience. In discussing this research we hope to support the expansion of how dopaminergic prediction errors are thought to contribute to the learning process beyond the traditional concept of transferring quantitative value. PMID:28275359

  9. Neuroimaging the neural correlates of increased risk for substance use disorders in attention-deficit/hyperactivity disorder-A systematic review.

    PubMed

    Adisetiyo, Vitria; Gray, Kevin M

    2017-03-01

    Children with attention-deficit/hyperactivity disorder (ADHD) are nearly three times more likely to develop substance use disorders (SUD) than their typically developing peers. Our objective was to review the existing neuroimaging research on high-risk ADHD (ie, ADHD with disruptive behavior disorders, familial SUD and/or early substance use), focusing on impulsivity as one possible mechanism underlying SUD risk. A PubMed literature search was conducted using combinations of the keywords "ADHD," "substance use," "substance use disorder," "SUD," "addiction," "dependence," "abuse," "risk," "brain" "MRI," "imaging" and "neuroimaging." Studies had to include cohorts that met diagnostic criteria for ADHD; studies of individuals with ADHD who all met criteria for SUD were excluded. Eight studies met the search criteria. Individuals with high-risk ADHD have hyperactivation in the motivation-reward processing brain network during tasks of impulsive choice, emotion processing, and risky decision-making. During response inhibition tasks, they have hypoactivation in the inhibitory control brain network. However, studies focusing on this latter circuit found hypoactivation during inhibitory control tasks, decreased white matter microstructure coherence and reduced cortical thickness in ADHD independent of substance use history. An exaggerated imbalance between the inhibitory control network and the motivation-reward processing network is theorized to distinguish individuals with high-risk ADHD. Preliminary findings suggest that an exaggerated aberrant reward processing network may be the driving neural correlate of increased SUD risk in ADHD. Neural biomarkers of increased SUD risk in ADHD could help clinicians identify which patients may benefit most from SUD prevention. Thus, more neuroimaging research on this vulnerable population is needed. (Am J Addict 2017;26:99-111). © 2017 American Academy of Addiction Psychiatry.

  10. Heterogeneity of reward mechanisms.

    PubMed

    Lajtha, A; Sershen, H

    2010-06-01

    The finding that many drugs that have abuse potential and other natural stimuli such as food or sexual activity cause similar chemical changes in the brain, an increase in extracellular dopamine (DA) in the shell of the nucleus accumbens (NAccS), indicated some time ago that the reward mechanism is at least very similar for all stimuli and that the mechanism is relatively simple. The presently available information shows that the mechanisms involved are more complex and have multiple elements. Multiple brain regions, multiple receptors, multiple distinct neurons, multiple transmitters, multiple transporters, circuits, peptides, proteins, metabolism of transmitters, and phosphorylation, all participate in reward mechanisms. The system is variable, is changed during development, is sex-dependent, and is influenced by genetic differences. Not all of the elements participate in the reward of all stimuli. Different set of mechanisms are involved in the reward of different drugs of abuse, yet different mechanisms in the reward of natural stimuli such as food or sexual activity; thus there are different systems that distinguish different stimuli. Separate functions of the reward system such as anticipation, evaluation, consummation and identification; all contain function-specific elements. The level of the stimulus also influences the participation of the elements of the reward system, there are possible reactions to even below threshold stimuli, and excessive stimuli can change reward to aversion involving parts of the system. Learning and memory of past reward is an important integral element of reward and addictive behavior. Many of the reward elements are altered by repeated or chronic stimuli, and chronic exposure to one drug is likely to alter the response to another stimulus. To evaluate and identify the reward stimulus thus requires heterogeneity of the reward components in the brain.

  11. Dopamine in motivational control: rewarding, aversive, and alerting

    PubMed Central

    Bromberg-Martin, Ethan S.; Matsumoto, Masayuki; Hikosaka, Okihide

    2010-01-01

    SUMMARY Midbrain dopamine neurons are well known for their strong responses to rewards and their critical role in positive motivation. It has become increasingly clear, however, that dopamine neurons also transmit signals related to salient but non-rewarding experiences such as aversive and alerting events. Here we review recent advances in understanding the reward and non-reward functions of dopamine. Based on this data, we propose that dopamine neurons come in multiple types that are connected with distinct brain networks and have distinct roles in motivational control. Some dopamine neurons encode motivational value, supporting brain networks for seeking, evaluation, and value learning. Others encode motivational salience, supporting brain networks for orienting, cognition, and general motivation. Both types of dopamine neurons are augmented by an alerting signal involved in rapid detection of potentially important sensory cues. We hypothesize that these dopaminergic pathways for value, salience, and alerting cooperate to support adaptive behavior. PMID:21144997

  12. Utilization of reward-prospect enhances preparatory attention and reduces stimulus conflict.

    PubMed

    van den Berg, Berry; Krebs, Ruth M; Lorist, Monicque M; Woldorff, Marty G

    2014-06-01

    The prospect of gaining money is an incentive widely at play in the real world. Such monetary motivation might have particularly strong influence when the cognitive system is challenged, such as when needing to process conflicting stimulus inputs. Here, we employed manipulations of reward-prospect and attentional-preparation levels in a cued-Stroop stimulus conflict task, along with the high temporal resolution of electrical brain recordings, to provide insight into the mechanisms by which reward-prospect and attention interact and modulate cognitive task performance. In this task, the cue indicated whether or not the participant needed to prepare for an upcoming Stroop stimulus and, if so, whether there was the potential for monetary reward (dependent on performance on that trial). Both cued attention and cued reward-prospect enhanced preparatory neural activity, as reflected by increases in the hallmark attention-related negative-polarity ERP slow wave (contingent negative variation [CNV]) and reductions in oscillatory Alpha activity, which was followed by enhanced processing of the subsequent Stroop stimulus. In addition, similar modulations of preparatory neural activity (larger CNVs and reduced Alpha) predicted shorter versus longer response times (RTs) to the subsequent target stimulus, consistent with such modulations reflecting trial-to-trial variations in attention. Particularly striking were the individual differences in the utilization of reward-prospect information. In particular, the size of the reward effects on the preparatory neural activity correlated across participants with the degree to which reward-prospect both facilitated overall task performance (shorter RTs) and reduced conflict-related behavioral interference. Thus, the prospect of reward appears to recruit attentional preparation circuits to enhance processing of task-relevant target information.

  13. Increased ventral striatal BOLD activity during non-drug reward anticipation in cannabis users.

    PubMed

    Nestor, Liam; Hester, Robert; Garavan, Hugh

    2010-01-01

    Despite an increased understanding of the pharmacology and long-term cognitive effects of cannabis in humans, there has been no research to date examining its chronic effects upon reward processing in the brain. Motivational theories regarding long-term drug use posit contrasting predictions with respect to how drug users are likely to process non-drug incentives. The reward deficiency syndrome (RDS) of addiction posits that there are deficits in dopamine (DA) motivational circuitry for non-drug rewards, such that only drugs of abuse are capable of normalizing DA in the ventral striatum (VS). Alternatively, the opponent process theory (OPT) holds that in individuals prone to drug use, there exists some form of mesolimbic hyperactivity, in which there is a bias towards reward-centred behaviour concomitant with impulsivity. The current study examined BOLD responses during reward and loss anticipation and their outcome deliveries in 14 chronic cannabis users and 14 drug-naive controls during a monetary incentive delay (MID) task. Despite no significant behavioural differences between the two groups, cannabis users had significantly more right VS BOLD activity during reward anticipation. Correlation analyses demonstrated that this right VS BOLD response was significantly correlated with life-time use and reported life-time cannabis joints consumed. No correlations between cannabis abstinence and BOLD responses were observed. We also observed a number of group differences following outcome deliveries, most notably hypoactivity in the left insula cortex in response to loss and loss avoidance outcome notifications in the cannabis group. These results may suggest hypersensitivity during instrumental response anticipation for non-drug rewards and a hyposensitivity to loss outcomes in chronic cannabis users; the implications of which are discussed with respect to the potentially sensitizing effects of cannabis for other rewards.

  14. Utilization of reward-prospect enhances preparatory attention and reduces stimulus conflict

    PubMed Central

    van den Berg, Berry; Krebs, Ruth M.; Lorist, Monicque M.; Woldorff, Marty G.

    2015-01-01

    The prospect of gaining money is an incentive widely at play in the real world. Such monetary motivation might have particularly strong influence when the cognitive system is challenged, such as when needing to process conflicting stimulus inputs. Here, we employed manipulations of reward-prospect and attentional-preparation levels in a cued-Stroop stimulus-conflict task, along with the high temporal resolution of electrical brain recordings, to provide insight into the mechanisms by which reward-prospect and attention interact and modulate cognitive-task performance. In this task the cue indicated whether or not the subject needed to prepare for an upcoming Stroop stimulus, and if so, whether there was the potential for monetary reward (dependent on performance on that trial). Both cued-attention and cued-reward-prospect enhanced preparatory neural activity, as reflected by increases in the hallmark attention-related negative-polarity ERP slow wave (CNV) and reductions in oscillatory Alpha activity, which was followed by enhanced processing of the subsequent Stroop stimulus. In addition, similar modulations of preparatory neural activity (larger CNVs and reduced Alpha) predicted faster versus slower response times (RTs) to the subsequent target stimulus, consistent with such modulations reflecting trial-to-trial variations in attention. Particularly striking were the individual differences in the utilization of reward-prospect information. In particular, the size of the reward effects on the preparatory neural activity correlated across-subjects with the degree to which reward-prospect both facilitated overall task performance (faster RTs) and reduced conflict-related behavioral interference. Thus, the prospect of reward appears to recruit attentional preparation circuits to enhance processing of task-relevant target information. PMID:24820263

  15. Attenuation of Frontostriatal Connectivity During Reward Processing Predicts Response to Psychotherapy in Major Depressive Disorder.

    PubMed

    Walsh, Erin; Carl, Hannah; Eisenlohr-Moul, Tory; Minkel, Jared; Crowther, Andrew; Moore, Tyler; Gibbs, Devin; Petty, Chris; Bizzell, Josh; Smoski, Moria J; Dichter, Gabriel S

    2017-03-01

    There are few reliable predictors of response to antidepressant treatments. In the present investigation, we examined pretreatment functional brain connectivity during reward processing as a potential predictor of response to Behavioral Activation Treatment for Depression (BATD), a validated psychotherapy that promotes engagement with rewarding stimuli and reduces avoidance behaviors. Thirty-three outpatients with major depressive disorder (MDD) and 20 matched controls completed two runs of the monetary incentive delay task during functional magnetic resonance imaging after which participants with MDD received up to 15 sessions of BATD. Seed-based generalized psychophysiological interaction analyses focused on task-based connectivity across task runs, as well as the attenuation of connectivity from the first to the second run of the task. The average change in Beck Depression Inventory-II scores due to treatment was 10.54 points, a clinically meaningful response. Groups differed in seed-based functional connectivity among multiple frontostriatal regions. Hierarchical linear modeling revealed that improved treatment response to BATD was predicted by greater connectivity between the left putamen and paracingulate gyrus during reward anticipation. In addition, MDD participants with greater attenuation of connectivity between several frontostriatal seeds, and midline subcallosal cortex and left paracingulate gyrus demonstrated improved response to BATD. These findings indicate that pretreatment frontostriatal functional connectivity during reward processing is predictive of response to a psychotherapy modality that promotes improving approach-related behaviors in MDD. Furthermore, connectivity attenuation among reward-processing regions may be a particularly powerful endophenotypic predictor of response to BATD in MDD.

  16. Reward-Related Dorsal Striatal Activity Differences between Former and Current Cocaine Dependent Individuals during an Interactive Competitive Game

    PubMed Central

    Hyatt, Christopher J.; Assaf, Michal; Muska, Christine E.; Rosen, Rivkah I.; Thomas, Andre D.; Johnson, Matthew R.; Hylton, Jennifer L.; Andrews, Melissa M.; Reynolds, Brady A.; Krystal, John H.; Potenza, Marc N.; Pearlson, Godfrey D.

    2012-01-01

    Cocaine addiction is characterized by impulsivity, impaired social relationships, and abnormal mesocorticolimbic reward processing, but their interrelationships relative to stages of cocaine addiction are unclear. We assessed blood-oxygenation-level dependent (BOLD) signal in ventral and dorsal striatum during functional magnetic resonance imaging (fMRI) in current (CCD; n = 30) and former (FCD; n = 28) cocaine dependent subjects as well as healthy control (HC; n = 31) subjects while playing an interactive competitive Domino game involving risk-taking and reward/punishment processing. Out-of-scanner impulsivity-related measures were also collected. Although both FCD and CCD subjects scored significantly higher on impulsivity-related measures than did HC subjects, only FCD subjects had differences in striatal activation, specifically showing hypoactivation during their response to gains versus losses in right dorsal caudate, a brain region linked to habituation, cocaine craving and addiction maintenance. Right caudate activity in FCD subjects also correlated negatively with impulsivity-related measures of self-reported compulsivity and sensitivity to reward. These findings suggest that remitted cocaine dependence is associated with striatal dysfunction during social reward processing in a manner linked to compulsivity and reward sensitivity measures. Future research should investigate the extent to which such differences might reflect underlying vulnerabilities linked to cocaine-using propensities (e.g., relapses). PMID:22606228

  17. Psychological processes in chronic pain: Influences of reward and fear learning as key mechanisms - Behavioral evidence, neural circuits, and maladaptive changes.

    PubMed

    Nees, Frauke; Becker, Susanne

    2017-09-07

    In the understanding of chronic pain, hypotheses derived from psychological theories, together with insights from physiological assessments and brain imaging, highlight the importance of mechanistically driven approaches. Physical system changes, for example following injury, can result in alterations of psychological processes and are accompanied by changes in corticolimbic circuits, which have been shown to be essential in emotional learning and memory, as well as reward processing and related behavior. In the present review, we thus highlight the importance of motivational, reward/pain relief, and fear learning processes in the context of chronic pain and discuss the potential of a mechanistic understanding of chronic pain within a clinical perspective, for example for the development of therapeutic strategies. We argue that changes in these mechanisms are not only characteristic for chronic pain, reflecting consequences of the disorder, but are also critically involved in the transition from acute to chronic pain states. Copyright © 2017 IBRO. Published by Elsevier Ltd. All rights reserved.

  18. Peers Increase Adolescent Risk Taking by Enhancing Activity in the Brain's Reward Circuitry

    ERIC Educational Resources Information Center

    Chein, Jason; Albert, Dustin; O'Brien, Lia; Uckert, Kaitlyn; Steinberg, Laurence

    2011-01-01

    The presence of peers increases risk taking among adolescents but not adults. We posited that the presence of peers may promote adolescent risk taking by sensitizing brain regions associated with the anticipation of potential rewards. Using fMRI, we measured brain activity in adolescents, young adults, and adults as they made decisions in a…

  19. Brain reward-system activation in response to anticipation and consumption of palatable food is altered by glucagon-like peptide-1 receptor activation in humans.

    PubMed

    van Bloemendaal, L; Veltman, D J; Ten Kulve, J S; Groot, P F C; Ruhé, H G; Barkhof, F; Sloan, J H; Diamant, M; Ijzerman, R G

    2015-09-01

    To test the hypothesis that food intake reduction after glucagon-like peptide-1 (GLP-1) receptor activation is mediated through brain areas regulating anticipatory and consummatory food reward. As part of a larger study, we determined the effects of GLP-1 receptor activation on brain responses to anticipation and receipt of chocolate milk versus a tasteless solution, using functional MRI (fMRI). Obese subjects with type 2 diabetes, and obese and lean subjects with normoglycaemia (n = 48) underwent three fMRI sessions at separate visits with intravenous infusion of the GLP-1 receptor agonist exenatide, exenatide with prior GLP-1 receptor blockade by exendin-9-39 or placebo, during somatostatin pituitary-pancreatic clamps. Body mass index negatively correlated with brain responses to receipt of chocolate milk and positively correlated with anticipation of receipt of chocolate milk in brain areas regulating reward, appetite and motivation. Exenatide increased brain responses to receipt of chocolate milk and decreased anticipation of receipt of chocolate milk compared with placebo, paralleled by reductions in food intake. Exendin-9-39 largely prevented these effects. Our findings show that GLP-1 receptor activation decreases anticipatory food reward, which may reduce cravings for food and increases consummatory food reward, which may prevent overeating. © 2015 John Wiley & Sons Ltd.

  20. “Liking” and “Wanting” Linked to Reward Deficiency Syndrome (RDS): Hypothesizing Differential Responsivity in Brain Reward Circuitry

    PubMed Central

    Blum, Kenneth; Gardner, Eliot; Oscar-Berman, Marlene; Gold, Mark

    2013-01-01

    In an attempt to resolve controversy regarding the causal contributions of mesolimbic dopamine (DA) systems to reward, we evaluate the three main competing explanatory categories: “liking,” “learning,” and “wanting” [1]. That is, DA may mediate (a) the hedonic impact of reward (liking), (b) learned predictions about rewarding effects (learning), or (c) the pursuit of rewards by attributing incentive salience to reward-related stimuli (wanting). We evaluate these hypotheses, especially as they relate to the Reward Deficiency Syndrome (RDS), and we find that the incentive salience or “wanting” hypothesis of DA function is supported by a majority of the evidence. Neuroimaging studies have shown that drugs of abuse, palatable foods, and anticipated behaviors such as sex and gaming affect brain regions involving reward circuitry, and may not be unidirectional. Drugs of abuse enhance DA signaling and sensitize mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Addictive drugs have in common that they are voluntarily self-administered, they enhance (directly or indirectly) dopaminergic synaptic function in the nucleus accumbens, and they stimulate the functioning of brain reward circuitry (producing the “high” that drug users seek). Although originally believed simply to encode the set point of hedonic tone, these circuits now are believed to be functionally more complex, also encoding attention, reward expectancy, disconfirmation of reward expectancy, and incentive motivation. Elevated stress levels, together with polymorphisms of dopaminergic genes and other neurotransmitter genetic variants, may have a cumulative effect on vulnerability to addiction. The RDS model of etiology holds very well for a variety of chemical and behavioral addictions. PMID:22236117

  1. A Selective Role for Dopamine in Learning to Maximize Reward But Not to Minimize Effort: Evidence from Patients with Parkinson's Disease.

    PubMed

    Skvortsova, Vasilisa; Degos, Bertrand; Welter, Marie-Laure; Vidailhet, Marie; Pessiglione, Mathias

    2017-06-21

    Instrumental learning is a fundamental process through which agents optimize their choices, taking into account various dimensions of available options such as the possible reward or punishment outcomes and the costs associated with potential actions. Although the implication of dopamine in learning from choice outcomes is well established, less is known about its role in learning the action costs such as effort. Here, we tested the ability of patients with Parkinson's disease (PD) to maximize monetary rewards and minimize physical efforts in a probabilistic instrumental learning task. The implication of dopamine was assessed by comparing performance ON and OFF prodopaminergic medication. In a first sample of PD patients ( n = 15), we observed that reward learning, but not effort learning, was selectively impaired in the absence of treatment, with a significant interaction between learning condition (reward vs effort) and medication status (OFF vs ON). These results were replicated in a second, independent sample of PD patients ( n = 20) using a simplified version of the task. According to Bayesian model selection, the best account for medication effects in both studies was a specific amplification of reward magnitude in a Q-learning algorithm. These results suggest that learning to avoid physical effort is independent from dopaminergic circuits and strengthen the general idea that dopaminergic signaling amplifies the effects of reward expectation or obtainment on instrumental behavior. SIGNIFICANCE STATEMENT Theoretically, maximizing reward and minimizing effort could involve the same computations and therefore rely on the same brain circuits. Here, we tested whether dopamine, a key component of reward-related circuitry, is also implicated in effort learning. We found that patients suffering from dopamine depletion due to Parkinson's disease were selectively impaired in reward learning, but not effort learning. Moreover, anti-parkinsonian medication restored the ability to maximize reward, but had no effect on effort minimization. This dissociation suggests that the brain has evolved separate, domain-specific systems for instrumental learning. These results help to disambiguate the motivational role of prodopaminergic medications: they amplify the impact of reward without affecting the integration of effort cost. Copyright © 2017 the authors 0270-6474/17/376087-11$15.00/0.

  2. Toward an autonomous brain machine interface: integrating sensorimotor reward modulation and reinforcement learning.

    PubMed

    Marsh, Brandi T; Tarigoppula, Venkata S Aditya; Chen, Chen; Francis, Joseph T

    2015-05-13

    For decades, neurophysiologists have worked on elucidating the function of the cortical sensorimotor control system from the standpoint of kinematics or dynamics. Recently, computational neuroscientists have developed models that can emulate changes seen in the primary motor cortex during learning. However, these simulations rely on the existence of a reward-like signal in the primary sensorimotor cortex. Reward modulation of the primary sensorimotor cortex has yet to be characterized at the level of neural units. Here we demonstrate that single units/multiunits and local field potentials in the primary motor (M1) cortex of nonhuman primates (Macaca radiata) are modulated by reward expectation during reaching movements and that this modulation is present even while subjects passively view cursor motions that are predictive of either reward or nonreward. After establishing this reward modulation, we set out to determine whether we could correctly classify rewarding versus nonrewarding trials, on a moment-to-moment basis. This reward information could then be used in collaboration with reinforcement learning principles toward an autonomous brain-machine interface. The autonomous brain-machine interface would use M1 for both decoding movement intention and extraction of reward expectation information as evaluative feedback, which would then update the decoding algorithm as necessary. In the work presented here, we show that this, in theory, is possible. Copyright © 2015 the authors 0270-6474/15/357374-14$15.00/0.

  3. Cumulative stress in childhood is associated with blunted reward-related brain activity in adulthood.

    PubMed

    Hanson, Jamie L; Albert, Dustin; Iselin, Anne-Marie R; Carré, Justin M; Dodge, Kenneth A; Hariri, Ahmad R

    2016-03-01

    Early life stress (ELS) is strongly associated with negative outcomes in adulthood, including reduced motivation and increased negative mood. The mechanisms mediating these relations, however, are poorly understood. We examined the relation between exposure to ELS and reward-related brain activity, which is known to predict motivation and mood, at age 26, in a sample followed since kindergarten with annual assessments. Using functional neuroimaging, we assayed individual differences in the activity of the ventral striatum (VS) during the processing of monetary rewards associated with a simple card-guessing task, in a sample of 72 male participants. We examined associations between a cumulative measure of ELS exposure and VS activity in adulthood. We found that greater levels of cumulative stress during childhood and adolescence predicted lower reward-related VS activity in adulthood. Extending this general developmental pattern, we found that exposure to stress early in development (between kindergarten and grade 3) was significantly associated with variability in adult VS activity. Our results provide an important demonstration that cumulative life stress, especially during this childhood period, is associated with blunted reward-related VS activity in adulthood. These differences suggest neurobiological pathways through which a history of ELS may contribute to reduced motivation and increased negative mood. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  4. Time and decision making: differential contribution of the posterior insular cortex and the striatum during a delay discounting task.

    PubMed

    Wittmann, Marc; Leland, David S; Paulus, Martin P

    2007-06-01

    Delay discounting refers to the fact that an immediate reward is valued more than the same reward if it occurs some time in the future. To examine the neural substrates underlying this process, we studied 13 healthy volunteers who repeatedly had to decide between an immediate and parametrically varied delayed hypothetical reward using a delay discounting task during event-related functional magnetic resonance imaging. Subject's preference judgments resulted in different discounting slopes for shorter (<1 year) and for longer (> or =1 year) delays. Neural activation associated with the shorter delays relative to the longer delays was associated with increased activation in the head of the left caudate nucleus and putamen. When individuals selected the delayed relative to the immediate reward, a strong activation was found in bilateral posterior insular cortex. Several brain areas including the left caudate nucleus showed a correlation between the behaviorally determined discounting and brain activation for the contrast of intervals with delays <1 and > or =1 year. These results suggest that (1) the posterior insula, which is a critical component of the decision-making neural network, is involved in delaying gratification and (2) the degree of neural activation in the striatum, which plays a fundamental role in reward prediction and in time estimation, may code for the time delay.

  5. When opportunity meets motivation: Neural engagement during social approach is linked to high approach motivation.

    PubMed

    Radke, Sina; Seidel, Eva-Maria; Eickhoff, Simon B; Gur, Ruben C; Schneider, Frank; Habel, Ute; Derntl, Birgit

    2016-02-15

    Social rewards are processed by the same dopaminergic-mediated brain networks as non-social rewards, suggesting a common representation of subjective value. Individual differences in personality and motivation influence the reinforcing value of social incentives, but it remains open whether the pursuit of social incentives is analogously supported by the neural reward system when positive social stimuli are connected to approach behavior. To test for a modulation of neural activation by approach motivation, individuals with high and low approach motivation (BAS) completed implicit and explicit social approach-avoidance paradigms during fMRI. High approach motivation was associated with faster implicit approach reactions as well as a trend for higher approach ratings, indicating increased approach tendencies. Implicit and explicit positive social approach was accompanied by stronger recruitment of the nucleus accumbens, middle cingulate cortex, and (pre-)cuneus for individuals with high compared to low approach motivation. These results support and extend prior research on social reward processing, self-other distinctions and affective judgments by linking approach motivation to the engagement of reward-related circuits during motivational reactions to social incentives. This interplay between motivational preferences and motivational contexts might underlie the rewarding experience during social interactions. Copyright © 2015 Elsevier Inc. All rights reserved.

  6. Parametric modulation of reward sequences during a reversal task in ACC and VMPFC but not amygdala and striatum.

    PubMed

    Becker, Michael P I; Nitsch, Alexander M; Hewig, Johannes; Miltner, Wolfgang H R; Straube, Thomas

    2016-12-01

    Several regions of the frontal cortex interact with striatal and amygdala regions to mediate the evaluation of reward-related information and subsequent adjustment of response choices. Recent theories discuss the particular relevance of dorsal anterior cingulate cortex (dACC) for switching behavior; consecutively, ventromedial prefrontal cortex (VMPFC) is involved in mediating exploitative behaviors by tracking reward values unfolding after the behavioral switch. Amygdala, on the other hand, has been implied in coding the valence of stimulus-outcome associations and the ventral striatum (VS) has consistently been shown to code a reward prediction error (RPE). Here, we used fMRI data acquired in humans during a reversal task to parametrically model different sequences of positive feedback in order to unravel differential contributions of these brain regions to the tracking and exploitation of rewards. Parameters from an Optimal Bayesian Learner accurately predicted the divergent involvement of dACC and VMPFC during feedback processing: dACC signaled the first, but not later, presentations of positive feedback, while VMPFC coded trial-by-trial accumulations in reward value. Our results confirm that dACC carries a prominent confirmatory signal during processing of first positive feedback. Amygdala coded positive feedbacks more uniformly, while striatal regions were associated with RPE. Copyright © 2016 Elsevier Inc. All rights reserved.

  7. Paralimbic system and striatum are involved in motivational behavior.

    PubMed

    Nishimura, Masahiko; Yoshii, Yoshihiko; Watanabe, Jobu; Ishiuchi, Shogo

    2009-10-28

    Goal-directed rewarded behavior and goal-directed non-rewarded behavior are concerned with motivation. However, the neural substrates involved in goal-directed non-rewarded behaviors are unknown. Using functional magnetic resonance imaging, we investigated the brain activities of healthy individuals during a novel tool use (turning a screwdriver) to elucidate the relationship between the brain mechanism relevant to goal-directed non-rewarded behavior and motivation. We found that our designed behavioral task evoked activities in the orbitofrontal cortex, striatum, anterior insula, lateral prefrontal cortex, and anterior cingulate cortex compared with a meaningless task. These results suggest that activation in these cerebral regions play important roles in motivational behavior without tangible rewards.

  8. Increased colonic propionate reduces anticipatory reward responses in the human striatum to high-energy foods.

    PubMed

    Byrne, Claire S; Chambers, Edward S; Alhabeeb, Habeeb; Chhina, Navpreet; Morrison, Douglas J; Preston, Tom; Tedford, Catriona; Fitzpatrick, Julie; Irani, Cherag; Busza, Albert; Garcia-Perez, Isabel; Fountana, Sofia; Holmes, Elaine; Goldstone, Anthony P; Frost, Gary S

    2016-07-01

    Short-chain fatty acids (SCFAs), metabolites produced through the microbial fermentation of nondigestible dietary components, have key roles in energy homeostasis. Animal research suggests that colon-derived SCFAs modulate feeding behavior via central mechanisms. In humans, increased colonic production of the SCFA propionate acutely reduces energy intake. However, evidence of an effect of colonic propionate on the human brain or reward-based eating behavior is currently unavailable. We investigated the effect of increased colonic propionate production on brain anticipatory reward responses during food picture evaluation. We hypothesized that elevated colonic propionate would reduce both reward responses and ad libitum energy intake via stimulation of anorexigenic gut hormone secretion. In a randomized crossover design, 20 healthy nonobese men completed a functional magnetic resonance imaging (fMRI) food picture evaluation task after consumption of control inulin or inulin-propionate ester, a unique dietary compound that selectively augments colonic propionate production. The blood oxygen level-dependent (BOLD) signal was measured in a priori brain regions involved in reward processing, including the caudate, nucleus accumbens, amygdala, anterior insula, and orbitofrontal cortex (n = 18 had analyzable fMRI data). Increasing colonic propionate production reduced BOLD signal during food picture evaluation in the caudate and nucleus accumbens. In the caudate, the reduction in BOLD signal was driven specifically by a lowering of the response to high-energy food. These central effects were partnered with a decrease in subjective appeal of high-energy food pictures and reduced energy intake during an ad libitum meal. These observations were not related to changes in blood peptide YY (PYY), glucagon-like peptide 1 (GLP-1), glucose, or insulin concentrations. Our results suggest that colonic propionate production may play an important role in attenuating reward-based eating behavior via striatal pathways, independent of changes in plasma PYY and GLP-1. This trial was registered at clinicaltrials.gov as NCT00750438.

  9. Inferior frontal cortex activity is modulated by reward sensitivity and performance variability.

    PubMed

    Fuentes-Claramonte, Paola; Ávila, César; Rodríguez-Pujadas, Aina; Costumero, Víctor; Ventura-Campos, Noelia; Bustamante, Juan Carlos; Rosell-Negre, Patricia; Barrós-Loscertales, Alfonso

    2016-02-01

    High reward sensitivity has been linked with motivational and cognitive disorders related with prefrontal and striatal brain function during inhibitory control. However, few studies have analyzed the interaction among reward sensitivity, task performance and neural activity. Participants (N=57) underwent fMRI while performing a Go/No-go task with Frequent-go (77.5%), Infrequent-go (11.25%) and No-go (11.25%) stimuli. Task-associated activity was found in inhibition-related brain regions, with different activity patterns for right and left inferior frontal gyri (IFG): right IFG responded more strongly to No-go stimuli, while left IFG responded similarly to all infrequent stimuli. Reward sensitivity correlated with omission errors in Go trials and reaction time (RT) variability, and with increased activity in right and left IFG for No-go and Infrequent-go stimuli compared with Frequent-go. Bilateral IFG activity was associated with RT variability, with reward sensitivity mediating this association. These results suggest that reward sensitivity modulates behavior and brain function during executive control. Copyright © 2016 Elsevier B.V. All rights reserved.

  10. Competitive control of cognition in rhesus monkeys.

    PubMed

    Kowaguchi, Mayuka; Patel, Nirali P; Bunnell, Megan E; Kralik, Jerald D

    2016-12-01

    The brain has evolved different approaches to solve problems, but the mechanisms that determine which approach to take remain unclear. One possibility is that control progresses from simpler processes, such as associative learning, to more complex ones, such as relational reasoning, when the simpler ones prove inadequate. Alternatively, control could be based on competition between the processes. To test between these possibilities, we posed the support problem to rhesus monkeys using a tool-use paradigm, in which subjects could pull an object (the tool) toward themselves to obtain an otherwise out-of-reach goal item. We initially provided one problem exemplar as a choice: for the correct option, a food item placed on the support tool; for the incorrect option, the food item placed off the tool. Perceptual cues were also correlated with outcome: e.g., red, triangular tool correct, blue, rectangular tool incorrect. Although the monkeys simply needed to touch the tool to register a response, they immediately pulled it, reflecting a relational reasoning process between themselves and another object (R self-other ), rather than an associative one between the arbitrary touch response and reward (A resp-reward ). Probe testing then showed that all four monkeys used a conjunction of perceptual features to select the correct option, reflecting an associative process between stimuli and reward (A stim-reward ). We then added a second problem exemplar and subsequent testing revealed that the monkeys switched to using the on/off relationship, reflecting a relational reasoning process between two objects (R other-other ). Because behavior appeared to reflect R self-other rather than A resp-reward , and A stim-reward prior to R other-other , our results suggest that cognitive processes are selected via competitive control dynamics. Copyright © 2016 Elsevier B.V. All rights reserved.

  11. Risky decisions and their consequences: neural processing by boys with Antisocial Substance Disorder.

    PubMed

    Crowley, Thomas J; Dalwani, Manish S; Mikulich-Gilbertson, Susan K; Du, Yiping P; Lejuez, Carl W; Raymond, Kristen M; Banich, Marie T

    2010-09-22

    Adolescents with conduct and substance problems ("Antisocial Substance Disorder" (ASD)) repeatedly engage in risky antisocial and drug-using behaviors. We hypothesized that, during processing of risky decisions and resulting rewards and punishments, brain activation would differ between abstinent ASD boys and comparison boys. We compared 20 abstinent adolescent male patients in treatment for ASD with 20 community controls, examining rapid event-related blood-oxygen-level-dependent (BOLD) responses during functional magnetic resonance imaging. In 90 decision trials participants chose to make either a cautious response that earned one cent, or a risky response that would either gain 5 cents or lose 10 cents; odds of losing increased as the game progressed. We also examined those times when subjects experienced wins, or separately losses, from their risky choices. We contrasted decision trials against very similar comparison trials requiring no decisions, using whole-brain BOLD-response analyses of group differences, corrected for multiple comparisons. During decision-making ASD boys showed hypoactivation in numerous brain regions robustly activated by controls, including orbitofrontal and dorsolateral prefrontal cortices, anterior cingulate, basal ganglia, insula, amygdala, hippocampus, and cerebellum. While experiencing wins, ASD boys had significantly less activity than controls in anterior cingulate, temporal regions, and cerebellum, with more activity nowhere. During losses ASD boys had significantly more activity than controls in orbitofrontal cortex, dorsolateral prefrontal cortex, brain stem, and cerebellum, with less activity nowhere. Adolescent boys with ASD had extensive neural hypoactivity during risky decision-making, coupled with decreased activity during reward and increased activity during loss. These neural patterns may underlie the dangerous, excessive, sustained risk-taking of such boys. The findings suggest that the dysphoria, reward insensitivity, and suppressed neural activity observed among older addicted persons also characterize youths early in the development of substance use disorders.

  12. The role of BDNF, leptin, and catecholamines in reward learning in bulimia nervosa.

    PubMed

    Homan, Philipp; Grob, Simona; Milos, Gabriella; Schnyder, Ulrich; Eckert, Anne; Lang, Undine; Hasler, Gregor

    2014-12-07

    A relationship between bulimia nervosa and reward-related behavior is supported by several lines of evidence. The dopaminergic dysfunctions in the processing of reward-related stimuli have been shown to be modulated by the neurotrophin brain derived neurotrophic factor (BDNF) and the hormone leptin. Using a randomized, double-blind, placebo-controlled, crossover design, a reward learning task was applied to study the behavior of 20 female subjects with remitted bulimia nervosa and 27 female healthy controls under placebo and catecholamine depletion with alpha-methyl-para-tyrosine (AMPT). The plasma levels of BDNF and leptin were measured twice during the placebo and the AMPT condition, immediately before and 1 hour after a standardized breakfast. AMPT-induced differences in plasma BDNF levels were positively correlated with the AMPT-induced differences in reward learning in the whole sample (P=.05). Across conditions, plasma brain derived neurotrophic factor levels were higher in remitted bulimia nervosa subjects compared with controls (diagnosis effect; P=.001). Plasma BDNF and leptin levels were higher in the morning before compared with after a standardized breakfast across groups and conditions (time effect; P<.0001). The plasma leptin levels were higher under catecholamine depletion compared with placebo in the whole sample (treatment effect; P=.0004). This study reports on preliminary findings that suggest a catecholamine-dependent association of plasma BDNF and reward learning in subjects with remitted bulimia nervosa and controls. A role of leptin in reward learning is not supported by this study. However, leptin levels were sensitive to a depletion of catecholamine stores in both remitted bulimia nervosa and controls. © The Author 2015. Published by Oxford University Press on behalf of CINP.

  13. NEURAL REACTIVITY TO REWARD AS A PREDICTOR OF COGNITIVE BEHAVIORAL THERAPY RESPONSE IN ANXIETY AND DEPRESSION.

    PubMed

    Burkhouse, Katie L; Kujawa, Autumn; Kennedy, Amy E; Shankman, Stewart A; Langenecker, Scott A; Phan, K Luan; Klumpp, Heide

    2016-04-01

    Cognitive behavioral therapy (CBT) is a well-established treatment for anxiety and depression; however, response to CBT is heterogeneous across patients and many remain symptomatic after therapy, raising the need to identify prospective predictors for treatment planning. Altered neural processing of reward has been implicated in both depression and anxiety, and improving hedonic capacity is a goal of CBT. However, little is known about how neural response to reward relates to CBT outcomes in depression and anxiety. The current study used the reward positivity (RewP) event-related potential (ERP) component to examine whether neural reactivity to reward would predict CBT response in a sample of patients with anxiety without depression (n = 30) and comorbid anxiety and depression (CAD, n = 22). Participants completed a guessing reward ERP paradigm before completing 12 weeks of standard CBT. The majority of the sample (68%; 35 out of 52 patients) responded to treatment, and those with a reduced RewP at baseline were more likely to respond to treatment. A reduced RewP was also associated with a greater pre-to-post CBT reduction in depressive symptoms among individuals with CAD, but not among individuals with pure anxiety. CBT may be most beneficial in reducing depressive symptoms for individuals who demonstrate decreased reward reactivity prior to treatment. CBT may target reward brain function, leading to greater improvement in symptoms. These effects may be strongest, and therefore most meaningful, for individuals with reward-processing deficits prior to treatment. © 2016 Wiley Periodicals, Inc.

  14. Neural Reactivity to Reward as a Predictor of Cognitive Behavioral Therapy Response in Anxiety and Depression

    PubMed Central

    Burkhouse, Katie L.; Kujawa, Autumn; Kennedy, Amy E.; Shankman, Stewart A.; Langenecker, Scott A.; Phan, K. Luan; Klumpp, Heide

    2016-01-01

    Background Cognitive behavioral therapy (CBT) is a well-established treatment for anxiety and depression; however, response to CBT is heterogeneous across patients and many remain symptomatic after therapy, raising the need to identify prospective predictors for treatment planning. Altered neural processing of reward has been implicated in both depression and anxiety, and improving hedonic capacity is a goal of CBT. However, little is known about how neural response to reward relates to CBT outcomes in depression and anxiety. The current study used the reward positivity (RewP) event-related potential (ERP) component to examine whether neural reactivity to reward would predict CBT response in a sample of patients with anxiety without depression (n = 30) and comorbid anxiety and depression (CAD, n = 22). Methods Participants completed a guessing reward ERP paradigm before completing 12 weeks of standard CBT. Results The majority of the sample (68%; 35 of 52 patients) responded to treatment, and those with a reduced RewP at baseline were more likely to respond to treatment. A reduced RewP was also associated with a greater pre-to-post CBT reduction in depressive symptoms among individuals with CAD, but not among individuals with pure anxiety. Conclusions CBT may be most beneficial in reducing depressive symptoms for individuals who demonstrate decreased reward reactivity prior to treatment. CBT may target reward brain function, leading to greater improvement in symptoms. These effects may be strongest, and therefore most meaningful, for individuals with reward processing deficits prior to treatment. PMID:27038409

  15. Neural reactivity to reward in school-age offspring of depressed mothers.

    PubMed

    Wiggins, Jillian Lee; Schwartz, Karen T G; Kryza-Lacombe, Maria; Spechler, Philip A; Blankenship, Sarah L; Dougherty, Lea R

    2017-05-01

    Identifying neural profiles predictive of future psychopathology in at-risk individuals is important to efficiently direct preventive care. Alterations in reward processing may be a risk factor for depression. The current study characterized neural substrates of reward processing in children at low- and high-risk for psychopathology due to maternal depression status. Children with (n=27) and without (n=19) maternal depression (ages 5.9-9.6 years) performed a monetary incentive delay task in which they received rewards, if they successfully hit a target, or no reward regardless of performance, during fMRI acquisition. Multiple dorsal prefrontal, temporal, and striatal regions showed significant Group (high- vs. low-risk)×Performance (hit vs. miss)×Condition (no reward vs. reward) interactions in a whole-brain analysis. All regions exhibited similar patterns, whereby the high-risk group showed blunted activation differences between trials with vs. without rewards when participants hit the target. Moreover, high-risk children showed activation differences between trials with vs. without rewards in the opposite direction, compared to the low-risk group, when they missed the target. This study had a modest sample size, though larger than existing studies. Children with maternal depression are at elevated risk for future psychopathology, yet not all experience clinically significant symptoms; longitudinal research is necessary to fully track the pathway from risk to disorder. Children of depressed mothers exhibited attenuated neural activation differences and activation patterns opposite to children without depressed mothers. Our findings may provide targets for hypothesis-driven preventive interventions and lead to earlier identification of individuals at risk. Copyright © 2017 Elsevier B.V. All rights reserved.

  16. Modeling effects of intrinsic and extrinsic rewards on the competition between striatal learning systems.

    PubMed

    Boedecker, Joschka; Lampe, Thomas; Riedmiller, Martin

    2013-01-01

    A common assumption in psychology, economics, and other fields holds that higher performance will result if extrinsic rewards (such as money) are offered as an incentive. While this principle seems to work well for tasks that require the execution of the same sequence of steps over and over, with little uncertainty about the process, in other cases, especially where creative problem solving is required due to the difficulty in finding the optimal sequence of actions, external rewards can actually be detrimental to task performance. Furthermore, they have the potential to undermine intrinsic motivation to do an otherwise interesting activity. In this work, we extend a computational model of the dorsomedial and dorsolateral striatal reinforcement learning systems to account for the effects of extrinsic and intrinsic rewards. The model assumes that the brain employs both a goal-directed and a habitual learning system, and competition between both is based on the trade-off between the cost of the reasoning process and value of information. The goal-directed system elicits internal rewards when its models of the environment improve, while the habitual system, being model-free, does not. Our results account for the phenomena that initial extrinsic reward leads to reduced activity after extinction compared to the case without any initial extrinsic rewards, and that performance in complex task settings drops when higher external rewards are promised. We also test the hypothesis that external rewards bias the competition in favor of the computationally efficient, but cruder and less flexible habitual system, which can negatively influence intrinsic motivation and task performance in the class of tasks we consider.

  17. The effects of HIV-1 regulatory TAT protein expression on brain reward function, response to psychostimulants and delay-dependent memory in mice.

    PubMed

    Kesby, James P; Markou, Athina; Semenova, Svetlana

    2016-10-01

    Depression and psychostimulant abuse are common comorbidities among humans with immunodeficiency virus (HIV) disease. The HIV regulatory protein TAT is one of multiple HIV-related proteins associated with HIV-induced neurotoxicity. TAT-induced dysfunction of dopamine and serotonin systems in corticolimbic brain areas may result in impaired reward function, thus, contributing to depressive symptoms and psychostimulant abuse. Transgenic mice with doxycycline-induced TAT protein expression in the brain (TAT+, TAT- control) show neuropathology resembling brain abnormalities in HIV+ humans. We evaluated brain reward function in response to TAT expression, nicotine and methamphetamine administration in TAT+ and TAT- mice using the intracranial self-stimulation procedure. We evaluated the brain dopamine and serotonin systems with high-performance liquid chromatography. The effects of TAT expression on delay-dependent working memory in TAT+ and TAT- mice using the operant delayed nonmatch-to-position task were also assessed. During doxycycline administration, reward thresholds were elevated by 20% in TAT+ mice compared with TAT- mice. After the termination of doxycycline treatment, thresholds of TAT+ mice remained significantly higher than those of TAT- mice and this was associated with changes in mesolimbic serotonin and dopamine levels. TAT+ mice showed a greater methamphetamine-induced threshold lowering compared with TAT- mice. TAT expression did not alter delay-dependent working memory. These results indicate that TAT expression in mice leads to reward deficits, a core symptom of depression, and a greater sensitivity to methamphetamine-induced reward enhancement. Our findings suggest that the TAT protein may contribute to increased depressive-like symptoms and continued methamphetamine use in HIV-positive individuals. Copyright © 2016 Elsevier Ltd. All rights reserved.

  18. Within-subject neural reactivity to reward and threat is inverted in young adolescents.

    PubMed

    Thomason, M E; Marusak, H A

    2017-07-01

    As children mature, they become increasingly independent and less reliant on caregiver support. Changes in brain systems are likely to stimulate and guide this process. One mechanistic hypothesis suggests that changes in neural systems that process reward and threat support the increase in exploratory behavior observed in the transition to adolescence. This study examines the basic tenets of this hypothesis by performing functional magnetic resonance imaging (fMRI) during well-established reward and threat processing tasks in 40 children and adolescents, aged 9-15 years. fMRI responses in the striatum and amygdala are fit to a model predicting that striatal reward and amygdala threat-responses will be unrelated in younger participants (aged 9-12 years), while older participants (aged 13-15 years) will differentially engage these structures. Our data are consistent with this model. Activity in the striatum and amygdala are comparable in younger children, but in older children, they are inversely related; those more responsive to reward show a reduced threat-response. Analyses testing age as a continuous variable yield consistent results. In addition, the proportion of threat to reward-response relates to self-reported approach behavior in older but not younger youth, exposing behavioral relevance in the relative level of activity in these structures. Results are consistent with the notion that both individual and developmental differences drive reward-seeking behavior in adolescence. While these response patterns may serve adaptive functions in the shift to independence, skew in these systems may relate to increased rates of emotional psychopathology and risk-taking observed in adolescence.

  19. Reward Systems in the Brain and Nutrition.

    PubMed

    Rolls, Edmund T

    2016-07-17

    The taste cortex in the anterior insula provides separate and combined representations of the taste, temperature, and texture of food in the mouth independently of hunger and thus of reward value and pleasantness. One synapse on, in the orbitofrontal cortex, these sensory inputs are combined by associative learning with olfactory and visual inputs for some neurons, and these neurons encode food reward value in that they respond to food only when hunger is present and in that activations correlate linearly with subjective pleasantness. Cognitive factors, including word-level descriptions and selective attention to affective value, modulate the representation of the reward value of taste, olfactory, and flavor stimuli in the orbitofrontal cortex and a region to which it projects, the anterior cingulate cortex. These food reward representations are important in the control of appetite and food intake. Individual differences in reward representations may contribute to obesity, and there are age-related differences in these reward representations. Implications of how reward systems in the brain operate for understanding, preventing, and treating obesity are described.

  20. How we learn to make decisions: rapid propagation of reinforcement learning prediction errors in humans.

    PubMed

    Krigolson, Olav E; Hassall, Cameron D; Handy, Todd C

    2014-03-01

    Our ability to make decisions is predicated upon our knowledge of the outcomes of the actions available to us. Reinforcement learning theory posits that actions followed by a reward or punishment acquire value through the computation of prediction errors-discrepancies between the predicted and the actual reward. A multitude of neuroimaging studies have demonstrated that rewards and punishments evoke neural responses that appear to reflect reinforcement learning prediction errors [e.g., Krigolson, O. E., Pierce, L. J., Holroyd, C. B., & Tanaka, J. W. Learning to become an expert: Reinforcement learning and the acquisition of perceptual expertise. Journal of Cognitive Neuroscience, 21, 1833-1840, 2009; Bayer, H. M., & Glimcher, P. W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron, 47, 129-141, 2005; O'Doherty, J. P. Reward representations and reward-related learning in the human brain: Insights from neuroimaging. Current Opinion in Neurobiology, 14, 769-776, 2004; Holroyd, C. B., & Coles, M. G. H. The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709, 2002]. Here, we used the brain ERP technique to demonstrate that not only do rewards elicit a neural response akin to a prediction error but also that this signal rapidly diminished and propagated to the time of choice presentation with learning. Specifically, in a simple, learnable gambling task, we show that novel rewards elicited a feedback error-related negativity that rapidly decreased in amplitude with learning. Furthermore, we demonstrate the existence of a reward positivity at choice presentation, a previously unreported ERP component that has a similar timing and topography as the feedback error-related negativity that increased in amplitude with learning. The pattern of results we observed mirrored the output of a computational model that we implemented to compute reward prediction errors and the changes in amplitude of these prediction errors at the time of choice presentation and reward delivery. Our results provide further support that the computations that underlie human learning and decision-making follow reinforcement learning principles.

  1. Adolescent Depression: Stress and Reward Dysfunction

    PubMed Central

    Auerbach, Randy P.; Admon, Roee; Pizzagalli, Diego A.

    2014-01-01

    Adolescence is a peak period for the onset of depression, and it is also a time marked by substantial stress as well as neural development within the brain reward circuitry. In the current review, we provide a selective overview of current animal and human research investigating the relationship among reward processes, stress, and depression. Three separate, but related, etiological models examine the differential roles that stress may play with regard to reward dysfunction and adolescent depression. First, the reward mediation model suggests that acute and chronic stress contribute to reward deficits, which in turn, potentiate depressive symptoms and/or increase the risk for depression. Second, in line with the stress generation perspective, it is plausible that premorbid reward-related dysfunction generates stress, in particular interpersonal stress, which then leads to the manifestation of depressive symptoms. Last, consistent with a diathesis-stress model, the interaction between stress and premorbid reward dysfunction may contribute to the onset of depression. Given the equifinal nature of depression, these models could shed important light on different etiological pathways during adolescence, particularly as they may relate to understanding the heterogeneity of depression. To highlight the translational potential of these insights, a hypothetical case study is provided as means of demonstrating the importance of targeting reward dysfunction in both assessment and treatment of adolescent depression. PMID:24704785

  2. Prediction-error in the context of real social relationships modulates reward system activity.

    PubMed

    Poore, Joshua C; Pfeifer, Jennifer H; Berkman, Elliot T; Inagaki, Tristen K; Welborn, Benjamin L; Lieberman, Matthew D

    2012-01-01

    The human reward system is sensitive to both social (e.g., validation) and non-social rewards (e.g., money) and is likely integral for relationship development and reputation building. However, data is sparse on the question of whether implicit social reward processing meaningfully contributes to explicit social representations such as trust and attachment security in pre-existing relationships. This event-related fMRI experiment examined reward system prediction-error activity in response to a potent social reward-social validation-and this activity's relation to both attachment security and trust in the context of real romantic relationships. During the experiment, participants' expectations for their romantic partners' positive regard of them were confirmed (validated) or violated, in either positive or negative directions. Primary analyses were conducted using predefined regions of interest, the locations of which were taken from previously published research. Results indicate that activity for mid-brain and striatal reward system regions of interest was modulated by social reward expectation violation in ways consistent with prior research on reward prediction-error. Additionally, activity in the striatum during viewing of disconfirmatory information was associated with both increases in post-scan reports of attachment anxiety and decreases in post-scan trust, a finding that follows directly from representational models of attachment and trust.

  3. Cerebellar granule cells encode the expectation of reward

    PubMed Central

    Wagner, Mark J; Kim, Tony Hyun; Savall, Joan; Schnitzer, Mark J; Luo, Liqun

    2017-01-01

    The human brain contains ~60 billion cerebellar granule cells1, which outnumber all other neurons combined. Classical theories posit that a large, diverse population of granule cells allows for highly detailed representations of sensorimotor context, enabling downstream Purkinje cells to sense fine contextual changes2–6. Although evidence suggests a role for cerebellum in cognition7–10, granule cells are known to encode only sensory11–13 and motor14 context. Using two-photon calcium imaging in behaving mice, here we show that granule cells convey information about the expectation of reward. Mice initiated voluntary forelimb movements for delayed water reward. Some granule cells responded preferentially to reward or reward omission, whereas others selectively encoded reward anticipation. Reward responses were not restricted to forelimb movement, as a Pavlovian task evoked similar responses. Compared to predictable rewards, unexpected rewards elicited markedly different granule cell activity despite identical stimuli and licking responses. In both tasks, reward signals were widespread throughout multiple cerebellar lobules. Tracking the same granule cells over several days of learning revealed that cells with reward-anticipating responses emerged from those that responded at the start of learning to reward delivery, whereas reward omission responses grew stronger as learning progressed. The discovery of predictive, non-sensorimotor encoding in granule cells is a major departure from current understanding of these neurons and dramatically enriches contextual information available to postsynaptic Purkinje cells, with important implications for cognitive processing in the cerebellum. PMID:28321129

  4. Drug-Induced Alterations of Endocannabinoid-Mediated Plasticity in Brain Reward Regions.

    PubMed

    Zlebnik, Natalie E; Cheer, Joseph F

    2016-10-05

    The endocannabinoid (eCB) system has emerged as one of the most important mediators of physiological and pathological reward-related synaptic plasticity. eCBs are retrograde messengers that provide feedback inhibition, resulting in the suppression of neurotransmitter release at both excitatory and inhibitory synapses, and they serve a critical role in the spatiotemporal regulation of both short- and long-term synaptic plasticity that supports adaptive learning of reward-motivated behaviors. However, mechanisms of eCB-mediated synaptic plasticity in reward areas of the brain are impaired following exposure to drugs of abuse. Because of this, it is theorized that maladaptive eCB signaling may contribute to the development and maintenance of addiction-related behavior. Here we review various forms of eCB-mediated synaptic plasticity present in regions of the brain involved in reward and reinforcement and explore the potential physiological relevance of maladaptive eCB signaling to addiction vulnerability. Copyright © 2016 the authors 0270-6474/16/3610230-09$15.00/0.

  5. Relationship between Personality Traits and Brain Reward Responses when Playing on a Team

    PubMed Central

    Morawetz, Carmen; Kirilina, Evgeniya; Baudewig, Juergen; Heekeren, Hauke R.

    2014-01-01

    Cooperation is an integral part of human social life and we often build teams to achieve certain goals. However, very little is currently understood about emotions with regard to cooperation. Here, we investigated the impact of social context (playing alone versus playing on a team) on emotions while winning or losing a game. We hypothesized that activity in the reward network is modulated by the social context and that personality characteristics might impact team play. We conducted an event-related functional magnetic resonance imaging experiment that involved a simple game of dice. In the team condition, the participant played with a partner against another two-person team. In the single-player condition, the participant played alone against another player. Our results revealed that reward processing in the right amygdala was modulated by the social context. The main effect of outcome (gains versus losses) was associated with increased responses in the reward network. We also found that differences in the reward-related neural response due to social context were associated with specific personality traits. When playing on a team, increased activity in the amygdala during winning was a unique function of openness, while decreased activity in the ventromedial prefrontal cortex and ventral striatum during losing was associated with extraversion and conscientiousness, respectively. In conclusion, we provide evidence that working on a team influences the affective value of a negative outcome by attenuating the negative response associated with it in the amygdala. Our results also show that brain reward responses in a social context are affected by personality traits related to teamwork. PMID:24475262

  6. Relationship between personality traits and brain reward responses when playing on a team.

    PubMed

    Morawetz, Carmen; Kirilina, Evgeniya; Baudewig, Juergen; Heekeren, Hauke R

    2014-01-01

    Cooperation is an integral part of human social life and we often build teams to achieve certain goals. However, very little is currently understood about emotions with regard to cooperation. Here, we investigated the impact of social context (playing alone versus playing on a team) on emotions while winning or losing a game. We hypothesized that activity in the reward network is modulated by the social context and that personality characteristics might impact team play. We conducted an event-related functional magnetic resonance imaging experiment that involved a simple game of dice. In the team condition, the participant played with a partner against another two-person team. In the single-player condition, the participant played alone against another player. Our results revealed that reward processing in the right amygdala was modulated by the social context. The main effect of outcome (gains versus losses) was associated with increased responses in the reward network. We also found that differences in the reward-related neural response due to social context were associated with specific personality traits. When playing on a team, increased activity in the amygdala during winning was a unique function of openness, while decreased activity in the ventromedial prefrontal cortex and ventral striatum during losing was associated with extraversion and conscientiousness, respectively. In conclusion, we provide evidence that working on a team influences the affective value of a negative outcome by attenuating the negative response associated with it in the amygdala. Our results also show that brain reward responses in a social context are affected by personality traits related to teamwork.

  7. Fluctuations in Nucleus Accumbens Extracellular Glutamate and Glucose during Motivated Glucose-drinking Behavior: Dissecting the Neurochemistry of Reward

    PubMed Central

    Wakabayashi, Ken T.; Myal, Stephanie E.; Kiyatkin, Eugene A.

    2015-01-01

    While motivated behavior involves multiple neurochemical systems, few studies have focused on the role of glutamate, the brain’s excitatory neurotransmitter, and glucose, the energetic substrate of neural activity in reward-related neural processes. Here, we used high-speed amperometry with enzyme-based substrate-sensitive and control, enzyme-free biosensors to examine second-scale fluctuations in the extracellular levels of these substances in the nucleus accumbens shell during glucose-drinking behavior in trained rats. Glutamate rose rapidly after the presentation of a glucose-containing cup and before the initiation of drinking (reward seeking), decreased more slowly to levels below baseline during consumption (sensory reward), and returned to baseline when the ingested glucose reached the brain (metabolic reward). When water was substituted for glucose, glutamate rapidly increased with cup presentation and in contrast to glucose drinking, increased above baseline after rats tasted the water and refused to drink further. Therefore, extracellular glutamate show distinct changes associated with key events of motivated drinking behavior and opposite dynamics during sensory and metabolic components of reward. In contrast to glutamate, glucose increased at each stimulus and behavioral event, showing a sustained elevation during the entire behavior and a robust post-ingestion rise that correlated with the gradual return of glutamate levels to their baseline. By comparing active drinking with passive intra-gastric glucose delivery, we revealed that fluctuations in extracellular glucose are highly dynamic, reflecting a balance between rapid delivery due to neural activity, intense metabolism, and the influence of ingested glucose reaching the brain. PMID:25393775

  8. Foraging for brain stimulation: toward a neurobiology of computation.

    PubMed

    Gallistel, C R

    1994-01-01

    The self-stimulating rat performs foraging tasks mediated by simple computations that use interreward intervals and subjective reward magnitudes to determine stay durations. This is a simplified preparation in which to study the neurobiology of the elementary computational operations that make cognition possible, because the neural signal specifying the value of a computationally relevant variable is produced by direct electrical stimulation of a neural pathway. Newly developed measurement methods yield functions relating the subjective reward magnitude to the parameters of the neural signal. These measurements also show that the decision process that governs foraging behavior divides the subjective reward magnitude by the most recent interreward interval to determine the preferability of an option (a foraging patch). The decision process sets the parameters that determine stay durations (durations of visits to foraging patches) so that the ratios of the stay durations match the ratios of the preferabilities.

  9. Frontal cortex electrophysiology in reward- and punishment-related feedback processing during advice-guided decision making: An interleaved EEG-DC stimulation study.

    PubMed

    Wischnewski, Miles; Bekkering, Harold; Schutter, Dennis J L G

    2018-04-01

    During decision making, individuals are prone to rely on external cues such as expert advice when the outcome is not known. However, the electrophysiological correlates associated with outcome uncertainty and the use of expert advice are not completely understood. The feedback-related negativity (FRN), P3a, and P3b are event-related brain potentials (ERPs) linked to dissociable stages of feedback and attentional processing during decision making. Even though these ERPs are influenced by both reward- and punishment-related feedback, it remains unclear how extrinsic information during uncertainty modulates these brain potentials. In this study, the effects of advice cues on decision making were investigated in two separate experiments. In the first experiment, electroencephalography (EEG) was recorded in healthy volunteers during a decision-making task in which the participants received reward or punishment feedback preceded by novice, amateur, or expert advice. The results showed that the P3a component was significantly influenced by the subjective predictive value of an advice cue, whereas the FRN and P3b were unaffected by the advice cues. In the second, sham-controlled experiment, cathodal transcranial direct current stimulation (ctDCS) was administered in conjunction with EEG in order to explore the direct contributions of the frontal cortex to these brain potentials. Results showed no significant change in either advice-following behavior or decision times. However, ctDCS did decrease FRN amplitudes as compared to sham, with no effect on the P3a or P3b. Together, these findings suggest that advice information may act primarily on attention allocation during feedback processing, whereas the electrophysiological correlates of the detection and updating of internal prediction models are not affected.

  10. Regional brain responses in nulliparous women to emotional infant stimuli.

    PubMed

    Montoya, Jessica L; Landi, Nicole; Kober, Hedy; Worhunsky, Patrick D; Rutherford, Helena J V; Mencl, W Einar; Mayes, Linda C; Potenza, Marc N

    2012-01-01

    Infant cries and facial expressions influence social interactions and elicit caretaking behaviors from adults. Recent neuroimaging studies suggest that neural responses to infant stimuli involve brain regions that process rewards. However, these studies have yet to investigate individual differences in tendencies to engage or withdraw from motivationally relevant stimuli. To investigate this, we used event-related fMRI to scan 17 nulliparous women. Participants were presented with novel infant cries of two distress levels (low and high) and unknown infant faces of varying affect (happy, sad, and neutral) in a randomized, counter-balanced order. Brain activation was subsequently correlated with scores on the Behavioral Inhibition System/Behavioral Activation System scale. Infant cries activated bilateral superior and middle temporal gyri (STG and MTG) and precentral and postcentral gyri. Activation was greater in bilateral temporal cortices for low- relative to high-distress cries. Happy relative to neutral faces activated the ventral striatum, caudate, ventromedial prefrontal, and orbitofrontal cortices. Sad versus neutral faces activated the precuneus, cuneus, and posterior cingulate cortex, and behavioral activation drive correlated with occipital cortical activations in this contrast. Behavioral inhibition correlated with activation in the right STG for high- and low-distress cries relative to pink noise. Behavioral drive correlated inversely with putamen, caudate, and thalamic activations for the comparison of high-distress cries to pink noise. Reward-responsiveness correlated with activation in the left precentral gyrus during the perception of low-distress cries relative to pink noise. Our findings indicate that infant cry stimuli elicit activations in areas implicated in auditory processing and social cognition. Happy infant faces may be encoded as rewarding, whereas sad faces activate regions associated with empathic processing. Differences in motivational tendencies may modulate neural responses to infant cues.

  11. The ICCAM platform study: An experimental medicine platform for evaluating new drugs for relapse prevention in addiction. Part B: fMRI description

    PubMed Central

    McGonigle, John; Murphy, Anna; Paterson, Louise M; Reed, Laurence J; Nestor, Liam; Nash, Jonathan; Elliott, Rebecca; Ersche, Karen D; Flechais, Remy SA; Newbould, Rexford; Orban, Csaba; Smith, Dana G; Taylor, Eleanor M; Waldman, Adam D; Robbins, Trevor W; Deakin, JF William; Nutt, David J; Lingford-Hughes, Anne R; Suckling, John

    2016-01-01

    Objectives: We aimed to set up a robust multi-centre clinical fMRI and neuropsychological platform to investigate the neuropharmacology of brain processes relevant to addiction – reward, impulsivity and emotional reactivity. Here we provide an overview of the fMRI battery, carried out across three centres, characterizing neuronal response to the tasks, along with exploring inter-centre differences in healthy participants. Experimental design: Three fMRI tasks were used: monetary incentive delay to probe reward sensitivity, go/no-go to probe impulsivity and an evocative images task to probe emotional reactivity. A coordinate-based activation likelihood estimation (ALE) meta-analysis was carried out for the reward and impulsivity tasks to help establish region of interest (ROI) placement. A group of healthy participants was recruited from across three centres (total n=43) to investigate inter-centre differences. Principle observations: The pattern of response observed for each of the three tasks was consistent with previous studies using similar paradigms. At the whole brain level, significant differences were not observed between centres for any task. Conclusions: In developing this platform we successfully integrated neuroimaging data from three centres, adapted validated tasks and applied whole brain and ROI approaches to explore and demonstrate their consistency across centres. PMID:27703042

  12. Informatic parcellation of the network involved in the computation of subjective value

    PubMed Central

    Rangel, Antonio

    2014-01-01

    Understanding how the brain computes value is a basic question in neuroscience. Although individual studies have driven this progress, meta-analyses provide an opportunity to test hypotheses that require large collections of data. We carry out a meta-analysis of a large set of functional magnetic resonance imaging studies of value computation to address several key questions. First, what is the full set of brain areas that reliably correlate with stimulus values when they need to be computed? Second, is this set of areas organized into dissociable functional networks? Third, is a distinct network of regions involved in the computation of stimulus values at decision and outcome? Finally, are different brain areas involved in the computation of stimulus values for different reward modalities? Our results demonstrate the centrality of ventromedial prefrontal cortex (VMPFC), ventral striatum and posterior cingulate cortex (PCC) in the computation of value across tasks, reward modalities and stages of the decision-making process. We also find evidence of distinct subnetworks of co-activation within VMPFC, one involving central VMPFC and dorsal PCC and another involving more anterior VMPFC, left angular gyrus and ventral PCC. Finally, we identify a posterior-to-anterior gradient of value representations corresponding to concrete-to-abstract rewards. PMID:23887811

  13. Earlier adolescent substance use onset predicts stronger connectivity between reward and cognitive control brain networks.

    PubMed

    Weissman, David G; Schriber, Roberta A; Fassbender, Catherine; Atherton, Olivia; Krafft, Cynthia; Robins, Richard W; Hastings, Paul D; Guyer, Amanda E

    2015-12-01

    Early adolescent onset of substance use is a robust predictor of future substance use disorders. We examined the relation between age of substance use initiation and resting state functional connectivity (RSFC) of the core reward processing (nucleus accumbens; NAcc) to cognitive control (prefrontal cortex; PFC) brain networks. Adolescents in a longitudinal study of Mexican-origin youth reported their substance use annually from ages 10 to 16 years. At age 16, 69 adolescents participated in a resting state functional magnetic resonance imaging scan. Seed-based correlational analyses were conducted using regions of interest in bilateral NAcc. The earlier that adolescents initiated substance use, the stronger the connectivity between bilateral NAcc and right dorsolateral PFC, right dorsomedial PFC, right pre-supplementary motor area, right inferior parietal lobule, and left medial temporal gyrus. The regions that demonstrated significant positive linear relationships between the number of adolescent years using substances and connectivity with NAcc are nodes in the right frontoparietal network, which is central to cognitive control. The coupling of reward and cognitive control networks may be a mechanism through which earlier onset of substance use is related to brain function over time, a trajectory that may be implicated in subsequent substance use disorders. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

  14. The ICCAM platform study: An experimental medicine platform for evaluating new drugs for relapse prevention in addiction. Part B: fMRI description.

    PubMed

    McGonigle, John; Murphy, Anna; Paterson, Louise M; Reed, Laurence J; Nestor, Liam; Nash, Jonathan; Elliott, Rebecca; Ersche, Karen D; Flechais, Remy Sa; Newbould, Rexford; Orban, Csaba; Smith, Dana G; Taylor, Eleanor M; Waldman, Adam D; Robbins, Trevor W; Deakin, Jf William; Nutt, David J; Lingford-Hughes, Anne R; Suckling, John

    2017-01-01

    We aimed to set up a robust multi-centre clinical fMRI and neuropsychological platform to investigate the neuropharmacology of brain processes relevant to addiction - reward, impulsivity and emotional reactivity. Here we provide an overview of the fMRI battery, carried out across three centres, characterizing neuronal response to the tasks, along with exploring inter-centre differences in healthy participants. Three fMRI tasks were used: monetary incentive delay to probe reward sensitivity, go/no-go to probe impulsivity and an evocative images task to probe emotional reactivity. A coordinate-based activation likelihood estimation (ALE) meta-analysis was carried out for the reward and impulsivity tasks to help establish region of interest (ROI) placement. A group of healthy participants was recruited from across three centres (total n=43) to investigate inter-centre differences. Principle observations: The pattern of response observed for each of the three tasks was consistent with previous studies using similar paradigms. At the whole brain level, significant differences were not observed between centres for any task. In developing this platform we successfully integrated neuroimaging data from three centres, adapted validated tasks and applied whole brain and ROI approaches to explore and demonstrate their consistency across centres.

  15. FNDC5/irisin, a molecular target for boosting reward-related learning and motivation.

    PubMed

    Zsuga, Judit; Tajti, Gabor; Papp, Csaba; Juhasz, Bela; Gesztelyi, Rudolf

    2016-05-01

    Interventions focusing on the prevention and treatment of chronic non-communicable diseases are on rise. In the current article, we propose that dysfunction of the mesocortico-limbic reward system contributes to the emergence of the WHO-identified risk behaviors (tobacco use, unhealthy diet, physical inactivity and harmful use of alcohol), behaviors that underlie the evolution of major non-communicable diseases (e.g. cardiovascular diseases, cancer, diabetes and chronic respiratory diseases). Given that dopaminergic neurons of the mesocortico-limbic system are tightly associated with reward-related processes and motivation, their dysfunction may fundamentally influence behavior. While nicotine and alcohol alter dopamine neuron function by influencing some receptors, mesocortico-limbic system dysfunction was associated with elevation of metabolic set-point leading to hedonic over-eating. Although there is some empirical evidence, precise molecular mechanism for linking physical inactivity and mesocortico-limbic dysfunction per se seems to be missing; identification of which may contribute to higher success rates for interventions targeting lifestyle changes pertaining to physical activity. In the current article, we compile evidence in support of a link between exercise and the mesocortico-limbic system by elucidating interactions on the axis of muscle - irisin - brain derived neurotrophic factor (BDNF) - and dopaminergic function of the midbrain. Irisin is a contraction-regulated myokine formed primarily in skeletal muscle but also in the brain. Irisin stirred considerable interest, when its ability to induce browning of white adipose tissue parallel to increasing thermogenesis was discovered. Furthermore, it may also play a role in the regulation of behavior given it readily enters the central nervous system, where it induces BDNF expression in several brain areas linked to reward processing, e.g. the ventral tegmental area and the hippocampus. BDNF is a neurotropic factor that increases neuronal dopamine content, modulates dopamine release relevant for neuronal plasticity and increased neuronal survival as well as learning and memory. Further linking BDNF to dopaminergic function is BDNF's ability to activate tropomyosin-related kinase B receptor that shares signalization with presynaptic dopamine-3 receptors in the ventral tegmental area. Summarizing, we propose that the skeletal muscle derived irisin may be the link between physical activity and reward-related processes and motivation. Moreover alteration of this axis may contribute to sedentary lifestyle and subsequent non-communicable diseases. Preclinical and clinical experimental models to test this hypothesis are also proposed. Copyright © 2016 Elsevier Ltd. All rights reserved.

  16. Reward anticipation in the adolescent and aging brain.

    PubMed

    Lorenz, Robert C; Gleich, Tobias; Beck, Anne; Pöhland, Lydia; Raufelder, Diana; Sommer, Werner; Rapp, Michael A; Kühn, Simone; Gallinat, Jürgen

    2014-10-01

    Processing of reward is the basis of adaptive behavior of the human being. Neural correlates of reward processing seem to be influenced by developmental changes from adolescence to late adulthood. The aim of this study is to uncover these neural correlates during a slot machine gambling task across the lifespan. Therefore, we used functional magnetic resonance imaging to investigate 102 volunteers in three different age groups: 34 adolescents, 34 younger adults, and 34 older adults. We focused on the core reward areas ventral striatum (VS) and ventromedial prefrontal cortex (VMPFC), the valence processing associated areas, anterior cingulate cortex (ACC) and insula, as well as information integration associated areas, dorsolateral prefrontal cortex (DLPFC), and inferior parietal lobule (IPL). Results showed that VS and VMPFC were characterized by a hyperactivation in adolescents compared with younger adults. Furthermore, the ACC and insula were characterized by a U-shape pattern (hypoactivation in younger adults compared with adolescents and older adults), whereas the DLPFC and IPL were characterized by a J-shaped form (hyperactivation in older adults compared with younger groups). Furthermore, a functional connectivity analysis revealed an elevated negative functional coupling between the inhibition-related area rIFG and VS in younger adults compared with adolescents. Results indicate that lifespan-related changes during reward anticipation are characterized by different trajectories in different reward network modules and support the hypothesis of an imbalance in maturation of striatal and prefrontal cortex in adolescents. Furthermore, these results suggest compensatory age-specific effects in fronto-parietal regions. Copyright © 2014 Wiley Periodicals, Inc.

  17. Brain reward region responsivity of adolescents with and without parental substance use disorders.

    PubMed

    Stice, Eric; Yokum, Sonja

    2014-09-01

    The present study tested the competing hypotheses that adolescents at risk for future substance abuse and dependence by virtue of parental substance use disorders show either weaker or stronger responsivity of brain regions implicated in reward relative to youth without parental history of substance use disorders. Adolescents (n = 52) matched on demographics with and without parental substance use disorders, as determined by diagnostic interviews, who denied substance use in the past year were compared on functional MRI (fMRI) paradigms assessing neural response to receipt and anticipated receipt of monetary and food reward. Parental-history-positive versus -negative adolescents showed greater activation in the left dorsolateral prefrontal cortex and bilateral putamen, and less activation in the fusiform gyrus and inferior temporal gyrus in response to anticipating winning money, as well as greater activation in the left midbrain and right paracentral lobule, and less activation in the right middle frontal gyrus in response to milkshake receipt. Results indicate that adolescents at risk for future onset of substance use disorders show elevated responsivity of brain regions implicated in reward, extending results from 2 smaller prior studies that found that individuals with versus without parental alcohol use disorders showed greater reward region response to anticipated monetary reward and pictures of alcohol. Collectively, results provide support for the reward surfeit model of substance use disorders, rather than the reward deficit model.

  18. Enhancing response inhibition by incentive: Comparison of adolescents with and without substance use disorder

    PubMed Central

    Chung, Tammy; Geier, Charles; Luna, Beatriz; Pajtek, Stefan; Terwilliger, Robert; Thatcher, Dawn; Clark, Duncan

    2010-01-01

    Effective response inhibition is a key component of recovery from addiction. Some research suggests that response inhibition can be enhanced through reward contingencies. We examined the effect of monetary incentive on response inhibition among adolescents with and without substance use disorder (SUD) using a fast event-related fMRI antisaccade reward task. The fMRI task permits investigation of how reward (monetary incentive) might modulate inhibitory control during three task phases: cue presentation (reward or neutral trial), response preparation, and response execution. Adolescents with lifetime SUD (n=12; 100% marijuana use disorder) were gender and age-matched to healthy controls (n=12). Monetary incentive facilitated inhibitory control for SUD adolescents; for healthy controls, the difference in error rate for neutral and reward trials was not significant. There were no significant differences in behavioral performance between groups across reward and neutral trials, however, group differences in regional brain activation were identified. During the response preparation phase of reward trials, SUD adolescents, compared to controls, showed increased activation of prefrontal and oculomotor control (e.g., frontal eye field) areas, brain regions that have been associated with effective response inhibition. Results indicate differences in brain activation between SUD and control youth when preparing to inhibit a prepotent response in the context of reward, and support a possible role for incentives in enhancing response inhibition among youth with SUD. PMID:21115229

  19. Can Decision Making Research Provide a Better Understanding of Chemical and Behavioral Addictions?

    PubMed

    Engel, Anzhelika; Cáceda, Ricardo

    2015-01-01

    We reviewed the cognitive and neurobiological commonalities between chemical and behavioral addictions. Poor impulse control, limited executive function and abnormalities in reward processing are seen in both group of entities. Brain imaging shows consistent abnormalities in frontoparietal regions and the limbic system. In drug addiction, exaggerated risk taking behavior and temporal discounting may reflect an imbalance between a hyperactive mesolimbic and hypoactive executive systems. Several cognitive distortions are found in pathological gambling that seems to harness the brain reward system that has evolved to face situations related to skill, not random chance. Abnormalities in risk assessment and impulsivity are found in variety of eating disorders, in particularly related to eating behavior. Corresponding findings in eating disorder patients include abnormalities in the limbic system, i.e. orbitofrontal cortex (OFC), striatum and insula. Similarly, internet addiction disorder is associated with risky decision making and increased choice impulsivity with corresponding discrepant activation in the dorsolateral prefrontal cortex, OFC, anterior cingulate cortex, caudate and insula. Sexual addictions are in turn associated with exaggerated impulsive choice and suggestive evidence of abnormalities in reward processing. In sum, exploration of executive function and decision making abnormalities in chemical and behavioral addictions may increase understanding in their psychopathology and yield valuable targets for therapeutic interventions.

  20. The habenula as a novel link between the homeostatic and hedonic pathways in cancer-associated weight loss: a pilot study.

    PubMed

    Maldonado, Maria; Molfese, David L; Viswanath, Humsini; Curtis, Kaylah; Jones, Ashley; Hayes, Teresa G; Marcelli, Marco; Mediwala, Sanjay; Baldwin, Philip; Garcia, Jose M; Salas, Ramiro

    2018-06-01

    Little is known about the brain mechanisms underlying cancer-associated weight loss (C-WL) in humans despite this condition negatively affecting their quality of life and survival. We tested the hypothesis that patients with C-WL have abnormal connectivity in homeostatic and hedonic brain pathways together with altered brain activity during food reward. In 12 patients with cancer and 12 healthy controls, resting-state functional connectivity (RSFC, resting brain activity observed through changes in blood flow in the brain which creates a blood oxygen level-dependent signal that can be measured using functional magnetic resonance imaging) was used to compare three brain regions hypothesized to play a role in C-WL: the hypothalamus (homeostatic), the nucleus accumbens (hedonic), and the habenula (an important regulator of reward). In addition, the brain reward response to juice was studied. Participants included 12 patients with histological diagnosis of incurable cancer (solid tumours), a European Cooperative Oncology Group performance status of 0-2, and a ≥5% involuntary body weight loss from pre-illness over the previous 6 months and 12 non-cancer controls matched for age, sex, and race. RSFC between the hypothalamus, nucleus accumbens, and habenula and brain striatum activity as measured by functional MRI during juice reward delivery events were the main outcome measures. After adjusting for BMI and compared with matched controls, patients with C-WL were found to have reduced RSFC between the habenula and hypothalamus (P = 0.04) and between the habenula and nucleus accumbens (P = 0.014). Patients with C-WL also had reduced juice reward responses in the striatum compared with controls. In patients with C-WL, reduced connectivity between both homeostatic and hedonic brain regions and the habenula and reduced juice reward were observed. Further research is needed to establish the relevance of the habenula and striatum in C-WL. Published 2018. This article is a U.S. Government work and is in the public domain in the USA. Journal of Cachexia, Sarcopenia and Muscle published by John Wiley & Sons Ltd on behalf of the Society on Sarcopenia, Cachexia and Wasting Disorders.

  1. Willed action, free will, and the stochastic neurodynamics of decision-making

    PubMed Central

    Rolls, Edmund T.

    2012-01-01

    It is shown that the randomness of the firing times of neurons in decision-making attractor neuronal networks that is present before the decision cues are applied can cause statistical fluctuations that influence the decision that will be taken. In this rigorous sense, it is possible to partially predict decisions before they are made. This raises issues about free will and determinism. There are many decision-making networks in the brain. Some decision systems operate to choose between gene-specified rewards such as taste, touch, and beauty (in for example the peacock's tail). Other processes capable of planning ahead with multiple steps held in working memory may require correction by higher order thoughts that may involve explicit, conscious, processing. The explicit system can allow the gene-specified rewards not to be selected or deferred. The decisions between the selfish gene-specified rewards, and the explicitly calculated rewards that are in the interests of the individual, the phenotype, may themselves be influenced by noise in the brain. When the explicit planning system does take the decision, it can report on its decision-making, and can provide a causal account rather than a confabulation about the decision process. We might use the terms “willed action” and “free will” to refer to the operation of the planning system that can think ahead over several steps held in working memory with which it can take explicit decisions. Reduced connectivity in some of the default mode cortical regions including the precuneus that are active during self-initiated action appears to be related to the reduction in the sense of self and agency, of causing willed actions, that can be present in schizophrenia. PMID:22973205

  2. Self-Affirmation Activates the Ventral Striatum: A Possible Reward-Related Mechanism for Self-Affirmation.

    PubMed

    Dutcher, Janine M; Creswell, J David; Pacilio, Laura E; Harris, Peter R; Klein, William M P; Levine, John M; Bower, Julienne E; Muscatell, Keely A; Eisenberger, Naomi I

    2016-04-01

    Self-affirmation (reflecting on important personal values) has been shown to have a range of positive effects; however, the neural basis of self-affirmation is not known. Building on studies showing that thinking about self-preferences activates neural reward pathways, we hypothesized that self-affirmation would activate brain reward circuitry during functional MRI (fMRI) studies. In Study 1, with college students, making judgments about important personal values during self-affirmation activated neural reward regions (i.e., ventral striatum), whereas making preference judgments that were not self-relevant did not. Study 2 replicated these results in a community sample, again showing that self-affirmation activated the ventral striatum. These are among the first fMRI studies to identify neural processes during self-affirmation. The findings extend theory by showing that self-affirmation may be rewarding and may provide a first step toward identifying a neural mechanism by which self-affirmation may produce a wide range of beneficial effects. © The Author(s) 2016.

  3. Homeostatic reinforcement learning for integrating reward collection and physiological stability

    PubMed Central

    Keramati, Mehdi; Gutkin, Boris

    2014-01-01

    Efficient regulation of internal homeostasis and defending it against perturbations requires adaptive behavioral strategies. However, the computational principles mediating the interaction between homeostatic and associative learning processes remain undefined. Here we use a definition of primary rewards, as outcomes fulfilling physiological needs, to build a normative theory showing how learning motivated behaviors may be modulated by internal states. Within this framework, we mathematically prove that seeking rewards is equivalent to the fundamental objective of physiological stability, defining the notion of physiological rationality of behavior. We further suggest a formal basis for temporal discounting of rewards by showing that discounting motivates animals to follow the shortest path in the space of physiological variables toward the desired setpoint. We also explain how animals learn to act predictively to preclude prospective homeostatic challenges, and several other behavioral patterns. Finally, we suggest a computational role for interaction between hypothalamus and the brain reward system. DOI: http://dx.doi.org/10.7554/eLife.04811.001 PMID:25457346

  4. Reward Circuitry in Addiction.

    PubMed

    Cooper, Sarah; Robison, A J; Mazei-Robison, Michelle S

    2017-07-01

    Understanding the brain circuitry that underlies reward is critical to improve treatment for many common health issues, including obesity, depression, and addiction. Here we focus on insights into the organization and function of reward circuitry and its synaptic and structural adaptations in response to cocaine exposure. While the importance of certain circuits, such as the mesocorticolimbic dopamine pathway, are well established in drug reward, recent studies using genetics-based tools have revealed functional changes throughout the reward circuitry that contribute to different facets of addiction, such as relapse and craving. The ability to observe and manipulate neuronal activity within specific cell types and circuits has led to new insight into not only the basic connections between brain regions, but also the molecular changes within these specific microcircuits, such as neurotrophic factor and GTPase signaling or α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) receptor function, that underlie synaptic and structural plasticity evoked by drugs of abuse. Excitingly, these insights from preclinical rodent work are now being translated into the clinic, where transcranial magnetic simulation and deep brain stimulation therapies are being piloted in human cocaine dependence. Thus, this review seeks to summarize current understanding of the major brain regions implicated in drug-related behaviors and the molecular mechanisms that contribute to altered connectivity between these regions, with the postulation that increased knowledge of the plasticity within the drug reward circuit will lead to new and improved treatments for addiction.

  5. An imaging genetics approach to understanding social influence

    PubMed Central

    Falk, Emily B.; Way, Baldwin M.; Jasinska, Agnes J.

    2012-01-01

    Normative social influences shape nearly every aspect of our lives, yet the biological processes mediating the impact of these social influences on behavior remain incompletely understood. In this Hypothesis, we outline a theoretical framework and an integrative research approach to the study of social influences on the brain and genetic moderators of such effects. First, we review neuroimaging evidence linking social influence and conformity to the brain's reward system. We next review neuroimaging evidence linking social punishment (exclusion) to brain systems involved in the experience of pain, as well as evidence linking exclusion to conformity. We suggest that genetic variants that increase sensitivity to social cues may predispose individuals to be more sensitive to either social rewards or punishments (or potentially both), which in turn increases conformity and susceptibility to normative social influences more broadly. To this end, we review evidence for genetic moderators of neurochemical responses in the brain, and suggest ways in which genes and pharmacology may modulate sensitivity to social influences. We conclude by proposing an integrative imaging genetics approach to the study of brain mediators and genetic modulators of a variety of social influences on human attitudes, beliefs, and actions. PMID:22701416

  6. Hunger is the best spice: an fMRI study of the effects of attention, hunger and calorie content on food reward processing in the amygdala and orbitofrontal cortex.

    PubMed

    Siep, Nicolette; Roefs, Anne; Roebroeck, Alard; Havermans, Remco; Bonte, Milene L; Jansen, Anita

    2009-03-02

    Research indicates that dysfunctional food reward processing may contribute to pathological eating behaviour. It is widely recognized that both the amygdala and the orbitofrontal cortex (OFC) are essential parts of the brain's reward circuitry. The aims of this fMRI study were (1) to examine the effects of food deprivation and calorie content on reward processing in the amygdala and the OFC, and (2) to examine whether an explicit evaluation of foods is necessary for OFC, but not amygdalar activity. Addressing the first aim, healthy females were presented with high and low calorie food pictures while being either hungry or satiated. For the second aim, attention focus was manipulated by directing participants' attention either to the food or to a neutral aspect. This study shows that hunger interacts with the energy content of foods, modulating activity in the posterior cingulate cortex, medial OFC, insula, caudate putamen and fusiform gyrus. Results show that satiated healthy females show an increased reward processing in response to low calorie foods. Confirming our hypothesis, food deprivation increased activity following the presentation of high calorie foods, which may explain why treatments of obesity energy restricting diets often are unsuccessful. Interestingly, activity in both the amygdala and mOFC was only evident when participants explicitly evaluated foods. However, attention independent activity was found in the mPFC following the high calorie foods cues when participants where hungry. Current findings indicate that research on how attention modulates food reward processing might prove especially insightful in the study of the neural substrates of healthy and pathological eating behaviour.

  7. The endocannabinoid system and nondrug rewarding behaviours.

    PubMed

    Fattore, Liana; Melis, Miriam; Fadda, Paola; Pistis, Marco; Fratta, Walter

    2010-07-01

    Rewarding behaviours such as sexual activity, eating, nursing, parenting, social interactions, and play activity are conserved strongly in evolution, and they are essential for development and survival. All of these behaviours are enjoyable and represent pleasant experiences with a high reward value. Remarkably, rewarding behaviours activate the same brain circuits that mediate the positive reinforcing effects of drugs of abuse and of other forms of addiction, such as gambling and food addiction. Given the involvement of the endocannabinoid system in a variety of physiological functions of the nervous system, it is not surprising that it takes part in the complex machinery that regulates gratification and perception of pleasure. In this review, we focus first on the role of the endocannabinoid system in the modulation of neural activity and synaptic functions in brain regions that are involved in natural and nonnatural rewards (namely, the ventral tegmental area, striatum, amygdala, and prefrontal cortex). Then, we examine the role of the endocannabinoid system in modulating behaviours that directly or indirectly activate these brain reward pathways. More specifically, current knowledge of the effects of the pharmacological manipulation of the endocannabinoid system on natural (eating, sexual behaviour, parenting, and social play) and pathological (gambling) rewarding behaviours is summarised and discussed. Copyright 2010 Elsevier Inc. All rights reserved.

  8. A common currency for the computation of motivational values in the human striatum

    PubMed Central

    Li, Yansong; Dreher, Jean-Claude

    2015-01-01

    Reward comparison in the brain is thought to be achieved through the use of a ‘common currency’, implying that reward value representations are computed on a unique scale in the same brain regions regardless of the reward type. Although such a mechanism has been identified in the ventro-medial prefrontal cortex and ventral striatum in the context of decision-making, it is less clear whether it similarly applies to non-choice situations. To answer this question, we scanned 38 participants with fMRI while they were presented with single cues predicting either monetary or erotic rewards, without the need to make a decision. The ventral striatum was the main brain structure to respond to both cues while showing increasing activity with increasing expected reward intensity. Most importantly, the relative response of the striatum to monetary vs erotic cues was correlated with the relative motivational value of these rewards as inferred from reaction times. Similar correlations were observed in a fronto-parietal network known to be involved in attentional focus and motor readiness. Together, our results suggest that striatal reward value signals not only obey to a common currency mechanism in the absence of choice but may also serve as an input to adjust motivated behaviour accordingly. PMID:24837478

  9. Altered reward system reactivity for personalized circumscribed interests in autism.

    PubMed

    Kohls, Gregor; Antezana, Ligia; Mosner, Maya G; Schultz, Robert T; Yerys, Benjamin E

    2018-01-01

    Neurobiological research in autism spectrum disorders (ASD) has paid little attention on brain mechanisms that cause and maintain restricted and repetitive behaviors and interests (RRBIs). Evidence indicates an imbalance in the brain's reward system responsiveness to social and non-social stimuli may contribute to both social deficits and RRBIs. Thus, this study's central aim was to compare brain responsiveness to individual RRBI (i.e., circumscribed interests), with social rewards (i.e., social approval), in youth with ASD relative to typically developing controls (TDCs). We conducted a 3T functional magnetic resonance imaging (fMRI) study to investigate the blood-oxygenation-level-dependent effect of personalized circumscribed interest rewards versus social rewards in 39 youth with ASD relative to 22 TDC. To probe the reward system, we employed short video clips as reinforcement in an instrumental incentive delay task. This optimization increased the task's ecological validity compared to still pictures that are often used in this line of research. Compared to TDCs, youth with ASD had stronger reward system responses for CIs mostly within the non-social realm (e.g., video games) than social rewards (e.g., approval). Additionally, this imbalance within the caudate nucleus' responsiveness was related to greater social impairment. The current data support the idea of reward system dysfunction that may contribute to enhanced motivation for RRBIs in ASD, accompanied by diminished motivation for social engagement. If a dysregulated reward system indeed supports the emergence and maintenance of social and non-social symptoms of ASD, then strategically targeting the reward system in future treatment endeavors may allow for more efficacious treatment practices that help improve outcomes for individuals with ASD and their families.

  10. The Effects of Experimental Manipulation of Sleep Duration on Neural Response to Food Cues.

    PubMed

    Demos, Kathryn E; Sweet, Lawrence H; Hart, Chantelle N; McCaffery, Jeanne M; Williams, Samantha E; Mailloux, Kimberly A; Trautvetter, Jennifer; Owens, Max M; Wing, Rena R

    2017-11-01

    Despite growing literature on neural food cue responsivity in obesity, little is known about how the brain processes food cues following partial sleep deprivation and whether short sleep leads to changes similar to those observed in obesity. We used functional magnetic resonance imaging (fMRI) to test the hypothesis that short sleep leads to increased reward-related and decreased inhibitory control-related processing of food cues.In a within-subject design, 30 participants (22 female, mean age = 36.7 standard deviation = 10.8 years, body mass index range 20.4-40.7) completed four nights of 6 hours/night time-in-bed (TIB; short sleep) and four nights of 9 hours/night TIB (long sleep) in random counterbalanced order in their home environments. Following each sleep condition, participants completed an fMRI scan while viewing food and nonfood images.A priori region of interest analyses revealed increased activity to food in short versus long sleep in regions of reward processing (eg, nucleus accumbens/putamen) and sensory/motor signaling (ie, right paracentral lobule, an effect that was most pronounced in obese individuals). Contrary to the hypothesis, whole brain analyses indicated greater food cue responsivity during short sleep in an inhibitory control region (right inferior frontal gyrus) and ventral medial prefrontal cortex, which has been implicated in reward coding and decision-making (false discovery rate corrected q = 0.05).These findings suggest that sleep restriction leads to both greater reward and control processing in response to food cues. Future research is needed to understand the dynamic functional connectivity between these regions during short sleep and whether the interplay between these neural processes determines if one succumbs to food temptation. © Sleep Research Society 2017. Published by Oxford University Press on behalf of the Sleep Research Society. All rights reserved. For permissions, please e-mail journals.permissions@oup.com.

  11. Neural computations underlying inverse reinforcement learning in the human brain

    PubMed Central

    Pauli, Wolfgang M; Bossaerts, Peter; O'Doherty, John

    2017-01-01

    In inverse reinforcement learning an observer infers the reward distribution available for actions in the environment solely through observing the actions implemented by another agent. To address whether this computational process is implemented in the human brain, participants underwent fMRI while learning about slot machines yielding hidden preferred and non-preferred food outcomes with varying probabilities, through observing the repeated slot choices of agents with similar and dissimilar food preferences. Using formal model comparison, we found that participants implemented inverse RL as opposed to a simple imitation strategy, in which the actions of the other agent are copied instead of inferring the underlying reward structure of the decision problem. Our computational fMRI analysis revealed that anterior dorsomedial prefrontal cortex encoded inferences about action-values within the value space of the agent as opposed to that of the observer, demonstrating that inverse RL is an abstract cognitive process divorceable from the values and concerns of the observer him/herself. PMID:29083301

  12. Impaired implicit learning and feedback processing after stroke.

    PubMed

    Lam, J M; Globas, C; Hosp, J A; Karnath, H-O; Wächter, T; Luft, A R

    2016-02-09

    The ability to learn is assumed to support successful recovery and rehabilitation therapy after stroke. Hence, learning impairments may reduce the recovery potential. Here, the hypothesis is tested that stroke survivors have deficits in feedback-driven implicit learning. Stroke survivors (n=30) and healthy age-matched control subjects (n=21) learned a probabilistic classification task with brain activation measured using functional magnetic resonance imaging in a subset of these individuals (17 stroke and 10 controls). Stroke subjects learned slower than controls to classify cues. After being rewarded with a smiley face, they were less likely to give the same response when the cue was repeated. Stroke subjects showed reduced brain activation in putamen, pallidum, thalamus, frontal and prefrontal cortices and cerebellum when compared with controls. Lesion analysis identified those stroke survivors as learning-impaired who had lesions in frontal areas, putamen, thalamus, caudate and insula. Lesion laterality had no effect on learning efficacy or brain activation. These findings suggest that stroke survivors have deficits in reinforcement learning that may be related to dysfunctional processing of feedback-based decision-making, reward signals and working memory. Copyright © 2015 IBRO. Published by Elsevier Ltd. All rights reserved.

  13. Trading Later Rewards for Current Pleasure: Pornography Consumption and Delay Discounting.

    PubMed

    Negash, Sesen; Sheppard, Nicole Van Ness; Lambert, Nathaniel M; Fincham, Frank D

    2016-01-01

    Internet pornography is a multi-billion-dollar industry that has grown increasingly accessible. Delay discounting involves devaluing larger, later rewards in favor of smaller, more immediate rewards. The constant novelty and primacy of sexual stimuli as particularly strong natural rewards make Internet pornography a unique activator of the brain's reward system, thereby having implications for decision-making processes. Based on theoretical studies of evolutionary psychology and neuroeconomics, two studies tested the hypothesis that consuming Internet pornography would relate to higher rates of delay discounting. Study 1 used a longitudinal design. Participants completed a pornography use questionnaire and a delay discounting task at Time 1 and then again four weeks later. Participants reporting higher initial pornography use demonstrated a higher delay discounting rate at Time 2, controlling for initial delay discounting. Study 2 tested for causality with an experimental design. Participants were randomly assigned to abstain from either their favorite food or pornography for three weeks. Participants who abstained from pornography use demonstrated lower delay discounting than participants who abstained from their favorite food. The finding suggests that Internet pornography is a sexual reward that contributes to delay discounting differently than other natural rewards. Theoretical and clinical implications of these studies are highlighted.

  14. Separating the effect of reward from corrective feedback during learning in patients with Parkinson's disease.

    PubMed

    Freedberg, Michael; Schacherer, Jonathan; Chen, Kuan-Hua; Uc, Ergun Y; Narayanan, Nandakumar S; Hazeltine, Eliot

    2017-06-01

    Parkinson's disease (PD) is associated with procedural learning deficits. Nonetheless, studies have demonstrated that reward-related learning is comparable between patients with PD and controls (Bódi et al., Brain, 132(9), 2385-2395, 2009; Frank, Seeberger, & O'Reilly, Science, 306(5703), 1940-1943, 2004; Palminteri et al., Proceedings of the National Academy of Sciences of the United States of America, 106(45), 19179-19184, 2009). However, because these studies do not separate the effect of reward from the effect of practice, it is difficult to determine whether the effect of reward on learning is distinct from the effect of corrective feedback on learning. Thus, it is unknown whether these group differences in learning are due to reward processing or learning in general. Here, we compared the performance of medicated PD patients to demographically matched healthy controls (HCs) on a task where the effect of reward can be examined separately from the effect of practice. We found that patients with PD showed significantly less reward-related learning improvements compared to HCs. In addition, stronger learning of rewarded associations over unrewarded associations was significantly correlated with smaller skin-conductance responses for HCs but not PD patients. These results demonstrate that when separating the effect of reward from the effect of corrective feedback, PD patients do not benefit from reward.

  15. Intranasal Oxytocin Enhances Connectivity in the Neural Circuitry Supporting Social Motivation and Social Perception in Children with Autism.

    PubMed

    Gordon, Ilanit; Jack, Allison; Pretzsch, Charlotte M; Vander Wyk, Brent; Leckman, James F; Feldman, Ruth; Pelphrey, Kevin A

    2016-11-15

    Oxytocin (OT) has become a focus in investigations of autism spectrum disorder (ASD). The social deficits that characterize ASD may relate to reduced connectivity between brain sites on the mesolimbic reward pathway (nucleus accumbens; amygdala) that receive OT projections and contribute to social motivation, and cortical sites involved in social perception. Using functional magnetic resonance imaging and a randomized, double blind, placebo-controlled crossover design, we show that OT administration in ASD increases activity in brain regions important for perceiving social-emotional information. Further, OT enhances connectivity between nodes of the brain's reward and socioemotional processing systems, and does so preferentially for social (versus nonsocial) stimuli. This effect is observed both while viewing coherent versus scrambled biological motion, and while listening to happy versus angry voices. Our findings suggest a mechanism by which intranasal OT may bolster social motivation-one that could, in future, be harnessed to augment behavioral treatments for ASD.

  16. Social learning through prediction error in the brain

    NASA Astrophysics Data System (ADS)

    Joiner, Jessica; Piva, Matthew; Turrin, Courtney; Chang, Steve W. C.

    2017-06-01

    Learning about the world is critical to survival and success. In social animals, learning about others is a necessary component of navigating the social world, ultimately contributing to increasing evolutionary fitness. How humans and nonhuman animals represent the internal states and experiences of others has long been a subject of intense interest in the developmental psychology tradition, and, more recently, in studies of learning and decision making involving self and other. In this review, we explore how psychology conceptualizes the process of representing others, and how neuroscience has uncovered correlates of reinforcement learning signals to explore the neural mechanisms underlying social learning from the perspective of representing reward-related information about self and other. In particular, we discuss self-referenced and other-referenced types of reward prediction errors across multiple brain structures that effectively allow reinforcement learning algorithms to mediate social learning. Prediction-based computational principles in the brain may be strikingly conserved between self-referenced and other-referenced information.

  17. The role of orgasm in the development and shaping of partner preferences.

    PubMed

    Coria-Avila, Genaro A; Herrera-Covarrubias, Deissy; Ismail, Nafissa; Pfaus, James G

    2016-01-01

    The effect of orgasm on the development and shaping of partner preferences may involve a catalysis of the neurochemical mechanisms of bonding. Therefore, understanding such process is relevant for neuroscience and psychology. A systematic review was carried out using the terms Orgasm, Sexual Reward, Partner Preference, Pair Bonding, Brain, Learning, Sex, Copulation. In humans, concentrations of arousing neurotransmitters and potential bonding neurotransmitters increase during orgasm in the cerebrospinal fluid and the bloodstream. Similarly, studies in animals indicate that those neurotransmitters (noradrenaline, oxytocin, prolactin) and others (e.g. dopamine, opioids, serotonin) modulate the appetitive and consummatory phases of sexual behavior and reward. This suggests a link between the experience of orgasm/sexual reward and the neurochemical mechanisms of pair bonding. Orgasm/reward functions as an unconditioned stimulus (UCS). Some areas in the nervous system function as UCS-detection centers, which become activated during orgasm. Partner-related cues function as conditioned stimuli (CS) and are processed in CS-detector centers. Throughout the article, we discuss how UCS- and CS-detection centers must interact to facilitate memory consolidation and produce recognition and motivation during future social encounters.

  18. Caudate responses to reward anticipation associated with delay discounting behavior in healthy youth

    PubMed Central

    Benningfield, Margaret M.; Blackford, Jennifer U.; Ellsworth, Melissa E.; Samanez-Larkin, Gregory R.; Martin, Peter R.; Cowan, Ronald L.; Zald, David H.

    2014-01-01

    Background Choices requiring delay of gratification made during adolescence can have significant impact on life trajectory. Willingness to delay gratification can be measured using delay discounting tasks that require a choice between a smaller immediate reward and a larger delayed reward. Individual differences in the subjective value of delayed rewards are associated with risk for development of psychopathology including substance abuse. The neurobiological underpinnings related to these individual differences early in life are not fully understood. Using functional magnetic resonance imaging (fMRI), we tested the hypothesis that individual differences in delay discounting behavior in healthy youth are related to differences in responsiveness to potential reward. Method Nineteen 10 to 14 year-olds performed a monetary incentive delay task to assess neural sensitivity to potential reward and a questionnaire to measure discounting of future monetary rewards. Results Left ventromedial caudate activation during anticipation of potential reward was negatively correlated with delay discounting behavior. There were no regions where brain responses during notification of reward outcome were associated with discounting behavior. Conclusions Brain activation during anticipation of potential reward may serve as a marker for individual differences in ability or willingness to delay gratification in healthy youth. PMID:24309299

  19. Neural correlates of reward-based spatial learning in persons with cocaine dependence.

    PubMed

    Tau, Gregory Z; Marsh, Rachel; Wang, Zhishun; Torres-Sanchez, Tania; Graniello, Barbara; Hao, Xuejun; Xu, Dongrong; Packard, Mark G; Duan, Yunsuo; Kangarlu, Alayar; Martinez, Diana; Peterson, Bradley S

    2014-02-01

    Dysfunctional learning systems are thought to be central to the pathogenesis of and impair recovery from addictions. The functioning of the brain circuits for episodic memory or learning that support goal-directed behavior has not been studied previously in persons with cocaine dependence (CD). Thirteen abstinent CD and 13 healthy participants underwent MRI scanning while performing a task that requires the use of spatial cues to navigate a virtual-reality environment and find monetary rewards, allowing the functional assessment of the brain systems for spatial learning, a form of episodic memory. Whereas both groups performed similarly on the reward-based spatial learning task, we identified disturbances in brain regions involved in learning and reward in CD participants. In particular, CD was associated with impaired functioning of medial temporal lobe (MTL), a brain region that is crucial for spatial learning (and episodic memory) with concomitant recruitment of striatum (which normally participates in stimulus-response, or habit, learning), and prefrontal cortex. CD was also associated with enhanced sensitivity of the ventral striatum to unexpected rewards but not to expected rewards earned during spatial learning. We provide evidence that spatial learning in CD is characterized by disturbances in functioning of an MTL-based system for episodic memory and a striatum-based system for stimulus-response learning and reward. We have found additional abnormalities in distributed cortical regions. Consistent with findings from animal studies, we provide the first evidence in humans describing the disruptive effects of cocaine on the coordinated functioning of multiple neural systems for learning and memory.

  20. Decision Utility, Incentive Salience, and Cue-Triggered “Wanting”

    PubMed Central

    Berridge, Kent C.; Aldridge, J. Wayne

    2010-01-01

    This chapter examines brain mechanisms of reward utility operating at particular decision moments in life—moments such as when one encounters an image, sound, scent, or other cue associated in the past with a particular reward or perhaps just when one vividly imagines that cue. Such a cue can often trigger a sudden motivational urge to pursue its reward and sometimes a decision to do so. Drawing on a utility taxonomy that distinguishes among subtypes of reward utility—predicted utility, decision utility, experienced utility, and remembered utility—it is shown how cue-triggered cravings, such as an addict’s surrender to relapse, can hang on special transformations by brain mesolimbic systems of one utility subtype, namely, decision utility. The chapter focuses on a particular form of decision utility called incentive salience, a type of “wanting” for rewards that is amplified by brain mesolimbic systems. Sudden peaks of intensity of incentive salience, caused by neurobiological mechanisms, can elevate the decision utility of a particular reward at the moment its cue occurs. An understanding of what happens at such moments leads to a better understanding of the mechanisms at work in decision making in general. PMID:25309963

  1. Decision Utility, Incentive Salience, and Cue-Triggered "Wanting"

    PubMed

    Berridge, Kent C; Aldridge, J Wayne

    2009-01-01

    This chapter examines brain mechanisms of reward utility operating at particular decision moments in life-moments such as when one encounters an image, sound, scent, or other cue associated in the past with a particular reward or perhaps just when one vividly imagines that cue. Such a cue can often trigger a sudden motivational urge to pursue its reward and sometimes a decision to do so. Drawing on a utility taxonomy that distinguishes among subtypes of reward utility-predicted utility, decision utility, experienced utility, and remembered utility-it is shown how cue-triggered cravings, such as an addict's surrender to relapse, can hang on special transformations by brain mesolimbic systems of one utility subtype, namely, decision utility. The chapter focuses on a particular form of decision utility called incentive salience, a type of "wanting" for rewards that is amplified by brain mesolimbic systems. Sudden peaks of intensity of incentive salience, caused by neurobiological mechanisms, can elevate the decision utility of a particular reward at the moment its cue occurs. An understanding of what happens at such moments leads to a better understanding of the mechanisms at work in decision making in general.

  2. Major depression in mothers predict reduced ventral striatum activation in adolescent female offspring with and without depression

    USDA-ARS?s Scientific Manuscript database

    Prior research has identified reduced reward-related brain activation as a promising endophenotype for the early identification of adolescents with major depressive disorder. However, it is unclear whether reduced reward-related brain activation constitutes a true vulnerability for major depressive ...

  3. The human sexual response cycle: brain imaging evidence linking sex to other pleasures.

    PubMed

    Georgiadis, J R; Kringelbach, M L

    2012-07-01

    Sexual behavior is critical to species survival, yet comparatively little is known about the neural mechanisms in the human brain. Here we systematically review the existing human brain imaging literature on sexual behavior and show that the functional neuroanatomy of sexual behavior is comparable to that involved in processing other rewarding stimuli. Sexual behavior clearly follows the established principles and phases for wanting, liking and satiety involved in the pleasure cycle of other rewards. The studies have uncovered the brain networks involved in sexual wanting or motivation/anticipation, as well as sexual liking or arousal/consummation, while there is very little data on sexual satiety or post-orgasmic refractory period. Human sexual behavior also interacts with other pleasures, most notably social interaction and high arousal states. We discuss the changes in the underlying brain networks supporting sexual behavior in the context of the pleasure cycle, the changes to this cycle over the individual's life-time and the interactions between them. Overall, it is clear from the data that the functional neuroanatomy of sex is very similar to that of other pleasures and that it is unlikely that there is anything special about the brain mechanisms and networks underlying sex. Copyright © 2012 Elsevier Ltd. All rights reserved.

  4. Effort-based cost-benefit valuation and the human brain

    PubMed Central

    Croxson, Paula L; Walton, Mark E; O'Reilly, Jill X; Behrens, Timothy EJ; Rushworth, Matthew FS

    2010-01-01

    In both the wild and the laboratory, animals' preferences for one course of action over another reflect not just reward expectations but also the cost in terms of effort that must be invested in pursuing the course of action. The ventral striatum and dorsal anterior cingulate cortex (ACCd) are implicated in the making of cost-benefit decisions in the rat but there is little information about how effort costs are processed and influence calculations of expected net value in other mammals including the human. We carried out a functional magnetic resonance imaging (fMRI) study to determine whether and where activity in the human brain was available to guide effort-based cost-benefit valuation. Subjects were scanned while they performed a series of effortful actions to obtain secondary reinforcers. At the beginning of each trial, subjects were presented with one of eight different visual cues which they had learned indicated how much effort the course of action would entail and how much reward could be expected at its completion. Cue-locked activity in the ventral striatum and midbrain reflected the net value of the course of action, signaling the expected amount of reward discounted by the amount of effort to be invested. Activity in ACCd also reflected the interaction of both expected reward and effort costs. Posterior orbitofrontal and insular activity, however, only reflected the expected reward magnitude. The ventral striatum and anterior cingulate cortex may be the substrate of effort-based cost-benefit valuation in primates as well as in rats. PMID:19357278

  5. Antireward, compulsivity, and addiction: seminal contributions of Dr. Athina Markou to motivational dysregulation in addiction.

    PubMed

    Koob, George F

    2017-05-01

    Addiction is defined as a chronically relapsing disorder characterized by compulsive drug seeking that is hypothesized to derive from multiple sources of motivational dysregulation. Dr. Athina Markou made seminal contributions to our understanding of the neurobiology of addiction with her studies on the dysregulation of reward function using animal models with construct validity. Repeated overstimulation of the reward systems with drugs of abuse decreases reward function, characterized by brain stimulation reward and presumbably reflecting dysphoria-like states. The construct of negative reinforcement, defined as drug taking that alleviates a negative emotional state that is created by drug abstinence, is particularly relevant as a driving force in both the withdrawal/negative affect and preoccupation/anticipation stages of the addiction cycle. The negative emotional state that drives such negative reinforcement is hypothesized to derive from the dysregulation of key neurochemical circuits that drive incentive-salience/reward systems (dopamine, opioid peptides) in the ventral striatum and from the recruitment of brain stress systems (corticotropin-releasing factor, dynorphin) within the extended amygdala. As drug taking becomes compulsive-like, the factors that motivate behavior are hypothesized to shift to drug-seeking behavior that is driven not only by positive reinforcement but also by negative reinforcement. This shift in motivation is hypothesized to reflect the allostatic misregulation of hedonic tone such that drug taking makes the hedonic negative emotional state worse during the process of seeking temporary relief with compulsive drug taking.

  6. Greater impulsivity is associated with decreased brain activation in obese women during a delay discounting task.

    PubMed

    Stoeckel, Luke E; Murdaugh, Donna L; Cox, James E; Cook, Edwin W; Weller, Rosalyn E

    2013-06-01

    Impulsivity and poor inhibitory control are associated with higher rates of delay discounting (DD), or a greater preference for smaller, more immediate rewards at the expense of larger, but delayed rewards. Of the many functional magnetic resonance imaging (fMRI) studies of DD, few have investigated the correlation between individual differences in DD rate and brain activation related to DD trial difficulty, with difficult DD trials expected to activate putative executive function brain areas involved in impulse control. In the current study, we correlated patterns of brain activation as measured by fMRI during difficult vs. easy trials of a DD task with DD rate (k) in obese women. Difficulty was defined by how much a reward choice deviated from an individual's 'indifference point', or the point where the subjective preference for an immediate and a delayed reward was approximately equivalent. We found that greater delay discounting was correlated with less modulation of activation in putative executive function brain areas, such as the middle and superior frontal gyri and inferior parietal lobule, in response to difficult compared to easy DD trials. These results support the suggestion that increased impulsivity is associated with deficient functioning of executive function areas of the brain.

  7. Modulation of frontostriatal interaction aligns with reduced primary reward processing under serotonergic drugs.

    PubMed

    Abler, Birgit; Grön, Georg; Hartmann, Antonie; Metzger, Coraline; Walter, Martin

    2012-01-25

    Recently, functional interactions between anteroventral prefrontal cortex and nucleus accumbens (NAcc) have been shown to relate to behavior counteracting reward-desiring (Diekhof and Gruber, 2010). Downregulation of the reward system by serotonin has also been suggested as the mode of action accounting for unsatisfactory effects of serotonin reuptake inhibitors (SSRIs) such as insufficient alleviation or even increase of anhedonia, and loss of interest. However, understanding of the in vivo mechanisms of SSRI-related alteration of the human reward system is still incomplete. Using functional magnetic resonance imaging (fMRI) within a double-blind cross-over within-subjects study design and administering the SSRI paroxetine, the dopamine/norepinephrine reuptake inhibitor bupropione, and placebo for 7 d each, we investigated a group of 18 healthy male subjects. Under paroxetine, subjects showed significantly decreased activation of the bilateral NAcc during processing of primary rewards (erotic videos), but not under bupropion. Similar to the previous study, analysis of psychophysiological interactions revealed that this downregulation relied on negative interactions between left and right NAcc fMRI signals and the bilateral anteroventral prefrontal cortex that now were significantly enhanced under paroxetine and reduced under bupropion. Individual drug-dependent modulations of interacting brain regions were significantly associated with individual expressions of impulsivity as a personality trait. Our results corroborate and extend previous insights on interregional crosstalk from secondary to primary rewards and demonstrate parallels between active inhibitory control of and serotonergic effects on the dopaminergic reward system's activity.

  8. Mechanisms Underlying the Risk to Develop Drug Addiction, Insights From Studies in Drosophila melanogaster.

    PubMed

    Ryvkin, Julia; Bentzur, Assa; Zer-Krispil, Shir; Shohat-Ophir, Galit

    2018-01-01

    The ability to adapt to environmental changes is an essential feature of biological systems, achieved in animals by a coordinated crosstalk between neuronal and hormonal programs that allow rapid and integrated organismal responses. Reward systems play a key role in mediating this adaptation by reinforcing behaviors that enhance immediate survival, such as eating or drinking, or those that ensure long-term survival, such as sexual behavior or caring for offspring. Drugs of abuse co-opt neuronal and molecular pathways that mediate natural rewards, which under certain circumstances can lead to addiction. Many factors can contribute to the transition from drug use to drug addiction, highlighting the need to discover mechanisms underlying the progression from initial drug use to drug addiction. Since similar responses to natural and drug rewards are present in very different animals, it is likely that the central systems that process reward stimuli originated early in evolution, and that common ancient biological principles and genes are involved in these processes. Thus, the neurobiology of natural and drug rewards can be studied using simpler model organisms that have their systems stripped of some of the immense complexity that exists in mammalian brains. In this paper we review studies in Drosophila melanogaster that model different aspects of natural and drug rewards, with an emphasis on how motivational states shape the value of the rewarding experience, as an entry point to understanding the mechanisms that contribute to the vulnerability of drug addiction.

  9. Neurocomputational mechanisms underlying subjective valuation of effort costs

    PubMed Central

    Giehl, Kathrin; Sillence, Annie

    2017-01-01

    In everyday life, we have to decide whether it is worth exerting effort to obtain rewards. Effort can be experienced in different domains, with some tasks requiring significant cognitive demand and others being more physically effortful. The motivation to exert effort for reward is highly subjective and varies considerably across the different domains of behaviour. However, very little is known about the computational or neural basis of how different effort costs are subjectively weighed against rewards. Is there a common, domain-general system of brain areas that evaluates all costs and benefits? Here, we used computational modelling and functional magnetic resonance imaging (fMRI) to examine the mechanisms underlying value processing in both the cognitive and physical domains. Participants were trained on two novel tasks that parametrically varied either cognitive or physical effort. During fMRI, participants indicated their preferences between a fixed low-effort/low-reward option and a variable higher-effort/higher-reward offer for each effort domain. Critically, reward devaluation by both cognitive and physical effort was subserved by a common network of areas, including the dorsomedial and dorsolateral prefrontal cortex, the intraparietal sulcus, and the anterior insula. Activity within these domain-general areas also covaried negatively with reward and positively with effort, suggesting an integration of these parameters within these areas. Additionally, the amygdala appeared to play a unique, domain-specific role in processing the value of rewards associated with cognitive effort. These results are the first to reveal the neurocomputational mechanisms underlying subjective cost–benefit valuation across different domains of effort and provide insight into the multidimensional nature of motivation. PMID:28234892

  10. Reward and motivation in pain and pain relief

    PubMed Central

    Navratilova, Edita; Porreca, Frank

    2015-01-01

    Pain is fundamentally unpleasant, a feature that protects the organism by promoting motivation and learning. Relief of aversive states, including pain, is rewarding. The aversiveness of pain, as well as the reward from relief of pain, is encoded by brain reward/motivational mesocorticolimbic circuitry. In this Review, we describe current knowledge of the impact of acute and chronic pain on reward/motivation circuits gained from preclinical models and from human neuroimaging. We highlight emerging clinical evidence suggesting that anatomical and functional changes in these circuits contribute to the transition from acute to chronic pain. We propose that assessing activity in these conserved circuits can offer new outcome measures for preclinical evaluation of analgesic efficacy to improve translation and speed drug discovery. We further suggest that targeting reward/motivation circuits may provide a path for normalizing the consequences of chronic pain to the brain, surpassing symptomatic management to promote recovery from chronic pain. PMID:25254980

  11. Neural signal during immediate reward anticipation in schizophrenia: Relationship to real-world motivation and function.

    PubMed

    Subramaniam, Karuna; Hooker, Christine I; Biagianti, Bruno; Fisher, Melissa; Nagarajan, Srikantan; Vinogradov, Sophia

    2015-01-01

    Amotivation in schizophrenia is a central predictor of poor functioning, and is thought to occur due to deficits in anticipating future rewards, suggesting that impairments in anticipating pleasure can contribute to functional disability in schizophrenia. In healthy comparison (HC) participants, reward anticipation is associated with activity in frontal-striatal networks. By contrast, schizophrenia (SZ) participants show hypoactivation within these frontal-striatal networks during this motivated anticipatory brain state. Here, we examined neural activation in SZ and HC participants during the anticipatory phase of stimuli that predicted immediate upcoming reward and punishment, and during the feedback/outcome phase, in relation to trait measures of hedonic pleasure and real-world functional capacity. SZ patients showed hypoactivation in ventral striatum during reward anticipation. Additionally, we found distinct differences between HC and SZ groups in their association between reward-related immediate anticipatory neural activity and their reported experience of pleasure. HC participants recruited reward-related regions in striatum that significantly correlated with subjective consummatory pleasure, while SZ patients revealed activation in attention-related regions, such as the IPL, which correlated with consummatory pleasure and functional capacity. These findings may suggest that SZ patients activate compensatory attention processes during anticipation of immediate upcoming rewards, which likely contribute to their functional capacity in daily life.

  12. Neural signal during immediate reward anticipation in schizophrenia: Relationship to real-world motivation and function

    PubMed Central

    Subramaniam, Karuna; Hooker, Christine I.; Biagianti, Bruno; Fisher, Melissa; Nagarajan, Srikantan; Vinogradov, Sophia

    2015-01-01

    Amotivation in schizophrenia is a central predictor of poor functioning, and is thought to occur due to deficits in anticipating future rewards, suggesting that impairments in anticipating pleasure can contribute to functional disability in schizophrenia. In healthy comparison (HC) participants, reward anticipation is associated with activity in frontal–striatal networks. By contrast, schizophrenia (SZ) participants show hypoactivation within these frontal–striatal networks during this motivated anticipatory brain state. Here, we examined neural activation in SZ and HC participants during the anticipatory phase of stimuli that predicted immediate upcoming reward and punishment, and during the feedback/outcome phase, in relation to trait measures of hedonic pleasure and real-world functional capacity. SZ patients showed hypoactivation in ventral striatum during reward anticipation. Additionally, we found distinct differences between HC and SZ groups in their association between reward-related immediate anticipatory neural activity and their reported experience of pleasure. HC participants recruited reward-related regions in striatum that significantly correlated with subjective consummatory pleasure, while SZ patients revealed activation in attention-related regions, such as the IPL, which correlated with consummatory pleasure and functional capacity. These findings may suggest that SZ patients activate compensatory attention processes during anticipation of immediate upcoming rewards, which likely contribute to their functional capacity in daily life. PMID:26413478

  13. Face processing in autism spectrum disorders: from brain regions to brain networks

    PubMed Central

    Nomi, Jason S.; Uddin, Lucina Q.

    2015-01-01

    Autism spectrum disorder (ASD) is characterized by reduced attention to social stimuli including the human face. This hypo-responsiveness to stimuli that are engaging to typically developing individuals may result from dysfunctioning motivation, reward, and attention systems in the brain. Here we review an emerging neuroimaging literature that emphasizes a shift from focusing on hypo-activation of isolated brain regions such as the fusiform gyrus, amygdala, and superior temporal sulcus in ASD to a more holistic approach to understanding face perception as a process supported by distributed cortical and subcortical brain networks. We summarize evidence for atypical activation patterns within brain networks that may contribute to social deficits characteristic of the disorder. We conclude by pointing to gaps in the literature and future directions that will continue to shed light on aspects of face processing in autism that are still under-examined. In particular, we highlight the need for more developmental studies and studies examining ecologically valid and naturalistic social stimuli. PMID:25829246

  14. Altered processing of rewarding and aversive basic taste stimuli in symptomatic women with anorexia nervosa and bulimia nervosa: An fMRI study.

    PubMed

    Monteleone, Alessio Maria; Monteleone, Palmiero; Esposito, Fabrizio; Prinster, Anna; Volpe, Umberto; Cantone, Elena; Pellegrino, Francesca; Canna, Antonietta; Milano, Walter; Aiello, Marco; Di Salle, Francesco; Maj, Mario

    2017-07-01

    Functional magnetic resonance imaging (fMRI) studies have displayed a dysregulation in the way in which the brain processes pleasant taste stimuli in patients with anorexia nervosa (AN) and bulimia nervosa (BN). However, exactly how the brain processes disgusting basic taste stimuli has never been investigated, even though disgust plays a role in food intake modulation and AN and BN patients exhibit high disgust sensitivity. Therefore, we investigated the activation of brain areas following the administration of pleasant and aversive basic taste stimuli in symptomatic AN and BN patients compared to healthy subjects. Twenty underweight AN women, 20 symptomatic BN women and 20 healthy women underwent fMRI while tasting 0.292 M sucrose solution (sweet taste), 0.5 mM quinine hydrochloride solution (bitter taste) and water as a reference taste. In symptomatic AN and BN patients the pleasant sweet stimulus induced a higher activation in several brain areas than that induced by the aversive bitter taste. The opposite occurred in healthy controls. Moreover, compared to healthy controls, AN patients showed a decreased response to the bitter stimulus in the right amygdala and left anterior cingulate cortex, while BN patients showed a decreased response to the bitter stimulus in the right amygdala and left insula. These results show an altered processing of rewarding and aversive taste stimuli in ED patients, which may be relevant for understanding the pathophysiology of AN and BN. Copyright © 2017 Elsevier Ltd. All rights reserved.

  15. Time of Day Differences in Neural Reward Functioning in Healthy Young Men.

    PubMed

    Byrne, Jamie E M; Hughes, Matthew E; Rossell, Susan L; Johnson, Sheri L; Murray, Greg

    2017-09-13

    Reward function appears to be modulated by the circadian system, but little is known about the neural basis of this interaction. Previous research suggests that the neural reward response may be different in the afternoon; however, the direction of this effect is contentious. Reward response may follow the diurnal rhythm in self-reported positive affect, peaking in the early afternoon. An alternative is that daily reward response represents a type of prediction error, with neural reward activation relatively high at times of day when rewards are unexpected (i.e., early and late in the day). The present study measured neural reward activation in the context of a validated reward task at 10.00 h, 14.00 h, and 19.00 h in healthy human males. A region of interest BOLD fMRI protocol was used to investigate the diurnal waveform of activation in reward-related brain regions. Multilevel modeling found, as expected, a highly significant quadratic time-of-day effect focusing on the left putamen ( p < 0.001). Consistent with the "prediction error" hypothesis, activation was significantly higher at 10.00 h and 19.00 h compared with 14.00 h. It is provisionally concluded that the putamen may be particularly important in endogenous priming of reward motivation at different times of day, with the pattern of activation consistent with circadian-modulated reward expectancies in neural pathways (i.e., greater activation to reward stimuli at unexpected times of day). This study encourages further research into circadian modulation of reward and underscores the methodological importance of accounting for time of day in fMRI protocols. SIGNIFICANCE STATEMENT This is one of the first studies to use a repeated-measures imaging procedure to explore the diurnal rhythm of reward activation. Although self-reported reward (most often operationalized as positive affect) peaks in the afternoon, the present findings indicate that neural activation is lowest at this time. We conclude that the diurnal neural activation pattern may reflect a prediction error of the brain, where rewards at unexpected times (10.00 h and 19.00 h) elicit higher activation in reward brain regions than at expected (14.00 h) times. These data also have methodological significance, suggesting that there may be a time of day influence, which should be accounted for in neural reward studies. Copyright © 2017 the authors 0270-6474/17/378895-06$15.00/0.

  16. Effects of motivation on reward and attentional networks: an fMRI study.

    PubMed

    Ivanov, Iliyan; Liu, Xun; Clerkin, Suzanne; Schulz, Kurt; Friston, Karl; Newcorn, Jeffrey H; Fan, Jin

    2012-11-01

    Existing evidence suggests that reward and attentional networks function in concert and that activation in one system influences the other in a reciprocal fashion; however, the nature of these influences remains poorly understood. We therefore developed a three-component task to assess the interaction effects of reward anticipation and conflict resolution on the behavioral performance and the activation of brain reward and attentional systems. Sixteen healthy adult volunteers aged 21-45 years were scanned with functional magnetic resonance imaging (fMRI) while performing the task. A two-way repeated measures analysis of variance (ANOVA) with cue (reward vs. non-reward) and target (congruent vs. incongruent) as within-subjects factors was used to test for main and interaction effects. Neural responses to anticipation, conflict, and reward outcomes were tested. Behaviorally there were main effects of both reward cue and target congruency on reaction time. Neuroimaging results showed that reward anticipation and expected reward outcomes activated components of the attentional networks, including the inferior parietal and occipital cortices, whereas surprising non-rewards activated the frontoinsular cortex bilaterally and deactivated the ventral striatum. In turn, conflict activated a broad network associated with cognitive control and motor functions. Interaction effects showed decreased activity in the thalamus, anterior cingulated gyrus, and middle frontal gyrus bilaterally when difficult conflict trials (e.g., incongruent targets) were preceded by reward cues; in contrast, the ventral striatum and orbitofrontal cortex showed greater activation during congruent targets preceded by reward cues. These results suggest that reward anticipation is associated with lower activation in attentional networks, possibly due to increased processing efficiency, whereas more difficult, conflict trials are associated with lower activity in regions of the reward system, possibly because such trials are experienced as less rewarding.

  17. The endogenous opioid system: a common substrate in drug addiction.

    PubMed

    Trigo, José Manuel; Martin-García, Elena; Berrendero, Fernando; Robledo, Patricia; Maldonado, Rafael

    2010-05-01

    Drug addiction is a chronic brain disorder leading to complex adaptive changes within the brain reward circuits that involve several neurotransmitters. One of the neurochemical systems that plays a pivotal role in different aspects of addiction is the endogenous opioid system (EOS). Opioid receptors and endogenous opioid peptides are largely distributed in the mesolimbic system and modulate dopaminergic activity within these reward circuits. Chronic exposure to the different prototypical drugs of abuse, including opioids, alcohol, nicotine, psychostimulants and cannabinoids has been reported to produce significant alterations within the EOS, which seem to play an important role in the development of the addictive process. In this review, we will describe the adaptive changes produced by different drugs of abuse on the EOS, and the current knowledge about the contribution of each component of this neurobiological system to their addictive properties.

  18. Frontal theta and beta synchronizations for monetary reward increase visual working memory capacity

    PubMed Central

    Yamaguchi, Yoko

    2013-01-01

    Visual working memory (VWM) capacity is affected by motivational influences; however, little is known about how reward-related brain activities facilitate the VWM systems. To investigate the dynamic relationship between VWM- and reward-related brain activities, we conducted time–frequency analyses using electroencephalograph (EEG) data obtained during a monetary-incentive delayed-response task that required participants to memorize the position of colored disks. In case of a correct answer, participants received a monetary reward (0, 10 or 50 Japanese yen) announced at the beginning of each trial. Behavioral results showed that VWM capacity under high-reward condition significantly increased compared with that under low- or no-reward condition. EEG results showed that frontal theta (6 Hz) amplitudes enhanced during delay periods and positively correlated with VWM capacity, indicating involvement of theta local synchronizations in VWM. Moreover, frontal beta activities (24 Hz) were identified as reward-related activities, because delay-period amplitudes correlated with increases in VWM capacity between high-reward and no-reward conditions. Interestingly, cross-frequency couplings between frontal theta and beta phases were observed only under high-reward conditions. These findings suggest that the functional dynamic linking between VWM-related theta and reward-related beta activities on the frontal regions plays an integral role in facilitating increases in VWM capacity. PMID:22349800

  19. Frontal theta and beta synchronizations for monetary reward increase visual working memory capacity.

    PubMed

    Kawasaki, Masahiro; Yamaguchi, Yoko

    2013-06-01

    Visual working memory (VWM) capacity is affected by motivational influences; however, little is known about how reward-related brain activities facilitate the VWM systems. To investigate the dynamic relationship between VWM- and reward-related brain activities, we conducted time-frequency analyses using electroencephalograph (EEG) data obtained during a monetary-incentive delayed-response task that required participants to memorize the position of colored disks. In case of a correct answer, participants received a monetary reward (0, 10 or 50 Japanese yen) announced at the beginning of each trial. Behavioral results showed that VWM capacity under high-reward condition significantly increased compared with that under low- or no-reward condition. EEG results showed that frontal theta (6 Hz) amplitudes enhanced during delay periods and positively correlated with VWM capacity, indicating involvement of theta local synchronizations in VWM. Moreover, frontal beta activities (24 Hz) were identified as reward-related activities, because delay-period amplitudes correlated with increases in VWM capacity between high-reward and no-reward conditions. Interestingly, cross-frequency couplings between frontal theta and beta phases were observed only under high-reward conditions. These findings suggest that the functional dynamic linking between VWM-related theta and reward-related beta activities on the frontal regions plays an integral role in facilitating increases in VWM capacity.

  20. Modeling effects of intrinsic and extrinsic rewards on the competition between striatal learning systems

    PubMed Central

    Boedecker, Joschka; Lampe, Thomas; Riedmiller, Martin

    2013-01-01

    A common assumption in psychology, economics, and other fields holds that higher performance will result if extrinsic rewards (such as money) are offered as an incentive. While this principle seems to work well for tasks that require the execution of the same sequence of steps over and over, with little uncertainty about the process, in other cases, especially where creative problem solving is required due to the difficulty in finding the optimal sequence of actions, external rewards can actually be detrimental to task performance. Furthermore, they have the potential to undermine intrinsic motivation to do an otherwise interesting activity. In this work, we extend a computational model of the dorsomedial and dorsolateral striatal reinforcement learning systems to account for the effects of extrinsic and intrinsic rewards. The model assumes that the brain employs both a goal-directed and a habitual learning system, and competition between both is based on the trade-off between the cost of the reasoning process and value of information. The goal-directed system elicits internal rewards when its models of the environment improve, while the habitual system, being model-free, does not. Our results account for the phenomena that initial extrinsic reward leads to reduced activity after extinction compared to the case without any initial extrinsic rewards, and that performance in complex task settings drops when higher external rewards are promised. We also test the hypothesis that external rewards bias the competition in favor of the computationally efficient, but cruder and less flexible habitual system, which can negatively influence intrinsic motivation and task performance in the class of tasks we consider. PMID:24137146

  1. How the Brain Wants What the Body Needs: The Neural Basis of Positive Alliesthesia.

    PubMed

    Avery, Jason A; Burrows, Kaiping; Kerr, Kara L; Bodurka, Jerzy; Khalsa, Sahib S; Paulus, Martin P; Simmons, W Kyle

    2017-03-01

    Discontinuing unhealthy behaviors, such as overeating or drug use, depends upon an individual's ability to overcome the influence of environmental reward cues. The strength of that influence, however, varies greatly depending upon the internal state of the body. Characterizing the relationship between interoceptive signaling and shifting drug cue valuation provides an opportunity for understanding the neural bases of how changing internal states alter reward processing more generally. A total of 17 cigarette smokers rated the pleasantness of cigarette pictures when they were nicotine sated or nicotine abstinent. On both occasions, smokers also underwent functional magnetic resonance imaging (fMRI) scanning while performing a visceral interoceptive attention task and a resting-state functional connectivity scan. Hemodynamic, physiological, and behavioral parameters were compared between sated and abstinent scans. The relationships between changes in these parameters across scan sessions were also examined. Smokers rated cigarette pictures as significantly more pleasant while nicotine abstinent than while nicotine sated. Comparing abstinent with sated scans, smokers also exhibited significantly decreased mid-insula, amygdala, and orbitofrontal activity while attending to interoceptive signals from the body. Change in interoceptive activity within the left mid-insula predicted the increase in smoker's pleasantness ratings of cigarette cues. This increase in pleasantness ratings was also correlated with an increase in resting-state functional connectivity between the mid-insula and the ventral striatum and ventral pallidum. These findings support a model wherein interoceptive processing in the mid-insula of withdrawal signals from the body potentiates the motivational salience of reward cues through the recruitment of hedonic 'hot spots' within the brain's reward circuitry.

  2. Dietary Tyrosine/Phenylalanine Depletion Effects on Behavioral and Brain Signatures of Human Motivational Processing

    PubMed Central

    Bjork, James M; Grant, Steven J; Chen, Gang; Hommer, Daniel W

    2014-01-01

    Dopamine (DA) neurotransmission is critical for motivational processing. We assessed whether disruption of DA synthesis in healthy controls using an amino-acid beverage devoid of catecholamine precursors (tyrosine–phenylalanine depletion (TPD)) would blunt recruitment of the nucleus accumbens (NAcc) by rewards. Sixteen controls ingested each of a tyr/phe-depleting beverage (DEP) or a tyr/phe-balanced (BAL) control beverage in two laboratory visits. Five hours after consumption of each drink, subjects underwent functional magnetic resonance imaging while they viewed anticipatory cues to respond to a target to either win money or avoid losing money. TPD did not exert main effects on mood or on task behavior, but affected brain activation. In right NAcc, TPD blunted activation by anticipation of high rewards. In left NAcc, recruitment anticipating high rewards was modulated by individual differences in mood change across the DEP drink day, where subjects whose mood worsened following TPD (relative to within-day mood change under BAL conditions) also showed lower activation under DEP conditions relative to BAL conditions. Exploratory analysis indicated that TPD qualitatively blunted the voxel-wise spatial extent of suprathreshold activation by reward anticipation. Finally, loss outcomes activated anterior insula under DEP conditions but not under BAL conditions. These data indicate that: (1) dietary depletion of catacholamine precursors will blunt dopaminergic mesolimbic activity, and (2) in controls, synthetic pathways of this neurocircuitry maintain sufficient buffering capacity to resist an effect on motivated behavior. Additional studies are needed to determine if clinical populations would show similar resistance to behavioral effects of TPD. PMID:23995581

  3. Brain responses to erotic and other emotional stimuli in breast cancer survivors with and without distress about low sexual desire: a preliminary fMRI study.

    PubMed

    Versace, Francesco; Engelmann, Jeffrey M; Jackson, Edward F; Slapin, Aurelija; Cortese, Kristin M; Bevers, Therese B; Schover, Leslie R

    2013-12-01

    Many breast cancer survivors report a loss of sexual desire and arousability, consonant with the new DSM-V category of female sexual interest/arousal disorder. The cause of decreased sexual desire and pleasure after treatment for cancer is unknown. One possibility is that cancer, or treatment for cancer, damages brain circuits that are involved in reward-seeking. To test the hypothesis that brain reward systems are involved in decreased sexual desire in breast cancer survivors, we used functional magnetic resonance imaging (fMRI) to compare brain responses to erotica and other emotional stimuli in two groups of women previously treated for breast cancer with chemotherapy: those who were distressed about a perceived loss of sexual desire and those who may have had low desire, but were not distressed about it. Women distressed about their desire had reduced brain responses to erotica in the anterior cingulate and dorsolateral prefrontal cortex, which are part of the brain reward system. This study is the first to demonstrate, in cancer survivors, that problems with sexual desire/arousability are associated with blunted brain responses to erotica in reward systems. Future research is necessary to determine whether brain responses differ as a result of chemotherapy, hormone therapy, and menopausal status. This may contribute to the development of new, evidence-based interventions for one of the most prevalent and enduring side effects of cancer treatment.

  4. New developments on the neurobiological and pharmaco-genetic mechanisms underlying internet and videogame addiction.

    PubMed

    Weinstein, Aviv; Lejoyeux, Michel

    2015-03-01

    There is emerging evidence that the psychobiological mechanisms underlying behavioral addictions such as internet and videogame addiction resemble those of addiction for substances of abuse. Review of brain imaging, treatment and genetic studies on videogame and internet addiction. Literature search of published articles between 2009 and 2013 in Pubmed using "internet addiction" and "videogame addiction" as the search word. Twenty-nine studies have been selected and evaluated under the criteria of brain imaging, treatment, and genetics. Brain imaging studies of the resting state have shown that long-term internet game playing affected brain regions responsible for reward, impulse control and sensory-motor coordination. Brain activation studies have shown that videogame playing involved changes in reward and loss of control and that gaming pictures have activated regions similarly to those activated by cue-exposure to drugs. Structural studies have shown alterations in the volume of the ventral striatum possible as result of changes in reward. Furthermore, videogame playing was associated with dopamine release similar in magnitude to those of drugs of abuse and that there were faulty inhibitory control and reward mechanisms videogame addicted individuals. Finally, treatment studies using fMRI have shown reduction in craving for videogames and reduced associated brain activity. Videogame playing may be supported by similar neural mechanisms underlying drug abuse. Similar to drug and alcohol abuse, internet addiction results in sub-sensitivity of dopamine reward mechanisms. Given the fact that this research is in its early stage it is premature to conclude that internet addiction is equivalent to substance addictions. © American Academy of Addiction Psychiatry.

  5. Healthy adolescents' neural response to reward: associations with puberty, positive affect, and depressive symptoms.

    PubMed

    Forbes, Erika E; Ryan, Neal D; Phillips, Mary L; Manuck, Stephen B; Worthman, Carol M; Moyles, Donna L; Tarr, Jill A; Sciarrillo, Samantha R; Dahl, Ronald E

    2010-02-01

    Changes in reward-related behavior are an important component of normal adolescent affective development. Understanding the neural underpinnings of these normative changes creates a foundation for investigating adolescence as a period of vulnerability to affective disorders, substance use disorders, and health problems. Studies of reward-related brain function have revealed conflicting findings regarding developmental change in the reactivity of the striatum and medial prefrontal cortex (mPFC) and have not considered puberty. The current study focused on puberty-specific changes in brain function and their association with mood. A sample of 77 healthy adolescents (26 pre-/early pubertal, 51 mid-/late pubertal) recruited in a narrow age range (mean = 11.94 years, SD = 0.75) were assessed for sexual maturation and circulating testosterone, completed a functional magnetic resonance imaging (fMRI) guessing task with monetary reward, and underwent experience sampling of mood in natural environments. For comparison, 19 healthy adults completed the fMRI assessment. Adolescents with more advanced pubertal maturation exhibited less striatal and more mPFC reactivity during reward outcome than similarly aged adolescents with less advanced maturation. Testosterone was positively correlated with striatal reactivity in boys during reward anticipation and negatively correlated with striatal reactivity in girls and boys during reward outcome. Striatal reactivity was positively correlated with real-world subjective positive affect and negatively correlated with depressive symptoms. mPFC reactivity was positively correlated with depressive symptoms. Reward-related brain function changes with puberty and is associated with adolescents' positive affect and depressive symptoms. Increased reward-seeking behavior at this developmental point could serve to compensate for these changes.

  6. Different roads to the same destination - The impact of impulsivity on decision-making processes under risk within a rewarding context in a healthy male sample.

    PubMed

    Dinu-Biringer, Ramona; Nees, Frauke; Falquez, Rosalux; Berger, Moritz; Barnow, Sven

    2016-02-28

    The results of research about the influences of impulsivity on decision-making in situations of risk have been inconsistent. In this study, we used functional magnetic resonance imaging to examine the neural correlates of decision-making under risk in 12 impulsive, as defined by the Barratt Impulsiveness Scale-11, and 13 normal men. Although both groups showed similar decision-making behavior, neural activation regarding decision-making processes differed significantly. Impulsive persons revealed stronger activation in the (ventro-) medial prefrontal cortex and less deactivation of the orbitofrontal cortex while playing for potential gains. These brain regions might be associated with the emotional components of decision-making processes. Significant differences in brain areas linked to cognitive decision-making components were not found. This activation pattern might be seen as an indication for a hypersensitivity to rewarding cues in impulsive persons and might be linked to the propensity for inappropriate risk-taking behavior in persons with more extreme impulsivity levels, especially in situations in which they have a strong emotional involvement in the decision process. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

  7. Neural Signatures of Value Comparison in Human Cingulate Cortex during Decisions Requiring an Effort-Reward Trade-off

    PubMed Central

    Kennerley, Steven W.; Friston, Karl; Bestmann, Sven

    2016-01-01

    Integrating costs and benefits is crucial for optimal decision-making. Although much is known about decisions that involve outcome-related costs (e.g., delay, risk), many of our choices are attached to actions and require an evaluation of the associated motor costs. Yet how the brain incorporates motor costs into choices remains largely unclear. We used human fMRI during choices involving monetary reward and physical effort to identify brain regions that serve as a choice comparator for effort-reward trade-offs. By independently varying both options' effort and reward levels, we were able to identify the neural signature of a comparator mechanism. A network involving supplementary motor area and the caudal portion of dorsal anterior cingulate cortex encoded the difference in reward (positively) and effort levels (negatively) between chosen and unchosen choice options. We next modeled effort-discounted subjective values using a novel behavioral model. This revealed that the same network of regions involving dorsal anterior cingulate cortex and supplementary motor area encoded the difference between the chosen and unchosen options' subjective values, and that activity was best described using a concave model of effort-discounting. In addition, this signal reflected how precisely value determined participants' choices. By contrast, separate signals in supplementary motor area and ventromedial prefrontal cortex correlated with participants' tendency to avoid effort and seek reward, respectively. This suggests that the critical neural signature of decision-making for choices involving motor costs is found in human cingulate cortex and not ventromedial prefrontal cortex as typically reported for outcome-based choice. Furthermore, distinct frontal circuits seem to drive behavior toward reward maximization and effort minimization. SIGNIFICANCE STATEMENT The neural processes that govern the trade-off between expected benefits and motor costs remain largely unknown. This is striking because energetic requirements play an integral role in our day-to-day choices and instrumental behavior, and a diminished willingness to exert effort is a characteristic feature of a range of neurological disorders. We use a new behavioral characterization of how humans trade off reward maximization with effort minimization to examine the neural signatures that underpin such choices, using BOLD MRI neuroimaging data. We find the critical neural signature of decision-making, a signal that reflects the comparison of value between choice options, in human cingulate cortex, whereas two distinct brain circuits drive behavior toward reward maximization or effort minimization. PMID:27683898

  8. Neural Signatures of Value Comparison in Human Cingulate Cortex during Decisions Requiring an Effort-Reward Trade-off.

    PubMed

    Klein-Flügge, Miriam C; Kennerley, Steven W; Friston, Karl; Bestmann, Sven

    2016-09-28

    Integrating costs and benefits is crucial for optimal decision-making. Although much is known about decisions that involve outcome-related costs (e.g., delay, risk), many of our choices are attached to actions and require an evaluation of the associated motor costs. Yet how the brain incorporates motor costs into choices remains largely unclear. We used human fMRI during choices involving monetary reward and physical effort to identify brain regions that serve as a choice comparator for effort-reward trade-offs. By independently varying both options' effort and reward levels, we were able to identify the neural signature of a comparator mechanism. A network involving supplementary motor area and the caudal portion of dorsal anterior cingulate cortex encoded the difference in reward (positively) and effort levels (negatively) between chosen and unchosen choice options. We next modeled effort-discounted subjective values using a novel behavioral model. This revealed that the same network of regions involving dorsal anterior cingulate cortex and supplementary motor area encoded the difference between the chosen and unchosen options' subjective values, and that activity was best described using a concave model of effort-discounting. In addition, this signal reflected how precisely value determined participants' choices. By contrast, separate signals in supplementary motor area and ventromedial prefrontal cortex correlated with participants' tendency to avoid effort and seek reward, respectively. This suggests that the critical neural signature of decision-making for choices involving motor costs is found in human cingulate cortex and not ventromedial prefrontal cortex as typically reported for outcome-based choice. Furthermore, distinct frontal circuits seem to drive behavior toward reward maximization and effort minimization. The neural processes that govern the trade-off between expected benefits and motor costs remain largely unknown. This is striking because energetic requirements play an integral role in our day-to-day choices and instrumental behavior, and a diminished willingness to exert effort is a characteristic feature of a range of neurological disorders. We use a new behavioral characterization of how humans trade off reward maximization with effort minimization to examine the neural signatures that underpin such choices, using BOLD MRI neuroimaging data. We find the critical neural signature of decision-making, a signal that reflects the comparison of value between choice options, in human cingulate cortex, whereas two distinct brain circuits drive behavior toward reward maximization or effort minimization. Copyright © 2016 Klein-Flügge et al.

  9. Food portion size and energy density evoke different patterns of brain activation in children12

    PubMed Central

    Fearnbach, S Nicole; Wilson, Stephen J; Fisher, Jennifer O; Savage, Jennifer S; Rolls, Barbara J; Keller, Kathleen L

    2017-01-01

    Background: Large portions of food promote intake, but the mechanisms that drive this effect are unclear. Previous neuroimaging studies have identified the brain-reward and decision-making systems that are involved in the response to the energy density (ED) (kilocalories per gram) of foods, but few studies have examined the brain response to the food portion size (PS). Objective: We used functional MRI (fMRI) to determine the brain response to food images that differed in PSs (large and small) and ED (high and low). Design: Block-design fMRI was used to assess the blood oxygen level–dependent (BOLD) response to images in 36 children (7–10 y old; girls: 50%), which was tested after a 2-h fast. Pre-fMRI fullness and liking were rated on visual analog scales. A whole-brain cluster-corrected analysis was used to compare BOLD activation for main effects of the PS, ED, and their interaction. Secondary analyses were used to associate BOLD contrast values with appetitive traits and laboratory intake from meals for which the portions of all foods were increased. Results: Compared with small-PS cues, large-PS cues were associated with decreased activation in the inferior frontal gyrus (P < 0.01). Compared with low-ED cues, high-ED cues were associated with increased activation in multiple regions (e.g., in the caudate, cingulate, and precentral gyrus) and decreased activation in the insula and superior temporal gyrus (P < 0.01 for all). A PS × ED interaction was shown in the superior temporal gyrus (P < 0.01). BOLD contrast values for high-ED cues compared with low-ED cues in the insula, declive, and precentral gyrus were negatively related to appetitive traits (P < 0.05). There were no associations between the brain response to the PS and either appetitive traits or intake. Conclusions: Cues regarding food PS may be processed in the lateral prefrontal cortex, which is a region that is implicated in cognitive control, whereas ED activates multiple areas involved in sensory and reward processing. Possible implications include the development of interventions that target decision-making and reward systems differently to moderate overeating. PMID:27881393

  10. Dopamine Modulates Adaptive Prediction Error Coding in the Human Midbrain and Striatum.

    PubMed

    Diederen, Kelly M J; Ziauddeen, Hisham; Vestergaard, Martin D; Spencer, Tom; Schultz, Wolfram; Fletcher, Paul C

    2017-02-15

    Learning to optimally predict rewards requires agents to account for fluctuations in reward value. Recent work suggests that individuals can efficiently learn about variable rewards through adaptation of the learning rate, and coding of prediction errors relative to reward variability. Such adaptive coding has been linked to midbrain dopamine neurons in nonhuman primates, and evidence in support for a similar role of the dopaminergic system in humans is emerging from fMRI data. Here, we sought to investigate the effect of dopaminergic perturbations on adaptive prediction error coding in humans, using a between-subject, placebo-controlled pharmacological fMRI study with a dopaminergic agonist (bromocriptine) and antagonist (sulpiride). Participants performed a previously validated task in which they predicted the magnitude of upcoming rewards drawn from distributions with varying SDs. After each prediction, participants received a reward, yielding trial-by-trial prediction errors. Under placebo, we replicated previous observations of adaptive coding in the midbrain and ventral striatum. Treatment with sulpiride attenuated adaptive coding in both midbrain and ventral striatum, and was associated with a decrease in performance, whereas bromocriptine did not have a significant impact. Although we observed no differential effect of SD on performance between the groups, computational modeling suggested decreased behavioral adaptation in the sulpiride group. These results suggest that normal dopaminergic function is critical for adaptive prediction error coding, a key property of the brain thought to facilitate efficient learning in variable environments. Crucially, these results also offer potential insights for understanding the impact of disrupted dopamine function in mental illness. SIGNIFICANCE STATEMENT To choose optimally, we have to learn what to expect. Humans dampen learning when there is a great deal of variability in reward outcome, and two brain regions that are modulated by the brain chemical dopamine are sensitive to reward variability. Here, we aimed to directly relate dopamine to learning about variable rewards, and the neural encoding of associated teaching signals. We perturbed dopamine in healthy individuals using dopaminergic medication and asked them to predict variable rewards while we made brain scans. Dopamine perturbations impaired learning and the neural encoding of reward variability, thus establishing a direct link between dopamine and adaptation to reward variability. These results aid our understanding of clinical conditions associated with dopaminergic dysfunction, such as psychosis. Copyright © 2017 Diederen et al.

  11. The detrimental effects of emotional process dysregulation on decision-making in substance dependence

    PubMed Central

    Murphy, Anna; Taylor, Eleanor; Elliott, Rebecca

    2012-01-01

    Substance dependence is complex and multifactorial, with many distinct pathways involved in both the development and subsequent maintenance of addictive behaviors. Various cognitive mechanisms have been implicated, including impulsivity, compulsivity, and impaired decision-making. These mechanisms are modulated by emotional processes, resulting in increased likelihood of initial drug use, sustained substance dependence, and increased relapse during periods of abstinence. Emotional traits, such as sensation-seeking, are risk factors for substance use, and chronic drug use can result in further emotional dysregulation via effects on reward, motivation, and stress systems. We will explore theories of hyper and hypo sensitivity of the brain reward systems that may underpin motivational abnormalities and anhedonia. Disturbances in these systems contribute to the biasing of emotional processing toward cues related to drug use at the expense of natural rewards, which serves to maintain addictive behavior, via enhanced drug craving. We will additionally focus on the sensitization of the brain stress systems that result in negative affect states that continue into protracted abstinence that is may lead to compulsive drug-taking. We will explore how these emotional dysregulations impact upon decision-making controlled by goal-directed and habitual action selections systems, and, in combination with a failure of prefrontal inhibitory control, mediate maladaptive decision-making observed in substance dependent individuals such that they continue drug use in spite of negative consequences. An understanding of the emotional impacts on cognition in substance dependent individuals may guide the development of more effective therapeutic interventions. PMID:23162443

  12. Reward for food odors: an fMRI study of liking and wanting as a function of metabolic state and BMI

    PubMed Central

    Jiang, Tao; Soussignan, Robert; Schaal, Benoist

    2015-01-01

    Brain reward systems mediate liking and wanting for food reward. Here, we explore the differential involvement of the following structures for these two components: the ventral and dorsal striatopallidal area, orbitofrontal cortex (OFC), anterior insula and anterior cingulate. Twelve healthy female participants were asked to rate pleasantness (liking of food and non-food odors) and the desire to eat (wanting of odor-evoked food) during event-related functional magnetic resonance imaging (fMRI). The subjective ratings and fMRI were performed in hunger and satiety states. Activations of regions of interest were compared as a function of task (liking vs wanting), odor category (food vs non-food) and metabolic state (hunger vs satiety). We found that the nucleus accumbens and ventral pallidum were differentially involved in liking or wanting during the hunger state, which suggests a reciprocal inhibitory influence between these structures. Neural activation of OFC subregions was correlated with either liking or wanting ratings, suggesting an OFC role in reward processing magnitude. Finally, during the hunger state, participants with a high body mass index exhibited less activation in neural structures underlying food reward processing. Our results suggest that food liking and wanting are two separable psychological constructs and may be functionally segregated within the cortico-striatopallidal circuit. PMID:24948157

  13. The impact of cognitive load on reward evaluation.

    PubMed

    Krigolson, Olave E; Hassall, Cameron D; Satel, Jason; Klein, Raymond M

    2015-11-19

    The neural systems that afford our ability to evaluate rewards and punishments are impacted by a variety of external factors. Here, we demonstrate that increased cognitive load reduces the functional efficacy of a reward processing system within the human medial-frontal cortex. In our paradigm, two groups of participants used performance feedback to estimate the exact duration of one second while electroencephalographic (EEG) data was recorded. Prior to performing the time estimation task, both groups were instructed to keep their eyes still and avoid blinking in line with well established EEG protocol. However, during performance of the time-estimation task, one of the two groups was provided with trial-to-trial-feedback about their performance on the time-estimation task and their eye movements to induce a higher level of cognitive load relative to participants in the other group who were solely provided with feedback about the accuracy of their temporal estimates. In line with previous work, we found that the higher level of cognitive load reduced the amplitude of the feedback-related negativity, a component of the human event-related brain potential associated with reward evaluation within the medial-frontal cortex. Importantly, our results provide further support that increased cognitive load reduces the functional efficacy of a neural system associated with reward processing. Copyright © 2015 Elsevier B.V. All rights reserved.

  14. Dopamine in the Brain: Hypothesizing Surfeit or Deficit Links to Reward and Addiction.

    PubMed

    Blum, Kenneth; Thanos, Peter K; Oscar-Berman, Marlene; Febo, Marcelo; Baron, David; Badgaiyan, Rajendra D; Gardner, Eliot; Demetrovics, Zsolt; Fahlke, Claudia; Haberstick, Brett C; Dushaj, Kristina; Gold, Mark S

    Recently there has been debate concerning the role of brain dopamine in reward and addiction. David Nutt and associates eloquently proposed that dopamine (DA) may be central to psycho stimulant dependence and some what important for alcohol, but not important for opiates, nicotine or even cannabis. Others have also argued that surfeit theories can explain for example cocaine seeking behavior as well as non-substance-related addictive behaviors. It seems prudent to distinguish between what constitutes "surfeit" compared to" deficit" in terms of short-term (acute) and long-term (chronic) brain reward circuitry responsivity. In an attempt to resolve controversy regarding the contributions of mesolimbic DA systems to reward, we review the three main competing explanatory categories: "liking", "learning", and "wanting". They are (a) the hedonic impact -liking reward, (b) the ability to predict rewarding effects-learning and (c) the incentive salience of reward-related stimuli -wanting. In terms of acute effects, most of the evidence seems to favor the "surfeit theory". Due to preferential dopamine release at mesolimbic-VTA-caudate-accumbens loci most drugs of abuse and Reward Deficiency Syndrome (RDS) behaviors have been linked to heightened feelings of well-being and hyperdopaminergic states.The "dopamine hypotheses" originally thought to be simple, is now believed to be quite complex and involves encoding the set point of hedonic tone, encoding attention, reward expectancy, and incentive motivation. Importantly, Willuhn et al. shows that in a self-administration paradigm, (chronic) excessive use of cocaine is caused by decreased phasic dopamine signaling in the striatum. In terms of chronic addictions, others have shown a blunted responsivity at brain reward sites with food, nicotine, and even gambling behavior. Finally, we are cognizant of the differences in dopaminergic function as addiction progresses and argue that relapse may be tied to dopamine deficiency. Vulnerability to addiction and relapse may be the result of the cumulative effects of dopaminergic and other neurotransmitter genetic variants and elevated stress levels. We therefore propose that dopamine homeostasis may be a preferred goal to combat relapse.

  15. Aberrant mesolimbic dopamine-opiate interaction in obesity.

    PubMed

    Tuominen, Lauri; Tuulari, Jetro; Karlsson, Henry; Hirvonen, Jussi; Helin, Semi; Salminen, Paulina; Parkkola, Riitta; Hietala, Jarmo; Nuutila, Pirjo; Nummenmaa, Lauri

    2015-11-15

    Dopamine and opioid neurotransmitter systems share many functions such as regulation of reward and pleasure. μ-Opioid receptors (MOR) modulate the mesolimbic dopamine system in ventral tegmental area and striatum, key areas implicated in reward. We hypothesized that dopamine and opioid receptor availabilities correlate in vivo and that this correlation is altered in obesity, a disease with altered reward processing. Twenty lean females (mean BMI 22) and 25 non-binge eating morbidly obese females (mean BMI 41) underwent two positron emission tomography scans with [(11)C]carfentanil and [(11)C]raclopride to measure the MOR and dopamine D2 receptor (DRD2) availability, respectively. In lean subjects, the MOR and DRD2 availabilities were positively associated in the ventral striatum (r=0.62, p=0.003) and dorsal caudate nucleus (r=0.62, p=0.004). Moreover, DRD2 availability in the ventral striatum was associated with MOR availability in other regions of the reward circuitry, particularly in the ventral tegmental area. In morbidly obese subjects, this receptor interaction was significantly weaker in ventral striatum but unaltered in the caudate nucleus. Finally, the association between DRD2 availability in the ventral striatum and MOR availability in the ventral tegmental area was abolished in the morbidly obese. The study demonstrates a link between DRD2 and MOR availabilities in living human brain. This interaction is selectively disrupted in mesolimbic dopamine system in morbid obesity. We propose that interaction between the dopamine and opioid systems is a prerequisite for normal reward processing and that disrupted cross-talk may underlie altered reward processing in obesity. Copyright © 2015 Elsevier Inc. All rights reserved.

  16. Functional changes of the reward system underlie blunted response to social gaze in cocaine users

    PubMed Central

    Preller, Katrin H.; Herdener, Marcus; Schilbach, Leonhard; Stämpfli, Philipp; Hulka, Lea M.; Vonmoos, Matthias; Ingold, Nina; Vogeley, Kai; Tobler, Philippe N.; Seifritz, Erich; Quednow, Boris B.

    2014-01-01

    Social interaction deficits in drug users likely impede treatment, increase the burden of the affected families, and consequently contribute to the high costs for society associated with addiction. Despite its significance, the neural basis of altered social interaction in drug users is currently unknown. Therefore, we investigated basal social gaze behavior in cocaine users by applying behavioral, psychophysiological, and functional brain-imaging methods. In study I, 80 regular cocaine users and 63 healthy controls completed an interactive paradigm in which the participants’ gaze was recorded by an eye-tracking device that controlled the gaze of an anthropomorphic virtual character. Valence ratings of different eye-contact conditions revealed that cocaine users show diminished emotional engagement in social interaction, which was also supported by reduced pupil responses. Study II investigated the neural underpinnings of changes in social reward processing observed in study I. Sixteen cocaine users and 16 controls completed a similar interaction paradigm as used in study I while undergoing functional magnetic resonance imaging. In response to social interaction, cocaine users displayed decreased activation of the medial orbitofrontal cortex, a key region of reward processing. Moreover, blunted activation of the medial orbitofrontal cortex was significantly correlated with a decreased social network size, reflecting problems in real-life social behavior because of reduced social reward. In conclusion, basic social interaction deficits in cocaine users as observed here may arise from altered social reward processing. Consequently, these results point to the importance of reinstatement of social reward in the treatment of stimulant addiction. PMID:24449854

  17. Addiction and brain reward and antireward pathways.

    PubMed

    Gardner, Eliot L

    2011-01-01

    Addictive drugs have in common that they are voluntarily self-administered by laboratory animals (usually avidly), and that they enhance the functioning of the reward circuitry of the brain (producing the 'high' that the drug user seeks). The core reward circuitry consists of an 'in-series' circuit linking the ventral tegmental area, nucleus accumbens and ventral pallidum via the medial forebrain bundle. Although originally believed to simply encode the set point of hedonic tone, these circuits are now believed to be functionally far more complex, also encoding attention, expectancy of reward, disconfirmation of reward expectancy, and incentive motivation. 'Hedonic dysregulation' within these circuits may lead to addiction. The 'second-stage' dopaminergic component in this reward circuitry is the crucial addictive-drug-sensitive component. All addictive drugs have in common that they enhance (directly or indirectly or even transsynaptically) dop-aminergic reward synaptic function in the nucleus accumbens. Drug self-administration is regulated by nucleus accumbens dopamine levels, and is done to keep nucleus accumbens dopamine within a specific elevated range (to maintain a desired hedonic level). For some classes of addictive drugs (e.g. opiates), tolerance to the euphoric effects develops with chronic use. Postuse dysphoria then comes to dominate reward circuit hedonic tone, and addicts no longer use drugs to get high, but simply to get back to normal ('get straight'). The brain circuits mediating the pleasurable effects of addictive drugs are anatomically, neurophysiologically and neurochemically different from those mediating physical dependence, and from those mediating craving and relapse. There are important genetic variations in vulnerability to drug addiction, yet environmental factors such as stress and social defeat also alter brain-reward mechanisms in such a manner as to impart vulnerability to addiction. In short, the 'bio-psycho-social' model of etiology holds very well for addiction. Addiction appears to correlate with a hypodopaminergic dysfunctional state within the reward circuitry of the brain. Neuroimaging studies in humans add credence to this hypothesis. Credible evidence also implicates serotonergic, opioid, endocannabinoid, GABAergic and glutamatergic mechanisms in addiction. Critically, drug addiction progresses from occasional recreational use to impulsive use to habitual compulsive use. This correlates with a progression from reward-driven to habit-driven drug-seeking behavior. This behavioral progression correlates with a neuroanatomical progression from ventral striatal (nucleus accumbens) to dorsal striatal control over drug-seeking behavior. The three classical sets of craving and relapse triggers are (a) reexposure to addictive drugs, (b) stress, and (c) reexposure to environmental cues (people, places, things) previously associated with drug-taking behavior. Drug-triggered relapse involves the nucleus accumbens and the neurotransmitter dopamine. Stress-triggered relapse involves (a) the central nucleus of the amygdala, the bed nucleus of the stria terminalis, and the neurotransmitter corticotrophin-releasing factor, and (b) the lateral tegmental noradrenergic nuclei of the brain stem and the neurotransmitter norepinephrine. Cue-triggered relapse involves the basolateral nucleus of the amygdala, the hippocampus and the neurotransmitter glutamate. Knowledge of the neuroanatomy, neurophysiology, neurochemistry and neuropharmacology of addictive drug action in the brain is currently producing a variety of strategies for pharmacotherapeutic treatment of drug addiction, some of which appear promising. Copyright © 2011 S. Karger AG, Basel.

  18. Diet-Induced Obesity and Diet-Resistant rats: differences in the rewarding and anorectic effects of D-amphetamine

    PubMed Central

    Valenza, Marta; Steardo, Luca; Cottone, Pietro; Sabino, Valentina

    2015-01-01

    Rationale Obesity is a leading public health problem worldwide. Multiple lines of evidence associate deficits in the brain reward circuit with obesity. Objective Whether alterations in brain reward sensitivity precede or are a consequence of obesity is unknown. This study aimed to investigate both innate and obesity-induced differences in the sensitivity to the effects of an indirect dopaminergic agonist. Methods Rats genetically prone to diet-induced obesity (DIO) and their counterpart diet-resistant (DR) were fed a chow diet and their response to D-amphetamine on intracranial self-stimulation and food intake were assessed. The same variables were then evaluated after exposing the rats to a high-fat diet, after DIO rats selectively developed obesity. Finally, gene expression levels of dopamine receptor 1 and 2 as well as tyrosine hydroxylase were measured in reward-related brain regions. Results In a pre-obesity state, DIO rats showed innate decreased sensitivity to the reward-enhancing and anorectic effects of D-amphetamine, as compared to DR rats. In a diet-induced obese state, the insensitivity to the potentiating effects of D-amphetamine on ICSS threshold persisted and became more marked in DIO rats, while the anorectic effects were comparable between genotypes. Finally, innate and obesity-induced differences in the gene expression of dopamine receptors were observed. Conclusions Our results demonstrate that brain reward deficits antedate the development of obesity and worsen after obesity is fully developed, suggesting that these alterations represent vulnerability factors for its development. Moreover, our data suggests that the reward-enhancing and anorectic effects of D-amphetamine are dissociable in the context of obesity. PMID:26047964

  19. GLP-1 and estrogen conjugate acts in the supramammillary nucleus to reduce food-reward and body weight.

    PubMed

    Vogel, Heike; Wolf, Stefanie; Rabasa, Cristina; Rodriguez-Pacheco, Francisca; Babaei, Carina S; Stöber, Franziska; Goldschmidt, Jürgen; DiMarchi, Richard D; Finan, Brian; Tschöp, Matthias H; Dickson, Suzanne L; Schürmann, Annette; Skibicka, Karolina P

    2016-11-01

    The obesity epidemic continues unabated and currently available pharmacological treatments are not sufficiently effective. Combining gut/brain peptide, GLP-1, with estrogen into a conjugate may represent a novel, safe and potent, strategy to treat diabesity. Here we demonstrate that the central administration of GLP-1-estrogen conjugate reduced food reward, food intake, and body weight in rats. In order to determine the brain location of the interaction of GLP-1 with estrogen, we avail of single-photon emission computed tomography imaging of regional cerebral blood flow and pinpoint a brain site unexplored for its role in feeding and reward, the supramammillary nucleus (SUM) as a potential target of the conjugated GLP-1-estrogen. We confirm that conjugated GLP-1 and estrogen directly target the SUM with site-specific microinjections. Additional microinjections of GLP-1-estrogen into classic energy balance controlling nuclei, the lateral hypothalamus (LH) and the nucleus of the solitary tract (NTS) revealed that the metabolic benefits resulting from GLP-1-estrogen injections are mediated through the LH and to some extent by the NTS. In contrast, no additional benefit of the conjugate was noted on food reward when the compound was microinjected into the LH or the NTS, identifying the SUM as the only neural substrate identified here to underlie the reward reducing benefits of GLP-1 and estrogen conjugate. Collectively we discover a surprising neural substrate underlying food intake and reward effects of GLP-1 and estrogen and uncover a new brain area capable of regulating energy balance and reward. Copyright © 2016 The Author(s). Published by Elsevier Ltd.. All rights reserved.

  20. The integrate model of emotion, thinking and self regulation: an application to the "paradox of aging".

    PubMed

    Williams, Leanne M; Gatt, Justine M; Hatch, Ainslie; Palmer, Donna M; Nagy, Marie; Rennie, Christopher; Cooper, Nicholas J; Morris, Charlotte; Grieve, Stuart; Dobson-Stone, Carol; Schofield, Peter; Clark, C Richard; Gordon, Evian; Arns, Martijn; Paul, Robert H

    2008-09-01

    This study was undertaken using the INTEGRATE Model of brain organization, which is based on a temporal continuum of emotion, thinking and self regulation. In this model, the key organizing principle of self adaption is the motivation to minimize danger and maximize reward. This principle drives brain organization across a temporal continuum spanning milliseconds to seconds, minutes and hours. The INTEGRATE Model comprises three distinct processes across this continuum. Emotion is defined by automatic action tendencies triggered by signals that are significant due to their relevance to minimizing danger-maximizing reward (such as abrupt, high contrast stimuli). Thinking represents cognitive functions and feelings that rely on brain and body feedback emerging from around 200 ms post-stimulus onwards. Self regulation is the modulation of emotion, thinking and feeling over time, according to more abstract adaptions to minimize danger-maximize reward. Here, we examined the impact of dispositional factors, age and genetic variation, on this temporal continuum. Brain Resource methodology provided a standardized platform for acquiring genetic, brain and behavioral data in the same 1000 healthy subjects. Results showed a "paradox" of declining function in the "thinking" time scale over the lifespan (6 to 80+ years), but a corresponding preservation or even increase in automatic functions of "emotion" and "self regulation". This paradox was paralleled by a greater loss of grey matter in cortical association areas (assessed using MRI) over age, but a relative preservation of subcortical grey matter. Genetic polymorphisms associated with both healthy function and susceptibility to disorder (including the BDNFVal(66)Met, COMTVal(158/108)Met, MAOA and DRD4 tandem repeat and 5HTT-LPR polymorphisms) made specific contributions to emotion, thinking and self regulatory functions, which also varied according to age.

  1. Differential encoding of factors influencing predicted reward value in monkey rostral anterior cingulate cortex.

    PubMed

    Toda, Koji; Sugase-Miyamoto, Yasuko; Mizuhiki, Takashi; Inaba, Kiyonori; Richmond, Barry J; Shidara, Munetaka

    2012-01-01

    The value of a predicted reward can be estimated based on the conjunction of both the intrinsic reward value and the length of time to obtain it. The question we addressed is how the two aspects, reward size and proximity to reward, influence the responses of neurons in rostral anterior cingulate cortex (rACC), a brain region thought to play an important role in reward processing. We recorded from single neurons while two monkeys performed a multi-trial reward schedule task. The monkeys performed 1-4 sequential color discrimination trials to obtain a reward of 1-3 liquid drops. There were two task conditions, a valid cue condition, where the number of trials and reward amount were associated with visual cues, and a random cue condition, where the cue was picked from the cue set at random. In the valid cue condition, the neuronal firing is strongly modulated by the predicted reward proximity during the trials. Information about the predicted reward amount is almost absent at those times. In substantial subpopulations, the neuronal responses decreased or increased gradually through schedule progress to the predicted outcome. These two gradually modulating signals could be used to calculate the effect of time on the perception of reward value. In the random cue condition, little information about the reward proximity or reward amount is encoded during the course of the trial before reward delivery, but when the reward is actually delivered the responses reflect both the reward proximity and reward amount. Our results suggest that the rACC neurons encode information about reward proximity and amount in a manner that is dependent on utility of reward information. The manner in which the information is represented could be used in the moment-to-moment calculation of the effect of time and amount on predicted outcome value.

  2. Introduction: Addiction and Brain Reward and Anti-Reward Pathways

    PubMed Central

    Gardner, Eliot L.

    2013-01-01

    Addictive drugs have in common that they are voluntarily self-administered by laboratory animals (usually avidly) and that they enhance the functioning of the reward circuitry of the brain (producing the “high” that the drug-user seeks). The core reward circuitry consists of an “in series” circuit linking the ventral tegmental area, nucleus accumbens, and ventral pallidum - via the medial forebrain bundle. Although originally believed to encode simply the set-point of hedonic tone, these circuits are now believed to be functionally far more complex - also encoding attention, expectancy of reward, disconfirmation of reward expectancy, and incentive motivation. “Hedonic dysregulation” within these circuits may lead to addiction. The “second-stage” dopaminergic component in this reward circuitry is the crucial addictive-drug-sensitive component. All addictive drugs have in common that they enhance (directly or indirectly or even transsynaptically) dopaminergic reward synaptic function in the nucleus accumbens. Drug self-administration is regulated by nucleus accumbens dopamine levels, and is done to keep nucleus accumbens dopamine within a specific elevated range (to maintain a desired hedonic level). For some classes of addictive drugs (e.g., opiates), tolerance to the euphoric effects develops with chronic use. Post-use dysphoria then comes to dominate reward circuit hedonic tone, and addicts no longer use drugs to get “high,” but simply to get back to normal (“get straight”). The brain circuits mediating the pleasurable effects of addictive drugs are anatomically, neurophysiologically, and neurochemically different from those mediating physical dependence, and from those mediating craving and relapse. There are important genetic variations in vulnerability to drug addiction, yet environmental factors such as stress and social defeat also alter brain-reward mechanisms in such a manner as to impart vulnerability to addiction. In short, the “bio-psycho-social” model of etiology holds very well for addiction. Addiction appears to correlate with a hypo-dopaminergic dysfunctional state within the reward circuitry of the brain. Neuroimaging studies in humans add credence to this hypothesis. Credible evidence also implicates serotonergic, opioid, endocannabinoid, GABAergic, and glutamatergic mechanisms in addiction. Critically, drug addiction progresses from occasional recreational use to impulsive use to habitual compulsive use. This correlates with a progression from reward-driven to habit-driven drug-seeking behavior. This behavioral progression correlates with a neuroanatomical progression from ventral striatal (nucleus accumbens) to dorsal striatal control over drug-seeking behavior. The three classical sets of craving and relapse triggers are a) re-exposure to addictive drugs, b) stress, and c) re-exposure to environmental cues (“people, places, things”) previously associated with drug-taking behavior. Drug-triggered relapse involves the nucleus accumbens and the neurotransmitter dopamine. Stress-triggered relapse involves a) the central nucleus of the amygdala, the bed nucleus of the stria terminalis, and the neurotransmitter CRF; and b) the lateral tegmental noradrenergic nuclei of the brain stem and the neurotransmitter norepinephrine. Cue-triggered relapse involves the basolateral nucleus of the amygdala, the hippocampus, and the neurotransmitter glutamate. Knowledge of the neuroanatomy, neurophysiology, neurochemistry, and neuropharmacology of addictive drug action in the brain is currently producing a variety of strategies for pharmacotherapeutic treatment of drug addiction, some of which appear promising. PMID:21508625

  3. Neural evidence for description dependent reward processing in the framing effect.

    PubMed

    Yu, Rongjun; Zhang, Ping

    2014-01-01

    Human decision making can be influenced by emotionally valenced contexts, known as the framing effect. We used event-related brain potentials to investigate how framing influences the encoding of reward. We found that the feedback related negativity (FRN), which indexes the "worse than expected" negative prediction error in the anterior cingulate cortex (ACC), was more negative for the negative frame than for the positive frame in the win domain. Consistent with previous findings that the FRN is not sensitive to "better than expected" positive prediction error, the FRN did not differentiate the positive and negative frame in the loss domain. Our results provide neural evidence that the description invariance principle which states that reward representation and decision making are not influenced by how options are presented is violated in the framing effect.

  4. Reward-based spatial learning in unmedicated adults with obsessive-compulsive disorder.

    PubMed

    Marsh, Rachel; Tau, Gregory Z; Wang, Zhishun; Huo, Yuankai; Liu, Ge; Hao, Xuejun; Packard, Mark G; Peterson, Bradley S; Simpson, H Blair

    2015-04-01

    The authors assessed the functioning of mesolimbic and striatal areas involved in reward-based spatial learning in unmedicated adults with obsessive-compulsive disorder (OCD). Functional MRI blood-oxygen-level-dependent response was compared in 33 unmedicated adults with OCD and 33 healthy, age-matched comparison subjects during a reward-based learning task that required learning to use extramaze cues to navigate a virtual eight-arm radial maze to find hidden rewards. The groups were compared in their patterns of brain activation associated with reward-based spatial learning versus a control condition in which rewards were unexpected because they were allotted pseudorandomly to experimentally prevent learning. Both groups learned to navigate the maze to find hidden rewards, but group differences in neural activity during navigation and reward processing were detected in mesolimbic and striatal areas. During navigation, the OCD group, unlike the healthy comparison group, exhibited activation in the left posterior hippocampus. Unlike healthy subjects, participants in the OCD group did not show activation in the left ventral putamen and amygdala when anticipating rewards or in the left hippocampus, amygdala, and ventral putamen when receiving unexpected rewards (control condition). Signal in these regions decreased relative to baseline during unexpected reward receipt among those in the OCD group, and the degree of activation was inversely associated with doubt/checking symptoms. Participants in the OCD group displayed abnormal recruitment of mesolimbic and ventral striatal circuitry during reward-based spatial learning. Whereas healthy comparison subjects exhibited activation in this circuitry in response to the violation of reward expectations, unmedicated OCD participants did not and instead over-relied on the posterior hippocampus during learning. Thus, dopaminergic innervation of reward circuitry may be altered, and future study of anterior/posterior hippocampal dysfunction in OCD is warranted.

  5. Witnessing hateful people in pain modulates brain activity in regions associated with physical pain and reward

    PubMed Central

    Fox, Glenn R.; Sobhani, Mona; Aziz-Zadeh, Lisa

    2013-01-01

    How does witnessing a hateful person in pain compare to witnessing a likable person in pain? The current study compared the brain bases for how we perceive likable people in pain with those of viewing hateful people in pain. While social bonds are built through sharing the plight and pain of others in the name of empathy, viewing a hateful person in pain also has many potential ramifications. In this functional Magnetic Resonance Imaging (fMRI) study, Caucasian Jewish male participants viewed videos of (1) disliked, hateful, anti-Semitic individuals, and (2) liked, non-hateful, tolerant individuals in pain. The results showed that, compared with viewing liked people, viewing hateful people in pain elicited increased responses in regions associated with observation of physical pain (the insular cortex, the anterior cingulate cortex (ACC), and the somatosensory cortex), reward processing (the striatum), and frontal regions associated with emotion regulation. Functional connectivity analyses revealed connections between seed regions in the left ACC and right insular cortex with reward regions, the amygdala, and frontal regions associated with emotion regulation. These data indicate that regions of the brain active while viewing someone in pain may be more active in response to the danger or threat posed by witnessing the pain of a hateful individual more so than the desire to empathize with a likable person's pain. PMID:24167496

  6. Reward-based hypertension control by a synthetic brain-dopamine interface.

    PubMed

    Rössger, Katrin; Charpin-El Hamri, Ghislaine; Fussenegger, Martin

    2013-11-05

    Synthetic biology has significantly advanced the design of synthetic trigger-controlled devices that can reprogram mammalian cells to interface with complex metabolic activities. In the brain, the neurotransmitter dopamine coordinates communication with target neurons via a set of dopamine receptors that control behavior associated with reward-driven learning. This dopamine transmission has recently been suggested to increase central sympathetic outflow, resulting in plasma dopamine levels that correlate with corresponding brain activities. By functionally rewiring the human dopamine receptor D1 (DRD1) via the second messenger cyclic adenosine monophosphate (cAMP) to synthetic promoters containing cAMP response element-binding protein 1(CREB1)-specific cAMP-responsive operator modules, we have designed a synthetic dopamine-sensitive transcription controller that reversibly fine-tunes specific target gene expression at physiologically relevant brain-derived plasma dopamine levels. Following implantation of circuit-transgenic human cell lines insulated by semipermeable immunoprotective microcontainers into mice, the designer device interfaced with dopamine-specific brain activities and produced a systemic expression response when the animal's reward system was stimulated by food, sexual arousal, or addictive drugs. Reward-triggered brain activities were able to remotely program peripheral therapeutic implants to produce sufficient amounts of the atrial natriuretic peptide, which reduced the blood pressure of hypertensive mice to the normal physiologic range. Seamless control of therapeutic transgenes by subconscious behavior may provide opportunities for treatment strategies of the future.

  7. The procrastinators want it now: Behavioral and event-related potential evidence of the procrastination of intertemporal choices.

    PubMed

    Wu, Haiyan; Gui, Danyang; Lin, Wenzheng; Gu, Ruolei; Zhu, Xiangru; Liu, Xun

    2016-08-01

    Much past research has focused on the correlation between procrastination and personality traits (e.g., impulsivity). According to the temporal motivation theory, procrastinators are impulsive and sensitive to delays in time. However, there is still a lack of direct evidence of the tendency of procrastinators to prefer immediate over future rewards. To investigate this question, we recorded event-related potentials (ERPs) in the brain while participants performed an intertemporal choice task involving both time delay and reward processing. The participants were assigned to a high procrastination group and a low procrastination group according to their scores on self-report measures. We found that high procrastination participants preferred immediate rewards compared to future ones whereas low procrastination participants did not. High procrastinators also exhibited a larger and delayed P2 component, indicating delay time processing and abnormal reward processing. No significant effect associated with procrastination was found on the P300 component. Taken together, these findings suggest that high procrastinators are more impulsive and encode the information of delay time more slowly but with a higher level of motivation-driven attention. The current study substantiates higher impulsivity in procrastination and verifies that a difference exists in the sensitivity to time delay between high and low procrastinators. Copyright © 2016 Elsevier Inc. All rights reserved.

  8. The attention habit: how reward learning shapes attentional selection.

    PubMed

    Anderson, Brian A

    2016-04-01

    There is growing consensus that reward plays an important role in the control of attention. Until recently, reward was thought to influence attention indirectly by modulating task-specific motivation and its effects on voluntary control over selection. Such an account was consistent with the goal-directed (endogenous) versus stimulus-driven (exogenous) framework that had long dominated the field of attention research. Now, a different perspective is emerging. Demonstrations that previously reward-associated stimuli can automatically capture attention even when physically inconspicuous and task-irrelevant challenge previously held assumptions about attentional control. The idea that attentional selection can be value driven, reflecting a distinct and previously unrecognized control mechanism, has gained traction. Since these early demonstrations, the influence of reward learning on attention has rapidly become an area of intense investigation, sparking many new insights. The result is an emerging picture of how the reward system of the brain automatically biases information processing. Here, I review the progress that has been made in this area, synthesizing a wealth of recent evidence to provide an integrated, up-to-date account of value-driven attention and some of its broader implications. © 2015 New York Academy of Sciences.

  9. Atypical Brain Responses to Reward Cues in Autism as Revealed by Event-Related Potentials

    ERIC Educational Resources Information Center

    Kohls, Gregor; Peltzer, Judith; Schulte-Ruther, Martin; Kamp-Becker, Inge; Remschmidt, Helmut; Herpertz-Dahlmann, Beate; Konrad, Kerstin

    2011-01-01

    Social motivation deficit theories suggest that children with autism do not properly anticipate and appreciate the pleasure of social stimuli. In this study, we investigated event-related brain potentials evoked by cues that triggered social versus monetary reward anticipation in children with autism. Children with autism showed attenuated P3…

  10. Cognition, emotion, and attention.

    PubMed

    Müller-Oehring, Eva M; Schulte, Tilman

    2014-01-01

    Deficits of attention, emotion, and cognition occur in individuals with alcohol abuse and addiction. This review elucidates the concepts of attention, emotion, and cognition and references research on the underlying neural networks and their compromise in alcohol use disorder. Neuroimaging research on adolescents with family history of alcoholism contributes to the understanding of pre-existing brain structural conditions and characterization of cognition and attention processes in high-risk individuals. Attention and cognition interact with other brain functions, including perceptual selection, salience, emotion, reward, and memory, through interconnected neural networks. Recent research reports compromised microstructural and functional network connectivity in alcoholism, which can have an effect on the dynamic tuning between brain systems, e.g., the frontally based executive control system, the limbic emotion system, and the midbrain-striatal reward system, thereby impeding cognitive flexibility and behavioral adaptation to changing environments. Finally, we introduce concepts of functional compensation, the capacity to generate attentional resources for performance enhancement, and brain structure recovery with abstinence. An understanding of the neural mechanisms of attention, emotion, and cognition will likely provide the basis for better treatment strategies for developing skills that enhance alcoholism therapy adherence and quality of life, and reduce the propensity for relapse. © 2014 Elsevier B.V. All rights reserved.

  11. Gene expression changes in a zebrafish model of drug dependency suggest conservation of neuro-adaptation pathways.

    PubMed

    Kily, Layla J M; Cowe, Yuka C M; Hussain, Osman; Patel, Salma; McElwaine, Suzanne; Cotter, Finbarr E; Brennan, Caroline H

    2008-05-01

    Addiction is a complex psychiatric disorder considered to be a disease of the brain's natural reward reinforcement system. Repeated stimulation of the 'reward' pathway leads to adaptive changes in gene expression and synaptic organization that reinforce drug taking and underlie long-term changes in behaviour. The primitive nature of reward reinforcement pathways and the near universal ability of abused drugs to target the same system allow drug-associated reward and reinforcement to be studied in non-mammalian species. Zebrafish have proved to be a valuable model system for the study of vertebrate development and disease. Here we demonstrate that adult zebrafish show a dose-dependent acute conditioned place preference (CPP) reinforcement response to ethanol or nicotine. Repeated exposure of adult zebrafish to either nicotine or ethanol leads to a robust CPP response that persists following 3 weeks of abstinence and in the face of adverse stimuli, a behavioural indicator of the establishment of dependence. Microarray analysis using whole brain samples from drug-treated and control zebrafish identified 1362 genes that show a significant change in expression between control and treated individuals. Of these genes, 153 are common to both ethanol- and nicotine-treated animals. These genes include members of pathways and processes implicated in drug dependence in mammalian models, revealing conservation of neuro-adaptation pathways between zebrafish and mammals.

  12. Reward expectation regulates brain responses to task-relevant and task-irrelevant emotional words: ERP evidence.

    PubMed

    Wei, Ping; Wang, Di; Ji, Liyan

    2016-02-01

    We investigated the effect of reward expectation on the processing of emotional words in two experiments using event-related potentials (ERPs). A cue indicating the reward condition of each trial (incentive vs non-incentive) was followed by the presentation of a negative or neutral word, the target. Participants were asked to discriminate the emotional content of the target word in Experiment 1 and to discriminate the color of the target word in Experiment 2, rendering the emotionality of the target word task-relevant in Experiment 1, but task-irrelevant in Experiment 2. The negative bias effect, in terms of the amplitude difference between ERPs for negative and neutral targets, was modulated by the task-set. In Experiment 1, P31 and early posterior negativity revealed a larger negative bias effect in the incentive condition than that in the non-incentive condition. However, in Experiment 2, P31 revealed a diminished negative bias effect in the incentive condition compared with that in the non-incentive condition. These results indicate that reward expectation improves top-down attentional concentration to task-relevant information, with enhanced sensitivity to the emotional content of target words when emotionality is task-relevant, but with reduced differential brain responses to emotional words when their content is task-irrelevant. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  13. New developments in brain research of internet and gaming disorder.

    PubMed

    Weinstein, Aviv; Livny, Abigail; Weizman, Abraham

    2017-04-01

    There is evidence that the neural mechanisms underlying Internet Gaming Disorder (IGD) resemble those of drug addiction. Functional Magnetic Resonance Imaging (fMRI) studies of the resting state and measures of gray matter volume have shown that Internet game playing was associated with changes to brain regions responsible for attention and control, impulse control, motor function, emotional regulation, sensory-motor coordination. Furthermore, Internet game playing was associated with lower white matter density in brain regions that are involved in decision-making, behavioral inhibition and emotional regulation. Videogame playing involved changes in reward inhibitory mechanisms and loss of control. Structural brain imaging studies showed alterations in the volume of the ventral striatum that is an important part of the brain's reward mechanisms. Finally, videogame playing was associated with dopamine release similar in magnitude to those of drugs of abuse and lower dopamine transporter and dopamine receptor D 2 occupancy indicating sub-sensitivity of dopamine reward mechanisms. Copyright © 2017 Elsevier Ltd. All rights reserved.

  14. Convergence of EEG and fMRI measures of reward anticipation.

    PubMed

    Gorka, Stephanie M; Phan, K Luan; Shankman, Stewart A

    2015-12-01

    Deficits in reward anticipation are putative mechanisms for multiple psychopathologies. Research indicates that these deficits are characterized by reduced left (relative to right) frontal electroencephalogram (EEG) activity and blood oxygenation level-dependent (BOLD) signal abnormalities in mesolimbic and prefrontal neural regions during reward anticipation. Although it is often assumed that these two measures capture similar mechanisms, no study to our knowledge has directly examined the convergence between frontal EEG alpha asymmetry and functional magnetic resonance imaging (fMRI) during reward anticipation in the same sample. Therefore, the aim of the current study was to investigate if and where in the brain frontal EEG alpha asymmetry and fMRI measures were correlated in a sample of 40 adults. All participants completed two analogous reward anticipation tasks--once during EEG data collection and the other during fMRI data collection. Results indicated that the two measures do converge and that during reward anticipation, increased relative left frontal activity is associated with increased left anterior cingulate cortex (ACC)/medial prefrontal cortex (mPFC) and left orbitofrontal cortex (OFC) activation. This suggests that the two measures may similarly capture PFC functioning, which is noteworthy given the role of these regions in reward processing and the pathophysiology of disorders such as depression and schizophrenia. Copyright © 2015 Elsevier B.V. All rights reserved.

  15. The craving stops before you feel it: neural correlates of chocolate craving during cue exposure with response prevention.

    PubMed

    Frankort, Astrid; Roefs, Anne; Siep, Nicolette; Roebroeck, Alard; Havermans, Remco; Jansen, Anita

    2014-06-01

    Cue reactivity and craving can be influenced by cue exposure with response prevention (CERP). This study investigated the neural correlates of CERP using functional magnetic resonance imaging, while participants smelled chocolate (17 participants) or a control object (17 participants). CERP was interrupted by 7 scanning sequences measuring the brain response to neutral and chocolate pictures. Chocolate craving was hypothesized to be mirrored by activation in brain reward regions. As expected, control group craving remained similar throughout the session. A short exposure (30 min) increased chocolate craving in the experimental group, which was mirrored by significant group differences in activation in brain reward regions. Unexpectedly, a long exposure (60 min) did not lead to craving extinction in the experimental group, although craving started to decrease at this point. On a neural level, however, activation in regions of interest in the experimental group seemed to have extinguished after the long exposure, as activation levels returned to or fell below control group levels. These results indicate that brain reward activation during CERP is linked to craving, at least for a short exposure. Regarding a longer exposure, the decline in brain reward activation in the experimental group may be a precursor of a decrease in craving.

  16. Robust changes in reward circuitry during reward loss in current and former cocaine users during performance of a monetary incentive delay task.

    PubMed

    Patel, Krishna T; Stevens, Michael C; Meda, Shashwath A; Muska, Christine; Thomas, Andre D; Potenza, Marc N; Pearlson, Godfrey D

    2013-10-01

    Abnormal function in reward circuitry in cocaine addiction could predate drug use as a risk factor, follow drug use as a consequence of substance-induced alterations, or both. We used a functional magnetic resonance imaging monetary incentive delay task (MIDT) to investigate reward-loss neural response differences among 42 current cocaine users, 35 former cocaine users, and 47 healthy subjects who also completed psychological measures and tasks related to impulsivity and reward. We found various reward processing-related group differences in several MIDT phases. Across task phases we found a control > current user > former user activation pattern, except for loss outcome, where former compared with current cocaine users activated ventral tegmental area more robustly. We also found regional prefrontal activation differences during loss anticipation between cocaine-using groups. Both groups of cocaine users scored higher than control subjects on impulsivity, compulsivity and reward-punishment sensitivity factors. In addition, impulsivity-related factors correlated positively with activation in amygdala and negatively with anterior cingulate activation during loss anticipation. Compared with healthy subjects, both former and current users displayed abnormal brain activation patterns during MIDT performance. Both cocaine groups differed similarly from healthy subjects, but differences between former and current users were localized to the ventral tegmental area during loss outcome and to prefrontal regions during loss anticipation, suggesting that long-term cocaine abstinence does not normalize most reward circuit abnormalities. Elevated impulsivity-related factors that relate to loss processing in current and former users suggest that these tendencies and relationships may pre-exist cocaine addiction. © 2013 Society of Biological Psychiatry.

  17. The neurobiology of pleasure, reward processes, addiction and their health implications.

    PubMed

    Esch, Tobias; Stefano, George B

    2004-08-01

    Modern science begins to understand pleasure as a potential component of salutogenesis. Thereby, pleasure is described as a state or feeling of happiness and satisfaction resulting from an experience that one enjoys. We examine the neurobiological factors underlying reward processes and pleasure phenomena. Further, health implications related to pleasurable activities are analyzed. With regard to possible negative effects of pleasure, we focus on addiction and motivational toxicity. Pleasure can serve cognition, productivity and health, but simultaneously promotes addiction and other negative behaviors, i.e., motivational toxicity. It is a complex neurobiological phenomenon, relying on reward circuitry or limbic activity. These processes involve dopaminergic signaling. Moreover, endorphin and endogenous morphinergic mechanisms may play a role. Natural rewarding activities are necessary for survival and appetitive motivation, usually governing beneficial biological behaviors like eating, sex and reproduction. Social contacts can further facilitate the positive effects exerted by pleasurable experiences. However, artificial stimulants can be detrimental, since flexibility and normal control of behavior are deteriorated. Additionally, addictive drugs are capable of directly acting on reward pathways. Thus, the concrete outcome of pleasant experiences may be a question of dose. Moderate pleasurable experiences are able to enhance biological flexibility and health. Hence, pleasure can be a resistance resource or may serve salutogenesis. Natural rewards are mediated by sensory organ stimulation, thereby exhibiting a potential association with complementary medical approaches. Trust and belief can be part of a self-healing potential connected with rewarding stimuli. Further, the placebo response physiologically resembles pleasure phenomena, since both involve brain's reward circuitry stimulation and subjective feelings of well-being. Pleasurable activities can stimulate personal growth and may help to induce healthy behavioral changes, including stress management. However, more research is needed to better understand the nature, neurobiology and maybe dangerous aspects of pleasure. Also, a possible involvement of endogenous morphinergic signaling has to be studied further.

  18. Reward circuit connectivity relates to delay discounting in children with attention-deficit/hyperactivity disorder

    PubMed Central

    Costa Dias, Taciana G.; Wilson, Vanessa B.; Bathula, Deepti R.; Iyer, Swathi P.; Mills, Kathryn L.; Thurlow, Bria L.; Stevens, Corinne A.; Musser, Erica D.; Carpenter, Samuel D.; Grayson, David S.; Mitchell, Suzanne H.; Nigg, Joel T.; Fair, Damien A.

    2012-01-01

    Attention-deficit/hyperactivity disorder (ADHD) is a prevalent psychiatric disorder that has poor long-term outcomes and remains a major public health concern. Recent theories have proposed that ADHD arises from alterations in multiple neural pathways. Alterations in reward circuits are hypothesized as one core dysfunction, leading to altered processing of anticipated rewards. The nucleus accumbens (NAcc) is particularly important for reward processes; task-based fMRI studies have found atypical activation of this region while the participants performed a reward task. Understanding how reward circuits are involved with ADHD may be further enhanced by considering how the NAcc interacts with other brain regions. Here we used the technique of resting-state functional connectivity MRI (rs-fcMRI) to examine the alterations in the NAcc interactions and how they relate to impulsive decision making in ADHD. Using rs-fcMRI, this study: examined differences in functional connectivity of the NAcc between children with ADHD and control children; correlated the functional connectivity of NAcc with impulsivity, as measured by a delay discounting task; and combined these two initial segments to identify the atypical NAcc connections that were associated with impulsive decision making in ADHD. We found that functional connectivity of NAcc was atypical in children with ADHD and the ADHD-related increased connectivity between NAcc and the prefrontal cortex was associated with greater impulsivity (steeper delayed-reward discounting). These findings are consistent with the hypothesis that atypical signaling of the NAcc to the prefrontal cortex in ADHD may lead to excessive approach and failure in estimating future consequences; thus, leading to impulsive behavior. PMID:23206930

  19. Viewing pictures of a romantic partner reduces experimental pain: involvement of neural reward systems.

    PubMed

    Younger, Jarred; Aron, Arthur; Parke, Sara; Chatterjee, Neil; Mackey, Sean

    2010-10-13

    The early stages of a new romantic relationship are characterized by intense feelings of euphoria, well-being, and preoccupation with the romantic partner. Neuroimaging research has linked those feelings to activation of reward systems in the human brain. The results of those studies may be relevant to pain management in humans, as basic animal research has shown that pharmacologic activation of reward systems can substantially reduce pain. Indeed, viewing pictures of a romantic partner was recently demonstrated to reduce experimental thermal pain. We hypothesized that pain relief evoked by viewing pictures of a romantic partner would be associated with neural activations in reward-processing centers. In this functional magnetic resonance imaging (fMRI) study, we examined fifteen individuals in the first nine months of a new, romantic relationship. Participants completed three tasks under periods of moderate and high thermal pain: 1) viewing pictures of their romantic partner, 2) viewing pictures of an equally attractive and familiar acquaintance, and 3) a word-association distraction task previously demonstrated to reduce pain. The partner and distraction tasks both significantly reduced self-reported pain, although only the partner task was associated with activation of reward systems. Greater analgesia while viewing pictures of a romantic partner was associated with increased activity in several reward-processing regions, including the caudate head, nucleus accumbens, lateral orbitofrontal cortex, amygdala, and dorsolateral prefrontal cortex--regions not associated with distraction-induced analgesia. The results suggest that the activation of neural reward systems via non-pharmacologic means can reduce the experience of pain.

  20. Brain Stimulation Reward Supports More Consistent and Accurate Rodent Decision-Making than Food Reward.

    PubMed

    McMurray, Matthew S; Conway, Sineadh M; Roitman, Jamie D

    2017-01-01

    Animal models of decision-making rely on an animal's motivation to decide and its ability to detect differences among various alternatives. Food reinforcement, although commonly used, is associated with problematic confounds, especially satiety. Here, we examined the use of brain stimulation reward (BSR) as an alternative reinforcer in rodent models of decision-making and compared it with the effectiveness of sugar pellets. The discriminability of various BSR frequencies was compared to differing numbers of sugar pellets in separate free-choice tasks. We found that BSR was more discriminable and motivated greater task engagement and more consistent preference for the larger reward. We then investigated whether rats prefer BSR of varying frequencies over sugar pellets. We found that animals showed either a clear preference for sugar reward or no preference between reward modalities, depending on the frequency of the BSR alternative and the size of the sugar reward. Overall, these results suggest that BSR is an effective reinforcer in rodent decision-making tasks, removing food-related confounds and resulting in more accurate, consistent, and reliable metrics of choice.

  1. Abnormalities of functional brain networks in pathological gambling: a graph-theoretical approach

    PubMed Central

    Tschernegg, Melanie; Crone, Julia S.; Eigenberger, Tina; Schwartenbeck, Philipp; Fauth-Bühler, Mira; Lemènager, Tagrid; Mann, Karl; Thon, Natasha; Wurst, Friedrich M.; Kronbichler, Martin

    2013-01-01

    Functional neuroimaging studies of pathological gambling (PG) demonstrate alterations in frontal and subcortical regions of the mesolimbic reward system. However, most investigations were performed using tasks involving reward processing or executive functions. Little is known about brain network abnormalities during task-free resting state in PG. In the present study, graph-theoretical methods were used to investigate network properties of resting state functional magnetic resonance imaging data in PG. We compared 19 patients with PG to 19 healthy controls (HCs) using the Graph Analysis Toolbox (GAT). None of the examined global metrics differed between groups. At the nodal level, pathological gambler showed a reduced clustering coefficient in the left paracingulate cortex and the left juxtapositional lobe (supplementary motor area, SMA), reduced local efficiency in the left SMA, as well as an increased node betweenness for the left and right paracingulate cortex and the left SMA. At an uncorrected threshold level, the node betweenness in the left inferior frontal gyrus was decreased and increased in the caudate. Additionally, increased functional connectivity between fronto-striatal regions and within frontal regions has also been found for the gambling patients. These findings suggest that regions associated with the reward system demonstrate reduced segregation but enhanced integration while regions associated with executive functions demonstrate reduced integration. The present study makes evident that PG is also associated with abnormalities in the topological network structure of the brain during rest. Since alterations in PG cannot be explained by direct effects of abused substances on the brain, these findings will be of relevance for understanding functional connectivity in other addictive disorders. PMID:24098282

  2. Cerebral activations during viewing of food stimuli in adult patients with acquired structural hypothalamic damage: a functional neuroimaging study.

    PubMed

    Steele, C A; Powell, J L; Kemp, G J; Halford, J C G; Wilding, J P; Harrold, J A; Kumar, S V D; Cuthbertson, D J; Cross, A A; Javadpour, M; MacFarlane, I A; Stancak, A A; Daousi, C

    2015-09-01

    Obesity is common following hypothalamic damage due to tumours. Homeostatic and non-homeostatic brain centres control appetite and energy balance but their interaction in the presence of hypothalamic damage remains unknown. We hypothesized that abnormal appetite in obese patients with hypothalamic damage results from aberrant brain processing of food stimuli. We sought to establish differences in activation of brain food motivation and reward neurocircuitry in patients with hypothalamic obesity (HO) compared with patients with hypothalamic damage whose weight had remained stable. In a cross-sectional study at a University Clinical Research Centre, we studied 9 patients with HO, 10 age-matched obese controls, 7 patients who remained weight-stable following hypothalamic insult (HWS) and 10 non-obese controls. Functional magnetic resonance imaging was performed in the fasted state, 1 h and 3 h after a test meal, while subjects were presented with images of high-calorie foods, low-calorie foods and non-food objects. Insulin, glucagon-like peptide-1, Peptide YY and ghrelin were measured throughout the experiment, and appetite ratings were recorded. Mean neural activation in the posterior insula and lingual gyrus (brain areas linked to food motivation and reward value of food) in HWS were significantly lower than in the other three groups (P=0.001). A significant negative correlation was found between insulin levels and posterior insula activation (P=0.002). Neural pathways associated with food motivation and reward-related behaviour, and the influence of insulin on their activation may be involved in the pathophysiology of HO.

  3. Prediction error and somatosensory insula activation in women recovered from anorexia nervosa

    PubMed Central

    Frank, Guido K.W.; Collier, Shaleise; Shott, Megan E.; O’Reilly, Randall C.

    2016-01-01

    Background Previous research in patients with anorexia nervosa showed heightened brain response during a taste reward conditioning task and heightened sensitivity to rewarding and punishing stimuli. Here we tested the hypothesis that individuals recovered from anorexia nervosa would also experience greater brain activation during this task as well as higher sensitivity to salient stimuli than controls. Methods Women recovered from restricting-type anorexia nervosa and healthy control women underwent fMRI during application of a prediction error taste reward learning paradigm. Results Twenty-four women recovered from anorexia nervosa (mean age 30.3 ± 8.1 yr) and 24 control women (mean age 27.4 ± 6.3 yr) took part in this study. The recovered anorexia nervosa group showed greater left posterior insula activation for the prediction error model analysis than the control group (family-wise error– and small volume–corrected p < 0.05). A group × condition analysis found greater posterior insula response in women recovered from anorexia nervosa than controls for unexpected stimulus omission, but not for unexpected receipt. Sensitivity to punishment was elevated in women recovered from anorexia nervosa. Limitations This was a cross-sectional study, and the sample size was modest. Conclusion Anorexia nervosa after recovery is associated with heightened prediction error–related brain response in the posterior insula as well as greater response to unexpected reward stimulus omission. This finding, together with behaviourally increased sensitivity to punishment, could indicate that individuals recovered from anorexia nervosa are particularly responsive to punishment. The posterior insula processes somatosensory stimuli, including unexpected bodily states, and greater response could indicate altered perception or integration of unexpected or maybe unwanted bodily feelings. Whether those findings develop during the ill state or whether they are biological traits requires further study. PMID:26836623

  4. Prediction error and somatosensory insula activation in women recovered from anorexia nervosa.

    PubMed

    Frank, Guido K W; Collier, Shaleise; Shott, Megan E; O'Reilly, Randall C

    2016-08-01

    Previous research in patients with anorexia nervosa showed heightened brain response during a taste reward conditioning task and heightened sensitivity to rewarding and punishing stimuli. Here we tested the hypothesis that individuals recovered from anorexia nervosa would also experience greater brain activation during this task as well as higher sensitivity to salient stimuli than controls. Women recovered from restricting-type anorexia nervosa and healthy control women underwent fMRI during application of a prediction error taste reward learning paradigm. Twenty-four women recovered from anorexia nervosa (mean age 30.3 ± 8.1 yr) and 24 control women (mean age 27.4 ± 6.3 yr) took part in this study. The recovered anorexia nervosa group showed greater left posterior insula activation for the prediction error model analysis than the control group (family-wise error- and small volume-corrected p < 0.05). A group × condition analysis found greater posterior insula response in women recovered from anorexia nervosa than controls for unexpected stimulus omission, but not for unexpected receipt. Sensitivity to punishment was elevated in women recovered from anorexia nervosa. This was a cross-sectional study, and the sample size was modest. Anorexia nervosa after recovery is associated with heightened prediction error-related brain response in the posterior insula as well as greater response to unexpected reward stimulus omission. This finding, together with behaviourally increased sensitivity to punishment, could indicate that individuals recovered from anorexia nervosa are particularly responsive to punishment. The posterior insula processes somatosensory stimuli, including unexpected bodily states, and greater response could indicate altered perception or integration of unexpected or maybe unwanted bodily feelings. Whether those findings develop during the ill state or whether they are biological traits requires further study.

  5. Individual differences in the neuropsychopathology of addiction

    PubMed Central

    George, Olivier; Koob, George F.

    2017-01-01

    Drug addiction or substance-use disorder is a chronically relapsing disorder that progresses through binge/intoxication, withdrawal/negative affect and preoccupation/anticipation stages. These stages represent diverse neurobiological mechanisms that are differentially involved in the transition from recreational to compulsive drug use and from positive to negative reinforcement. The progression from recreational to compulsive substance use is associated with downregulation of the brain reward systems and upregulation of the brain stress systems. Individual differences in the neurobiological systems that underlie the processing of reward, incentive salience, habits, stress, pain, and executive function may explain (i) the vulnerability to substance-use disorder; (ii) the diversity of emotional, motivational, and cognitive profiles of individuals with substance-use disorders; and (iii) heterogeneous responses to cognitive and pharmacological treatments. Characterization of the neuropsychological mechanisms that underlie individual differences in addiction-like behaviors is the key to understanding the mechanisms of addiction and development of personalized pharmacotherapy. PMID:29302219

  6. Decision-making in the adolescent brain.

    PubMed

    Blakemore, Sarah-Jayne; Robbins, Trevor W

    2012-09-01

    Adolescence is characterized by making risky decisions. Early lesion and neuroimaging studies in adults pointed to the ventromedial prefrontal cortex and related structures as having a key role in decision-making. More recent studies have fractionated decision-making processes into its various components, including the representation of value, response selection (including inter-temporal choice and cognitive control), associative learning, and affective and social aspects. These different aspects of decision-making have been the focus of investigation in recent studies of the adolescent brain. Evidence points to a dissociation between the relatively slow, linear development of impulse control and response inhibition during adolescence versus the nonlinear development of the reward system, which is often hyper-responsive to rewards in adolescence. This suggests that decision-making in adolescence may be particularly modulated by emotion and social factors, for example, when adolescents are with peers or in other affective ('hot') contexts.

  7. Neural mechanisms of the rejection-aggression link.

    PubMed

    Chester, David S; Lynam, Donald R; Milich, Richard; DeWall, C Nathan

    2018-05-01

    Social rejection is a painful event that often increases aggression. However, the neural mechanisms of this rejection-aggression link remain unclear. A potential clue may be that rejected people often recruit the ventrolateral prefrontal cortex's (VLPFC) self-regulatory processes to manage the pain of rejection. Using functional MRI, we replicated previous links between rejection and activity in the brain's mentalizing network, social pain network and VLPFC. VLPFC recruitment during rejection was associated with greater activity in the brain's reward network (i.e. the ventral striatum) when individuals were given an opportunity to retaliate. This retaliation-related striatal response was associated with greater levels of retaliatory aggression. Dispositionally aggressive individuals exhibited less functional connectivity between the ventral striatum and the right VLPFC during aggression. This connectivity exerted a suppressing effect on dispositionally aggressive individuals' greater aggressive responses to rejection. These results help explain how the pain of rejection and reward of revenge motivate rejected people to behave aggressively.

  8. Biological Risk for the Development of Problem Behavior in Adolescence: Integrating Insights from Behavioral Genetics and Neuroscience.

    PubMed

    Harden, K Paige; Mann, Frank D

    2015-12-01

    Adolescence is a time of increasing engagement in a variety of problem behaviors, including substance use and delinquency. Genetic risk for problem behavior increases over adolescence, is mediated partially by individual differences in sensation seeking, and is exacerbated by involvement with deviant peers. In this article, we describe how findings from behavioral genetic research on problem behavior intersect with research from developmental neuroscience. In particular, the incentive-processing system, including the ventral striatum, responds increasingly to rewards in adolescence, particularly in peer contexts. This developmental shift may be influenced by hormonal changes at puberty. Individual differences in the structure and function of reward-responsive brain regions may be intermediary phenotypes that mediate adolescents' genetic risk for problem behavior. The study of problem behavior can be enriched by interdisciplinary research that integrates measures of brain structure and function into genetically informed studies.

  9. Neural Basis of Reinforcement Learning and Decision Making

    PubMed Central

    Lee, Daeyeol; Seo, Hyojung; Jung, Min Whan

    2012-01-01

    Reinforcement learning is an adaptive process in which an animal utilizes its previous experience to improve the outcomes of future choices. Computational theories of reinforcement learning play a central role in the newly emerging areas of neuroeconomics and decision neuroscience. In this framework, actions are chosen according to their value functions, which describe how much future reward is expected from each action. Value functions can be adjusted not only through reward and penalty, but also by the animal’s knowledge of its current environment. Studies have revealed that a large proportion of the brain is involved in representing and updating value functions and using them to choose an action. However, how the nature of a behavioral task affects the neural mechanisms of reinforcement learning remains incompletely understood. Future studies should uncover the principles by which different computational elements of reinforcement learning are dynamically coordinated across the entire brain. PMID:22462543

  10. Dual roles of dopamine in food- and drug-seeking: the drive-reward paradox

    PubMed Central

    Wise, Roy A.

    2012-01-01

    The question of whether (or to what degree) obesity reflects addiction to high energy foods often narrows to the question of whether the overeating of these foods causes the same long-term neuroadaptations as are identified with the late stages of addiction. Of equal or perhaps greater interest is the question of whether common brain mechanisms mediate the acquisition and development of eating and drug-taking habits. The earliest evidence on this question is rooted in early studies of brain stimulation reward. Lateral hypothalamic electrical stimulation can be reinforcing in some conditions and can motivate feeding in others. That stimulation of the same brain region should be both reinforcing and drive-inducing is paradoxical; why should an animal work to induce a drive-like state such as hunger? This is known as the “drive-reward paradox.” Insights into the substrates of the drive-reward paradox suggest an answer to the controversial question of whether the dopamine system—a system “downstream” from the stimulated fibers of the lateral hypothalamus—is more critically involved in “wanting” or in “liking” of various rewards including food and addictive drugs. That the same brain circuitry is implicated in the motivation for and the reinforcement by both food and addictive drugs extends the argument for a common mechanism underlying compulsive overeating and compulsive drug-taking. PMID:23044182

  11. Distinct representations for shifts of spatial attention and changes of reward contingencies in the human brain

    PubMed Central

    Tosoni, Annalisa; Shulman, Gordon L.; Pope, Anna L. W.; McAvoy, Mark P.; Corbetta, Maurizio

    2012-01-01

    Success in a dynamically changing world requires both rapid shifts of attention to the location of important objects and the detection of changes in motivational contingencies that may alter future behavior. Here we addressed the relationship between these two processes by measuring the blood-oxygenation-level-dependent (BOLD) signal during a visual search task in which the location and the color of a salient cue respectively indicated where a rewarded target would appear and the monetary gain (large or small) associated with its detection. While cues that either shifted or maintained attention were presented every 4 to 8 seconds, the reward magnitude indicated by the cue changed roughly every 30 seconds, allowing us to distinguish a change in expected reward magnitude from a maintained state of expected reward magnitude. Posterior cingulate cortex was modulated by cues signaling an increase in expected reward magnitude, but not by cues for shifting versus maintaining spatial attention. Dorsal fronto-parietal regions in precuneus and FEF also showed increased BOLD activity for changes in expected reward magnitude from low to high, but in addition showed large independent modulations for shifting versus maintaining attention. In particular, the differential activation for shifting versus maintaining attention was not affected by expected reward magnitude. These results indicate that BOLD activations for shifts of attention and increases in expected reward magnitude are largely separate. Finally, visual cortex showed sustained spatially selective signals that were significantly enhanced when greater reward magnitude was expected, but this reward-related modulation was not observed in spatially selective regions of dorsal fronto-parietal cortex. PMID:22578709

  12. Additive effects of oxytocin receptor gene polymorphisms on reward circuitry in youth with autism.

    PubMed

    Hernandez, L M; Krasileva, K; Green, S A; Sherman, L E; Ponting, C; McCarron, R; Lowe, J K; Geschwind, D H; Bookheimer, S Y; Dapretto, M

    2017-08-01

    Several common alleles in the oxytocin receptor gene (OXTR) are associated with altered brain function in reward circuitry in neurotypical adults and may increase risk for autism spectrum disorders (ASD). Yet, it is currently unknown how variation in the OXTR relates to brain functioning in individuals with ASD, and, critically, whether neural endophenotypes vary as a function of aggregate genetic risk. Here, for we believe the first time, we use a multi-locus approach to examine how genetic variation across several OXTR single-nucleotide polymorphisms (SNPs) affect functional connectivity of the brain's reward network. Using data from 41 children with ASD and 41 neurotypical children, we examined functional connectivity of the nucleus accumbens (NAcc) - a hub of the reward network - focusing on how connectivity varies with OXTR risk-allele dosage. Youth with ASD showed reduced NAcc connectivity with other areas in the reward circuit as a function of increased OXTR risk-allele dosage, as well as a positive association between risk-allele dosage and symptom severity, whereas neurotypical youth showed increased NAcc connectivity with frontal brain regions involved in mentalizing. In addition, we found that increased NAcc-frontal cortex connectivity in typically developing youth was related to better scores on a standardized measure of social functioning. Our results indicate that cumulative genetic variation on the OXTR impacts reward system connectivity in both youth with ASD and neurotypical controls. By showing differential genetic effects on neuroendophenotypes, these pathways elucidate mechanisms of vulnerability versus resilience in carriers of disease-associated risk alleles.

  13. The Serotonin 2C Receptor Agonist Lorcaserin Attenuates Intracranial Self-Stimulation and Blocks the Reward-Enhancing Effects of Nicotine.

    PubMed

    Zeeb, Fiona D; Higgins, Guy A; Fletcher, Paul J

    2015-07-15

    Lorcaserin, a serotonin (5-hydroxytryptamine, 5-HT) 2C receptor agonist, was recently approved for the treatment of obesity. We previously suggested that 5-HT2C receptor agonists affect reward processes and reduce the rewarding effects of drugs of abuse. Here, we determined whether lorcaserin (1) decreases responding for brain stimulation reward (BSR) and (2) prevents nicotine from enhancing the efficacy of BSR. Rats were trained on the intracranial self-stimulation (ICSS) paradigm to nosepoke for BSR of either the dorsal raphé nucleus or left medial forebrain bundle. In Experiment 1, lorcaserin (0.3-1.0 mg/kg) dose-dependently reduced the efficacy of BSR. This effect was blocked by prior administration of the 5-HT2C receptor antagonist SB242084. In Experiment 2, separate groups of rats received saline or nicotine (0.4 mg/kg) for eight sessions prior to testing. Although thresholds were unaltered in saline-treated rats, nicotine reduced reward thresholds. An injection of lorcaserin (0.3 mg/kg) prior to nicotine prevented the reward-enhancing effect of nicotine across multiple test sessions. These results demonstrated that lorcaserin reduces the rewarding value of BSR and also prevents nicotine from facilitating ICSS. Hence, lorcaserin may be effective in treating psychiatric disorders, including obesity and nicotine addiction, by reducing the value of food or drug rewards.

  14. Diminished caudate and superior temporal gyrus responses to effort-based decision making in patients with first-episode major depressive disorder.

    PubMed

    Yang, Xin-hua; Huang, Jia; Lan, Yong; Zhu, Cui-ying; Liu, Xiao-qun; Wang, Ye-fei; Cheung, Eric F C; Xie, Guang-rong; Chan, Raymond C K

    2016-01-04

    Anhedonia, the loss of interest or pleasure in reward processing, is a hallmark feature of major depressive disorder (MDD), but its underlying neurobiological mechanism is largely unknown. The present study aimed to examine the underlying neural mechanism of reward-related decision-making in patients with MDD. We examined behavioral and neural responses to rewards in patients with first-episode MDD (N=25) and healthy controls (N=25) using the Effort-Expenditure for Rewards Task (EEfRT). The task involved choices about possible rewards of varying magnitude and probability. We tested the hypothesis that individuals with MDD would exhibit a reduced neural response in reward-related brain structures involved in cost-benefit decision-making. Compared with healthy controls, patients with MDD showed significantly weaker responses in the left caudate nucleus when contrasting the 'high reward'-'low reward' condition, and blunted responses in the left superior temporal gyrus and the right caudate nucleus when contrasting high and low probabilities. In addition, hard tasks chosen during high probability trials were negatively correlated with superior temporal gyrus activity in MDD patients, while the same choices were negatively correlated with caudate nucleus activity in healthy controls. These results indicate that reduced caudate nucleus and superior temporal gyrus activation may underpin abnormal cost-benefit decision-making in MDD. Copyright © 2015 Elsevier Inc. All rights reserved.

  15. Reward and loss anticipation in panic disorder: An fMRI study.

    PubMed

    Held-Poschardt, Dada; Sterzer, Philipp; Schlagenhauf, Florian; Pehrs, Corinna; Wittmann, Andre; Stoy, Meline; Hägele, Claudia; Knutson, Brian; Heinz, Andreas; Ströhle, Andreas

    2018-01-30

    Anticipatory anxiety and harm avoidance are essential features of panic disorder (PD) and may involve deficits in the reward system of the brain, in particular in the ventral striatum. While neuroimaging studies on PD have focused on fearful and negative affective stimulus processing, no investigations have directly addressed deficits in reward and loss anticipation. To determine whether the ventral striatum shows abnormal neural activity in PD patients during anticipation of loss or gain, an event-related functional magnetic resonance imaging experiment using a monetary incentive delay task was employed in 10 patients with PD and 10 healthy controls. A repeated-measures ANOVA to identify effects of group (PD vs. Control) and condition (anticipation of loss vs. gain vs. neutral outcome) revealed that patients with PD showed significantly reduced bilateral ventral striatal activation during reward anticipation but increased activity during loss anticipation. Within the patient group, the degree of activation in the ventral striatum during loss-anticipation was positively correlated with harm avoidance and negatively correlated with novelty seeking. These findings suggest that behavioural impairments in panic disorder may be related to abnormal neural processing of motivational cues. Copyright © 2017 Elsevier B.V. All rights reserved.

  16. The role of orgasm in the development and shaping of partner preferences

    PubMed Central

    Coria-Avila, Genaro A.; Herrera-Covarrubias, Deissy; Ismail, Nafissa; Pfaus, James G.

    2016-01-01

    Background The effect of orgasm on the development and shaping of partner preferences may involve a catalysis of the neurochemical mechanisms of bonding. Therefore, understanding such process is relevant for neuroscience and psychology. Methods A systematic review was carried out using the terms Orgasm, Sexual Reward, Partner Preference, Pair Bonding, Brain, Learning, Sex, Copulation. Results In humans, concentrations of arousing neurotransmitters and potential bonding neurotransmitters increase during orgasm in the cerebrospinal fluid and the bloodstream. Similarly, studies in animals indicate that those neurotransmitters (noradrenaline, oxytocin, prolactin) and others (e.g. dopamine, opioids, serotonin) modulate the appetitive and consummatory phases of sexual behavior and reward. This suggests a link between the experience of orgasm/sexual reward and the neurochemical mechanisms of pair bonding. Orgasm/reward functions as an unconditioned stimulus (UCS). Some areas in the nervous system function as UCS-detection centers, which become activated during orgasm. Partner-related cues function as conditioned stimuli (CS) and are processed in CS-detector centers. Conclusions Throughout the article, we discuss how UCS- and CS-detection centers must interact to facilitate memory consolidation and produce recognition and motivation during future social encounters. PMID:27799080

  17. Antagonism at the NR2B subunit of NMDA receptors induces increased connectivity of the prefrontal and subcortical regions regulating reward behavior.

    PubMed

    Gass, Natalia; Becker, Robert; Sack, Markus; Schwarz, Adam J; Reinwald, Jonathan; Cosa-Linan, Alejandro; Zheng, Lei; von Hohenberg, Christian Clemm; Inta, Dragos; Meyer-Lindenberg, Andreas; Weber-Fahr, Wolfgang; Gass, Peter; Sartorius, Alexander

    2018-04-01

    Evidence indicates that ketamine's rapid antidepressant efficacy likely results from its antagonism of NR2B-subunit-containing NMDA receptors (NMDAR). Since ketamine equally blocks NR2A- and NR2B-containing NMDAR, and has affinity to other receptors, NR2B-selective drugs might have improved therapeutic efficiency and side effect profile. We aimed to compare the effects of (S)-ketamine and two different types of NR2B-selective antagonists on functional brain networks in rats, in order to find common circuits, where their effects intersect, and that might explain their antidepressant action. The experimental design comprised four parallel groups of rats (N = 37), each receiving (S)-Ketamine, CP-101,606, Ro 25-6981 or saline. After compound injection, we acquired resting-state functional magnetic resonance imaging time series. We used graph theoretical approach to calculate brain network properties. Ketamine and CP-101,606 diminished the global clustering coefficient and small-worldness index. At the nodal level, all compounds induced increased connectivity of the regions mediating reward and cognitive aspects of emotional processing, such as ventromedial prefrontal cortex, septal nuclei, and nucleus accumbens. The dorsal hippocampus and regions involved in sensory processing and aversion, such as superior and inferior colliculi, exhibited an opposite effect. The effects common to ketamine and NR2B-selective compounds were localized to the same brain regions as those reported in depression, but in the opposite direction. The upregulation of the reward circuitry might partially underlie the antidepressant and anti-anhedonic effects of the antagonists and could potentially serve as a translational imaging phenotype for testing putative antidepressants, especially those targeting the NR2B receptor subtype.

  18. Risk-Taking Behavior in a Computerized Driving Task: Brain Activation Correlates of Decision-Making, Outcome, and Peer Influence in Male Adolescents.

    PubMed

    Vorobyev, Victor; Kwon, Myoung Soo; Moe, Dagfinn; Parkkola, Riitta; Hämäläinen, Heikki

    2015-01-01

    Increased propensity for risky behavior in adolescents, particularly in peer groups, is thought to reflect maturational imbalance between reward processing and cognitive control systems that affect decision-making. We used functional magnetic resonance imaging (fMRI) to investigate brain functional correlates of risk-taking behavior and effects of peer influence in 18-19-year-old male adolescents. The subjects were divided into low and high risk-taking groups using either personality tests or risk-taking rates in a simulated driving task. The fMRI data were analyzed for decision-making (whether to take a risk at intersections) and outcome (pass or crash) phases, and for the influence of peer competition. Personality test-based groups showed no difference in the amount of risk-taking (similarly increased during peer competition) and brain activation. When groups were defined by actual task performance, risk-taking activated two areas in the left medial prefrontal cortex (PFC) significantly more in low than in high risk-takers. In the entire sample, risky decision-specific activation was found in the anterior and dorsal cingulate, superior parietal cortex, basal ganglia (including the nucleus accumbens), midbrain, thalamus, and hypothalamus. Peer competition increased outcome-related activation in the right caudate head and cerebellar vermis in the entire sample. Our results suggest that the activation of the medial (rather than lateral) PFC and striatum is most specific to risk-taking behavior of male adolescents in a simulated driving situation, and reflect a stronger conflict and thus increased cognitive effort to take risks in low risk-takers, and reward anticipation for risky decisions, respectively. The activation of the caudate nucleus, particularly for the positive outcome (pass) during peer competition, further suggests enhanced reward processing of risk-taking under peer influence.

  19. Cingulate neglect in humans: disruption of contralesional reward learning in right brain damage.

    PubMed

    Lecce, Francesca; Rotondaro, Francesca; Bonnì, Sonia; Carlesimo, Augusto; Thiebaut de Schotten, Michel; Tomaiuolo, Francesco; Doricchi, Fabrizio

    2015-01-01

    Motivational valence plays a key role in orienting spatial attention. Nonetheless, clinical documentation and understanding of motivationally based deficits of spatial orienting in the human is limited. Here in a series of one group-study and two single-case studies, we have examined right brain damaged patients (RBD) with and without left spatial neglect in a spatial reward-learning task, in which the motivational valence of the left contralesional and the right ipsilesional space was contrasted. In each trial two visual boxes were presented, one to the left and one to the right of central fixation. In one session monetary rewards were released more frequently in the box on the left side (75% of trials) whereas in another session they were released more frequently on the right side. In each trial patients were required to: 1) point to each one of the two boxes; 2) choose one of the boxes for obtaining monetary reward; 3) report explicitly the position of reward and whether this position matched or not the original choice. Despite defective spontaneous allocation of attention toward the contralesional space, RBD patients with left spatial neglect showed preserved contralesional reward learning, i.e., comparable to ipsilesional learning and to reward learning displayed by patients without neglect. A notable exception in the group of neglect patients was L.R., who showed no sign of contralesional reward learning in a series of 120 consecutive trials despite being able of reaching learning criterion in only 20 trials in the ipsilesional space. L.R. suffered a cortical-subcortical brain damage affecting the anterior components of the parietal-frontal attentional network and, compared with all other neglect and non-neglect patients, had additional lesion involvement of the medial anterior cingulate cortex (ACC) and of the adjacent sectors of the corpus callosum. In contrast to his lateralized motivational learning deficit, L.R. had no lateral bias in the early phases of attentional processing as he suffered no contralesional visual or auditory extinction on double simultaneous tachistoscopic and dichotic stimulation and detected, with no exception, single contralesional visual and auditory stimuli. In a separate study, we were able to compare L.R. with another RBD patient, G.P., who had a selective lesion in the right ACC, in the adjacent callosal connections and the medial-basal prefrontal cortex. G.P. had no contralesional neglect and displayed normal reward learning both in the left and right side of space. These findings show that contralesional reward learning is generally preserved in RBD patients with left spatial neglect and that this can be exploited in rehabilitation protocols. Contralesional reward learning is severely disrupted in neglect patients when an additional lesion of the ACC is present: however, as demonstrated by the comparison between L.R. and G.P. cases, selective unilateral lesion of the right ACC does not produce motivational neglect for the contralesional space. Copyright © 2014 Elsevier Ltd. All rights reserved.

  20. Reward-dependent learning in neuronal networks for planning and decision making.

    PubMed

    Dehaene, S; Changeux, J P

    2000-01-01

    Neuronal network models have been proposed for the organization of evaluation and decision processes in prefrontal circuitry and their putative neuronal and molecular bases. The models all include an implementation and simulation of an elementary reward mechanism. Their central hypothesis is that tentative rules of behavior, which are coded by clusters of active neurons in prefrontal cortex, are selected or rejected based on an evaluation by this reward signal, which may be conveyed, for instance, by the mesencephalic dopaminergic neurons with which the prefrontal cortex is densely interconnected. At the molecular level, the reward signal is postulated to be a neurotransmitter such as dopamine, which exerts a global modulatory action on prefrontal synaptic efficacies, either via volume transmission or via targeted synaptic triads. Negative reinforcement has the effect of destabilizing the currently active rule-coding clusters; subsequently, spontaneous activity varies again from one cluster to another, giving the organism the chance to discover and learn a new rule. Thus, reward signals function as effective selection signals that either maintain or suppress currently active prefrontal representations as a function of their current adequacy. Simulations of this variation-selection have successfully accounted for the main features of several major tasks that depend on prefrontal cortex integrity, such as the delayed-response test, the Wisconsin card sorting test, the Tower of London test and the Stroop test. For the more complex tasks, we have found it necessary to supplement the external reward input with a second mechanism that supplies an internal reward; it consists of an auto-evaluation loop which short-circuits the reward input from the exterior. This allows for an internal evaluation of covert motor intentions without actualizing them as behaviors, by simply testing them covertly by comparison with memorized former experiences. This element of architecture gives access to enhanced rates of learning via an elementary process of internal or covert mental simulation. We have recently applied these ideas to a new model, developed with M. Kerszberg, which hypothesizes that prefrontal cortex and its reward-related connections contribute crucially to conscious effortful tasks. This model distinguishes two main computational spaces within the human brain: a unique global workspace composed of distributed and heavily interconnected neurons with long-range axons, and a set of specialized and modular perceptual, motor, memory, evaluative and attentional processors. We postulate that workspace neurons are mobilized in effortful tasks for which the specialized processors do not suffice; they selectively mobilize or suppress, through descending connections, the contribution of specific processor neurons. In the course of task performance, workspace neurons become spontaneously co-activated, forming discrete though variable spatio-temporal patterns subject to modulation by vigilance signals and to selection by reward signals. A computer simulation of the Stroop task shows workspace activation to increase during acquisition of a novel task, effortful execution, and after errors. This model makes predictions concerning the spatio-temporal activation patterns during brain imaging of cognitive tasks, particularly concerning the conditions of activation of dorsolateral prefrontal cortex and anterior cingulate, their relation to reward mechanisms, and their specific reaction during error processing.

Top