Quicker Q-Learning in Multi-Agent Systems

NASA Technical Reports Server (NTRS)

Agogino, Adrian K.; Tumer, Kagan

2005-01-01

Multi-agent learning in Markov Decisions Problems is challenging because of the presence ot two credit assignment problems: 1) How to credit an action taken at time step t for rewards received at t' greater than t; and 2) How to credit an action taken by agent i considering the system reward is a function of the actions of all the agents. The first credit assignment problem is typically addressed with temporal difference methods such as Q-learning OK TD(lambda) The second credit assi,onment problem is typically addressed either by hand-crafting reward functions that assign proper credit to an agent, or by making certain independence assumptions about an agent's state-space and reward function. To address both credit assignment problems simultaneously, we propose the Q Updates with Immediate Counterfactual Rewards-learning (QUICR-learning) designed to improve both the convergence properties and performance of Q-learning in large multi-agent problems. Instead of assuming that an agent s value function can be made independent of other agents, this method suppresses the impact of other agents using counterfactual rewards. Results on multi-agent grid-world problems over multiple topologies show that QUICR-learning can achieve up to thirty fold improvements in performance over both conventional and local Q-learning in the largest tested systems.

A performability solution method for degradable nonrepairable systems

NASA Technical Reports Server (NTRS)

Furchtgott, D. G.; Meyer, J. F.

1984-01-01

The present performability model-solving algorithm identifies performance with 'reward', representing the state behavior of a system S by a finite-state stochastic process and determining reward by means of reward rates that are associated with the states of the base model. A general method is obtained for determining the probability distribution function of the performance (reward) variable, and therefore the performability, of the corresponding system. This is done for bounded utilization periods, and the result is an integral expression which is either analytically or numerically solvable.

Influence of ventral tegmental area input on cortico-subcortical networks underlying action control and decision making.

PubMed

Richter, Anja; Gruber, Oliver

2018-02-01

It is argued that the mesolimbic system has a more general function in processing all salient events, including and extending beyond rewards. Saliency was defined as an event that is unexpected due to its frequency of occurrence and elicits an attentional-behavioral switch. Using functional magnetic resonance imaging (fMRI), signals were measured in response to the modulation of salience of rewarding and nonrewarding events during a reward-based decision making task, the so called desire-reason dilemma paradigm (DRD). Replicating previous findings, both frequent and infrequent, and therefore salient, reward stimuli elicited reliable activation of the ventral tegmental area (VTA) and ventral striatum (vStr). When immediate reward desiring contradicted the superordinate task-goal, we found an increased activation of the VTA and vStr when the salient reward stimuli were presented compared to the nonsalient reward stimuli, indicating a boosting of activation in these brain regions. Furthermore, we found a significantly increased functional connectivity between the VTA and vStr, confirming the boosting of vStr activation via VTA input. Moreover, saliency per se without a reward association led to an increased activation of brain regions in the mesolimbic reward system as well as the orbitofrontal cortex (OFC), inferior frontal gyrus (IFG), and anterior cingulate cortex (ACC). Finally, findings uncovered multiple increased functional interactions between cortical saliency-processing brain areas and the VTA and vStr underlying detection and processing of salient events and adaptive decision making. © 2017 Wiley Periodicals, Inc.

Addiction and the brain antireward system.

PubMed

Koob, George F; Le Moal, Michel

2008-01-01

A neurobiological model of the brain emotional systems has been proposed to explain the persistent changes in motivation that are associated with vulnerability to relapse in addiction, and this model may generalize to other psychopathology associated with dysregulated motivational systems. In this framework, addiction is conceptualized as a cycle of decreased function of brain reward systems and recruitment of antireward systems that progressively worsen, resulting in the compulsive use of drugs. Counteradaptive processes, such as opponent process, that are part of the normal homeostatic limitation of reward function fail to return within the normal homeostatic range and are hypothesized to repeatedly drive the allostatic state. Excessive drug taking thus results in not only the short-term amelioration of the reward deficit but also suppression of the antireward system. However, in the long term, there is worsening of the underlying neurochemical dysregulations that ultimately form an allostatic state (decreased dopamine and opioid peptide function, increased corticotropin-releasing factor activity). This allostatic state is hypothesized to be reflected in a chronic deviation of reward set point that is fueled not only by dysregulation of reward circuits per se but also by recruitment of brain and hormonal stress responses. Vulnerability to addiction may involve genetic comorbidity and developmental factors at the molecular, cellular, or neurocircuitry levels that sensitize the brain antireward systems.

Reward and aversion in a heterogeneous midbrain dopamine system.

PubMed

Lammel, Stephan; Lim, Byung Kook; Malenka, Robert C

2014-01-01

The ventral tegmental area (VTA) is a heterogeneous brain structure that serves a central role in motivation and reward processing. Abnormalities in the function of VTA dopamine (DA) neurons and the targets they influence are implicated in several prominent neuropsychiatric disorders including addiction and depression. Recent studies suggest that the midbrain DA system is composed of anatomically and functionally heterogeneous DA subpopulations with different axonal projections. These findings may explain a number of previously confusing observations that suggested a role for DA in processing both rewarding as well as aversive events. Here we will focus on recent advances in understanding the neural circuits mediating reward and aversion in the VTA and how stress as well as drugs of abuse, in particular cocaine, alter circuit function within a heterogeneous midbrain DA system. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'. Copyright © 2013 Elsevier Ltd. All rights reserved.

Music and the nucleus accumbens.

PubMed

Mavridis, Ioannis N

2015-03-01

Music is a universal feature of human societies over time, mainly because it allows expression and regulation of strong emotions, thus influencing moods and evoking pleasure. The nucleus accumbens (NA), the most important pleasure center of the human brain (dominates the reward system), is the 'king of neurosciences' and dopamine (DA) can be rightfully considered as its 'crown' due to the fundamental role that this neurotransmitter plays in the brain's reward system. Purpose of this article was to review the existing literature regarding the relation between music and the NA. Studies have shown that reward value for music can be coded by activity levels in the NA, whose functional connectivity with auditory and frontal areas increases as a function of increasing musical reward. Listening to music strongly modulates activity in a network of mesolimbic structures involved in reward processing including the NA. The functional connectivity between brain regions mediating reward, autonomic and cognitive processing provides insight into understanding why listening to music is one of the most rewarding and pleasurable human experiences. Musical stimuli can significantly increase extracellular DA levels in the NA. NA DA and serotonin were found significantly higher in animals exposed to music. Finally, passive listening to unfamiliar although liked music showed activations in the NA.

Abnormal Reward System Activation in Mania

PubMed Central

Abler, Birgit; Greenhouse, Ian; Ongur, Dost; Walter, Henrik; Heckers, Stephan

2008-01-01

Transmission of reward signals is a function of dopamine, a neurotransmitter known to be involved in the mechanism of psychosis. Using functional magnetic resonance imaging (fMRI), we investigated how expectation and receipt of monetary rewards modulate brain activation in patients with bipolar mania and schizophrenia. We studied 12 acutely manic patients with a history of bipolar disorder, 12 patients with a current episode of schizoaffective disorder or schizophrenia and 12 healthy subjects. All patients were treated with dopamine antagonists at the time of the study. Subjects performed a delayed incentive paradigm with monetary reward in the scanner that allowed for investigating effects of expectation, receipt, and omission of rewards. Patients with schizophrenia and healthy control subjects showed the expected activation of dopaminergic brain areas, that is, ventral tegmentum activation upon expectation of monetary rewards and nucleus accumbens activation during receipt vs omission of rewards. In manic patients, however, we did not find a similar pattern of brain activation and the differential signal in the nucleus accumbens upon receipt vs omission of rewards was significantly lower compared to the healthy control subjects. Our findings provide evidence for abnormal function of the dopamine system during receipt or omission of expected rewards in bipolar disorder. These deficits in prediction error processing in acute mania may help to explain symptoms of disinhibition and abnormal goal pursuit regulation. PMID:17987058

Looking for reward in all the wrong places: dopamine receptor gene polymorphisms indirectly affect aggression through sensation-seeking.

PubMed

Chester, David S; DeWall, C Nathan; Derefinko, Karen J; Estus, Steven; Lynam, Donald R; Peters, Jessica R; Jiang, Yang

2016-10-01

Individuals with genotypes that code for reduced dopaminergic brain activity often exhibit a predisposition toward aggression. However, it remains largely unknown how dopaminergic genotypes may increase aggression. Lower-functioning dopamine systems motivate individuals to seek reward from external sources such as illicit drugs and other risky experiences. Based on emerging evidence that aggression is a rewarding experience, we predicted that the effect of lower-functioning dopaminergic functioning on aggression would be mediated by tendencies to seek the environment for rewards. Caucasian female and male undergraduates (N = 277) were genotyped for five polymorphisms of the dopamine D2 receptor (DRD2) gene; they reported their previous history of aggression and their dispositional reward-seeking. Lower-functioning DRD2 profiles were associated with greater sensation-seeking, which then predicted greater aggression. Our findings suggest that lower-functioning dopaminergic activity puts individuals at risk for violence because it motivates them to experience aggression's hedonically rewarding qualities.

Pain and suicidality: insights from reward and addiction neuroscience.

PubMed

Elman, Igor; Borsook, David; Volkow, Nora D

2013-10-01

Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system's role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward circuitry); both are relevant etiologic factors in pain, suicide and social attachments. A comprehensive literature search on neurobiology of pain and suicidality was performed. The collected articles were critically reviewed and relevant data were extracted and summarized within four key areas: (1) physical and emotional pain, (2) emotional pain and social attachments, (3) pain- and suicide-related alterations of the reward and anti-reward circuits as compared to addiction, which is the premier probe for dysfunction of these circuits and (4) mechanistically informed treatments of co-occurring pain and suicidality. Pain-, stress- and analgesic drugs-induced opponent and proponent states of the mesolimbic dopaminergic pathways may render reward and anti-reward systems vulnerable to sensitization, cross-sensitization and aberrant learning of contents and contexts associated with suicidal acts and behaviors. These findings suggest that pain patients exhibit alterations in the brain circuits mediating reward (depressed function) and anti-reward (sensitized function) that may affect their proclivity for suicide and support pain and suicidality classification among other "reward deficiency syndromes" and a new proposal for "enhanced anti-reward syndromes". We suggest that interventions aimed at restoring the balance between the reward and anti-reward networks in patients with chronic pain may help decreasing their suicide risk. Published by Elsevier Ltd.

Hyperresponsivity and impaired prefrontal control of the mesolimbic reward system in schizophrenia.

PubMed

Richter, Anja; Petrovic, Aleksandra; Diekhof, Esther K; Trost, Sarah; Wolter, Sarah; Gruber, Oliver

2015-12-01

Schizophrenia is characterized by substantial dysfunctions of reward processing, leading to detrimental consequences for decision-making. The neurotransmitter dopamine is responsible for the transmission of reward signals and also known to be involved in the mechanism of psychosis. Using functional magnetic resonance imaging (fMRI), sixteen medicated patients with schizophrenia and sixteen healthy controls performed the 'desire-reason dilemma' (DRD) paradigm. This paradigm allowed us to directly investigate reward-related brain activations depending on the interaction of bottom-up and top-down mechanisms, when a previously conditioned reward stimulus had to be rejected to achieve a superordinate long-term goal. Both patients and controls showed significant activations in the mesolimbic reward system. In patients with schizophrenia, however, we found a significant hyperactivation of the left ventral striatum (vStr) when they were allowed to accept the conditioned reward stimuli, and a reduced top-down regulation of activation in the ventral striatum (vStr) and ventral tegmental area (VTA) while having to reject the immediate reward to pursue the superordinate task-goal. Moreover, while healthy subjects exhibited a negative functional coupling of the vStr with both the anteroventral prefrontal cortex (avPFC) and the ventromedial prefrontal cortex (VMPFC) in the dilemma situation, this functional coupling was significantly impaired in the patient group. These findings provide evidence for an increased ventral striatal activation to reward stimuli and an impaired top-down control of reward signals by prefrontal brain regions in schizophrenia. Copyright © 2015 Elsevier Ltd. All rights reserved.

fMRI of alterations in reward selection, anticipation, and feedback in major depressive disorder.

PubMed

Smoski, Moria J; Felder, Jennifer; Bizzell, Joshua; Green, Steven R; Ernst, Monique; Lynch, Thomas R; Dichter, Gabriel S

2009-11-01

The purpose of the present investigation was to evaluate reward processing in unipolar major depressive disorder (MDD). Specifically, we investigated whether adults with MDD demonstrated hyporesponsivity in striatal brain regions and/or hyperresponsivity in cortical brain regions involved in conflict monitoring using a Wheel of Fortune task designed to probe responses during reward selection, reward anticipation, and reward feedback. Functional magnetic resonance imaging (fMRI) data indicated that the MDD group was characterized by reduced activation of striatal reward regions during reward selection, reward anticipation, and reward feedback, supporting previous data indicating hyporesponsivity of reward systems in MDD. Support was not found for hyperresponsivity of cognitive control regions during reward selection or reward anticipation. Instead, MDD participants showed hyperresponsivity in orbitofrontal cortex, a region associated with assessment of risk and reward, during reward selection, as well as decreased activation of the middle frontal gyrus and the rostral cingulate gyrus during reward selection and anticipation. Finally, depression severity was predicted by activation in bilateral midfrontal gyrus during reward selection. Results indicate that MDD is characterized by striatal hyporesponsivity, and that future studies of MDD treatments that seek to improve responses to rewarding stimuli should assess striatal functioning.

Markov reward processes

NASA Technical Reports Server (NTRS)

Smith, R. M.

1991-01-01

Numerous applications in the area of computer system analysis can be effectively studied with Markov reward models. These models describe the behavior of the system with a continuous-time Markov chain, where a reward rate is associated with each state. In a reliability/availability model, upstates may have reward rate 1 and down states may have reward rate zero associated with them. In a queueing model, the number of jobs of certain type in a given state may be the reward rate attached to that state. In a combined model of performance and reliability, the reward rate of a state may be the computational capacity, or a related performance measure. Expected steady-state reward rate and expected instantaneous reward rate are clearly useful measures of the Markov reward model. More generally, the distribution of accumulated reward or time-averaged reward over a finite time interval may be determined from the solution of the Markov reward model. This information is of great practical significance in situations where the workload can be well characterized (deterministically, or by continuous functions e.g., distributions). The design process in the development of a computer system is an expensive and long term endeavor. For aerospace applications the reliability of the computer system is essential, as is the ability to complete critical workloads in a well defined real time interval. Consequently, effective modeling of such systems must take into account both performance and reliability. This fact motivates our use of Markov reward models to aid in the development and evaluation of fault tolerant computer systems.

An Update on the Role of Serotonin and its Interplay with Dopamine for Reward.

PubMed

Fischer, Adrian G; Ullsperger, Markus

2017-01-01

The specific role of serotonin and its interplay with dopamine (DA) in adaptive, reward guided behavior as well as drug dependance, still remains elusive. Recently, novel methods allowed cell type specific anatomical, functional and interventional analyses of serotonergic and dopaminergic circuits, promising significant advancement in understanding their functional roles. Furthermore, it is increasingly recognized that co-release of neurotransmitters is functionally relevant, understanding of which is required in order to interpret results of pharmacological studies and their relationship to neural recordings. Here, we review recent animal studies employing such techniques with the aim to connect their results to effects observed in human pharmacological studies and subjective effects of drugs. It appears that the additive effect of serotonin and DA conveys significant reward related information and is subjectively highly euphorizing. Neither DA nor serotonin alone have such an effect. This coincides with optogenetically targeted recordings in mice, where the dopaminergic system codes reward prediction errors (PE), and the serotonergic system mainly unsigned PE. Overall, this pattern of results indicates that joint activity between both systems carries essential reward information and invites parallel investigation of both neurotransmitter systems.

The effects of AMPA receptor blockade in the prelimbic cortex on systemic and ventral tegmental area opiate reward sensitivity.

PubMed

De Jaeger, Xavier; Bishop, Stephanie F; Ahmad, Tasha; Lyons, Danika; Ng, Garye Ami; Laviolette, Steven R

2013-02-01

The medial prefrontal cortex (mPFC) is a key neural region involved in opiate-related reward memory processing. AMPA receptor transmission in the mPFC modulates opiate-related reward memory processing, and chronic opiate exposure is associated with alterations in intra-mPFC AMPA receptor function. The objectives of this study were to examine how pharmacological blockade of AMPA receptor transmission in the prelimbic (PLC) division of the mPFC may modulate opiate reward memory acquisition and whether opiate exposure state may modulate the functional role of intra-PLC AMPA receptor transmission during opiate reward learning. Using an unbiased conditioned place preference (CPP) procedure in rats, we performed discrete, bilateral intra-PLC microinfusions of the AMPA receptor antagonist, 6,7-dinitroquinoxaline-2,3-dione, prior to behavioral morphine CPP conditioning, using sub-reward threshold conditioning doses of either systemic (0.05 mg/kg; i.p.) or intra-ventral tegmental area (VTA) morphine (250 ng/0.5 μl). We show that, in both opiate-naïve and opiate-dependent states, intra-PLC blockade of AMPA receptor transmission, but not the infralimbic cortex, increases the behavioral reward magnitude of systemic or intra-VTA morphine. This effect is dependent on dopamine (DA)ergic signaling because pre-administration of cis-(Z)-flupenthixol-dihydrochloride (α-flu), a broad-spectrum dopamine receptor antagonist, blocked the morphine-reward potentiating effects of AMPA receptor blockade. These findings suggest a critical role for intra-PLC AMPA receptor transmission in the processing of opiate reward signaling. Furthermore, blockade of AMPA transmission specifically within the PLC is capable of switching opiate reward processing to a DA-dependent reward system, independently of previous opiate exposure history.

The roles of valuation and reward processing in cognitive function and psychiatric disorders

PubMed Central

Hélie, Sébastien; Shamloo, Farzin; Novak, Keisha; Foti, Dan

2017-01-01

In neuroeconomics, valuation refers to the process of assigning values to states and actions based on the animal’s current representation of the environment while reward processing corresponds to processing the feedback received from the environment to update the values of states and actions. In this article, we review the brain circuits associated with valuation and reward processing and argue that these are fundamental processes critical in many cognitive functions. Specifically, we focus on the role of valuation and reward processing in attention, memory, decision–making, and learning. Next, the extant neuroimaging literature on a number of psychiatric disorders is reviewed (i.e., addiction, pathological gambling, schizophrenia, and mood disorders), and an argument is made that associated deficits in cognitive functions can be explained in terms of abnormal valuation and reward processing. The review concludes with the impact of this framework in clinical settings and prescriptions for future research, in particular with regards to the conversions of qualitatively different valuation systems into a system of common currency. PMID:28415138

Plasticity of reward neurocircuitry and the 'dark side' of drug addiction.

PubMed

Koob, George F; Le Moal, Michel

2005-11-01

Drug seeking is associated with activation of reward neural circuitry. Here we argue that drug addiction also involves a 'dark side'--a decrease in the function of normal reward-related neurocircuitry and persistent recruitment of anti-reward systems. Understanding the neuroplasticity of the dark side of this circuitry is the key to understanding vulnerability to addiction.

Addiction is a Reward Deficit and Stress Surfeit Disorder

PubMed Central

Koob, George F.

2013-01-01

Drug addiction can be defined by a three-stage cycle – binge/intoxication, withdrawal/negative affect, and preoccupation/anticipation – that involves allostatic changes in the brain reward and stress systems. Two primary sources of reinforcement, positive and negative reinforcement, have been hypothesized to play a role in this allostatic process. The negative emotional state that drives negative reinforcement is hypothesized to derive from dysregulation of key neurochemical elements involved in the brain reward and stress systems. Specific neurochemical elements in these structures include not only decreases in reward system function (within-system opponent processes) but also recruitment of the brain stress systems mediated by corticotropin-releasing factor (CRF) and dynorphin-κ opioid systems in the ventral striatum, extended amygdala, and frontal cortex (both between-system opponent processes). CRF antagonists block anxiety-like responses associated with withdrawal, block increases in reward thresholds produced by withdrawal from drugs of abuse, and block compulsive-like drug taking during extended access. Excessive drug taking also engages the activation of CRF in the medial prefrontal cortex, paralleled by deficits in executive function that may facilitate the transition to compulsive-like responding. Neuropeptide Y, a powerful anti-stress neurotransmitter, has a profile of action on compulsive-like responding for ethanol similar to a CRF1 antagonist. Blockade of the κ opioid system can also block dysphoric-like effects associated with withdrawal from drugs of abuse and block the development of compulsive-like responding during extended access to drugs of abuse, suggesting another powerful brain stress system that contributes to compulsive drug seeking. The loss of reward function and recruitment of brain systems provide a powerful neurochemical basis that drives the compulsivity of addiction. PMID:23914176

Reward-seeking behavior and addiction: cause or cog?

PubMed

Arias-Carrión, Oscar; Salama, Mohamed

2012-09-01

Although dopaminergic system represents the cornerstone in rewarding, other neurotransmitters can modulate both the reward system and the psychomotor effects of addictive drugs. Many hypotheses have been proposed for a better understanding of the reward system and its role in drug addiction. However, after many years of investigation, no single theory can completely explain the neural basis of drug addiction. Recent reports introduce novel neurotransmitters into the game e.g. dynorphins, orexins, histamine, gheralin and galanin. The interacting functions of these neurotransmitters have shown that the reward system and its role in drug dependence, is far more complicated than was thought before. Individual variations exist regarding response to drug exposure, vulnerability for addiction and the effects of different cues on reward systems. Consequently, genetic variations of neurotransmission are thought to influence reward processing that in turn may affect distinctive social behavior and susceptibility to addiction. However, the individual variations can not be based mainly on genetics; environmental factors seem to play a role too. Here we discuss the current knowledge about the orquestic regulation of different neurotransmitters on reward-seeking behavior and their potential effect on drug addiction.

Effort, anhedonia, and function in schizophrenia: reduced effort allocation predicts amotivation and functional impairment.

PubMed

Barch, Deanna M; Treadway, Michael T; Schoen, Nathan

2014-05-01

One of the most debilitating aspects of schizophrenia is an apparent interest in or ability to exert effort for rewards. Such "negative symptoms" may prevent individuals from obtaining potentially beneficial outcomes in educational, occupational, or social domains. In animal models, dopamine abnormalities decrease willingness to work for rewards, implicating dopamine (DA) function as a candidate substrate for negative symptoms given that schizophrenia involves dysregulation of the dopamine system. We used the effort-expenditure for rewards task (EEfRT) to assess the degree to which individuals with schizophrenia were wiling to exert increased effort for either larger magnitude rewards or for rewards that were more probable. Fifty-nine individuals with schizophrenia and 39 demographically similar controls performed the EEfRT task, which involves making choices between "easy" and "hard" tasks to earn potential rewards. Individuals with schizophrenia showed less of an increase in effort allocation as either reward magnitude or probability increased. In controls, the frequency of choosing the hard task in high reward magnitude and probability conditions was negatively correlated with depression severity and anhedonia. In schizophrenia, fewer hard task choices were associated with more severe negative symptoms and worse community and work function as assessed by a caretaker. Consistent with patterns of disrupted dopamine functioning observed in animal models of schizophrenia, these results suggest that 1 mechanism contributing to impaired function and motivational drive in schizophrenia may be a reduced allocation of greater effort for higher magnitude or higher probability rewards.

"Liking" and "wanting" linked to Reward Deficiency Syndrome (RDS): hypothesizing differential responsivity in brain reward circuitry.

PubMed

Blum, Kenneth; Gardner, Eliot; Oscar-Berman, Marlene; Gold, Mark

2012-01-01

In an attempt to resolve controversy regarding the causal contributions of mesolimbic dopamine (DA) systems to reward, we evaluate the three main competing explanatory categories: "liking,"learning," and "wanting" [1]. That is, DA may mediate (a) the hedonic impact of reward (liking), (b) learned predictions about rewarding effects (learning), or (c) the pursuit of rewards by attributing incentive salience to reward-related stimuli (wanting). We evaluate these hypotheses, especially as they relate to the Reward Deficiency Syndrome (RDS), and we find that the incentive salience or "wanting" hypothesis of DA function is supported by a majority of the evidence. Neuroimaging studies have shown that drugs of abuse, palatable foods, and anticipated behaviors such as sex and gaming affect brain regions involving reward circuitry, and may not be unidirectional. Drugs of abuse enhance DA signaling and sensitize mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Addictive drugs have in common that they are voluntarily selfadministered, they enhance (directly or indirectly) dopaminergic synaptic function in the nucleus accumbens (NAC), and they stimulate the functioning of brain reward circuitry (producing the "high" that drug users seek). Although originally believed simply to encode the set point of hedonic tone, these circuits now are believed to be functionally more complex, also encoding attention, reward expectancy, disconfirmation of reward expectancy, and incentive motivation. Elevated stress levels, together with polymorphisms of dopaminergic genes and other neurotransmitter genetic variants, may have a cumulative effect on vulnerability to addiction. The RDS model of etiology holds very well for a variety of chemical and behavioral addictions.

Menstrual cycle phase modulates reward-related neural function in women.

PubMed

Dreher, Jean-Claude; Schmidt, Peter J; Kohn, Philip; Furman, Daniella; Rubinow, David; Berman, Karen Faith

2007-02-13

There is considerable evidence from animal studies that the mesolimbic and mesocortical dopamine systems are sensitive to circulating gonadal steroid hormones. Less is known about the influence of estrogen and progesterone on the human reward system. To investigate this directly, we used functional MRI and an event-related monetary reward paradigm to study women with a repeated-measures, counterbalanced design across the menstrual cycle. Here we show that during the midfollicular phase (days 4-8 after onset of menses) women anticipating uncertain rewards activated the orbitofrontal cortex and amygdala more than during the luteal phase (6-10 days after luteinizing hormone surge). At the time of reward delivery, women in the follicular phase activated the midbrain, striatum, and left fronto-polar cortex more than during the luteal phase. These data demonstrate augmented reactivity of the reward system in women during the midfollicular phase when estrogen is unopposed by progesterone. Moreover, investigation of between-sex differences revealed that men activated ventral putamen more than women during anticipation of uncertain rewards, whereas women more strongly activated the anterior medial prefrontal cortex at the time of reward delivery. Correlation between brain activity and gonadal steroid levels also revealed that the amygdalo-hippocampal complex was positively correlated with estradiol level, regardless of menstrual cycle phase. Together, our findings provide evidence of neurofunctional modulation of the reward system by gonadal steroid hormones in humans and establish a neurobiological foundation for understanding their impact on vulnerability to drug abuse, neuropsychiatric diseases with differential expression across males and females, and hormonally mediated mood disorders.

Reward in the mirror neuron system, social context, and the implications on psychopathology.

PubMed

Brown, Elliot C; Brüne, Martin

2014-04-01

Positive and negative reinforcers guide our behaviors as we interact with others in our social environment. Here, we present evidence that highlights a central role for reward in the general functioning of the mirror neuron system (MNS). We also discuss the relevance of reward-related modulation on other previous findings revealing certain properties of the MNS, and on social context and psychopathology.

Reward sensitivity is associated with brain activity during erotic stimulus processing.

PubMed

Costumero, Victor; Barrós-Loscertales, Alfonso; Bustamante, Juan Carlos; Ventura-Campos, Noelia; Fuentes, Paola; Rosell-Negre, Patricia; Ávila, César

2013-01-01

The behavioral approach system (BAS) from Gray's reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray's theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men completed the Sensitivity to Reward scale (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire) to measure BAS-related traits. Results showed that Sensitivity to Reward scores correlated positively with brain activity during reactivity to erotic pictures in the left orbitofrontal cortex, left insula, and right ventral striatum. These results demonstrated a relationship between the BAS and reward sensitivity during the processing of erotic stimuli, filling the gap of previous reports that identified the dopaminergic system as a neural substrate for the BAS during the processing of other rewarding stimuli such as money and food.

Reward Sensitivity Is Associated with Brain Activity during Erotic Stimulus Processing

PubMed Central

Costumero, Victor; Barrós-Loscertales, Alfonso; Bustamante, Juan Carlos; Ventura-Campos, Noelia; Fuentes, Paola; Rosell-Negre, Patricia; Ávila, César

2013-01-01

The behavioral approach system (BAS) from Gray’s reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray’s theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men completed the Sensitivity to Reward scale (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire) to measure BAS-related traits. Results showed that Sensitivity to Reward scores correlated positively with brain activity during reactivity to erotic pictures in the left orbitofrontal cortex, left insula, and right ventral striatum. These results demonstrated a relationship between the BAS and reward sensitivity during the processing of erotic stimuli, filling the gap of previous reports that identified the dopaminergic system as a neural substrate for the BAS during the processing of other rewarding stimuli such as money and food. PMID:23840558

A Systematic Review of fMRI Reward Paradigms in Adolescents versus Adults: The Impact of Task Design and Implications for Understanding Neurodevelopment

PubMed Central

Richards, Jessica M.; Plate, Rista C.; Ernst, Monique

2013-01-01

The neural systems underlying reward-related behaviors across development have recently generated a great amount of interest. Yet, the neurodevelopmental literature on reward processing is marked by inconsistencies due to the heterogeneity of the reward paradigms used, the complexity of the behaviors being studied, and the developing brain itself as a moving target. The present review will examine task design as one source of variability across findings by compiling this literature along three dimensions: (1) task structures, (2) cognitive processes, and (3) neural systems. We start with the presentation of a heuristic neural systems model, the Triadic Model, as a way to provide a theoretical framework for the neuroscience research on motivated behaviors. We then discuss the principles guiding reward task development. Finally, we review the extant developmental neuroimaging literature on reward-related processing, organized by reward task type. We hope that this approach will help to clarify the literature on the functional neurodevelopment of reward-related neural systems, and to identify the role of the experimental parameters that significantly influence these findings. PMID:23518270

Altered neural reward representations in pathological gamblers revealed by delay and probability discounting.

PubMed

Miedl, Stephan F; Peters, Jan; Büchel, Christian

2012-02-01

The neural basis of excessive delay discounting and reduced risk sensitivity of pathological gamblers with a particular focus on subjective neural reward representations has not been previously examined. To examine how pathological gamblers represent subjective reward value at a neural level and how this is affected by gambling severity. Model-based functional magnetic resonance imaging study with patients and control subjects. Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf. Participants were recruited from the local community by advertisement and through self-help groups. A sample of 16 pathological gamblers (according to the DSM-IV definition) was matched by age, sex, smoking status, income, educational level, and handedness to 16 healthy controls. Pathological gamblers showed increased discounting of delayed rewards and a trend toward decreased discounting of probabilistic rewards compared with matched controls. At the neural level, a significant group × condition interaction indicated that reward representations in the gamblers were modulated in a condition-specific manner, such that they exhibited increased (delay discounting) and decreased (probability discounting) neural value correlations in the reward system. In addition, throughout the reward system, neuronal value signals for delayed rewards were negatively correlated with gambling severity. The results extend previous reports of a generally hypoactive reward system in pathological gamblers by showing that, even when subjective reward valuation is accounted for, gamblers still show altered reward representations. Furthermore, results point toward a gradual degradation of mesolimbic reward representations for delayed rewards during the course of pathological gambling.

“Liking” and “Wanting” Linked to Reward Deficiency Syndrome (RDS): Hypothesizing Differential Responsivity in Brain Reward Circuitry

PubMed Central

Blum, Kenneth; Gardner, Eliot; Oscar-Berman, Marlene; Gold, Mark

2013-01-01

In an attempt to resolve controversy regarding the causal contributions of mesolimbic dopamine (DA) systems to reward, we evaluate the three main competing explanatory categories: “liking,” “learning,” and “wanting” [1]. That is, DA may mediate (a) the hedonic impact of reward (liking), (b) learned predictions about rewarding effects (learning), or (c) the pursuit of rewards by attributing incentive salience to reward-related stimuli (wanting). We evaluate these hypotheses, especially as they relate to the Reward Deficiency Syndrome (RDS), and we find that the incentive salience or “wanting” hypothesis of DA function is supported by a majority of the evidence. Neuroimaging studies have shown that drugs of abuse, palatable foods, and anticipated behaviors such as sex and gaming affect brain regions involving reward circuitry, and may not be unidirectional. Drugs of abuse enhance DA signaling and sensitize mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Addictive drugs have in common that they are voluntarily self-administered, they enhance (directly or indirectly) dopaminergic synaptic function in the nucleus accumbens, and they stimulate the functioning of brain reward circuitry (producing the “high” that drug users seek). Although originally believed simply to encode the set point of hedonic tone, these circuits now are believed to be functionally more complex, also encoding attention, reward expectancy, disconfirmation of reward expectancy, and incentive motivation. Elevated stress levels, together with polymorphisms of dopaminergic genes and other neurotransmitter genetic variants, may have a cumulative effect on vulnerability to addiction. The RDS model of etiology holds very well for a variety of chemical and behavioral addictions. PMID:22236117

"I won, but I’m not getting my hopes up": Depression Moderates the Relationship Outcomes and Reward Anticipation

PubMed Central

Olino, Thomas M.; McMakin, Dana L.; Dahl, Ronald E.; Ryan, Neal D.; Silk, Jennifer S.; Birmaher, Boris; Axelson, David A.; Forbes, Erika E.

2011-01-01

Major Depressive Disorder (MDD) in adolescents is characterized by alterations in positive emotions and reward processing. Recent investigations using functional magnetic resonance imaging (fMRI) find depression-related differences in reward anticipation. However, it is unknown whether feedback influences subsequent reward anticipation, which may highlight the context of reward processing. Ten youth with MDD and sixteen youth with no history of MDD completed an fMRI assessment using a reward task. Reward anticipation was indexed by blood oxygen level dependent signal change in the striatum following winning; losing; non-winning; and non-losing outcomes. A significant interaction between diagnostic status and outcome condition predicted reward anticipation in the caudate. Decomposition of the interaction indicated that following winning outcomes, depressed youth demonstrated reduced reward anticipation relative to healthy youth. However, no significant differences between depressed and healthy youth were found after other outcomes. Reward anticipation is altered following winning outcomes. This finding has implications for understanding the developmental pathophysiology of MDD and suggests specific contexts where altered motivational system functioning may play a role in maintaining depression. PMID:22079656

Dramatic decreases in brain reward function during nicotine withdrawal.

PubMed

Epping-Jordan, M P; Watkins, S S; Koob, G F; Markou, A

1998-05-07

Tobacco smoking is a worldwide public health problem. In the United States alone, over 400,000 deaths and $50 billion in medical costs annually are directly attributed to smoking. Accumulated evidence indicates that nicotine is the component of tobacco smoke that leads to addiction, but the means by which nicotine produces addiction remain unclear. Nicotine is less effective as a positive reinforcer than other drugs of abuse in non-dependent animals. Nevertheless, nicotine-withdrawal symptoms, including depressed mood, anxiety, irritability and craving in dependent subjects may contribute to the addictive liability of nicotine. We show here that spontaneous nicotine withdrawal in rats resulted in a significant decrease in brain reward function, as measured by elevations in brain reward thresholds, which persisted for four days. Further, systemic injections of a competitive nicotinic-receptor antagonist led to a dose-dependent increase in brain reward thresholds in chronic nicotine-treated rats. The decreased function in brain reward systems during nicotine withdrawal is comparable in magnitude and duration to that of other major drugs of abuse, and may constitute an important motivational factor that contributes to craving, relapse and continued tobacco consumption in humans.

Hyporesponsive reward anticipation in the basal ganglia following severe institutional deprivation early in life.

PubMed

Mehta, Mitul A; Gore-Langton, Emma; Golembo, Nicole; Colvert, Emma; Williams, Steven C R; Sonuga-Barke, Edmund

2010-10-01

Severe deprivation in the first few years of life is associated with multiple difficulties in cognition and behavior. However, the brain basis for these difficulties is poorly understood. Structural and functional neuroimaging studies have implicated limbic system structures as dysfunctional, and one functional imaging study in a heterogeneous group of maltreated individuals has confirmed the presence of abnormalities in the basal ganglia. Based on these studies and known dopaminergic abnormalities from studies in experimental animals using social isolation, we used a task of monetary reward anticipation to examine the functional integrity of brain regions previously shown to be implicated in reward processing. Our sample included a group of adolescents (n = 12) who had experienced global deprivation early in their lives in Romania prior to adoption into UK families. In contrast to a nonadopted comparison group (n = 11), the adoptees did not recruit the striatum during reward anticipation despite comparable performance accuracy and latency. These results show, for the first time, an association between early institutional deprivation and brain reward systems in humans and highlight potential neural vulnerabilities resulting from such exposures.

Elevated cognitive control over reward processing in recovered female patients with anorexia nervosa.

PubMed

Ehrlich, Stefan; Geisler, Daniel; Ritschel, Franziska; King, Joseph A; Seidel, Maria; Boehm, Ilka; Breier, Marion; Clas, Sabine; Weiss, Jessika; Marxen, Michael; Smolka, Michael N; Roessner, Veit; Kroemer, Nils B

2015-09-01

Individuals with anorexia nervosa are thought to exert excessive self-control to inhibit primary drives. This study used functional MRI (fMRI) to interrogate interactions between the neural correlates of cognitive control and motivational processes in the brain reward system during the anticipation of monetary reward and reward-related feedback. In order to avoid confounding effects of undernutrition, we studied female participants recovered from anorexia nervosa and closely matched healthy female controls. The fMRI analysis (including node-to-node functional connectivity) followed a region of interest approach based on models of the brain reward system and cognitive control regions implicated in anorexia nervosa: the ventral striatum, medial orbitofrontal cortex (mOFC) and dorsolateral prefrontal cortex (DLPFC). We included 30 recovered patients and 30 controls in our study. There were no behavioural differences and no differences in hemodynamic responses of the ventral striatum and the mOFC in the 2 phases of the task. However, relative to controls, recovered patients showed elevated DLPFC activity during the anticipation phase, failed to deactivate this region during the feedback phase and displayed greater functional coupling between the DLPFC and mOFC. Recovered patients also had stronger associations than controls between anticipation-related DLPFC responses and instrumental responding. The results we obtained using monetary stimuli might not generalize to other forms of reward. Unaltered neural responses in ventral limbic reward networks but increased recruitment of and connectivity with lateral-frontal brain circuitry in recovered patients suggests an elevated degree of selfregulatory processes in response to rewarding stimuli. An imbalance between brain systems subserving bottom-up and top-down processes may be a trait marker of the disorder.

Medial reward and lateral non-reward orbitofrontal cortex circuits change in opposite directions in depression.

PubMed

Cheng, Wei; Rolls, Edmund T; Qiu, Jiang; Liu, Wei; Tang, Yanqing; Huang, Chu-Chung; Wang, XinFa; Zhang, Jie; Lin, Wei; Zheng, Lirong; Pu, JunCai; Tsai, Shih-Jen; Yang, Albert C; Lin, Ching-Po; Wang, Fei; Xie, Peng; Feng, Jianfeng

2016-12-01

The first brain-wide voxel-level resting state functional connectivity neuroimaging analysis of depression is reported, with 421 patients with major depressive disorder and 488 control subjects. Resting state functional connectivity between different voxels reflects correlations of activity between those voxels and is a fundamental tool in helping to understand the brain regions with altered connectivity and function in depression. One major circuit with altered functional connectivity involved the medial orbitofrontal cortex Brodmann area 13, which is implicated in reward, and which had reduced functional connectivity in depression with memory systems in the parahippocampal gyrus and medial temporal lobe, especially involving the perirhinal cortex Brodmann area 36 and entorhinal cortex Brodmann area 28. The Hamilton Depression Rating Scale scores were correlated with weakened functional connectivity of the medial orbitofrontal cortex Brodmann area 13. Thus in depression there is decreased reward-related and memory system functional connectivity, and this is related to the depressed symptoms. The lateral orbitofrontal cortex Brodmann area 47/12, involved in non-reward and punishing events, did not have this reduced functional connectivity with memory systems. Second, the lateral orbitofrontal cortex Brodmann area 47/12 had increased functional connectivity with the precuneus, the angular gyrus, and the temporal visual cortex Brodmann area 21. This enhanced functional connectivity of the non-reward/punishment system (Brodmann area 47/12) with the precuneus (involved in the sense of self and agency), and the angular gyrus (involved in language) is thus related to the explicit affectively negative sense of the self, and of self-esteem, in depression. A comparison of the functional connectivity in 185 depressed patients not receiving medication and 182 patients receiving medication showed that the functional connectivity of the lateral orbitofrontal cortex Brodmann area 47/12 with these three brain areas was lower in the medicated than the unmedicated patients. This is consistent with the hypothesis that the increased functional connectivity of the lateral orbitofrontal cortex Brodmann area 47/12 is related to depression. Relating the changes in cortical connectivity to our understanding of the functions of different parts of the orbitofrontal cortex in emotion helps to provide new insight into the brain changes related to depression. © The Author (2016). Published by Oxford University Press on behalf of the Guarantors of Brain. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Executive functions, information sampling, and decision making in narcolepsy with cataplexy.

PubMed

Delazer, Margarete; Högl, Birgit; Zamarian, Laura; Wenter, Johanna; Gschliesser, Viola; Ehrmann, Laura; Brandauer, Elisabeth; Cevikkol, Zehra; Frauscher, Birgit

2011-07-01

Narcolepsy with cataplexy (NC) affects neurotransmitter systems regulating emotions and cognitive functions. This study aimed to assess executive functions, information sampling, reward processing, and decision making in NC. Twenty-one NC patients and 58 healthy participants performed an extensive neuropsychological test battery. NC patients scored as controls in executive function tasks assessing set shifting, reversal learning, working memory, and planning. Group differences appeared in a task measuring information sampling and reward sensitivity. NC patients gathered less information, tolerated a higher level of uncertainty, and were less influenced by reward contingencies than controls. NC patients also showed reduced learning in decision making and had significantly lower scores than controls in the fifth block of the IOWA gambling task. No correlations were found with measures of sleepiness. NC patients may achieve high performance in several neuropsychological domains, including executive functions. Specific differences between NC patients and controls highlight the importance of the hypocretin system in reward processing and decision making and are in line with previous neuroimaging and neurophysiological studies. PsycINFO Database Record (c) 2011 APA, all rights reserved.

Pain and suicidality: Insights from reward and addiction neuroscience

PubMed Central

Elman, Igor; Borsook, David; Volkow, Nora D.

2016-01-01

Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system’s role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward circuitry); both are relevant etiologic factors in pain, suicide and social attachments. A comprehensive literature search on neurobiology of pain and suicidality was performed. The collected articles were critically reviewed and relevant data were extracted and summarized within four key areas: (1) physical and emotional pain, (2) emotional pain and social attachments, (3) pain-and suicide-related alterations of the reward and anti-reward circuits as compared to addiction, which is the premier probe for dysfunction of these circuits and (4) mechanistically informed treatments of co-occurring pain and suicidality. Pain-, stress- and analgesic drugs-induced opponent and proponent states of the mesolimbic dopaminergic pathways may render reward and anti-reward systems vulnerable to sensitization, cross-sensitization and aberrant learning of contents and contexts associated with suicidal acts and behaviors. These findings suggest that pain patients exhibit alterations in the brain circuits mediating reward (depressed function) and anti-reward (sensitized function) that may affect their proclivity for suicide and support pain and suicidality classification among other “reward deficiency syndromes” and a new proposal for “enhanced anti-reward syndromes”. We suggest that interventions aimed at restoring the balance between the reward and anti-reward networks in patients with chronic pain may help decreasing their suicide risk. PMID:23827972

Learning to reach by reinforcement learning using a receptive field based function approximation approach with continuous actions.

PubMed

Tamosiunaite, Minija; Asfour, Tamim; Wörgötter, Florentin

2009-03-01

Reinforcement learning methods can be used in robotics applications especially for specific target-oriented problems, for example the reward-based recalibration of goal directed actions. To this end still relatively large and continuous state-action spaces need to be efficiently handled. The goal of this paper is, thus, to develop a novel, rather simple method which uses reinforcement learning with function approximation in conjunction with different reward-strategies for solving such problems. For the testing of our method, we use a four degree-of-freedom reaching problem in 3D-space simulated by a two-joint robot arm system with two DOF each. Function approximation is based on 4D, overlapping kernels (receptive fields) and the state-action space contains about 10,000 of these. Different types of reward structures are being compared, for example, reward-on- touching-only against reward-on-approach. Furthermore, forbidden joint configurations are punished. A continuous action space is used. In spite of a rather large number of states and the continuous action space these reward/punishment strategies allow the system to find a good solution usually within about 20 trials. The efficiency of our method demonstrated in this test scenario suggests that it might be possible to use it on a real robot for problems where mixed rewards can be defined in situations where other types of learning might be difficult.

The "proactive" model of learning: Integrative framework for model-free and model-based reinforcement learning utilizing the associative learning-based proactive brain concept.

PubMed

Zsuga, Judit; Biro, Klara; Papp, Csaba; Tajti, Gabor; Gesztelyi, Rudolf

2016-02-01

Reinforcement learning (RL) is a powerful concept underlying forms of associative learning governed by the use of a scalar reward signal, with learning taking place if expectations are violated. RL may be assessed using model-based and model-free approaches. Model-based reinforcement learning involves the amygdala, the hippocampus, and the orbitofrontal cortex (OFC). The model-free system involves the pedunculopontine-tegmental nucleus (PPTgN), the ventral tegmental area (VTA) and the ventral striatum (VS). Based on the functional connectivity of VS, model-free and model based RL systems center on the VS that by integrating model-free signals (received as reward prediction error) and model-based reward related input computes value. Using the concept of reinforcement learning agent we propose that the VS serves as the value function component of the RL agent. Regarding the model utilized for model-based computations we turned to the proactive brain concept, which offers an ubiquitous function for the default network based on its great functional overlap with contextual associative areas. Hence, by means of the default network the brain continuously organizes its environment into context frames enabling the formulation of analogy-based association that are turned into predictions of what to expect. The OFC integrates reward-related information into context frames upon computing reward expectation by compiling stimulus-reward and context-reward information offered by the amygdala and hippocampus, respectively. Furthermore we suggest that the integration of model-based expectations regarding reward into the value signal is further supported by the efferent of the OFC that reach structures canonical for model-free learning (e.g., the PPTgN, VTA, and VS). (c) 2016 APA, all rights reserved).

Autistic traits modulate frontostriatal connectivity during processing of rewarding faces

PubMed Central

Neufeld, Janina; Johnstone, Tom; Chakrabarti, Bhismadev

2014-01-01

Deficits in facial mimicry have been widely reported in autism. Some studies have suggested that these deficits are restricted to spontaneous mimicry and do not extend to volitional mimicry. We bridge these apparently inconsistent observations by testing the impact of reward value on neural indices of mimicry and how autistic traits modulate this impact. Neutral faces were conditioned with high and low reward. Subsequently, functional connectivity between the ventral striatum (VS) and inferior frontal gyrus (IFG) was measured while neurotypical adults (n = 30) watched happy expressions made by these conditioned faces. We found greater VS–IFG connectivity in response to high reward vs low reward happy faces. This difference was negatively proportional to autistic traits, suggesting that reduced spontaneous mimicry of social stimuli seen in autism, may be related to a failure in the modulation of the mirror system by the reward system rather than a circumscribed deficit in the mirror system. PMID:24493838

Mapping brain functional alterations in betel-quid chewers using resting-state fMRI and network analysis.

PubMed

Weng, Jun-Cheng; Chou, Yu-Syuan; Huang, Guo-Joe; Tyan, Yeu-Sheng; Ho, Ming-Chou

2018-04-01

The World Health Organization regards betel quid (BQ) as a human carcinogen, and DSM-IV and ICD-10 dependence symptoms may develop with its heavy use. BQ's possible effects of an enhanced reward system and disrupted inhibitory control may increase the likelihood of habitual substance use. The current study aimed to employ resting-state fMRI to examine the hypothesized enhanced reward system (e.g., the basal forebrain system) and disrupted inhibitory control (e.g., the prefrontal system) in BQ chewers. The current study recruited three groups of 48 male participants: 16 BQ chewers, 15 tobacco- and alcohol-user controls, and 17 healthy controls. We used functional connectivity (FC), mean fractional amplitude of low-frequency fluctuations (mfALFF), and mean regional homogeneity (mReHo) to evaluate functional alternations in BQ chewers. Graph theoretical analysis (GTA) and network-based statistical (NBS) analysis were also performed to identify the functional network differences among the three groups. Our hypothesis was partially supported: the enhanced reward system for the BQ chewers (e.g., habitual drug-seeking behavior) was supported; however, their inhibitory control was relatively preserved. In addition, we reported that the BQ chewers may have enhanced visuospatial processing and decreased local segregation. The current results (showing an enhanced reward system in the chewers) provided the clinicians with important insight for the future development of an effective abstinence treatment.

Immaturities in Reward Processing and Its Influence on Inhibitory Control in Adolescence

PubMed Central

Terwilliger, R.; Teslovich, T.; Velanova, K.; Luna, B.

2010-01-01

The nature of immature reward processing and the influence of rewards on basic elements of cognitive control during adolescence are currently not well understood. Here, during functional magnetic resonance imaging, healthy adolescents and adults performed a modified antisaccade task in which trial-by-trial reward contingencies were manipulated. The use of a novel fast, event-related design enabled developmental differences in brain function underlying temporally distinct stages of reward processing and response inhibition to be assessed. Reward trials compared with neutral trials resulted in faster correct inhibitory responses across ages and in fewer inhibitory errors in adolescents. During reward trials, the blood oxygen level–dependent signal was attenuated in the ventral striatum in adolescents during cue assessment, then overactive during response preparation, suggesting limitations during adolescence in reward assessment and heightened reactivity in anticipation of reward compared with adults. Importantly, heightened activity in the frontal cortex along the precentral sulcus was also observed in adolescents during reward-trial response preparation, suggesting reward modulation of oculomotor control regions supporting correct inhibitory responding. Collectively, this work characterizes specific immaturities in adolescent brain systems that support reward processing and describes the influence of reward on inhibitory control. In sum, our findings suggest mechanisms that may underlie adolescents’ vulnerability to poor decision-making and risk-taking behavior. PMID:19875675

The role of reward in word learning and its implications for language acquisition.

PubMed

Ripollés, Pablo; Marco-Pallarés, Josep; Hielscher, Ulrike; Mestres-Missé, Anna; Tempelmann, Claus; Heinze, Hans-Jochen; Rodríguez-Fornells, Antoni; Noesselt, Toemme

2014-11-03

The exact neural processes behind humans' drive to acquire a new language--first as infants and later as second-language learners--are yet to be established. Recent theoretical models have proposed that during human evolution, emerging language-learning mechanisms might have been glued to phylogenetically older subcortical reward systems, reinforcing human motivation to learn a new language. Supporting this hypothesis, our results showed that adult participants exhibited robust fMRI activation in the ventral striatum (VS)--a core region of reward processing--when successfully learning the meaning of new words. This activation was similar to the VS recruitment elicited using an independent reward task. Moreover, the VS showed enhanced functional and structural connectivity with neocortical language areas during successful word learning. Together, our results provide evidence for the neural substrate of reward and motivation during word learning. We suggest that this strong functional and anatomical coupling between neocortical language regions and the subcortical reward system provided a crucial advantage in humans that eventually enabled our lineage to successfully acquire linguistic skills. Copyright © 2014 Elsevier Ltd. All rights reserved.

The effects of intranasal oxytocin on reward circuitry responses in children with autism spectrum disorder.

PubMed

Greene, R K; Spanos, M; Alderman, C; Walsh, E; Bizzell, J; Mosner, M G; Kinard, J L; Stuber, G D; Chandrasekhar, T; Politte, L C; Sikich, L; Dichter, G S

2018-03-27

Intranasal oxytocin (OT) has been shown to improve social communication functioning of individuals with autism spectrum disorder (ASD) and, thus, has received considerable interest as a potential ASD therapeutic agent. Although preclinical research indicates that OT modulates the functional output of the mesocorticolimbic dopamine system that processes rewards, no clinical brain imaging study to date has examined the effects of OT on this system using a reward processing paradigm. To address this, we used an incentive delay task to examine the effects of a single dose of intranasal OT, versus placebo (PLC), on neural responses to social and nonsocial rewards in children with ASD. In this placebo-controlled double-blind study, 28 children and adolescents with ASD (age: M = 13.43 years, SD = 2.36) completed two fMRI scans, one after intranasal OT administration and one after PLC administration. During both scanning sessions, participants completed social and nonsocial incentive delay tasks. Task-based neural activation and connectivity were examined to assess the impact of OT relative to PLC on mesocorticolimbic brain responses to social and nonsocial reward anticipation and outcomes. Central analyses compared the OT and PLC conditions. During nonsocial reward anticipation, there was greater activation in the right nucleus accumbens (NAcc), left anterior cingulate cortex (ACC), bilateral orbital frontal cortex (OFC), left superior frontal cortex, and right frontal pole (FP) during the OT condition relative to PLC. Alternatively, during social reward anticipation and outcomes, there were no significant increases in brain activation during the OT condition relative to PLC. A Treatment Group × Reward Condition interaction revealed relatively greater activation in the right NAcc, right caudate nucleus, left ACC, and right OFC during nonsocial relative to social reward anticipation during the OT condition relative to PLC. Additionally, these analyses revealed greater activation during nonsocial reward outcomes during the OT condition relative to PLC in the right OFC and left FP. Finally, functional connectivity analyses generally revealed changes in frontostriatal connections during the OT condition relative to PLC in response to nonsocial, but not social, rewards. The effects of intranasal OT administration on mesocorticolimbic brain systems that process rewards in ASD were observable primarily during the processing of nonsocial incentive salience stimuli. These findings have implications for understanding the effects of OT on neural systems that process rewards, as well as for experimental trials of novel ASD treatments developed to ameliorate social communication impairments in ASD.

The neuroscience of investing: fMRI of the reward system.

PubMed

Peterson, Richard L

2005-11-15

Functional magnetic resonance imaging (fMRI) has proven a useful tool for observing neural BOLD signal changes during complex cognitive and emotional tasks. Yet the meaning and applicability of the fMRI data being gathered is still largely unknown. The brain's reward system underlies the fundamental neural processes of goal evaluation, preference formation, positive motivation, and choice behavior. fMRI technology allows researchers to dynamically visualize reward system processes. Experimenters can then correlate reward system BOLD activations with experimental behavior from carefully controlled experiments. In the SPAN lab at Stanford University, directed by Brian Knutson Ph.D., researchers have been using financial tasks during fMRI scanning to correlate emotion, behavior, and cognition with the reward system's fundamental neural activations. One goal of the SPAN lab is the development of predictive models of behavior. In this paper we extrapolate our fMRI results toward understanding and predicting individual behavior in the uncertain and high-risk environment of the financial markets. The financial market price anomalies of "value versus glamour" and "momentum" may be real-world examples of reward system activation biasing collective behavior. On the individual level, the investor's bias of overconfidence may similarly be related to reward system activation. We attempt to understand selected "irrational" investor behaviors and anomalous financial market price patterns through correlations with findings from fMRI research of the reward system.

Reward-Dependent Modulation of Movement Variability

PubMed Central

Izawa, Jun; Shadmehr, Reza

2015-01-01

Movement variability is often considered an unwanted byproduct of a noisy nervous system. However, variability can signal a form of implicit exploration, indicating that the nervous system is intentionally varying the motor commands in search of actions that yield the greatest success. Here, we investigated the role of the human basal ganglia in controlling reward-dependent motor variability as measured by trial-to-trial changes in performance during a reaching task. We designed an experiment in which the only performance feedback was success or failure and quantified how reach variability was modulated as a function of the probability of reward. In healthy controls, reach variability increased as the probability of reward decreased. Control of variability depended on the history of past rewards, with the largest trial-to-trial changes occurring immediately after an unrewarded trial. In contrast, in participants with Parkinson's disease, a known example of basal ganglia dysfunction, reward was a poor modulator of variability; that is, the patients showed an impaired ability to increase variability in response to decreases in the probability of reward. This was despite the fact that, after rewarded trials, reach variability in the patients was comparable to healthy controls. In summary, we found that movement variability is partially a form of exploration driven by the recent history of rewards. When the function of the human basal ganglia is compromised, the reward-dependent control of movement variability is impaired, particularly affecting the ability to increase variability after unsuccessful outcomes. PMID:25740529

THC reduces the anticipatory nucleus accumbens response to reward in subjects with a nicotine addiction

PubMed Central

Jansma, J M; van Hell, H H; Vanderschuren, L J M J; Bossong, M G; Jager, G; Kahn, R S; Ramsey, N F

2013-01-01

Recent evidence has implicated the endocannabinoid (eCB) system in nicotine addiction. The eCB system also has an important role in reward mechanisms, and nicotine addiction has been associated with aberrant reward processing. Motivated by this evidence, we tested the hypothesis that eCB modulation of reward processing is altered in subjects with a nicotine addiction (NAD). For this purpose, we compared reward-related activity in NAD with healthy controls (HC) in a pharmacological magnetic resonance imaging (MRI) study using Δ9-tetrahydrocannabinol (THC) administration to challenge the eCB system. Eleven HC and 10 NAD participated in a 3-T functional MRI (fMRI) study with a double-blind, cross-over, placebo-controlled design, using a Monetary Incentive Delay (MID) paradigm with three reward levels. Reward activity in the nucleus accumbens (NAcc) and caudate putamen during anticipation and feedback of reward was compared after THC and placebo. fMRI results indicated a significant reduction of reward anticipation activity in the NAcc in NAD after THC administration, which was not present in HC. This is indicated by a significant group by drug by reward interaction. Our data show that THC significantly reduces the NAcc response to monetary reward anticipation in NAD. These results suggest that nicotine addiction is associated with altered eCB modulation of reward processing in the NAcc. This study adds important human data to existing evidence implicating the eCB system in nicotine addiction. PMID:23443360

A systematic review of fMRI reward paradigms used in studies of adolescents vs. adults: the impact of task design and implications for understanding neurodevelopment.

PubMed

Richards, Jessica M; Plate, Rista C; Ernst, Monique

2013-06-01

The neural systems underlying reward-related behaviors across development have recently generated a great amount of interest. Yet, the neurodevelopmental literature on reward processing is marked by inconsistencies due to the heterogeneity of the reward paradigms used, the complexity of the behaviors being studied, and the developing brain itself as a moving target. The present review will examine task design as one source of variability across findings by compiling this literature along three dimensions: (1) task structures, (2) cognitive processes, and (3) neural systems. We start with the presentation of a heuristic neural systems model, the Triadic Model, as a way to provide a theoretical framework for the neuroscience research on motivated behaviors. We then discuss the principles guiding reward task development. Finally, we review the extant developmental neuroimaging literature on reward-related processing, organized by reward task type. We hope that this approach will help to clarify the literature on the functional neurodevelopment of reward-related neural systems, and to identify the role of the experimental parameters that significantly influence these findings. Published by Elsevier Ltd.

Parental substance abuse and function of the motivation and behavioral inhibition systems in drug-naïve youth.

PubMed

Ivanov, Iliyan; Liu, Xun; Shulz, Kurt; Fan, Jin; London, Edythe; Friston, Karl; Halperin, Jeffrey M; Newcorn, Jeffrey H

2012-02-28

It is hypothesized that the development of substance abuse (SA) may be due to imbalance in functions of the motivation-reward and behavioral inhibition systems in the brain. This speaks to the search for biological risk factors for SA in drug-naïve children who also exhibit motivational and inhibitory control deficits; however, this type of research is currently lacking. The objective of this study was to establish a neurobiological basis for addiction vulnerability using functional magnetic resonance imaging (fMRI) in drug-naïve youth with attention deficit/hyperactivity disorder (ADHD). We hypothesized that children with ADHD alone would show higher activity in regions of the motivation-reward and behavioral inhibition systems than children with ADHD and a parental history of SA. Toward this goal we scanned 20 drug-naïve children with ADHD ages 8-13 while performing an event-related reward task. High (N=10) and low (N=10) risk subjects were identified, based on parental history of SA. The effects of anticipation, conflict, and reward were assessed with appropriate linear contrasts, and between-group differences were assessed using statistical parametric mapping. The two groups did not differ on behavioral measures of the task. The fMRI results show heightened activation in the brain motivational-reward system and reduced activation of the inhibitory control system in high-risk compared to low-risk children. These results suggest that a functional mismatch between these two systems may represent one possible biological underpinning of SA risk, which is conferred by a parental history of addiction. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Two spatiotemporally distinct value systems shape reward-based learning in the human brain.

PubMed

Fouragnan, Elsa; Retzler, Chris; Mullinger, Karen; Philiastides, Marios G

2015-09-08

Avoiding repeated mistakes and learning to reinforce rewarding decisions is critical for human survival and adaptive actions. Yet, the neural underpinnings of the value systems that encode different decision-outcomes remain elusive. Here coupling single-trial electroencephalography with simultaneously acquired functional magnetic resonance imaging, we uncover the spatiotemporal dynamics of two separate but interacting value systems encoding decision-outcomes. Consistent with a role in regulating alertness and switching behaviours, an early system is activated only by negative outcomes and engages arousal-related and motor-preparatory brain structures. Consistent with a role in reward-based learning, a later system differentially suppresses or activates regions of the human reward network in response to negative and positive outcomes, respectively. Following negative outcomes, the early system interacts and downregulates the late system, through a thalamic interaction with the ventral striatum. Critically, the strength of this coupling predicts participants' switching behaviour and avoidance learning, directly implicating the thalamostriatal pathway in reward-based learning.

A Fly's Eye View of Natural and Drug Reward.

PubMed

Lowenstein, Eve G; Velazquez-Ulloa, Norma A

2018-01-01

Animals encounter multiple stimuli each day. Some of these stimuli are innately appetitive or aversive, while others are assigned valence based on experience. Drugs like ethanol can elicit aversion in the short term and attraction in the long term. The reward system encodes the predictive value for different stimuli, mediating anticipation for attractive or punishing stimuli and driving animal behavior to approach or avoid conditioned stimuli. The neurochemistry and neurocircuitry of the reward system is partly evolutionarily conserved. In both vertebrates and invertebrates, including Drosophila melanogaster , dopamine is at the center of a network of neurotransmitters and neuromodulators acting in concert to encode rewards. Behavioral assays in D. melanogaster have become increasingly sophisticated, allowing more direct comparison with mammalian research. Moreover, recent evidence has established the functional modularity of the reward neural circuits in Drosophila . This functional modularity resembles the organization of reward circuits in mammals. The powerful genetic and molecular tools for D. melanogaster allow characterization and manipulation at the single-cell level. These tools are being used to construct a detailed map of the neural circuits mediating specific rewarding stimuli and have allowed for the identification of multiple genes and molecular pathways that mediate the effects of reinforcing stimuli, including their rewarding effects. This report provides an overview of the research on natural and drug reward in D. melanogaster , including natural rewards such as sugar and other food nutrients, and drug rewards including ethanol, cocaine, amphetamine, methamphetamine, and nicotine. We focused mainly on the known genetic and neural mechanisms underlying appetitive reward for sugar and reward for ethanol. We also include genes, molecular pathways, and neural circuits that have been identified using assays that test the palatability of the rewarding stimulus, the preference for the rewarding stimulus, or other effects of the stimulus that indicate how it can modify behavior. Commonalities between mechanisms of natural and drug reward are highlighted and future directions are presented, putting forward questions best suited for research using D. melanogaster as a model organism.

A Fly’s Eye View of Natural and Drug Reward

PubMed Central

Lowenstein, Eve G.; Velazquez-Ulloa, Norma A.

2018-01-01

Animals encounter multiple stimuli each day. Some of these stimuli are innately appetitive or aversive, while others are assigned valence based on experience. Drugs like ethanol can elicit aversion in the short term and attraction in the long term. The reward system encodes the predictive value for different stimuli, mediating anticipation for attractive or punishing stimuli and driving animal behavior to approach or avoid conditioned stimuli. The neurochemistry and neurocircuitry of the reward system is partly evolutionarily conserved. In both vertebrates and invertebrates, including Drosophila melanogaster, dopamine is at the center of a network of neurotransmitters and neuromodulators acting in concert to encode rewards. Behavioral assays in D. melanogaster have become increasingly sophisticated, allowing more direct comparison with mammalian research. Moreover, recent evidence has established the functional modularity of the reward neural circuits in Drosophila. This functional modularity resembles the organization of reward circuits in mammals. The powerful genetic and molecular tools for D. melanogaster allow characterization and manipulation at the single-cell level. These tools are being used to construct a detailed map of the neural circuits mediating specific rewarding stimuli and have allowed for the identification of multiple genes and molecular pathways that mediate the effects of reinforcing stimuli, including their rewarding effects. This report provides an overview of the research on natural and drug reward in D. melanogaster, including natural rewards such as sugar and other food nutrients, and drug rewards including ethanol, cocaine, amphetamine, methamphetamine, and nicotine. We focused mainly on the known genetic and neural mechanisms underlying appetitive reward for sugar and reward for ethanol. We also include genes, molecular pathways, and neural circuits that have been identified using assays that test the palatability of the rewarding stimulus, the preference for the rewarding stimulus, or other effects of the stimulus that indicate how it can modify behavior. Commonalities between mechanisms of natural and drug reward are highlighted and future directions are presented, putting forward questions best suited for research using D. melanogaster as a model organism. PMID:29720947

Developing a Comprehensive Reward System.

ERIC Educational Resources Information Center

Votruba, James C.

1979-01-01

Providing incentives for teachers of adults is an important means of attracting, retaining, and stimulating staff. Developing a variety of extrinsic and intrinsic rewards and incentives and instituting them effectively are important administrative functions. (SK)

Phasic dopamine as a prediction error of intrinsic and extrinsic reinforcements driving both action acquisition and reward maximization: a simulated robotic study.

PubMed

Mirolli, Marco; Santucci, Vieri G; Baldassarre, Gianluca

2013-03-01

An important issue of recent neuroscientific research is to understand the functional role of the phasic release of dopamine in the striatum, and in particular its relation to reinforcement learning. The literature is split between two alternative hypotheses: one considers phasic dopamine as a reward prediction error similar to the computational TD-error, whose function is to guide an animal to maximize future rewards; the other holds that phasic dopamine is a sensory prediction error signal that lets the animal discover and acquire novel actions. In this paper we propose an original hypothesis that integrates these two contrasting positions: according to our view phasic dopamine represents a TD-like reinforcement prediction error learning signal determined by both unexpected changes in the environment (temporary, intrinsic reinforcements) and biological rewards (permanent, extrinsic reinforcements). Accordingly, dopamine plays the functional role of driving both the discovery and acquisition of novel actions and the maximization of future rewards. To validate our hypothesis we perform a series of experiments with a simulated robotic system that has to learn different skills in order to get rewards. We compare different versions of the system in which we vary the composition of the learning signal. The results show that only the system reinforced by both extrinsic and intrinsic reinforcements is able to reach high performance in sufficiently complex conditions. Copyright © 2013 Elsevier Ltd. All rights reserved.

Altered reward system reactivity for personalized circumscribed interests in autism.

PubMed

Kohls, Gregor; Antezana, Ligia; Mosner, Maya G; Schultz, Robert T; Yerys, Benjamin E

2018-01-01

Neurobiological research in autism spectrum disorders (ASD) has paid little attention on brain mechanisms that cause and maintain restricted and repetitive behaviors and interests (RRBIs). Evidence indicates an imbalance in the brain's reward system responsiveness to social and non-social stimuli may contribute to both social deficits and RRBIs. Thus, this study's central aim was to compare brain responsiveness to individual RRBI (i.e., circumscribed interests), with social rewards (i.e., social approval), in youth with ASD relative to typically developing controls (TDCs). We conducted a 3T functional magnetic resonance imaging (fMRI) study to investigate the blood-oxygenation-level-dependent effect of personalized circumscribed interest rewards versus social rewards in 39 youth with ASD relative to 22 TDC. To probe the reward system, we employed short video clips as reinforcement in an instrumental incentive delay task. This optimization increased the task's ecological validity compared to still pictures that are often used in this line of research. Compared to TDCs, youth with ASD had stronger reward system responses for CIs mostly within the non-social realm (e.g., video games) than social rewards (e.g., approval). Additionally, this imbalance within the caudate nucleus' responsiveness was related to greater social impairment. The current data support the idea of reward system dysfunction that may contribute to enhanced motivation for RRBIs in ASD, accompanied by diminished motivation for social engagement. If a dysregulated reward system indeed supports the emergence and maintenance of social and non-social symptoms of ASD, then strategically targeting the reward system in future treatment endeavors may allow for more efficacious treatment practices that help improve outcomes for individuals with ASD and their families.

Neural Correlates of Impaired Reward-Effort Integration in Remitted Bulimia Nervosa.

PubMed

Mueller, Stefanie Verena; Morishima, Yosuke; Schwab, Simon; Wiest, Roland; Federspiel, Andrea; Hasler, Gregor

2018-03-01

The integration of reward magnitudes and effort costs is required for an effective behavioral guidance. This reward-effort integration was reported to be dependent on dopaminergic neurotransmission. As bulimia nervosa has been associated with a dysregulated dopamine system and catecholamine depletion led to reward-processing deficits in remitted bulimia nervosa, the purpose of this study was to identify the role of catecholamine dysfunction and its relation to behavioral and neural reward-effort integration in bulimia nervosa. To investigate the interaction between catecholamine functioning and behavioral, and neural responses directly, 17 remitted bulimic (rBN) and 21 healthy individuals (HC) received alpha-methyl-paratyrosine (AMPT) over 24 h to achieve catecholamine depletion in a randomized, crossover study design. We used functional magnetic resonance imaging (fMRI) and the monetary incentive delay (MID) task to assess reward-effort integration in relation to catecholaminergic neurotransmission at the behavioral and neural level. AMPT reduced the ability to integrate rewards and efforts effectively in HC participants. In contrast, in rBN participants, the reduced reward-effort integration was associated with illness duration in the sham condition and unrelated to catecholamine depletion. Regarding neural activation, AMPT decreased the reward anticipation-related neural activation in the anteroventral striatum. This decrease was associated with the AMPT-induced reduction of monetary earning in HC in contrast to rBN participants. Our findings contributed to the theory of a desensitized dopaminergic system in bulimia nervosa. A disrupted processing of reward magnitudes and effort costs might increase the probability of maintenance of bulimic symptoms.

The influence of motherhood on neural systems for reward processing in low income, minority, young women.

PubMed

Moses-Kolko, Eydie L; Forbes, Erika E; Stepp, Stephanie; Fraser, David; Keenan, Kate E; Guyer, Amanda E; Chase, Henry W; Phillips, Mary L; Zevallos, Carlos R; Guo, Chaohui; Hipwell, Alison E

2016-04-01

Given the association between maternal caregiving behavior and heightened neural reward activity in experimental animal studies, the present study examined whether motherhood in humans positively modulates reward-processing neural circuits, even among mothers exposed to various life stressors and depression. Subjects were 77 first-time mothers and 126 nulliparous young women from the Pittsburgh Girls Study, a longitudinal study beginning in childhood. Subjects underwent a monetary reward task during functional magnetic resonance imaging in addition to assessment of current depressive symptoms. Life stress was measured by averaging data collected between ages 8-15 years. Using a region-of-interest approach, we conducted hierarchical regression to examine the relationship of psychosocial factors (life stress and current depression) and motherhood with extracted ventral striatal (VST) response to reward anticipation. Whole-brain regression analyses were performed post-hoc to explore non-striatal regions associated with reward anticipation in mothers vs nulliparous women. Anticipation of monetary reward was associated with increased neural activity in expected regions including caudate, orbitofrontal, occipital, superior and middle frontal cortices. There was no main effect of motherhood nor motherhood-by-psychosocial factor interaction effect on VST response during reward anticipation. Depressive symptoms were associated with increased VST activity across the entire sample. In exploratory whole brain analysis, motherhood was associated with increased somatosensory cortex activity to reward (FWE cluster forming threshold p<0.001). These findings indicate that motherhood is not associated with reward anticipation-related VST activity nor does motherhood modulate the impact of depression or life stress on VST activity. Future studies are needed to evaluate whether earlier postpartum assessment of reward function, inclusion of mothers with more severe depressive symptoms, and use of reward tasks specific for social reward might reveal an impact of motherhood on reward system activity. Copyright © 2016 Elsevier Ltd. All rights reserved.

Listening to Rhythmic Music Reduces Connectivity within the Basal Ganglia and the Reward System.

PubMed

Brodal, Hans P; Osnes, Berge; Specht, Karsten

2017-01-01

Music can trigger emotional responses in a more direct way than any other stimulus. In particular, music-evoked pleasure involves brain networks that are part of the reward system. Furthermore, rhythmic music stimulates the basal ganglia and may trigger involuntary movements to the beat. In the present study, we created a continuously playing rhythmic, dance floor-like composition where the ambient noise from the MR scanner was incorporated as an additional instrument of rhythm. By treating this continuous stimulation paradigm as a variant of resting-state, the data was analyzed with stochastic dynamic causal modeling (sDCM), which was used for exploring functional dependencies and interactions between core areas of auditory perception, rhythm processing, and reward processing. The sDCM model was a fully connected model with the following areas: auditory cortex, putamen/pallidum, and ventral striatum/nucleus accumbens of both hemispheres. The resulting estimated parameters were compared to ordinary resting-state data, without an additional continuous stimulation. Besides reduced connectivity within the basal ganglia, the results indicated a reduced functional connectivity of the reward system, namely the right ventral striatum/nucleus accumbens from and to the basal ganglia and auditory network while listening to rhythmic music. In addition, the right ventral striatum/nucleus accumbens demonstrated also a change in its hemodynamic parameter, reflecting an increased level of activation. These converging results may indicate that the dopaminergic reward system reduces its functional connectivity and relinquishing its constraints on other areas when we listen to rhythmic music.

Listening to Rhythmic Music Reduces Connectivity within the Basal Ganglia and the Reward System

PubMed Central

Brodal, Hans P.; Osnes, Berge; Specht, Karsten

2017-01-01

Music can trigger emotional responses in a more direct way than any other stimulus. In particular, music-evoked pleasure involves brain networks that are part of the reward system. Furthermore, rhythmic music stimulates the basal ganglia and may trigger involuntary movements to the beat. In the present study, we created a continuously playing rhythmic, dance floor-like composition where the ambient noise from the MR scanner was incorporated as an additional instrument of rhythm. By treating this continuous stimulation paradigm as a variant of resting-state, the data was analyzed with stochastic dynamic causal modeling (sDCM), which was used for exploring functional dependencies and interactions between core areas of auditory perception, rhythm processing, and reward processing. The sDCM model was a fully connected model with the following areas: auditory cortex, putamen/pallidum, and ventral striatum/nucleus accumbens of both hemispheres. The resulting estimated parameters were compared to ordinary resting-state data, without an additional continuous stimulation. Besides reduced connectivity within the basal ganglia, the results indicated a reduced functional connectivity of the reward system, namely the right ventral striatum/nucleus accumbens from and to the basal ganglia and auditory network while listening to rhythmic music. In addition, the right ventral striatum/nucleus accumbens demonstrated also a change in its hemodynamic parameter, reflecting an increased level of activation. These converging results may indicate that the dopaminergic reward system reduces its functional connectivity and relinquishing its constraints on other areas when we listen to rhythmic music. PMID:28400717

Modulation of frontostriatal interaction aligns with reduced primary reward processing under serotonergic drugs.

PubMed

Abler, Birgit; Grön, Georg; Hartmann, Antonie; Metzger, Coraline; Walter, Martin

2012-01-25

Recently, functional interactions between anteroventral prefrontal cortex and nucleus accumbens (NAcc) have been shown to relate to behavior counteracting reward-desiring (Diekhof and Gruber, 2010). Downregulation of the reward system by serotonin has also been suggested as the mode of action accounting for unsatisfactory effects of serotonin reuptake inhibitors (SSRIs) such as insufficient alleviation or even increase of anhedonia, and loss of interest. However, understanding of the in vivo mechanisms of SSRI-related alteration of the human reward system is still incomplete. Using functional magnetic resonance imaging (fMRI) within a double-blind cross-over within-subjects study design and administering the SSRI paroxetine, the dopamine/norepinephrine reuptake inhibitor bupropione, and placebo for 7 d each, we investigated a group of 18 healthy male subjects. Under paroxetine, subjects showed significantly decreased activation of the bilateral NAcc during processing of primary rewards (erotic videos), but not under bupropion. Similar to the previous study, analysis of psychophysiological interactions revealed that this downregulation relied on negative interactions between left and right NAcc fMRI signals and the bilateral anteroventral prefrontal cortex that now were significantly enhanced under paroxetine and reduced under bupropion. Individual drug-dependent modulations of interacting brain regions were significantly associated with individual expressions of impulsivity as a personality trait. Our results corroborate and extend previous insights on interregional crosstalk from secondary to primary rewards and demonstrate parallels between active inhibitory control of and serotonergic effects on the dopaminergic reward system's activity.

Stress and reward processing in bipolar disorder: a functional magnetic resonance imaging study.

PubMed

Berghorst, Lisa H; Kumar, Poornima; Greve, Doug N; Deckersbach, Thilo; Ongur, Dost; Dutra, Sunny J; Pizzagalli, Diego A

2016-11-01

A link between negative life stress and the onset of mood episodes in bipolar disorder (BD) has been established, but processes underlying such a link remain unclear. Growing evidence suggests that stress can negatively affect reward processing and related neurobiological substrates, indicating that a dysregulated reward system may provide a partial explanation. The aim of this study was to test the impact of stress on reward-related neural functioning in BD. Thirteen euthymic or mildly depressed individuals with BD and 15 controls performed a Monetary Incentive Delay (MID) task while undergoing functional magnetic resonance imaging during no-stress and stress (negative psychosocial stressor involving poor performance feedback and threat of monetary deductions) conditions. In hypothesis-driven region-of-interest analyses, a significant group-by-condition interaction emerged in the amygdala during reward anticipation. Relative to controls, while anticipating a potential reward, subjects with BD were characterized by amygdalar hyperactivation in the no-stress condition but hypoactivation during stress. Moreover, relative to controls, subjects with BD had significantly larger amygdala volumes. After controlling for structural differences, the effects of stress on amygdalar function remained, whereas groups no longer differed during the no-stress condition. During reward consumption, a group-by-condition interaction emerged in the putamen due to increased putamen activation in response to rewards in participants with BD during stress, but an opposite pattern in controls. Overall, findings highlight possible impairments in using reward-predicting cues to adaptively engage in goal-directed actions in BD, combined with stress-induced hypersensitivity to reward consumption. Potential clinical implications are discussed. © 2016 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Précis of The brain and emotion.

PubMed

Rolls, E T

2000-04-01

The topics treated in The brain and emotion include the definition, nature, and functions of emotion (Ch. 3); the neural bases of emotion (Ch. 4); reward, punishment, and emotion in brain design (Ch. 10); a theory of consciousness and its application to understanding emotion and pleasure (Ch. 9); and neural networks and emotion-related learning (Appendix). The approach is that emotions can be considered as states elicited by reinforcers (rewards and punishers). This approach helps with understanding the functions of emotion, with classifying different emotions, and in understanding what information-processing systems in the brain are involved in emotion, and how they are involved. The hypothesis is developed that brains are designed around reward- and punishment-evaluation systems, because this is the way that genes can build a complex system that will produce appropriate but flexible behavior to increase fitness (Ch. 10). By specifying goals rather than particular behavioral patterns of responses, genes leave much more open the possible behavioral strategies that might be required to increase fitness. The importance of reward and punishment systems in brain design also provides a basis for understanding the brain mechanisms of motivation, as described in Chapters 2 for appetite and feeding, 5 for brain-stimulation reward, 6 for addiction, 7 for thirst, and 8 for sexual behavior.

Preserved reward outcome processing in ASD as revealed by event-related potentials.

PubMed

McPartland, James C; Crowley, Michael J; Perszyk, Danielle R; Mukerji, Cora E; Naples, Adam J; Wu, Jia; Mayes, Linda C

2012-05-31

Problems with reward system function have been posited as a primary difficulty in autism spectrum disorders. The current study examined an electrophysiological marker of feedback monitoring, the feedback-related negativity (FRN), during a monetary reward task. The study advanced prior understanding by focusing exclusively on a developmental sample, applying rigorous diagnostic characterization and introducing an experimental paradigm providing more subtly different feedback valence (reward versus non-reward instead of reward versus loss). Twenty-six children with autism spectrum disorder and 28 typically developing peers matched on age and full-scale IQ played a guessing game resulting in monetary gain ("win") or neutral outcome ("draw"). ERP components marking early visual processing (N1, P2) and feedback appraisal (FRN) were contrasted between groups in each condition, and their relationships to behavioral measures of social function and dysfunction, social anxiety, and autism symptomatology were explored. FRN was observed on draw trials relative to win trials. Consistent with prior research, children with ASD exhibited a FRN to suboptimal outcomes that was comparable to typical peers. ERP parameters were unrelated to behavioral measures. Results of the current study indicate typical patterns of feedback monitoring in the context of monetary reward in ASD. The study extends prior findings of normative feedback monitoring to a sample composed exclusively of children and demonstrates that, as in typical development, individuals with autism exhibit a FRN to suboptimal outcomes, irrespective of neutral or negative valence. Results do not support a pervasive problem with reward system function in ASD, instead suggesting any dysfunction lies in more specific domains, such as social perception, or in response to particular feedback-monitoring contexts, such as self-evaluation of one's errors.

Adaptive scaling of reward in episodic memory: a replication study.

PubMed

Mason, Alice; Ludwig, Casimir; Farrell, Simon

2017-11-01

Reward is thought to enhance episodic memory formation via dopaminergic consolidation. Bunzeck, Dayan, Dolan, and Duzel [(2010). A common mechanism for adaptive scaling of reward and novelty. Human Brain Mapping, 31, 1380-1394] provided functional magnetic resonance imaging (fMRI) and behavioural evidence that reward and episodic memory systems are sensitive to the contextual value of a reward-whether it is relatively higher or lower-as opposed to absolute value or prediction error. We carried out a direct replication of their behavioural study and did not replicate their finding that memory performance associated with reward follows this pattern of adaptive scaling. An effect of reward outcome was in the opposite direction to that in the original study, with lower reward outcomes leading to better memory than higher outcomes. There was a marginal effect of reward context, suggesting that expected value affected memory performance. We discuss the robustness of the reward memory relationship to variations in reward context, and whether other reward-related factors have a more reliable influence on episodic memory.

Brain reward system's alterations in response to food and monetary stimuli in overweight and obese individuals.

PubMed

Verdejo-Román, Juan; Vilar-López, Raquel; Navas, Juan F; Soriano-Mas, Carles; Verdejo-García, Antonio

2017-02-01

The brain's reward system is crucial to understand obesity in modern society, as increased neural responsivity to reward can fuel the unhealthy food choices that are driving the growing obesity epidemic. Brain's reward system responsivity to food and monetary rewards in individuals with excessive weight (overweight and obese) versus normal weight controls, along with the relationship between this responsivity and body mass index (BMI) were tested. The sample comprised 21 adults with obesity (BMI > 30), 21 with overweight (BMI between 25 and 30), and 39 with normal weight (BMI < 25). Participants underwent a functional magnetic resonance imaging (fMRI) session while performing two tasks that involve the processing of food (Willing to Pay) and monetary rewards (Monetary Incentive Delay). Neural activations within the brain reward system were compared across the three groups. Curve fit analyses were conducted to establish the association between BMI and brain reward system's response. Individuals with obesity had greater food-evoked responsivity in the dorsal and ventral striatum compared with overweight and normal weight groups. There was an inverted U-shape association between BMI and monetary-evoked responsivity in the ventral striatum, medial frontal cortex, and amygdala; that is, individuals with BMIs between 27 and 32 had greater responsivity to monetary stimuli. Obesity is associated with greater food-evoked responsivity in the ventral and dorsal striatum, and overweight is associated with greater monetary-evoked responsivity in the ventral striatum, the amygdala, and the medial frontal cortex. Findings suggest differential reactivity of the brain's reward system to food versus monetary rewards in obesity and overweight. Hum Brain Mapp 38:666-677, 2017. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

Regulating task-monitoring systems in response to variable reward contingencies and outcomes in cocaine addicts.

PubMed

Morie, Kristen P; De Sanctis, Pierfilippo; Garavan, Hugh; Foxe, John J

2016-03-01

We investigated anticipatory and consummatory reward processing in cocaine addiction. In addition, we set out to assess whether task-monitoring systems were appropriately recalibrated in light of variable reward schedules. We also examined neural measures of task-monitoring and reward processing as a function of hedonic tone, since anhedonia is a vulnerability marker for addiction that is obviously germane in the context of reward processing. High-density event-related potentials were recorded while participants performed a speeded response task that systematically varied anticipated probabilities of reward receipt. The paradigm dissociated feedback regarding task success (or failure) from feedback regarding the value of reward (or loss), so that task-monitoring and reward processing could be examined in partial isolation. Twenty-three active cocaine abusers and 23 age-matched healthy controls participated. Cocaine abusers showed amplified anticipatory responses to reward predictive cues, but crucially, these responses were not as strongly modulated by reward probability as in controls. Cocaine users also showed blunted responses to feedback about task success or failure and did not use this information to update predictions about reward. In turn, they showed clearly blunted responses to reward feedback. In controls and users, measures of anhedonia were associated with reward motivation. In cocaine users, anhedonia was also associated with diminished monitoring and reward feedback responses. Findings imply that reward anticipation and monitoring deficiencies in addiction are associated with increased responsiveness to reward cues but impaired ability to predict reward in light of task contingencies, compounded by deficits in responding to actual reward outcomes.

Deficits in context-dependent adaptive coding of reward in schizophrenia

PubMed Central

Kirschner, Matthias; Hager, Oliver M; Bischof, Martin; Hartmann-Riemer, Matthias N; Kluge, Agne; Seifritz, Erich; Tobler, Philippe N; Kaiser, Stefan

2016-01-01

Theoretical principles of information processing and empirical findings suggest that to efficiently represent all possible rewards in the natural environment, reward-sensitive neurons have to adapt their coding range dynamically to the current reward context. Adaptation ensures that the reward system is most sensitive for the most likely rewards, enabling the system to efficiently represent a potentially infinite range of reward information. A deficit in neural adaptation would prevent precise representation of rewards and could have detrimental effects for an organism’s ability to optimally engage with its environment. In schizophrenia, reward processing is known to be impaired and has been linked to different symptom dimensions. However, despite the fundamental significance of coding reward adaptively, no study has elucidated whether adaptive reward processing is impaired in schizophrenia. We therefore studied patients with schizophrenia (n=27) and healthy controls (n=25), using functional magnetic resonance imaging in combination with a variant of the monetary incentive delay task. Compared with healthy controls, patients with schizophrenia showed less efficient neural adaptation to the current reward context, which leads to imprecise neural representation of reward. Importantly, the deficit correlated with total symptom severity. Our results suggest that some of the deficits in reward processing in schizophrenia might be due to inefficient neural adaptation to the current reward context. Furthermore, because adaptive coding is a ubiquitous feature of the brain, we believe that our findings provide an avenue in defining a general impairment in neural information processing underlying this debilitating disorder. PMID:27430009

Stress and reward processing in bipolar disorder: an fMRI study

PubMed Central

Berghorst, Lisa H; Kumar, Poornima; Greve, Doug N; Deckersbach, Thilo; Ongur, Dost; Dutra, Sunny; Pizzagalli, Diego A

2016-01-01

Objectives A link between negative life stress and the onset of mood episodes in bipolar disorder (BD) has been established, but processes underlying such a link remain unclear. Growing evidence suggests that stress can negatively affect reward processing and related neurobiological substrates, indicating that a dysregulated reward system may provide a partial explanation. The aim of this study was to test the impact of stress on reward-related neural functioning in BD. Methods Thirteen euthymic or mildly depressed individuals with BD and 15 controls performed a Monetary Incentive Delay task while undergoing functional magnetic resonance imaging during no-stress and stress (negative psychosocial stressor involving poor performance feedback and threat of monetary deductions) conditions. Results In hypothesis-driven region-of- interest-based analyses, a significant group by condition interaction emerged in the amygdala during reward anticipation. Relative to controls, while anticipating a potential reward, subjects with BD were characterized by amygdalar hyperactivation in the no-stress condition but hypoactivation during stress. Moreover, relative to controls, subjects with BD had significantly larger amygdala volumes. After controlling for structural differences, the effects of stress on amygdalar function remained, whereas groups no longer differed during the no-stress condition. During reward consumption, a group by condition interaction emerged in the putamen due to increased putamen activation to rewards in participants with BD during stress, but an opposite pattern in controls. Conclusions Overall, findings highlight possible impairments in using reward-predicting cues to adaptively engage in goal-directed actions in BD, combined with stress-induced hypersensitivity to reward consumption. Potential clinical implications are discussed. PMID:27870507

DOE Office of Scientific and Technical Information (OSTI.GOV)

Volkow N. D.; Wang G.; Volkow, N.D.

The ability to resist the urge to eat requires the proper functioning of neuronal circuits involved in top-down control to oppose the conditioned responses that predict reward from eating the food and the desire to eat the food. Imaging studies show that obese subjects might have impairments in dopaminergic pathways that regulate neuronal systems associated with reward sensitivity, conditioning and control. It is known that the neuropeptides that regulate energy balance (homeostatic processes) through the hypothalamus also modulate the activity of dopamine cells and their projections into regions involved in the rewarding processes underlying food intake. It is postulated thatmore » this could also be a mechanism by which overeating and the resultant resistance to homoeostatic signals impairs the function of circuits involved in reward sensitivity, conditioning and cognitive control.« less

Animal models of cannabinoid reward

PubMed Central

Panlilio, Leigh V; Justinova, Zuzana; Goldberg, Steven R

2010-01-01

The endogenous cannabinoid system is involved in numerous physiological and neuropsychological functions. Medications that target this system hold promise for the treatment of a wide variety of disorders. However, as reward is one of the most prominent of these functions, medications that activate this system must be evaluated for abuse potential. Meanwhile, cannabis is already being used chronically by millions of people, many of whom eventually seek treatment for cannabis dependence. Therefore, there is a need for procedures that can be used to: (i) better understand the mechanisms of cannabinoid reward; (ii) evaluate the abuse potential of new medications; and (iii) evaluate the effectiveness of medications developed for treating cannabis dependence. Animal models of cannabinoid reward provide a means of accomplishing these goals. In this review, we briefly describe and evaluate these models, their advantages and their shortcomings. Special emphasis is placed on intravenous cannabinoid self-administration in squirrel monkeys, a valid, reliable and flexible model that we have developed over the past decade. Although the conditions under which cannabinoid drugs have rewarding effects may be more restricted than with other drugs of abuse such as cocaine and heroin, work with these models indicates that cannabinoid reward involves similar brain mechanisms and produces the same kinds of reward-related behaviour. By continuing to use these animal models as tools in the development of new medications, it should be possible to take advantage of the potential benefits provided by the endocannabinoid system while minimizing its potential for harm. This article is part of a themed issue on Cannabinoids. To view the editorial for this themed issue visit http://dx.doi.org/10.1111/j.1476-5381.2010.00831.x PMID:20590560

Association of Elevated Reward Prediction Error Response With Weight Gain in Adolescent Anorexia Nervosa.

PubMed

DeGuzman, Marisa; Shott, Megan E; Yang, Tony T; Riederer, Justin; Frank, Guido K W

2017-06-01

Anorexia nervosa is a psychiatric disorder of unknown etiology. Understanding associations between behavior and neurobiology is important in treatment development. Using a novel monetary reward task during functional magnetic resonance brain imaging, the authors tested how brain reward learning in adolescent anorexia nervosa changes with weight restoration. Female adolescents with anorexia nervosa (N=21; mean age, 16.4 years [SD=1.9]) underwent functional MRI (fMRI) before and after treatment; similarly, healthy female control adolescents (N=21; mean age, 15.2 years [SD=2.4]) underwent fMRI on two occasions. Brain function was tested using the reward prediction error construct, a computational model for reward receipt and omission related to motivation and neural dopamine responsiveness. Compared with the control group, the anorexia nervosa group exhibited greater brain response 1) for prediction error regression within the caudate, ventral caudate/nucleus accumbens, and anterior and posterior insula, 2) to unexpected reward receipt in the anterior and posterior insula, and 3) to unexpected reward omission in the caudate body. Prediction error and unexpected reward omission response tended to normalize with treatment, while unexpected reward receipt response remained significantly elevated. Greater caudate prediction error response when underweight was associated with lower weight gain during treatment. Punishment sensitivity correlated positively with ventral caudate prediction error response. Reward system responsiveness is elevated in adolescent anorexia nervosa when underweight and after weight restoration. Heightened prediction error activity in brain reward regions may represent a phenotype of adolescent anorexia nervosa that does not respond well to treatment. Prediction error response could be a neurobiological marker of illness severity that can indicate individual treatment needs.

Association of Elevated Reward Prediction Error Response With Weight Gain in Adolescent Anorexia Nervosa

PubMed Central

DeGuzman, Marisa; Shott, Megan E.; Yang, Tony T.; Riederer, Justin; Frank, Guido K.W.

2017-01-01

Objective Anorexia nervosa is a psychiatric disorder of unknown etiology. Understanding associations between behavior and neurobiology is important in treatment development. Using a novel monetary reward task during functional magnetic resonance brain imaging, the authors tested how brain reward learning in adolescent anorexia nervosa changes with weight restoration. Method Female adolescents with anorexia nervosa (N=21; mean age, 15.2 years [SD=2.4]) underwent functional MRI (fMRI) before and after treatment; similarly, healthy female control adolescents (N=21; mean age, 16.4 years [SD=1.9]) underwent fMRI on two occasions. Brain function was tested using the reward prediction error construct, a computational model for reward receipt and omission related to motivation and neural dopamine responsiveness. Results Compared with the control group, the anorexia nervosa group exhibited greater brain response 1) for prediction error regression within the caudate, ventral caudate/nucleus accumbens, and anterior and posterior insula, 2) to unexpected reward receipt in the anterior and posterior insula, and 3) to unexpected reward omission in the caudate body. Prediction error and unexpected reward omission response tended to normalize with treatment, while unexpected reward receipt response remained significantly elevated. Greater caudate prediction error response when underweight was associated with lower weight gain during treatment. Punishment sensitivity correlated positively with ventral caudate prediction error response. Conclusions Reward system responsiveness is elevated in adolescent anorexia nervosa when underweight and after weight restoration. Heightened prediction error activity in brain reward regions may represent a phenotype of adolescent anorexia nervosa that does not respond well to treatment. Prediction error response could be a neurobiological marker of illness severity that can indicate individual treatment needs. PMID:28231717

Reward deficiency and anti-reward in pain chronification.

PubMed

Borsook, D; Linnman, C; Faria, V; Strassman, A M; Becerra, L; Elman, I

2016-09-01

Converging lines of evidence suggest that the pathophysiology of pain is mediated to a substantial degree via allostatic neuroadaptations in reward- and stress-related brain circuits. Thus, reward deficiency (RD) represents a within-system neuroadaptation to pain-induced protracted activation of the reward circuits that leads to depletion-like hypodopaminergia, clinically manifested anhedonia, and diminished motivation for natural reinforcers. Anti-reward (AR) conversely pertains to a between-systems neuroadaptation involving over-recruitment of key limbic structures (e.g., the central and basolateral amygdala nuclei, the bed nucleus of the stria terminalis, the lateral tegmental noradrenergic nuclei of the brain stem, the hippocampus and the habenula) responsible for massive outpouring of stressogenic neurochemicals (e.g., norepinephrine, corticotropin releasing factor, vasopressin, hypocretin, and substance P) giving rise to such negative affective states as anxiety, fear and depression. We propose here the Combined Reward deficiency and Anti-reward Model (CReAM), in which biopsychosocial variables modulating brain reward, motivation and stress functions can interact in a 'downward spiral' fashion to exacerbate the intensity, chronicity and comorbidities of chronic pain syndromes (i.e., pain chronification). Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Within-subject neural reactivity to reward and threat is inverted in young adolescents.

PubMed

Thomason, M E; Marusak, H A

2017-07-01

As children mature, they become increasingly independent and less reliant on caregiver support. Changes in brain systems are likely to stimulate and guide this process. One mechanistic hypothesis suggests that changes in neural systems that process reward and threat support the increase in exploratory behavior observed in the transition to adolescence. This study examines the basic tenets of this hypothesis by performing functional magnetic resonance imaging (fMRI) during well-established reward and threat processing tasks in 40 children and adolescents, aged 9-15 years. fMRI responses in the striatum and amygdala are fit to a model predicting that striatal reward and amygdala threat-responses will be unrelated in younger participants (aged 9-12 years), while older participants (aged 13-15 years) will differentially engage these structures. Our data are consistent with this model. Activity in the striatum and amygdala are comparable in younger children, but in older children, they are inversely related; those more responsive to reward show a reduced threat-response. Analyses testing age as a continuous variable yield consistent results. In addition, the proportion of threat to reward-response relates to self-reported approach behavior in older but not younger youth, exposing behavioral relevance in the relative level of activity in these structures. Results are consistent with the notion that both individual and developmental differences drive reward-seeking behavior in adolescence. While these response patterns may serve adaptive functions in the shift to independence, skew in these systems may relate to increased rates of emotional psychopathology and risk-taking observed in adolescence.

The impact of cognitive load on reward evaluation.

PubMed

Krigolson, Olave E; Hassall, Cameron D; Satel, Jason; Klein, Raymond M

2015-11-19

The neural systems that afford our ability to evaluate rewards and punishments are impacted by a variety of external factors. Here, we demonstrate that increased cognitive load reduces the functional efficacy of a reward processing system within the human medial-frontal cortex. In our paradigm, two groups of participants used performance feedback to estimate the exact duration of one second while electroencephalographic (EEG) data was recorded. Prior to performing the time estimation task, both groups were instructed to keep their eyes still and avoid blinking in line with well established EEG protocol. However, during performance of the time-estimation task, one of the two groups was provided with trial-to-trial-feedback about their performance on the time-estimation task and their eye movements to induce a higher level of cognitive load relative to participants in the other group who were solely provided with feedback about the accuracy of their temporal estimates. In line with previous work, we found that the higher level of cognitive load reduced the amplitude of the feedback-related negativity, a component of the human event-related brain potential associated with reward evaluation within the medial-frontal cortex. Importantly, our results provide further support that increased cognitive load reduces the functional efficacy of a neural system associated with reward processing. Copyright © 2015 Elsevier B.V. All rights reserved.

Reward, motivation, and emotion systems associated with early-stage intense romantic love.

PubMed

Aron, Arthur; Fisher, Helen; Mashek, Debra J; Strong, Greg; Li, Haifang; Brown, Lucy L

2005-07-01

Early-stage romantic love can induce euphoria, is a cross-cultural phenomenon, and is possibly a developed form of a mammalian drive to pursue preferred mates. It has an important influence on social behaviors that have reproductive and genetic consequences. To determine which reward and motivation systems may be involved, we used functional magnetic resonance imaging and studied 10 women and 7 men who were intensely "in love" from 1 to 17 mo. Participants alternately viewed a photograph of their beloved and a photograph of a familiar individual, interspersed with a distraction-attention task. Group activation specific to the beloved under the two control conditions occurred in dopamine-rich areas associated with mammalian reward and motivation, namely the right ventral tegmental area and the right postero-dorsal body and medial caudate nucleus. Activation in the left ventral tegmental area was correlated with facial attractiveness scores. Activation in the right anteromedial caudate was correlated with questionnaire scores that quantified intensity of romantic passion. In the left insula-putamen-globus pallidus, activation correlated with trait affect intensity. The results suggest that romantic love uses subcortical reward and motivation systems to focus on a specific individual, that limbic cortical regions process individual emotion factors, and that there is localization heterogeneity for reward functions in the human brain.

Additive effects of oxytocin receptor gene polymorphisms on reward circuitry in youth with autism.

PubMed

Hernandez, L M; Krasileva, K; Green, S A; Sherman, L E; Ponting, C; McCarron, R; Lowe, J K; Geschwind, D H; Bookheimer, S Y; Dapretto, M

2017-08-01

Several common alleles in the oxytocin receptor gene (OXTR) are associated with altered brain function in reward circuitry in neurotypical adults and may increase risk for autism spectrum disorders (ASD). Yet, it is currently unknown how variation in the OXTR relates to brain functioning in individuals with ASD, and, critically, whether neural endophenotypes vary as a function of aggregate genetic risk. Here, for we believe the first time, we use a multi-locus approach to examine how genetic variation across several OXTR single-nucleotide polymorphisms (SNPs) affect functional connectivity of the brain's reward network. Using data from 41 children with ASD and 41 neurotypical children, we examined functional connectivity of the nucleus accumbens (NAcc) - a hub of the reward network - focusing on how connectivity varies with OXTR risk-allele dosage. Youth with ASD showed reduced NAcc connectivity with other areas in the reward circuit as a function of increased OXTR risk-allele dosage, as well as a positive association between risk-allele dosage and symptom severity, whereas neurotypical youth showed increased NAcc connectivity with frontal brain regions involved in mentalizing. In addition, we found that increased NAcc-frontal cortex connectivity in typically developing youth was related to better scores on a standardized measure of social functioning. Our results indicate that cumulative genetic variation on the OXTR impacts reward system connectivity in both youth with ASD and neurotypical controls. By showing differential genetic effects on neuroendophenotypes, these pathways elucidate mechanisms of vulnerability versus resilience in carriers of disease-associated risk alleles.

Effects of selective serotonin reuptake inhibition on neural activity related to risky decisions and monetary rewards in healthy males.

PubMed

Macoveanu, Julian; Fisher, Patrick M; Haahr, Mette E; Frokjaer, Vibe G; Knudsen, Gitte M; Siebner, Hartwig R

2014-10-01

Selective serotonin reuptake inhibitors (SSRIs) such as fluoxetine are commonly prescribed antidepressant drugs targeting the dysfunctional serotonin (5-HT) system, yet little is known about the functional effects of prolonged serotonin reuptake inhibition in healthy individuals. Here we used functional MRI (fMRI) to investigate how a three-week fluoxetine intervention influences neural activity related to risk taking and reward processing. Employing a double-blinded parallel-group design, 29 healthy young males were randomly assigned to receive 3 weeks of a daily dose of 40 mg fluoxetine or placebo. Participants underwent task-related fMRI prior to and after the three-week intervention while performing a card gambling task. The task required participants to choose between two decks of cards. Choices were associated with different risk levels and potential reward magnitudes. Relative to placebo, the SSRI intervention did not alter individual risk-choice preferences, but modified neural activity during decision-making and reward processing: During the choice phase, SSRI reduced the neural response to increasing risk in lateral orbitofrontal cortex, a key structure for value-based decision-making. During the outcome phase, a midbrain region showed an independent decrease in the responsiveness to rewarding outcomes. This midbrain cluster included the raphe nuclei from which serotonergic modulatory projections originate to both cortical and subcortical regions. The findings corroborate the involvement of the normally functioning 5HT-system in decision-making under risk and processing of monetary rewards. The data suggest that prolonged SSRI treatment might reduce emotional engagement by reducing the impact of risk during decision-making or the impact of reward during outcome evaluation. Copyright © 2014 Elsevier Inc. All rights reserved.

Distinct Roles of Opioid and Dopamine Systems in Lateral Hypothalamic Intracranial Self-Stimulation.

PubMed

Ide, Soichiro; Takahashi, Takehiro; Takamatsu, Yukio; Uhl, George R; Niki, Hiroaki; Sora, Ichiro; Ikeda, Kazutaka

2017-05-01

Opioid and dopamine systems play crucial roles in reward. Similarities and differences in the neural mechanisms of reward that are mediated by these 2 systems have remained largely unknown. Thus, in the present study, we investigated the differences in reward function in both µ-opioid receptor knockout mice and dopamine transporter knockout mice, important molecules in the opioid and dopamine systems. Mice were implanted with electrodes into the right lateral hypothalamus (l hour). Mice were then trained to put their muzzle into the hole in the head-dipping chamber for intracranial electrical stimulation, and the influences of gene knockout were assessed. Significant differences are observed between opioid and dopamine systems in reward function. µ-Opioid receptor knockout mice exhibited enhanced intracranial electrical stimulation, which induced dopamine release. They also exhibited greater motility under conditions of "despair" in both the tail suspension test and water wheel test. In contrast, dopamine transporter knockout mice maintained intracranial electrical stimulation responding even when more active efforts were required to obtain the reward. The absence of µ-opioid receptor or dopamine transporter did not lead to the absence of intracranial electrical stimulation responsiveness but rather differentially altered it. The present results in µ-opioid receptor knockout mice are consistent with the suppressive involvement of µ-opioid receptors in both positive incentive motivation associated with intracranial electrical stimulation and negative incentive motivation associated with depressive states. In contrast, the results in dopamine transporter knockout mice are consistent with the involvement of dopamine transporters in positive incentive motivation, especially its persistence. Differences in intracranial electrical stimulation in µ-opioid receptor and dopamine transporter knockout mice underscore the multidimensional nature of reward. © The Author 2016. Published by Oxford University Press on behalf of CINP.

Abnormal reward functioning across substance use disorders and major depressive disorder: Considering reward as a transdiagnostic mechanism.

PubMed

Baskin-Sommers, Arielle R; Foti, Dan

2015-11-01

A common criticism of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 2013) is that its criteria are based more on behavioral descriptions than on underlying biological mechanisms. Increasingly, calls have intensified for a more biologically-based approach to conceptualizing, studying, and treating psychological disorders, as exemplified by the Research Domain Criteria Project (RDoC). Among the most well-studied neurobiological mechanisms is reward processing. Moreover, individual differences in reward sensitivity are related to risk for substance abuse and depression. The current review synthesizes the available preclinical, electrophysiological, and neuroimaging literature on reward processing from a transdiagnostic, multidimensional perspective. Findings are organized with respect to key reward constructs within the Positive Valence Systems domain of the RDoC matrix, including initial responsiveness to reward (physiological 'liking'), approach motivation (physiological 'wanting'), and reward learning/habit formation. In the current review, we (a) describe the neural basis of reward, (b) elucidate differences in reward activity in substance abuse and depression, and (c) suggest a framework for integrating these disparate literatures and discuss the utility of shifting focus from diagnosis to process for understanding liability and co-morbidity. Ultimately, we believe that an integrative focus on abnormal reward functioning across the full continuum of clinically heterogeneous samples, rather than within circumscribed diagnostic categories, might actually help to refine the phenotypes and improve the prediction of onset and recovery of these disorders. Copyright © 2015 Elsevier B.V. All rights reserved.

An Automated Motion Detection and Reward System for Animal Training.

PubMed

Miller, Brad; Lim, Audrey N; Heidbreder, Arnold F; Black, Kevin J

2015-12-04

A variety of approaches has been used to minimize head movement during functional brain imaging studies in awake laboratory animals. Many laboratories expend substantial effort and time training animals to remain essentially motionless during such studies. We could not locate an "off-the-shelf" automated training system that suited our needs.  We developed a time- and labor-saving automated system to train animals to hold still for extended periods of time. The system uses a personal computer and modest external hardware to provide stimulus cues, monitor movement using commercial video surveillance components, and dispense rewards. A custom computer program automatically increases the motionless duration required for rewards based on performance during the training session but allows changes during sessions. This system was used to train cynomolgus monkeys (Macaca fascicularis) for awake neuroimaging studies using positron emission tomography (PET) and functional magnetic resonance imaging (fMRI). The automated system saved the trainer substantial time, presented stimuli and rewards in a highly consistent manner, and automatically documented training sessions. We have limited data to prove the training system's success, drawn from the automated records during training sessions, but we believe others may find it useful. The system can be adapted to a range of behavioral training/recording activities for research or commercial applications, and the software is freely available for non-commercial use.

Reward System Activation in Response to Alcohol Advertisements Predicts College Drinking.

PubMed

Courtney, Andrea L; Rapuano, Kristina M; Sargent, James D; Heatherton, Todd F; Kelley, William M

2018-01-01

In this study, we assess whether activation of the brain's reward system in response to alcohol advertisements is associated with college drinking. Previous research has established a relationship between exposure to alcohol marketing and underage drinking. Within other appetitive domains, the relationship between cue exposure and behavioral enactment is known to rely on activation of the brain's reward system. However, the relationship between neural activation to alcohol advertisements and alcohol consumption has not been studied in a nondisordered population. In this cross-sectional study, 53 college students (32 women) completed a functional magnetic resonance imaging scan while viewing alcohol, food, and control (car and technology) advertisements. Afterward, they completed a survey about their alcohol consumption (including frequency of drinking, typical number of drinks consumed, and frequency of binge drinking) over the previous month. In 43 participants (24 women) meeting inclusion criteria, viewing alcohol advertisements elicited activation in the left orbitofrontal cortex and bilateral ventral striatum-regions of the reward system that typically activate to other appetitive rewards and relate to consumption behaviors. Moreover, the level of self-reported drinking correlated with the magnitude of activation in the left orbitofrontal cortex. Results suggest that alcohol cues are processed within the reward system in a way that may motivate drinking behavior.

Serotonergic modulation of reward and punishment: evidence from pharmacological fMRI studies.

PubMed

Macoveanu, Julian

2014-03-27

Until recently, the bulk of research on the human reward system was focused on studying the dopaminergic and opioid neurotransmitter systems. However, extending the initial data from animal studies on reward, recent pharmacological brain imaging studies on human participants bring a new line of evidence on the key role serotonin plays in reward processing. The reviewed research has revealed how central serotonin availability and receptor specific transmission modulates the neural response to both appetitive (rewarding) and aversive (punishing) stimuli in putative reward-related brain regions. Thus, serotonin is suggested to be involved in behavioral control when there is a prospect of reward or punishment. The new findings may have implications in understanding psychiatric disorders such as major depression which is characterized by abnormal serotonergic function and reward-related processing and may also provide a neural correlated for the emotional blunting observed in the clinical treatment of psychiatric disorders with selective serotonin reuptake inhibitors. Given the unique profile of action of each serotonergic receptor subtype, future pharmacological studies may favor receptor specific investigations to complement present research mainly focused on global serotonergic manipulations. Copyright © 2014 Elsevier B.V. All rights reserved.

Striatal dopamine release codes uncertainty in pathological gambling.

PubMed

Linnet, Jakob; Mouridsen, Kim; Peterson, Ericka; Møller, Arne; Doudet, Doris Jeanne; Gjedde, Albert

2012-10-30

Two mechanisms of midbrain and striatal dopaminergic projections may be involved in pathological gambling: hypersensitivity to reward and sustained activation toward uncertainty. The midbrain-striatal dopamine system distinctly codes reward and uncertainty, where dopaminergic activation is a linear function of expected reward and an inverse U-shaped function of uncertainty. In this study, we investigated the dopaminergic coding of reward and uncertainty in 18 pathological gambling sufferers and 16 healthy controls. We used positron emission tomography (PET) with the tracer [(11)C]raclopride to measure dopamine release, and we used performance on the Iowa Gambling Task (IGT) to determine overall reward and uncertainty. We hypothesized that we would find a linear function between dopamine release and IGT performance, if dopamine release coded reward in pathological gambling. If, on the other hand, dopamine release coded uncertainty, we would find an inversely U-shaped function. The data supported an inverse U-shaped relation between striatal dopamine release and IGT performance if the pathological gambling group, but not in the healthy control group. These results are consistent with the hypothesis of dopaminergic sensitivity toward uncertainty, and suggest that dopaminergic sensitivity to uncertainty is pronounced in pathological gambling, but not among non-gambling healthy controls. The findings have implications for understanding dopamine dysfunctions in pathological gambling and addictive behaviors. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Maternal Depression and Warmth During Childhood Predict Age 20 Neural Response to Reward

PubMed Central

Morgan, Judith K.; Shaw, Daniel S.; Forbes, Erika E.

2014-01-01

Objective Early parenting experiences likely shape children’s brain development, with consequences potentially extending into adulthood. Parents’ affective disorders and expressions of positive affect could exert an influence on affect-related circuitry. The current study evaluated how maternal depression and maternal warmth assessed in early childhood and early adolescence were related to boys’ reward function during early adulthood. Method Participants were 120 boys at socioeconomic risk for emotional problems. Mothers’ history of depression during the child’s lifetime was measured when boys were 42 months old and 10/11 years old. Maternal warmth was observed during mother–child interactions at 18 and 24 months and at 10 and 11 years. Results Maternal warmth during early childhood was associated with less activation in the medial prefrontal cortex (mPFC) when anticipating and experiencing reward loss. Maternal warmth during early adolescence was associated with less activation in the mPFC when winning rewards and greater activation in the caudate when experiencing loss. The association between maternal warmth during early childhood and early adolescence and reward function in the striatum and mPFC was stronger for boys exposed to maternal depression relative to boys who were not. Conclusions The experience of warmth and affection from mothers may be a protective factor for reward function in boys exposed to maternal depression, possibly by engaging vulnerable neural reward systems through affiliation. PMID:24342390

Integration of homeostatic signaling and food reward processing in the human brain.

PubMed

Simon, Joe J; Wetzel, Anne; Sinno, Maria Hamze; Skunde, Mandy; Bendszus, Martin; Preissl, Hubert; Enck, Paul; Herzog, Wolfgang; Friederich, Hans-Christoph

2017-08-03

Food intake is guided by homeostatic needs and by the reward value of food, yet the exact relation between the two remains unclear. The aim of this study was to investigate the influence of different metabolic states and hormonal satiety signaling on responses in neural reward networks. Twenty-three healthy participants underwent functional magnetic resonance imaging while performing a task distinguishing between the anticipation and the receipt of either food- or monetary-related reward. Every participant was scanned twice in a counterbalanced fashion, both during a fasted state (after 24 hours fasting) and satiety. A functional connectivity analysis was performed to investigate the influence of satiety signaling on activation in neural reward networks. Blood samples were collected to assess hormonal satiety signaling. Fasting was associated with sensitization of the striatal reward system to the anticipation of food reward irrespective of reward magnitude. Furthermore, during satiety, individual ghrelin levels were associated with increased neural processing during the expectation of food-related reward. Our findings show that physiological hunger stimulates food consumption by specifically increasing neural processing during the expectation (i.e., incentive salience) but not the receipt of food-related reward. In addition, these findings suggest that ghrelin signaling influences hedonic-driven food intake by increasing neural reactivity during the expectation of food-related reward. These results provide insights into the neurobiological underpinnings of motivational processing and hedonic evaluation of food reward. ClinicalTrials.gov NCT03081585. This work was supported by the German Competence Network on Obesity, which is funded by the German Federal Ministry of Education and Research (FKZ 01GI1122E).

Active and observational reward learning in adults with autism spectrum disorder: relationship with empathy in an atypical sample.

PubMed

Bellebaum, Christian; Brodmann, Katja; Thoma, Patrizia

2014-01-01

Autism spectrum disorders (ASDs) are characterised by disturbances in social behaviour. A prevailing hypothesis suggests that these problems are related to deficits in assigning rewarding value to social stimuli. The present study aimed to examine monetary reward processing in adults with ASDs by means of event-related potentials (ERPs). Ten individuals with mild ASDs (Asperger's syndrome and high-functioning autism) and 12 healthy control subjects performed an active and an observational probabilistic reward-learning task. Both groups showed similar overall learning performance. With respect to reward processing, subjects with ASDs exhibited a general reduction in feedback-related negativity (FRN) amplitude, irrespective of feedback valence and type of learning (active or observational). Individuals with ASDs showed lower scores for cognitive empathy, while affective empathy did not differ between groups. Correlation analyses revealed that higher empathy (both cognitive and affective) negatively affected performance in observational learning in controls and in active learning in ASDs (only cognitive empathy). No relationships were seen between empathy and ERPs. Reduced FRN amplitudes are discussed in terms of a deficit in fast reward processing in ASDs, which may indicate altered reward system functioning.

D-amphetamine stimulates unconditioned exploration/approach behaviors in crayfish: towards a conserved evolutionary function of ancestral drug reward

PubMed Central

Alcaro, Antonio; Panksepp, Jaak; Huber, Robert

2012-01-01

In mammals, rewarding properties of drugs depend on their capacity to activate a dopamine-mediated appetitive motivational seeking state—a system that allows animals to pursue and find all kinds of objects and events needed for survival. With such states strongly conserved in evolution, invertebrates have recently been developed into a powerful model in addiction research, where a shared ancestral brain system for the acquisition of reward can mediate drug addiction in many species. A conditioned place preference paradigm has illustrated that crayfish seek out environments that had previously been paired with psychostimulant and opioid administration. The present work demonstrates that the administration of d-amphetamine stimulates active explorative behaviors in crayfish through the action of the drug within their head ganglion. Crayfish, with a modularly organized and experimentally accessible, ganglionic nervous system offers a unique model to investigate (1) the fundamental, biological mechanisms of addictive drug reward; (2) how an appetitive/seeking disposition is implemented in a simple neural system, and (3) how it mediates the rewarding actions of major drugs of abuse. PMID:21504757

Paralimbic system and striatum are involved in motivational behavior.

PubMed

Nishimura, Masahiko; Yoshii, Yoshihiko; Watanabe, Jobu; Ishiuchi, Shogo

2009-10-28

Goal-directed rewarded behavior and goal-directed non-rewarded behavior are concerned with motivation. However, the neural substrates involved in goal-directed non-rewarded behaviors are unknown. Using functional magnetic resonance imaging, we investigated the brain activities of healthy individuals during a novel tool use (turning a screwdriver) to elucidate the relationship between the brain mechanism relevant to goal-directed non-rewarded behavior and motivation. We found that our designed behavioral task evoked activities in the orbitofrontal cortex, striatum, anterior insula, lateral prefrontal cortex, and anterior cingulate cortex compared with a meaningless task. These results suggest that activation in these cerebral regions play important roles in motivational behavior without tangible rewards.

Dopaminergic modulation of the human reward system: a placebo-controlled dopamine depletion fMRI study.

PubMed

da Silva Alves, Fabiana; Schmitz, Nicole; Figee, Martijn; Abeling, Nico; Hasler, Gregor; van der Meer, Johan; Nederveen, Aart; de Haan, Lieuwe; Linszen, Don; van Amelsvoort, Therese

2011-04-01

Reward related behaviour is linked to dopaminergic neurotransmission. Our aim was to gain insight into dopaminergic involvement in the human reward system. Combining functional magnetic resonance imaging with dopaminergic depletion by α-methylparatyrosine we measured dopamine-related brain activity in 10 healthy volunteers. In addition to blood-oxygen-level-dependent (BOLD) contrast we assessed the effect of dopaminergic depletion on prolactin response, peripheral markers for dopamine and norepinephrine. In the placebo condition we found increased activation in the left caudate and left cingulate gyrus during anticipation of reward. In the α-methylparatyrosine condition there was no significant brain activation during anticipation of reward or loss. In α-methylparatyrosine, anticipation of reward vs. loss increased activation in the right insula, left frontal, right parietal cortices and right cingulate gyrus. Comparing placebo versus α-methylparatyrosine showed increased activation in the left cingulate gyrus during anticipation of reward and the left medial frontal gyrus during anticipation of loss. α-methylparatyrosine reduced levels of dopamine in urine and homovanillic acid in plasma and increased prolactin. No significant effect of α-methylparatyrosine was found on norepinephrine markers. Our findings implicate distinct patterns of BOLD underlying reward processing following dopamine depletion, suggesting a role of dopaminergic neurotransmission for anticipation of monetary reward.

Neuroimaging of the Dopamine/Reward System in Adolescent Drug Use

PubMed Central

Ernst, Monique; Luciana, Monica

2015-01-01

Adolescence is characterized by heightened risk-taking, including substance misuse. These behavioral patterns are influenced by ontogenic changes in neurotransmitter systems, particularly the dopamine system, which is fundamentally involved in the neural coding of reward and motivated approach behavior. During adolescence, this system evidences a peak in activity. At the same time, the dopamine system is neuroplastically altered by substance abuse, impacting subsequent function. Here, we describe properties of the dopamine system that change with typical adolescent development and that are altered with substance abuse. Much of this work has been gleaned from animal models due to limitations in measuring dopamine in pediatric samples. Structural and functional neuroimaging techniques have been used to examine structures that are heavily DA-innervated; they measure morphological and functional changes with age and with drug exposure. Presenting marijuana abuse as an exemplar, we consider recent findings that support an adolescent peak in DA-driven reward-seeking behavior and related deviations in motivational systems that are associated with marijuana abuse/dependence. Clinicians are advised that (1) chronic adolescent marijuana use may lead to deficiencies in incentive motivation, (2) that this state is due to marijuana’s interactions with the developing DA system, and (3) that treatment strategies should be directed to remediating resultant deficiencies in goal-directed activity. PMID:26095977

Abstinent adult daily smokers show reduced anticipatory but elevated saccade-related brain responses during a rewarded antisaccade task.

PubMed

Geier, Charles F; Sweitzer, Maggie M; Denlinger, Rachel; Sparacino, Gina; Donny, Eric C

2014-08-30

Chronic smoking may result in reduced sensitivity to non-drug rewards (e.g., money), a phenomenon particularly salient during abstinence. During a quit attempt, this effect may contribute to biased decision-making (smoking>alternative reinforcers) and relapse. Although relevant for quitting, characterization of reduced reward function in abstinent smokers remains limited. Moreover, how attenuated reward function affects other brain systems supporting decision-making has not been established. Here, we use a rewarded antisaccade (rAS) task to characterize non-drug reward processing and its influence on inhibitory control, key elements underlying decision-making, in abstinent smokers vs. non-smokers. Abstinent (12-hours) adult daily smokers (N=23) and non-smokers (N=11) underwent fMRI while performing the rAS. Behavioral performances improved on reward vs. neutral trials. Smokers showed attenuated activation in ventral striatum during the reward cue and in superior precentral sulcus and posterior parietal cortex during response preparation, but greater responses during the saccade response in posterior cingulate and parietal cortices. Smokers' attenuated anticipatory responses suggest reduced motivation from monetary reward, while heightened activation during the saccade response suggests that additional circuitry may be engaged later to enhance inhibitory task performance. Overall, this preliminary study highlights group differences in decision-making components and the utility of the rAS to characterize these effects. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Comparing the neural basis of monetary reward and cognitive feedback during information-integration category learning.

PubMed

Daniel, Reka; Pollmann, Stefan

2010-01-06

The dopaminergic system is known to play a central role in reward-based learning (Schultz, 2006), yet it was also observed to be involved when only cognitive feedback is given (Aron et al., 2004). Within the domain of information-integration category learning, in which information from several stimulus dimensions has to be integrated predecisionally (Ashby and Maddox, 2005), the importance of contingent feedback is well established (Maddox et al., 2003). We examined the common neural correlates of reward anticipation and prediction error in this task. Sixteen subjects performed two parallel information-integration tasks within a single event-related functional magnetic resonance imaging session but received a monetary reward only for one of them. Similar functional areas including basal ganglia structures were activated in both task versions. In contrast, a single structure, the nucleus accumbens, showed higher activation during monetary reward anticipation compared with the anticipation of cognitive feedback in information-integration learning. Additionally, this activation was predicted by measures of intrinsic motivation in the cognitive feedback task and by measures of extrinsic motivation in the rewarded task. Our results indicate that, although all other structures implicated in category learning are not significantly affected by altering the type of reward, the nucleus accumbens responds to the positive incentive properties of an expected reward depending on the specific type of the reward.

Neuronal correlates of reward and loss in Cluster B personality disorders: a functional magnetic resonance imaging study.

PubMed

Völlm, Birgit; Richardson, Paul; McKie, Shane; Elliott, Rebecca; Dolan, Mairead; Deakin, Bill

2007-11-15

Decision making is guided by the likely consequences of behavioural choices. Neuronal correlates of financial reward have been described in a number of functional imaging studies in humans. Areas implicated in reward include ventral striatum, dopaminergic midbrain, amygdala and orbitofrontal cortex. Response to loss has not been as extensively studied but may involve prefrontal and medial temporal cortices. It has been proposed that increased sensitivity to reward and reduced sensitivity to punishment underlie some of the psychopathology in impulsive personality disordered individuals. However, few imaging studies using reinforcement tasks have been conducted in this group. In this fMRI study, we investigate the effects of positive (monetary reward) and negative (monetary loss) outcomes on BOLD responses in two target selection tasks. The experimental group comprised eight people with Cluster B (antisocial and borderline) personality disorder, whilst the control group contained fourteen healthy participants. A key finding was the absence of prefrontal responses and reduced BOLD signal in the subcortical reward system in the PD group during positive reinforcement. Impulsivity scores correlated negatively with prefrontal responses in the PD but not the control group during both, reward and loss. Our results suggest dysfunctional responses to rewarding and aversive stimuli in Cluster B personality disordered individuals but do not support the notion of hypersensitivity to reward and hyposensitivity to loss.

Methylphenidate and brain activity in a reward/conflict paradigm: role of the insula in task performance.

PubMed

Ivanov, Iliyan; Liu, Xun; Clerkin, Suzanne; Schulz, Kurt; Fan, Jin; Friston, Karl; London, Edythe D; Schwartz, Jeffrey; Newcorn, Jeffrey H

2014-06-01

Psychostimulants, such as methylphenidate, are thought to improve information processing in motivation-reward and attention-activation networks by enhancing the effects of more relevant signals and suppressing those of less relevant ones; however the nature of such reciprocal influences remains poorly understood. To explore this question, we tested the effect of methylphenidate on performance and associated brain activity in the Anticipation, Conflict, Reward (ACR) task. Sixteen healthy adult volunteers, ages 21-45, were scanned twice using functional magnetic resonance imaging (fMRI) as they performed the ACR task under placebo and methylphenidate conditions. A three-way repeated measures analysis of variance, with cue (reward vs. non-reward), target (congruent vs. incongruent) and medication condition (methylphenidate vs. placebo) as the factors, was used to analyze behaviors on the task. Blood oxygen level dependent (BOLD) signals, reflecting task-related neural activity, were evaluated using linear contrasts. Participants exhibited significantly greater accuracy in the methylphenidate condition than the placebo condition. Compared with placebo, the methylphenidate condition also was associated with lesser task-related activity in components of attention-activation systems irrespective of the reward cue, and less task-related activity in components of the reward-motivation system, particularly the insula, during reward trials irrespective of target difficulty. These results suggest that methylphenidate enhances task performance by improving efficiency of information processing in both reward-motivation and in attention-activation systems. Published by Elsevier B.V.

Association Between Reward Reactivity and Drug Use Severity is Substance Dependent: Preliminary Evidence From the Human Connectome Project.

PubMed

Peechatka, Alyssa L; Janes, Amy C

2017-06-01

Blunted nucleus accumbens (NAc) reactivity to reward is common across drug users. One theory is that individuals abuse substances due to this reward deficit. However, whether there is a relationship between the amount an individual uses and the severity of NAc dysfunction is unclear. It also is possible that such a relationship is substance specific, as nicotine transiently increases reward system sensitivity while alcohol, another commonly used substance, does not. As smokers may use nicotine to bolster NAc reward function, we hypothesize that NAc reactivity to reward will be related to volume of cigarette use, but not volume of alcohol use. A functional magnetic resonance imaging incentive-processing task collected by the Human Connectome Project was assessed in a cohort of tobacco smokers who reported smoking between 5-20 cigarettes/day and a cohort of alcohol users who reported drinking 7-25 drinks/wk. Number of cigarettes/day and drinks/wk were correlated with right and left NAc reactivity to the receipt of a monetary reward relative to baseline. Individuals who smoke greater numbers of cigarettes/day showed lower right NAc reactivity to reward (r = 0.853, p ≤ .001). Left NAc reactivity was not correlated with cigarettes/day. No association was found with drinks/wk. A negative association was found between NAc reactivity to reward and cigarettes/day, but not alcohol drinks/wk. Given nicotine's unique ability to increase sensitivity to rewards, these findings suggest that individuals who smoke more cigarettes/day may be compensating for more dysfunctional NAc reward reactivity. The present study demonstrates that a relationship between NAc reactivity to nondrug reward and volume of substance use is present in nicotine but not alcohol use. While prior work has implicated dysfunctional reward processing in addictions, these findings clarify a substance-specific role that blunted reward function has in determining patterns of use among chronic users. © The Author 2017. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Sex Differences in Drug-Related Stress-System Changes: Implications for Treatment in Substance-Abusing Women

PubMed Central

Fox, Helen C.; Sinha, Rajita

2009-01-01

Extensive research indicates that chronic substance abuse disrupts stress and reward systems of the brain. Gender variation within these stress-system alterations, including the impact of sex hormones on these changes, may influence sex-specific differences in both the development of, and recovery from, dependency. As such, gender variations in stress-system function may also provide a viable explanation for why women are markedly more vulnerable than men to the negative consequences of drug use. This article therefore initially reviews studies that have examined gender differences in emotional and biophysiological changes to the stress and reward system following the acute administration of drugs, including cocaine, alcohol, and nicotine. The article then reviews studies that have examined gender differences in response to various types of stress in both healthy and drug-abusing populations. Studies examining the impact of sex hormones on these gender-related responses are also reported. The implications of these sex-specific variations in stress and reward system function are discussed in terms of both comorbid psychopathology and treatment outcome. PMID:19373619

Dopaminergic Reward Sensitivity Can Promote Adolescent Health: A New Perspective on the Mechanism of Ventral Striatum Activation

PubMed Central

Telzer, Eva H.

2015-01-01

The prevailing view in the field of adolescent brain development is that heightened activity in the mesolimbic dopaminergic reward system serves as a liability, orienting adolescents towards risky behaviors, increasing their sensitivity to social evaluation and loss, and resulting in compromised well-being. Several findings inconsistent with this deficit view challenge the perspective that adolescent reward sensitivity largely serves as a liability and highlights the potential adaptive function that heightened striatal reactivity can serve. The goal of this review is to refine our understanding of dopaminergic reward sensitivity in adolescence. I review several studies showing that ventral striatum activation serves an adaptive function for adolescents’ health and well being relating to declines in both risk taking and depression and increases in cognitive persistence and achievement. PMID:26708774

A Positive Affective Neuroendocrinology Approach to Reward and Behavioral Dysregulation

PubMed Central

Welker, Keith M.; Gruber, June; Mehta, Pranjal H.

2015-01-01

Emerging lines of research suggest that both testosterone and maladaptive reward processing can modulate behavioral dysregulation. Yet, to date, no integrative account has been provided that systematically explains neuroendocrine function, dysregulation of reward, and behavioral dysregulation in a unified perspective. This is particularly important given specific neuroendocrine systems are potential mechanisms underlying and giving rise to reward-relevant behaviors. In this review, we propose a forward-thinking approach to study the mechanisms of reward and behavioral dysregulation from a positive affective neuroendocrinology (PANE) perspective. This approach holds that testosterone increases reward processing and motivation, which increase the likelihood of behavioral dysregulation. Additionally, the PANE framework holds that reward processing mediates the effects of testosterone on behavioral dysregulation. We also explore sources of potential sex differences and the roles of age, cortisol, and individual differences within the PANE framework. Finally, we discuss future prospects for research questions and methodology in the emerging field of affective neuroendocrinology. PMID:26191007

[Cognitive Functions in the Prefrontal Association Cortex; Transitive Inference and the Lateral Prefrontal Cortex].

PubMed

Tanaka, Shingo; Oguchi, Mineki; Sakagami, Masamichi

2016-11-01

To behave appropriately in a complex and uncertain world, the brain makes use of several distinct learning systems. One such system is called the "model-free process", via which conditioning allows the association between a stimulus or response and a given reward to be learned. Another system is called the "model-based process". Via this process, the state transition between a stimulus and a response is learned so that the brain is able to plan actions prior to their execution. Several studies have tried to relate the difference between model-based and model-free processes to the difference in functions of the lateral prefrontal cortex (LPFC) and the striatum. Here, we describe a series of studies that demonstrate the ability of LPFC neurons to categorize visual stimuli by their associated behavioral responses and to generate abstract information. If LPFC neurons utilize abstract code to associate a stimulus with a reward, they should be able to infer similar relationships between other stimuli of the same category and their rewards without direct experience of these stimulus-reward contingencies. We propose that this ability of LPFC neurons to utilize abstract information can contribute to the model-based learning process.

Nectar quality perception by honey bees (Apis mellifera ligustica).

PubMed

Sanderson, Charlotte E; Cook, Peyton; Hill, Peggy S M; Orozco, Benjamin S; Abramson, Charles I; Wells, Harrington

2013-11-01

In exploring how foragers perceive rewards, we often find that well-motivated individuals are not too choosy and unmotivated individuals are unreliable and inconsistent. Nevertheless, when given a choice we see that individuals can clearly distinguish between rewards. Here we develop the logic of using responses to two-choice problems as a derivative function of perceived reward, and utilize this model to examine honey bee perception of nectar quality. Measuring the derivative allows us to deduce the perceived reward function. The derivative function of the perceived reward equation gives the rate of change of the reward perceived for each reward value. This approach depends on presenting free-flying foragers with a series of two different rewards presented simultaneously (i.e., two-choice, binomial tests). We also examine how honey bees integrate information from a range of reward qualities to formulate a functional response. Results suggest that honey bees overestimate higher quality rewards and that direct comparison is an important step in the integration of information from a range of rewards.

Music-related reward responses predict episodic memory performance.

PubMed

Ferreri, Laura; Rodriguez-Fornells, Antoni

2017-12-01

Music represents a special type of reward involving the recruitment of the mesolimbic dopaminergic system. According to recent theories on episodic memory formation, as dopamine strengthens the synaptic potentiation produced by learning, stimuli triggering dopamine release could result in long-term memory improvements. Here, we behaviourally test whether music-related reward responses could modulate episodic memory performance. Thirty participants rated (in terms of arousal, familiarity, emotional valence, and reward) and encoded unfamiliar classical music excerpts. Twenty-four hours later, their episodic memory was tested (old/new recognition and remember/know paradigm). Results revealed an influence of music-related reward responses on memory: excerpts rated as more rewarding were significantly better recognized and remembered. Furthermore, inter-individual differences in the ability to experience musical reward, measured through the Barcelona Music Reward Questionnaire, positively predicted memory performance. Taken together, these findings shed new light on the relationship between music, reward and memory, showing for the first time that music-driven reward responses are directly implicated in higher cognitive functions and can account for individual differences in memory performance.

Circadian misalignment, reward-related brain function, and adolescent alcohol involvement.

PubMed

Hasler, Brant P; Clark, Duncan B

2013-04-01

Developmental changes in sleep and circadian rhythms that occur during adolescence may contribute to reward-related brain dysfunction, and consequently increase the risk of alcohol use disorders (AUDs). This review (i) describes marked changes in circadian rhythms, reward-related behavior and brain function, and alcohol involvement that occur during adolescence, (ii) offers evidence that these parallel developmental changes are associated, and (iii) posits a conceptual model by which misalignment between sleep-wake timing and endogenous circadian timing may increase the risk of adolescent AUDs by altering reward-related brain function. The timing of sleep shifts later throughout adolescence, in part due to developmental changes in endogenous circadian rhythms, which tend to become more delayed. This tendency for delayed sleep and circadian rhythms is at odds with early school start times during secondary education, leading to misalignment between many adolescents' sleep-wake schedules and their internal circadian timing. Circadian misalignment is associated with increased alcohol use and other risk-taking behaviors, as well as sleep loss and sleep disturbance. Growing evidence indicates that circadian rhythms modulate the reward system, suggesting that circadian misalignment may impact adolescent alcohol involvement by altering reward-related brain function. Neurocognitive function is also subject to sleep and circadian influence, and thus circadian misalignment may also impair inhibitory control and other cognitive processes relevant to alcohol use. Specifically, circadian misalignment may further exacerbate the cortical-subcortical imbalance within the reward circuit, an imbalance thought to explain increased risk-taking and sensation-seeking during adolescence. Adolescent alcohol use is highly contextualized, however, and thus studies testing this model will also need to consider factors that may influence both circadian misalignment and alcohol use. This review highlights growing evidence supporting a path by which circadian misalignment may disrupt reward mechanisms, which may in turn accelerate the transition from alcohol use to AUDs in vulnerable adolescents. Copyright © 2013 by the Research Society on Alcoholism.

Reward for food odors: an fMRI study of liking and wanting as a function of metabolic state and BMI

PubMed Central

Jiang, Tao; Soussignan, Robert; Schaal, Benoist

2015-01-01

Brain reward systems mediate liking and wanting for food reward. Here, we explore the differential involvement of the following structures for these two components: the ventral and dorsal striatopallidal area, orbitofrontal cortex (OFC), anterior insula and anterior cingulate. Twelve healthy female participants were asked to rate pleasantness (liking of food and non-food odors) and the desire to eat (wanting of odor-evoked food) during event-related functional magnetic resonance imaging (fMRI). The subjective ratings and fMRI were performed in hunger and satiety states. Activations of regions of interest were compared as a function of task (liking vs wanting), odor category (food vs non-food) and metabolic state (hunger vs satiety). We found that the nucleus accumbens and ventral pallidum were differentially involved in liking or wanting during the hunger state, which suggests a reciprocal inhibitory influence between these structures. Neural activation of OFC subregions was correlated with either liking or wanting ratings, suggesting an OFC role in reward processing magnitude. Finally, during the hunger state, participants with a high body mass index exhibited less activation in neural structures underlying food reward processing. Our results suggest that food liking and wanting are two separable psychological constructs and may be functionally segregated within the cortico-striatopallidal circuit. PMID:24948157

Reward inference by primate prefrontal and striatal neurons.

PubMed

Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru; Sakagami, Masamichi

2014-01-22

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus-reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning.

Reward Inference by Primate Prefrontal and Striatal Neurons

PubMed Central

Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru

2014-01-01

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus–reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning. PMID:24453328

Integration of homeostatic signaling and food reward processing in the human brain

PubMed Central

Simon, Joe J.; Wetzel, Anne; Sinno, Maria Hamze; Skunde, Mandy; Bendszus, Martin; Enck, Paul; Herzog, Wolfgang; Friederich, Hans-Christoph

2017-01-01

BACKGROUND. Food intake is guided by homeostatic needs and by the reward value of food, yet the exact relation between the two remains unclear. The aim of this study was to investigate the influence of different metabolic states and hormonal satiety signaling on responses in neural reward networks. METHODS. Twenty-three healthy participants underwent functional magnetic resonance imaging while performing a task distinguishing between the anticipation and the receipt of either food- or monetary-related reward. Every participant was scanned twice in a counterbalanced fashion, both during a fasted state (after 24 hours fasting) and satiety. A functional connectivity analysis was performed to investigate the influence of satiety signaling on activation in neural reward networks. Blood samples were collected to assess hormonal satiety signaling. RESULTS. Fasting was associated with sensitization of the striatal reward system to the anticipation of food reward irrespective of reward magnitude. Furthermore, during satiety, individual ghrelin levels were associated with increased neural processing during the expectation of food-related reward. CONCLUSIONS. Our findings show that physiological hunger stimulates food consumption by specifically increasing neural processing during the expectation (i.e., incentive salience) but not the receipt of food-related reward. In addition, these findings suggest that ghrelin signaling influences hedonic-driven food intake by increasing neural reactivity during the expectation of food-related reward. These results provide insights into the neurobiological underpinnings of motivational processing and hedonic evaluation of food reward. TRIAL REGISTRATION. ClinicalTrials.gov NCT03081585. FUNDING. This work was supported by the German Competence Network on Obesity, which is funded by the German Federal Ministry of Education and Research (FKZ 01GI1122E). PMID:28768906

Reward processing by the lateral habenula in normal and depressive behaviors

PubMed Central

Proulx, Christophe D.; Hikosaka, Okihide; Malinow, Roberto

2015-01-01

The brain reward circuit has a central role in reinforcing behaviors that are rewarding and preventing behaviors that lead to punishment. Recent work has shown that the lateral habenula is an important part of the reward circuit by providing ‘negative value’ signals to the dopaminergic and serotonergic systems. Studies also suggest that dysfunction of the lateral habenula is associated with psychiatric disorders including major depression. In this review, we first discuss insights gained from neuronal recordings in monkeys regarding how the lateral habenula processes reward-related information. We next highlight recent optogenetic experiments in rodents addressing normal and abnormal functions of the habenula. Finally, we discuss how deregulation of the lateral habenula may play a role in depressive behaviors. PMID:25157511

A universal role of the ventral striatum in reward-based learning: Evidence from human studies

PubMed Central

Daniel, Reka; Pollmann, Stefan

2014-01-01

Reinforcement learning enables organisms to adjust their behavior in order to maximize rewards. Electrophysiological recordings of dopaminergic midbrain neurons have shown that they code the difference between actual and predicted rewards, i.e., the reward prediction error, in many species. This error signal is conveyed to both the striatum and cortical areas and is thought to play a central role in learning to optimize behavior. However, in human daily life rewards are diverse and often only indirect feedback is available. Here we explore the range of rewards that are processed by the dopaminergic system in human participants, and examine whether it is also involved in learning in the absence of explicit rewards. While results from electrophysiological recordings in humans are sparse, evidence linking dopaminergic activity to the metabolic signal recorded from the midbrain and striatum with functional magnetic resonance imaging (fMRI) is available. Results from fMRI studies suggest that the human ventral striatum (VS) receives valuation information for a diverse set of rewarding stimuli. These range from simple primary reinforcers such as juice rewards over abstract social rewards to internally generated signals on perceived correctness, suggesting that the VS is involved in learning from trial-and-error irrespective of the specific nature of provided rewards. In addition, we summarize evidence that the VS can also be implicated when learning from observing others, and in tasks that go beyond simple stimulus-action-outcome learning, indicating that the reward system is also recruited in more complex learning tasks. PMID:24825620

From conflict management to reward-based decision making: actors and critics in primate medial frontal cortex.

PubMed

Silvetti, Massimo; Alexander, William; Verguts, Tom; Brown, Joshua W

2014-10-01

The role of the medial prefrontal cortex (mPFC) and especially the anterior cingulate cortex has been the subject of intense debate for the last decade. A number of theories have been proposed to account for its function. Broadly speaking, some emphasize cognitive control, whereas others emphasize value processing; specific theories concern reward processing, conflict detection, error monitoring, and volatility detection, among others. Here we survey and evaluate them relative to experimental results from neurophysiological, anatomical, and cognitive studies. We argue for a new conceptualization of mPFC, arising from recent computational modeling work. Based on reinforcement learning theory, these new models propose that mPFC is an Actor-Critic system. This system is aimed to predict future events including rewards, to evaluate errors in those predictions, and finally, to implement optimal skeletal-motor and visceromotor commands to obtain reward. This framework provides a comprehensive account of mPFC function, accounting for and predicting empirical results across different levels of analysis, including monkey neurophysiology, human ERP, human neuroimaging, and human behavior. Copyright © 2013 Elsevier Ltd. All rights reserved.

Limbic responses to reward cues correlate with antisocial trait density in heavy drinkers.

PubMed

Oberlin, Brandon G; Dzemidzic, Mario; Bragulat, Veronique; Lehigh, Cari A; Talavage, Thomas; O'Connor, Sean J; Kareken, David A

2012-03-01

Antisocial traits are common among alcoholics- particularly in certain subtypes. Although people with antisocial tendencies show atypical brain activation in some emotion and reward paradigms, how the brain reward systems of heavy drinkers (HD) are influenced by antisocial traits remains unclear. We used subjects' preferred alcohol drink odors (AO), appetitive (ApCO) and non-appetitive (NApO) control odors in functional magnetic resonance imaging (fMRI) to determine if reward system responses varied as a function of antisocial trait density (ASD). In this retrospective analysis, we examined 30 HD who had participated in imaging twice: once while exposed to clamped intravenous alcohol infusion targeted to 50mg%, and once during placebo saline infusion. Under placebo, there were positive correlations between ASD and blood oxygenation level dependent (BOLD) activation in the [AO>ApCO] contrast in the left dorsal putamen, while negative correlations were present in medial orbitofrontal cortex (OFC) and the bilateral amygdala. A similar pattern was observed in the correlation with the [AO>NApO] contrast. This inverse relationship between ASD and activation in OFC and amygdala was specific to AO. However, negative correlations between ASD and the [ApCO>NApO] contrast were also present in the insula, putamen, and medial frontal cortex. These data suggest that frontal and limbic reward circuits of those with significant ASD are less responsive to reward cues in general, and particularly to alcohol cues in medial OFC and amygdala. These findings are broadly consistent with the reward deficiency syndrome hypothesis, although positive correlation in the striatum suggests regional variability. Copyright © 2011 Elsevier Inc. All rights reserved.

Reward system dysfunction in autism spectrum disorders

PubMed Central

Schulte-Rüther, Martin; Nehrkorn, Barbara; Müller, Kristin; Fink, Gereon R.; Kamp-Becker, Inge; Herpertz-Dahlmann, Beate; Schultz, Robert T.; Konrad, Kerstin

2013-01-01

Although it has been suggested that social deficits of autism spectrum disorders (ASDs) are related to reward circuitry dysfunction, very little is known about the neural reward mechanisms in ASD. In the current functional magnetic resonance imaging study, we investigated brain activations in response to both social and monetary reward in a group of children with ASD, relative to matched controls. Participants with ASD showed the expected hypoactivation in the mesocorticolimbic circuitry in response to both reward types. In particular, diminished activation in the nucleus accumbens was observed when money, but not when social reward, was at stake, whereas the amygdala and anterior cingulate cortex were hypoactivated within the ASD group in response to both rewards. These data indicate that the reward circuitry is compromised in ASD in social as well as in non-social, i.e. monetary conditions, which likely contributes to atypical motivated behaviour. Taken together, with incentives used in this study sample, there is evidence for a general reward dysfunction in ASD. However, more ecologically valid social reward paradigms are needed to fully understand, whether there is any domain specificity to the reward deficit that appears evident in ASD, which would be most consistent with the ASD social phenotype. PMID:22419119

Adolescent cannabinoid exposure effects on natural reward seeking and learning in rats.

PubMed

Schoch, H; Huerta, M Y; Ruiz, C M; Farrell, M R; Jung, K M; Huang, J J; Campbell, R R; Piomelli, D; Mahler, S V

2018-01-01

Adolescence is characterized by endocannabinoid (ECB)-dependent refinement of neural circuits underlying emotion, learning, and motivation. As a result, adolescent cannabinoid receptor stimulation (ACRS) with phytocannabinoids or synthetic agonists like "Spice" cause robust and persistent changes in both behavior and circuit architecture in rodents, including in reward-related regions like medial prefrontal cortex and nucleus accumbens (NAc). Here, we examine persistent effects of ACRS with the cannabinoid receptor 1/2 specific agonist WIN55-212,2 (WIN; 1.2 mg/kg/day, postnatal day (PD) 30-43), on natural reward-seeking behaviors and ECB system function in adult male Long Evans rats (PD 60+). WIN ACRS increased palatable food intake, and altered attribution of incentive salience to food cues in a sign-/goal-tracking paradigm. ACRS also blunted hunger-induced sucrose intake, and resulted in increased anandamide and oleoylethanolamide levels in NAc after acute food restriction not seen in controls. ACRS did not affect food neophobia or locomotor response to a novel environment, but did increase preference for exploring a novel environment. These results demonstrate that ACRS causes long-term increases in natural reward-seeking behaviors and ECB system function that persist into adulthood, potentially increasing liability to excessive natural reward seeking later in life.

A Genetic Polymorphism of the Endogenous Opioid Dynorphin Modulates Monetary Reward Anticipation in the Corticostriatal Loop

PubMed Central

Votinov, Mikhail; Pripfl, Juergen; Windischberger, Christian; Kalcher, Klaudius; Zimprich, Alexander; Zimprich, Fritz; Moser, Ewald

2014-01-01

The dynorphin/κ-opioid receptor (KOP-R) system has been shown to play a role in different types of behavior regulation, including reward-related behavior and drug craving. It has been shown that alleles with 3 or 4 repeats (HH genotype) of the variable nucleotide tandem repeat (68-bp VNTR) functional polymorphism of the prodynorphin (PDYN) gene are associated with higher levels of dynorphin peptides than alleles with 1 or 2 repeats (LL genotype). We used fMRI on N = 71 prescreened healthy participants to investigate the effect of this polymorphism on cerebral activation in the limbic-corticostriatal loop during reward anticipation. Individuals with the HH genotype showed higher activation than those with the LL genotype in the medial orbitofrontal cortex (mOFC) when anticipating a possible monetary reward. In addition, the HH genotype showed stronger functional coupling (as assessed by effective connectivity analyses) of mOFC with VMPFC, subgenual anterior cingulate cortex, and ventral striatum during reward anticipation. This hints at a larger sensitivity for upcoming rewards in individuals with the HH genotype, resulting in a higher motivation to attain these rewards. These findings provide first evidence in humans that the PDYN polymorphism modulates neural processes associated with the anticipation of rewards, which ultimately may help to explain differences between genotypes with respect to addiction and drug abuse. PMID:24587148

Neural responses to various rewards and feedback in the brains of adolescent Internet addicts detected by functional magnetic resonance imaging.

PubMed

Kim, Ji-Eun; Son, Jung-Woo; Choi, Won-Hee; Kim, Yeoung-Rang; Oh, Jong-Hyun; Lee, Seungbok; Kim, Jang-Kyu

2014-06-01

This study aimed to examine differences in brain activation for various types of reward and feedback in adolescent Internet addicts (AIA) and normal adolescents (NA) using functional magnetic resonance imaging (fMRI). AIA (n = 15) and NA (n = 15) underwent fMRI while performing easy tasks for which performance feedback (PF), social reward (SR) (such as compliments), or monetary reward (MR) was given. Using the no reward (NR) condition, three types of contrasts (PF-NR, SR-NR, and MR-NR) were analyzed. In NA, we observed activation in the reward-related subcortical system, self-related brain region, and other brain areas for the three contrasts, but these brain areas showed almost no activation in AIA. Instead, AIA showed significant activation in the dorsolateral prefrontal cortex for the PF-NR contrast and the negative correlation was found between the level of activation in the left superior temporal gyrus (BA 22) and the duration of Internet game use per day in AIA. These findings suggest that AIA show reduced levels of self-related brain activation and decreased reward sensitivity irrespective of the type of reward and feedback. AIA may be only sensitive to error monitoring regardless of positive feelings, such as sense of satisfaction or achievement. © 2014 The Authors. Psychiatry and Clinical Neurosciences © 2014 Japanese Society of Psychiatry and Neurology.

A genetic polymorphism of the endogenous opioid dynorphin modulates monetary reward anticipation in the corticostriatal loop.

PubMed

Votinov, Mikhail; Pripfl, Juergen; Windischberger, Christian; Kalcher, Klaudius; Zimprich, Alexander; Zimprich, Fritz; Moser, Ewald; Lamm, Claus; Sailer, Uta

2014-01-01

The dynorphin/κ-opioid receptor (KOP-R) system has been shown to play a role in different types of behavior regulation, including reward-related behavior and drug craving. It has been shown that alleles with 3 or 4 repeats (HH genotype) of the variable nucleotide tandem repeat (68-bp VNTR) functional polymorphism of the prodynorphin (PDYN) gene are associated with higher levels of dynorphin peptides than alleles with 1 or 2 repeats (LL genotype). We used fMRI on N = 71 prescreened healthy participants to investigate the effect of this polymorphism on cerebral activation in the limbic-corticostriatal loop during reward anticipation. Individuals with the HH genotype showed higher activation than those with the LL genotype in the medial orbitofrontal cortex (mOFC) when anticipating a possible monetary reward. In addition, the HH genotype showed stronger functional coupling (as assessed by effective connectivity analyses) of mOFC with VMPFC, subgenual anterior cingulate cortex, and ventral striatum during reward anticipation. This hints at a larger sensitivity for upcoming rewards in individuals with the HH genotype, resulting in a higher motivation to attain these rewards. These findings provide first evidence in humans that the PDYN polymorphism modulates neural processes associated with the anticipation of rewards, which ultimately may help to explain differences between genotypes with respect to addiction and drug abuse.

Aerobic exercise modulates anticipatory reward processing via the μ-opioid receptor system.

PubMed

Saanijoki, Tiina; Nummenmaa, Lauri; Tuulari, Jetro J; Tuominen, Lauri; Arponen, Eveliina; Kalliokoski, Kari K; Hirvonen, Jussi

2018-06-08

Physical exercise modulates food reward and helps control body weight. The endogenous µ-opioid receptor (MOR) system is involved in rewarding aspects of both food and physical exercise, yet interaction between endogenous opioid release following exercise and anticipatory food reward remains unresolved. Here we tested whether exercise-induced opioid release correlates with increased anticipatory reward processing in humans. We scanned 24 healthy lean men after rest and after a 1 h session of aerobic exercise with positron emission tomography (PET) using MOR-selective radioligand [ 11 C]carfentanil. After both PET scans, the subjects underwent a functional magnetic resonance imaging (fMRI) experiment where they viewed pictures of palatable versus nonpalatable foods to trigger anticipatory food reward responses. Exercise-induced changes in MOR binding in key regions of reward circuit (amygdala, thalamus, ventral and dorsal striatum, and orbitofrontal and cingulate cortices) were used to predict the changes in anticipatory reward responses in fMRI. Exercise-induced changes in MOR binding correlated negatively with the exercise-induced changes in neural anticipatory food reward responses in orbitofrontal and cingulate cortices, insula, ventral striatum, amygdala, and thalamus: higher exercise-induced opioid release predicted higher brain responses to palatable versus nonpalatable foods. We conclude that MOR activation following exercise may contribute to the considerable interindividual variation in food craving and consumption after exercise, which might promote compensatory eating and compromise weight control. © 2018 Wiley Periodicals, Inc.

Impairments in learning by monetary rewards and alcohol-associated rewards in detoxified alcoholic patients.

PubMed

Jokisch, Daniel; Roser, Patrik; Juckel, Georg; Daum, Irene; Bellebaum, Christian

2014-07-01

Excessive alcohol consumption has been linked to structural and functional brain changes associated with cognitive, emotional, and behavioral impairments. It has been suggested that neural processing in the reward system is also affected by alcoholism. The present study aimed at further investigating reward-based associative learning and reversal learning in detoxified alcohol-dependent patients. Twenty-one detoxified alcohol-dependent patients and 26 healthy control subjects participated in a probabilistic learning task using monetary and alcohol-associated rewards as feedback stimuli indicating correct responses. Performance during acquisition and reversal learning in the different feedback conditions was analyzed. Alcohol-dependent patients and healthy control subjects showed an increase in learning performance over learning blocks during acquisition, with learning performance being significantly lower in alcohol-dependent patients. After changing the contingencies, alcohol-dependent patients exhibited impaired reversal learning and showed, in contrast to healthy controls, different learning curves for different types of rewards with no increase in performance for high monetary and alcohol-associated feedback. The present findings provide evidence that dysfunctional processing in the reward system in alcohol-dependent patients leads to alterations in reward-based learning resulting in a generally reduced performance. In addition, the results suggest that alcohol-dependent patients are, in particular, more impaired in changing an established behavior originally reinforced by high rewards. Copyright © 2014 by the Research Society on Alcoholism.

The role of the dopaminergic projections in MFB self-stimulation.

PubMed

Gallistel, C R

1986-11-01

Psychophysical experiments indicate that the first stage of the reward pathway in medial forebrain bundle self-stimulation consists of small myelinated descending axons. Pharmacological experiments show that neuroleptics attenuate or abolish the rewarding effect. This had led to the hypothesis that the descending myelinated axons synapse on an ascending dopaminergic second stage projection. 2-Deoxy-[14C]glucose autoradiography in self-stimulating animals or animals receiving automatically administered rewarding stimulation after treatment with reward-blocking doses of pimozide reveals activation of a descending myelinated system but no stimulation-produced activation of an ascending dopaminergic projection system, even though the autoradiographic method reveals the mild elevations and depressions of activity in dopaminergic terminal fields consequent upon injections of neuroleptics and amphetamine, respectively, and the strong activation of the nigrostriatal projection produced by stimulating directly in the substantia nigra. When the effects of neuroleptics and clonidine are measured by the psychophysical method (that is, by lateral shifts in the rate-frequency function), it is found that both drugs produce only gradual and rather small attenuations of rewarding efficacy up to doses at which it is no longer possible to measure their effects. It is suggested that, for neuroleptics at least, the rewarding effect abruptly fails at these doses. It is further suggested that these drugs do not act on the rewarding pathway itself, but on the process by which the rewarding signal is converted to an enduring rewarding effect.

The role of the dopaminergic projections in MFB self-stimulation.

PubMed

Gallistel, C R

1986-06-01

Psychophysical experiments indicate that the first stage of the reward pathway in medial forebrain bundle self-stimulation consists of small myelinated descending axons. Pharmacological experiments show that neuroleptics attenuate or abolish the rewarding effect. This had led to the hypothesis that the descending myelinated axons synapse on an ascending dopaminergic second stage projection. 2-Deoxy-[14C]glucose autoradiography in self-stimulating animals or animals receiving automatically administered rewarding stimulation after treatment with reward-blocking doses of pimozide reveals activation of a descending myelinated system but no stimulation-produced activation of an ascending dopaminergic projection system, even though the autoradiographic method reveals the mild elevations and depressions of activity in dopaminergic terminal fields consequent upon injections of neuroleptics and amphetamine, respectively, and the strong activation of the nigrostriatal projection produced by stimulating directly in the substantia nigra. When the effects of neuroleptics and clonidine are measured by the psychophysical method (that is, by lateral shifts in the rate-frequency function), it is found that both drugs produce only gradual and rather small attenuations of rewarding efficacy up to doses at which it is no longer possible to measure their effects. It is suggested that, for neuroleptics at least, the rewarding effect abruptly fails at these doses. It is further suggested that these drugs do not act on the rewarding pathway itself, but on the process by which the rewarding signal is converted to an enduring rewarding effect.

Dopamine Depletion Reduces Food-Related Reward Activity Independent of BMI

PubMed Central

Frank, Sabine; Veit, Ralf; Sauer, Helene; Enck, Paul; Friederich, Hans-Christoph; Unholzer, Theresa; Bauer, Ute-Maria; Linder, Katarzyna; Heni, Martin; Fritsche, Andreas; Preissl, Hubert

2016-01-01

Reward sensitivity and possible alterations in the dopaminergic-reward system are associated with obesity. We therefore aimed to investigate the influence of dopamine depletion on food-reward processing. We investigated 34 female subjects in a randomized placebo-controlled, within-subject design (body mass index (BMI)=27.0 kg/m2 ±4.79 SD; age=28 years ±4.97 SD) using an acute phenylalanine/tyrosine depletion drink representing dopamine depletion and a balanced amino acid drink as the control condition. Brain activity was measured with functional magnetic resonance imaging during a ‘wanting' and ‘liking' rating of food items. Eating behavior-related traits and states were assessed on the basis of questionnaires. Dopamine depletion resulted in reduced activation in the striatum and higher activation in the superior frontal gyrus independent of BMI. Brain activity during the wanting task activated a more distributed network than during the liking task. This network included gustatory, memory, visual, reward, and frontal regions. An interaction effect of dopamine depletion and the wanting/liking task was observed in the hippocampus. The interaction with the covariate BMI was significant in motor and control regions but not in the striatum. Our results support the notion of altered brain activity in the reward and prefrontal network with blunted dopaminergic action during food-reward processing. This effect is, however, independent of BMI, which contradicts the reward-deficiency hypothesis. This hints to the hypothesis suggesting a different or more complex mechanism underlying the dopaminergic reward function in obesity. PMID:26450814

The effects of HIV-1 regulatory TAT protein expression on brain reward function, response to psychostimulants and delay-dependent memory in mice.

PubMed

Kesby, James P; Markou, Athina; Semenova, Svetlana

2016-10-01

Depression and psychostimulant abuse are common comorbidities among humans with immunodeficiency virus (HIV) disease. The HIV regulatory protein TAT is one of multiple HIV-related proteins associated with HIV-induced neurotoxicity. TAT-induced dysfunction of dopamine and serotonin systems in corticolimbic brain areas may result in impaired reward function, thus, contributing to depressive symptoms and psychostimulant abuse. Transgenic mice with doxycycline-induced TAT protein expression in the brain (TAT+, TAT- control) show neuropathology resembling brain abnormalities in HIV+ humans. We evaluated brain reward function in response to TAT expression, nicotine and methamphetamine administration in TAT+ and TAT- mice using the intracranial self-stimulation procedure. We evaluated the brain dopamine and serotonin systems with high-performance liquid chromatography. The effects of TAT expression on delay-dependent working memory in TAT+ and TAT- mice using the operant delayed nonmatch-to-position task were also assessed. During doxycycline administration, reward thresholds were elevated by 20% in TAT+ mice compared with TAT- mice. After the termination of doxycycline treatment, thresholds of TAT+ mice remained significantly higher than those of TAT- mice and this was associated with changes in mesolimbic serotonin and dopamine levels. TAT+ mice showed a greater methamphetamine-induced threshold lowering compared with TAT- mice. TAT expression did not alter delay-dependent working memory. These results indicate that TAT expression in mice leads to reward deficits, a core symptom of depression, and a greater sensitivity to methamphetamine-induced reward enhancement. Our findings suggest that the TAT protein may contribute to increased depressive-like symptoms and continued methamphetamine use in HIV-positive individuals. Copyright © 2016 Elsevier Ltd. All rights reserved.

Theoretical Frameworks and Mechanistic Aspects of Alcohol Addiction: Alcohol Addiction as a Reward Deficit Disorder

PubMed Central

2012-01-01

Alcoholism can be defined by a compulsion to seek and take drug, loss of control in limiting intake, and the emergence of a negative emotional state when access to the drug is prevented. Alcoholism impacts multiple motivational mechanisms and can be conceptualized as a disorder that includes a progression from impulsivity (positive reinforcement) to compulsivity (negative reinforcement). The compulsive drug seeking associated with alcoholism can be derived from multiple neuroadaptations, but the thesis argued here is that a key component involves the construct of negative reinforcement. Negative reinforcement is defined as drug taking that alleviates a negative emotional state. The negative emotional state that drives such negative reinforcement is hypothesized to derive from dysregulation of specific neurochemical elements involved in reward and stress within the basal forebrain structures involving the ventral striatum and extended amygdala, respectively. Specific neurochemical elements in these structures include not only decreases in reward neurotransmission, such as decreased dopamine and γ-aminobutyric acid function in the ventral striatum, but also recruitment of brain stress systems, such as corticotropin-releasing factor (CRF), in the extended amygdala. Acute withdrawal from chronic alcohol, sufficient to produce dependence, increases reward thresholds, increases anxiety-like responses, decreases dopamine system function, and increases extracellular levels of CRF in the central nucleus of the amygdala. CRF receptor antagonists also block excessive drug intake produced by dependence. A brain stress response system is hypothesized to be activated by acute excessive drug intake, to be sensitized during repeated withdrawal, to persist into protracted abstinence, and to contribute to the compulsivity of alcoholism. Other components of brain stress systems in the extended amygdala that interact with CRF and that may contribute to the negative motivational state of withdrawal include norepinephrine, dynorphin, and neuropeptide Y. The combination of loss of reward function and recruitment of brain stress systems provides a powerful neurochemical basis for a negative emotional state that is responsible for the negative reinforcement driving, at least partially, the compulsivity of alcoholism. PMID:21744309

Convergent dysregulation of frontal cortical cognitive and reward systems in eating disorders.

PubMed

Stefano, George B; Ptáček, Radek; Kuželová, Hana; Mantione, Kirk J; Raboch, Jiří; Papezova, Hana; Kream, Richard M

2013-05-10

A substantive literature has drawn a compelling case for the functional involvement of mesolimbic/prefrontal cortical neural reward systems in normative control of eating and in the etiology and persistence of severe eating disorders that affect diverse human populations. Presently, we provide a short review that develops an equally compelling case for the importance of dysregulated frontal cortical cognitive neural networks acting in concert with regional reward systems in the regulation of complex eating behaviors and in the presentation of complex pathophysiological symptoms associated with major eating disorders. Our goal is to highlight working models of major eating disorders that incorporate complementary approaches to elucidate functionally interactive neural circuits defined by their regulatory neurochemical phenotypes. Importantly, we also review evidence-based linkages between widely studied psychiatric and neurodegenerative syndromes (e.g., autism spectrum disorders and Parkinson's disease) and co-morbid eating disorders to elucidate basic mechanisms involving dopaminergic transmission and its regulation by endogenously expressed morphine in these same cortical regions.

Dopamine prediction errors in reward learning and addiction: from theory to neural circuitry

PubMed Central

Keiflin, Ronald; Janak, Patricia H.

2015-01-01

Summary Midbrain dopamine (DA) neurons are proposed to signal reward prediction error (RPE), a fundamental parameter in associative learning models. This RPE hypothesis provides a compelling theoretical framework for understanding DA function in reward learning and addiction. New studies support a causal role for DA-mediated RPE activity in promoting learning about natural reward; however, this question has not been explicitly tested in the context of drug addiction. In this review, we integrate theoretical models with experimental findings on the activity of DA systems, and on the causal role of specific neuronal projections and cell types, to provide a circuit-based framework for probing DA-RPE function in addiction. By examining error-encoding DA neurons in the neural network in which they are embedded, hypotheses regarding circuit-level adaptations that possibly contribute to pathological error-signaling and addiction can be formulated and tested. PMID:26494275

How motivation and reward learning modulate selective attention.

PubMed

Bourgeois, A; Chelazzi, L; Vuilleumier, P

2016-01-01

Motivational stimuli such as rewards elicit adaptive responses and influence various cognitive functions. Notably, increasing evidence suggests that stimuli with particular motivational values can strongly shape perception and attention. These effects resemble both selective top-down and stimulus-driven attentional orienting, as they depend on internal states but arise without conscious will, yet they seem to reflect attentional systems that are functionally and anatomically distinct from those classically associated with frontoparietal cortical networks in the brain. Recent research in human and nonhuman primates has begun to reveal how reward can bias attentional selection, and where within the cognitive system the signals providing attentional priority are generated. This review aims at describing the different mechanisms sustaining motivational attention, their impact on different behavioral tasks, and current knowledge concerning the neural networks governing the integration of motivational influences on attentional behavior. © 2016 Elsevier B.V. All rights reserved.

Viewing pictures of a romantic partner reduces experimental pain: involvement of neural reward systems.

PubMed

Younger, Jarred; Aron, Arthur; Parke, Sara; Chatterjee, Neil; Mackey, Sean

2010-10-13

The early stages of a new romantic relationship are characterized by intense feelings of euphoria, well-being, and preoccupation with the romantic partner. Neuroimaging research has linked those feelings to activation of reward systems in the human brain. The results of those studies may be relevant to pain management in humans, as basic animal research has shown that pharmacologic activation of reward systems can substantially reduce pain. Indeed, viewing pictures of a romantic partner was recently demonstrated to reduce experimental thermal pain. We hypothesized that pain relief evoked by viewing pictures of a romantic partner would be associated with neural activations in reward-processing centers. In this functional magnetic resonance imaging (fMRI) study, we examined fifteen individuals in the first nine months of a new, romantic relationship. Participants completed three tasks under periods of moderate and high thermal pain: 1) viewing pictures of their romantic partner, 2) viewing pictures of an equally attractive and familiar acquaintance, and 3) a word-association distraction task previously demonstrated to reduce pain. The partner and distraction tasks both significantly reduced self-reported pain, although only the partner task was associated with activation of reward systems. Greater analgesia while viewing pictures of a romantic partner was associated with increased activity in several reward-processing regions, including the caudate head, nucleus accumbens, lateral orbitofrontal cortex, amygdala, and dorsolateral prefrontal cortex--regions not associated with distraction-induced analgesia. The results suggest that the activation of neural reward systems via non-pharmacologic means can reduce the experience of pain.

Cannabinoid transmission in the prelimbic cortex bidirectionally controls opiate reward and aversion signaling through dissociable kappa versus μ-opiate receptor dependent mechanisms.

PubMed

Ahmad, Tasha; Lauzon, Nicole M; de Jaeger, Xavier; Laviolette, Steven R

2013-09-25

Cannabinoid, dopamine (DA), and opiate receptor pathways play integrative roles in emotional learning, associative memory, and sensory perception. Modulation of cannabinoid CB1 receptor transmission within the medial prefrontal cortex (mPFC) regulates the emotional valence of both rewarding and aversive experiences. Furthermore, CB1 receptor substrates functionally interact with opiate-related motivational processing circuits, particularly in the context of reward-related learning and memory. Considerable evidence demonstrates functional interactions between CB1 and DA signaling pathways during the processing of motivationally salient information. However, the role of mPFC CB1 receptor transmission in the modulation of behavioral opiate-reward processing is not currently known. Using an unbiased conditioned place preference paradigm with rats, we examined the role of intra-mPFC CB1 transmission during opiate reward learning. We report that activation or inhibition of CB1 transmission within the prelimbic cortical (PLC) division of the mPFC bidirectionally regulates the motivational valence of opiates; whereas CB1 activation switched morphine reward signaling into an aversive stimulus, blockade of CB1 transmission potentiated the rewarding properties of normally sub-reward threshold conditioning doses of morphine. Both of these effects were dependent upon DA transmission as systemic blockade of DAergic transmission prevented CB1-dependent modulation of morphine reward and aversion behaviors. We further report that CB1-mediated intra-PLC opiate motivational signaling is mediated through a μ-opiate receptor-dependent reward pathway, or a κ-opiate receptor-dependent aversion pathway, directly within the ventral tegmental area. Our results provide evidence for a novel CB1-mediated motivational valence switching mechanism within the PLC, controlling dissociable subcortical reward and aversion pathways.

Striatal response to reward anticipation: evidence for a systems-level intermediate phenotype for schizophrenia.

PubMed

Grimm, Oliver; Heinz, Andreas; Walter, Henrik; Kirsch, Peter; Erk, Susanne; Haddad, Leila; Plichta, Michael M; Romanczuk-Seiferth, Nina; Pöhland, Lydia; Mohnke, Sebastian; Mühleisen, Thomas W; Mattheisen, Manuel; Witt, Stephanie H; Schäfer, Axel; Cichon, Sven; Nöthen, Markus; Rietschel, Marcella; Tost, Heike; Meyer-Lindenberg, Andreas

2014-05-01

Attenuated ventral striatal response during reward anticipation is a core feature of schizophrenia that is seen in prodromal, drug-naive, and chronic schizophrenic patients. Schizophrenia is highly heritable, raising the possibility that this phenotype is related to the genetic risk for the disorder. To examine a large sample of healthy first-degree relatives of schizophrenic patients and compare their neural responses to reward anticipation with those of carefully matched controls without a family psychiatric history. To further support the utility of this phenotype, we studied its test-retest reliability, its potential brain structural contributions, and the effects of a protective missense variant in neuregulin 1 (NRG1) linked to schizophrenia by meta-analysis (ie, rs10503929). Examination of a well-established monetary reward anticipation paradigm during functional magnetic resonance imaging at a university hospital; voxel-based morphometry; test-retest reliability analysis of striatal activations in an independent sample of 25 healthy participants scanned twice with the same task; and imaging genetics analysis of the control group. A total of 54 healthy first-degree relatives of schizophrenic patients and 80 controls matched for demographic, psychological, clinical, and task performance characteristics were studied. Blood oxygen level-dependent response during reward anticipation, analysis of intraclass correlations of functional contrasts, and associations between striatal gray matter volume and NRG1 genotype. Compared with controls, healthy first-degree relatives showed a highly significant decrease in ventral striatal activation during reward anticipation (familywise error-corrected P < .03 for multiple comparisons across the whole brain). Supplemental analyses confirmed that the identified systems-level functional phenotype is reliable (with intraclass correlation coefficients of 0.59-0.73), independent of local gray matter volume (with no corresponding group differences and no correlation to function, and with all uncorrected P values >.05), and affected by the NRG1 genotype (higher striatal responses in controls with the protective rs10503929 C allele; familywise error-corrected P < .03 for ventral striatal response). Healthy first-degree relatives of schizophrenic patients show altered striatal activation during reward anticipation in a directionality and localization consistent with prior patient findings. This provides evidence for a functional neural system mechanism related to familial risk. The phenotype can be assessed reliably, is independent of alterations in striatal structure, and is influenced by a schizophrenia candidate gene variant in NRG1. These data encourage us to further investigate the genetic and molecular contributions to this phenotype.

Cannabinoid modulation of drug reward and the implications of marijuana legalization.

PubMed

Covey, Dan P; Wenzel, Jennifer M; Cheer, Joseph F

2015-12-02

Marijuana is the most popular illegal drug worldwide. Recent trends indicate that this may soon change; not due to decreased marijuana use, but to an amendment in marijuana's illegal status. The cannabinoid type 1 (CB1) receptor mediates marijuana's psychoactive and reinforcing properties. CB1 receptors are also part of the brain endocannabinoid (eCB) system and support numerous forms of learning and memory, including the conditioned reinforcing properties of cues predicting reward or punishment. This is accomplished via eCB-dependent alterations in mesolimbic dopamine function, which plays an obligatory role in reward learning and motivation. Presynaptic CB1 receptors control midbrain dopamine neuron activity and thereby shape phasic dopamine release in target regions, particularly the nucleus accumbens (NAc). By also regulating synaptic input to the NAc, CB1 receptors modulate NAc output onto downstream neurons of the basal ganglia motor circuit, and thereby support goal-directed behaviors. Abused drugs promote short- and long-term adaptations in eCB-regulation of mesolimbic dopamine function, and thereby hijack neural systems related to the pursuit of rewards to promote drug abuse. By pharmacologically targeting the CB1 receptors, marijuana has preferential access to this neuronal system and can potently alter eCB-dependent processing of reward-related stimuli. As marijuana legalization progresses, greater access to this drug should increase the utility of marijuana as a research tool to better understand the eCB system, which has the potential to advance cannabinoid-based treatments for drug addiction. Copyright © 2014 Elsevier B.V. All rights reserved.

Rash impulsiveness and reward sensitivity in relation to risky drinking by university students: potential roles of frontal systems.

PubMed

Lyvers, Michael; Duff, Helen; Basch, Vanessa; Edwards, Mark S

2012-08-01

Two forms of impulsivity, rash impulsiveness and reward sensitivity, have been proposed to reflect aspects of frontal lobe functioning and promote substance use. The present study examined these two forms of impulsivity as well as frontal lobe symptoms in relation to risky drinking by university students. University undergraduates aged 18-26years completed the Alcohol Use Disorders Identification Test (AUDIT), Barratt Impulsiveness Scale (BIS-11), Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ), Frontal Systems Behavior Scale (FrSBe), and a demographics questionnaire assessing age, gender, and age of onset of weekly drinking (AOD). AUDIT-defined harmful drinkers reported earlier AOD and scored higher on BIS-11, the Sensitivity to Reward (SR) scale of the SPSRQ, and the Disinhibition and Executive Dysfunction scales of the FrSBe compared to lower risk groups. Differences remained significant after controlling for duration of alcohol exposure. Path analyses indicated that the influence of SR on AUDIT was mediated by FrSBe Disinhibition, whereas the influence of BIS-11 on AUDIT was mediated by both Disinhibition and Executive Dysfunction scales of the FrSBe. Findings tentatively suggest that the influence of rash impulsiveness on drinking may reflect dysfunction in dorsolateral prefrontal and orbitofrontal systems, whereas the influence of reward sensitivity on drinking may primarily reflect orbitofrontal dysfunction. Irrespective of the underlying functional brain systems involved, results appear to be more consistent with a pre-drinking trait interpretation than effects of alcohol exposure. Copyright © 2012 Elsevier Ltd. All rights reserved.

Serotonergic antidepressants decrease hedonic signals but leave learning signals in the nucleus accumbens unaffected.

PubMed

Graf, Heiko; Metzger, Coraline D; Walter, Martin; Abler, Birgit

2016-01-06

Investigating the effects of serotonergic antidepressants on neural correlates of visual erotic stimulation revealed decreased reactivity within the dopaminergic reward network along with decreased subjective sexual functioning compared with placebo. However, a global dampening of the reward system under serotonergic drugs is not intuitive considering clinical observations of their beneficial effects in the treatment of depression. Particularly, learning signals as coded in prediction error processing within the dopaminergic reward system can be assumed to be rather enhanced as antidepressant drugs have been demonstrated to facilitate the efficacy of psychotherapeutic interventions relying on learning processes. Within the same study sample, we now explored the effects of serotonergic and dopaminergic/noradrenergic antidepressants on prediction error signals compared with placebo by functional MRI. A total of 17 healthy male participants (mean age: 25.4 years) were investigated under the administration of paroxetine, bupropion and placebo for 7 days each within a randomized, double-blind, within-subject cross-over design. During functional MRI, we used an established monetary incentive task to explore neural prediction error signals within the bilateral nucleus accumbens as region of interest within the dopaminergic reward system. In contrast to diminished neural activations and subjective sexual functioning under the serotonergic agent paroxetine under visual erotic stimulation, we revealed unaffected or even enhanced neural prediction error processing within the nucleus accumbens under this antidepressant along with unaffected behavioural processing. Our study provides evidence that serotonergic antidepressants facilitate prediction error signalling and may support suggestions of beneficial effects of these agents on reinforced learning as an essential element in behavioural psychotherapy.

Antireward, compulsivity, and addiction: seminal contributions of Dr. Athina Markou to motivational dysregulation in addiction.

PubMed

Koob, George F

2017-05-01

Addiction is defined as a chronically relapsing disorder characterized by compulsive drug seeking that is hypothesized to derive from multiple sources of motivational dysregulation. Dr. Athina Markou made seminal contributions to our understanding of the neurobiology of addiction with her studies on the dysregulation of reward function using animal models with construct validity. Repeated overstimulation of the reward systems with drugs of abuse decreases reward function, characterized by brain stimulation reward and presumbably reflecting dysphoria-like states. The construct of negative reinforcement, defined as drug taking that alleviates a negative emotional state that is created by drug abstinence, is particularly relevant as a driving force in both the withdrawal/negative affect and preoccupation/anticipation stages of the addiction cycle. The negative emotional state that drives such negative reinforcement is hypothesized to derive from the dysregulation of key neurochemical circuits that drive incentive-salience/reward systems (dopamine, opioid peptides) in the ventral striatum and from the recruitment of brain stress systems (corticotropin-releasing factor, dynorphin) within the extended amygdala. As drug taking becomes compulsive-like, the factors that motivate behavior are hypothesized to shift to drug-seeking behavior that is driven not only by positive reinforcement but also by negative reinforcement. This shift in motivation is hypothesized to reflect the allostatic misregulation of hedonic tone such that drug taking makes the hedonic negative emotional state worse during the process of seeking temporary relief with compulsive drug taking.

Functional requirements for reward-modulated spike-timing-dependent plasticity.

PubMed

Frémaux, Nicolas; Sprekeler, Henning; Gerstner, Wulfram

2010-10-06

Recent experiments have shown that spike-timing-dependent plasticity is influenced by neuromodulation. We derive theoretical conditions for successful learning of reward-related behavior for a large class of learning rules where Hebbian synaptic plasticity is conditioned on a global modulatory factor signaling reward. We show that all learning rules in this class can be separated into a term that captures the covariance of neuronal firing and reward and a second term that presents the influence of unsupervised learning. The unsupervised term, which is, in general, detrimental for reward-based learning, can be suppressed if the neuromodulatory signal encodes the difference between the reward and the expected reward-but only if the expected reward is calculated for each task and stimulus separately. If several tasks are to be learned simultaneously, the nervous system needs an internal critic that is able to predict the expected reward for arbitrary stimuli. We show that, with a critic, reward-modulated spike-timing-dependent plasticity is capable of learning motor trajectories with a temporal resolution of tens of milliseconds. The relation to temporal difference learning, the relevance of block-based learning paradigms, and the limitations of learning with a critic are discussed.

Pervasive competition between threat and reward in the brain

PubMed Central

Choi, Jong Moon; Padmala, Srikanth; Spechler, Philip

2014-01-01

In the current functional MRI study, we investigated interactions between reward and threat processing. Visual cues at the start of each trial informed participants about the chance of winning monetary reward and/or receiving a mild aversive shock. We tested two competing hypothesis: according to the ‘salience hypothesis’, in the condition involving both reward and threat, enhanced activation would be observed because of increased salience; according to the ‘competition hypothesis’, the processing of reward and threat would trade-off against each other, leading to reduced activation. Analysis of skin conductance data during a delay phase revealed an interaction between reward and threat processing, such that the effect of reward was reduced during threat and the effect of threat was reduced during reward. Analysis of imaging data during the same task phase revealed interactions between reward and threat processing in several regions, including the midbrain/ventral tegmental area, caudate, putamen, bed nucleus of the stria terminalis, anterior insula, middle frontal gyrus and dorsal anterior cingulate cortex. Taken together, our findings reveal conditions during which reward and threat trade-off against each other across multiple sites. Such interactions are suggestive of competitive processes and may reflect the organization of opponent systems in the brain. PMID:23547242

An Upside to Reward Sensitivity: The Hippocampus Supports Enhanced Reinforcement Learning in Adolescence.

PubMed

Davidow, Juliet Y; Foerde, Karin; Galván, Adriana; Shohamy, Daphna

2016-10-05

Adolescents are notorious for engaging in reward-seeking behaviors, a tendency attributed to heightened activity in the brain's reward systems during adolescence. It has been suggested that reward sensitivity in adolescence might be adaptive, but evidence of an adaptive role has been scarce. Using a probabilistic reinforcement learning task combined with reinforcement learning models and fMRI, we found that adolescents showed better reinforcement learning and a stronger link between reinforcement learning and episodic memory for rewarding outcomes. This behavioral benefit was related to heightened prediction error-related BOLD activity in the hippocampus and to stronger functional connectivity between the hippocampus and the striatum at the time of reinforcement. These findings reveal an important role for the hippocampus in reinforcement learning in adolescence and suggest that reward sensitivity in adolescence is related to adaptive differences in how adolescents learn from experience. Copyright © 2016 Elsevier Inc. All rights reserved.

Quality management of human resources. Providers should begin by focusing on education, performance management, and reward systems.

PubMed

Blair, C S; Fordyce, M; Barney, S M

1993-10-01

For a quality management transformation to occur, a healthcare organization must focus on education and development, performance management, and recognition and reward systems during the first years of implementation. Education and development are perhaps the most important human resource management functions when implementing quality management principles and processes because behavioral changes will be required at all organizational levels. Specific programs that support an organization's quality management effort will vary but should include the conceptual, cultural, and technical aspects of quality management. The essence of quality management is to always satisfy the customer and to continuously improve the services and products the organization offers. The approach to performance management should therefore rely on customer feedback and satisfaction. An organization committed to quality management should base its performance management approach on customer orientation, process improvement, employee involvement, decision making with data, and continuous improvement. Managers and trustees are being challenged to provide innovative recognition and reward systems that reinforce the values and behaviors consistent with quality management. Such systems must also be aligned with the behaviors and outcomes that support the philosophy, mission, and values of the Catholic healthcare ministry. The following components should be considered for a recognition and reward system: base pay, incentives, benefits, and nonmonetary rewards.

Increased frequency of social interaction is associated with enjoyment enhancement and reward system activation

PubMed Central

Kawamichi, Hiroaki; Sugawara, Sho K.; Hamano, Yuki H.; Makita, Kai; Kochiyama, Takanori; Sadato, Norihiro

2016-01-01

Positive social interactions contribute to the sense that one’s life has meaning. Enjoyment of feelings associated through social interaction motivates humans to build social connections according to their personal preferences. Therefore, we hypothesized that social interaction itself activates the reward system in a manner that depends upon individual interaction preferences. To test this hypothesis, we conducted a functional magnetic resonance imaging (fMRI) study in which 38 participants played a virtual ball-toss game in which the number of ball tosses to the participant was either similar to (normal-frequency condition) or higher than (high-frequency condition) the number of tosses to the other players. Participants reported greater-than-anticipated enjoyment during the high-frequency condition, suggesting that receiving a social reward led to unexpected positive feelings. Consistent with this, the high-frequency condition produced stronger activation in the ventral striatum, which is part of the reward system, and the precuneus, representing positive self-image, which might be translated to social reward. Furthermore, ventral striatal activation covaried with individual participants’ preference for interactions with others. These findings suggest that an elevated frequency of social interaction is represented as a social reward, which might motivate individuals to promote social interaction in a manner that is modulated by personal preference. PMID:27090501

Increased frequency of social interaction is associated with enjoyment enhancement and reward system activation.

PubMed

Kawamichi, Hiroaki; Sugawara, Sho K; Hamano, Yuki H; Makita, Kai; Kochiyama, Takanori; Sadato, Norihiro

2016-04-19

Positive social interactions contribute to the sense that one's life has meaning. Enjoyment of feelings associated through social interaction motivates humans to build social connections according to their personal preferences. Therefore, we hypothesized that social interaction itself activates the reward system in a manner that depends upon individual interaction preferences. To test this hypothesis, we conducted a functional magnetic resonance imaging (fMRI) study in which 38 participants played a virtual ball-toss game in which the number of ball tosses to the participant was either similar to (normal-frequency condition) or higher than (high-frequency condition) the number of tosses to the other players. Participants reported greater-than-anticipated enjoyment during the high-frequency condition, suggesting that receiving a social reward led to unexpected positive feelings. Consistent with this, the high-frequency condition produced stronger activation in the ventral striatum, which is part of the reward system, and the precuneus, representing positive self-image, which might be translated to social reward. Furthermore, ventral striatal activation covaried with individual participants' preference for interactions with others. These findings suggest that an elevated frequency of social interaction is represented as a social reward, which might motivate individuals to promote social interaction in a manner that is modulated by personal preference.

Reward for food odors: an fMRI study of liking and wanting as a function of metabolic state and BMI.

PubMed

Jiang, Tao; Soussignan, Robert; Schaal, Benoist; Royet, Jean-Pierre

2015-04-01

Brain reward systems mediate liking and wanting for food reward. Here, we explore the differential involvement of the following structures for these two components: the ventral and dorsal striatopallidal area, orbitofrontal cortex (OFC), anterior insula and anterior cingulate. Twelve healthy female participants were asked to rate pleasantness (liking of food and non-food odors) and the desire to eat (wanting of odor-evoked food) during event-related functional magnetic resonance imaging (fMRI). The subjective ratings and fMRI were performed in hunger and satiety states. Activations of regions of interest were compared as a function of task (liking vs wanting), odor category (food vs non-food) and metabolic state (hunger vs satiety). We found that the nucleus accumbens and ventral pallidum were differentially involved in liking or wanting during the hunger state, which suggests a reciprocal inhibitory influence between these structures. Neural activation of OFC subregions was correlated with either liking or wanting ratings, suggesting an OFC role in reward processing magnitude. Finally, during the hunger state, participants with a high body mass index exhibited less activation in neural structures underlying food reward processing. Our results suggest that food liking and wanting are two separable psychological constructs and may be functionally segregated within the cortico-striatopallidal circuit. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Cannabinoid Regulation of Brain Reward Processing with an Emphasis on the Role of CB1 Receptors: A Step Back into the Future.

PubMed

Panagis, George; Mackey, Brian; Vlachou, Styliani

2014-01-01

Over the last decades, the endocannabinoid system has been implicated in a large variety of functions, including a crucial modulation of brain-reward circuits and the regulation of motivational processes. Importantly, behavioral studies have shown that cannabinoid compounds activate brain reward mechanisms and circuits in a similar manner to other drugs of abuse, such as nicotine, alcohol, cocaine, and heroin, although the conditions under which cannabinoids exert their rewarding effects may be more limited. Furthermore, there is evidence on the involvement of the endocannabinoid system in the regulation of cue- and drug-induced relapsing phenomena in animal models. The aim of this review is to briefly present the available data obtained using diverse behavioral experimental approaches in experimental animals, namely, the intracranial self-stimulation paradigm, the self-administration procedure, the conditioned place preference procedure, and the reinstatement of drug-seeking behavior procedure, to provide a comprehensive picture of the current status of what is known about the endocannabinoid system mechanisms that underlie modification of brain-reward processes. Emphasis is placed on the effects of cannabinoid 1 (CB1) receptor agonists, antagonists, and endocannabinoid modulators. Further, the role of CB1 receptors in reward processes is investigated through presentation of respective genetic ablation studies in mice. The vast majority of studies in the existing literature suggest that the endocannabinoid system plays a major role in modulating motivation and reward processes. However, much remains to be done before we fully understand these interactions. Further research in the future will shed more light on these processes and, thus, could lead to the development of potential pharmacotherapies designed to treat reward-dysfunction-related disorders.

Subliminal and supraliminal processing of reward-related stimuli in anorexia nervosa.

PubMed

Boehm, I; King, J A; Bernardoni, F; Geisler, D; Seidel, M; Ritschel, F; Goschke, T; Haynes, J-D; Roessner, V; Ehrlich, S

2018-04-01

Previous studies have highlighted the role of the brain reward and cognitive control systems in the etiology of anorexia nervosa (AN). In an attempt to disentangle the relative contribution of these systems to the disorder, we used functional magnetic resonance imaging (fMRI) to investigate hemodynamic responses to reward-related stimuli presented both subliminally and supraliminally in acutely underweight AN patients and age-matched healthy controls (HC). fMRI data were collected from a total of 35 AN patients and 35 HC, while they passively viewed subliminally and supraliminally presented streams of food, positive social, and neutral stimuli. Activation patterns of the group × stimulation condition × stimulus type interaction were interrogated to investigate potential group differences in processing different stimulus types under the two stimulation conditions. Moreover, changes in functional connectivity were investigated using generalized psychophysiological interaction analysis. AN patients showed a generally increased response to supraliminally presented stimuli in the inferior frontal junction (IFJ), but no alterations within the reward system. Increased activation during supraliminal stimulation with food stimuli was observed in the AN group in visual regions including superior occipital gyrus and the fusiform gyrus/parahippocampal gyrus. No group difference was found with respect to the subliminal stimulation condition and functional connectivity. Increased IFJ activation in AN during supraliminal stimulation may indicate hyperactive cognitive control, which resonates with clinical presentation of excessive self-control in AN patients. Increased activation to food stimuli in visual regions may be interpreted in light of an attentional food bias in AN.

Link Between Increased Satiety Gut Hormones and Reduced Food Reward After Gastric Bypass Surgery for Obesity.

PubMed

Goldstone, Anthony P; Miras, Alexander D; Scholtz, Samantha; Jackson, Sabrina; Neff, Karl J; Pénicaud, Luc; Geoghegan, Justin; Chhina, Navpreet; Durighel, Giuliana; Bell, Jimmy D; Meillon, Sophie; le Roux, Carel W

2016-02-01

Roux-en-Y gastric bypass (RYGB) surgery is an effective long-term intervention for weight loss maintenance, reducing appetite, and also food reward, via unclear mechanisms. To investigate the role of elevated satiety gut hormones after RYGB, we examined food hedonic-reward responses after their acute post-prandial suppression. These were randomized, placebo-controlled, double-blind, crossover experimental medicine studies. Two groups, more than 5 months after RYGB for obesity (n = 7-11), compared with nonobese controls (n = 10), or patients after gastric banding (BAND) surgery (n = 9) participated in the studies. Studies were performed after acute administration of the somatostatin analog octreotide or saline. In one study, patients after RYGB, and nonobese controls, performed a behavioral progressive ratio task for chocolate sweets. In another study, patients after RYGB, and controls after BAND surgery, performed a functional magnetic resonance imaging food picture evaluation task. Octreotide increased both appetitive food reward (breakpoint) in the progressive ratio task (n = 9), and food appeal (n = 9) and reward system blood oxygen level-dependent signal (n = 7) in the functional magnetic resonance imaging task, in the RYGB group, but not in the control groups. Octreotide suppressed postprandial plasma peptide YY, glucagon-like peptide-1, and fibroblast growth factor-19 after RYGB. The reduction in plasma peptide YY with octreotide positively correlated with the increase in brain reward system blood oxygen level-dependent signal in RYGB/BAND subjects, with a similar trend for glucagon-like peptide-1. Enhanced satiety gut hormone responses after RYGB may be a causative mechanism by which anatomical alterations of the gut in obesity surgery modify behavioral and brain reward responses to food.

The role of orgasm in the development and shaping of partner preferences.

PubMed

Coria-Avila, Genaro A; Herrera-Covarrubias, Deissy; Ismail, Nafissa; Pfaus, James G

2016-01-01

The effect of orgasm on the development and shaping of partner preferences may involve a catalysis of the neurochemical mechanisms of bonding. Therefore, understanding such process is relevant for neuroscience and psychology. A systematic review was carried out using the terms Orgasm, Sexual Reward, Partner Preference, Pair Bonding, Brain, Learning, Sex, Copulation. In humans, concentrations of arousing neurotransmitters and potential bonding neurotransmitters increase during orgasm in the cerebrospinal fluid and the bloodstream. Similarly, studies in animals indicate that those neurotransmitters (noradrenaline, oxytocin, prolactin) and others (e.g. dopamine, opioids, serotonin) modulate the appetitive and consummatory phases of sexual behavior and reward. This suggests a link between the experience of orgasm/sexual reward and the neurochemical mechanisms of pair bonding. Orgasm/reward functions as an unconditioned stimulus (UCS). Some areas in the nervous system function as UCS-detection centers, which become activated during orgasm. Partner-related cues function as conditioned stimuli (CS) and are processed in CS-detector centers. Throughout the article, we discuss how UCS- and CS-detection centers must interact to facilitate memory consolidation and produce recognition and motivation during future social encounters.

An Examination of the Multi-Faceted Motivation System in Healthy Young Adults.

PubMed

Da Silva, Susana; Apatsidou, Areti; Saperia, Sarah; Siddiqui, Ishraq; Jeffay, Eliyas; Voineskos, Aristotle N; Daskalakis, Zafiris J; Remington, Gary; Zakzanis, Konstantine K; Foussias, George

2018-01-01

Background: Amotivation is a prevalent symptom in schizophrenia (SZ) and depression (MDD), and is linked to poor functional outcomes in affected individuals. Conceptualizations of motivation have outlined a multi-faceted construct comprised of reward responsiveness, reward expectancy, reward valuation, effort valuation, and action selection/preference-based decision making. To date, findings from studies utilizing variable-centered approaches to examining isolated facets of motivation in SZ and MDD have been inconsistent. Thus, the present study adopted a person-centered approach, and comprehensively examined the reward system in a non-clinical sample in an attempt to explore potential subtypes of motivation impairments, while minimizing the effects of illness-related confounds. Methods: Ninety-six healthy undergraduate students were evaluated for amotivation, schizotypal traits, depressive symptoms, and cognition, and administered objective computerized tasks to measure the different facets of motivation. Cluster analysis was performed to explore subgroups of individuals based on similar motivation task performance. Additionally, correlational analyses were conducted in order to examine inter-relationships between motivation facets, and relations between clinical measures and facets of motivation. Results: Cluster analysis identified two subgroups of individuals with differential motivation performance profiles. Correlational analyses revealed that reward responsiveness was associated with amotivation, depressive symptoms, and negative schizotypy. Further, significant inter-correlations were found between reward responsiveness and reward expectancy, as well as between reward valuation and effort valuation. Conclusions: Our results mark important steps forward in understanding motivation in a non-clinical sample, and guide future dimensional and comprehensive analyses of the multi-faceted reward system. It remains to be seen whether these patterns of results will be similar in clinical populations such as SZ and MDD.

An Examination of the Multi-Faceted Motivation System in Healthy Young Adults

PubMed Central

Da Silva, Susana; Apatsidou, Areti; Saperia, Sarah; Siddiqui, Ishraq; Jeffay, Eliyas; Voineskos, Aristotle N.; Daskalakis, Zafiris J.; Remington, Gary; Zakzanis, Konstantine K.; Foussias, George

2018-01-01

Background: Amotivation is a prevalent symptom in schizophrenia (SZ) and depression (MDD), and is linked to poor functional outcomes in affected individuals. Conceptualizations of motivation have outlined a multi-faceted construct comprised of reward responsiveness, reward expectancy, reward valuation, effort valuation, and action selection/preference-based decision making. To date, findings from studies utilizing variable-centered approaches to examining isolated facets of motivation in SZ and MDD have been inconsistent. Thus, the present study adopted a person-centered approach, and comprehensively examined the reward system in a non-clinical sample in an attempt to explore potential subtypes of motivation impairments, while minimizing the effects of illness-related confounds. Methods: Ninety-six healthy undergraduate students were evaluated for amotivation, schizotypal traits, depressive symptoms, and cognition, and administered objective computerized tasks to measure the different facets of motivation. Cluster analysis was performed to explore subgroups of individuals based on similar motivation task performance. Additionally, correlational analyses were conducted in order to examine inter-relationships between motivation facets, and relations between clinical measures and facets of motivation. Results: Cluster analysis identified two subgroups of individuals with differential motivation performance profiles. Correlational analyses revealed that reward responsiveness was associated with amotivation, depressive symptoms, and negative schizotypy. Further, significant inter-correlations were found between reward responsiveness and reward expectancy, as well as between reward valuation and effort valuation. Conclusions: Our results mark important steps forward in understanding motivation in a non-clinical sample, and guide future dimensional and comprehensive analyses of the multi-faceted reward system. It remains to be seen whether these patterns of results will be similar in clinical populations such as SZ and MDD.

White Matter Correlates of Musical Anhedonia: Implications for Evolution of Music.

PubMed

Loui, Psyche; Patterson, Sean; Sachs, Matthew E; Leung, Yvonne; Zeng, Tima; Przysinda, Emily

2017-01-01

Recent theoretical advances in the evolution of music posit that affective communication is an evolutionary function of music through which the mind and brain are transformed. A rigorous test of this view should entail examining the neuroanatomical mechanisms for affective communication of music, specifically by comparing individual differences in the general population with a special population who lacks specific affective responses to music. Here we compare white matter connectivity in BW, a case with severe musical anhedonia, with a large sample of control subjects who exhibit normal variability in reward sensitivity to music. We show for the first time that structural connectivity within the reward system can predict individual differences in musical reward in a large population, but specific patterns in connectivity between auditory and reward systems are special in an extreme case of specific musical anhedonia. Results support and extend the Mixed Origins of Music theory by identifying multiple neural pathways through which music might operate as an affective signaling system.

White Matter Correlates of Musical Anhedonia: Implications for Evolution of Music

PubMed Central

Loui, Psyche; Patterson, Sean; Sachs, Matthew E.; Leung, Yvonne; Zeng, Tima; Przysinda, Emily

2017-01-01

Recent theoretical advances in the evolution of music posit that affective communication is an evolutionary function of music through which the mind and brain are transformed. A rigorous test of this view should entail examining the neuroanatomical mechanisms for affective communication of music, specifically by comparing individual differences in the general population with a special population who lacks specific affective responses to music. Here we compare white matter connectivity in BW, a case with severe musical anhedonia, with a large sample of control subjects who exhibit normal variability in reward sensitivity to music. We show for the first time that structural connectivity within the reward system can predict individual differences in musical reward in a large population, but specific patterns in connectivity between auditory and reward systems are special in an extreme case of specific musical anhedonia. Results support and extend the Mixed Origins of Music theory by identifying multiple neural pathways through which music might operate as an affective signaling system. PMID:28993748

Statistical Mechanics of the Delayed Reward-Based Learning with Node Perturbation

NASA Astrophysics Data System (ADS)

Hiroshi Saito,; Kentaro Katahira,; Kazuo Okanoya,; Masato Okada,

2010-06-01

In reward-based learning, reward is typically given with some delay after a behavior that causes the reward. In machine learning literature, the framework of the eligibility trace has been used as one of the solutions to handle the delayed reward in reinforcement learning. In recent studies, the eligibility trace is implied to be important for difficult neuroscience problem known as the “distal reward problem”. Node perturbation is one of the stochastic gradient methods from among many kinds of reinforcement learning implementations, and it searches the approximate gradient by introducing perturbation to a network. Since the stochastic gradient method does not require a objective function differential, it is expected to be able to account for the learning mechanism of a complex system, like a brain. We study the node perturbation with the eligibility trace as a specific example of delayed reward-based learning, and analyzed it using a statistical mechanics approach. As a result, we show the optimal time constant of the eligibility trace respect to the reward delay and the existence of unlearnable parameter configurations.

Altered prefrontal correlates of monetary anticipation and outcome in chronic pain.

PubMed

Martucci, Katherine T; Borg, Nicholas; MacNiven, Kelly H; Knutson, Brian; Mackey, Sean C

2018-04-04

Chronic pain may alter both affect- and value-related behaviors, which represents a potentially treatable aspect of chronic pain experience. Current understanding of how chronic pain influences the function of brain reward systems, however, is limited. Using a monetary incentive delay task and functional magnetic resonance imaging (fMRI), we measured neural correlates of reward anticipation and outcomes in female participants with the chronic pain condition of fibromyalgia (N = 17) and age-matched, pain-free, female controls (N = 15). We hypothesized that patients would demonstrate lower positive arousal, as well as altered reward anticipation and outcome activity within corticostriatal circuits implicated in reward processing. Patients demonstrated lower arousal ratings as compared with controls, but no group differences were observed for valence, positive arousal, or negative arousal ratings. Group fMRI analyses were conducted to determine predetermined region of interest, nucleus accumbens (NAcc) and medial prefrontal cortex (mPFC), responses to potential gains, potential losses, reward outcomes, and punishment outcomes. Compared with controls, patients demonstrated similar, although slightly reduced, NAcc activity during gain anticipation. Conversely, patients demonstrated dramatically reduced mPFC activity during gain anticipation-possibly related to lower estimated reward probabilities. Further, patients demonstrated normal mPFC activity to reward outcomes, but dramatically heightened mPFC activity to no-loss (nonpunishment) outcomes. In parallel to NAcc and mPFC responses, patients demonstrated slightly reduced activity during reward anticipation in other brain regions, which included the ventral tegmental area, anterior cingulate cortex, and anterior insular cortex. Together, these results implicate altered corticostriatal processing of monetary rewards in chronic pain.

Frontal theta and beta synchronizations for monetary reward increase visual working memory capacity

PubMed Central

Yamaguchi, Yoko

2013-01-01

Visual working memory (VWM) capacity is affected by motivational influences; however, little is known about how reward-related brain activities facilitate the VWM systems. To investigate the dynamic relationship between VWM- and reward-related brain activities, we conducted time–frequency analyses using electroencephalograph (EEG) data obtained during a monetary-incentive delayed-response task that required participants to memorize the position of colored disks. In case of a correct answer, participants received a monetary reward (0, 10 or 50 Japanese yen) announced at the beginning of each trial. Behavioral results showed that VWM capacity under high-reward condition significantly increased compared with that under low- or no-reward condition. EEG results showed that frontal theta (6 Hz) amplitudes enhanced during delay periods and positively correlated with VWM capacity, indicating involvement of theta local synchronizations in VWM. Moreover, frontal beta activities (24 Hz) were identified as reward-related activities, because delay-period amplitudes correlated with increases in VWM capacity between high-reward and no-reward conditions. Interestingly, cross-frequency couplings between frontal theta and beta phases were observed only under high-reward conditions. These findings suggest that the functional dynamic linking between VWM-related theta and reward-related beta activities on the frontal regions plays an integral role in facilitating increases in VWM capacity. PMID:22349800

Frontal theta and beta synchronizations for monetary reward increase visual working memory capacity.

PubMed

Kawasaki, Masahiro; Yamaguchi, Yoko

2013-06-01

Visual working memory (VWM) capacity is affected by motivational influences; however, little is known about how reward-related brain activities facilitate the VWM systems. To investigate the dynamic relationship between VWM- and reward-related brain activities, we conducted time-frequency analyses using electroencephalograph (EEG) data obtained during a monetary-incentive delayed-response task that required participants to memorize the position of colored disks. In case of a correct answer, participants received a monetary reward (0, 10 or 50 Japanese yen) announced at the beginning of each trial. Behavioral results showed that VWM capacity under high-reward condition significantly increased compared with that under low- or no-reward condition. EEG results showed that frontal theta (6 Hz) amplitudes enhanced during delay periods and positively correlated with VWM capacity, indicating involvement of theta local synchronizations in VWM. Moreover, frontal beta activities (24 Hz) were identified as reward-related activities, because delay-period amplitudes correlated with increases in VWM capacity between high-reward and no-reward conditions. Interestingly, cross-frequency couplings between frontal theta and beta phases were observed only under high-reward conditions. These findings suggest that the functional dynamic linking between VWM-related theta and reward-related beta activities on the frontal regions plays an integral role in facilitating increases in VWM capacity.

A test of the reward-value hypothesis.

PubMed

Smith, Alexandra E; Dalecki, Stefan J; Crystal, Jonathon D

2017-03-01

Rats retain source memory (memory for the origin of information) over a retention interval of at least 1 week, whereas their spatial working memory (radial maze locations) decays within approximately 1 day. We have argued that different forgetting functions dissociate memory systems. However, the two tasks, in our previous work, used different reward values. The source memory task used multiple pellets of a preferred food flavor (chocolate), whereas the spatial working memory task provided access to a single pellet of standard chow-flavored food at each location. Thus, according to the reward-value hypothesis, enhanced performance in the source memory task stems from enhanced encoding/memory of a preferred reward. We tested the reward-value hypothesis by using a standard 8-arm radial maze task to compare spatial working memory accuracy of rats rewarded with either multiple chocolate or chow pellets at each location using a between-subjects design. The reward-value hypothesis predicts superior accuracy for high-valued rewards. We documented equivalent spatial memory accuracy for high- and low-value rewards. Importantly, a 24-h retention interval produced equivalent spatial working memory accuracy for both flavors. These data are inconsistent with the reward-value hypothesis and suggest that reward value does not explain our earlier findings that source memory survives unusually long retention intervals.

Time of Day Differences in Neural Reward Functioning in Healthy Young Men.

PubMed

Byrne, Jamie E M; Hughes, Matthew E; Rossell, Susan L; Johnson, Sheri L; Murray, Greg

2017-09-13

Reward function appears to be modulated by the circadian system, but little is known about the neural basis of this interaction. Previous research suggests that the neural reward response may be different in the afternoon; however, the direction of this effect is contentious. Reward response may follow the diurnal rhythm in self-reported positive affect, peaking in the early afternoon. An alternative is that daily reward response represents a type of prediction error, with neural reward activation relatively high at times of day when rewards are unexpected (i.e., early and late in the day). The present study measured neural reward activation in the context of a validated reward task at 10.00 h, 14.00 h, and 19.00 h in healthy human males. A region of interest BOLD fMRI protocol was used to investigate the diurnal waveform of activation in reward-related brain regions. Multilevel modeling found, as expected, a highly significant quadratic time-of-day effect focusing on the left putamen ( p < 0.001). Consistent with the "prediction error" hypothesis, activation was significantly higher at 10.00 h and 19.00 h compared with 14.00 h. It is provisionally concluded that the putamen may be particularly important in endogenous priming of reward motivation at different times of day, with the pattern of activation consistent with circadian-modulated reward expectancies in neural pathways (i.e., greater activation to reward stimuli at unexpected times of day). This study encourages further research into circadian modulation of reward and underscores the methodological importance of accounting for time of day in fMRI protocols. SIGNIFICANCE STATEMENT This is one of the first studies to use a repeated-measures imaging procedure to explore the diurnal rhythm of reward activation. Although self-reported reward (most often operationalized as positive affect) peaks in the afternoon, the present findings indicate that neural activation is lowest at this time. We conclude that the diurnal neural activation pattern may reflect a prediction error of the brain, where rewards at unexpected times (10.00 h and 19.00 h) elicit higher activation in reward brain regions than at expected (14.00 h) times. These data also have methodological significance, suggesting that there may be a time of day influence, which should be accounted for in neural reward studies. Copyright © 2017 the authors 0270-6474/17/378895-06$15.00/0.

Distinct medial temporal networks encode surprise during motivation by reward versus punishment

PubMed Central

Murty, Vishnu P.; LaBar, Kevin S.; Adcock, R. Alison

2016-01-01

Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment. PMID:26854903

Distinct medial temporal networks encode surprise during motivation by reward versus punishment.

PubMed

Murty, Vishnu P; LaBar, Kevin S; Adcock, R Alison

2016-10-01

Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment. Copyright © 2016 Elsevier Inc. All rights reserved.

A reward-centred model of anorexia nervosa: a focussed narrative review of the neurological and psychophysiological literature.

PubMed

O'Hara, Caitlin B; Campbell, Iain C; Schmidt, Ulrike

2015-05-01

This focussed narrative review examines neurobiological and psychophysiological evidence supporting a role for altered reward processes in the development and maintenance of anorexia nervosa (AN). In AN, there does not appear to be a generalised inability to experience reward. Rather, data suggest that a reluctance to gain weight leads to an aversive appraisal of food- and taste-related stimuli. As a result, cues compatible with this aberrant mode of thinking become rewarding for the individual. Evidence also suggests that attribution of motivational salience to such cues promotes anorectic behaviours. These findings are consistent with models in which interactions between cognition and reward are important in eliciting the anorectic "habit". A model is proposed which is consistent with elements of other theoretical frameworks, but differs in that its emphasis is towards neural overlaps between AN and addiction. It is consistent with AN being a reward-based learned behaviour in which aberrant cognitions related to eating and shape alter functioning of central reward systems. It proposes that the primary neural problem responsible for the development, maintenance, and treatment resistance is centred in the striatal reward system. This helps shift the emphasis of aetiological models towards reward processing, particularly in the context of illness-compatible cues. Furthermore, it suggests that continuing to explore the utility and valued nature of AN in the patient's life would be a useful inclusion in treatment and prevention models. Copyright © 2015. Published by Elsevier Ltd.

Underconnectivity between voice-selective cortex and reward circuitry in children with autism.

PubMed

Abrams, Daniel A; Lynch, Charles J; Cheng, Katherine M; Phillips, Jennifer; Supekar, Kaustubh; Ryali, Srikanth; Uddin, Lucina Q; Menon, Vinod

2013-07-16

Individuals with autism spectrum disorders (ASDs) often show insensitivity to the human voice, a deficit that is thought to play a key role in communication deficits in this population. The social motivation theory of ASD predicts that impaired function of reward and emotional systems impedes children with ASD from actively engaging with speech. Here we explore this theory by investigating distributed brain systems underlying human voice perception in children with ASD. Using resting-state functional MRI data acquired from 20 children with ASD and 19 age- and intelligence quotient-matched typically developing children, we examined intrinsic functional connectivity of voice-selective bilateral posterior superior temporal sulcus (pSTS). Children with ASD showed a striking pattern of underconnectivity between left-hemisphere pSTS and distributed nodes of the dopaminergic reward pathway, including bilateral ventral tegmental areas and nucleus accumbens, left-hemisphere insula, orbitofrontal cortex, and ventromedial prefrontal cortex. Children with ASD also showed underconnectivity between right-hemisphere pSTS, a region known for processing speech prosody, and the orbitofrontal cortex and amygdala, brain regions critical for emotion-related associative learning. The degree of underconnectivity between voice-selective cortex and reward pathways predicted symptom severity for communication deficits in children with ASD. Our results suggest that weak connectivity of voice-selective cortex and brain structures involved in reward and emotion may impair the ability of children with ASD to experience speech as a pleasurable stimulus, thereby impacting language and social skill development in this population. Our study provides support for the social motivation theory of ASD.

Memory and reward systems coproduce 'nostalgic' experiences in the brain.

PubMed

Oba, Kentaro; Noriuchi, Madoka; Atomi, Tomoaki; Moriguchi, Yoshiya; Kikuchi, Yoshiaki

2016-07-01

People sometimes experience an emotional state known as 'nostalgia', which involves experiencing predominantly positive emotions while remembering autobiographical events. Nostalgia is thought to play an important role in psychological resilience. Previous neuroimaging studies have shown involvement of memory and reward systems in such experiences. However, it remains unclear how these two systems are collaboratively involved with nostalgia experiences. Here, we conducted a functional magnetic resonance imaging study of healthy females to investigate the relationship between memory-reward co-activation and nostalgia, using childhood-related visual stimuli. Moreover, we examined the factors constituting nostalgia and their neural correlates. We confirmed the presence of nostalgia-related activity in both memory and reward systems, including the hippocampus (HPC), substantia nigra/ventral tegmental area (SN/VTA), and ventral striatum (VS). We also found significant HPC-VS co-activation, with its strength correlating with individual 'nostalgia tendencies'. Factor analyses showed that two dimensions underlie nostalgia: emotional and personal significance and chronological remoteness, with the former correlating with caudal SN/VTA and left anterior HPC activity, and the latter correlating with rostral SN/VTA activity. These findings demonstrate the cooperative activity of memory and reward systems, where each system has a specific role in the construction of the factors that underlie the experience of nostalgia. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Neural substrates of reward magnitude, probability, and risk during a wheel of fortune decision-making task.

PubMed

Smith, Bruce W; Mitchell, Derek G V; Hardin, Michael G; Jazbec, Sandra; Fridberg, Daniel; Blair, R James R; Ernst, Monique

2009-01-15

Economic decision-making involves the weighting of magnitude and probability of potential gains/losses. While previous work has examined the neural systems involved in decision-making, there is a need to understand how the parameters associated with decision-making (e.g., magnitude of expected reward, probability of expected reward and risk) modulate activation within these neural systems. In the current fMRI study, we modified the monetary wheel of fortune (WOF) task [Ernst, M., Nelson, E.E., McClure, E.B., Monk, C.S., Munson, S., Eshel, N., et al. (2004). Choice selection and reward anticipation: an fMRI study. Neuropsychologia 42(12), 1585-1597.] to examine in 25 healthy young adults the neural responses to selections of different reward magnitudes, probabilities, or risks. Selection of high, relative to low, reward magnitude increased activity in insula, amygdala, middle and posterior cingulate cortex, and basal ganglia. Selection of low-probability, as opposed to high-probability reward, increased activity in anterior cingulate cortex, as did selection of risky, relative to safe reward. In summary, decision-making that did not involve conflict, as in the magnitude contrast, recruited structures known to support the coding of reward values, and those that integrate motivational and perceptual information for behavioral responses. In contrast, decision-making under conflict, as in the probability and risk contrasts, engaged the dorsal anterior cingulate cortex whose role in conflict monitoring is well established. However, decision-making under conflict failed to activate the structures that track reward values per se. Thus, the presence of conflict in decision-making seemed to significantly alter the pattern of neural responses to simple rewards. In addition, this paradigm further clarifies the functional specialization of the cingulate cortex in processes of decision-making.

Divergent Relationship of Depression Severity to Social Reward Responses Among Patients with Bipolar Versus Unipolar Depression

PubMed Central

Sharma, Anup; Satterthwaite, Theodore D.; Vandekar, Lillie; Katchmar, Natalie; Daldal, Aylin; Ruparel, Kosha; A.Elliott, Mark; Baldassano, Claudia; Thase, Michael E.; Gur, Raquel E.; Kable, Joseph W.; Wolf, Daniel H.

2016-01-01

Neuroimaging studies of mood disorders demonstrate abnormalities in brain regions implicated in reward processing. However, there is a paucity of research investigating how social rewards affect reward circuit activity in these disorders. Here, we evaluated the relationship of both diagnostic category and dimensional depression severity to reward system function in bipolar and unipolar depression. In total, 86 adults were included, including 24 patients with bipolar depression, 24 patients with unipolar depression, and 38 healthy comparison subjects. Participants completed a social reward task during 3T BOLD fMRI. On average, diagnostic groups did not differ in activation to social reward. However, greater depression severity significantly correlated with reduced bilateral ventral striatum activation to social reward in the bipolar depressed group, but not the unipolar depressed group. In addition, decreased left orbitofrontal cortical activation correlated with more severe symptoms in bipolar depression, but not unipolar depression. These differential dimensional effects resulted in a significant voxelwise group by depression severity interaction. Taken together, these results provide initial evidence that deficits in social reward processing are differentially related to depression severity in the two disorders. PMID:27295401

Developmental changes in autonomic responses are associated with future reward/punishment expectations: A study of sympathetic skin responses in the Markov decision task.

PubMed

Hosaka, Hiromi; Aoyagi, Kakuro; Kaga, Yoshimi; Kanemura, Hideaki; Sugita, Kanji; Aihara, Masao

2017-08-01

Autonomic nervous system activity is recognized as a major component of emotional responses. Future reward/punishment expectations depend upon the process of decision making in the frontal lobe, which is considered to play an important role in executive function. The aim of this study was to investigate the relationship between autonomic responses and decision making during reinforcement tasks using sympathetic skin responses (SSR). Nine adult and 9 juvenile (mean age, 10.2years) volunteers were enrolled in this study. SSRs were measured during the Markov decision task (MDT), which is a reinforcement task. In this task, subjects must endure a small immediate loss to ultimately get a large reward. The subjects had to undergo three sets of tests and their scores in these tests were assessed and evaluated. All adults showed gradually increasing scores for the MDT from the first to third set. As the trial progressed from the first to second set in adults, SSR appearance ratios remarkably increased for both punishment and reward expectations. In comparison with adults, children showed decreasing scores from the first to second set. There were no significant inter-target differences in the SSR appearance ratio in the first and second set in children. In the third set, the SSR appearance ratio for reward expectations was higher than that in the neutral condition. In reinforcement tasks, such as MDT, autonomic responses play an important role in decision making. We assume that SSRs are elicited during efficient decision making tasks associated with future reward/punishment expectations, which demonstrates the importance of autonomic function. In contrast, in children around the age of 10years, the autonomic system does not react as an organized response specific to reward/punishment expectations. This suggests the immaturity of the future reward/punishment expectations process in children. Copyright © 2017 The Japanese Society of Child Neurology. Published by Elsevier B.V. All rights reserved.

Abstinence duration modulates striatal functioning during monetary reward processing in cocaine patients.

PubMed

Bustamante, Juan-Carlos; Barrós-Loscertales, Alfonso; Costumero, Víctor; Fuentes-Claramonte, Paola; Rosell-Negre, Patricia; Ventura-Campos, Noelia; Llopis, Juan-José; Ávila, César

2014-09-01

Pre-clinical and clinical studies in cocaine addiction highlight alterations in the striatal dopaminergic reward system that subserve maintenance of cocaine use. Using an instrumental conditioning paradigm with monetary reinforcement, we studied striatal functional alterations in long-term abstinent cocaine-dependent patients and striatal functioning as a function of abstinence and treatment duration. Eighteen patients and 20 controls underwent functional magnetic resonance imaging during a Monetary Incentive Delay task. Region of interest analyses based on masks of the dorsal and ventral striatum were conducted to test between-group differences and the functional effects in the cocaine group of time (in months) with no more than two lapses from the first time patients visited the clinical service to seek treatment at the scanning time (duration of treatment), and the functional effects of the number of months with no lapses or relapses at the scanning session time (length of abstinence). We applied a voxel-wise and a cluster-wise FWE-corrected level (pFWE) at a threshold of P < 0.05. The patient group showed lower activation in the right caudate during reward anticipation than the control group. The regression analyses in the patients group revealed a positive correlation between duration of treatment and brain activity in the left caudate during reward anticipation. Likewise, length of abstinence negatively correlated with brain activity in the bilateral nucleus accumbens during monetary outcome processing. In conclusion, caudate and nucleus accumbens show a different brain response pattern to non-drug rewards during cocaine addiction, which can be modulated by treatment success. © 2013 The Authors, Addiction Biology © 2013 Society for the Study of Addiction.

Pervasive competition between threat and reward in the brain.

PubMed

Choi, Jong Moon; Padmala, Srikanth; Spechler, Philip; Pessoa, Luiz

2014-06-01

In the current functional MRI study, we investigated interactions between reward and threat processing. Visual cues at the start of each trial informed participants about the chance of winning monetary reward and/or receiving a mild aversive shock. We tested two competing hypothesis: according to the 'salience hypothesis', in the condition involving both reward and threat, enhanced activation would be observed because of increased salience; according to the 'competition hypothesis', the processing of reward and threat would trade-off against each other, leading to reduced activation. Analysis of skin conductance data during a delay phase revealed an interaction between reward and threat processing, such that the effect of reward was reduced during threat and the effect of threat was reduced during reward. Analysis of imaging data during the same task phase revealed interactions between reward and threat processing in several regions, including the midbrain/ventral tegmental area, caudate, putamen, bed nucleus of the stria terminalis, anterior insula, middle frontal gyrus and dorsal anterior cingulate cortex. Taken together, our findings reveal conditions during which reward and threat trade-off against each other across multiple sites. Such interactions are suggestive of competitive processes and may reflect the organization of opponent systems in the brain. © The Author (2013). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Dopamine Reward Prediction Error Responses Reflect Marginal Utility

PubMed Central

Stauffer, William R.; Lak, Armin; Schultz, Wolfram

2014-01-01

Summary Background Optimal choices require an accurate neuronal representation of economic value. In economics, utility functions are mathematical representations of subjective value that can be constructed from choices under risk. Utility usually exhibits a nonlinear relationship to physical reward value that corresponds to risk attitudes and reflects the increasing or decreasing marginal utility obtained with each additional unit of reward. Accordingly, neuronal reward responses coding utility should robustly reflect this nonlinearity. Results In two monkeys, we measured utility as a function of physical reward value from meaningful choices under risk (that adhered to first- and second-order stochastic dominance). The resulting nonlinear utility functions predicted the certainty equivalents for new gambles, indicating that the functions’ shapes were meaningful. The monkeys were risk seeking (convex utility function) for low reward and risk avoiding (concave utility function) with higher amounts. Critically, the dopamine prediction error responses at the time of reward itself reflected the nonlinear utility functions measured at the time of choices. In particular, the reward response magnitude depended on the first derivative of the utility function and thus reflected the marginal utility. Furthermore, dopamine responses recorded outside of the task reflected the marginal utility of unpredicted reward. Accordingly, these responses were sufficient to train reinforcement learning models to predict the behaviorally defined expected utility of gambles. Conclusions These data suggest a neuronal manifestation of marginal utility in dopamine neurons and indicate a common neuronal basis for fundamental explanatory constructs in animal learning theory (prediction error) and economic decision theory (marginal utility). PMID:25283778

Neural basis of the undermining effect of monetary reward on intrinsic motivation

PubMed Central

Murayama, Kou; Matsumoto, Madoka; Izuma, Keise; Matsumoto, Kenji

2010-01-01

Contrary to the widespread belief that people are positively motivated by reward incentives, some studies have shown that performance-based extrinsic reward can actually undermine a person's intrinsic motivation to engage in a task. This “undermining effect” has timely practical implications, given the burgeoning of performance-based incentive systems in contemporary society. It also presents a theoretical challenge for economic and reinforcement learning theories, which tend to assume that monetary incentives monotonically increase motivation. Despite the practical and theoretical importance of this provocative phenomenon, however, little is known about its neural basis. Herein we induced the behavioral undermining effect using a newly developed task, and we tracked its neural correlates using functional MRI. Our results show that performance-based monetary reward indeed undermines intrinsic motivation, as assessed by the number of voluntary engagements in the task. We found that activity in the anterior striatum and the prefrontal areas decreased along with this behavioral undermining effect. These findings suggest that the corticobasal ganglia valuation system underlies the undermining effect through the integration of extrinsic reward value and intrinsic task value. PMID:21078974

Neural basis of the undermining effect of monetary reward on intrinsic motivation.

PubMed

Murayama, Kou; Matsumoto, Madoka; Izuma, Keise; Matsumoto, Kenji

2010-12-07

Contrary to the widespread belief that people are positively motivated by reward incentives, some studies have shown that performance-based extrinsic reward can actually undermine a person's intrinsic motivation to engage in a task. This "undermining effect" has timely practical implications, given the burgeoning of performance-based incentive systems in contemporary society. It also presents a theoretical challenge for economic and reinforcement learning theories, which tend to assume that monetary incentives monotonically increase motivation. Despite the practical and theoretical importance of this provocative phenomenon, however, little is known about its neural basis. Herein we induced the behavioral undermining effect using a newly developed task, and we tracked its neural correlates using functional MRI. Our results show that performance-based monetary reward indeed undermines intrinsic motivation, as assessed by the number of voluntary engagements in the task. We found that activity in the anterior striatum and the prefrontal areas decreased along with this behavioral undermining effect. These findings suggest that the corticobasal ganglia valuation system underlies the undermining effect through the integration of extrinsic reward value and intrinsic task value.

Altered striatal activation predicting real-world positive affect in adolescent major depressive disorder.

PubMed

Forbes, Erika E; Hariri, Ahmad R; Martin, Samantha L; Silk, Jennifer S; Moyles, Donna L; Fisher, Patrick M; Brown, Sarah M; Ryan, Neal D; Birmaher, Boris; Axelson, David A; Dahl, Ronald E

2009-01-01

Alterations in reward-related brain function and phenomenological aspects of positive affect are increasingly examined in the development of major depressive disorder. The authors tested differences in reward-related brain function in healthy and depressed adolescents, and the authors examined direct links between reward-related brain function and positive mood that occurred in real-world contexts. Fifteen adolescents with major depressive disorder and 28 adolescents with no history of psychiatric disorder, ages 8-17 years, completed a functional magnetic resonance imaging guessing task involving monetary reward. Participants also reported their subjective positive affect in natural environments during a 4-day cell-phone-based ecological momentary assessment. Adolescents with major depressive disorder exhibited less striatal response than healthy comparison adolescents during reward anticipation and reward outcome, but more response in dorsolateral and medial prefrontal cortex. Diminished activation in a caudate region associated with this depression group difference was correlated with lower subjective positive affect in natural environments, particularly within the depressed group. Results support models of altered reward processing and related positive affect in young people with major depressive disorder and indicate that depressed adolescents' brain response to monetary reward is related to their affective experience in natural environments. Additionally, these results suggest that reward-processing paradigms capture brain function relevant to real-world positive affect.

The anticipation and outcome phases of reward and loss processing: A neuroimaging meta-analysis of the monetary incentive delay task.

PubMed

Oldham, Stuart; Murawski, Carsten; Fornito, Alex; Youssef, George; Yücel, Murat; Lorenzetti, Valentina

2018-04-25

The processing of rewards and losses are crucial to everyday functioning. Considerable interest has been attached to investigating the anticipation and outcome phases of reward and loss processing, but results to date have been inconsistent. It is unclear if anticipation and outcome of a reward or loss recruit similar or distinct brain regions. In particular, while the striatum has widely been found to be active when anticipating a reward, whether it activates in response to the anticipation of losses as well remains ambiguous. Furthermore, concerning the orbitofrontal/ventromedial prefrontal regions, activation is often observed during reward receipt. However, it is unclear if this area is active during reward anticipation as well. We ran an Activation Likelihood Estimation meta-analysis of 50 fMRI studies, which used the Monetary Incentive Delay Task (MIDT), to identify which brain regions are implicated in the anticipation of rewards, anticipation of losses, and the receipt of reward. Anticipating rewards and losses recruits overlapping areas including the striatum, insula, amygdala and thalamus, suggesting that a generalised neural system initiates motivational processes independent of valence. The orbitofrontal/ventromedial prefrontal regions were recruited only during the reward outcome, likely representing the value of the reward received. Our findings help to clarify the neural substrates of the different phases of reward and loss processing, and advance neurobiological models of these processes. © 2018 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Dopamine reward prediction error responses reflect marginal utility.

PubMed

Stauffer, William R; Lak, Armin; Schultz, Wolfram

2014-11-03

Optimal choices require an accurate neuronal representation of economic value. In economics, utility functions are mathematical representations of subjective value that can be constructed from choices under risk. Utility usually exhibits a nonlinear relationship to physical reward value that corresponds to risk attitudes and reflects the increasing or decreasing marginal utility obtained with each additional unit of reward. Accordingly, neuronal reward responses coding utility should robustly reflect this nonlinearity. In two monkeys, we measured utility as a function of physical reward value from meaningful choices under risk (that adhered to first- and second-order stochastic dominance). The resulting nonlinear utility functions predicted the certainty equivalents for new gambles, indicating that the functions' shapes were meaningful. The monkeys were risk seeking (convex utility function) for low reward and risk avoiding (concave utility function) with higher amounts. Critically, the dopamine prediction error responses at the time of reward itself reflected the nonlinear utility functions measured at the time of choices. In particular, the reward response magnitude depended on the first derivative of the utility function and thus reflected the marginal utility. Furthermore, dopamine responses recorded outside of the task reflected the marginal utility of unpredicted reward. Accordingly, these responses were sufficient to train reinforcement learning models to predict the behaviorally defined expected utility of gambles. These data suggest a neuronal manifestation of marginal utility in dopamine neurons and indicate a common neuronal basis for fundamental explanatory constructs in animal learning theory (prediction error) and economic decision theory (marginal utility). Copyright © 2014 The Authors. Published by Elsevier Inc. All rights reserved.

Distinguishing between learning and motivation in behavioral tests of the reinforcement sensitivity theory of personality.

PubMed

Smillie, Luke D; Dalgleish, Len I; Jackson, Chris J

2007-04-01

According to Gray's (1973) Reinforcement Sensitivity Theory (RST), a Behavioral Inhibition System (BIS) and a Behavioral Activation System (BAS) mediate effects of goal conflict and reward on behavior. BIS functioning has been linked with individual differences in trait anxiety and BAS functioning with individual differences in trait impulsivity. In this article, it is argued that behavioral outputs of the BIS and BAS can be distinguished in terms of learning and motivation processes and that these can be operationalized using the Signal Detection Theory measures of response-sensitivity and response-bias. In Experiment 1, two measures of BIS-reactivity predicted increased response-sensitivity under goal conflict, whereas one measure of BAS-reactivity predicted increased response-sensitivity under reward. In Experiment 2, two measures of BIS-reactivity predicted response-bias under goal conflict, whereas a measure of BAS-reactivity predicted motivation response-bias under reward. In both experiments, impulsivity measures did not predict criteria for BAS-reactivity as traditionally predicted by RST.

The Function of Verbal Rewards in the Science Classroom.

ERIC Educational Resources Information Center

Lawlor, Francis Xavier

Contained is a review of the research done on the use of verbal rewards in the classroom. Some verbal rewards are tasks rewards, other rewards are more personal; and still other verbal rewards are impersonal. Verbal rewards, therefore, have both intellectual and emotional implications. Research literature indicates that "verbal reward"…

The left hemisphere learns what is right: Hemispatial reward learning depends on reinforcement learning processes in the contralateral hemisphere.

PubMed

Aberg, Kristoffer Carl; Doell, Kimberly Crystal; Schwartz, Sophie

2016-08-01

Orienting biases refer to consistent, trait-like direction of attention or locomotion toward one side of space. Recent studies suggest that such hemispatial biases may determine how well people memorize information presented in the left or right hemifield. Moreover, lesion studies indicate that learning rewarded stimuli in one hemispace depends on the integrity of the contralateral striatum. However, the exact neural and computational mechanisms underlying the influence of individual orienting biases on reward learning remain unclear. Because reward-based behavioural adaptation depends on the dopaminergic system and prediction error (PE) encoding in the ventral striatum, we hypothesized that hemispheric asymmetries in dopamine (DA) function may determine individual spatial biases in reward learning. To test this prediction, we acquired fMRI in 33 healthy human participants while they performed a lateralized reward task. Learning differences between hemispaces were assessed by presenting stimuli, assigned to different reward probabilities, to the left or right of central fixation, i.e. presented in the left or right visual hemifield. Hemispheric differences in DA function were estimated through differential fMRI responses to positive vs. negative feedback in the left vs. right ventral striatum, and a computational approach was used to identify the neural correlates of PEs. Our results show that spatial biases favoring reward learning in the right (vs. left) hemifield were associated with increased reward responses in the left hemisphere and relatively better neural encoding of PEs for stimuli presented in the right (vs. left) hemifield. These findings demonstrate that trait-like spatial biases implicate hemisphere-specific learning mechanisms, with individual differences between hemispheres contributing to reinforcing spatial biases. Copyright © 2016 Elsevier Ltd. All rights reserved.

Neural signal during immediate reward anticipation in schizophrenia: Relationship to real-world motivation and function.

PubMed

Subramaniam, Karuna; Hooker, Christine I; Biagianti, Bruno; Fisher, Melissa; Nagarajan, Srikantan; Vinogradov, Sophia

2015-01-01

Amotivation in schizophrenia is a central predictor of poor functioning, and is thought to occur due to deficits in anticipating future rewards, suggesting that impairments in anticipating pleasure can contribute to functional disability in schizophrenia. In healthy comparison (HC) participants, reward anticipation is associated with activity in frontal-striatal networks. By contrast, schizophrenia (SZ) participants show hypoactivation within these frontal-striatal networks during this motivated anticipatory brain state. Here, we examined neural activation in SZ and HC participants during the anticipatory phase of stimuli that predicted immediate upcoming reward and punishment, and during the feedback/outcome phase, in relation to trait measures of hedonic pleasure and real-world functional capacity. SZ patients showed hypoactivation in ventral striatum during reward anticipation. Additionally, we found distinct differences between HC and SZ groups in their association between reward-related immediate anticipatory neural activity and their reported experience of pleasure. HC participants recruited reward-related regions in striatum that significantly correlated with subjective consummatory pleasure, while SZ patients revealed activation in attention-related regions, such as the IPL, which correlated with consummatory pleasure and functional capacity. These findings may suggest that SZ patients activate compensatory attention processes during anticipation of immediate upcoming rewards, which likely contribute to their functional capacity in daily life.

Neural signal during immediate reward anticipation in schizophrenia: Relationship to real-world motivation and function

PubMed Central

Subramaniam, Karuna; Hooker, Christine I.; Biagianti, Bruno; Fisher, Melissa; Nagarajan, Srikantan; Vinogradov, Sophia

2015-01-01

Amotivation in schizophrenia is a central predictor of poor functioning, and is thought to occur due to deficits in anticipating future rewards, suggesting that impairments in anticipating pleasure can contribute to functional disability in schizophrenia. In healthy comparison (HC) participants, reward anticipation is associated with activity in frontal–striatal networks. By contrast, schizophrenia (SZ) participants show hypoactivation within these frontal–striatal networks during this motivated anticipatory brain state. Here, we examined neural activation in SZ and HC participants during the anticipatory phase of stimuli that predicted immediate upcoming reward and punishment, and during the feedback/outcome phase, in relation to trait measures of hedonic pleasure and real-world functional capacity. SZ patients showed hypoactivation in ventral striatum during reward anticipation. Additionally, we found distinct differences between HC and SZ groups in their association between reward-related immediate anticipatory neural activity and their reported experience of pleasure. HC participants recruited reward-related regions in striatum that significantly correlated with subjective consummatory pleasure, while SZ patients revealed activation in attention-related regions, such as the IPL, which correlated with consummatory pleasure and functional capacity. These findings may suggest that SZ patients activate compensatory attention processes during anticipation of immediate upcoming rewards, which likely contribute to their functional capacity in daily life. PMID:26413478

Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feedback error-related negativity and N200.

PubMed

Baker, Travis E; Holroyd, Clay B

2011-04-01

The reinforcement learning theory of the error-related negativity (ERN) holds that the impact of reward signals carried by the midbrain dopamine system modulates activity of the anterior cingulate cortex (ACC), alternatively disinhibiting and inhibiting the ACC following unpredicted error and reward events, respectively. According to a recent formulation of the theory, activity that is intrinsic to the ACC produces a component of the event-related brain potential (ERP) called the N200, and following unpredicted rewards, the N200 is suppressed by extrinsically applied positive dopamine reward signals, resulting in an ERP component called the feedback-ERN (fERN). Here we demonstrate that, despite extensive spatial and temporal overlap between the two ERP components, the functional processes indexed by the N200 (conflict) and the fERN (reward) are dissociable. These results point toward avenues for future investigation. Copyright © 2011 Elsevier B.V. All rights reserved.

A review of reward processing and motivational impairment in schizophrenia.

PubMed

Strauss, Gregory P; Waltz, James A; Gold, James M

2014-03-01

This article reviews and synthesizes research on reward processing in schizophrenia, which has begun to provide important insights into the cognitive and neural mechanisms associated with motivational impairments. Aberrant cortical-striatal interactions may be involved with multiple reward processing abnormalities, including: (1) dopamine-mediated basal ganglia systems that support reinforcement learning and the ability to predict cues that lead to rewarding outcomes; (2) orbitofrontal cortex-driven deficits in generating, updating, and maintaining value representations; (3) aberrant effort-value computations, which may be mediated by disrupted anterior cingulate cortex and midbrain dopamine functioning; and (4) altered activation of the prefrontal cortex, which is important for generating exploratory behaviors in environments where reward outcomes are uncertain. It will be important for psychosocial interventions targeting negative symptoms to account for abnormalities in each of these reward processes, which may also have important interactions; suggestions for novel behavioral intervention strategies that make use of external cues, reinforcers, and mobile technology are discussed.

NMDA receptor blockade in the prelimbic cortex activates the mesolimbic system and dopamine-dependent opiate reward signaling.

PubMed

Tan, Huibing; Rosen, Laura G; Ng, Garye A; Rushlow, Walter J; Laviolette, Steven R

2014-12-01

N-Methyl-D-aspartate (NMDA) receptors in the medial prefrontal cortex (mPFC) are involved in opiate reward processing and modulate sub-cortical dopamine (DA) activity. NMDA receptor blockade in the prelimbic (PLC) division of the mPFC strongly potentiates the rewarding behavioural properties of normally sub-reward threshold doses of opiates. However, the possible functional interactions between cortical NMDA and sub-cortical DAergic motivational neural pathways underlying these effects are not understood. This study examines how NMDA receptor modulation in the PLC influences opiate reward processing via interactions with sub-cortical DAergic transmission. We further examined whether direct intra-PLC NMDA receptor modulation may activate DA-dependent opiate reward signaling via interactions with the ventral tegmental area (VTA). Using an unbiased place conditioning procedure (CPP) in rats, we performed bilateral intra-PLC microinfusions of the competitive NMDA receptor antagonist, (2R)-amino-5-phosphonovaleric acid (AP-5), prior to behavioural morphine place conditioning and challenged the rewarding effects of morphine with DA receptor blockade. We next examined the effects of intra-PLC NMDA receptor blockade on the spontaneous activity patterns of presumptive VTA DA or GABAergic neurons, using single-unit, extracellular in vivo neuronal recordings. We show that intra-PLC NMDA receptor blockade strongly activates sub-cortical DA neurons within the VTA while inhibiting presumptive non-DA GABAergic neurons. Behaviourally, NMDA receptor blockade activates a DA-dependent opiate reward system, as pharmacological blockade of DA transmission blocked morphine reward only in the presence of intra-PLC NMDA receptor antagonism. These findings demonstrate a cortical NMDA-mediated mechanism controlling mesolimbic DAergic modulation of opiate reward processing.

Further support for association between GWAS variant for positive emotion and reward systems.

PubMed

Lancaster, T M; Ihssen, N; Brindley, L M; Linden, D E J

2017-01-31

A recent genome-wide association study (GWAS) identified a significant single-nucleotide polymorphism (SNP) for trait-positive emotion at rs322931 on chromosome 1, which was also associated with brain activation in the reward system of healthy individuals when observing positive stimuli in a functional magnetic resonance imaging (fMRI) study. In the current study, we aimed to further validate the role of variation at rs322931 in reward processing. Using a similar fMRI approach, we use two paradigms that elicit a strong ventral striatum (VS) blood oxygen-level dependency (BOLD) response in a sample of young, healthy individuals (N=82). In the first study we use a similar picture-viewing task to the discovery sample (positive>neutral stimuli) to replicate an effect of the variant on emotion processing. In the second study we use a probabilistic reversal learning procedure to identify reward processing during decision-making under uncertainly (reward>punishment). In a region of interest (ROI) analysis of the bilateral VS, we show that the rs322931 genotype was associated with BOLD in the left VS during the positive>neutral contrast (P ROI-CORRECTED =0.045) and during the reward>punishment contrast (P ROI-CORRECTED =0.018), although the effect of passive picture viewing was in the opposite direction from that reported in the discovery sample. These findings suggest that the recently identified GWAS hit may influence positive emotion via individual differences in activity in the key hubs of the brain's reward system. Furthermore, these effects may not be limited to the passive viewing of positive emotional scenes, but may also be observed during dynamic decision-making. This study suggests that future studies of this GWAS locus may yield further insight into the biological mechanisms of psychopathologies characterised by deficits in reward processing and positive emotion.

Neural Reward Processing Mediates the Relationship between Insomnia Symptoms and Depression in Adolescence.

PubMed

Casement, Melynda D; Keenan, Kate E; Hipwell, Alison E; Guyer, Amanda E; Forbes, Erika E

2016-02-01

Emerging evidence suggests that insomnia may disrupt reward-related brain function-a potentially important factor in the development of depressive disorder. Adolescence may be a period during which such disruption is especially problematic given the rise in the incidence of insomnia and ongoing development of neural systems that support reward processing. The present study uses longitudinal data to test the hypothesis that disruption of neural reward processing is a mechanism by which insomnia symptoms-including nocturnal insomnia symptoms (NIS) and nonrestorative sleep (NRS)-contribute to depressive symptoms in adolescent girls. Participants were 123 adolescent girls and their caregivers from an ongoing longitudinal study of precursors to depression across adolescent development. NIS and NRS were assessed annually from ages 9 to 13 years. Girls completed a monetary reward task during a functional MRI scan at age 16 years. Depressive symptoms were assessed at ages 16 and 17 years. Multivariable regression tested the prospective associations between NIS and NRS, neural response during reward anticipation, and the mean number of depressive symptoms (omitting sleep problems). NRS, but not NIS, during early adolescence was positively associated with late adolescent dorsal medial prefrontal cortex (dmPFC) response to reward anticipation and depressive symptoms. DMPFC response mediated the relationship between early adolescent NRS and late adolescent depressive symptoms. These results suggest that NRS may contribute to depression by disrupting reward processing via altered activity in a region of prefrontal cortex involved in affective control. The results also support the mechanistic differentiation of NIS and NRS. © 2016 Associated Professional Sleep Societies, LLC.

Hedonic Homeostatic Dysregulation as a Driver of Drug-Seeking Behavior

PubMed Central

Koob, George F.

2009-01-01

Drug addiction can be defined by a compulsion to seek and take drug and loss of control in limiting intake, and the excessive drug taking derives from multiple motivational mechanisms. One such mechanism is the emergence of a negative emotional state when access to the drug is prevented, reflecting hedonic homeostatic dysregulation. Excessive drug taking then results in part via the construct of negative reinforcement. The negative emotional state that drives such negative reinforcement is hypothesized to derive from dysregulation of key neurochemical elements involved in reward and stress within basal forebrain structures, including the ventral striatum and extended amygdala. Specific neurochemical elements in these structures include not only decreases in reward neurotransmission, such as decreases in dopamine and opioid peptide function in the ventral striatum, but also recruitment of brain stress systems, such as corticotropin-releasing factor (CRF), in the extended amygdala. Chronic exposure or extended access to self-administration of all major drugs of abuse produces during abstinence increases in reward thresholds, increases in aversive anxiety-like responses, increases in extracellular levels of CRF in the central nucleus of the amygdala, and increases in drug self-administration. CRF receptor antagonists block excessive drug intake produced by dependence. A combination of decreased reward system function and increased brain stress response system function is hypothesized to be responsible for hedonic homeostatic dysregulation that drives drug seeking behavior in dependence. Such hedonic dysregulation is hypothesized to extend into protracted abstinence to provide a residual negative emotional state that enhances the salience of cues eliciting drug seeking and relapse. PMID:20054425

The neuromodulator of exploration: A unifying theory of the role of dopamine in personality

PubMed Central

DeYoung, Colin G.

2013-01-01

The neuromodulator dopamine is centrally involved in reward, approach behavior, exploration, and various aspects of cognition. Variations in dopaminergic function appear to be associated with variations in personality, but exactly which traits are influenced by dopamine remains an open question. This paper proposes a theory of the role of dopamine in personality that organizes and explains the diversity of findings, utilizing the division of the dopaminergic system into value coding and salience coding neurons (Bromberg-Martin et al., 2010). The value coding system is proposed to be related primarily to Extraversion and the salience coding system to Openness/Intellect. Global levels of dopamine influence the higher order personality factor, Plasticity, which comprises the shared variance of Extraversion and Openness/Intellect. All other traits related to dopamine are linked to Plasticity or its subtraits. The general function of dopamine is to promote exploration, by facilitating engagement with cues of specific reward (value) and cues of the reward value of information (salience). This theory constitutes an extension of the entropy model of uncertainty (EMU; Hirsh et al., 2012), enabling EMU to account for the fact that uncertainty is an innate incentive reward as well as an innate threat. The theory accounts for the association of dopamine with traits ranging from sensation and novelty seeking, to impulsivity and aggression, to achievement striving, creativity, and cognitive abilities, to the overinclusive thinking characteristic of schizotypy. PMID:24294198

Belief state representation in the dopamine system.

PubMed

Babayan, Benedicte M; Uchida, Naoshige; Gershman, Samuel J

2018-05-14

Learning to predict future outcomes is critical for driving appropriate behaviors. Reinforcement learning (RL) models have successfully accounted for such learning, relying on reward prediction errors (RPEs) signaled by midbrain dopamine neurons. It has been proposed that when sensory data provide only ambiguous information about which state an animal is in, it can predict reward based on a set of probabilities assigned to hypothetical states (called the belief state). Here we examine how dopamine RPEs and subsequent learning are regulated under state uncertainty. Mice are first trained in a task with two potential states defined by different reward amounts. During testing, intermediate-sized rewards are given in rare trials. Dopamine activity is a non-monotonic function of reward size, consistent with RL models operating on belief states. Furthermore, the magnitude of dopamine responses quantitatively predicts changes in behavior. These results establish the critical role of state inference in RL.

Journal Impact Factor Shapes Scientists’ Reward Signal in the Prospect of Publication

PubMed Central

Paulus, Frieder Michel; Rademacher, Lena; Schäfer, Theo Alexander Jose; Müller-Pinzler, Laura; Krach, Sören

2015-01-01

The incentive structure of a scientist’s life is increasingly mimicking economic principles. While intensely criticized, the journal impact factor (JIF) has taken a role as the new currency for scientists. Successful goal-directed behavior in academia thus requires knowledge about the JIF. Using functional neuroimaging we examined how the JIF, as a powerful incentive in academia, has shaped the behavior of scientists and the reward signal in the striatum. We demonstrate that the reward signal in the nucleus accumbens increases with higher JIF during the anticipation of a publication and found a positive correlation with the personal publication record (pJIF) supporting the notion that scientists have incorporated the predominant reward principle of the scientific community in their reward system. The implications of this behavioral adaptation within the ecological niche of the scientist’s habitat remain unknown, but may also have effects which were not intended by the community. PMID:26555725

Brain connectivity reflects human aesthetic responses to music

PubMed Central

Sachs, Matthew E.; Ellis, Robert J.; Schlaug, Gottfried

2016-01-01

Abstract Humans uniquely appreciate aesthetics, experiencing pleasurable responses to complex stimuli that confer no clear intrinsic value for survival. However, substantial variability exists in the frequency and specificity of aesthetic responses. While pleasure from aesthetics is attributed to the neural circuitry for reward, what accounts for individual differences in aesthetic reward sensitivity remains unclear. Using a combination of survey data, behavioral and psychophysiological measures and diffusion tensor imaging, we found that white matter connectivity between sensory processing areas in the superior temporal gyrus and emotional and social processing areas in the insula and medial prefrontal cortex explains individual differences in reward sensitivity to music. Our findings provide the first evidence for a neural basis of individual differences in sensory access to the reward system, and suggest that social–emotional communication through the auditory channel may offer an evolutionary basis for music making as an aesthetically rewarding function in humans. PMID:26966157

The role of orgasm in the development and shaping of partner preferences

PubMed Central

Coria-Avila, Genaro A.; Herrera-Covarrubias, Deissy; Ismail, Nafissa; Pfaus, James G.

2016-01-01

Background The effect of orgasm on the development and shaping of partner preferences may involve a catalysis of the neurochemical mechanisms of bonding. Therefore, understanding such process is relevant for neuroscience and psychology. Methods A systematic review was carried out using the terms Orgasm, Sexual Reward, Partner Preference, Pair Bonding, Brain, Learning, Sex, Copulation. Results In humans, concentrations of arousing neurotransmitters and potential bonding neurotransmitters increase during orgasm in the cerebrospinal fluid and the bloodstream. Similarly, studies in animals indicate that those neurotransmitters (noradrenaline, oxytocin, prolactin) and others (e.g. dopamine, opioids, serotonin) modulate the appetitive and consummatory phases of sexual behavior and reward. This suggests a link between the experience of orgasm/sexual reward and the neurochemical mechanisms of pair bonding. Orgasm/reward functions as an unconditioned stimulus (UCS). Some areas in the nervous system function as UCS-detection centers, which become activated during orgasm. Partner-related cues function as conditioned stimuli (CS) and are processed in CS-detector centers. Conclusions Throughout the article, we discuss how UCS- and CS-detection centers must interact to facilitate memory consolidation and produce recognition and motivation during future social encounters. PMID:27799080

Reward system and temporal pole contributions to affective evaluation during a first person shooter video game.

PubMed

Mathiak, Krystyna A; Klasen, Martin; Weber, René; Ackermann, Hermann; Shergill, Sukhwinder S; Mathiak, Klaus

2011-07-12

Violent content in video games evokes many concerns but there is little research concerning its rewarding aspects. It was demonstrated that playing a video game leads to striatal dopamine release. It is unclear, however, which aspects of the game cause this reward system activation and if violent content contributes to it. We combined functional Magnetic Resonance Imaging (fMRI) with individual affect measures to address the neuronal correlates of violence in a video game. Thirteen male German volunteers played a first-person shooter game (Tactical Ops: Assault on Terror) during fMRI measurement. We defined success as eliminating opponents, and failure as being eliminated themselves. Affect was measured directly before and after game play using the Positive and Negative Affect Schedule (PANAS). Failure and success events evoked increased activity in visual cortex but only failure decreased activity in orbitofrontal cortex and caudate nucleus. A negative correlation between negative affect and responses to failure was evident in the right temporal pole (rTP). The deactivation of the caudate nucleus during failure is in accordance with its role in reward-prediction error: it occurred whenever subject missed an expected reward (being eliminated rather than eliminating the opponent). We found no indication that violence events were directly rewarding for the players. We addressed subjective evaluations of affect change due to gameplay to study the reward system. Subjects reporting greater negative affect after playing the game had less rTP activity associated with failure. The rTP may therefore be involved in evaluating the failure events in a social context, to regulate the players' mood.

The Functional DRD3 Ser9Gly Polymorphism (rs6280) Is Pleiotropic, Affecting Reward as Well as Movement

PubMed Central

Savitz, Jonathan; Hodgkinson, Colin A.; Martin-Soelch, Chantal; Shen, Pei-Hong; Szczepanik, Joanna; Nugent, Allison; Herscovitch, Peter; Grace, Anthony A.; Goldman, David; Drevets, Wayne C.

2013-01-01

Abnormalities of motivation and behavior in the context of reward are a fundamental component of addiction and mood disorders. Here we test the effect of a functional missense mutation in the dopamine 3 receptor (DRD3) gene (ser9gly, rs6280) on reward-associated dopamine (DA) release in the striatum. Twenty-six healthy controls (HCs) and 10 unmedicated subjects with major depressive disorder (MDD) completed two positron emission tomography (PET) scans with [11C]raclopride using the bolus plus constant infusion method. On one occasion subjects completed a sensorimotor task (control condition) and on another occasion subjects completed a gambling task (reward condition). A linear regression analysis controlling for age, sex, diagnosis, and self-reported anhedonia indicated that during receipt of unpredictable monetary reward the glycine allele was associated with a greater reduction in D2/3 receptor binding (i.e., increased reward-related DA release) in the middle (anterior) caudate (p<0.01) and the ventral striatum (p<0.05). The possible functional effect of the ser9gly polymorphism on DA release is consistent with previous work demonstrating that the glycine allele yields D3 autoreceptors that have a higher affinity for DA and display more robust intracellular signaling. Preclinical evidence indicates that chronic stress and aversive stimulation induce activation of the DA system, raising the possibility that the glycine allele, by virtue of its facilitatory effect on striatal DA release, increases susceptibility to hyperdopaminergic responses that have previously been associated with stress, addiction, and psychosis. PMID:23365649

Functional changes of the reward system underlie blunted response to social gaze in cocaine users

PubMed Central

Preller, Katrin H.; Herdener, Marcus; Schilbach, Leonhard; Stämpfli, Philipp; Hulka, Lea M.; Vonmoos, Matthias; Ingold, Nina; Vogeley, Kai; Tobler, Philippe N.; Seifritz, Erich; Quednow, Boris B.

2014-01-01

Social interaction deficits in drug users likely impede treatment, increase the burden of the affected families, and consequently contribute to the high costs for society associated with addiction. Despite its significance, the neural basis of altered social interaction in drug users is currently unknown. Therefore, we investigated basal social gaze behavior in cocaine users by applying behavioral, psychophysiological, and functional brain-imaging methods. In study I, 80 regular cocaine users and 63 healthy controls completed an interactive paradigm in which the participants’ gaze was recorded by an eye-tracking device that controlled the gaze of an anthropomorphic virtual character. Valence ratings of different eye-contact conditions revealed that cocaine users show diminished emotional engagement in social interaction, which was also supported by reduced pupil responses. Study II investigated the neural underpinnings of changes in social reward processing observed in study I. Sixteen cocaine users and 16 controls completed a similar interaction paradigm as used in study I while undergoing functional magnetic resonance imaging. In response to social interaction, cocaine users displayed decreased activation of the medial orbitofrontal cortex, a key region of reward processing. Moreover, blunted activation of the medial orbitofrontal cortex was significantly correlated with a decreased social network size, reflecting problems in real-life social behavior because of reduced social reward. In conclusion, basic social interaction deficits in cocaine users as observed here may arise from altered social reward processing. Consequently, these results point to the importance of reinstatement of social reward in the treatment of stimulant addiction. PMID:24449854

The amount effect and marginal value.

PubMed

Rachlin, Howard; Arfer, Kodi B; Safin, Vasiliy; Yen, Ming

2015-07-01

The amount effect of delay discounting (by which the value of larger reward amounts is discounted by delay at a lower rate than that of smaller amounts) strictly implies that value functions (value as a function of amount) are steeper at greater delays than they are at lesser delays. That is, the amount effect and the difference in value functions at different delays are actually a single empirical finding. Amount effects of delay discounting are typically found with choice experiments. Value functions for immediate rewards have been empirically obtained by direct judgment. (Value functions for delayed rewards have not been previously obtained.) The present experiment obtained value functions for both immediate and delayed rewards by direct judgment and found them to be steeper when the rewards were delayed--hence, finding an amount effect with delay discounting. © Society for the Experimental Analysis of Behavior.

QUICR-learning for Multi-Agent Coordination

NASA Technical Reports Server (NTRS)

Agogino, Adrian K.; Tumer, Kagan

2006-01-01

Coordinating multiple agents that need to perform a sequence of actions to maximize a system level reward requires solving two distinct credit assignment problems. First, credit must be assigned for an action taken at time step t that results in a reward at time step t > t. Second, credit must be assigned for the contribution of agent i to the overall system performance. The first credit assignment problem is typically addressed with temporal difference methods such as Q-learning. The second credit assignment problem is typically addressed by creating custom reward functions. To address both credit assignment problems simultaneously, we propose the "Q Updates with Immediate Counterfactual Rewards-learning" (QUICR-learning) designed to improve both the convergence properties and performance of Q-learning in large multi-agent problems. QUICR-learning is based on previous work on single-time-step counterfactual rewards described by the collectives framework. Results on a traffic congestion problem shows that QUICR-learning is significantly better than a Q-learner using collectives-based (single-time-step counterfactual) rewards. In addition QUICR-learning provides significant gains over conventional and local Q-learning. Additional results on a multi-agent grid-world problem show that the improvements due to QUICR-learning are not domain specific and can provide up to a ten fold increase in performance over existing methods.

Cigarette craving is associated with blunted reward processing in nicotine-dependent smokers.

PubMed

Peechatka, Alyssa L; Whitton, Alexis E; Farmer, Stacey L; Pizzagalli, Diego A; Janes, Amy C

2015-10-01

Dysfunctional reward processing leading to the undervaluation of non-drug rewards is hypothesized to play a crucial role in nicotine dependence. However, it is unclear if blunted reward responsivity and the desire to use nicotine are directly linked after a brief period of abstinence. Such an association would suggest that individuals with reduced reward responsivity may be at increased risk to experience nicotine craving. Reward function was evaluated with a probabilistic reward task (PRT), which measures reward responsivity to monetary incentives. To identify whether smoking status influenced reward function, PRT performance was compared between non-depressed, nicotine-dependent smokers and non-smokers. Within smokers, correlations were conducted to determine if blunted reward responsivity on the PRT was associated with increased nicotine craving. Time since last nicotine exposure was standardized to 4h for all smokers. Smokers and non-smokers did not differ in reward responsivity on the PRT. However, within smokers, a significant negative correlation was found between reward responsivity and intensity of nicotine craving. The current findings show that, among smokers, the intensity of nicotine craving is linked to lower sensitivity to non-drug rewards. This finding is in line with prior theories that suggest reward dysfunction in some clinical populations (e.g., depressive disorders, schizophrenia) may facilitate nicotine use. The current study expands on such theories by indicating that sub-clinical variations in reward function are related to motivation for nicotine use. Identifying smokers who show blunted sensitivity to non-drug rewards may help guide treatments aimed at mitigating the motivation to smoke. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Taking two to tango: a role for ghrelin receptor heterodimerization in stress and reward.

PubMed

Schellekens, Harriët; Dinan, Timothy G; Cryan, John F

2013-08-30

The gut hormone, ghrelin, is the only known peripherally derived orexigenic signal. It activates its centrally expressed receptor, the growth hormone secretagogue receptor (GHS-R1a), to stimulate food intake. The ghrelin signaling system has recently been suggested to play a key role at the interface of homeostatic control of appetite and the hedonic aspects of food intake, as a critical role for ghrelin in dopaminergic mesolimbic circuits involved in reward signaling has emerged. Moreover, enhanced plasma ghrelin levels are associated with conditions of physiological stress, which may underline the drive to eat calorie-dense "comfort-foods" and signifies a role for ghrelin in stress-induced food reward behaviors. These complex and diverse functionalities of the ghrelinergic system are not yet fully elucidated and likely involve crosstalk with additional signaling systems. Interestingly, accumulating data over the last few years has shown the GHS-R1a receptor to dimerize with several additional G-protein coupled receptors (GPCRs) involved in appetite signaling and reward, including the GHS-R1b receptor, the melanocortin 3 receptor (MC3), dopamine receptors (D1 and D2), and more recently, the serotonin 2C receptor (5-HT2C). GHS-R1a dimerization was shown to affect downstream signaling and receptor trafficking suggesting a potential novel mechanism for fine-tuning GHS-R1a receptor mediated activity. This review summarizes ghrelin's role in food reward and stress and outlines the GHS-R1a dimer pairs identified to date. In addition, the downstream signaling and potential functional consequences of dimerization of the GHS-R1a receptor in appetite and stress-induced food reward behavior are discussed. The existence of multiple GHS-R1a heterodimers has important consequences for future pharmacotherapies as it significantly increases the pharmacological diversity of the GHS-R1a receptor and has the potential to enhance specificity of novel ghrelin-targeted drugs.

Taking two to tango: a role for ghrelin receptor heterodimerization in stress and reward

PubMed Central

Schellekens, Harriët; Dinan, Timothy G.; Cryan, John F.

2013-01-01

The gut hormone, ghrelin, is the only known peripherally derived orexigenic signal. It activates its centrally expressed receptor, the growth hormone secretagogue receptor (GHS-R1a), to stimulate food intake. The ghrelin signaling system has recently been suggested to play a key role at the interface of homeostatic control of appetite and the hedonic aspects of food intake, as a critical role for ghrelin in dopaminergic mesolimbic circuits involved in reward signaling has emerged. Moreover, enhanced plasma ghrelin levels are associated with conditions of physiological stress, which may underline the drive to eat calorie-dense “comfort-foods” and signifies a role for ghrelin in stress-induced food reward behaviors. These complex and diverse functionalities of the ghrelinergic system are not yet fully elucidated and likely involve crosstalk with additional signaling systems. Interestingly, accumulating data over the last few years has shown the GHS-R1a receptor to dimerize with several additional G-protein coupled receptors (GPCRs) involved in appetite signaling and reward, including the GHS-R1b receptor, the melanocortin 3 receptor (MC3), dopamine receptors (D1 and D2), and more recently, the serotonin 2C receptor (5-HT2C). GHS-R1a dimerization was shown to affect downstream signaling and receptor trafficking suggesting a potential novel mechanism for fine-tuning GHS-R1a receptor mediated activity. This review summarizes ghrelin's role in food reward and stress and outlines the GHS-R1a dimer pairs identified to date. In addition, the downstream signaling and potential functional consequences of dimerization of the GHS-R1a receptor in appetite and stress-induced food reward behavior are discussed. The existence of multiple GHS-R1a heterodimers has important consequences for future pharmacotherapies as it significantly increases the pharmacological diversity of the GHS-R1a receptor and has the potential to enhance specificity of novel ghrelin-targeted drugs. PMID:24009547

Inducing Negative Affect Increases the Reward Value of Appetizing Foods in Dieters

PubMed Central

Wagner, Dylan D.; Boswell, Rebecca G.; Kelley, William M.; Heatherton, Todd F.

2013-01-01

Experiencing negative affect frequently precedes lapses in self-control for dieters, smokers, and drug addicts. Laboratory research has similarly shown that inducing negative emotional distress increases the consumption of food or drugs. One hypothesis for this finding is that emotional distress sensitizes the brain’s reward system to appetitive stimuli. Using functional neuroimaging, we demonstrate that inducing negative affect in chronic dieters increases activity in brain regions representing the reward value of appetitive stimuli when viewing appetizing food cues. Thirty female chronic dieters were randomly assigned to receive either a negative (n = 15) or neutral mood induction (n = 15) immediately followed by exposure to images of appetizing foods and natural scenes during functional magnetic resonance imaging (fMRI). Compared to chronic dieters in a neutral mood, those receiving a negative mood induction showed increased activity in the orbitofrontal cortex to appetizing food images. In addition, activity to food images in the orbitofrontal cortex and ventral striatum was correlated with individual differences in the degree to which the negative mood induction decreased participants’ self-esteem. These findings suggest that distress sensitizes the brain’s reward system to appetitive cues thereby offering a mechanism for the oft-observed relationship between negative affect and disinhibited eating. PMID:22524295

Reward processing in the value-driven attention network: reward signals tracking cue identity and location.

PubMed

Anderson, Brian A

2017-03-01

Through associative reward learning, arbitrary cues acquire the ability to automatically capture visual attention. Previous studies have examined the neural correlates of value-driven attentional orienting, revealing elevated activity within a network of brain regions encompassing the visual corticostriatal loop [caudate tail, lateral occipital complex (LOC) and early visual cortex] and intraparietal sulcus (IPS). Such attentional priority signals raise a broader question concerning how visual signals are combined with reward signals during learning to create a representation that is sensitive to the confluence of the two. This study examines reward signals during the cued reward training phase commonly used to generate value-driven attentional biases. High, compared with low, reward feedback preferentially activated the value-driven attention network, in addition to regions typically implicated in reward processing. Further examination of these reward signals within the visual system revealed information about the identity of the preceding cue in the caudate tail and LOC, and information about the location of the preceding cue in IPS, while early visual cortex represented both location and identity. The results reveal teaching signals within the value-driven attention network during associative reward learning, and further suggest functional specialization within different regions of this network during the acquisition of an integrated representation of stimulus value. © The Author (2016). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Orbitofrontal overactivation in reward processing in borderline personality disorder: the role of non-suicidal self-injury.

PubMed

Vega, Daniel; Ripollés, Pablo; Soto, Àngel; Torrubia, Rafael; Ribas, Joan; Monreal, Jose Antonio; Pascual, Juan Carlos; Salvador, Raymond; Pomarol-Clotet, Edith; Rodríguez-Fornells, Antoni; Marco-Pallarés, Josep

2018-02-01

Borderline Personality Disorder (BPD) is a disabling and difficult-to-treat mental disease. One of its core features is a significant difficulty in affect regulation, which is often accompanied by Non-Suicidal Self-Injury (NSSI). It is suggested that this type of behavior elicits positive emotions and mitigates emotional distress, and therefore can ultimately be reinforced and promoted. In spite of the high prevalence of NSSI behaviors (also in non-BPD samples), their role in modulating reward-related processes has not yet been investigated in BPD patients. In the present study, this lack of research was addressed. A large sample of BPD patients (N = 40), divided into two groups depending on the presence of NSSI, and a group of matched healthy controls underwent functional Magnetic Resonance Imaging (fMRI) while performing a gambling task. Patients who committed NSSI acts exhibited enhanced activation of the orbitofrontal cortex following an unexpected reward, when compared with controls and BPD patients with no NSSI behavior. In addition, the NSSI group showed diminished functional connectivity between the left orbitofrontal cortex and the right parahippocampal gyrus. These findings might suggest impaired ability to update reward associations of potential choices when both BPD and NSSI are present. We propose that the presence of NSSI involves alterations in the reward system independently of BPD, and thus can be considered as a possible phenotype for reward-related alterations.

The neurobiology of reward and cognitive control systems and their role in incentivizing health behavior.

PubMed

Garavan, Hugh; Weierstall, Karen

2012-11-01

This article reviews the neurobiology of cognitive control and reward processes and addresses their role in the treatment of addiction. We propose that the neurobiological mechanisms involved in treatment may differ from those involved in the etiology of addiction and consequently are worthy of increased investigation. We review the literature on reward and control processes and evidence of differences in these systems in drug addicted individuals. We also review the relatively small literature on neurobiological predictors of abstinence. We conclude that prefrontal control systems may be central to a successful recovery from addiction. The frontal lobes have been shown to regulate striatal reward-related processes, to be among the regions that predict treatment outcome, and to show elevated functioning in those who have succeeded in maintaining abstinence. The evidence of the involvement of the frontal lobes in recovery is consistent with the hypothesis that recovery is a distinct process that is more than the undoing of those processes involved in becoming addicted and a return to the pre-addiction state of the individual. The extent to which these frontal systems are engaged by treatment interventions may contribute to their efficacy. Copyright © 2012 Elsevier Inc. All rights reserved.

Graded Multiple Choice Questions: Rewarding Understanding and Preventing Plagiarism

NASA Astrophysics Data System (ADS)

Denyer, G. S.; Hancock, D.

2002-08-01

This paper describes an easily implemented method that allows the generation and analysis of graded multiple-choice examinations. The technique, which uses standard functions in user-end software (Microsoft Excel 5+), can also produce several different versions of an examination that can be employed to prevent the reward of plagarism. The manuscript also discusses the advantages of having a graded marking system for the elimination of ambiguities, use in multi-step calculation questions, and questions that require extrapolation or reasoning. The advantages of the scrambling strategy, which maintains the same question order, is discussed with reference to student equity. The system provides a non-confrontational mechanism for dealing with cheating in large-class multiple-choice examinations, as well as providing a reward for problem solving over surface learning.

Aberrant mesolimbic dopamine-opiate interaction in obesity.

PubMed

Tuominen, Lauri; Tuulari, Jetro; Karlsson, Henry; Hirvonen, Jussi; Helin, Semi; Salminen, Paulina; Parkkola, Riitta; Hietala, Jarmo; Nuutila, Pirjo; Nummenmaa, Lauri

2015-11-15

Dopamine and opioid neurotransmitter systems share many functions such as regulation of reward and pleasure. μ-Opioid receptors (MOR) modulate the mesolimbic dopamine system in ventral tegmental area and striatum, key areas implicated in reward. We hypothesized that dopamine and opioid receptor availabilities correlate in vivo and that this correlation is altered in obesity, a disease with altered reward processing. Twenty lean females (mean BMI 22) and 25 non-binge eating morbidly obese females (mean BMI 41) underwent two positron emission tomography scans with [(11)C]carfentanil and [(11)C]raclopride to measure the MOR and dopamine D2 receptor (DRD2) availability, respectively. In lean subjects, the MOR and DRD2 availabilities were positively associated in the ventral striatum (r=0.62, p=0.003) and dorsal caudate nucleus (r=0.62, p=0.004). Moreover, DRD2 availability in the ventral striatum was associated with MOR availability in other regions of the reward circuitry, particularly in the ventral tegmental area. In morbidly obese subjects, this receptor interaction was significantly weaker in ventral striatum but unaltered in the caudate nucleus. Finally, the association between DRD2 availability in the ventral striatum and MOR availability in the ventral tegmental area was abolished in the morbidly obese. The study demonstrates a link between DRD2 and MOR availabilities in living human brain. This interaction is selectively disrupted in mesolimbic dopamine system in morbid obesity. We propose that interaction between the dopamine and opioid systems is a prerequisite for normal reward processing and that disrupted cross-talk may underlie altered reward processing in obesity. Copyright © 2015 Elsevier Inc. All rights reserved.

Reward from bugs to bipeds: a comparative approach to understanding how reward circuits function

PubMed Central

Scaplen, Kristin M.; Kaun, Karla R.

2016-01-01

Abstract In a complex environment, animals learn from their responses to stimuli and events. Appropriate response to reward and punishment can promote survival, reproduction and increase evolutionary fitness. Interestingly, the neural processes underlying these responses are remarkably similar across phyla. In all species, dopamine is central to encoding reward and directing motivated behaviors, however, a comprehensive understanding of how circuits encode reward and direct motivated behaviors is still lacking. In part, this is a result of the sheer diversity of neurons, the heterogeneity of their responses and the complexity of neural circuits within which they are found. We argue that general features of reward circuitry are common across model organisms, and thus principles learned from invertebrate model organisms can inform research across species. In particular, we discuss circuit motifs that appear to be functionally equivalent from flies to primates. We argue that a comparative approach to studying and understanding reward circuit function provides a more comprehensive understanding of reward circuitry, and informs disorders that affect the brain’s reward circuitry. PMID:27328845

Neurocircuitry of drug reward

PubMed Central

Ikemoto, Satoshi; Bonci, Antonello

2013-01-01

In recent years, neuroscientists have produced profound conceptual and mechanistic advances on the neurocircuitry of reward and substance use disorders. Here, we will provide a brief review of intracranial drug self-administration and optogenetic self-stimulation studies that identified brain regions and neurotransmitter systems involved in drug- and reward-related behaviors. Also discussed is a theoretical framework that helps to understand the functional properties of the circuitry involved in these behaviors. The circuitry appears to be homeostatically regulated and mediate anticipatory processes that regulate behavioral interaction with the environment in response to salient stimuli. That is, abused drugs or, at least, some may act on basic motivation and mood processes, regulating behavior-environment interaction. Optogenetics and related technologies have begun to uncover detailed circuit mechanisms linking key brain regions in which abused drugs act for rewarding effects. PMID:23664810

Life stress in adolescence predicts early adult reward-related brain function and alcohol dependence

PubMed Central

Shaw, Daniel S.; Sitnick, Stephanie L.; Musselman, Samuel C.; Forbes, Erika E.

2015-01-01

Stressful life events increase vulnerability to problematic alcohol use, and they may do this by disrupting reward-related neural circuitry. This is particularly relevant for adolescents because alcohol use rises sharply after mid-adolescence and alcohol abuse peaks at age 20. Adolescents also report more stressors compared with children, and neural reward circuitry may be especially vulnerable to stressors during adolescence because of prefrontal cortex remodeling. Using a large sample of male participants in a longitudinal functional magnetic resonance imaging study (N = 157), we evaluated whether cumulative stressful life events between the ages of 15 and 18 were associated with reward-related brain function and problematic alcohol use at age 20 years. Higher cumulative stressful life events during adolescence were associated with decreased response in the medial prefrontal cortex (mPFC) during monetary reward anticipation and following the receipt of monetary rewards. Stress-related decreases in mPFC response during reward anticipation and following rewarding outcomes were associated with the severity of alcohol dependence. Furthermore, mPFC response mediated the association between stressful life events and later symptoms of alcohol dependence. These data are consistent with neurobiological models of addiction that propose that stressors during adolescence increase risk for problematic alcohol use by disrupting reward circuit function. PMID:24795442

Reward loss and the basolateral amygdala: A function in reward comparisons.

PubMed

Kawasaki, Katsuyoshi; Annicchiarico, Iván; Glueck, Amanda C; Morón, Ignacio; Papini, Mauricio R

2017-07-28

The neural circuitry underlying behavior in reward loss situations is poorly understood. We considered two such situations: reward devaluation (from large to small rewards) and reward omission (from large rewards to no rewards). There is evidence that the central nucleus of the amygdala (CeA) plays a role in the negative emotion accompanying reward loss. However, little is known about the function of the basolateral nucleus (BLA) in reward loss. Two hypotheses of BLA function in reward loss, negative emotion and reward comparisons, were tested in an experiment involving pretraining excitotoxic BLA lesions followed by training in four tasks: consummatory successive negative contrast (cSNC), autoshaping (AS) acquisition and extinction, anticipatory negative contrast (ANC), and open field testing (OF). Cell counts in the BLA (but not in the CeA) were significantly lower in animals with lesions vs. shams. BLA lesions eliminated cSNC and ANC, and accelerated extinction of lever pressing in AS. BLA lesions had no effect on OF testing: higher activity in the periphery than in the central area. This pattern of results provides support for the hypothesis that BLA neurons are important for reward comparison. The three affected tasks (cSNC, ANC, and AS extinction) involve reward comparisons. However, ANC does not seem to involve negative emotions and it was affected, whereas OF activity is known to involve negative emotion, but it was not affected. It is hypothesized that a circuit involving the thalamus, insular cortex, and BLA is critically involved in the mechanism comparing current and expected rewards. Copyright © 2017 Elsevier B.V. All rights reserved.

Discrete coding of stimulus value, reward expectation, and reward prediction error in the dorsal striatum.

PubMed

Oyama, Kei; Tateyama, Yukina; Hernádi, István; Tobler, Philippe N; Iijima, Toshio; Tsutsui, Ken-Ichiro

2015-11-01

To investigate how the striatum integrates sensory information with reward information for behavioral guidance, we recorded single-unit activity in the dorsal striatum of head-fixed rats participating in a probabilistic Pavlovian conditioning task with auditory conditioned stimuli (CSs) in which reward probability was fixed for each CS but parametrically varied across CSs. We found that the activity of many neurons was linearly correlated with the reward probability indicated by the CSs. The recorded neurons could be classified according to their firing patterns into functional subtypes coding reward probability in different forms such as stimulus value, reward expectation, and reward prediction error. These results suggest that several functional subgroups of dorsal striatal neurons represent different kinds of information formed through extensive prior exposure to CS-reward contingencies. Copyright © 2015 the American Physiological Society.

Discrete coding of stimulus value, reward expectation, and reward prediction error in the dorsal striatum

PubMed Central

Oyama, Kei; Tateyama, Yukina; Hernádi, István; Tobler, Philippe N.; Iijima, Toshio

2015-01-01

To investigate how the striatum integrates sensory information with reward information for behavioral guidance, we recorded single-unit activity in the dorsal striatum of head-fixed rats participating in a probabilistic Pavlovian conditioning task with auditory conditioned stimuli (CSs) in which reward probability was fixed for each CS but parametrically varied across CSs. We found that the activity of many neurons was linearly correlated with the reward probability indicated by the CSs. The recorded neurons could be classified according to their firing patterns into functional subtypes coding reward probability in different forms such as stimulus value, reward expectation, and reward prediction error. These results suggest that several functional subgroups of dorsal striatal neurons represent different kinds of information formed through extensive prior exposure to CS-reward contingencies. PMID:26378201

Neural and personality correlates of individual differences related to the effects of acute tryptophan depletion on future reward evaluation.

PubMed

Demoto, Yoshihiko; Okada, Go; Okamoto, Yasumasa; Kunisato, Yoshihiko; Aoyama, Shiori; Onoda, Keiichi; Munakata, Ayumi; Nomura, Michio; Tanaka, Saori C; Schweighofer, Nicolas; Doya, Kenji; Yamawaki, Shigeto

2012-01-01

In general, humans tend to discount the value of delayed reward. An increase in the rate of discounting leads to an inability to select a delayed reward over a smaller immediate reward (reward-delay impulsivity). Although deficits in the serotonergic system are implicated in this reward-delay impulsivity, there is individual variation in response to serotonin depletion. The aim of the present study was to investigate whether the effects of serotonin depletion on the ability to evaluate future reward are affected by individual personality traits or brain activation. Personality traits were assessed using the NEO-Five Factor Inventory and Temperament and Character Inventory. The central serotonergic levels of 16 healthy volunteers were manipulated by dietary tryptophan depletion. Subjects performed a delayed reward choice task that required the continuous estimation of reward value during functional magnetic resonance imaging scanning. Discounting rates were increased in 9 participants, but were unchanged or decreased in 7 participants in response to tryptophan depletion. Participants whose discounting rate was increased by tryptophan depletion had significantly higher neuroticism and lower self-directedness. Furthermore, tryptophan depletion differentially affected the groups in terms of hemodynamic responses to the value of predicted future reward in the right insula. These results suggest that individuals who have high neuroticism and low self-directedness as personality traits are particularly vulnerable to the effect of low serotonin on future reward evaluation accompanied by altered brain activation patterns. Copyright © 2012 S. Karger AG, Basel.

A measurement-based performability model for a multiprocessor system

NASA Technical Reports Server (NTRS)

Ilsueh, M. C.; Iyer, Ravi K.; Trivedi, K. S.

1987-01-01

A measurement-based performability model based on real error-data collected on a multiprocessor system is described. Model development from the raw errror-data to the estimation of cumulative reward is described. Both normal and failure behavior of the system are characterized. The measured data show that the holding times in key operational and failure states are not simple exponential and that semi-Markov process is necessary to model the system behavior. A reward function, based on the service rate and the error rate in each state, is then defined in order to estimate the performability of the system and to depict the cost of different failure types and recovery procedures.

Insulin, Central Dopamine D2 Receptors, and Monetary Reward Discounting in Obesity

PubMed Central

Eisenstein, Sarah A.; Gredysa, Danuta M.; Antenor–Dorsey, Jo Ann; Green, Leonard; Arbeláez, Ana Maria; Koller, Jonathan M.; Black, Kevin J.; Perlmutter, Joel S.; Moerlein, Stephen M.; Hershey, Tamara

2015-01-01

Animal research finds that insulin regulates dopamine signaling and reward behavior, but similar research in humans is lacking. We investigated whether individual differences in body mass index, percent body fat, pancreatic β-cell function, and dopamine D2 receptor binding were related to reward discounting in obese and non-obese adult men and women. Obese (n = 27; body mass index>30) and non-obese (n = 20; body mass index<30) adults were assessed for percent body fat with dual-energy X-ray absorptiometry and for β-cell function using disposition index. Choice of larger, but delayed or less certain, monetary rewards relative to immediate, certain smaller monetary rewards was measured using delayed and probabilistic reward discounting tasks. Positron emission tomography using a non-displaceable D2-specific radioligand, [11C](N-methyl)benperidol quantified striatal D2 receptor binding. Groups differed in body mass index, percent body fat, and disposition index, but not in striatal D2 receptor specific binding or reward discounting. Higher percent body fat in non-obese women related to preference for a smaller, certain reward over a larger, less likely one (greater probabilistic discounting). Lower β-cell function in the total sample and lower insulin sensitivity in obese related to stronger preference for an immediate and smaller monetary reward over delayed receipt of a larger one (greater delay discounting). In obese adults, higher striatal D2 receptor binding related to greater delay discounting. Interestingly, striatal D2 receptor binding was not significantly related to body mass index, percent body fat, or β-cell function in either group. Our findings indicate that individual differences in percent body fat, β-cell function, and striatal D2 receptor binding may each contribute to altered reward discounting behavior in non-obese and obese individuals. These results raise interesting questions about whether and how striatal D2 receptor binding and metabolic factors, including β-cell function, interact to affect reward discounting in humans. PMID:26192187

Insulin, Central Dopamine D2 Receptors, and Monetary Reward Discounting in Obesity.

PubMed

Eisenstein, Sarah A; Gredysa, Danuta M; Antenor-Dorsey, Jo Ann; Green, Leonard; Arbeláez, Ana Maria; Koller, Jonathan M; Black, Kevin J; Perlmutter, Joel S; Moerlein, Stephen M; Hershey, Tamara

2015-01-01

Animal research finds that insulin regulates dopamine signaling and reward behavior, but similar research in humans is lacking. We investigated whether individual differences in body mass index, percent body fat, pancreatic β-cell function, and dopamine D2 receptor binding were related to reward discounting in obese and non-obese adult men and women. Obese (n = 27; body mass index>30) and non-obese (n = 20; body mass index<30) adults were assessed for percent body fat with dual-energy X-ray absorptiometry and for β-cell function using disposition index. Choice of larger, but delayed or less certain, monetary rewards relative to immediate, certain smaller monetary rewards was measured using delayed and probabilistic reward discounting tasks. Positron emission tomography using a non-displaceable D2-specific radioligand, [11C](N-methyl)benperidol quantified striatal D2 receptor binding. Groups differed in body mass index, percent body fat, and disposition index, but not in striatal D2 receptor specific binding or reward discounting. Higher percent body fat in non-obese women related to preference for a smaller, certain reward over a larger, less likely one (greater probabilistic discounting). Lower β-cell function in the total sample and lower insulin sensitivity in obese related to stronger preference for an immediate and smaller monetary reward over delayed receipt of a larger one (greater delay discounting). In obese adults, higher striatal D2 receptor binding related to greater delay discounting. Interestingly, striatal D2 receptor binding was not significantly related to body mass index, percent body fat, or β-cell function in either group. Our findings indicate that individual differences in percent body fat, β-cell function, and striatal D2 receptor binding may each contribute to altered reward discounting behavior in non-obese and obese individuals. These results raise interesting questions about whether and how striatal D2 receptor binding and metabolic factors, including β-cell function, interact to affect reward discounting in humans.

Incorporating Target Priorities in the Sensor Tasking Reward Function

NASA Astrophysics Data System (ADS)

Gehly, S.; Bennett, J.

2016-09-01

Orbital debris tracking poses many challenges, most fundamentally the need to track a large number of objects from a limited number of sensors. The use of information theoretic sensor allocation provides a means to efficiently collect data on the multitarget system. An additional need of the community is the ability to specify target priorities, driven both by user needs and environmental factors such as collision warnings. This research develops a method to incorporate target priorities in the sensor tasking reward function, allowing for several applications in different tasking modes such as catalog maintenance, calibration, and collision monitoring. A set of numerical studies is included to demonstrate the functionality of the method.

The endocannabinoid system in brain reward processes.

PubMed

Solinas, M; Goldberg, S R; Piomelli, D

2008-05-01

Food, drugs and brain stimulation can serve as strong rewarding stimuli and are all believed to activate common brain circuits that evolved in mammals to favour fitness and survival. For decades, endogenous dopaminergic and opioid systems have been considered the most important systems in mediating brain reward processes. Recent evidence suggests that the endogenous cannabinoid (endocannabinoid) system also has an important role in signalling of rewarding events. First, CB(1) receptors are found in brain areas involved in reward processes, such as the dopaminergic mesolimbic system. Second, activation of CB(1) receptors by plant-derived, synthetic or endogenous CB(1) receptor agonists stimulates dopaminergic neurotransmission, produces rewarding effects and increases rewarding effects of abused drugs and food. Third, pharmacological or genetic blockade of CB(1) receptors prevents activation of dopaminergic neurotransmission by several addictive drugs and reduces rewarding effects of food and these drugs. Fourth, brain levels of the endocannabinoids anandamide and 2-arachidonoylglycerol are altered by activation of reward processes. However, the intrinsic activity of the endocannabinoid system does not appear to play a facilitatory role in brain stimulation reward and some evidence suggests it may even oppose it. The influence of the endocannabinoid system on brain reward processes may depend on the degree of activation of the different brain areas involved and might represent a mechanism for fine-tuning dopaminergic activity. Although involvement of the various components of the endocannabinoid system may differ depending on the type of rewarding event investigated, this system appears to play a major role in modulating reward processes.

Cocaine affects foraging behaviour and biogenic amine modulated behavioural reflexes in honey bees.

PubMed

Søvik, Eirik; Even, Naïla; Radford, Catherine W; Barron, Andrew B

2014-01-01

In humans and other mammals, drugs of abuse alter the function of biogenic amine pathways in the brain leading to the subjective experience of reward and euphoria. Biogenic amine pathways are involved in reward processing across diverse animal phyla, however whether cocaine acts on these neurochemical pathways to cause similar rewarding behavioural effects in animal phyla other than mammals is unclear. Previously, it has been shown that bees are more likely to dance (a signal of perceived reward) when returning from a sucrose feeder after cocaine treatment. Here we examined more broadly whether cocaine altered reward-related behaviour, and biogenic amine modulated behavioural responses in bees. Bees developed a preference for locations at which they received cocaine, and when foraging at low quality sucrose feeders increase their foraging rate in response to cocaine treatment. Cocaine also increased reflexive proboscis extension to sucrose, and sting extension to electric shock. Both of these simple reflexes are modulated by biogenic amines. This shows that systemic cocaine treatment alters behavioural responses that are modulated by biogenic amines in insects. Since insect reward responses involve both octopamine and dopamine signalling, we conclude that cocaine treatment altered diverse reward-related aspects of behaviour in bees. We discuss the implications of these results for understanding the ecology of cocaine as a plant defence compound. Our findings further validate the honey bee as a model system for understanding the behavioural impacts of cocaine, and potentially other drugs of abuse.

Potential effects of reward and loss avoidance in overweight adolescents.

PubMed

Reyes, Sussanne; Peirano, Patricio; Luna, Beatriz; Lozoff, Betsy; Algarín, Cecilia

2015-08-01

Reward system and inhibitory control are brain functions that exert an influence on eating behavior regulation. We studied the differences in inhibitory control and sensitivity to reward and loss avoidance between overweight/obese and normal-weight adolescents. We assessed 51 overweight/obese and 52 normal-weight 15-y-old Chilean adolescents. The groups were similar regarding sex and intelligence quotient. Using Antisaccade and Incentive tasks, we evaluated inhibitory control and the effect of incentive trials (neutral, loss avoidance, and reward) on generating correct and incorrect responses (latency and error rate). Compared to normal-weight group participants, overweight/obese adolescents showed shorter latency for incorrect antisaccade responses (186.0 (95% CI: 176.8-195.2) vs. 201.3 ms (95% CI: 191.2-211.5), P < 0.05) and better performance reflected by lower error rate in incentive trials (43.6 (95% CI: 37.8-49.4) vs. 53.4% (95% CI: 46.8-60.0), P < 0.05). Overweight/obese adolescents were more accurate on loss avoidance (40.9 (95% CI: 33.5-47.7) vs. 49.8% (95% CI: 43.0-55.1), P < 0.05) and reward (41.0 (95% CI: 34.5-47.5) vs. 49.8% (95% CI: 43.0-55.1), P < 0.05) compared to neutral trials. Overweight/obese adolescents showed shorter latency for incorrect responses and greater accuracy in reward and loss avoidance trials. These findings could suggest that an imbalance of inhibition and reward systems influence their eating behavior.

Reward-based contextual learning supported by anterior cingulate cortex.

PubMed

Umemoto, Akina; HajiHosseini, Azadeh; Yates, Michael E; Holroyd, Clay B

2017-06-01

The anterior cingulate cortex (ACC) is commonly associated with cognitive control and decision making, but its specific function is highly debated. To explore a recent theory that the ACC learns the reward values of task contexts (Holroyd & McClure in Psychological Review, 122, 54-83, 2015; Holroyd & Yeung in Trends in Cognitive Sciences, 16, 122-128, 2012), we recorded the event-related brain potentials (ERPs) from participants as they played a novel gambling task. The participants were first required to select from among three games in one "virtual casino," and subsequently they were required to select from among three different games in a different virtual casino; unbeknownst to them, the payoffs for the games were higher in one casino than in the other. Analysis of the reward positivity, an ERP component believed to reflect reward-related signals carried to the ACC by the midbrain dopamine system, revealed that the ACC is sensitive to differences in the reward values associated with both the casinos and the games inside the casinos, indicating that participants learned the values of the contexts in which rewards were delivered. These results highlight the importance of the ACC in learning the reward values of task contexts in order to guide action selection.

A test of the reward-contrast hypothesis.

PubMed

Dalecki, Stefan J; Panoz-Brown, Danielle E; Crystal, Jonathon D

2017-12-01

Source memory, a facet of episodic memory, is the memory of the origin of information. Whereas source memory in rats is sustained for at least a week, spatial memory degraded after approximately a day. Different forgetting functions may suggest that two memory systems (source memory and spatial memory) are dissociated. However, in previous work, the two tasks used baiting conditions consisting of chocolate and chow flavors; notably, the source memory task used the relatively better flavor. Thus, according to the reward-contrast hypothesis, when chocolate and chow were presented within the same context (i.e., within a single radial maze trial), the chocolate location was more memorable than the chow location because of contrast. We tested the reward-contrast hypothesis using baiting configurations designed to produce reward-contrast. The reward-contrast hypothesis predicts that under these conditions, spatial memory will survive a 24-h retention interval. We documented elimination of spatial memory performance after a 24-h retention interval using a reward-contrast baiting pattern. These data suggest that reward contrast does not explain our earlier findings that source memory survives unusually long retention intervals. Copyright © 2017 Elsevier B.V. All rights reserved.

Revealing the paradox of drug reward in human evolution

PubMed Central

Sullivan, Roger J; Hagen, Edward H; Hammerstein, Peter

2008-01-01

Neurobiological models of drug abuse propose that drug use is initiated and maintained by rewarding feedback mechanisms. However, the most commonly used drugs are plant neurotoxins that evolved to punish, not reward, consumption by animal herbivores. Reward models therefore implicitly assume an evolutionary mismatch between recent drug-profligate environments and a relatively drug-free past in which a reward centre, incidentally vulnerable to neurotoxins, could evolve. By contrast, emerging insights from plant evolutionary ecology and the genetics of hepatic enzymes, particularly cytochrome P450, indicate that animal and hominid taxa have been exposed to plant toxins throughout their evolution. Specifically, evidence of conserved function, stabilizing selection, and population-specific selection of human cytochrome P450 genes indicate recent evolutionary exposure to plant toxins, including those that affect animal nervous systems. Thus, the human propensity to seek out and consume plant neurotoxins is a paradox with far-reaching implications for current drug-reward theory. We sketch some potential resolutions of the paradox, including the possibility that humans may have evolved to counter-exploit plant neurotoxins. Resolving the paradox of drug reward will require a synthesis of ecological and neurobiological perspectives of drug seeking and use. PMID:18353749

Endocannabinoid Signaling in Motivation, Reward, and Addiction: Influences on Mesocorticolimbic Dopamine Function.

PubMed

Sagheddu, Claudia; Muntoni, Anna Lisa; Pistis, Marco; Melis, Miriam

2015-01-01

Evidence suggests that the endocannabinoid system has been conserved in the animal kingdom for 500 million years, and this system influences many critical behavioral processes including associative learning, reward signaling, goal-directed behavior, motor skill learning, and action-habit transformation. Additionally, the neurotransmitter dopamine has long been recognized to play a critical role in the processing of natural rewards, as well as of motivation that regulates approach and avoidance behavior. This motivational role of dopamine neurons is also based upon the evidence provided by several studies investigating disorders of dopamine pathways such as drug addiction and Parkinson's disease. From an evolutionary point of view, individuals engage in behaviors aimed at maximizing and minimizing positive and aversive consequences, respectively. Accordingly, those with the greatest fitness have a better potential to survival. Hence, deviations from fitness can be viewed as a part of the evolutionary process by means of natural selection. Given the long evolutionary history of both the endocannabinoid and dopaminergic systems, it is plausible that they must serve as fundamental and basic modulators of physiological functions and needs. Notably, endocannabinoids regulate dopamine neuronal activity and its influence on behavioral output. The goal of this chapter is to examine the endocannabinoid influence on dopamine signaling specifically related to (i) those behavioral processes that allow us to successfully adapt to ever-changing environments (i.e., reward signaling and motivational processes) and (ii) derangements from behavioral flexibility that underpin drug addiction. © 2015 Elsevier Inc. All rights reserved.

Disentangling reward anticipation with simultaneous pupillometry / fMRI.

PubMed

Schneider, Max; Leuchs, Laura; Czisch, Michael; Sämann, Philipp G; Spoormaker, Victor I

2018-05-05

The reward system may provide an interesting intermediate phenotype for anhedonia in affective disorders. Reward anticipation is characterized by an increase in arousal, and previous studies have linked the anterior cingulate cortex (ACC) to arousal responses such as dilation of the pupil. Here, we examined pupil dynamics during a reward anticipation task in forty-six healthy human subjects and evaluated its neural correlates using functional magnetic resonance imaging (fMRI). Pupil size showed a strong increase during monetary reward anticipation, a moderate increase during verbal reward anticipation and a decrease during control trials. For fMRI analyses, average pupil size and pupil change were computed in 1-s time bins during the anticipation phase. Activity in the ventral striatum was inversely related to the pupil size time course, indicating an early onset of activation and a role in reward prediction processing. Pupil dilations were linked to increased activity in the salience network (dorsal ACC and bilateral insula), which likely triggers an increase in arousal to enhance task performance. Finally, increased pupil size preceding the required motor response was associated with activity in the ventral attention network. In sum, pupillometry provides an effective tool for disentangling different phases of reward anticipation, with relevance for affective symptomatology. Copyright © 2018 Elsevier Inc. All rights reserved.

Reward system and temporal pole contributions to affective evaluation during a first person shooter video game

PubMed Central

2011-01-01

Background Violent content in video games evokes many concerns but there is little research concerning its rewarding aspects. It was demonstrated that playing a video game leads to striatal dopamine release. It is unclear, however, which aspects of the game cause this reward system activation and if violent content contributes to it. We combined functional Magnetic Resonance Imaging (fMRI) with individual affect measures to address the neuronal correlates of violence in a video game. Results Thirteen male German volunteers played a first-person shooter game (Tactical Ops: Assault on Terror) during fMRI measurement. We defined success as eliminating opponents, and failure as being eliminated themselves. Affect was measured directly before and after game play using the Positive and Negative Affect Schedule (PANAS). Failure and success events evoked increased activity in visual cortex but only failure decreased activity in orbitofrontal cortex and caudate nucleus. A negative correlation between negative affect and responses to failure was evident in the right temporal pole (rTP). Conclusions The deactivation of the caudate nucleus during failure is in accordance with its role in reward-prediction error: it occurred whenever subject missed an expected reward (being eliminated rather than eliminating the opponent). We found no indication that violence events were directly rewarding for the players. We addressed subjective evaluations of affect change due to gameplay to study the reward system. Subjects reporting greater negative affect after playing the game had less rTP activity associated with failure. The rTP may therefore be involved in evaluating the failure events in a social context, to regulate the players' mood. PMID:21749711

Acute stress-induced cortisol elevations mediate reward system activity during subconscious processing of sexual stimuli.

PubMed

Oei, Nicole Y L; Both, Stephanie; van Heemst, Diana; van der Grond, Jeroen

2014-01-01

Stress is thought to alter motivational processes by increasing dopamine (DA) secretion in the brain's "reward system", and its key region, the nucleus accumbens (NAcc). However, stress studies using functional magnetic resonance imaging (fMRI), mainly found evidence for stress-induced decreases in NAcc responsiveness toward reward cues. Results from both animal and human PET studies indicate that the stress hormone cortisol may be crucial in the interaction between stress and dopaminergic actions. In the present study we therefore investigated whether cortisol mediated the effect of stress on DA-related responses to -subliminal-presentation of reward cues using the Trier Social Stress Test (TSST), which is known to reliably enhance cortisol levels. Young healthy males (n = 37) were randomly assigned to the TSST or control condition. After stress induction, brain activation was assessed using fMRI during a backward-masking paradigm in which potentially rewarding (sexual), emotionally negative and neutral stimuli were presented subliminally, masked by pictures of inanimate objects. A region of interest analysis showed that stress decreased activation in the NAcc in response to masked sexual cues (voxel-corrected, p<05). Furthermore, with mediation analysis it was found that high cortisol levels were related to stronger NAcc activation, showing that cortisol acted as a suppressor variable in the negative relation between stress and NAcc activation. The present findings indicate that cortisol is crucially involved in the relation between stress and the responsiveness of the reward system. Although generally stress decreases activation in the NAcc in response to rewarding stimuli, high stress-induced cortisol levels suppress this relation, and are associated with stronger NAcc activation. Individuals with a high cortisol response to stress might on one hand be protected against reductions in reward sensitivity, which has been linked to anhedonia and depression, but they may ultimately be more vulnerable to increased reward sensitivity, and addictions. Future studies investigating effects of stress on reward sensitivity should take into account the severity of the stressor and the individual cortisol response to stress. Copyright © 2013 Elsevier Ltd. All rights reserved.

A Focus on Reward Prediction and the Lateral Habenula: Functional Alterations and the Behavioral Outcomes Induced by Drugs of Abuse.

PubMed

Graziane, Nicholas M; Neumann, Peter A; Dong, Yan

2018-01-01

The lateral habenula (LHb) regulates reward learning and controls the updating of reward-related information. Drugs of abuse have the capacity to hijack the cellular and neurocircuit mechanisms mediating reward learning, forming non-adaptable, compulsive behaviors geared toward obtaining illicit substances. Here, we discuss current findings demonstrating how drugs of abuse alter intrinsic and synaptic LHb neuronal function. Additionally, we discuss evidence for how drug-induced LHb alterations may affect the ability to predict reward, potentially facilitating an addiction-like state. Altogether, we combine ex vivo and in vivo results for an overview of how drugs of abuse alter LHb function and how these functional alterations affect the ability to learn and update behavioral responses to hedonic external stimuli.

Continuous, but not intermittent, antipsychotic drug delivery intensifies the pursuit of reward cues.

PubMed

Bédard, Anne-Marie; Maheux, Jérôme; Lévesque, Daniel; Samaha, Anne-Noël

2011-05-01

Chronic exposure to antipsychotic medications can persistently change brain dopamine systems. Most studies on the functional significance of these neural changes have focused on motor behavior and few have addressed how long-term antipsychotic treatment might influence dopamine-mediated reward function. We asked, therefore, whether a clinically relevant antipsychotic treatment regimen would alter the incentive motivational properties of a reward cue. We assessed the ability of a Pavlovian-conditioned stimulus to function as a conditioned reward, as well as to elicit approach behavior in rats treated with haloperidol, either continuously (achieved via subcutaneous osmotic minipump) or intermittently (achieved via daily subcutaneous injections). Continuous, but not intermittent, treatment enhanced the ability of amphetamine to potentiate the conditioned reinforcing effects of a cue associated with water. This effect was not related to differences in the ability to attribute predictive value to a conditioned stimulus (as measured by conditioned approach behavior), but was potentially linked to the development of behavioral supersensitivity to amphetamine and to augmented amphetamine-induced immediate early-gene expression (c-fos and Nur77) in dorsal striatopallidal and striatonigral cells. By enhancing the ability of reward cues to control behavior and by intensifying dopamine-mediated striatopallidal and striatonigral cell activity, standard (ie, continuous) antipsychotic treatment regimens might exacerbate drug-seeking and drug-taking behavior in schizophrenia. Achieving regular but transiently high antipsychotic levels in the brain (as modeled in the intermittent condition) might be a viable option to prevent these changes. This possibility should be explored in the clinic.

Toward an autonomous brain machine interface: integrating sensorimotor reward modulation and reinforcement learning.

PubMed

Marsh, Brandi T; Tarigoppula, Venkata S Aditya; Chen, Chen; Francis, Joseph T

2015-05-13

For decades, neurophysiologists have worked on elucidating the function of the cortical sensorimotor control system from the standpoint of kinematics or dynamics. Recently, computational neuroscientists have developed models that can emulate changes seen in the primary motor cortex during learning. However, these simulations rely on the existence of a reward-like signal in the primary sensorimotor cortex. Reward modulation of the primary sensorimotor cortex has yet to be characterized at the level of neural units. Here we demonstrate that single units/multiunits and local field potentials in the primary motor (M1) cortex of nonhuman primates (Macaca radiata) are modulated by reward expectation during reaching movements and that this modulation is present even while subjects passively view cursor motions that are predictive of either reward or nonreward. After establishing this reward modulation, we set out to determine whether we could correctly classify rewarding versus nonrewarding trials, on a moment-to-moment basis. This reward information could then be used in collaboration with reinforcement learning principles toward an autonomous brain-machine interface. The autonomous brain-machine interface would use M1 for both decoding movement intention and extraction of reward expectation information as evaluative feedback, which would then update the decoding algorithm as necessary. In the work presented here, we show that this, in theory, is possible. Copyright © 2015 the authors 0270-6474/15/357374-14$15.00/0.

Reward-related frontostriatal activity and smoking behavior among adolescents in treatment for smoking cessation.

PubMed

Garrison, Kathleen A; Yip, Sarah W; Balodis, Iris M; Carroll, Kathleen M; Potenza, Marc N; Krishnan-Sarin, Suchitra

2017-08-01

Tobacco use is often initiated during adolescence and continued into adulthood despite desires to quit. A better understanding of the neural correlates of abstinence from smoking in adolescents may inform more effective smoking cessation interventions. Neural reward systems are implicated in tobacco use disorder, and adolescent smokers have shown reduced reward-related ventral striatal activation related to increased smoking. The current study evaluated nondrug reward anticipation in adolescent smokers using a monetary incentive delay task in fMRI pre- and post- smoking cessation treatment (n=14). This study tested how changes in neural responses to reward anticipation pre- to post-treatment were related to reduced smoking. An exploratory analysis in a larger sample of adolescents with only pre-treatment fMRI (n=28) evaluated how neural responses to reward anticipation were related to behavioral inhibition and behavioral activation scales. Adolescent smokers showed pre- to post-treatment increases in reward anticipation-related activity in the bilateral nucleus accumbens and insula, and medial prefrontal cortex, and greater increases in reward anticipation-related activity were correlated with larger percent days of smoking abstinence during treatment. These findings suggest that reduced smoking during smoking cessation treatment is associated with a "recovery of function" in frontostriatal responses to nondrug reward anticipation in adolescent smokers, although comparison with a developmental control group of adolescent nonsmokers is warranted. Copyright © 2017 Elsevier B.V. All rights reserved.

Dynamic corticostriatal activity biases social bonding in monogamous female prairie voles

PubMed Central

Amadei, Elizabeth A.; Johnson, Zachary V.; Kwon, Yong Jun; Shpiner, Aaron C.; Saravanan, Varun; Mays, Wittney D.; Ryan, Steven J.; Walum, Hasse; Rainnie, Donald G.; Young, Larry J.; Liu, Robert C.

2017-01-01

Summary paragraph Adult pair bonding involves dramatic changes in the perception and valuation of another individual1. One key change is that partners come to reliably activate the brain's reward system2-6, though the precise neural mechanisms by which partners become rewarding during sociosexual interactions leading to a bond remain unclear. Using a prairie vole model of social bonding7, we show how a functional circuit from medial prefrontal cortex (mPFC) to nucleus accumbens (NAcc) is dynamically modulated to enhance females' affiliative behavior towards a partner. Individual variation in the strength of this functional connectivity, particularly after the first mating encounter, predicts how quickly animals begin affiliative huddling with their partner. Rhythmically activating this circuit in a social context without mating biases later preference towards a partner, indicating that this circuit's activity is not just correlated with how quickly animals become affiliative but causally accelerates it. These results provide the first dynamic view of corticostriatal activity during bond formation, revealing how social interactions can recruit brain reward systems to drive changes in affiliative behavior. PMID:28562592

Punishment sensitivity modulates the processing of negative feedback but not error-induced learning.

PubMed

Unger, Kerstin; Heintz, Sonja; Kray, Jutta

2012-01-01

Accumulating evidence suggests that individual differences in punishment and reward sensitivity are associated with functional alterations in neural systems underlying error and feedback processing. In particular, individuals highly sensitive to punishment have been found to be characterized by larger mediofrontal error signals as reflected in the error negativity/error-related negativity (Ne/ERN) and the feedback-related negativity (FRN). By contrast, reward sensitivity has been shown to relate to the error positivity (Pe). Given that Ne/ERN, FRN, and Pe have been functionally linked to flexible behavioral adaptation, the aim of the present research was to examine how these electrophysiological reflections of error and feedback processing vary as a function of punishment and reward sensitivity during reinforcement learning. We applied a probabilistic learning task that involved three different conditions of feedback validity (100%, 80%, and 50%). In contrast to prior studies using response competition tasks, we did not find reliable correlations between punishment sensitivity and the Ne/ERN. Instead, higher punishment sensitivity predicted larger FRN amplitudes, irrespective of feedback validity. Moreover, higher reward sensitivity was associated with a larger Pe. However, only reward sensitivity was related to better overall learning performance and higher post-error accuracy, whereas highly punishment sensitive participants showed impaired learning performance, suggesting that larger negative feedback-related error signals were not beneficial for learning or even reflected maladaptive information processing in these individuals. Thus, although our findings indicate that individual differences in reward and punishment sensitivity are related to electrophysiological correlates of error and feedback processing, we found less evidence for influences of these personality characteristics on the relation between performance monitoring and feedback-based learning.

Can Decision Making Research Provide a Better Understanding of Chemical and Behavioral Addictions?

PubMed

Engel, Anzhelika; Cáceda, Ricardo

2015-01-01

We reviewed the cognitive and neurobiological commonalities between chemical and behavioral addictions. Poor impulse control, limited executive function and abnormalities in reward processing are seen in both group of entities. Brain imaging shows consistent abnormalities in frontoparietal regions and the limbic system. In drug addiction, exaggerated risk taking behavior and temporal discounting may reflect an imbalance between a hyperactive mesolimbic and hypoactive executive systems. Several cognitive distortions are found in pathological gambling that seems to harness the brain reward system that has evolved to face situations related to skill, not random chance. Abnormalities in risk assessment and impulsivity are found in variety of eating disorders, in particularly related to eating behavior. Corresponding findings in eating disorder patients include abnormalities in the limbic system, i.e. orbitofrontal cortex (OFC), striatum and insula. Similarly, internet addiction disorder is associated with risky decision making and increased choice impulsivity with corresponding discrepant activation in the dorsolateral prefrontal cortex, OFC, anterior cingulate cortex, caudate and insula. Sexual addictions are in turn associated with exaggerated impulsive choice and suggestive evidence of abnormalities in reward processing. In sum, exploration of executive function and decision making abnormalities in chemical and behavioral addictions may increase understanding in their psychopathology and yield valuable targets for therapeutic interventions.

Post-conventional moral reasoning is associated with increased ventral striatal activity at rest and during task.

PubMed

Fang, Zhuo; Jung, Wi Hoon; Korczykowski, Marc; Luo, Lijuan; Prehn, Kristin; Xu, Sihua; Detre, John A; Kable, Joseph W; Robertson, Diana C; Rao, Hengyi

2017-08-02

People vary considerably in moral reasoning. According to Kohlberg's theory, individuals who reach the highest level of post-conventional moral reasoning judge moral issues based on deeper principles and shared ideals rather than self-interest or adherence to laws and rules. Recent research has suggested the involvement of the brain's frontostriatal reward system in moral judgments and prosocial behaviors. However, it remains unknown whether moral reasoning level is associated with differences in reward system function. Here, we combined arterial spin labeling perfusion and blood oxygen level-dependent functional magnetic resonance imaging and measured frontostriatal reward system activity both at rest and during a sequential risky decision making task in a sample of 64 participants at different levels of moral reasoning. Compared to individuals at the pre-conventional and conventional level of moral reasoning, post-conventional individuals showed increased resting cerebral blood flow in the ventral striatum and ventromedial prefrontal cortex. Cerebral blood flow in these brain regions correlated with the degree of post-conventional thinking across groups. Post-conventional individuals also showed greater task-induced activation in the ventral striatum during risky decision making. These findings suggest that high-level post-conventional moral reasoning is associated with increased activity in the brain's frontostriatal system, regardless of task-dependent or task-independent states.

An Update on CRF Mechanisms Underlying Alcohol Use Disorders and Dependence

PubMed Central

Quadros, Isabel Marian Hartmann; Macedo, Giovana Camila; Domingues, Liz Paola; Favoretto, Cristiane Aparecida

2016-01-01

Alcohol is the most commonly used and abused substance worldwide. The emergence of alcohol use disorders, and alcohol dependence in particular, is accompanied by functional changes in brain reward and stress systems, which contribute to escalated alcohol drinking and seeking. Corticotropin-releasing factor (CRF) systems have been critically implied in the transition toward problematic alcohol drinking and alcohol dependence. This review will discuss how dysregulation of CRF function contributes to the vulnerability for escalated alcohol drinking and other consequences of alcohol consumption, based on preclinical evidence. CRF signaling, mostly via CRF1 receptors, seems to be particularly important in conditions of excessive alcohol taking and seeking, including during early and protracted withdrawal, relapse, as well as during withdrawal-induced anxiety and escalated aggression promoted by alcohol. Modulation of CRF1 function seems to exert a less prominent role over low to moderate alcohol intake, or to species-typical behaviors. While CRF mechanisms in the hypothalamic–pituitary–adrenal axis have some contribution to the neurobiology of alcohol abuse and dependence, a pivotal role for extra-hypothalamic CRF pathways, particularly in the extended amygdala, is well characterized. More recent studies further suggest a direct modulation of brain reward function by CRF signaling in the ventral tegmental area, nucleus accumbens, and the prefrontal cortex, among other structures. This review will further discuss a putative role for other components of the CRF system that contribute for the overall balance of CRF function in reward and stress pathways, including CRF2 receptors, CRF-binding protein, and urocortins, a family of CRF-related peptides. PMID:27818644

Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans.

PubMed

Elliott, R; Agnew, Z; Deakin, J F W

2008-05-01

Functional imaging studies in recent years have confirmed the involvement of orbitofrontal cortex (OFC) in human reward processing and have suggested that OFC responses are context-dependent. A seminal electrophysiological experiment in primates taught animals to associate abstract visual stimuli with differently valuable food rewards. Subsequently, pairs of these learned abstract stimuli were presented and firing of OFC neurons to the medium-value stimulus was measured. OFC firing was shown to depend on the relative value context. In this study, we developed a human analogue of this paradigm and scanned subjects using functional magnetic resonance imaging. The analysis compared neuronal responses to two superficially identical events, which differed only in terms of the preceding context. Medial OFC response to the same perceptual stimulus was greater when the stimulus predicted the more valuable of two rewards than when it predicted the less valuable. Additional responses were observed in other components of reward circuitry, the amygdala and ventral striatum. The central finding is consistent with the primate results and suggests that OFC neurons code relative rather than absolute reward value. Amygdala and striatal involvement in coding reward value is also consistent with recent functional imaging data. By using a simpler and less confounded paradigm than many functional imaging studies, we are able to demonstrate that relative financial reward value per se is coded in distinct subregions of an extended reward and decision-making network.

Neural correlates of reward processing in adults with 22q11 deletion syndrome.

PubMed

van Duin, Esther D A; Goossens, Liesbet; Hernaus, Dennis; da Silva Alves, Fabiana; Schmitz, Nicole; Schruers, Koen; van Amelsvoort, Therese

2016-01-01

22q11.2 deletion syndrome (22q11DS) is caused by a microdeletion on chromosome 22q11.2 and associated with an increased risk to develop psychosis. The gene coding for catechol-O-methyl-transferase (COMT) is located at the deleted region, resulting in disrupted dopaminergic neurotransmission in 22q11DS, which may contribute to the increased vulnerability for psychosis. A dysfunctional motivational reward system is considered one of the salient features in psychosis and thought to be related to abnormal dopaminergic neurotransmission. The functional anatomy of the brain reward circuitry has not yet been investigated in 22q11DS. This study aims to investigate neural activity during anticipation of reward and loss in adult patients with 22q11DS. We measured blood-oxygen-level dependent (BOLD) activity in 16 patients with 22q11DS and 12 healthy controls during a monetary incentive delay task using a 3T Philips Intera MRI system. Data were analysed using SPM8. During anticipation of reward, the 22q11DS group alone displayed significant activation in bilateral middle frontal and temporal brain regions. Compared to healthy controls, significantly less activation in bilateral cingulate gyrus extending to premotor, primary motor and somatosensory areas was found. During anticipation of loss, the 22q11DS group displayed activity in the left middle frontal gyrus and anterior cingulate cortex, and relative to controls, they showed reduced brain activation in bilateral (pre)cuneus and left posterior cingulate. Within the 22q11DS group, COMT Val hemizygotes displayed more activation compared to Met hemizygotes in right posterior cingulate and bilateral parietal regions during anticipation of reward. During anticipation of loss, COMT Met hemizygotes compared to Val hemizygotes showed more activation in bilateral insula, striatum and left anterior cingulate. This is the first study to investigate reward processing in 22q11DS. Our preliminary results suggest that people with 22q11DS engage a fronto-temporal neural network. Compared to healthy controls, people with 22q11DS primarily displayed reduced activity in medial frontal regions during reward anticipation. COMT hemizygosity affects responsivity of the reward system in this condition. Alterations in reward processing partly underlain by the dopamine system may play a role in susceptibility for psychosis in 22q11DS.

Time-of-day differences and short-term stability of the neural response to monetary reward: a pilot study.

PubMed

Hasler, Brant P; Forbes, Erika E; Franzen, Peter L

2014-10-30

Human and animal studies indicate that reward function is modulated by the circadian clock that governs our daily sleep/wake rhythm. For example, a robust circadian rhythm exists in positive affect, which is lower in the morning hours and peaks in the afternoon. A handful of functional neuroimaging studies suggest that systematic diurnal variation exists in brain activity related to other functions, but no published human studies have examined daily variation in the neural processing of reward. In the present study, we attempt to advance this literature by using functional neuroimaging methods to examine time-of-day changes in the responsivity of the reward circuit. Using a within-person design and a functional magnetic resonance imaging (fMRI) monetary reward task, we compared morning and afternoon reward-related brain activation in a sample of healthy young adults within 24h. Region of interest analyses focused on the striatum, and we hypothesized greater reward activation in the afternoon, concordant with the circadian peak in positive affect. Results were consistent with our hypothesis. In addition, we counterbalanced the order of morning and afternoon scans in order to explore the short-term stability of the neural response. Whole-brain analyses showed a markedly higher reactivity to reward throughout the brain in the first scan relative to the second scan, consistent with habituation to the monetary reward stimuli. However, these effects did not appear to explain the time-of-day findings. In summary, we report the first preliminary evidence of circadian variation in the neural processing of reward. These findings have both methodological and theoretical implications. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Chopped or Long Roughage: What Do Calves Prefer? Using Cross Point Analysis of Double Demand Functions

PubMed Central

Webb, Laura E.; Bak Jensen, Margit; Engel, Bas; van Reenen, Cornelis G.; Gerrits, Walter J. J.; de Boer, Imke J. M.; Bokkers, Eddie A. M.

2014-01-01

The present study aimed to quantify calves'(Bos taurus) preference for long versus chopped hay and straw, and hay versus straw, using cross point analysis of double demand functions, in a context where energy intake was not a limiting factor. Nine calves, fed milk replacer and concentrate, were trained to work for roughage rewards from two simultaneously available panels. The cost (number of muzzle presses) required on the panels varied in each session (left panel/right panel): 7/35, 14/28, 21/21, 28/14, 35/7. Demand functions were estimated from the proportion of rewards achieved on one panel relative to the total number of rewards achieved in one session. Cross points (cp) were calculated as the cost at which an equal number of rewards was achieved from both panels. The deviation of the cp from the midpoint (here 21) indicates the strength of the preference. Calves showed a preference for long versus chopped hay (cp  = 14.5; P  = 0.004), and for hay versus straw (cp  = 38.9; P = 0.004), both of which improve rumen function. Long hay may stimulate chewing more than chopped hay, and the preference for hay versus straw could be related to hedonic characteristics. No preference was found for chopped versus long straw (cp  = 20.8; P = 0.910). These results could be used to improve the welfare of calves in production systems; for example, in systems where calves are fed hay along with high energy concentrate, providing long hay instead of chopped could promote roughage intake, rumen development, and rumination. PMID:24558426

Eveningness among late adolescent males predicts neural reactivity to reward and alcohol dependence two years later

PubMed Central

Hasler, Brant P.; Casement, Melynda D.; Sitnick, Stephanie L.; Shaw, Daniel S.; Forbes, Erika E.

2017-01-01

Eveningness, a preference for later sleep-wake timing, is linked to altered reward function, which may explain a consistent association with substance abuse. Notably, the extant literature rests largely on cross-sectional data, yet both eveningness and reward function show developmental changes. We examined whether circadian preference during late adolescence predicted the neural response to reward two years later. A sample of 93 males reported circadian preference and completed a monetary reward fMRI paradigm at ages 20 and 22. Primary analyses examined longitudinal paths from circadian preference to medial prefrontal cortex (mPFC) and ventral striatal (VS) reward responses. We also explored whether reward responses mediated longitudinal associations between circadian preference and alcohol dependence, frequency of alcohol use, and/or frequency of cannabis use. Age 20 eveningness was positively associated with age 22 mPFC and VS responses to win, but not associated with age 22 reactivity to reward anticipation. Age 20 eveningness was indirectly related to age 22 alcohol dependence via age 22 mPFC response to win. Our findings provide novel evidence that altered reward-related brain function could underlie associations between eveningness and alcohol use problems. Eveningness may be an under-recognized but modifiable risk factor for reward-related problems such as mood and substance use disorders. PMID:28254633

ADHD Related Behaviors Are Associated with Brain Activation in the Reward System

ERIC Educational Resources Information Center

Stark, R.; Bauer, E.; Merz, C. J.; Zimmermann, M.; Reuter, M.; Plichta, M. M.; Kirsch, P.; Lesch, K. P.; Fallgatter, A. J.; Vaitl, D.; Herrmann, M. J.

2011-01-01

Neuroimaging studies on attention-deficit/hyperactivity disorder (ADHD) suggest dysfunctional reward processing, with hypo-responsiveness during reward anticipation in the reward system including the nucleus accumbens (NAcc). In this study, we investigated the association between ADHD related behaviors and the reward system using functional…

Neural Basis of Anhedonia and Amotivation in Patients with Schizophrenia: The role of Reward System

PubMed Central

Lee, Jung Suk; Jung, Suwon; Park, Il Ho; Kim, Jae-Jin

2015-01-01

Anhedonia, the inability to feel pleasure, and amotivation, the lack of motivation, are two prominent negative symptoms of schizophrenia, which contribute to the poor social and occupational behaviors in the patients. Recently growing evidence shows that anhedonia and amotivation are tied together, but have distinct neural correlates. It is important to note that both of these symptoms may derive from deficient functioning of the reward network. A further analysis into the neuroimaging findings of schizophrenia shows that the neural correlates overlap in the reward network including the ventral striatum, anterior cingulate cortex and orbitofrontal cortex. Other neuroimaging studies have demonstrated the involvement of the default mode network in anhedonia. The identification of a specific deficit in hedonic and motivational capacity may help to elucidate the mechanisms behind social functioning deficits in schizophrenia, and may also lead to more targeted treatment of negative symptoms. PMID:26630955

Neural Basis of Anhedonia and Amotivation in Patients with Schizophrenia: The Role of Reward System.

PubMed

Lee, Jung Suk; Jung, Suwon; Park, Il Ho; Kim, Jae-Jin

2015-01-01

Anhedonia, the inability to feel pleasure, and amotivation, the lack of motivation, are two prominent negative symptoms of schizophrenia, which contribute to the poor social and occupational behaviors in the patients. Recently growing evidence shows that anhedonia and amotivation are tied together, but have distinct neural correlates. It is important to note that both of these symptoms may derive from deficient functioning of the reward network. A further analysis into the neuroimaging findings of schizophrenia shows that the neural correlates overlap in the reward network including the ventral striatum, anterior cingulate cortex and orbitofrontal cortex. Other neuroimaging studies have demonstrated the involvement of the default mode network in anhedonia. The identification of aspecific deficit in hedonic and motivational capacity may help to elucidate the mechanisms behind social functioning deficits in schizophrenia, and may also lead to more targeted treatment of negative symptoms.

Role stress, role reward, and mental health in a multiethnic sample of midlife women: results from the Study of Women's Health Across the Nation (SWAN).

PubMed

Lanza di Scalea, Teresa; Matthews, Karen A; Avis, Nancy E; Thurston, Rebecca C; Brown, Charlotte; Harlow, Sioban; Bromberger, Joyce T

2012-05-01

Little is known about the independent associations of reward and stress within specific roles with multiple measures of mental health in an ethnically diverse community sample of midlife women. The objective of this study is to examine if (1) role reward (within each role and across roles) contributes directly to mental health and buffers the negative impact of role stress and (2) associations among role occupancy, role stress, and role reward and mental health vary by race/ethnicity. With separate logistic regression analysis, we investigated cross-sectional relationships between role stress and role reward with presence/absence of high depressive symptoms (Center for Epidemiologic Studies Depression Scale [CES-D≥16]), anxiety symptoms (feeling tense or nervous, irritable or grouchy, fearful for no reason, and heart pounding or racing total score≥4), or low social functioning (bottom 25th percentile of the Short-Form-36 [SF-36] social functioning subscale) in 2549 women participating in the third visit of the Study of Women's Health Across the Nation (SWAN), a longitudinal population-based study of menopause. High reward across roles attenuated the negative impact of role stress on social functioning but not on anxiety or depression. High reward marriage buffered the impact of marital stress on depression, and high reward mothering buffered the effect of maternal stress on depression and social functioning. Compared to Caucasians, Hispanics and Chinese with high stress across roles had better social functioning, and African American mothers had lower odds of high depressive symptoms. Role reward buffers the negative impact of stress on social functioning and depression, but not on anxiety. Minorities may respond to role stress by seeking social support.

Role Stress, Role Reward, and Mental Health in a Multiethnic Sample of Midlife Women: Results from the Study of Women's Health Across the Nation (SWAN)

PubMed Central

Lanza di Scalea, Teresa; Matthews, Karen A.; Avis, Nancy E.; Thurston, Rebecca C.; Brown, Charlotte; Harlow, Sioban

2012-01-01

Abstract Background Little is known about the independent associations of reward and stress within specific roles with multiple measures of mental health in an ethnically diverse community sample of midlife women. The objective of this study is to examine if (1) role reward (within each role and across roles) contributes directly to mental health and buffers the negative impact of role stress and (2) associations among role occupancy, role stress, and role reward and mental health vary by race/ethnicity. Methods With separate logistic regression analysis, we investigated cross-sectional relationships between role stress and role reward with presence/absence of high depressive symptoms (Center for Epidemiologic Studies Depression Scale [CES-D≥16]), anxiety symptoms (feeling tense or nervous, irritable or grouchy, fearful for no reason, and heart pounding or racing total score≥4), or low social functioning (bottom 25th percentile of the Short-Form-36 [SF-36] social functioning subscale) in 2549 women participating in the third visit of the Study of Women's Health Across the Nation (SWAN), a longitudinal population-based study of menopause. Results High reward across roles attenuated the negative impact of role stress on social functioning but not on anxiety or depression. High reward marriage buffered the impact of marital stress on depression, and high reward mothering buffered the effect of maternal stress on depression and social functioning. Compared to Caucasians, Hispanics and Chinese with high stress across roles had better social functioning, and African American mothers had lower odds of high depressive symptoms. Conclusions Role reward buffers the negative impact of stress on social functioning and depression, but not on anxiety. Minorities may respond to role stress by seeking social support. PMID:22360697

Ventral pallidum roles in reward and motivation.

PubMed

Smith, Kyle S; Tindell, Amy J; Aldridge, J Wayne; Berridge, Kent C

2009-01-23

In recent years the ventral pallidum has become a focus of great research interest as a mechanism of reward and incentive motivation. As a major output for limbic signals, the ventral pallidum was once associated primarily with motor functions rather than regarded as a reward structure in its own right. However, ample evidence now suggests that ventral pallidum function is a major mechanism of reward in the brain. We review data indicating that (1) an intact ventral pallidum is necessary for normal reward and motivation, (2) stimulated activation of ventral pallidum is sufficient to cause reward and motivation enhancements, and (3) activation patterns in ventral pallidum neurons specifically encode reward and motivation signals via phasic bursts of excitation to incentive and hedonic stimuli. We conclude that the ventral pallidum may serve as an important 'limbic final common pathway' for mesocorticolimbic processing of many rewards.

Reward circuitry dysfunction in psychiatric and neurodevelopmental disorders and genetic syndromes: animal models and clinical findings.

PubMed

Dichter, Gabriel S; Damiano, Cara A; Allen, John A

2012-07-06

This review summarizes evidence of dysregulated reward circuitry function in a range of neurodevelopmental and psychiatric disorders and genetic syndromes. First, the contribution of identifying a core mechanistic process across disparate disorders to disease classification is discussed, followed by a review of the neurobiology of reward circuitry. We next consider preclinical animal models and clinical evidence of reward-pathway dysfunction in a range of disorders, including psychiatric disorders (i.e., substance-use disorders, affective disorders, eating disorders, and obsessive compulsive disorders), neurodevelopmental disorders (i.e., schizophrenia, attention-deficit/hyperactivity disorder, autism spectrum disorders, Tourette's syndrome, conduct disorder/oppositional defiant disorder), and genetic syndromes (i.e., Fragile X syndrome, Prader-Willi syndrome, Williams syndrome, Angelman syndrome, and Rett syndrome). We also provide brief overviews of effective psychopharmacologic agents that have an effect on the dopamine system in these disorders. This review concludes with methodological considerations for future research designed to more clearly probe reward-circuitry dysfunction, with the ultimate goal of improved intervention strategies.

Reward circuitry dysfunction in psychiatric and neurodevelopmental disorders and genetic syndromes: animal models and clinical findings

PubMed Central

2012-01-01

This review summarizes evidence of dysregulated reward circuitry function in a range of neurodevelopmental and psychiatric disorders and genetic syndromes. First, the contribution of identifying a core mechanistic process across disparate disorders to disease classification is discussed, followed by a review of the neurobiology of reward circuitry. We next consider preclinical animal models and clinical evidence of reward-pathway dysfunction in a range of disorders, including psychiatric disorders (i.e., substance-use disorders, affective disorders, eating disorders, and obsessive compulsive disorders), neurodevelopmental disorders (i.e., schizophrenia, attention-deficit/hyperactivity disorder, autism spectrum disorders, Tourette’s syndrome, conduct disorder/oppositional defiant disorder), and genetic syndromes (i.e., Fragile X syndrome, Prader–Willi syndrome, Williams syndrome, Angelman syndrome, and Rett syndrome). We also provide brief overviews of effective psychopharmacologic agents that have an effect on the dopamine system in these disorders. This review concludes with methodological considerations for future research designed to more clearly probe reward-circuitry dysfunction, with the ultimate goal of improved intervention strategies. PMID:22958744

Brain connectivity reflects human aesthetic responses to music.

PubMed

Sachs, Matthew E; Ellis, Robert J; Schlaug, Gottfried; Loui, Psyche

2016-06-01

Humans uniquely appreciate aesthetics, experiencing pleasurable responses to complex stimuli that confer no clear intrinsic value for survival. However, substantial variability exists in the frequency and specificity of aesthetic responses. While pleasure from aesthetics is attributed to the neural circuitry for reward, what accounts for individual differences in aesthetic reward sensitivity remains unclear. Using a combination of survey data, behavioral and psychophysiological measures and diffusion tensor imaging, we found that white matter connectivity between sensory processing areas in the superior temporal gyrus and emotional and social processing areas in the insula and medial prefrontal cortex explains individual differences in reward sensitivity to music. Our findings provide the first evidence for a neural basis of individual differences in sensory access to the reward system, and suggest that social-emotional communication through the auditory channel may offer an evolutionary basis for music making as an aesthetically rewarding function in humans. © The Author (2016). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

A Learning Theory for Reward-Modulated Spike-Timing-Dependent Plasticity with Application to Biofeedback

PubMed Central

Maass, Wolfgang

2008-01-01

Reward-modulated spike-timing-dependent plasticity (STDP) has recently emerged as a candidate for a learning rule that could explain how behaviorally relevant adaptive changes in complex networks of spiking neurons could be achieved in a self-organizing manner through local synaptic plasticity. However, the capabilities and limitations of this learning rule could so far only be tested through computer simulations. This article provides tools for an analytic treatment of reward-modulated STDP, which allows us to predict under which conditions reward-modulated STDP will achieve a desired learning effect. These analytical results imply that neurons can learn through reward-modulated STDP to classify not only spatial but also temporal firing patterns of presynaptic neurons. They also can learn to respond to specific presynaptic firing patterns with particular spike patterns. Finally, the resulting learning theory predicts that even difficult credit-assignment problems, where it is very hard to tell which synaptic weights should be modified in order to increase the global reward for the system, can be solved in a self-organizing manner through reward-modulated STDP. This yields an explanation for a fundamental experimental result on biofeedback in monkeys by Fetz and Baker. In this experiment monkeys were rewarded for increasing the firing rate of a particular neuron in the cortex and were able to solve this extremely difficult credit assignment problem. Our model for this experiment relies on a combination of reward-modulated STDP with variable spontaneous firing activity. Hence it also provides a possible functional explanation for trial-to-trial variability, which is characteristic for cortical networks of neurons but has no analogue in currently existing artificial computing systems. In addition our model demonstrates that reward-modulated STDP can be applied to all synapses in a large recurrent neural network without endangering the stability of the network dynamics. PMID:18846203

Differential reward network functional connectivity in cannabis dependent and non-dependent users☆

PubMed Central

Filbey, Francesca M.; Dunlop, Joseph

2015-01-01

Background Emergent studies show that similar to other substances of abuse, cue-reactivity to cannabis is also associated with neural response in the brain’s reward pathway (Filbey et al., 2009). However, the inter-relatedness of brain regions during cue-reactivity in cannabis users remains unknown. Methods In this study, we conducted a series of investigations to determine functional connectivity during cue-reactivity in 71 cannabis users. First, we used psychophysiological interaction (PPI) analysis to examine coherent neural response to cannabis cues. Second, we evaluated whether these patterns of network functional connectivity differentiated dependent and non-dependent users. Finally, as an exploratory analysis, we determined the directionality of these connections via Granger connectivity analyses. Results PPI analyses showed reward network functional connectivity with the nucleus accumbens (NAc) seed region during cue exposure. Between-group contrasts found differential effects of dependence status. Dependent users (N = 31) had greater functional connectivity with amygdala and anterior cingulate gyrus (ACG) seeds while the non-dependent users (N = 24) had greater functional connectivity with the NAc, orbitofrontal cortex (OFC) and hippocampus seeds. Granger analyses showed that hippocampal and ACG activation preceded neural response in reward areas. Conclusions Both PPI and Granger analyses demonstrated strong functional coherence in reward regions during exposure to cannabis cues in current cannabis users. Functional connectivity (but not regional activation) in the reward network differentiated dependent from non-dependent cannabis users. Our findings suggest that repeated cannabis exposure causes observable changes in functional connectivity in the reward network and should be considered in intervention strategies. PMID:24838032

Saturation of subjective reward magnitude as a function of current and pulse frequency.

PubMed

Simmons, J M; Gallistel, C R

1994-02-01

In rats with electrodes in the medial forebrain bundle, the upper portion of the function relating the experienced magnitude of the reward to pulse frequency was determined at currents ranging from 100 to 1,000 microA. The pulse frequency required to produce an asymptotic level of reward was inversely proportional to current except at the lowest currents and highest pulse frequencies. At a given current, the subjective reward magnitude functions decelerated to an asymptote over an interval in which the pulse frequency doubled or tripled. The asymptotic level of reward was approximately constant for currents between 200 and 1,000 microA but declined substantially at currents at or below 100 microA and pulse frequencies at or above 250 to 400 pulses per second. The results are consistent with the hypothesis that the magnitude of the experienced reward depends only on the number of action potentials generated by the train of pulses in the bundle of reward-relevant axons.

Orbitofrontal reward sensitivity and impulsivity in adult attention deficit hyperactivity disorder.

PubMed

Wilbertz, Gregor; van Elst, Ludger Tebartz; Delgado, Mauricio R; Maier, Simon; Feige, Bernd; Philipsen, Alexandra; Blechert, Jens

2012-03-01

Impulsivity symptoms of adult attention deficit hyperactivity disorder (ADHD) such as increased risk taking have been linked with impaired reward processing. Previous studies have focused on reward anticipation or on rewarded executive functioning tasks and have described a striatal hyporesponsiveness and orbitofrontal alterations in adult and adolescent ADHD. Passive reward delivery and its link to behavioral impulsivity are less well understood. To study this crucial aspect of reward processing we used functional magnetic resonance imaging (fMRI) combined with electrodermal assessment in male and female adult ADHD patients (N=28) and matched healthy control participants (N=28) during delivery of monetary and non-monetary rewards. Further, two behavioral tasks assessed risky decision making (game of dice task) and delay discounting. Results indicated that both groups activated ventral and dorsal striatum and the medial orbitofrontal cortex (mOFC) in response to high-incentive (i.e. monetary) rewards. A similar, albeit less strong activation pattern was found for low-incentive (i.e. non-monetary) rewards. Group differences emerged when comparing high and low incentive rewards directly: activation in the mOFC coded for the motivational change in reward delivery in healthy controls, but not ADHD patients. Additionally, this dysfunctional mOFC activity in patients correlated with risky decision making and delay discounting and was paralleled by physiological arousal. Together, these results suggest that the mOFC codes reward value and type in healthy individuals whereas this function is deficient in ADHD. The brain-behavior correlations suggest that this deficit might be related to behavioral impulsivity. Reward value processing difficulties in ADHD should be considered when assessing reward anticipation and emotional learning in research and applied settings. Copyright © 2011 Elsevier Inc. All rights reserved.

Motivational orientation modulates the neural response to reward.

PubMed

Linke, Julia; Kirsch, Peter; King, Andrea V; Gass, Achim; Hennerici, Michael G; Bongers, André; Wessa, Michèle

2010-02-01

Motivational orientation defines the source of motivation for an individual to perform a particular action and can either originate from internal desires (e.g., interest) or external compensation (e.g., money). To this end, motivational orientation should influence the way positive or negative feedback is processed during learning situations and this might in turn have an impact on the learning process. In the present study, we thus investigated whether motivational orientation, i.e., extrinsic and intrinsic motivation modulates the neural response to reward and punishment as well as learning from reward and punishment in 33 healthy individuals. To assess neural responses to reward, punishment and learning of reward contingencies we employed a probabilistic reversal learning task during functional magnetic resonance imaging. Extrinsic and intrinsic motivation were assessed with a self-report questionnaire. Rewarding trials fostered activation in the medial orbitofrontal cortex and anterior cingulate gyrus (ACC) as well as the amygdala and nucleus accumbens, whereas for punishment an increased neural response was observed in the medial and inferior prefrontal cortex, the superior parietal cortex and the insula. High extrinsic motivation was positively correlated to increased neural responses to reward in the ACC, amygdala and putamen, whereas a negative relationship between intrinsic motivation and brain activation in these brain regions was observed. These findings show that motivational orientation indeed modulates the responsiveness to reward delivery in major components of the human reward system and therefore extends previous results showing a significant influence of individual differences in reward-related personality traits on the neural processing of reward. Copyright (c) 2009 Elsevier Inc. All rights reserved.

FNDC5/irisin, a molecular target for boosting reward-related learning and motivation.

PubMed

Zsuga, Judit; Tajti, Gabor; Papp, Csaba; Juhasz, Bela; Gesztelyi, Rudolf

2016-05-01

Interventions focusing on the prevention and treatment of chronic non-communicable diseases are on rise. In the current article, we propose that dysfunction of the mesocortico-limbic reward system contributes to the emergence of the WHO-identified risk behaviors (tobacco use, unhealthy diet, physical inactivity and harmful use of alcohol), behaviors that underlie the evolution of major non-communicable diseases (e.g. cardiovascular diseases, cancer, diabetes and chronic respiratory diseases). Given that dopaminergic neurons of the mesocortico-limbic system are tightly associated with reward-related processes and motivation, their dysfunction may fundamentally influence behavior. While nicotine and alcohol alter dopamine neuron function by influencing some receptors, mesocortico-limbic system dysfunction was associated with elevation of metabolic set-point leading to hedonic over-eating. Although there is some empirical evidence, precise molecular mechanism for linking physical inactivity and mesocortico-limbic dysfunction per se seems to be missing; identification of which may contribute to higher success rates for interventions targeting lifestyle changes pertaining to physical activity. In the current article, we compile evidence in support of a link between exercise and the mesocortico-limbic system by elucidating interactions on the axis of muscle - irisin - brain derived neurotrophic factor (BDNF) - and dopaminergic function of the midbrain. Irisin is a contraction-regulated myokine formed primarily in skeletal muscle but also in the brain. Irisin stirred considerable interest, when its ability to induce browning of white adipose tissue parallel to increasing thermogenesis was discovered. Furthermore, it may also play a role in the regulation of behavior given it readily enters the central nervous system, where it induces BDNF expression in several brain areas linked to reward processing, e.g. the ventral tegmental area and the hippocampus. BDNF is a neurotropic factor that increases neuronal dopamine content, modulates dopamine release relevant for neuronal plasticity and increased neuronal survival as well as learning and memory. Further linking BDNF to dopaminergic function is BDNF's ability to activate tropomyosin-related kinase B receptor that shares signalization with presynaptic dopamine-3 receptors in the ventral tegmental area. Summarizing, we propose that the skeletal muscle derived irisin may be the link between physical activity and reward-related processes and motivation. Moreover alteration of this axis may contribute to sedentary lifestyle and subsequent non-communicable diseases. Preclinical and clinical experimental models to test this hypothesis are also proposed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Cocaine cues drive opposing context-dependent shifts in reward processing and emotional state.

PubMed

Wheeler, Robert A; Aragona, Brandon J; Fuhrmann, Katherine A; Jones, Joshua L; Day, Jeremy J; Cacciapaglia, Fabio; Wightman, R Mark; Carelli, Regina M

2011-06-01

Prominent neurobiological theories of addiction posit a central role for aberrant mesolimbic dopamine release but disagree as to whether repeated drug experience blunts or enhances this system. Although drug withdrawal diminishes dopamine release, drug sensitization augments mesolimbic function, and both processes have been linked to drug seeking. One possibility is that the dopamine system can rapidly switch from dampened to enhanced release depending on the specific drug-predictive environment. To test this, we examined dopamine release when cues signaled delayed cocaine delivery versus imminent cocaine self-administration. Fast-scan cyclic voltammetry was used to examine real-time dopamine release while simultaneously monitoring behavioral indexes of aversion as rats experienced a sweet taste cue that predicted delayed cocaine availability and during self-administration. Furthermore, the impact of cues signaling delayed drug availability on intracranial self-stimulation, a broad measure of reward function, was assessed. We observed decreased mesolimbic dopamine concentrations, decreased reward sensitivity, and negative affect in response to the cocaine-predictive taste cue that signaled delayed cocaine availability. Importantly, dopamine concentration rapidly switched to elevated levels to cues signaling imminent cocaine delivery in the subsequent self-administration session. These findings show rapid, bivalent contextual control over brain reward processing, affect, and motivated behavior and have implications for mechanisms mediating substance abuse. Copyright © 2011 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Abnormalities of functional brain networks in pathological gambling: a graph-theoretical approach

PubMed Central

Tschernegg, Melanie; Crone, Julia S.; Eigenberger, Tina; Schwartenbeck, Philipp; Fauth-Bühler, Mira; Lemènager, Tagrid; Mann, Karl; Thon, Natasha; Wurst, Friedrich M.; Kronbichler, Martin

2013-01-01

Functional neuroimaging studies of pathological gambling (PG) demonstrate alterations in frontal and subcortical regions of the mesolimbic reward system. However, most investigations were performed using tasks involving reward processing or executive functions. Little is known about brain network abnormalities during task-free resting state in PG. In the present study, graph-theoretical methods were used to investigate network properties of resting state functional magnetic resonance imaging data in PG. We compared 19 patients with PG to 19 healthy controls (HCs) using the Graph Analysis Toolbox (GAT). None of the examined global metrics differed between groups. At the nodal level, pathological gambler showed a reduced clustering coefficient in the left paracingulate cortex and the left juxtapositional lobe (supplementary motor area, SMA), reduced local efficiency in the left SMA, as well as an increased node betweenness for the left and right paracingulate cortex and the left SMA. At an uncorrected threshold level, the node betweenness in the left inferior frontal gyrus was decreased and increased in the caudate. Additionally, increased functional connectivity between fronto-striatal regions and within frontal regions has also been found for the gambling patients. These findings suggest that regions associated with the reward system demonstrate reduced segregation but enhanced integration while regions associated with executive functions demonstrate reduced integration. The present study makes evident that PG is also associated with abnormalities in the topological network structure of the brain during rest. Since alterations in PG cannot be explained by direct effects of abused substances on the brain, these findings will be of relevance for understanding functional connectivity in other addictive disorders. PMID:24098282

Motivational salience and genetic variability of dopamine D2 receptor expression interact in the modulation of interference processing

PubMed Central

Richter, Anni; Richter, Sylvia; Barman, Adriana; Soch, Joram; Klein, Marieke; Assmann, Anne; Libeau, Catherine; Behnisch, Gusalija; Wüstenberg, Torsten; Seidenbecher, Constanze I.; Schott, Björn H.

2013-01-01

Dopamine has been implicated in the fine-tuning of complex cognitive and motor function and also in the anticipation of future rewards. This dual function of dopamine suggests that dopamine might be involved in the generation of active motivated behavior. The DRD2 TaqIA polymorphism of the dopamine D2 receptor gene (rs1800497) has previously been suggested to affect striatal function with carriers of the less common A1 allele exhibiting reduced striatal D2 receptor density and increased risk for addiction. Here we aimed to investigate the influences of DRD2 TaqIA genotype on the modulation of interference processing by reward and punishment. Forty-six young, healthy volunteers participated in a behavioral experiment, and 32 underwent functional magnetic resonance imaging (fMRI). Participants performed a flanker task with a motivation manipulation (monetary reward, monetary loss, neither, or both). Reaction times (RTs) were shorter in motivated flanker trials, irrespective of congruency. In the fMRI experiment motivation was associated with reduced prefrontal activation during incongruent vs. congruent flanker trials, possibly reflecting increased processing efficiency. DRD2 TaqIA genotype did not affect overall RTs, but interacted with motivation on the congruency-related RT differences, with A1 carriers showing smaller interference effects to reward alone and A2 homozygotes exhibiting a specific interference reduction during combined reward (REW) and punishment trials (PUN). In fMRI, anterior cingulate activity showed a similar pattern of genotype-related modulation. Additionally, A1 carriers showed increased anterior insula activation relative to A2 homozygotes. Our results point to a role for genetic variations of the dopaminergic system in individual differences of cognition-motivation interaction. PMID:23760450

Neuroendocrine circuits governing energy balance and stress regulation: functional overlap and therapeutic implications

PubMed Central

Ulrich-Lai, Yvonne M.; Ryan, Karen K.

2014-01-01

Significant co-morbidities between obesity-related metabolic disease and stress-related psychological disorders suggest important functional interactions between energy balance and brain stress integration. Largely overlapping neural circuits control these systems, and this anatomical arrangement optimizes opportunities for mutual influence. Here we first review the current literature identifying effects of metabolic neuroendocrine signals on stress regulation, and vice versa. Next, the contributions of reward driven food intake to these metabolic and stress interactions are discussed. Lastly, we consider the inter-relationships among metabolism, stress and reward in light of their important implications in the development of therapies for metabolism- or stress-related disease. PMID:24630812

Ventral Pallidum Roles in Reward and Motivation

PubMed Central

Smith, Kyle S.; Tindell, Amy J.; Aldridge, J. Wayne; Berridge, Kent C.

2008-01-01

In recent years the ventral pallidum has become a focus of great research interest as a mechanism of reward and incentive motivation. As a major output for limbic signals, the ventral pallidum was once associated primarily with motor functions rather than regarded as a reward structure in its own right. However, ample evidence now suggests that ventral pallidum function is a major mechanism of reward in the brain. We review data indicating that 1) an intact ventral pallidum is necessary for normal reward and motivation, 2) stimulated activation of ventral pallidum is sufficient to cause reward and motivation enhancements, and 3) activation patterns in ventral pallidum neurons specifically encode reward and motivation signals via phasic bursts of excitation to incentive and hedonic stimuli. We conclude that the ventral pallidum may serve as an important ‘limbic final common pathway’ for mesocorticolimbic processing of many rewards. PMID:18955088

Response effort discounts the subjective value of rewards.

PubMed

Nishiyama, Ryoji

2014-09-01

Factors associated with obtaining a reward, such as a temporal delay in receiving the reward, can influence the subjective value of the reward. Cognitive as well as physical response effort is also known to influence choice behaviors. The present study used hypothetical situations to assess whether response effort affects the subjective value of rewards. The results demonstrated that increasing response effort increases the amount of money that participants are willing to forgo to avoid engaging in work. An exponential as well as hyperbolic function provided a good fit for such discounting. The findings suggest that response effort discounts the subjective value of a reward as a function of its amount. Copyright © 2014 Elsevier B.V. All rights reserved.

Baby schema modulates the brain reward system in nulliparous women.

PubMed

Glocker, Melanie L; Langleben, Daniel D; Ruparel, Kosha; Loughead, James W; Valdez, Jeffrey N; Griffin, Mark D; Sachser, Norbert; Gur, Ruben C

2009-06-02

Ethologist Konrad Lorenz defined the baby schema ("Kindchenschema") as a set of infantile physical features, such as round face and big eyes, that is perceived as cute and motivates caretaking behavior in the human, with the evolutionary function of enhancing offspring survival. The neural basis of this fundamental altruistic instinct is not well understood. Prior studies reported a pattern of brain response to pictures of children, but did not dissociate the brain response to baby schema from the response to children. Using functional magnetic resonance imaging and controlled manipulation of the baby schema in infant faces, we found that baby schema activates the nucleus accumbens, a key structure of the mesocorticolimbic system mediating reward processing and appetitive motivation, in nulliparous women. Our findings suggest that engagement of the mesocorticolimbic system is the neurophysiologic mechanism by which baby schema promotes human caregiving, regardless of kinship.

Enhanced functional connectivity and volume between cognitive and reward centers of naïve rodent brain produced by pro-dopaminergic agent KB220Z

PubMed Central

Badgaiyan, Rajendra D.; Thanos, Panayotis K.; Kulkarni, Praveen; Giordano, John; Baron, David; Gold, Mark S.

2017-01-01

Dopaminergic reward dysfunction in addictive behaviors is well supported in the literature. There is evidence that alterations in synchronous neural activity between brain regions subserving reward and various cognitive functions may significantly contribute to substance-related disorders. This study presents the first evidence showing that a pro-dopaminergic nutraceutical (KB220Z) significantly enhances, above placebo, functional connectivity between reward and cognitive brain areas in the rat. These include the nucleus accumbens, anterior cingulate gyrus, anterior thalamic nuclei, hippocampus, prelimbic and infralimbic loci. Significant functional connectivity, increased brain connectivity volume recruitment (potentially neuroplasticity), and dopaminergic functionality were found across the brain reward circuitry. Increases in functional connectivity were specific to these regions and were not broadly distributed across the brain. While these initial findings have been observed in drug naïve rodents, this robust, yet selective response implies clinical relevance for addicted individuals at risk for relapse, who show reductions in functional connectivity after protracted withdrawal. Future studies will evaluate KB220Z in animal models of addiction. PMID:28445527

Potential effects of reward and loss avoidance in overweight adolescents

PubMed Central

Reyes, Sussanne; Peirano, Patricio; Luna, Beatriz; Lozoff, Betsy; Algarín, Cecilia

2015-01-01

Background Reward system and inhibitory control are brain functions that exert an influence on eating behavior regulation. We studied the differences in inhibitory control and sensitivity to reward and loss avoidance between overweight/obese and normal-weight adolescents. Methods We assessed 51 overweight/obese and 52 normal-weight 15-y-old Chilean adolescents. The groups were similar regarding sex and intelligence quotient. Using Antisaccade and Incentive tasks, we evaluated inhibitory control and the effect of incentive trials (neutral, loss avoidance, and reward) on generating correct and incorrect responses (latency and error rate). Results Compared to normal-weight group participants, overweight/obese adolescents showed shorter latency for incorrect antisaccade responses (186.0 (95% CI: 176.8–195.2) vs. 201.3 ms (95% CI: 191.2–211.5), P < 0.05) and better performance reflected by lower error rate in incentive trials (43.6 (95% CI: 37.8–49.4) vs. 53.4% (95% CI: 46.8–60.0), P < 0.05). Overweight/obese adolescents were more accurate on loss avoidance (40.9 (95% CI: 33.5–47.7) vs. 49.8% (95% CI: 43.0–55.1), P < 0.05) and reward (41.0 (95% CI: 34.5–47.5) vs. 49.8% (95% CI: 43.0–55.1), P < 0.05) compared to neutral trials. Conclusion Overweight/obese adolescents showed shorter latency for incorrect responses and greater accuracy in reward and loss avoidance trials. These findings could suggest that an imbalance of inhibition and reward systems influence their eating behavior. PMID:25927543

Tentative Evidence for Striatal Hyperactivity in Adolescent Cannabis Using Boys: A Cross-Sectional Multicenter fMRI Study

PubMed Central

Jager, Gerry; Block, Robert I.; Luijten, Maartje; Ramsey, Nick F.

2013-01-01

Adolescents' risk-taking behavior has been linked to a maturational imbalance between reward (“go”) and inhibitory-control (“stop”) related brain circuitry. This may drive adolescent drug-taking, such as cannabis use. In this study we assessed the non-acute effects of adolescent cannabis use on reward-related brain function. We performed a two-site (United States and Netherlands; pooled data) functional magnetic resonance imaging (fMRI) study with a cross-sectional design. Twenty-one abstinent but frequent cannabis-using boys were compared with 24 non-using peers on reward-related brain function, using a monetary incentive delay task with fMRI. Focus was on anticipatory and response stages of reward and brain areas critically involved in reward processing like the striatum. Performance in users was normal. Region-of-interest analysis indicated striatal hyperactivity during anticipatory stages of reward in users. Intriguingly, this effect was most pronounced during non-rewarding events. Striatal hyperactivity in adolescent cannabis users may signify an overly sensitive motivational brain circuitry. Frequent cannabis use during adolescence may induce diminished ability to disengage the motivational circuit when no reward can be obtained. This could strengthen the search for reinforcements like drugs of abuse, even when facing the negative (non-rewarding) consequences. PMID:23909003

Suboptimal choice in rats: incentive salience attribution promotes maladaptive decision-making

PubMed Central

Chow, Jonathan J; Smith, Aaron P; Wilson, A George; Zentall, Thomas R; Beckmann, Joshua S

2016-01-01

Stimuli that are more predictive of subsequent reward also function as better conditioned reinforcers. Moreover, stimuli attributed with incentive salience function as more robust conditioned reinforcers. Some theories have suggested that conditioned reinforcement plays an important role in promoting suboptimal choice behavior, like gambling. The present experiments examined how different stimuli, those attributed with incentive salience versus those without, can function in tandem with stimulus-reward predictive utility to promote maladaptive decision-making in rats. One group of rats had lights associated with goal-tracking as the reward-predictive stimuli and another had levers associated with sign-tracking as the reward-predictive stimuli. All rats were first trained on a choice procedure in which the expected value across both alternatives was equivalent but differed in their stimulus-reward predictive utility. Next, the expected value across both alternatives was systematically changed so that the alternative with greater stimulus-reward predictive utility was suboptimal in regard to primary reinforcement. The results demonstrate that in order to obtain suboptimal choice behavior, incentive salience alongside strong stimulus-reward predictive utility may be necessary; thus, maladaptive decision-making can be driven more by the value attributed to stimuli imbued with incentive salience that reliably predict a reward rather than the reward itself. PMID:27993692

Suboptimal choice in rats: Incentive salience attribution promotes maladaptive decision-making.

PubMed

Chow, Jonathan J; Smith, Aaron P; Wilson, A George; Zentall, Thomas R; Beckmann, Joshua S

2017-03-01

Stimuli that are more predictive of subsequent reward also function as better conditioned reinforcers. Moreover, stimuli attributed with incentive salience function as more robust conditioned reinforcers. Some theories have suggested that conditioned reinforcement plays an important role in promoting suboptimal choice behavior, like gambling. The present experiments examined how different stimuli, those attributed with incentive salience versus those without, can function in tandem with stimulus-reward predictive utility to promote maladaptive decision-making in rats. One group of rats had lights associated with goal-tracking as the reward-predictive stimuli and another had levers associated with sign-tracking as the reward-predictive stimuli. All rats were first trained on a choice procedure in which the expected value across both alternatives was equivalent but differed in their stimulus-reward predictive utility. Next, the expected value across both alternatives was systematically changed so that the alternative with greater stimulus-reward predictive utility was suboptimal in regard to primary reinforcement. The results demonstrate that in order to obtain suboptimal choice behavior, incentive salience alongside strong stimulus-reward predictive utility may be necessary; thus, maladaptive decision-making can be driven more by the value attributed to stimuli imbued with incentive salience that reliably predict a reward rather than the reward itself. Copyright © 2016 Elsevier B.V. All rights reserved.

Tentative evidence for striatal hyperactivity in adolescent cannabis-using boys: a cross-sectional multicenter fMRI study.

PubMed

Jager, Gerry; Block, Robert I; Luijten, Maartje; Ramsey, Nick F

2013-01-01

Adolescents' risk-taking behavior has been linked to a maturational imbalance between reward ("go") and inhibitory-control ("stop")-related brain circuitry. This may drive adolescent drug-taking, such as cannabis use. In this study, we assessed the non-acute effects of adolescent cannabis use on reward-related brain function. We performed a two-site (United States and Netherlands; pooled data) functional magnetic resonance imaging (fMRI) study with a cross-sectional design. Twenty-one abstinent but frequent cannabis-using boys were compared with 24 non-using peers on reward-related brain function, using a monetary incentive delay task with fMRI. Focus was on anticipatory and response stages of reward and brain areas critically involved in reward processing like the striatum. Performance in users was normal. Region-of-interest analysis indicated striatal hyperactivity during anticipatory stages of reward in users. Intriguingly, this effect was most pronounced during non-rewarding events. Striatal hyperactivity in adolescent cannabis users may signify an overly sensitive motivational brain circuitry. Frequent cannabis use during adolescence may induce diminished ability to disengage the motivational circuit when no reward can be obtained. This could strengthen the search for reinforcements like drugs of abuse, even when facing the negative (non-rewarding) consequences.

Dopamine Modulates Adaptive Prediction Error Coding in the Human Midbrain and Striatum.

PubMed

Diederen, Kelly M J; Ziauddeen, Hisham; Vestergaard, Martin D; Spencer, Tom; Schultz, Wolfram; Fletcher, Paul C

2017-02-15

Learning to optimally predict rewards requires agents to account for fluctuations in reward value. Recent work suggests that individuals can efficiently learn about variable rewards through adaptation of the learning rate, and coding of prediction errors relative to reward variability. Such adaptive coding has been linked to midbrain dopamine neurons in nonhuman primates, and evidence in support for a similar role of the dopaminergic system in humans is emerging from fMRI data. Here, we sought to investigate the effect of dopaminergic perturbations on adaptive prediction error coding in humans, using a between-subject, placebo-controlled pharmacological fMRI study with a dopaminergic agonist (bromocriptine) and antagonist (sulpiride). Participants performed a previously validated task in which they predicted the magnitude of upcoming rewards drawn from distributions with varying SDs. After each prediction, participants received a reward, yielding trial-by-trial prediction errors. Under placebo, we replicated previous observations of adaptive coding in the midbrain and ventral striatum. Treatment with sulpiride attenuated adaptive coding in both midbrain and ventral striatum, and was associated with a decrease in performance, whereas bromocriptine did not have a significant impact. Although we observed no differential effect of SD on performance between the groups, computational modeling suggested decreased behavioral adaptation in the sulpiride group. These results suggest that normal dopaminergic function is critical for adaptive prediction error coding, a key property of the brain thought to facilitate efficient learning in variable environments. Crucially, these results also offer potential insights for understanding the impact of disrupted dopamine function in mental illness. SIGNIFICANCE STATEMENT To choose optimally, we have to learn what to expect. Humans dampen learning when there is a great deal of variability in reward outcome, and two brain regions that are modulated by the brain chemical dopamine are sensitive to reward variability. Here, we aimed to directly relate dopamine to learning about variable rewards, and the neural encoding of associated teaching signals. We perturbed dopamine in healthy individuals using dopaminergic medication and asked them to predict variable rewards while we made brain scans. Dopamine perturbations impaired learning and the neural encoding of reward variability, thus establishing a direct link between dopamine and adaptation to reward variability. These results aid our understanding of clinical conditions associated with dopaminergic dysfunction, such as psychosis. Copyright © 2017 Diederen et al.

A functional neuroimaging study assessing gender differences in the neural mechanisms underlying the ability to resist impulsive desires.

PubMed

Diekhof, Esther K; Keil, Maria; Obst, Katrin U; Henseler, Ilona; Dechent, Peter; Falkai, Peter; Gruber, Oliver

2012-09-14

There is ample evidence of gender differences in neural processes and behavior. Differences in reward-related behaviors have been linked to either temporary or permanent organizational influences of gonadal hormones on the mesolimbic dopamine system and reward-related activation. Still, little is known about the association between biological gender and the neural underpinnings of the ability to resist reward-related impulses. Here we assessed with functional magnetic resonance imaging which neural processes enable men and women to successfully control their desire for immediate reward when this is required by a higher-order goal (i.e., during a 'desire-reason dilemma'; Diekhof and Gruber, 2010). Thirty-two participants (16 females) were closely matched for age, personality characteristics (e.g., novelty seeking) and behavioral performance in the 'desire-reason task'. On the neural level, men and women showed similarities in the general response of the nucleus accumbens and of the ventral tegmental area to predictors of immediate reward, but they differed in additional brain mechanisms that enabled self-controlled decisions against the preference for immediate reward. Firstly, men exhibited a stronger reduction of activation in the ventral pallidum, putamen, temporal pole and pregenual anterior cingulate cortex during the 'desire-reason dilemma'. Secondly, connectivity analyses revealed a significant change in the direction of the connectivity between anteroventral prefrontal cortex and nucleus accumbens during decisions counteracting the reward-related impulse when comparing men and women. Together, these findings support the view of a sexual dimorphism that manifested in the recruitment of gender-specific neural resources during the successful deployment of self-control. Copyright © 2012 Elsevier B.V. All rights reserved.

Dissociated effects of anticipating smoking versus monetary reward in the caudate as a function of smoking abstinence.

PubMed

Sweitzer, Maggie M; Geier, Charles F; Joel, Danielle L; McGurrin, Patrick; Denlinger, Rachel L; Forbes, Erika E; Donny, Eric C

2014-11-01

Theories of addiction suggest that chronic smoking may be associated with both hypersensitivity to smoking and related cues and hyposensitivity to alternative reinforcers. However, neural responses to smoking and nonsmoking rewards are rarely evaluated within the same paradigm, leaving the extent to which both processes operate simultaneously uncertain. Behavioral evidence and theoretical models suggest that dysregulated reward processing may be more pronounced during deprivation from nicotine, but neuroimaging evidence on the effects of deprivation on reward processing is limited. The current study examined the impact of deprivation from smoking on neural processing of both smoking and monetary rewards. Two separate functional magnetic resonance imaging scans were performed in 38 daily smokers, one after smoking without restriction and one following 24 hours of abstinence. A rewarded guessing task was conducted during each scan to evaluate striatal blood oxygen level-dependent response during anticipation of both smoking and monetary rewards. A significant reward type by abstinence interaction was observed in the bilateral caudate and medial prefrontal cortex during reward anticipation. The blood oxygen level-dependent response to anticipation of smoking reward was significantly higher and anticipation of monetary rewards was significantly lower during abstinence compared with nonabstinence. Attenuation of monetary reward-related activation during abstinence was significantly correlated with abstinence-induced increases in craving and withdrawal. These results provide the first direct evidence of dissociated effects of smoking versus monetary rewards as a function of abstinence. The findings suggest an important neural pathway that may underlie the choice to smoke in lieu of alternative reinforcement during a quit attempt. © 2013 Society of Biological Psychiatry Published by Society of Biological Psychiatry All rights reserved.

Song practice as a rewarding form of play in songbirds.

PubMed

Riters, Lauren V; Spool, Jeremy A; Merullo, Devin P; Hahn, Allison H

2017-10-12

In adult songbirds, the primary functions of song are mate attraction and territory defense; yet, many songbirds sing at high rates as juveniles and outside these primary contexts as adults. Singing outside primary contexts is critical for song learning and maintenance, and ultimately necessary for breeding success. However, this type of singing (i.e., song "practice") occurs even in the absence of immediate or obvious extrinsic reinforcement; that is, it does not attract mates or repel competitors. Here we review studies that support the hypothesis that song practice is stimulated and maintained by intrinsic reward mechanisms (i.e., that it is associated with a positive affective state). Additionally, we propose that song practice can be considered a rewarding form of play behavior similar to forms of play observed in multiple young animals as they practice sequences of motor events that are used later in primary adult reproductive contexts. This review highlights research suggesting at least partially overlapping roles for neural reward systems in birdsong and mammalian play and evidence that steroid hormones modify these systems to shift animals from periods of intrinsically rewarded motor exploration (i.e., singing in birds and play in mammals) to the use of similar motor patterns in primary reproductive contexts. Copyright © 2017 Elsevier B.V. All rights reserved.

Neural Sensitivity to Absolute and Relative Anticipated Reward in Adolescents

PubMed Central

Vaidya, Jatin G.; Knutson, Brian; O'Leary, Daniel S.; Block, Robert I.; Magnotta, Vincent

2013-01-01

Adolescence is associated with a dramatic increase in risky and impulsive behaviors that have been attributed to developmental differences in neural processing of rewards. In the present study, we sought to identify age differences in anticipation of absolute and relative rewards. To do so, we modified a commonly used monetary incentive delay (MID) task in order to examine brain activity to relative anticipated reward value (neural sensitivity to the value of a reward as a function of other available rewards). This design also made it possible to examine developmental differences in brain activation to absolute anticipated reward magnitude (the degree to which neural activity increases with increasing reward magnitude). While undergoing fMRI, 18 adolescents and 18 adult participants were presented with cues associated with different reward magnitudes. After the cue, participants responded to a target to win money on that trial. Presentation of cues was blocked such that two reward cues associated with $.20, $1.00, or $5.00 were in play on a given block. Thus, the relative value of the $1.00 reward varied depending on whether it was paired with a smaller or larger reward. Reflecting age differences in neural responses to relative anticipated reward (i.e., reference dependent processing), adults, but not adolescents, demonstrated greater activity to a $1 reward when it was the larger of the two available rewards. Adults also demonstrated a more linear increase in ventral striatal activity as a function of increasing absolute reward magnitude compared to adolescents. Additionally, reduced ventral striatal sensitivity to absolute anticipated reward (i.e., the difference in activity to medium versus small rewards) correlated with higher levels of trait Impulsivity. Thus, ventral striatal activity in anticipation of absolute and relative rewards develops with age. Absolute reward processing is also linked to individual differences in Impulsivity. PMID:23544046

Modeling the effect of reward amount on probability discounting.

PubMed

Myerson, Joel; Green, Leonard; Morris, Joshua

2011-03-01

The present study with college students examined the effect of amount on the discounting of probabilistic monetary rewards. A hyperboloid function accurately described the discounting of hypothetical rewards ranging in amount from $20 to $10,000,000. The degree of discounting increased continuously with amount of probabilistic reward. This effect of amount was not due to changes in the rate parameter of the discounting function, but rather was due to increases in the exponent. These results stand in contrast to those observed with the discounting of delayed monetary rewards, in which the degree of discounting decreases with reward amount due to amount-dependent decreases in the rate parameter. Taken together, this pattern of results suggests that delay and probability discounting reflect different underlying mechanisms. That is, the fact that the exponent in the delay discounting function is independent of amount is consistent with a psychophysical scaling interpretation, whereas the finding that the exponent of the probability-discounting function is amount-dependent is inconsistent with such an interpretation. Instead, the present results are consistent with the idea that the probability-discounting function is itself the product of a value function and a weighting function. This idea was first suggested by Kahneman and Tversky (1979), although their prospect theory does not predict amount effects like those observed. The effect of amount on probability discounting was parsimoniously incorporated into our hyperboloid discounting function by assuming that the exponent was proportional to the amount raised to a power. The amount-dependent exponent of the probability-discounting function may be viewed as reflecting the effect of amount on the weighting of the probability with which the reward will be received.

Neurobiological Substrates for the Dark Side of Compulsivity in Addiction

PubMed Central

Koob, George F.

2009-01-01

Drug addiction can be defined by a compulsion to seek and take drug, loss of control in limiting intake, and the emergence of a negative emotional state when access to the drug is prevented. Drug addiction impacts multiple motivational mechanisms and can be conceptualized as a disorder that progresses from impulsivity (positive reinforcement) to compulsivity (negative reinforcement). The construct of negative reinforcement is defined as drug taking that alleviates a negative emotional state. The negative emotional state that drives such negative reinforcement is hypothesized to derive from dysregulation of key neurochemical elements involved in reward and stress within the basal forebrain structures involving the ventral striatum and extended amygdala. Specific neurochemical elements in these structures include not only decreases in reward neurotransmission, such as decreases in dopamine and opioid peptide function in the ventral striatum, but also recruitment of brain stress systems, such as corticotropin-releasing factor (CRF), in the extended amygdala. Acute withdrawal from all major drugs of abuse produces increases in reward thresholds, increases in anxiety-like responses, and increases in extracellular levels of CRF in the central nucleus of the amygdala. CRF receptor antagonists also block excessive drug intake produced by dependence. A brain stress response system is hypothesized to be activated by acute excessive drug intake, to be sensitized during repeated withdrawal, to persist into protracted abstinence, and to contribute to the compulsivity of addiction. Other components of brain stress systems in the extended amygdala that interact with CRF and may contribute to the negative motivational state of withdrawal include norepinephrine, dynorphin, and neuropeptide Y. The combination of loss of reward function and recruitment of brain stress systems provides a powerful neurochemical basis for a negative emotional state that is responsible for the negative reinforcement driving, at least in part, the compulsivity of addiction. PMID:18725236

Abnormal Social Reward Responses in Anorexia Nervosa: An fMRI Study.

PubMed

Via, Esther; Soriano-Mas, Carles; Sánchez, Isabel; Forcano, Laura; Harrison, Ben J; Davey, Christopher G; Pujol, Jesús; Martínez-Zalacaín, Ignacio; Menchón, José M; Fernández-Aranda, Fernando; Cardoner, Narcís

2015-01-01

Patients with anorexia nervosa (AN) display impaired social interactions, implicated in the development and prognosis of the disorder. Importantly, social behavior is modulated by reward-based processes, and dysfunctional at-brain-level reward responses have been involved in AN neurobiological models. However, no prior evidence exists of whether these neural alterations would be equally present in social contexts. In this study, we conducted a cross-sectional social-judgment functional magnetic resonance imaging (fMRI) study of 20 restrictive-subtype AN patients and 20 matched healthy controls. Brain activity during acceptance and rejection was investigated and correlated with severity measures (Eating Disorder Inventory -EDI-2) and with personality traits of interest known to modulate social behavior (The Sensitivity to Punishment and Sensitivity to Reward Questionnaire). Patients showed hypoactivation of the dorsomedial prefrontal cortex (DMPFC) during social acceptance and hyperactivation of visual areas during social rejection. Ventral striatum activation during rejection was positively correlated in patients with clinical severity scores. During acceptance, activation of the frontal opercula-anterior insula and dorsomedial/dorsolateral prefrontal cortices was differentially associated with reward sensitivity between groups. These results suggest an abnormal motivational drive for social stimuli, and involve overlapping social cognition and reward systems leading to a disruption of adaptive responses in the processing of social reward. The specific association of reward-related regions with clinical and psychometric measures suggests the putative involvement of reward structures in the maintenance of pathological behaviors in AN.

Led into temptation? Rewarding brand logos bias the neural encoding of incidental economic decisions.

PubMed

Murawski, Carsten; Harris, Philip G; Bode, Stefan; Domínguez D, Juan F; Egan, Gary F

2012-01-01

Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI) study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness.

Led into Temptation? Rewarding Brand Logos Bias the Neural Encoding of Incidental Economic Decisions

PubMed Central

Murawski, Carsten; Harris, Philip G.; Bode, Stefan; Domínguez D., Juan F.; Egan, Gary F.

2012-01-01

Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI) study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness. PMID:22479547

Magnetoencephalographic imaging of deep corticostriatal network activity during a rewards paradigm.

PubMed

Kanal, Eliezer Y; Sun, Mingui; Ozkurt, Tolga E; Jia, Wenyan; Sclabassi, Robert

2009-01-01

The human rewards network is a complex system spanning both cortical and subcortical regions. While much is known about the functions of the various components of the network, research on the behavior of the network as a whole has been stymied due to an inability to detect signals at a high enough temporal resolution from both superficial and deep network components simultaneously. In this paper, we describe the application of magnetoencephalographic imaging (MEG) combined with advanced signal processing techniques to this problem. Using data collected while subjects performed a rewards-related gambling paradigm demonstrated to activate the rewards network, we were able to identify neural signals which correspond to deep network activity. We also show that this signal was not observable prior to filtration. These results suggest that MEG imaging may be a viable tool for the detection of deep neural activity.

What's the Point?: A Review of Reward Systems Implemented in Gamification Interventions.

PubMed

Lewis, Zakkoyya H; Swartz, Maria C; Lyons, Elizabeth J

2016-04-01

Rewards are commonly used in interventions to change behavior, but they can inhibit development of intrinsic motivation, which is associated with long-term behavior maintenance. Gamification is a novel intervention strategy that may target intrinsic motivation through fun and enjoyment. Before the effects of gamified interventions on motivation can be determined, there must be an understanding of how gamified interventions operationalize rewards, such as point systems. The purpose of this review is to determine the prevalence of different reward types, specifically point systems, within gamified interventions. Electronic databases were searched for relevant articles. Data sources included Medline OVID, Medline PubMed, Web of Science, CINAHL, Cochrane Central, and PsycINFO. Out of the 21 articles retrieved, 18 studies described a reward system and were included in this review. Gamified interventions were designed to target a myriad of clinical outcomes across diverse populations. Rewards included points (n = 14), achievements/badges/medals (n = 7), tangible rewards (n = 7), currency (n = 4), other unspecified rewards (n = 3), likes (n = 2), animated feedback (n = 1), and kudos (n = 1). Rewards, and points in particular, appear to be a foundational component of gamified interventions. Despite their prevalence, authors seldom described the use of noncontingent rewards or how the rewards interacted with other game features. The reward systems relying on tangible rewards and currency may have been limited by inhibited intrinsic motivation. As gamification proliferates, future research should explicitly describe how rewards were operationalized in the intervention and evaluate the effects of gamified rewards on motivation across populations and research outcomes.

Probing reward function in posttraumatic stress disorder: expectancy and satisfaction with monetary gains and losses.

PubMed

Hopper, James W; Pitman, Roger K; Su, Zhaohui; Heyman, Gene M; Lasko, Natasha B; Macklin, Michael L; Orr, Scott P; Lukas, Scott E; Elman, Igor

2008-08-01

Posttraumatic stress disorder (PTSD) may be associated with dysfunctional reward processing. The present study assessed for such dysfunction in both the expectancy and outcome phases of reward processing. Male Vietnam veterans with (n=15) and without (n=11) combat-related PTSD were administered a wheel of fortune-type gambling task. Self-reported ratings of expectancy and satisfaction were collected respectively before and after each experience of monetary gain or loss. PTSD participants reported both lower expectancy of reward and lower satisfaction with reward when it was received. The latter result was manifest in a failure of PTSD participants to show the greater satisfaction that normally accompanies rewards received under conditions of low expectancy. These results suggest reward function impairment in PTSD related to expectancy, satisfaction, and the expectancy-satisfaction relationship.

Ventral Striatum Functional Connectivity as a Predictor of Adolescent Depressive Disorder in a Longitudinal Community-Based Sample.

PubMed

Pan, Pedro Mario; Sato, João R; Salum, Giovanni A; Rohde, Luis A; Gadelha, Ary; Zugman, Andre; Mari, Jair; Jackowski, Andrea; Picon, Felipe; Miguel, Eurípedes C; Pine, Daniel S; Leibenluft, Ellen; Bressan, Rodrigo A; Stringaris, Argyris

2017-11-01

Previous studies have implicated aberrant reward processing in the pathogenesis of adolescent depression. However, no study has used functional connectivity within a distributed reward network, assessed using resting-state functional MRI (fMRI), to predict the onset of depression in adolescents. This study used reward network-based functional connectivity at baseline to predict depressive disorder at follow-up in a community sample of adolescents. A total of 637 children 6-12 years old underwent resting-state fMRI. Discovery and replication analyses tested intrinsic functional connectivity (iFC) among nodes of a putative reward network. Logistic regression tested whether striatal node strength, a measure of reward-related iFC, predicted onset of a depressive disorder at 3-year follow-up. Further analyses investigated the specificity of this prediction. Increased left ventral striatum node strength predicted increased risk for future depressive disorder (odds ratio=1.54, 95% CI=1.09-2.18), even after excluding participants who had depressive disorders at baseline (odds ratio=1.52, 95% CI=1.05-2.20). Among 11 reward-network nodes, only the left ventral striatum significantly predicted depression. Striatal node strength did not predict other common adolescent psychopathology, such as anxiety, attention deficit hyperactivity disorder, and substance use. Aberrant ventral striatum functional connectivity specifically predicts future risk for depressive disorder. This finding further emphasizes the need to understand how brain reward networks contribute to youth depression.

Reward Abnormalities Among Women with Full and Subthreshold Bulimia Nervosa: A Functional Magnetic Resonance Imaging Study

PubMed Central

Bohon, Cara; Stice, Eric

2010-01-01

Objective To test the hypothesis that women with full and subthreshold bulimia nervosa show abnormal neural activation in response to food intake and anticipated food intake relative to healthy control women. Method Females with and without full/subthreshold bulimia nervosa recruited from the community (N = 26) underwent functional magnetic resonance imaging (fMRI) during receipt and anticipated receipt of chocolate milkshake and a tasteless control solution. Results Women with bulimia nervosa showed trends for less activation than healthy controls in the right anterior insula in response to anticipated receipt of chocolate milkshake (versus tasteless solution) and in the left middle frontal gyrus, right posterior insula, right precentral gyrus, and right mid dorsal insula in response to consumptions of milkshake (versus tasteless solution). Discussion Bulimia nervosa may be related to potential hypo-functioning of the brain reward system, which may lead these individuals to binge eat to compensate for this reward deficit, though the hypo-responsivity might be a result of a history of binge eating highly palatable foods. PMID:21997421

A Survey of Collective Intelligence

NASA Technical Reports Server (NTRS)

Wolpert, David H.; Tumer, Kagan

1999-01-01

This chapter presents the science of "COllective INtelligence" (COIN). A COIN is a large multi-agent systems where: i) the agents each run reinforcement learning (RL) algorithms; ii) there is little to no centralized communication or control; iii) there is a provided world utility function that, rates the possible histories of tile full system. Tile conventional approach to designing large distributed systems to optimize a world utility does not use agents running RL algorithms. Rather that approach begins with explicit modeling of the overall system's dynamics, followed by detailed hand-tuning of the interactions between the components to ensure that they "cooperate" as far as the world utility is concerned. This approach is labor-intensive, often results in highly non-robust systems, and usually results in design techniques that, have limited applicability. In contrast, with COINs we wish to solve the system design problems implicitly, via the 'adaptive' character of the RL algorithms of each of the agents. This COIN approach introduces an entirely new, profound design problem: Assuming the RL algorithms are able to achieve high rewards, what reward functions for the individual agents will, when pursued by those agents, result in high world utility? In other words, what reward functions will best ensure that we do not have phenomena like the tragedy of the commons, or Braess's paradox? Although still very young, the science of COINs has already resulted in successes in artificial domains, in particular in packet-routing, the leader-follower problem, and in variants of Arthur's "El Farol bar problem". It is expected that as it matures not only will COIN science expand greatly the range of tasks addressable by human engineers, but it will also provide much insight into already established scientific fields, such as economics, game theory, or population biology.

Levodopa administration modulates striatal processing of punishment-associated items in healthy participants.

PubMed

Wittmann, Bianca C; D'Esposito, Mark

2015-01-01

Appetitive and aversive processes share a number of features such as their relevance for action and learning. On a neural level, reward and its predictors are associated with increased firing of dopaminergic neurons, whereas punishment processing has been linked to the serotonergic system and to decreases in dopamine transmission. Recent data indicate, however, that the dopaminergic system also responds to aversive stimuli and associated actions. In this pharmacological functional magnetic resonance imaging study, we investigated the contribution of the dopaminergic system to reward and punishment processing in humans. Two groups of participants received either placebo or the dopamine precursor levodopa and were scanned during alternating reward and punishment anticipation blocks. Levodopa administration increased striatal activations for cues presented in punishment blocks. In an interaction with individual personality scores, levodopa also enhanced striatal activation for punishment-predictive compared with neutral cues in participants scoring higher on the novelty-seeking dimension. These data support recent indications that dopamine contributes to punishment processing and suggest that the novelty-seeking trait is a measure of susceptibility to drug effects on motivation. These findings are also consistent with the possibility of an inverted U-shaped response function of dopamine in the striatum, suggesting an optimal level of dopamine release for motivational processing.

Levodopa administration modulates striatal processing of punishment-associated items in healthy participants

PubMed Central

Wittmann, Bianca C.; D’Esposito, Mark

2014-01-01

Rationale Appetitive and aversive processes share a number of features such as their relevance for action and learning. On a neural level, reward and its predictors are associated with increased firing of dopaminergic neurons, whereas punishment processing has been linked to the serotonergic system and to decreases in dopamine transmission. Recent data indicate, however, that the dopaminergic system also responds to aversive stimuli and associated actions. Objectives In this pharmacological functional magnetic resonance imaging (fMRI) study, we investigated the contribution of the dopaminergic system to reward and punishment processing in humans. Methods Two groups of participants received either placebo or the dopamine precursor levodopa and were scanned during alternating reward and punishment anticipation blocks. Results Levodopa administration increased striatal activations for cues presented in punishment blocks. In an interaction with individual personality scores, levodopa also enhanced striatal activation for punishment-predictive compared to neutral cues in participants scoring higher on the novelty-seeking dimension. Conclusions These data support recent indications that dopamine contributes to punishment processing and suggest that the novelty-seeking trait is a measure of susceptibility to drug effects on motivation. These findings are also consistent with the possibility of an inverted U-shaped response function of dopamine in the striatum, suggesting an optimal level of dopamine release for motivational processing. PMID:24923987

Common Dimensional Reward Deficits Across Mood and Psychotic Disorders: A Connectome-Wide Association Study.

PubMed

Sharma, Anup; Wolf, Daniel H; Ciric, Rastko; Kable, Joseph W; Moore, Tyler M; Vandekar, Simon N; Katchmar, Natalie; Daldal, Aylin; Ruparel, Kosha; Davatzikos, Christos; Elliott, Mark A; Calkins, Monica E; Shinohara, Russell T; Bassett, Danielle S; Satterthwaite, Theodore D

2017-07-01

Anhedonia is central to multiple psychiatric disorders and causes substantial disability. A dimensional conceptualization posits that anhedonia severity is related to a transdiagnostic continuum of reward deficits in specific neural networks. Previous functional connectivity studies related to anhedonia have focused on case-control comparisons in specific disorders, using region-specific seed-based analyses. Here, the authors explore the entire functional connectome in relation to reward responsivity across a population of adults with heterogeneous psychopathology. In a sample of 225 adults from five diagnostic groups (major depressive disorder, N=32; bipolar disorder, N=50; schizophrenia, N=51; psychosis risk, N=39; and healthy control subjects, N=53), the authors conducted a connectome-wide analysis examining the relationship between a dimensional measure of reward responsivity (the reward sensitivity subscale of the Behavioral Activation Scale) and resting-state functional connectivity using multivariate distance-based matrix regression. The authors identified foci of dysconnectivity associated with reward responsivity in the nucleus accumbens, the default mode network, and the cingulo-opercular network. Follow-up analyses revealed dysconnectivity among specific large-scale functional networks and their connectivity with the nucleus accumbens. Reward deficits were associated with decreased connectivity between the nucleus accumbens and the default mode network and increased connectivity between the nucleus accumbens and the cingulo-opercular network. In addition, impaired reward responsivity was associated with default mode network hyperconnectivity and diminished connectivity between the default mode network and the cingulo-opercular network. These results emphasize the centrality of the nucleus accumbens in the pathophysiology of reward deficits and suggest that dissociable patterns of connectivity among large-scale networks are critical to the neurobiology of reward dysfunction across clinical diagnostic categories.

Interactions between the nucleus accumbens and auditory cortices predict music reward value.

PubMed

Salimpoor, Valorie N; van den Bosch, Iris; Kovacevic, Natasa; McIntosh, Anthony Randal; Dagher, Alain; Zatorre, Robert J

2013-04-12

We used functional magnetic resonance imaging to investigate neural processes when music gains reward value the first time it is heard. The degree of activity in the mesolimbic striatal regions, especially the nucleus accumbens, during music listening was the best predictor of the amount listeners were willing to spend on previously unheard music in an auction paradigm. Importantly, the auditory cortices, amygdala, and ventromedial prefrontal regions showed increased activity during listening conditions requiring valuation, but did not predict reward value, which was instead predicted by increasing functional connectivity of these regions with the nucleus accumbens as the reward value increased. Thus, aesthetic rewards arise from the interaction between mesolimbic reward circuitry and cortical networks involved in perceptual analysis and valuation.

Lyme and Dopaminergic Function: Hypothesizing Reduced Reward Deficiency Symptomatology by Regulating Dopamine Transmission

PubMed Central

Blum, Kenneth; Modestino, Edward J; Febo, Marcelo; Steinberg, Bruce; McLaughlin, Thomas; Fried, Lyle; Baron, David; Siwicki, David; Badgaiyan, Rajendra D

2017-01-01

The principal vector of Lyme disease in the United States is Ixodes scapularis: black legged or deer ticks. There is increased evidence that those infected may be plagued by anxiety or depression as well. Researchers have identified transcripts coding for two putative cytosolic sulfotransferases in these ticks, which recognized phenolic monoamines as their substrates. It is hypothesized that protracted Lyme disease sequelae may be due to impairment of dopaminergic function of the brain reward circuitry. The subsequent recombinant proteins exhibited sulfotransferase function against two neurotransmitters: dopamine and octopamine. This, in itself, can reduce dopamine function leading to many Reward Deficiency Syndrome behaviors, including depression and possibly, anxiety. In fact, it was shown that activity of Ixosc Sult 1 and Sult 2 in the Ixodid tick salivary glands might contain inactivation of the salivation signal through sulfonation of either dopamine or octopamine. This infraction results in a number of clinically observed mood changes, such as anxiety and depression. In fact, there are common symptoms observed for both Parkinson and Lyme diseases. The importance of understanding the mechanistic and neurobiological effects of Lyme on the central nervous system (CNS) provides the basis for pro-dopamine regulation as a treatment. WC 195 PMID:28736624

Cognitive enhancement as a pharmacotherapy target for stimulant addiction.

PubMed

Sofuoglu, Mehmet

2010-01-01

No medications have been proven to be effective for cocaine and methamphetamine addiction. Attenuation of drug reward has been the main strategy for medications development, but this approach has not led to effective treatments. Thus, there is a need to identify novel treatment targets in addition to the brain reward system. To propose a novel treatment strategy for stimulant addiction that will focus on medications enhancing cognitive function and attenuating drug reward. Pre-clinical and clinical literature on potential use of cognitive enhancers for stimulant addiction pharmacotherapy was reviewed. Cocaine and methamphetamine users show significant cognitive impairments, especially in attention, working memory and response inhibition functions. The cognitive impairments seem to be predictive of poor treatment retention and outcome. Medications targeting acetylcholine and norepinephrine are particularly well suited for enhancing cognitive function in stimulant users. Many cholinergic and noradrenergic medications are on the market and have a good safety profile and low abuse potential. These include galantamine, donepezil and rivastigmine (cholinesterase inhibitors), varenicline (partial nicotine agonist), guanfacine (alpha(2)-adrenergic agonist) and atomoxetine (norepinephrine transporter inhibitor). Future clinical studies designed optimally to measure cognitive function as well as drug use behavior would be needed to test the efficacy of these cognitive enhancers for stimulant addiction.

Lyme and Dopaminergic Function: Hypothesizing Reduced Reward Deficiency Symptomatology by Regulating Dopamine Transmission.

PubMed

Blum, Kenneth; Modestino, Edward J; Febo, Marcelo; Steinberg, Bruce; McLaughlin, Thomas; Fried, Lyle; Baron, David; Siwicki, David; Badgaiyan, Rajendra D

2017-05-01

The principal vector of Lyme disease in the United States is Ixodes scapularis: black legged or deer ticks. There is increased evidence that those infected may be plagued by anxiety or depression as well. Researchers have identified transcripts coding for two putative cytosolic sulfotransferases in these ticks, which recognized phenolic monoamines as their substrates. It is hypothesized that protracted Lyme disease sequelae may be due to impairment of dopaminergic function of the brain reward circuitry. The subsequent recombinant proteins exhibited sulfotransferase function against two neurotransmitters: dopamine and octopamine. This, in itself, can reduce dopamine function leading to many Reward Deficiency Syndrome behaviors, including depression and possibly, anxiety. In fact, it was shown that activity of Ixosc Sult 1 and Sult 2 in the Ixodid tick salivary glands might contain inactivation of the salivation signal through sulfonation of either dopamine or octopamine. This infraction results in a number of clinically observed mood changes, such as anxiety and depression. In fact, there are common symptoms observed for both Parkinson and Lyme diseases. The importance of understanding the mechanistic and neurobiological effects of Lyme on the central nervous system (CNS) provides the basis for pro-dopamine regulation as a treatment. WC 195.

A hypothesis on the biological origins and social evolution of music and dance.

PubMed

Wang, Tianyan

2015-01-01

The origins of music and musical emotions is still an enigma, here I propose a comprehensive hypothesis on the origins and evolution of music, dance, and speech from a biological and sociological perspective. I suggest that every pitch interval between neighboring notes in music represents corresponding movement pattern through interpreting the Doppler effect of sound, which not only provides a possible explanation for the transposition invariance of music, but also integrates music and dance into a common form-rhythmic movements. Accordingly, investigating the origins of music poses the question: why do humans appreciate rhythmic movements? I suggest that human appreciation of rhythmic movements and rhythmic events developed from the natural selection of organisms adapting to the internal and external rhythmic environments. The perception and production of, as well as synchronization with external and internal rhythms are so vital for an organism's survival and reproduction, that animals have a rhythm-related reward and emotion (RRRE) system. The RRRE system enables the appreciation of rhythmic movements and events, and is integral to the origination of music, dance and speech. The first type of rewards and emotions (rhythm-related rewards and emotions, RRREs) are evoked by music and dance, and have biological and social functions, which in turn, promote the evolution of music, dance and speech. These functions also evoke a second type of rewards and emotions, which I name society-related rewards and emotions (SRREs). The neural circuits of RRREs and SRREs develop in species formation and personal growth, with congenital and acquired characteristics, respectively, namely music is the combination of nature and culture. This hypothesis provides probable selection pressures and outlines the evolution of music, dance, and speech. The links between the Doppler effect and the RRREs and SRREs can be empirically tested, making the current hypothesis scientifically concrete.

Remembering with gains and losses: effects of monetary reward and punishment on successful encoding activation of source memories.

PubMed

Shigemune, Yayoi; Tsukiura, Takashi; Kambara, Toshimune; Kawashima, Ryuta

2014-05-01

The motivation of getting rewards or avoiding punishments reinforces learning behaviors. Although the neural mechanisms underlying the effect of rewards on episodic memory have been demonstrated, there is little evidence of the effect of punishments on this memory. Our functional magnetic resonance imaging (fMRI) study investigated the effects of monetary rewards and punishments on activation during the encoding of source memories. During encoding, participants memorized words (item) and locations of presented words (source) under 3 conditions (Reward, Punishment, and Control). During retrieval, participants retrieved item and source memories of the words and were rewarded or penalized according to their performance. Source memories encoded with rewards or punishments were remembered better than those without such encoding. fMRI data demonstrated that the ventral tegmental area and substantia nigra and nucleus accumbens activations reflected both the processes of reward and punishment, whereas insular activation increased as a linear function of punishment. Activation in the hippocampus and parahippocampal cortex predicted subsequent retrieval success of source memories. Additionally, correlations between these reward/punishment-related regions and the hippocampus were significant. The successful encoding of source memories could be enhanced by punishments and rewards, and interactions between reward/punishment-related regions and memory-related regions could contribute to memory enhancement by reward and/or punishment.

Diminished social reward anticipation in the broad autism phenotype as revealed by event-related brain potentials

PubMed Central

Cox, Anthony; Kohls, Gregor; Naples, Adam J.; Mukerji, Cora E.; Coffman, Marika C.; Rutherford, Helena J. V.; Mayes, Linda C.

2015-01-01

Diminished responsivity to reward incentives is a key contributor to the social-communication problems seen in autism spectrum disorders (ASDs). Social motivation theories suggest that individuals with ASD do not experience social interactions as rewarding, leading to negative consequences for the development of brain circuitry subserving social information. In this study, we examined neural responses to social and non-social reward anticipation in 35 typically developing young adults, examining modulation of reward sensitivity by level of autistic traits. Using an Event-related potential incentive-delay task incorporating novel, more ecologically valid forms of reward, higher expression of autistic traits was associated with an attenuated P3 response to the anticipation of social (simulated real-time video feedback from an observer), but not non-social (candy), rewards. Exploratory analyses revealed that this was unrelated to mentalizing ability. The P3 component reflects motivated attention to reward signals, suggesting attenuated motivation allocation specific to social incentives. The study extends prior findings of atypical reward anticipation in ASD, demonstrating that attenuated social reward responsiveness extends to autistic traits in the range of typical functioning. Results support the development of innovative paradigms for investigating social and non-social reward responsiveness. Insight into vulnerabilities in reward processing is critical for understanding social function in ASD. PMID:25752905

Remembering with Gains and Losses: Effects of Monetary Reward and Punishment on Successful Encoding Activation of Source Memories

PubMed Central

Shigemune, Yayoi; Tsukiura, Takashi; Kambara, Toshimune; Kawashima, Ryuta

2014-01-01

The motivation of getting rewards or avoiding punishments reinforces learning behaviors. Although the neural mechanisms underlying the effect of rewards on episodic memory have been demonstrated, there is little evidence of the effect of punishments on this memory. Our functional magnetic resonance imaging (fMRI) study investigated the effects of monetary rewards and punishments on activation during the encoding of source memories. During encoding, participants memorized words (item) and locations of presented words (source) under 3 conditions (Reward, Punishment, and Control). During retrieval, participants retrieved item and source memories of the words and were rewarded or penalized according to their performance. Source memories encoded with rewards or punishments were remembered better than those without such encoding. fMRI data demonstrated that the ventral tegmental area and substantia nigra and nucleus accumbens activations reflected both the processes of reward and punishment, whereas insular activation increased as a linear function of punishment. Activation in the hippocampus and parahippocampal cortex predicted subsequent retrieval success of source memories. Additionally, correlations between these reward/punishment-related regions and the hippocampus were significant. The successful encoding of source memories could be enhanced by punishments and rewards, and interactions between reward/punishment-related regions and memory-related regions could contribute to memory enhancement by reward and/or punishment. PMID:23314939

Healthy adolescents' neural response to reward: associations with puberty, positive affect, and depressive symptoms.

PubMed

Forbes, Erika E; Ryan, Neal D; Phillips, Mary L; Manuck, Stephen B; Worthman, Carol M; Moyles, Donna L; Tarr, Jill A; Sciarrillo, Samantha R; Dahl, Ronald E

2010-02-01

Changes in reward-related behavior are an important component of normal adolescent affective development. Understanding the neural underpinnings of these normative changes creates a foundation for investigating adolescence as a period of vulnerability to affective disorders, substance use disorders, and health problems. Studies of reward-related brain function have revealed conflicting findings regarding developmental change in the reactivity of the striatum and medial prefrontal cortex (mPFC) and have not considered puberty. The current study focused on puberty-specific changes in brain function and their association with mood. A sample of 77 healthy adolescents (26 pre-/early pubertal, 51 mid-/late pubertal) recruited in a narrow age range (mean = 11.94 years, SD = 0.75) were assessed for sexual maturation and circulating testosterone, completed a functional magnetic resonance imaging (fMRI) guessing task with monetary reward, and underwent experience sampling of mood in natural environments. For comparison, 19 healthy adults completed the fMRI assessment. Adolescents with more advanced pubertal maturation exhibited less striatal and more mPFC reactivity during reward outcome than similarly aged adolescents with less advanced maturation. Testosterone was positively correlated with striatal reactivity in boys during reward anticipation and negatively correlated with striatal reactivity in girls and boys during reward outcome. Striatal reactivity was positively correlated with real-world subjective positive affect and negatively correlated with depressive symptoms. mPFC reactivity was positively correlated with depressive symptoms. Reward-related brain function changes with puberty and is associated with adolescents' positive affect and depressive symptoms. Increased reward-seeking behavior at this developmental point could serve to compensate for these changes.

Reward-related brain function and sleep in pre/early pubertal and mid/late pubertal adolescents.

PubMed

Holm, Stephanie M; Forbes, Erika E; Ryan, Neal D; Phillips, Mary L; Tarr, Jill A; Dahl, Ronald E

2009-10-01

The onset of adolescence is a time of dramatic changes, including changes in sleep, and a time of new health concerns related to increases in risk-taking, sensation seeking, depression, substance use, and accidents. As part of a larger study examining puberty-specific changes in adolescents' reward-related brain function, the current article focuses on the relationship between functional neuroimaging measures of reward and measures of sleep. A total of 58 healthy participants 11-13 years of age completed a functional magnetic resonance imaging scan using a guessing task with monetary rewards and 4 days of at-home actigraphy and self-reported sleep ratings. Sleep variables included actigraph measures of mean weekend minutes asleep, sleep onset time, and sleep offset time, as well as self-reported sleep quality. During reward anticipation, less activation in the caudate (part of the ventral striatum) was associated with fewer minutes asleep, later sleep onset time, and lower sleep quality. During reward outcome, less caudate activation was associated with later sleep onset time, earlier sleep offset time, and lower sleep quality. It has been hypothesized that adolescents' low reactivity in reward-related brain areas could lead to compensatory increases in reward-driven behavior. This study's findings suggest that sleep could contribute to such behavior. Because decreased sleep has been associated with risky behavior and negative mood, these findings raise concerns about a negative spiral whereby the effects of puberty and sleep deprivation may have synergistic effects on reward processing, contributing to adolescent behavioral and emotional health problems.

Reward-Based Spatial Learning in Teens With Bulimia Nervosa

PubMed Central

Cyr, Marilyn; Wang, Zhishun; Tau, Gregory Z.; Zhao, Guihu; Friedl, Eve; Stefan, Mihaela; Terranova, Kate; Marsh, Rachel

2016-01-01

Objective To assess the functioning of mesolimbic and fronto-striatal areas involved in reward-based spatial learning in teenaged girls with bulimia nervosa (BN) that might be involved in the development and maintenance of maladaptive behaviors characteristic of the disorder. Method We compared functional magnetic resonance imaging blood oxygen level dependent response in 27 adolescent girls with BN to that of 27 healthy, age-matched control participants during a reward-based learning task that required learning to use extra-maze cues to navigate a virtual 8-arm radial maze to find hidden rewards. We compared groups in their patterns of brain activation associated with reward-based spatial learning versus a control condition in which rewards were unexpected because they were allotted pseudo-randomly to experimentally prevent learning. Results Both groups learned to navigate the maze to find hidden rewards, but group differences in brain activity associated with maze navigation and reward processing were detected in fronto-striatal regions and right anterior hippocampus. Unlike healthy adolescents, those with BN did not engage right inferior frontal gyrus during maze navigation, activated right anterior hippocampus during the receipt of unexpected rewards (control condition), and deactivated left superior frontal gyrus and right anterior hippocampus during expected reward receipt (learning condition). These patterns of hippocampal activation in the control condition were significantly associated with the frequency of binge-eating episodes. Conclusion Adolescents with BN displayed abnormal functioning of anterior hippocampus and fronto-striatal regions during reward-based spatial learning. These findings suggest that an imbalance in control and reward circuits may arise early in the course of BN. Clinical trial registration information An fMRI Study of Self-regulation in Adolescents With Bulimia Nervosa; https://clinicaltrials.gov/ct2/show/NCT00345943; NCT00345943. PMID:27806864

Enhanced neural responsiveness to reward associated with obesity in the absence of food-related stimuli.

PubMed

Opel, Nils; Redlich, Ronny; Grotegerd, Dominik; Dohm, Katharina; Haupenthal, Cordula; Heindel, Walter; Kugel, Harald; Arolt, Volker; Dannlowski, Udo

2015-06-01

Obesity has been characterized by alterations in brain structure and function associated with emotion processing and regulation. Particularly, aberrations in food-related reward processing have been frequently demonstrated in obese subjects. However, it remains unclear whether reward-associated functional aberrations in obesity are specific for food-related stimuli or represent a general deficit in reward processing, extending to other stimulus domains. Given the crucial role of rewarding effects in the development of obesity and the ongoing discussion on overlapping neurobiological traits of obesity and psychiatric disorders such as depression and substance-related disorders, this study aimed to investigate the possibility of altered reward processing in obese subjects to occur in the absence of food-related stimuli during a monetary reward condition. Twenty-nine healthy obese subjects (body mass index >30) and 29 healthy, age-, and sex-matched control subjects of normal weight underwent functional MRI during a frequently used card guessing paradigm. A Group × Condition (win vs. loss) ANOVA was conducted to investigate differences between obese and normal-weight subjects. We found significant Group × Condition interaction effects in brain areas involved in emotion regulation and reward processing including the insula, the striatum, and the orbitofrontal cortex (OFC). This interaction was predominantly driven by a significant increase in blood oxygenation level dependent (BOLD) response in obese individuals while experiencing reward. Enhanced neural activation in obesity during reward processing seems to be apparent even in the absence of food-related stimuli and, thus, might point to generalized dysfunctions in reward-related brain circuits in obese individuals. © 2015 Wiley Periodicals, Inc.

Striatal activation and frontostriatal connectivity during non-drug reward anticipation in alcohol dependence.

PubMed

Becker, Alena; Kirsch, Martina; Gerchen, Martin Fungisai; Kiefer, Falk; Kirsch, Peter

2017-05-01

According to prevailing neurobiological theories of addiction, altered function in neural reward circuitry is a central mechanism of alcohol dependence. Growing evidence postulates that the ventral striatum (VS), as well as areas of the prefrontal cortex, contribute to the increased incentive salience of alcohol-associated cues, diminished motivation to pursue non-drug rewards and weakened strength of inhibitory cognitive control, which are central to addiction. The present study aims to investigate the neural response and functional connectivity underlying monetary, non-drug reward processing in alcohol dependence. We utilized a reward paradigm to investigate the anticipation of monetary reward in 32 alcohol-dependent inpatients and 35 healthy controls. Functional magnetic resonance imaging was used to measure task-related brain activation and connectivity. Alcohol-dependent patients showed increased activation of the VS during anticipation of monetary gain compared with healthy controls. Generalized psychophysiological interaction analyses revealed decreased functional connectivity between the VS and the dorsolateral prefrontal cortex in alcohol dependent patients relative to controls. Increased activation of the VS and reduced frontostriatal connectivity were associated with increased craving. These findings provide evidence that alcohol dependence is rather associated with disrupted integration of striatal and prefrontal processes than with a global reward anticipation deficit. © 2016 Society for the Study of Addiction.

Regulatory processes of hunger motivated behavior.

PubMed

Lénárd, L; Karádi, Z

2012-01-01

While food intake and body weight are under homeostatic regulation, eating is a highly motivated and reinforced behavior that induces feelings of gratification and pleasure. The chemical senses (taste and odor) and their evaluation are essential to these functions. Brainstem and limbic glucose-monitoring (GM) neurons receiving neurochemical information from the periphery and from the local brain milieu are important controlling hunger motivation, and brain gut peptides have a modulatory role on this function. The hypothalamic and limbic forebrain areas are responsible for evaluation of reward quality and related emotions. They are innervated by the mesolimbic dopaminergic system (MLDS) and majority of GM neurons are also influenced by dopamine. Via dopamine release, the MLDS plays an essential role in rewarding-reinforcing processes of feeding and addiction. The GM network and the MLDS in the limbic system represent essential elements in the neural substrate of motivation.

Perceived Chronic Stress Exposure Modulates Reward-Related Medial Prefrontal Cortex Responses to Acute Stress in Depression

PubMed Central

Kumar, Poornima; Slavich, George M.; Berghorst, Lisa H.; Treadway, Michael T.; Brooks, Nancy H.; Dutra, Sunny J.; Greve, Douglas N.; O'Donovan, Aoife; Bleil, Maria E.; Maninger, Nicole; Pizzagalli, Diego A.

2015-01-01

Introduction Major depressive disorder (MDD) is often precipitated by life stress and growing evidence suggests that stress-induced alterations in reward processing may contribute to such risk. However, no human imaging studies have examined how recent life stress exposure modulates the neural systems that underlie reward processing in depressed and healthy individuals. Methods In this proof-of-concept study, 12 MDD and 10 psychiatrically healthy individuals were interviewed using the Life Events and Difficulties Schedule (LEDS) to assess their perceived levels of recent acute and chronic life stress exposure. Additionally, each participant performed a monetary incentive delay task under baseline (no-stress) and stress (social-evaluative) conditions during functional MRI. Results Across groups, medial prefrontal cortex (mPFC) activation to reward feedback was greater during acute stress versus no-stress conditions in individuals with greater perceived stressor severity. Under acute stress, depressed individuals showed a positive correlation between perceived stressor severity levels and reward-related mPFC activation (r = 0.79, p = 0.004), whereas no effect was found in healthy controls. Moreover, for depressed (but not healthy) individuals, the correlations between the stress (r = 0.79) and no-stress (r = −0.48) conditions were significantly different. Finally, relative to controls, depressed participants showed significantly reduced mPFC grey matter, but functional findings remained when accounting for structural differences. Limitation Small sample size, which warrants replication. Conclusion Depressed individuals experiencing greater recent life stress recruited the mPFC more under stress when processing rewards. Our results represent an initial step toward elucidating mechanisms underlying stress sensitization and recurrence in depression. PMID:25898329

Pro-Dopamine Regulator – (KB220) to Balance Brain Reward Circuitry in Reward Deficiency Syndrome (RDS)

PubMed Central

Blum, Kenneth; Febo, Marcelo; Fried, Lyle; Baron, David; Braverman, Eric R.; Dushaj, Kristina; Li, Mona; Demetrovics, Zsolt; Badgaiyan, Rajendra D.

2017-01-01

We are faced with a worldwide opiate/opioid epidemic that is devastating. According to the Centers for Disease Control and Prevention (CDC), at least 127 people, young and old, are dying every day in America due to narcotic overdose. The Food and Drug Administration (FDA) has approved Medication-Assisted Treatments (MATs) for opiate/opioids as well as alcohol and nicotine. The mechanism of action of most MATS favors either blocking of dopaminergic function or a form of Opiate Substitution Therapy (OST). These treatment options are adequate for short-term treatment of the symptoms of addiction and harm reduction but fail long-term to deal with the cause or lead to recovery. There is a need to continue to seek better treatment options. This mini-review is the history of the development of one such treatment; a glutaminergic-dopaminergic optimization complex called KB220. Growing evidence indicates that brain reward circuitry controls drug addiction, in conjunction with “anti-reward systems” as the “anti-reward systems” can be affected by both glutaminergic and dopaminergic transmission. KB220 may likely alter the function of these regions and provide for the possible eventual balancing the brain reward system and the induction of “dopamine homeostasis.” Many of these concepts have been reported elsewhere and have become an integral part of the addiction science literature. However, the concise review may encourage readership to reconsider these facts and stimulate further research focused on the impact that the induction of “dopamine homeostasis” may have on recovery and relapse prevention. PMID:28804788

Orbitofrontal and hippocampal contributions to memory for face-name associations: the rewarding power of a smile.

PubMed

Tsukiura, Takashi; Cabeza, Roberto

2008-01-01

Memory processes can be enhanced by reward, and social signals such a smiling face can be rewarding to humans. Using event-related functional MRI (fMRI), we investigated the rewarding effect of a simple smile during the encoding and retrieval of face-name associations. During encoding, participants viewed smiling or neutral faces, each paired with a name, and during retrieval, only names were presented, and participants retrieved the associated facial expressions. Successful memory activity of face-name associations was identified by comparing remembered vs. forgotten trials during both encoding and retrieval, and the effect of a smile was identified by comparing successful memory trials for smiling vs. neutral faces. The study yielded three main findings. First, behavioral results showed that the retrieval of face-name associations was more accurate and faster for smiling than neutral faces. Second, the orbitofrontal cortex and the hippocampus showed successful encoding and retrieval activations, which were greater for smiling than neutral faces. Third, functional connectivity between the orbitofrontal cortex and the hippocampus during successful encoding and retrieval was stronger for smiling than neutral faces. As a part of the reward system, the orbitofrontal cortex may modulate memory processes of face-name associations mediated by the hippocampus. Interestingly, the effect of a smile during retrieval was found even though only names were presented as retrieval cues, suggesting that the effect was mediated by face imagery. Taken together, the results demonstrate how rewarding social signals from a smiling face can enhance relational memory for face-name associations.

Peril and Pleasure: An RDoC-inspired examination of threat responses and reward processing in anxiety and depression

PubMed Central

Dillon, Daniel G.; Rosso, Isabelle M.; Pechtel, Pia; Killgore, William D. S.; Rauch, Scott L.; Pizzagalli, Diego A.

2014-01-01

As a step toward addressing limitations in the current psychiatric diagnostic system, the NIMH recently developed the Research Domain Criteria (RDoC) to stimulate integrative research—spanning self-report, behavior, neural circuitry, and molecular/genetic mechanisms—on core psychological processes implicated in mental illness. Here, we use the RDoC conceptualization to review research on threat responses, reward processing, and their interaction. The first section of the manuscript highlights the pivotal role of exaggerated threat responses—mediated by circuits connecting the frontal cortex, amygdala, and midbrain—in anxiety, and reviews data indicating that genotypic variation in the serotonin system is associated with hyperactivity in this circuitry, which elevates the risk for anxiety and mood disorders. In the second section, we describe mounting evidence linking anhedonic behavior to deficits in psychological functions that rely heavily on dopamine signaling, especially cost/benefit decision-making and reward learning. The third section covers recent studies that document negative effects of acute threats and chronic stress on reward responses in humans. The mechanisms underlying such effects are unclear, but new optogenetic data in rodents indicate that GABAergic inhibition of midbrain dopamine neurons, driven by activation of the habenula, may play a fundamental role in stress-induced anhedonia. In addition to its basic scientific value, a better understanding of interactions between the neural systems that mediate threat and reward responses may offer relief from the burdensome condition of anxious depression. PMID:24151118

Oxytocin modulates hemodynamic responses to monetary incentives in humans

PubMed Central

Mickey, Brian J.; Heffernan, Joseph; Heisel, Curtis; Peciña, Marta; Hsu, David T.; Zubieta, Jon-Kar; Love, Tiffany M.

2016-01-01

Oxytocin is a neuropeptide widely recognized for its role in regulating social and reproductive behavior. Increasing evidence from animal models suggests that oxytocin also modulates reward circuitry in non-social contexts, but evidence in humans is lacking. Here we examined the effects of oxytocin administration on reward circuit function in 18 healthy men as they performed a monetary incentive task. The blood oxygenation level dependent (BOLD) signal was measured using functional magnetic resonance imaging in the context of a randomized, double-blind, placebo-controlled, crossover trial of intranasal oxytocin. We found that oxytocin increases the BOLD signal in the midbrain (substantia nigra and ventral tegmental area) during the late phase of the hemodynamic response to incentive stimuli. Oxytocin’s effects on midbrain responses correlated positively with its effects on positive emotional state. We did not detect an effect of oxytocin on responses in the nucleus accumbens. Whole-brain analyses revealed that oxytocin attenuated medial prefrontal cortical deactivation specifically during anticipation of loss. Our findings demonstrate that intranasal administration of oxytocin modulates human midbrain and medial prefrontal function during motivated behavior. These findings suggest that endogenous oxytocin is a neurochemical mediator of reward behaviors in humans – even in a non-social context – and that the oxytocinergic system is a potential target of pharmacotherapy for psychiatric disorders that involve dysfunction of reward circuitry. PMID:27614896

Reward salience and risk aversion underlie differential ACC activity in substance dependence

PubMed Central

Alexander, William H.; Fukunaga, Rena; Finn, Peter; Brown, Joshua W.

2015-01-01

The medial prefrontal cortex, especially the dorsal anterior cingulate cortex (ACC), has long been implicated in cognitive control and error processing. Although the association between ACC and behavior has been established, it is less clear how ACC contributes to dysfunctional behavior such as substance dependence. Evidence from neuroimaging studies investigating ACC function in substance users is mixed, with some studies showing disengagement of ACC in substance dependent individuals (SDs), while others show increased ACC activity related to substance use. In this study, we investigate ACC function in SDs and healthy individuals performing a change signal task for monetary rewards. Using a priori predictions derived from a recent computational model of ACC, we find that ACC activity differs between SDs and controls in factors related to reward salience and risk aversion between SDs and healthy individuals. Quantitative fits of a computational model to fMRI data reveal significant differences in best fit parameters for reward salience and risk preferences. Specifically, the ACC in SDs shows greater risk aversion, defined as concavity in the utility function, and greater attention to rewards relative to reward omission. Furthermore, across participants risk aversion and reward salience are positively correlated. The results clarify the role that ACC plays in both the reduced sensitivity to omitted rewards and greater reward valuation in SDs. Clinical implications of applying computational modeling in psychiatry are also discussed. PMID:26106528

Reward salience and risk aversion underlie differential ACC activity in substance dependence.

PubMed

Alexander, William H; Fukunaga, Rena; Finn, Peter; Brown, Joshua W

2015-01-01

The medial prefrontal cortex, especially the dorsal anterior cingulate cortex (ACC), has long been implicated in cognitive control and error processing. Although the association between ACC and behavior has been established, it is less clear how ACC contributes to dysfunctional behavior such as substance dependence. Evidence from neuroimaging studies investigating ACC function in substance users is mixed, with some studies showing disengagement of ACC in substance dependent individuals (SDs), while others show increased ACC activity related to substance use. In this study, we investigate ACC function in SDs and healthy individuals performing a change signal task for monetary rewards. Using a priori predictions derived from a recent computational model of ACC, we find that ACC activity differs between SDs and controls in factors related to reward salience and risk aversion between SDs and healthy individuals. Quantitative fits of a computational model to fMRI data reveal significant differences in best fit parameters for reward salience and risk preferences. Specifically, the ACC in SDs shows greater risk aversion, defined as concavity in the utility function, and greater attention to rewards relative to reward omission. Furthermore, across participants risk aversion and reward salience are positively correlated. The results clarify the role that ACC plays in both the reduced sensitivity to omitted rewards and greater reward valuation in SDs. Clinical implications of applying computational modeling in psychiatry are also discussed.

Discounting of Delayed Food Rewards in Pigeons and Rats: Is There a Magnitude Effect

ERIC Educational Resources Information Center

Green, Leonard; Myerson, Joel; Holt, Daniel D.; Slavin, John R.; Estle, Sara J.

2004-01-01

Temporal discounting refers to the decrease in the present, subjective value of a reward as the time to its receipt increases. Results from humans have shown that a hyperbola-like function describes the form of the discounting function when choices involve hypothetical monetary rewards. In addition, magnitude effects have been reported in which…

The rat's not for turning: Dissociating the psychological components of cognitive inflexibility☆

PubMed Central

Nilsson, Simon R.O.; Alsiö, Johan; Somerville, Elizabeth M.; Clifton, Peter G.

2015-01-01

Executive function is commonly assessed by assays of cognitive flexibility such as reversal learning and attentional set-shifting. Disrupted performance in these assays, apparent in many neuropsychiatric disorders, is frequently interpreted as inability to overcome prior associations with reward. However, non-rewarded or irrelevant associations may be of considerable importance in both discrimination learning and cognitive flexibility. Non-rewarded associations can have greater influence on choice behaviour than rewarded associations in discrimination learning. Pathology-related deficits in cognitive flexibility can produce selective disruptions to both the processing of irrelevant associations and associations with reward. Genetic and pharmacological animal models demonstrate that modulation of reversal learning may result from alterations in either rewarded or non-rewarded associations. Successful performance in assays of cognitive flexibility can therefore depend on a combination of rewarded, non-rewarded, and irrelevant associations derived from previous learning, accounting for some inconsistencies observed in the literature. Taking this combination into account may increase the validity of animal models and may also reveal pathology-specific differences in problem solving and executive function. PMID:26112128

Post-learning hippocampal dynamics promote preferential retention of rewarding events

PubMed Central

Gruber, Matthias J.; Ritchey, Maureen; Wang, Shao-Fang; Doss, Manoj K.; Ranganath, Charan

2016-01-01

Reward motivation is known to modulate memory encoding, and this effect depends on interactions between the substantia nigra/ ventral tegmental area complex (SN/VTA) and the hippocampus. It is unknown, however, whether these interactions influence offline neural activity in the human brain that is thought to promote memory consolidation. Here, we used functional magnetic resonance imaging (fMRI) to test the effect of reward motivation on post-learning neural dynamics and subsequent memory for objects that were learned in high- or low-reward motivation contexts. We found that post-learning increases in resting-state functional connectivity between the SN/VTA and hippocampus predicted preferential retention of objects that were learned in high-reward contexts. In addition, multivariate pattern classification revealed that hippocampal representations of high-reward contexts were preferentially reactivated during post-learning rest, and the number of hippocampal reactivations was predictive of preferential retention of items learned in high-reward contexts. These findings indicate that reward motivation alters offline post-learning dynamics between the SN/VTA and hippocampus, providing novel evidence for a potential mechanism by which reward could influence memory consolidation. PMID:26875624

The functional divide for primary reinforcement of D-amphetamine lies between the medial and lateral ventral striatum: is the division of the accumbens core, shell, and olfactory tubercle valid?

PubMed

Ikemoto, Satoshi; Qin, Mei; Liu, Zhong-Hua

2005-05-18

When projection analyses placed the nucleus accumbens and olfactory tubercle in the striatal system, functional links between these sites began to emerge. The accumbens has been implicated in the rewarding effects of psychomotor stimulants, whereas recent work suggests that the medial accumbens shell and medial olfactory tubercle mediate the rewarding effects of cocaine. Interestingly, anatomical evidence suggests that medial portions of the shell and tubercle receive afferents from common zones in a number of regions. Here, we report results suggesting that the current division of the ventral striatum into the accumbens core and shell and the olfactory tubercle does not reflect the functional organization for amphetamine reward. Rats quickly learned to self-administer D-amphetamine into the medial shell or medial tubercle, whereas they failed to learn to do so into the accumbens core, ventral shell, or lateral tubercle. Our results suggest that primary reinforcement of amphetamine is mediated via the medial portion of the ventral striatum. Thus, the medial shell and medial tubercle are more functionally related than the medial and ventral shell or the medial and lateral tubercle. The current core-shell-tubercle scheme should be reconsidered in light of recent anatomical data and these functional findings.

Altered resting state functional connectivity of fear and reward circuitry in comorbid PTSD and major depression.

PubMed

Zhu, Xi; Helpman, Liat; Papini, Santiago; Schneier, Franklin; Markowitz, John C; Van Meter, Page E; Lindquist, Martin A; Wager, Tor D; Neria, Yuval

2017-07-01

Individuals with comorbid posttraumatic stress disorder and major depressive disorder (PTSD-MDD) often exhibit greater functional impairment and poorer treatment response than individuals with PTSD alone. Research has not determined whether PTSD-MDD is associated with different network connectivity abnormalities than PTSD alone. We used functional magnetic resonance imaging (fMRI) to measure resting state functional connectivity (rs-FC) patterns of brain regions involved in fear and reward processing in three groups: patients with PTSD-alone (n = 27), PTSD-MDD (n = 21), and trauma-exposed healthy controls (TEHCs, n = 34). Based on previous research, seeds included basolateral amygdala (BLA), centromedial amygdala (CMA), and nucleus accumbens (NAcc). Regardless of MDD comorbidity, PTSD was associated with decreased connectivity of BLA-orbitalfrontal cortex (OFC) and CMA-thalamus pathways, key to fear processing, and fear expression, respectively. PTSD-MDD, compared to PTSD-alone and TEHC, was associated with decreased connectivity across multiple amygdala and striatal-subcortical pathways: BLA-OFC, NAcc-thalamus, and NAcc-hippocampus. Further, while both the BLA-OFC and the NAcc-thalamus pathways were correlated with MDD symptoms, PTSD symptoms correlated with the amygdala pathways (BLA-OFC; CMA-thalamus) only. Comorbid PTSD-MDD may be associated with multifaceted functional connectivity alterations in both fear and reward systems. Clinical implications are discussed. © 2016 Wiley Periodicals, Inc.

Executive functioning and substance use in adolescence: Neurobiological and behavioral perspectives.

PubMed

Kim-Spoon, Jungmeen; Kahn, Rachel E; Lauharatanahirun, Nina; Deater-Deckard, Kirby; Bickel, Warren K; Chiu, Pearl H; King-Casas, Brooks

2017-06-01

The current review is guided by the theoretical perspective that emphasizes the regulating role of executive functioning (Carver et al., 2009) and presents studies that elucidate the ways that executive functioning (inhibition and working memory) explain individual differences in adolescent substance use independently or by regulating the reactive system (reward and punishment sensitivity). Behavioral studies indicate that main effects of executive functioning on adolescent substance use are often nonsignificant or weak in effect sizes. In contrast, emerging evidence suggests consistent and stronger regulating effects of executive functioning over reward and punishment sensitivity. Functional neuroimaging studies reveal significant associations between executive functioning task-related hemodynamic responses and substance use with strong effect sizes. There is also direct evidence from studies testing statistical interactions of the regulating effects of EF-related brain activation, and indirect evidence in studies examining functional connectivity, temporal discounting, and reinforced control. We note key future directions and ways to address limitations in existing work. Copyright © 2017 Elsevier Ltd. All rights reserved.

An endocannabinoid hypothesis of drug reward and drug addiction.

PubMed

Onaivi, Emmanuel S

2008-10-01

Pharmacologic treatment of drug and alcohol dependency has largely been disappointing, and new therapeutic targets and hypotheses are needed. There is accumulating evidence indicating a central role for the previously unknown but ubiquitous endocannabinoid physiological control system (EPCS) in the regulation of the rewarding effects of abused substances. Thus an endocannabinoid hypothesis of drug reward is postulated. Endocannabinoids mediate retrograde signaling in neuronal tissues and are involved in the regulation of synaptic transmission to suppress neurotransmitter release by the presynaptic cannabinoid receptors (CB-Rs). This powerful modulatory action on synaptic transmission has significant functional implications and interactions with the effects of abused substances. Our data, along with those from other investigators, provide strong new evidence for a role for EPCS modulation in the effects of drugs of abuse, and specifically for involvement of cannabinoid receptors in the neural basis of addiction. Cannabinoids and endocannabinoids appear to be involved in adding to the rewarding effects of addictive substances, including, nicotine, opiates, alcohol, cocaine, and BDZs. The results suggest that the EPCS may be an important natural regulatory mechanism for drug reward and a target for the treatment of addictive disorders.

Social stress reactivity alters reward and punishment learning

PubMed Central

Frank, Michael J.; Allen, John J. B.

2011-01-01

To examine how stress affects cognitive functioning, individual differences in trait vulnerability (punishment sensitivity) and state reactivity (negative affect) to social evaluative threat were examined during concurrent reinforcement learning. Lower trait-level punishment sensitivity predicted better reward learning and poorer punishment learning; the opposite pattern was found in more punishment sensitive individuals. Increasing state-level negative affect was directly related to punishment learning accuracy in highly punishment sensitive individuals, but these measures were inversely related in less sensitive individuals. Combined electrophysiological measurement, performance accuracy and computational estimations of learning parameters suggest that trait and state vulnerability to stress alter cortico-striatal functioning during reinforcement learning, possibly mediated via medio-frontal cortical systems. PMID:20453038

Social stress reactivity alters reward and punishment learning.

PubMed

Cavanagh, James F; Frank, Michael J; Allen, John J B

2011-06-01

To examine how stress affects cognitive functioning, individual differences in trait vulnerability (punishment sensitivity) and state reactivity (negative affect) to social evaluative threat were examined during concurrent reinforcement learning. Lower trait-level punishment sensitivity predicted better reward learning and poorer punishment learning; the opposite pattern was found in more punishment sensitive individuals. Increasing state-level negative affect was directly related to punishment learning accuracy in highly punishment sensitive individuals, but these measures were inversely related in less sensitive individuals. Combined electrophysiological measurement, performance accuracy and computational estimations of learning parameters suggest that trait and state vulnerability to stress alter cortico-striatal functioning during reinforcement learning, possibly mediated via medio-frontal cortical systems.

Effects of anabolic-androgens on brain reward function

PubMed Central

Mhillaj, Emanuela; Morgese, Maria G.; Tucci, Paolo; Bove, Maria; Schiavone, Stefania; Trabace, Luigia

2015-01-01

Androgens are mainly prescribed to treat several diseases caused by testosterone deficiency. However, athletes try to promote muscle growth by manipulating testosterone levels or assuming androgen anabolic steroids (AAS). These substances were originally synthesized to obtain anabolic effects greater than testosterone. Although AAS are rarely prescribed compared to testosterone, their off-label utilization is very wide. Furthermore, combinations of different steroids and doses generally higher than those used in therapy are common. Symptoms of the chronic use of supra-therapeutic doses of AAS include anxiety, depression, aggression, paranoia, distractibility, confusion, amnesia. Interestingly, some studies have shown that AAS elicited electroencephalographic changes similar to those observed with amphetamine abuse. The frequency of side effects is higher among AAS abusers, with psychiatric complications such as labile mood, lack of impulse control and high violence. On the other hand, AAS addiction studies are complex because data collection is very difficult due to the subjects' reticence and can be biased by many variables, including physical exercise, that alter the reward system. Moreover, it has been reported that AAS may imbalance neurotransmitter systems involved in the reward process, leading to increased sensitivity toward opioid narcotics and central stimulants. The goal of this article is to review the literature on steroid abuse and changes to the reward system in preclinical and clinical studies. PMID:26379484

Review. Neurobiological mechanisms for opponent motivational processes in addiction.

PubMed

Koob, George F; Le Moal, Michel

2008-10-12

The conceptualization of drug addiction as a compulsive disorder with excessive drug intake and loss of control over intake requires motivational mechanisms. Opponent process as a motivational theory for the negative reinforcement of drug dependence has long required a neurobiological explanation. Key neurochemical elements involved in reward and stress within basal forebrain structures involving the ventral striatum and extended amygdala are hypothesized to be dysregulated in addiction to convey the opponent motivational processes that drive dependence. Specific neurochemical elements in these structures include not only decreases in reward neurotransmission such as dopamine and opioid peptides in the ventral striatum, but also recruitment of brain stress systems such as corticotropin-releasing factor (CRF), noradrenaline and dynorphin in the extended amygdala. Acute withdrawal from all major drugs of abuse produces increases in reward thresholds, anxiety-like responses and extracellular levels of CRF in the central nucleus of the amygdala. CRF receptor antagonists block excessive drug intake produced by dependence. A brain stress response system is hypothesized to be activated by acute excessive drug intake, to be sensitized during repeated withdrawal, to persist into protracted abstinence and to contribute to stress-induced relapse. The combination of loss of reward function and recruitment of brain stress systems provides a powerful neurochemical basis for the long hypothesized opponent motivational processes responsible for the negative reinforcement driving addiction.

Effects of anabolic-androgens on brain reward function.

PubMed

Mhillaj, Emanuela; Morgese, Maria G; Tucci, Paolo; Bove, Maria; Schiavone, Stefania; Trabace, Luigia

2015-01-01

Androgens are mainly prescribed to treat several diseases caused by testosterone deficiency. However, athletes try to promote muscle growth by manipulating testosterone levels or assuming androgen anabolic steroids (AAS). These substances were originally synthesized to obtain anabolic effects greater than testosterone. Although AAS are rarely prescribed compared to testosterone, their off-label utilization is very wide. Furthermore, combinations of different steroids and doses generally higher than those used in therapy are common. Symptoms of the chronic use of supra-therapeutic doses of AAS include anxiety, depression, aggression, paranoia, distractibility, confusion, amnesia. Interestingly, some studies have shown that AAS elicited electroencephalographic changes similar to those observed with amphetamine abuse. The frequency of side effects is higher among AAS abusers, with psychiatric complications such as labile mood, lack of impulse control and high violence. On the other hand, AAS addiction studies are complex because data collection is very difficult due to the subjects' reticence and can be biased by many variables, including physical exercise, that alter the reward system. Moreover, it has been reported that AAS may imbalance neurotransmitter systems involved in the reward process, leading to increased sensitivity toward opioid narcotics and central stimulants. The goal of this article is to review the literature on steroid abuse and changes to the reward system in preclinical and clinical studies.

Ventral striatal hyperconnectivity during rewarded interference control in adolescents with ADHD.

PubMed

Ma, Ili; van Holstein, Mieke; Mies, Gabry W; Mennes, Maarten; Buitelaar, Jan; Cools, Roshan; Cillessen, Antonius H N; Krebs, Ruth M; Scheres, Anouk

2016-09-01

Attention-deficit/hyperactivity disorder (ADHD) is characterized by cognitive deficits (e.g., interference control) and altered reward processing. Cognitive control is influenced by incentive motivation and according to current theoretical models, ADHD is associated with abnormal interactions between incentive motivation and cognitive control. However, the neural mechanisms by which reward modulates cognitive control in individuals with ADHD are unknown. We used event-related functional resonance imaging (fMRI) to study neural responses during a rewarded Stroop color-word task in adolescents (14-17 years) with ADHD (n = 25; 19 boys) and healthy controls (n = 33; 22 boys). Adolescents with ADHD showed increased reward signaling within the superior frontal gyrus and ventral striatum (VS) relative to controls. Importantly, functional connectivity analyses revealed a hyperconnectivity between VS and motor control regions in the ADHD group, as a function of reward-cognitive control integration. Connectivity was associated with performance improvement in controls but not in the ADHD group, suggesting inefficient connectivity. Adolescents with ADHD show increased neural sensitivity to rewards and its interactions with interference control in VS and motor regions, respectively. The findings support theoretical models of altered reward-cognitive control integration in individuals with ADHD. Copyright © 2016 Elsevier Ltd. All rights reserved.

Individual differences in sensitivity to reward and punishment and neural activity during reward and avoidance learning

PubMed Central

Yoon, HeungSik; Kim, Hackjin; Hamann, Stephan

2015-01-01

In this functional neuroimaging study, we investigated neural activations during the process of learning to gain monetary rewards and to avoid monetary loss, and how these activations are modulated by individual differences in reward and punishment sensitivity. Healthy young volunteers performed a reinforcement learning task where they chose one of two fractal stimuli associated with monetary gain (reward trials) or avoidance of monetary loss (avoidance trials). Trait sensitivity to reward and punishment was assessed using the behavioral inhibition/activation scales (BIS/BAS). Functional neuroimaging results showed activation of the striatum during the anticipation and reception periods of reward trials. During avoidance trials, activation of the dorsal striatum and prefrontal regions was found. As expected, individual differences in reward sensitivity were positively associated with activation in the left and right ventral striatum during reward reception. Individual differences in sensitivity to punishment were negatively associated with activation in the left dorsal striatum during avoidance anticipation and also with activation in the right lateral orbitofrontal cortex during receiving monetary loss. These results suggest that learning to attain reward and learning to avoid loss are dependent on separable sets of neural regions whose activity is modulated by trait sensitivity to reward or punishment. PMID:25680989

Mechanisms Underlying Motivational Deficits in Psychopathology: Similarities and Differences in Depression and Schizophrenia.

PubMed

Barch, Deanna M; Pagliaccio, David; Luking, Katherine

2016-01-01

Motivational and hedonic impairments are core aspects of a variety of types of psychopathology. These impairments cut across diagnostic categories and may be critical to understanding major aspects of the functional impairments accompanying psychopathology. Given the centrality of motivational and hedonic systems to psychopathology, the Research Domain Criteria (RDoC) initiative includes a "positive valence" systems domain that outlines a number of constructs that may be key to understanding the nature and mechanisms of motivational and hedonic impairments in psychopathology. These component constructs include initial responsiveness to reward, reward anticipation or expectancy, incentive or reinforcement learning, effort valuation, and action selection. Here, we review behavioral and neuroimaging studies providing evidence for impairments in these constructs in individuals with psychosis versus in individuals with depressive pathology. There are important differences in the nature of reward-related and hedonic deficits associated with psychosis versus depression that have major implications for our understanding of etiology and treatment development. In particular, the literature strongly suggests the presence of impairments in in-the-moment hedonics or "liking" in individuals with depressive pathology, particularly among those who experience anhedonia. Such deficits may propagate forward and contribute to impairments in other constructs that are dependent on hedonic responses, such as anticipation, learning, effort, and action selection. Such hedonic impairments could reflect alterations in dopamine and/or opioid signaling in the striatum related to depression or specifically to anhedonia in depressed populations. In contrast, the literature points to relatively intact in-the-moment hedonic processing in psychosis, but provides much evidence for impairments in other components involved in translating reward to action selection. Particularly, individuals with schizophrenia exhibit altered reward prediction and associated striatal and prefrontal activation, impaired reward learning, and impaired reward-modulated action selection.

Comprehensive Behavioral Analysis of Male Ox1r (-/-) Mice Showed Implication of Orexin Receptor-1 in Mood, Anxiety, and Social Behavior.

PubMed

Abbas, Md G; Shoji, Hirotaka; Soya, Shingo; Hondo, Mari; Miyakawa, Tsuyoshi; Sakurai, Takeshi

2015-01-01

Neuropeptides orexin A and orexin B, which are exclusively produced by neurons in the lateral hypothalamic area, play an important role in the regulation of a wide range of behaviors and homeostatic processes, including regulation of sleep/wakefulness states and energy homeostasis. The orexin system has close anatomical and functional relationships with systems that regulate the autonomic nervous system, emotion, mood, the reward system, and sleep/wakefulness states. Recent pharmacological studies using selective antagonists have suggested that orexin receptor-1 (OX1R) is involved in physiological processes that regulate emotion, the reward system, and autonomic nervous system. Here, we examined Ox1r (-/-) mice with a comprehensive behavioral test battery to screen additional OX1R functions. Ox1r (-/-) mice showed increased anxiety-like behavior, altered depression-like behavior, slightly decreased spontaneous locomotor activity, reduced social interaction, increased startle response, and decreased prepulse inhibition. These results suggest that OX1R plays roles in social behavior and sensory motor gating in addition to roles in mood and anxiety.

Comprehensive Behavioral Analysis of Male Ox1r−/− Mice Showed Implication of Orexin Receptor-1 in Mood, Anxiety, and Social Behavior

PubMed Central

Abbas, Md. G.; Shoji, Hirotaka; Soya, Shingo; Hondo, Mari; Miyakawa, Tsuyoshi; Sakurai, Takeshi

2015-01-01

Neuropeptides orexin A and orexin B, which are exclusively produced by neurons in the lateral hypothalamic area, play an important role in the regulation of a wide range of behaviors and homeostatic processes, including regulation of sleep/wakefulness states and energy homeostasis. The orexin system has close anatomical and functional relationships with systems that regulate the autonomic nervous system, emotion, mood, the reward system, and sleep/wakefulness states. Recent pharmacological studies using selective antagonists have suggested that orexin receptor-1 (OX1R) is involved in physiological processes that regulate emotion, the reward system, and autonomic nervous system. Here, we examined Ox1r−/− mice with a comprehensive behavioral test battery to screen additional OX1R functions. Ox1r−/− mice showed increased anxiety-like behavior, altered depression-like behavior, slightly decreased spontaneous locomotor activity, reduced social interaction, increased startle response, and decreased prepulse inhibition. These results suggest that OX1R plays roles in social behavior and sensory motor gating in addition to roles in mood and anxiety. PMID:26696848

Do Effort and Reward at Work Predict Changes in Cognitive Function? First Longitudinal Results from the Representative German Socio-Economic Panel.

PubMed

Riedel, Natalie; Siegrist, Johannes; Wege, Natalia; Loerbroks, Adrian; Angerer, Peter; Li, Jian

2017-11-15

It has been suggested that work characteristics, such as mental demands, job control, and occupational complexity, are prospectively related to cognitive function. However, current evidence on links between psychosocial working conditions and cognitive change over time is inconsistent. In this study, we applied the effort-reward imbalance model that allows to build on previous research on mental demands and to introduce reward-based learning as a principle with beneficial effect on cognitive function. We aimed to investigate whether high effort, high reward, and low over-commitment in 2006 were associated with positive changes in cognitive function in terms of perceptual speed and word fluency (2006-2012), and whether the co-manifestation of high effort and high reward would yield the strongest association. To this end, we used data on 1031 employees who participated in a large and representative study. Multivariate linear regression analyses supported our main hypotheses (separate and combined effects of effort and reward), particularly on changes in perceptual speed, whereas the effects of over-commitment did not reach the level of statistical significance. Our findings extend available knowledge by examining the course of cognitive function over time. If corroborated by further evidence, organization-based measures in the workplace can enrich efforts towards preventing cognitive decline in ageing workforces.

The Effectiveness of Rewards and Incentives for Teachers.

ERIC Educational Resources Information Center

Kimball, Roland B.

This study examined (1) the rewards and incentive systems currently used in schools, (2) the relationship between the existing reward system and both the excellence of the school and the behavior of teachers and administrators in searching for alternatives, and (3) the possibility of defining a rewards system for teachers which would elicit…

Diminished social reward anticipation in the broad autism phenotype as revealed by event-related brain potentials.

PubMed

Cox, Anthony; Kohls, Gregor; Naples, Adam J; Mukerji, Cora E; Coffman, Marika C; Rutherford, Helena J V; Mayes, Linda C; McPartland, James C

2015-10-01

Diminished responsivity to reward incentives is a key contributor to the social-communication problems seen in autism spectrum disorders (ASDs). Social motivation theories suggest that individuals with ASD do not experience social interactions as rewarding, leading to negative consequences for the development of brain circuitry subserving social information. In this study, we examined neural responses to social and non-social reward anticipation in 35 typically developing young adults, examining modulation of reward sensitivity by level of autistic traits. Using an Event-related potential incentive-delay task incorporating novel, more ecologically valid forms of reward, higher expression of autistic traits was associated with an attenuated P3 response to the anticipation of social (simulated real-time video feedback from an observer), but not non-social (candy), rewards. Exploratory analyses revealed that this was unrelated to mentalizing ability. The P3 component reflects motivated attention to reward signals, suggesting attenuated motivation allocation specific to social incentives. The study extends prior findings of atypical reward anticipation in ASD, demonstrating that attenuated social reward responsiveness extends to autistic traits in the range of typical functioning. Results support the development of innovative paradigms for investigating social and non-social reward responsiveness. Insight into vulnerabilities in reward processing is critical for understanding social function in ASD. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Abnormal Striatal BOLD Responses to Reward Anticipation and Reward Delivery in ADHD

PubMed Central

Furukawa, Emi; Bado, Patricia; Tripp, Gail; Mattos, Paulo; Wickens, Jeff R.; Bramati, Ivanei E.; Alsop, Brent; Ferreira, Fernanda Meireles; Lima, Debora; Tovar-Moll, Fernanda; Sergeant, Joseph A.; Moll, Jorge

2014-01-01

Altered reward processing has been proposed to contribute to the symptoms of attention deficit hyperactivity disorder (ADHD). The neurobiological mechanism underlying this alteration remains unclear. We hypothesize that the transfer of dopamine release from reward to reward-predicting cues, as normally observed in animal studies, may be deficient in ADHD. Functional magnetic resonance imaging (fMRI) was used to investigate striatal responses to reward-predicting cues and reward delivery in a classical conditioning paradigm. Data from 14 high-functioning and stimulant-naïve young adults with elevated lifetime symptoms of ADHD (8 males, 6 females) and 15 well-matched controls (8 males, 7 females) were included in the analyses. During reward anticipation, increased blood-oxygen-level-dependent (BOLD) responses in the right ventral and left dorsal striatum were observed in controls, but not in the ADHD group. The opposite pattern was observed in response to reward delivery; the ADHD group demonstrated significantly greater BOLD responses in the ventral striatum bilaterally and the left dorsal striatum relative to controls. In the ADHD group, the number of current hyperactivity/impulsivity symptoms was inversely related to ventral striatal responses during reward anticipation and positively associated with responses to reward. The BOLD response patterns observed in the striatum are consistent with impaired predictive dopamine signaling in ADHD, which may explain altered reward-contingent behaviors and symptoms of ADHD. PMID:24586543

Prefrontal Cortex and Drug Abuse Vulnerability: Translation to Prevention and Treatment Interventions

PubMed Central

Perry, Jennifer L.; Joseph, Jane E.; Jiang, Yang; Zimmerman, Rick S.; Kelly, Thomas H.; Darna, Mahesh; Huettl, Peter; Dwoskin, Linda P.; Bardo, Michael T.

2010-01-01

Vulnerability to drug abuse is related to both reward seeking and impulsivity, two constructs thought to have a biological basis in the prefrontal cortex (PFC). This review addresses similarities and differences in neuroanatomy, neurochemistry and behavior associated with PFC function in rodents and primates. Emphasis is placed on monoamine and amino acid neurotransmitter systems located in anatomically distinct subregions: medial prefrontal cortex (mPFC); lateral prefrontal cortex (lPFC); anterior cingulate cortex (ACC); and orbitofrontal cortex (OFC). While there are complex interconnections and overlapping functions among these regions, each is thought to be involved in various functions related to health-related risk behaviors and drug abuse vulnerability. Among the various functions implicated, evidence suggests that mPFC is involved in reward processing, attention and drug reinstatement; lPFC is involved in decision-making, behavioral inhibition and attentional gating; ACC is involved in attention, emotional processing and self-monitoring; and OFC is involved in behavioral inhibition, signaling of expected outcomes and reward/punishment sensitivity. Individual differences factors (e.g., age and sex) influence functioning of these regions, which, in turn, impacts drug abuse vulnerability. Implications for the development of drug abuse prevention and treatment strategies aimed at engaging PFC inhibitory processes that may reduce risk-related behaviors are discussed, including the design of effective public service announcements, cognitive exercises, physical activity, direct current stimulation, feedback control training and pharmacotherapies. A major challenge in drug abuse prevention and treatment rests with improving intervention strategies aimed at strengthening PFC inhibitory systems among at-risk individuals. PMID:20837060

Coupling Neurogenetics (GARS™) and a Nutrigenomic Based Dopaminergic Agonist to Treat Reward Deficiency Syndrome (RDS): Targeting Polymorphic Reward Genes for Carbohydrate Addiction Algorithms

PubMed Central

Blum, Kenneth; Simpatico, Thomas; Badgaiyan, Rajendra D.; Demetrovics, Zsolt; Fratantonio, James; Agan, Gozde; Febo, Marcelo; Gold, Mark S.

2016-01-01

Earlier work from our laboratory, showing anti-addiction activity of a nutraceutical consisting of amino-acid precursors and enkephalinase inhibition properties and our discovery of the first polymorphic gene (Dopamine D2 Receptor Gene [DRD2]) to associate with severe alcoholism serves as a blue-print for the development of “Personalized Medicine” in addiction. Prior to the later genetic finding, we developed the concept of Brain Reward Cascade, which continues to act as an important component for stratification of addiction risk through neurogenetics. In 1996 our laboratory also coined the term “Reward Deficiency Syndrome (RDS)” to define a common genetic rubric for both substance and non-substance related addictive behaviors. Following many reiterations we utilized polymorphic targets of a number of reward genes (serotonergic, Opioidergic, GABAergic and Dopaminergic) to customize KB220 [Neuroadaptogen- amino-acid therapy (NAAT)] by specific algorithms. Identifying 1,000 obese subjects in the Netherlands a subsequent small subset was administered various KB220Z formulae customized according to respective DNA polymorphisms individualized that translated to significant decreases in both Body Mass Index (BMI) and weight in pounds. Following these experiments, we have been successfully developing a panel of genes known as “Genetic Addiction Risk Score” (GARSpDX)™. Selection of 10 genes with appropriate variants, a statistically significant association between the ASI-Media Version-alcohol and drug severity scores and GARSpDx was found A variant of KB220Z in abstinent heroin addicts increased resting state functional connectivity in a putative network including: dorsal anterior cingulate, medial frontal gyrus, nucleus accumbens, posterior cingulate, occipital cortical areas, and cerebellum. In addition, we show that KB220Z significantly activates, above placebo, seed regions of interest including the left nucleus accumbens, cingulate gyrus, anterior thalamic nuclei, hippocampus, pre-limbic and infra-limbic loci. KB220Z demonstrates significant functional connectivity, increased brain volume recruitment and enhanced dopaminergic functionality across the brain reward circuitry. We propose a Reward Deficiency System Solution that promotes early identification and stratification of risk alleles by utilizing GARSDx, allowing for customized nutrigenomic targeting of these risk alleles by altering KB220Z ingredients as an algorithmic function of carrying these polymorphic DNA–SNPS, potentially yielding the first ever nutrigenomic solution for addiction and pain. PMID:27617300

When performance and risk taking are related: Working for rewards is related to risk taking when the value of rewards is presented briefly.

PubMed

Veling, Harm; Bijleveld, Erik

2015-12-01

Valuable monetary rewards can boost human performance on various effortful tasks even when the value of the rewards is presented too briefly to allow for strategic decision making. However, the mechanism by which briefly-presented reward information influences performance has remained unclear. One possibility is that performance after briefly-presented reward information is primarily boosted via activation of the dopamine reward system, whereas performance after very visible reward information is driven more by strategic processes. To examine this hypothesis, we first presented participants with a task in which they could earn rewards of relatively low (1 cent) or high (10 cents) value, and the value information was presented either briefly (17 ms) or for an extended duration (300 ms). Furthermore, responsiveness of the dopamine system was indirectly estimated with a measure of risk taking, the Balloon Analogue Risk Task (BART). Results showed that performance after high- compared to low-value rewards was indeed related to the BART scores only when reward information was presented briefly. These results are suggestive of the possibility that brief presentation of reward information boosts performance directly via activating the dopamine system, whereas extended presentation of reward information leads to more strategic reward-driven behavior. Copyright © 2015 Elsevier Inc. All rights reserved.

Anabolic-androgenic steroids and decision making: Probability and effort discounting in male rats.

PubMed

Wallin, Kathryn G; Alves, Jasmin M; Wood, Ruth I

2015-07-01

Anabolic-androgenic steroid (AAS) abuse is implicated in maladaptive behaviors such as increased aggression and risk taking. Impaired judgment due to changes in the mesocorticolimbic dopamine system may contribute to these behavioral changes. While AAS are known to influence dopamine function in mesocorticolimbic circuitry, the effects on decision making are unknown. This was the focus of the present study. Adolescent male Long-Evans rats were treated chronically with high-dose testosterone (7.5 mg/kg) or vehicle (13% cyclodextrin in water), and tested for cost/benefit decision making in two discounting paradigms. Rats chose between a small reward (1 sugar pellet) and a large discounted reward (3 or 4 pellets). Probability discounting (PD) measures sensitivity to reward uncertainty by decreasing the probability (100, 75, 50, 25, 0%) of receiving the large reward in successive blocks of each daily session. Effort discounting (ED) measures sensitivity to a work cost by increasing the lever presses required to earn the large reward (1, 2, 5, 10, 15 presses). In PD, testosterone-treated rats selected the large/uncertain reward significantly less than vehicle-treated controls. However, during ED, testosterone-treated rats selected the large/high effort reward significantly more than controls. These studies show that testosterone has divergent effects on different aspects of decision making. Specifically, testosterone increases aversion to uncertainty but decreases sensitivity to the output of effort for reward. These results have implications for understanding maladaptive behavioral changes in human AAS users. Copyright © 2015 Elsevier Ltd. All rights reserved.

Dopamine D2/3- and μ-opioid receptor antagonists reduce cue-induced responding and reward impulsivity in humans.

PubMed

Weber, S C; Beck-Schimmer, B; Kajdi, M-E; Müller, D; Tobler, P N; Quednow, B B

2016-07-05

Increased responding to drug-associated stimuli (cue reactivity) and an inability to tolerate delayed gratification (reward impulsivity) have been implicated in the development and maintenance of drug addiction. Whereas data from animal studies suggest that both the dopamine and opioid system are involved in these two reward-related processes, their role in humans is less clear. Moreover, dopaminergic and opioidergic drugs have not been directly compared with regard to these functions, even though a deeper understanding of the underlying mechanisms might inform the development of specific treatments for elevated cue reactivity and reward impulsivity. In a randomized, double-blind, between-subject design we administered the selective dopamine D2/D3 receptor antagonist amisulpride (400 mg, n=41), the unspecific opioid receptor antagonist naltrexone (50 mg, n=40) or placebo (n=40) to healthy humans and measured cue-induced responding with a Pavlovian-instrumental transfer task and reward impulsivity with a delay discounting task. Mood was assessed using a visual analogue scale. Compared with placebo, amisulpride significantly suppressed cue-induced responding and reward impulsivity. The effects of naltrexone were similar, although less pronounced. Both amisulpride and naltrexone decreased average mood ratings compared with placebo. Our results demonstrate that a selective blockade of dopamine D2/D3 receptors reduces cue-induced responding and reward impulsivity in healthy humans. Antagonizing μ-opioid receptors has similar effects for cue-induced responding and to a lesser extent for reward impulsivity.

Modeling the Effect of Reward Amount on Probability Discounting

ERIC Educational Resources Information Center

Myerson, Joel; Green, Leonard; Morris, Joshua

2011-01-01

The present study with college students examined the effect of amount on the discounting of probabilistic monetary rewards. A hyperboloid function accurately described the discounting of hypothetical rewards ranging in amount from $20 to $10,000,000. The degree of discounting increased continuously with amount of probabilistic reward. This effect…

Reward Circuitry Function in Autism during Face Anticipation and Outcomes

ERIC Educational Resources Information Center

Dichter, Gabriel S.; Richey, J. Anthony; Rittenberg, Alison M.; Sabatino, Antoinette; Bodfish, James W.

2012-01-01

The aim of this study was to investigate reward circuitry responses in autism during reward anticipation and outcomes for monetary and social rewards. During monetary anticipation, participants with autism spectrum disorders (ASDs) showed hypoactivation in right nucleus accumbens and hyperactivation in right hippocampus, whereas during monetary…

Reward anticipation revisited- evidence from an fMRI study in euthymic bipolar I patients and healthy first-degree relatives.

PubMed

Kollmann, Bianca; Scholz, Vanessa; Linke, Julia; Kirsch, Peter; Wessa, Michèle

2017-09-01

Symptomatic phases in bipolar disorder (BD) are hypothesized to result from a hypersensitive behavioral activation system (BAS) being sensitive to potential rewards. However, studies on the neuronal underpinnings of reward anticipation in BD are scarce with contradictory findings and possibly confounded by effects of dopaminergic medication, necessitating further research on dysfunctional motivation in BD. Moreover, its role as vulnerability marker for BD is unclear. Functional imaging was conducted in 16 euthymic BD-I patients free from dopaminergic medication and 19 healthy first-degree relatives using a monetary incentive delay task and compared to parallelized control groups. Further, reward proneness, using the BIS/BAS questionnaire, and its relationship to neural reward anticipation was investigated. BD-I patients displayed greater anterior cingulate cortex (ACC) activity during reward anticipation and higher BIS total scores compared to controls, with a positive relationship between the two measures. There were no neural or self-report group differences between relatives and controls. Due to the experimental design, the role of the ACC during receipt of reward remains unknown, sample sizes were rather small, and patients were not naïve to dopaminergic drugs, making an exclusion of medication effects on findings impossible. Our findings give new insights on reward anticipation in BD. BD-I patients rated themselves as more risk avoidant and showed larger recruitment of the ACC rather than ventral striatum compared to controls during reward anticipation, possibly to down-regulate hyperactive limbic reward regions. This activation seems to be a consequence of rather than a vulnerability marker for the disorder. Copyright © 2017 Elsevier B.V. All rights reserved.

Association between the oxytocin receptor (OXTR) gene and mesolimbic responses to rewards.

PubMed

Damiano, Cara R; Aloi, Joseph; Dunlap, Kaitlyn; Burrus, Caley J; Mosner, Maya G; Kozink, Rachel V; McLaurin, Ralph Edward; Mullette-Gillman, O'Dhaniel A; Carter, Ronald McKell; Huettel, Scott A; McClernon, Francis Joseph; Ashley-Koch, Allison; Dichter, Gabriel S

2014-01-31

There has been significant progress in identifying genes that confer risk for autism spectrum disorders (ASDs). However, the heterogeneity of symptom presentation in ASDs impedes the detection of ASD risk genes. One approach to understanding genetic influences on ASD symptom expression is to evaluate relations between variants of ASD candidate genes and neural endophenotypes in unaffected samples. Allelic variations in the oxytocin receptor (OXTR) gene confer small but significant risk for ASDs for which the underlying mechanisms may involve associations between variability in oxytocin signaling pathways and neural response to rewards. The purpose of this preliminary study was to investigate the influence of allelic variability in the OXTR gene on neural responses to monetary rewards in healthy adults using functional magnetic resonance imaging (fMRI). The moderating effects of three single nucleotide polymorphisms (SNPs) (rs1042778, rs2268493 and rs237887) of the OXTR gene on mesolimbic responses to rewards were evaluated using a monetary incentive delay fMRI task. T homozygotes of the rs2268493 SNP demonstrated relatively decreased activation in mesolimbic reward circuitry (including the nucleus accumbens, amygdala, insula, thalamus and prefrontal cortical regions) during the anticipation of rewards but not during the outcome phase of the task. Allelic variation of the rs1042778 and rs237887 SNPs did not moderate mesolimbic activation during either reward anticipation or outcomes. This preliminary study suggests that the OXTR SNP rs2268493, which has been previously identified as an ASD risk gene, moderates mesolimbic responses during reward anticipation. Given previous findings of decreased mesolimbic activation during reward anticipation in ASD, the present results suggest that OXTR may confer ASD risk via influences on the neural systems that support reward anticipation.

Reward and vocal production: song-associated place preference in songbirds.

PubMed

Riters, Lauren V; Stevenson, Sharon A

2012-05-15

Vocal production is crucial for successful social interactions in multiple species. Reward can strongly influence behavior; however, the extent to which reward systems influence vocal behavior is unknown. In songbirds, singing occurs in different contexts. It can be spontaneous and undirected (e.g., song produced alone or as part of a large flock) or directed towards a conspecific (e.g., song used to attract a mate or influence a competitor). In this study, we developed a conditioned place preference paradigm to measure reward associated with different types of singing behavior in two songbird species. Both male zebra finches and European starlings developed a preference for a chamber associated with production of undirected song, suggesting that the production of undirected song is tightly coupled to intrinsic reward. In contrast, neither starlings nor zebra finches developed a place preference in association with directed song; however, male starlings singing directed song that failed to attract a female developed a place aversion. Unsuccessful contact calling behavior was also associated with a place aversion. These findings suggest that directed vocal behavior is not tightly linked to intrinsic reward but may be externally reinforced by social interactions. Data across two species thus support the hypothesis that the production of undirected but not directed song is tightly coupled to intrinsic reward. This study is the first to identify song-associated reward and suggests that reward associated with vocal production differs depending upon the context in which communication occurs. The findings have implications for understanding what motivates animals to engage in social behaviors and ways in which distinct reward mechanisms function to direct socially appropriate behaviors. Copyright © 2012 Elsevier Inc. All rights reserved.

Toward isolating the role of dopamine in the acquisition of incentive salience attribution.

PubMed

Chow, Jonathan J; Nickell, Justin R; Darna, Mahesh; Beckmann, Joshua S

2016-10-01

Stimulus-reward learning has been heavily linked to the reward-prediction error learning hypothesis and dopaminergic function. However, some evidence suggests dopaminergic function may not strictly underlie reward-prediction error learning, but may be specific to incentive salience attribution. Utilizing a Pavlovian conditioned approach procedure consisting of two stimuli that were equally reward-predictive (both undergoing reward-prediction error learning) but functionally distinct in regard to incentive salience (levers that elicited sign-tracking and tones that elicited goal-tracking), we tested the differential role of D1 and D2 dopamine receptors and nucleus accumbens dopamine in the acquisition of sign- and goal-tracking behavior and their associated conditioned reinforcing value within individuals. Overall, the results revealed that both D1 and D2 inhibition disrupted performance of sign- and goal-tracking. However, D1 inhibition specifically prevented the acquisition of sign-tracking to a lever, instead promoting goal-tracking and decreasing its conditioned reinforcing value, while neither D1 nor D2 signaling was required for goal-tracking in response to a tone. Likewise, nucleus accumbens dopaminergic lesions disrupted acquisition of sign-tracking to a lever, while leaving goal-tracking in response to a tone unaffected. Collectively, these results are the first evidence of an intraindividual dissociation of dopaminergic function in incentive salience attribution from reward-prediction error learning, indicating that incentive salience, reward-prediction error, and their associated dopaminergic signaling exist within individuals and are stimulus-specific. Thus, individual differences in incentive salience attribution may be reflective of a differential balance in dopaminergic function that may bias toward the attribution of incentive salience, relative to reward-prediction error learning only. Copyright © 2016 Elsevier Ltd. All rights reserved.

Explorative Function in Williams Syndrome Analyzed through a Large-Scale Task with Multiple Rewards

ERIC Educational Resources Information Center

Foti, F.; Petrosini, L.; Cutuli, D.; Menghini, D.; Chiarotti, F.; Vicari, S.; Mandolesi, L.

2011-01-01

This study aimed to evaluate spatial function in subjects with Williams syndrome (WS) by using a large-scale task with multiple rewards and comparing the spatial abilities of WS subjects with those of mental age-matched control children. In the present spatial task, WS participants had to explore an open space to search nine rewards placed in…

Neuropsychology of reward learning and negative symptoms in schizophrenia.

PubMed

Nestor, Paul G; Choate, Victoria; Niznikiewicz, Margaret; Levitt, James J; Shenton, Martha E; McCarley, Robert W

2014-11-01

We used the Iowa Gambling Test (IGT) to examine the relationship of reward learning to both neuropsychological functioning and symptom formation in 65 individuals with schizophrenia. Results indicated that compared to controls, participants with schizophrenia showed significantly reduced reward learning, which in turn correlated with reduced intelligence, memory and executive function, and negative symptoms. The current findings suggested that a disease-related disturbance in reward learning may underlie both cognitive and motivation deficits, as expressed by neuropsychological impairment and negative symptoms in schizophrenia. Copyright © 2014 Elsevier B.V. All rights reserved.

General functioning predicts reward and punishment learning in schizophrenia.

PubMed

Somlai, Zsuzsanna; Moustafa, Ahmed A; Kéri, Szabolcs; Myers, Catherine E; Gluck, Mark A

2011-04-01

Previous studies investigating feedback-driven reinforcement learning in patients with schizophrenia have provided mixed results. In this study, we explored the clinical predictors of reward and punishment learning using a probabilistic classification learning task. Patients with schizophrenia (n=40) performed similarly to healthy controls (n=30) on the classification learning task. However, more severe negative and general symptoms were associated with lower reward-learning performance, whereas poorer general psychosocial functioning was correlated with both lower reward- and punishment-learning performances. Multiple linear regression analyses indicated that general psychosocial functioning was the only significant predictor of reinforcement learning performance when education, antipsychotic dose, and positive, negative and general symptoms were included in the analysis. These results suggest a close relationship between reinforcement learning and general psychosocial functioning in schizophrenia. Published by Elsevier B.V.

Performability modeling based on real data: A case study

NASA Technical Reports Server (NTRS)

Hsueh, M. C.; Iyer, R. K.; Trivedi, K. S.

1988-01-01

Described is a measurement-based performability model based on error and resource usage data collected on a multiprocessor system. A method for identifying the model structure is introduced and the resulting model is validated against real data. Model development from the collection of raw data to the estimation of the expected reward is described. Both normal and error behavior of the system are characterized. The measured data show that the holding times in key operational and error states are not simple exponentials and that a semi-Markov process is necessary to model system behavior. A reward function, based on the service rate and the error rate in each state, is then defined in order to estimate the performability of the system and to depict the cost of apparent types of errors.

Performability modeling based on real data: A casestudy

NASA Technical Reports Server (NTRS)

Hsueh, M. C.; Iyer, R. K.; Trivedi, K. S.

1987-01-01

Described is a measurement-based performability model based on error and resource usage data collected on a multiprocessor system. A method for identifying the model structure is introduced and the resulting model is validated against real data. Model development from the collection of raw data to the estimation of the expected reward is described. Both normal and error behavior of the system are characterized. The measured data show that the holding times in key operational and error states are not simple exponentials and that a semi-Markov process is necessary to model the system behavior. A reward function, based on the service rate and the error rate in each state, is then defined in order to estimate the performability of the system and to depict the cost of different types of errors.

A neural link between affective understanding and interpersonal attraction

PubMed Central

Anders, Silke; de Jong, Roos; Beck, Christian; Haynes, John-Dylan; Ethofer, Thomas

2016-01-01

Being able to comprehend another person’s intentions and emotions is essential for successful social interaction. However, it is currently unknown whether the human brain possesses a neural mechanism that attracts people to others whose mental states they can easily understand. Here we show that the degree to which a person feels attracted to another person can change while they observe the other’s affective behavior, and that these changes depend on the observer’s confidence in having correctly understood the other’s affective state. At the neural level, changes in interpersonal attraction were predicted by activity in the reward system of the observer’s brain. Importantly, these effects were specific to individual observer–target pairs and could not be explained by a target’s general attractiveness or expressivity. Furthermore, using multivoxel pattern analysis (MVPA), we found that neural activity in the reward system of the observer’s brain varied as a function of how well the target’s affective behavior matched the observer’s neural representation of the underlying affective state: The greater the match, the larger the brain’s intrinsic reward signal. Taken together, these findings provide evidence that reward-related neural activity during social encounters signals how well an individual’s “neural vocabulary” is suited to infer another person’s affective state, and that this intrinsic reward might be a source of changes in interpersonal attraction. PMID:27044071

The Dark Side of Addiction: The Horsley Gantt to Joseph Brady Connection.

PubMed

Koob, George F

2017-04-01

W. Horsley Gantt and Joseph V. Brady laid a rich foundation for understanding the concept of emotion, derived from 2 prominent traditions of physiology and psychology: classic conditioning and operant conditioning, respectively. This framework guided my fierce interest in motivation in general and the interaction between reward and stress, which began at John Hopkins with my thesis work under the guidance of Drs. Zoltan Annau, Solomon Synder, and Joseph Brady, among many others. Using the study of the neurobiology of addiction as a framework, I argue that drug addiction not only involves positive reinforcement associated with the rewarding effects of drugs of abuse but also involves another major source of reinforcement, specifically negative reinforcement driven by negative emotional states (termed the "dark side" of addiction). Excessive activation of the brain reward systems leads to antireward or a decrease in the function of normal reward-related neurocircuitry and persistent recruitment of the brain stress systems, both of which may be neurobiologically linked. Understanding the neuroplasticity of the neurocircuitry that comprises the negative reinforcement associated with addiction is a key to understanding negative emotional states in general and their pathophysiology.

Association between cerebral cannabinoid 1 receptor availability and body mass index in patients with food intake disorders and healthy subjects: a [(18)F]MK-9470 PET study.

PubMed

Ceccarini, J; Weltens, N; Ly, H G; Tack, J; Van Oudenhove, L; Van Laere, K

2016-07-12

Although of great public health relevance, the mechanisms underlying disordered eating behavior and body weight regulation remain insufficiently understood. Compelling preclinical evidence corroborates a critical role of the endocannabinoid system (ECS) in the central regulation of appetite and food intake. However, in vivo human evidence on ECS functioning in brain circuits involved in food intake regulation as well as its relationship with body weight is lacking, both in health and disease. Here, we measured cannabinoid 1 receptor (CB1R) availability using positron emission tomography (PET) with [(18)F]MK-9470 in 54 patients with food intake disorders (FID) covering a wide body mass index (BMI) range (anorexia nervosa, bulimia nervosa, functional dyspepsia with weight loss and obesity; BMI range=12.5-40.6 kg/m(2)) and 26 age-, gender- and average BMI-matched healthy subjects (BMI range=18.5-26.6 kg/m(2)). The association between regional CB1R availability and BMI was assessed within predefined homeostatic and reward-related regions of interest using voxel-based linear regression analyses. CB1R availability was inversely associated with BMI in homeostatic brain regions such as the hypothalamus and brainstem areas in both patients with FID and healthy subjects. However, in FID patients, CB1R availability was also negatively correlated with BMI throughout the mesolimbic reward system (midbrain, striatum, insula, amygdala and orbitofrontal cortex), which constitutes the key circuit implicated in processing appetitive motivation and hedonic value of perceived food rewards. Our results indicate that the cerebral homeostatic CB1R system is inextricably linked to BMI, with additional involvement of reward areas under conditions of disordered body weight.

Septal Glucagon-Like Peptide 1 Receptor Expression Determines Suppression of Cocaine-Induced Behavior

PubMed Central

Harasta, Anne E; Power, John M; von Jonquieres, Georg; Karl, Tim; Drucker, Daniel J; Housley, Gary D; Schneider, Miriam; Klugmann, Matthias

2015-01-01

Glucagon-like peptide 1 (GLP-1) and its receptor GLP-1R are a key component of the satiety signaling system, and long-acting GLP-1 analogs have been approved for the treatment of type-2 diabetes mellitus. Previous reports demonstrate that GLP-1 regulates glucose homeostasis alongside the rewarding effects of food. Both palatable food and illicit drugs activate brain reward circuitries, and pharmacological studies suggest that central nervous system GLP-1 signaling holds potential for the treatment of addiction. However, the role of endogenous GLP-1 in the attenuation of reward-oriented behavior, and the essential domains of the mesolimbic system mediating these beneficial effects, are largely unknown. We hypothesized that the central regions of highest Glp-1r gene activity are essential in mediating responses to drugs of abuse. Here, we show that Glp-1r-deficient (Glp-1r−/−) mice have greatly augmented cocaine-induced locomotor responses and enhanced conditional place preference compared with wild-type (Glp-1r+/+) controls. Employing mRNA in situ hybridization we located peak Glp-1r mRNA expression in GABAergic neurons of the dorsal lateral septum, an anatomical site with a crucial function in reward perception. Whole-cell patch-clamp recordings of dorsal lateral septum neurons revealed that genetic Glp-1r ablation leads to increased excitability of these cells. Viral vector-mediated Glp-1r gene delivery to the dorsal lateral septum of Glp-1r−/− animals reduced cocaine-induced locomotion and conditional place preference to wild-type levels. This site-specific genetic complementation did not affect the anxiogenic phenotype observed in Glp-1r−/− controls. These data reveal a novel role of GLP-1R in dorsal lateral septum function driving behavioral responses to cocaine. PMID:25669605

The Changing Functions of Citation: From Knowledge Networking to Academic Cash-Value

ERIC Educational Resources Information Center

Burbules, Nicholas C.

2015-01-01

This essay reviews the changing functions, and effects, of citation systems in scholarly research as they move from a range of uses primarily oriented around knowledge networking and epistemic validation, to their use as a set of metrics oriented around evaluating and rewarding certain kinds of academic performance (e.g. "impact…

Hyporesponsive Reward Anticipation in the Basal Ganglia following Severe Institutional Deprivation Early in Life

ERIC Educational Resources Information Center

Mehta, Mitul A.; Gore-Langton, Emma; Golembo, Nicole; Colvert, Emma; Williams, Steven C. R.; Sonuga-Barke, Edmund

2010-01-01

Severe deprivation in the first few years of life is associated with multiple difficulties in cognition and behavior. However, the brain basis for these difficulties is poorly understood. Structural and functional neuroimaging studies have implicated limbic system structures as dysfunctional, and one functional imaging study in a heterogeneous…

Cognition, emotion, and attention.

PubMed

Müller-Oehring, Eva M; Schulte, Tilman

2014-01-01

Deficits of attention, emotion, and cognition occur in individuals with alcohol abuse and addiction. This review elucidates the concepts of attention, emotion, and cognition and references research on the underlying neural networks and their compromise in alcohol use disorder. Neuroimaging research on adolescents with family history of alcoholism contributes to the understanding of pre-existing brain structural conditions and characterization of cognition and attention processes in high-risk individuals. Attention and cognition interact with other brain functions, including perceptual selection, salience, emotion, reward, and memory, through interconnected neural networks. Recent research reports compromised microstructural and functional network connectivity in alcoholism, which can have an effect on the dynamic tuning between brain systems, e.g., the frontally based executive control system, the limbic emotion system, and the midbrain-striatal reward system, thereby impeding cognitive flexibility and behavioral adaptation to changing environments. Finally, we introduce concepts of functional compensation, the capacity to generate attentional resources for performance enhancement, and brain structure recovery with abstinence. An understanding of the neural mechanisms of attention, emotion, and cognition will likely provide the basis for better treatment strategies for developing skills that enhance alcoholism therapy adherence and quality of life, and reduce the propensity for relapse. © 2014 Elsevier B.V. All rights reserved.

28 CFR 0.95 - General functions.

Code of Federal Regulations, 2010 CFR

2010-07-01

...) Payment of rewards with respect to escaped Federal prisoners (18 U.S.C. 3059). (f) Certification with... correctional systems (18 U.S.C. 4042). [Order No. 423-69, 34 FR 20388, Dec. 31, 1969, as amended by Order No...

Identifying the neural substrates of intrinsic motivation during task performance.

PubMed

Lee, Woogul; Reeve, Johnmarshall

2017-10-01

Intrinsic motivation is the inherent tendency to seek out novelty and challenge, to explore and investigate, and to stretch and extend one's capacities. When people imagine performing intrinsically motivating tasks, they show heightened anterior insular cortex (AIC) activity. To fully explain the neural system of intrinsic motivation, however, requires assessing neural activity while people actually perform intrinsically motivating tasks (i.e., while answering curiosity-inducing questions or solving competence-enabling anagrams). Using event-related functional magnetic resonance imaging, we found that the neural system of intrinsic motivation involves not only AIC activity, but also striatum activity and, further, AIC-striatum functional interactions. These findings suggest that subjective feelings of intrinsic satisfaction (associated with AIC activations), reward processing (associated with striatum activations), and their interactions underlie the actual experience of intrinsic motivation. These neural findings are consistent with the conceptualization of intrinsic motivation as the pursuit and satisfaction of subjective feelings (interest and enjoyment) as intrinsic rewards.

The Rewarding Aspects of Music Listening Are Related to Degree of Emotional Arousal

PubMed Central

Salimpoor, Valorie N.; Benovoy, Mitchel; Longo, Gregory; Cooperstock, Jeremy R.; Zatorre, Robert J.

2009-01-01

Background Listening to music is amongst the most rewarding experiences for humans. Music has no functional resemblance to other rewarding stimuli, and has no demonstrated biological value, yet individuals continue listening to music for pleasure. It has been suggested that the pleasurable aspects of music listening are related to a change in emotional arousal, although this link has not been directly investigated. In this study, using methods of high temporal sensitivity we investigated whether there is a systematic relationship between dynamic increases in pleasure states and physiological indicators of emotional arousal, including changes in heart rate, respiration, electrodermal activity, body temperature, and blood volume pulse. Methodology Twenty-six participants listened to self-selected intensely pleasurable music and “neutral” music that was individually selected for them based on low pleasure ratings they provided on other participants' music. The “chills” phenomenon was used to index intensely pleasurable responses to music. During music listening, continuous real-time recordings of subjective pleasure states and simultaneous recordings of sympathetic nervous system activity, an objective measure of emotional arousal, were obtained. Principal Findings Results revealed a strong positive correlation between ratings of pleasure and emotional arousal. Importantly, a dissociation was revealed as individuals who did not experience pleasure also showed no significant increases in emotional arousal. Conclusions/Significance These results have broader implications by demonstrating that strongly felt emotions could be rewarding in themselves in the absence of a physically tangible reward or a specific functional goal. PMID:19834599

Effective connectivity of a reward network in obese women

PubMed Central

Stoeckel, Luke E.; Kim, Jieun; Weller, Rosalyn E.; Cox, James E.; Cook, Edwin W.; Horwitz, Barry

2012-01-01

Exaggerated reactivity to food cues in obese women appears to be mediated in part by a hyperactive reward system that includes the nucleus accumbens, amygdala, and orbitofrontal cortex. The present study used fMRI to investigate whether differences between 12 obese and 12 normal-weight women in reward-related brain activation in response to food images can be explained by changes in the functional interactions between key reward network regions. A two-step path analysis/General Linear Model approach was used to test whether there were group differences in network connections between nucleus accumbens, amygdala, and orbitofrontal cortex in response to high- and low-calorie food images. There was abnormal connectivity in the obese group in response to both high- and low-calorie food cues compared to normal-weight controls. Compared to controls, the obese group had a relative deficiency in the amygdala’s modulation of activation in both orbitofrontal cortex and nucleus accumbens, but excessive influence of orbitofrontal cortex’s modulation of activation in nucleus accumbens. The deficient projections from the amygdala might relate to suboptimal modulation of the affective/emotional aspects of a food’s reward value or an associated cue’s motivational salience, whereas increased orbitofrontal cortex to nucleus accumbens connectivity might contribute to a heightened drive to eat in response to a food cue. Thus, it is possible that not only greater activation of the reward system, but also differences in the interaction of regions in this network may contribute to the relatively increased motivational value of foods in obese individuals. PMID:19467298

Reward prediction error signal enhanced by striatum-amygdala interaction explains the acceleration of probabilistic reward learning by emotion.

PubMed

Watanabe, Noriya; Sakagami, Masamichi; Haruno, Masahiko

2013-03-06

Learning does not only depend on rationality, because real-life learning cannot be isolated from emotion or social factors. Therefore, it is intriguing to determine how emotion changes learning, and to identify which neural substrates underlie this interaction. Here, we show that the task-independent presentation of an emotional face before a reward-predicting cue increases the speed of cue-reward association learning in human subjects compared with trials in which a neutral face is presented. This phenomenon was attributable to an increase in the learning rate, which regulates reward prediction errors. Parallel to these behavioral findings, functional magnetic resonance imaging demonstrated that presentation of an emotional face enhanced reward prediction error (RPE) signal in the ventral striatum. In addition, we also found a functional link between this enhanced RPE signal and increased activity in the amygdala following presentation of an emotional face. Thus, this study revealed an acceleration of cue-reward association learning by emotion, and underscored a role of striatum-amygdala interactions in the modulation of the reward prediction errors by emotion.

Reward circuitry in resilience to severe trauma: An fMRI investigation of resilient special forces soldiers

PubMed Central

Vythilingam, Meena; Nelson, Eric E.; Scaramozza, Matthew; Waldeck, Tracy; Hazlett, Gary; Southwick, Steven M.; Pine, Daniel S.; Drevets, Wayne; Charney, Dennis S.; Ernst, Monique

2008-01-01

Enhanced brain reward function could contribute to resilience to trauma. Reward circuitry in active duty, resilient special forces (SF) soldiers was evaluated using fMRI during a monetary incentive delay task. Findings in this group of resilient individuals revealed unique patterns of activation during expectation of reward in the subgenual prefrontal cortex and nucleus accumbens area; regions pivotal to reward processes. PMID:19243926

Neural connectivity during reward expectation dissociates psychopathic criminals from non-criminal individuals with high impulsive/antisocial psychopathic traits

PubMed Central

von Borries, Katinka; Volman, Inge; Bulten, Berend Hendrik; Cools, Roshan; Verkes, Robbert-Jan

2016-01-01

Criminal behaviour poses a big challenge for society. A thorough understanding of the neurobiological mechanisms underlying criminality could optimize its prevention and management. Specifically,elucidating the neural mechanisms underpinning reward expectation might be pivotal to understanding criminal behaviour. So far no study has assessed reward expectation and its mechanisms in a criminal sample. To fill this gap, we assessed reward expectation in incarcerated, psychopathic criminals. We compared this group to two groups of non-criminal individuals: one with high levels and another with low levels of impulsive/antisocial traits. Functional magnetic resonance imaging was used to quantify neural responses to reward expectancy. Psychophysiological interaction analyses were performed to examine differences in functional connectivity patterns of reward-related regions. The data suggest that overt criminality is characterized, not by abnormal reward expectation per se, but rather by enhanced communication between reward-related striatal regions and frontal brain regions. We establish that incarcerated psychopathic criminals can be dissociated from non-criminal individuals with comparable impulsive/antisocial personality tendencies based on the degree to which reward-related brain regions interact with brain regions that control behaviour. The present results help us understand why some people act according to their impulsive/antisocial personality while others are able to behave adaptively despite reward-related urges. PMID:27217111

Enriched Encoding: Reward Motivation Organizes Cortical Networks for Hippocampal Detection of Unexpected Events

PubMed Central

Murty, Vishnu P.; Adcock, R. Alison

2014-01-01

Learning how to obtain rewards requires learning about their contexts and likely causes. How do long-term memory mechanisms balance the need to represent potential determinants of reward outcomes with the computational burden of an over-inclusive memory? One solution would be to enhance memory for salient events that occur during reward anticipation, because all such events are potential determinants of reward. We tested whether reward motivation enhances encoding of salient events like expectancy violations. During functional magnetic resonance imaging, participants performed a reaction-time task in which goal-irrelevant expectancy violations were encountered during states of high- or low-reward motivation. Motivation amplified hippocampal activation to and declarative memory for expectancy violations. Connectivity of the ventral tegmental area (VTA) with medial prefrontal, ventrolateral prefrontal, and visual cortices preceded and predicted this increase in hippocampal sensitivity. These findings elucidate a novel mechanism whereby reward motivation can enhance hippocampus-dependent memory: anticipatory VTA-cortical–hippocampal interactions. Further, the findings integrate literatures on dopaminergic neuromodulation of prefrontal function and hippocampus-dependent memory. We conclude that during reward motivation, VTA modulation induces distributed neural changes that amplify hippocampal signals and records of expectancy violations to improve predictions—a potentially unique contribution of the hippocampus to reward learning. PMID:23529005

Impulsive responding in threat and reward contexts as a function of PTSD symptoms and trait disinhibition.

PubMed

Sadeh, Naomi; Spielberg, Jeffrey M; Hayes, Jasmeet P

2018-01-01

We examined current posttraumatic stress disorder (PTSD) symptoms, trait disinhibition, and affective context as contributors to impulsive and self-destructive behavior in 94 trauma-exposed Veterans. Participants completed an affective Go/No-Go task (GNG) with different emotional contexts (threat, reward, and a multidimensional threat/reward condition) and current PTSD, trait disinhibition, and risky/self-destructive behavior measures. PTSD interacted with trait disinhibition to explain recent engagement in risky/self-destructive behavior, with Veterans scoring high on trait disinhibition and current PTSD symptoms reporting the highest levels of these behaviors. On the GNG task, commission errors were also associated with the interaction of PTSD symptoms and trait disinhibition. Specifically, PTSD symptoms were associated with greater commission errors in threat vs. reward contexts for individuals who were low on trait disinhibition. In contrast, veterans high on PTSD and trait disinhibition exhibited the greatest number of commission errors in the multidimensional affective context that involved both threat and reward processing. Results highlight the interactive effects of PTSD and disinhibited personality traits, as well as threat and reward systems, as risk factors for impulsive and self-destructive behavior in trauma-exposed groups. Findings have clinical implications for understanding heterogeneity in the expression of PTSD and its association with disinhibited behavior. Copyright © 2017 Elsevier Ltd. All rights reserved.

Striatal response to favorite brands as a function of neuroticism and extraversion.

PubMed

Schaefer, Michael; Knuth, Michael; Rumpel, Franziska

2011-11-24

Recent research has demonstrated that the perception of favorite brands involves similar brain networks than artificially associated reward stimuli. This has been explained by the association of brands with appetitive stimuli due to marketing efforts. Thereby, strong emotional bonds between the brand and the customer may be established. Furthermore, previous studies have shown that the personality dimension extraversion can be linked with the dopaminergic system and reward-sensitive brain areas. The current study aimed to examine if personality traits are associated with the perception of brands as rewarding stimuli. In order to test this hypothesis we conducted an fMRI study in which we presented pictures of chocolate brands, which participants had to rate according to their personal attraction. The personality traits were assessed according to the Five-Factor-Model. Results revealed that favorite brands engaged reward-related brain areas (ventral striatum). This activation was significantly correlated with the degree of extraversion and neuroticism of the participants. Thus, the results demonstrate that personality traits are closely associated with the perception of brands as rewarding stimuli. We discuss the results with recent studies on the neuronal substrates of reward related processing of cultural objects and the role of personality in brand loyalty. Copyright © 2011 Elsevier B.V. All rights reserved.

Modulation of neural activity by reward in medial intraparietal cortex is sensitive to temporal sequence of reward

PubMed Central

Rajalingham, Rishi; Stacey, Richard Greg; Tsoulfas, Georgios

2014-01-01

To restore movements to paralyzed patients, neural prosthetic systems must accurately decode patients' intentions from neural signals. Despite significant advancements, current systems are unable to restore complex movements. Decoding reward-related signals from the medial intraparietal area (MIP) could enhance prosthetic performance. However, the dynamics of reward sensitivity in MIP is not known. Furthermore, reward-related modulation in premotor areas has been attributed to behavioral confounds. Here we investigated the stability of reward encoding in MIP by assessing the effect of reward history on reward sensitivity. We recorded from neurons in MIP while monkeys performed a delayed-reach task under two reward schedules. In the variable schedule, an equal number of small- and large-rewards trials were randomly interleaved. In the constant schedule, one reward size was delivered for a block of trials. The memory period firing rate of most neurons in response to identical rewards varied according to schedule. Using systems identification tools, we attributed the schedule sensitivity to the dependence of neural activity on the history of reward. We did not find schedule-dependent behavioral changes, suggesting that reward modulates neural activity in MIP. Neural discrimination between rewards was less in the variable than in the constant schedule, degrading our ability to decode reach target and reward simultaneously. The effect of schedule was mitigated by adding Haar wavelet coefficients to the decoding model. This raises the possibility of multiple encoding schemes at different timescales and reinforces the potential utility of reward information for prosthetic performance. PMID:25008408

Modulation of neural activity by reward in medial intraparietal cortex is sensitive to temporal sequence of reward.

PubMed

Rajalingham, Rishi; Stacey, Richard Greg; Tsoulfas, Georgios; Musallam, Sam

2014-10-01

To restore movements to paralyzed patients, neural prosthetic systems must accurately decode patients' intentions from neural signals. Despite significant advancements, current systems are unable to restore complex movements. Decoding reward-related signals from the medial intraparietal area (MIP) could enhance prosthetic performance. However, the dynamics of reward sensitivity in MIP is not known. Furthermore, reward-related modulation in premotor areas has been attributed to behavioral confounds. Here we investigated the stability of reward encoding in MIP by assessing the effect of reward history on reward sensitivity. We recorded from neurons in MIP while monkeys performed a delayed-reach task under two reward schedules. In the variable schedule, an equal number of small- and large-rewards trials were randomly interleaved. In the constant schedule, one reward size was delivered for a block of trials. The memory period firing rate of most neurons in response to identical rewards varied according to schedule. Using systems identification tools, we attributed the schedule sensitivity to the dependence of neural activity on the history of reward. We did not find schedule-dependent behavioral changes, suggesting that reward modulates neural activity in MIP. Neural discrimination between rewards was less in the variable than in the constant schedule, degrading our ability to decode reach target and reward simultaneously. The effect of schedule was mitigated by adding Haar wavelet coefficients to the decoding model. This raises the possibility of multiple encoding schemes at different timescales and reinforces the potential utility of reward information for prosthetic performance. Copyright © 2014 the American Physiological Society.

Perceived life stress exposure modulates reward-related medial prefrontal cortex responses to acute stress in depression.

PubMed

Kumar, Poornima; Slavich, George M; Berghorst, Lisa H; Treadway, Michael T; Brooks, Nancy H; Dutra, Sunny J; Greve, Douglas N; O'Donovan, Aoife; Bleil, Maria E; Maninger, Nicole; Pizzagalli, Diego A

2015-07-15

Major depressive disorder (MDD) is often precipitated by life stress and growing evidence suggests that stress-induced alterations in reward processing may contribute to such risk. However, no human imaging studies have examined how recent life stress exposure modulates the neural systems that underlie reward processing in depressed and healthy individuals. In this proof-of-concept study, 12 MDD and 10 psychiatrically healthy individuals were interviewed using the Life Events and Difficulties Schedule (LEDS) to assess their perceived levels of recent acute and chronic life stress exposure. Additionally, each participant performed a monetary incentive delay task under baseline (no-stress) and stress (social-evaluative) conditions during functional MRI. Across groups, medial prefrontal cortex (mPFC) activation to reward feedback was greater during acute stress versus no-stress conditions in individuals with greater perceived stressor severity. Under acute stress, depressed individuals showed a positive correlation between perceived stressor severity levels and reward-related mPFC activation (r=0.79, p=0.004), whereas no effect was found in healthy controls. Moreover, for depressed (but not healthy) individuals, the correlations between the stress (r=0.79) and no-stress (r=-0.48) conditions were significantly different. Finally, relative to controls, depressed participants showed significantly reduced mPFC gray matter, but functional findings remained robust while accounting for structural differences. Small sample size, which warrants replication. Depressed individuals experiencing greater recent life stress recruited the mPFC more under stress when processing rewards. Our results represent an initial step toward elucidating mechanisms underlying stress sensitization and recurrence in depression. Copyright © 2015 Elsevier B.V. All rights reserved.

Individual differences in sensitivity to reward and punishment and neural activity during reward and avoidance learning.

PubMed

Kim, Sang Hee; Yoon, HeungSik; Kim, Hackjin; Hamann, Stephan

2015-09-01

In this functional neuroimaging study, we investigated neural activations during the process of learning to gain monetary rewards and to avoid monetary loss, and how these activations are modulated by individual differences in reward and punishment sensitivity. Healthy young volunteers performed a reinforcement learning task where they chose one of two fractal stimuli associated with monetary gain (reward trials) or avoidance of monetary loss (avoidance trials). Trait sensitivity to reward and punishment was assessed using the behavioral inhibition/activation scales (BIS/BAS). Functional neuroimaging results showed activation of the striatum during the anticipation and reception periods of reward trials. During avoidance trials, activation of the dorsal striatum and prefrontal regions was found. As expected, individual differences in reward sensitivity were positively associated with activation in the left and right ventral striatum during reward reception. Individual differences in sensitivity to punishment were negatively associated with activation in the left dorsal striatum during avoidance anticipation and also with activation in the right lateral orbitofrontal cortex during receiving monetary loss. These results suggest that learning to attain reward and learning to avoid loss are dependent on separable sets of neural regions whose activity is modulated by trait sensitivity to reward or punishment. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Encoding of reward expectation by monkey anterior insular neurons

PubMed Central

Mizuhiki, Takashi; Richmond, Barry J.

2012-01-01

The insula, a cortical brain region that is known to encode information about autonomic, visceral, and olfactory functions, has recently been shown to encode information during reward-seeking tasks in both single neuronal recording and functional magnetic resonance imaging studies. To examine the reward-related activation, we recorded from 170 single neurons in anterior insula of 2 monkeys during a multitrial reward schedule task, where the monkeys had to complete a schedule of 1, 2, 3, or 4 trials to earn a reward. In one block of trials a visual cue indicated whether a reward would or would not be delivered in the current trial after the monkey successfully detected that a red spot turned green, and in other blocks the visual cue was random with respect to reward delivery. Over one-quarter of 131 responsive neurons were activated when the current trial would (certain or uncertain) be rewarded if performed correctly. These same neurons failed to respond in trials that were certain, as indicated by the cue, to be unrewarded. Another group of neurons responded when the reward was delivered, similar to results reported previously. The dynamics of population activity in anterior insula also showed strong signals related to knowing when a reward is coming. The most parsimonious explanation is that this activity codes for a type of expected outcome, where the expectation encompasses both certain and uncertain rewards. PMID:22402653

Reward-Based Spatial Learning in Teens With Bulimia Nervosa.

PubMed

Cyr, Marilyn; Wang, Zhishun; Tau, Gregory Z; Zhao, Guihu; Friedl, Eve; Stefan, Mihaela; Terranova, Kate; Marsh, Rachel

2016-11-01

To assess the functioning of mesolimbic and fronto-striatal areas involved in reward-based spatial learning in teenaged girls with bulimia nervosa (BN) that might be involved in the development and maintenance of maladaptive behaviors characteristic of the disorder. We compared functional magnetic resonance imaging blood oxygen level-dependent response in 27 adolescent girls with BN to that of 27 healthy, age-matched control participants during a reward-based learning task that required learning to use extra-maze cues to navigate a virtual 8-arm radial maze to find hidden rewards. We compared groups in their patterns of brain activation associated with reward-based spatial learning versus a control condition in which rewards were unexpected because they were allotted pseudo-randomly to experimentally prevent learning. Both groups learned to navigate the maze to find hidden rewards, but group differences in brain activity associated with maze navigation and reward processing were detected in the fronto-striatal regions and right anterior hippocampus. Unlike healthy adolescents, those with BN did not engage the right inferior frontal gyrus during maze navigation, activated the right anterior hippocampus during the receipt of unexpected rewards (control condition), and deactivated the left superior frontal gyrus and right anterior hippocampus during expected reward receipt (learning condition). These patterns of hippocampal activation in the control condition were significantly associated with the frequency of binge-eating episodes. Adolescents with BN displayed abnormal functioning of the anterior hippocampus and fronto-striatal regions during reward-based spatial learning. These findings suggest that an imbalance in control and reward circuits may arise early in the course of BN. Clinical trial registration information-An fMRI Study of Self-Regulation in Adolescents With Bulimia Nervosa; https://clinicaltrials.gov/; NCT00345943. Copyright © 2016 American Academy of Child and Adolescent Psychiatry. Published by Elsevier Inc. All rights reserved.

Fetal Programming Effects of Testosterone on the Reward System and Behavioral Approach Tendencies in Humans

PubMed Central

Lombardo, Michael V.; Ashwin, Emma; Auyeung, Bonnie; Chakrabarti, Bhismadev; Lai, Meng-Chuan; Taylor, Kevin; Hackett, Gerald; Bullmore, Edward T.; Baron-Cohen, Simon

2012-01-01

Background Sex differences are present in many neuropsychiatric conditions that affect emotion and approach-avoidance behavior. One potential mechanism underlying such observations is testosterone in early development. Although much is known about the effects of testosterone in adolescence and adulthood, little is known in humans about how testosterone in fetal development influences later neural sensitivity to valenced facial cues and approach-avoidance behavioral tendencies. Methods With functional magnetic resonance imaging we scanned 25 8–11-year-old children while viewing happy, fear, neutral, or scrambled faces. Fetal testosterone (FT) was measured via amniotic fluid sampled between 13 and 20 weeks gestation. Behavioral approach-avoidance tendencies were measured via parental report on the Sensitivity to Punishment and Sensitivity to Rewards questionnaire. Results Increasing FT predicted enhanced selectivity for positive compared with negatively valenced facial cues in reward-related regions such as caudate, putamen, and nucleus accumbens but not the amygdala. Statistical mediation analyses showed that increasing FT predicts increased behavioral approach tendencies by biasing caudate, putamen, and nucleus accumbens but not amygdala to be more responsive to positive compared with negatively valenced cues. In contrast, FT was not predictive of behavioral avoidance tendencies, either through direct or neurally mediated paths. Conclusions This work suggests that testosterone in humans acts as a fetal programming mechanism on the reward system and influences behavioral approach tendencies later in life. As a mechanism influencing atypical development, FT might be important across a range of neuropsychiatric conditions that asymmetrically affect the sexes, the reward system, emotion processing, and approach behavior. PMID:22763187

Fetal programming effects of testosterone on the reward system and behavioral approach tendencies in humans.

PubMed

Lombardo, Michael V; Ashwin, Emma; Auyeung, Bonnie; Chakrabarti, Bhismadev; Lai, Meng-Chuan; Taylor, Kevin; Hackett, Gerald; Bullmore, Edward T; Baron-Cohen, Simon

2012-11-15

Sex differences are present in many neuropsychiatric conditions that affect emotion and approach-avoidance behavior. One potential mechanism underlying such observations is testosterone in early development. Although much is known about the effects of testosterone in adolescence and adulthood, little is known in humans about how testosterone in fetal development influences later neural sensitivity to valenced facial cues and approach-avoidance behavioral tendencies. With functional magnetic resonance imaging we scanned 25 8-11-year-old children while viewing happy, fear, neutral, or scrambled faces. Fetal testosterone (FT) was measured via amniotic fluid sampled between 13 and 20 weeks gestation. Behavioral approach-avoidance tendencies were measured via parental report on the Sensitivity to Punishment and Sensitivity to Rewards questionnaire. Increasing FT predicted enhanced selectivity for positive compared with negatively valenced facial cues in reward-related regions such as caudate, putamen, and nucleus accumbens but not the amygdala. Statistical mediation analyses showed that increasing FT predicts increased behavioral approach tendencies by biasing caudate, putamen, and nucleus accumbens but not amygdala to be more responsive to positive compared with negatively valenced cues. In contrast, FT was not predictive of behavioral avoidance tendencies, either through direct or neurally mediated paths. This work suggests that testosterone in humans acts as a fetal programming mechanism on the reward system and influences behavioral approach tendencies later in life. As a mechanism influencing atypical development, FT might be important across a range of neuropsychiatric conditions that asymmetrically affect the sexes, the reward system, emotion processing, and approach behavior. Copyright © 2012 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Social work in the Veterans Health Administration (VA) System: rewards, challenges, roles and interventions.

PubMed

Beder, Joan; Postiglione, Paul

2013-01-01

For the social worker in the Veterans Health Administration (VA) System, numerous challenges are faced and met while serving the nation's Veterans. As part of the multidisciplinary team, social workers perform a variety of tasks and function in diverse roles. The qualitative survey research reported in this article sought to detail what social workers identified about the impact and rewards of their work and what they saw as the challenges and frustrations. In addition the social workers were asked to clarify their role with the patient and the family. Intervention strategies used in the course of the social workers interaction with the Veterans was also ascertained.

Galanin and addiction.

PubMed

Picciotto, M R

2008-06-01

There has been increasing interest in the ability of neuropeptides involved in feeding to modulate circuits important for responses to drugs of abuse. A number of peptides with effects on hypothalamic function also modulate the mesolimbic dopamine system (ventral tegmental area and nucleus accumbens). Similarly, common stress-related pathways can modulate food intake, drug reward and symptoms of drug withdrawal. Galanin promotes food intake and the analgesic properties of opiates; thus it initially seemed possible that galanin might potentiate opiate reinforcement. Instead, galanin agonists decrease opiate reward, measured by conditioned place preference, and opiate withdrawal signs, whereas opiate reward and withdrawal are increased in knock-out mice lacking galanin. This is consistent with studies showing that galanin decreases activity-evoked dopamine release in striatal slices and decreases the firing rate of noradrenergic neurons in locus coeruleus, areas involved in drug reward and withdrawal, respectively. These data suggest that polymorphisms in genes encoding galanin or galanin receptors might be associated with susceptibility to opiate abuse. Further, galanin receptors might be potential targets for development of novel treatments for addiction.

The rostromedial tegmental nucleus (RMTg), a major GABAergic afferent to midbrain dopamine neurons, selectively encodes aversive stimuli and promotes behavioral inhibition

PubMed Central

Jhou, Thomas C.; Fields, Howard L.; Baxter, Mark G.; Saper, Clifford B.; Holland, Peter C.

2009-01-01

Summary Separate studies have implicated the lateral habenula (LHb) or amygdala-related regions in processing aversive stimuli, but their relationships to each other and to appetitive motivational systems are poorly understood. We show that neurons in the recently identified GABAergic rostromedial tegmental nucleus (RMTg), which receive a major LHb input, project heavily to midbrain dopamine neurons, and show phasic activations and/or Fos induction after aversive stimuli (footshocks, shock-predictive cues, food deprivation, or reward omission) and inhibitions after rewards or reward-predictive stimuli. RMTg lesions markedly reduce passive fear behaviors (freezing, open-arm avoidance) dependent on the extended amygdala, periaqueductal gray, or septum, all regions that project directly to the RMTg. In contrast, RMTg lesions spare or enhance active fear responses (treading, escape) in these same paradigms. These findings suggest that aversive inputs from widespread brain regions and stimulus modalities converge onto the RMTg, which opposes reward and motor-activating functions of midbrain dopamine neurons PMID:19285474

Three real-time architectures - A study using reward models

NASA Technical Reports Server (NTRS)

Sjogren, J. A.; Smith, R. M.

1990-01-01

Numerous applications in the area of computer system analysis can be effectively studied with Markov reward models. These models describe the evolutionary behavior of the computer system by a continuous-time Markov chain, and a reward rate is associated with each state. In reliability/availability models, upstates have reward rate 1, and down states have reward rate zero associated with them. In a combined model of performance and reliability, the reward rate of a state may be the computational capacity, or a related performance measure. Steady-state expected reward rate and expected instantaneous reward rate are clearly useful measures which can be extracted from the Markov reward model. The diversity of areas where Markov reward models may be used is illustrated with a comparative study of three examples of interest to the fault tolerant computing community.

Rewards modulate saccade latency but not exogenous spatial attention.

PubMed

Dunne, Stephen; Ellison, Amanda; Smith, Daniel T

2015-01-01

The eye movement system is sensitive to reward. However, whilst the eye movement system is extremely flexible, the extent to which changes to oculomotor behavior induced by reward paradigms persist beyond the training period or transfer to other oculomotor tasks is unclear. To address these issues we examined the effects of presenting feedback that represented small monetary rewards to spatial locations on the latency of saccadic eye movements, the time-course of learning and extinction of the effects of rewarding saccades on exogenous spatial attention and oculomotor inhibition of return. Reward feedback produced a relative facilitation of saccadic latency in a stimulus driven saccade task which persisted for three blocks of extinction trials. However, this hemifield-specific effect failed to transfer to peripheral cueing tasks. We conclude that rewarding specific spatial locations is unlikely to induce long-term, systemic changes to the human oculomotor or attention systems.

Do Effort and Reward at Work Predict Changes in Cognitive Function? First Longitudinal Results from the Representative German Socio-Economic Panel

PubMed Central

Riedel, Natalie; Siegrist, Johannes; Wege, Natalia; Loerbroks, Adrian; Angerer, Peter; Li, Jian

2017-01-01

It has been suggested that work characteristics, such as mental demands, job control, and occupational complexity, are prospectively related to cognitive function. However, current evidence on links between psychosocial working conditions and cognitive change over time is inconsistent. In this study, we applied the effort–reward imbalance model that allows to build on previous research on mental demands and to introduce reward-based learning as a principle with beneficial effect on cognitive function. We aimed to investigate whether high effort, high reward, and low over-commitment in 2006 were associated with positive changes in cognitive function in terms of perceptual speed and word fluency (2006–2012), and whether the co-manifestation of high effort and high reward would yield the strongest association. To this end, we used data on 1031 employees who participated in a large and representative study. Multivariate linear regression analyses supported our main hypotheses (separate and combined effects of effort and reward), particularly on changes in perceptual speed, whereas the effects of over-commitment did not reach the level of statistical significance. Our findings extend available knowledge by examining the course of cognitive function over time. If corroborated by further evidence, organization-based measures in the workplace can enrich efforts towards preventing cognitive decline in ageing workforces. PMID:29140258

Noradrenergic modulation of risk/reward decision making.

PubMed

Montes, David R; Stopper, Colin M; Floresco, Stan B

2015-08-01

Catecholamine transmission modulates numerous cognitive and reward-related processes that can subserve more complex functions such as cost/benefit decision making. Dopamine has been shown to play an integral role in decisions involving reward uncertainty, yet there is a paucity of research investigating the contributions of noradrenaline (NA) transmission to these functions. The present study was designed to elucidate the contribution of NA to risk/reward decision making in rats, assessed with a probabilistic discounting task. We examined the effects of reducing noradrenergic transmission with the α2 agonist clonidine (10-100 μg/kg), and increasing activity at α2A receptor sites with the agonist guanfacine (0.1-1 mg/kg), the α2 antagonist yohimbine (1-3 mg/kg), and the noradrenaline transporter (NET) inhibitor atomoxetine (0.3-3 mg/kg) on probabilistic discounting. Rats chose between a small/certain reward and a larger/risky reward, wherein the probability of obtaining the larger reward either decreased (100-12.5 %) or increased (12.5-100 %) over a session. In well-trained rats, clonidine reduced risky choice by decreasing reward sensitivity, whereas guanfacine did not affect choice behavior. Yohimbine impaired adjustments in decision biases as reward probability changed within a session by altering negative feedback sensitivity. In a subset of rats that displayed prominent discounting of probabilistic rewards, the lowest dose of atomoxetine increased preference for the large/risky reward when this option had greater long-term utility. These data highlight an important and previously uncharacterized role for noradrenergic transmission in mediating different aspects of risk/reward decision making and mediating reward and negative feedback sensitivity.

Interaction of reward seeking and self-regulation in the prediction of risk taking: A cross-national test of the dual systems model.

PubMed

Duell, Natasha; Steinberg, Laurence; Chein, Jason; Al-Hassan, Suha M; Bacchini, Dario; Lei, Chang; Chaudhary, Nandita; Di Giunta, Laura; Dodge, Kenneth A; Fanti, Kostas A; Lansford, Jennifer E; Malone, Patrick S; Oburu, Paul; Pastorelli, Concetta; Skinner, Ann T; Sorbring, Emma; Tapanya, Sombat; Uribe Tirado, Liliana Maria; Alampay, Liane Peña

2016-10-01

In the present analysis, we test the dual systems model of adolescent risk taking in a cross-national sample of over 5,200 individuals aged 10 through 30 (M = 17.05 years, SD = 5.91) from 11 countries. We examine whether reward seeking and self-regulation make independent, additive, or interactive contributions to risk taking, and ask whether these relations differ as a function of age and culture. To compare across cultures, we conduct 2 sets of analyses: 1 comparing individuals from Asian and Western countries, and 1 comparing individuals from low- and high-GDP countries. Results indicate that reward seeking and self-regulation have largely independent associations with risk taking and that the influences of each variable on risk taking are not unique to adolescence, but that their link to risk taking varies across cultures. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Abuse Pattern of Toluene Exposure Alters Mouse Behavior in a Waiting-for-Reward Operant Task

PubMed Central

Bowen, Scott E.; McDonald, Phillip

2009-01-01

Inhaling solvents for recreational purposes continues to be a world-wide public health concern. Toluene, a volatile solvent in many abused products, adversely affects the central nervous system. However, the long-term neurobehavioral effects of exposure to high-concentration, binge patterns typical of toluene abuse remain understudied. We studied the behavioral effects of repeated toluene exposure on cognitive function following binge toluene exposure on behavioral impulse control in Swiss Webster mice using a “wait-for-reward” operant task. Mice were trained on a fixed-ratio (FR) schedule using sweetened milk as a reward. Upon achieving FR15, a wait component was added which delivered free rewards in the absence of responses at increasing time intervals (2 sec, 4 sec, 6 sec, etc…). Mice continued to receive free rewards until they pressed a lever that reinstated the FR component (FR Reset). Once proficient in the FR-Wait task, mice were exposed to either 1,000 ppm, 3,600 ppm or 6,000 ppm toluene, or 0 ppm (air controls) for 30 min per day for 40 days. To avoid acute effects of toluene exposure, behavior was assessed 23 hours later. Repeated toluene exposure decreased response rates, the number of FR resets, and increased mean wait time, resulting in a higher response-to-reinforcer ratio than exhibited by controls. Mice receiving the higher exposure level (6,000 ppm) showed a dramatic decrease in the number of rewards received, which was reversed when toluene exposure ceased. Mice receiving the lower exposure level (1,000 ppm) showed little change in the number of rewards. These results indicate that repeated binge exposures to high concentrations of toluene can significantly interfere with performance as measured by a waiting-for-reward task, suggesting a significant impact on cognitive and/or psychomotor function. PMID:18832024

Neurological Correlates of Reward Responding in Adolescents With and Without Externalizing Behavior Disorders

PubMed Central

Gatzke-Kopp, Lisa M.; Beauchaine, Theodore P.; Shannon, Katherine E.; Chipman, Jane; Fleming, Andrew P.; Crowell, Sheila E.; Liang, Olivia; Aylward, Elizabeth; Johnson, L. Clark

2009-01-01

Opposing theories of striatal hyper- and hypodopaminergic functioning have been suggested in the pathophysiology of externalizing behavior disorders. To test these competing theories, the authors used functional MRI to evaluate neural activity during a simple reward task in 12- to 16-year-old boys with attention-deficit/hyperactivity disorder and/or conduct disorder (n = 19) and in controls with no psychiatric condition (n = 11). The task proceeded in blocks during which participants received either (a) monetary incentives for correct responses or (b) no rewards for correct responses. Controls exhibited striatal activation only during reward, shifting to anterior cingulate activation during nonreward. In contrast, externalizing adolescents exhibited striatal activation during both reward and nonreward. Externalizing psychopathology appears to be characterized by deficits in processing the omission of predicted reward, which may render behaviors that are acquired through environmental contingencies difficult to extinguish when those contingencies change. PMID:19222326

Attention to nurses' rewarding - an interview study of registered nurses working in primary and private healthcare in Finland.

PubMed

Seitovirta, Jaana; Vehviläinen-Julkunen, Katri; Mitronen, Lasse; De Gieter, Sara; Kvist, Tarja

2017-04-01

To identify meaningful types of rewards and the consequences of rewards as expressed by Finnish registered nurses working in primary and private healthcare. Previous studies have found significant associations between nurses' rewards and both their commitment and job satisfaction. Furthermore, appropriate rewards can have beneficial effects on factors including workforce stability and occupational satisfaction that are highly important in times of nurse shortages. A cross-sectional, qualitative interview study. Data were collected via individual semi-structured interviews (n = 20) with registered nurses working in Finland's primary and private healthcare, and subjected to qualitative content analysis. Six meaningful types of rewards were identified by the registered nurses: Financial compensation and benefits, Work-Life balance, Work content, Professional development, Recognition, and Supportive leadership. Rewards encouraged respondents to perform their work correctly and reinforced occupational satisfaction, but also caused feelings of envy and stress. It is essential to pay attention to nurses' preferences for particular rewards and to reward management. When designing effective reward systems for registered nurses, it is not sufficient to provide financial rewards alone, as various kinds of non-financial rewards are both meaningful and necessary. When trying to improve registered nurses' commitment and job satisfaction through reward management, it is important to listen to nurses' opinions to create a reward system that integrates financial and non-financial rewards and is fair from their perspective. Healthcare organisations that offer registered nurses a holistic reward system are more likely to retain satisfied and committed nurses at a time of increasing nursing shortages. © 2016 John Wiley & Sons Ltd.

Hypoactivation of reward motivational system in patients with newly diagnosed hypertension grade I-II.

PubMed

Aftanas, L I; Brak, I V; Gilinskaya, O M; Korenek, V V; Pavlov, S V; Reva, N V

2014-08-01

In patients with newly diagnosed untreated grade I-II hypertension, EEG oscillations were recorded under conditions activation of the two basic motivational systems, defensive motivational system and positive reinforcement system, evoked by recall of personally meaningful emotional events. The 64-channel EEG and cardiovascular reactivity (beat-by-beat technology) were simultaneously recorded. At rest, hypertensive patients had significantly reduced platelet serotonin concentrations in comparison with healthy individuals. The patients experiencing emotional activation were characterized by significantly lower intensity of positive emotions associated with more pronounced suppression of EEG activity in the delta (2-4 Hz) and theta (ranges of frequency 4-6 and 6-8 Hz) oscillators in the parieto-occipital cortex (zones P and PO) in both hemispheres of the brain. The findings attest to insufficient function of the brain serotonin system and hypoactivation of the reward/reinforcement system in patients with primary hypertension.

Developmental continuity in reward-related enhancement of cognitive control.

PubMed

Strang, Nicole M; Pollak, Seth D

2014-10-01

Adolescents engage in more risky behavior than children or adults. The most prominent hypothesis for this phenomenon is that brain systems governing reward sensitivity and brain systems governing self-regulation mature at different rates. Those systems governing reward sensitivity mature in advance of those governing self-control. This hypothesis has substantial empirical support, however, the evidence supporting this theory has been exclusively derived from contexts where self-control systems are required to regulate reward sensitivity in order to promote adaptive behavior. In adults, reward promotes a shift to a proactive control strategy and better cognitive control performance. It is unclear whether children and adolescents will respond to reward in the same way. Using fMRI methodology, we explored whether children and adolescents would demonstrate a shift to proactive control in the context of reward. We tested 22 children, 20 adolescents, and 23 adults. In contrast to our hypothesis, children, adolescents, and adults all demonstrated a shift to proactive cognitive control in the context of reward. In light of the results, current neurobiological theories of adolescent behavior need to be refined to reflect that in certain contexts there is continuity in the manner reward and cognitive control systems interact across development. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Reward-based spatial learning in unmedicated adults with obsessive-compulsive disorder.

PubMed

Marsh, Rachel; Tau, Gregory Z; Wang, Zhishun; Huo, Yuankai; Liu, Ge; Hao, Xuejun; Packard, Mark G; Peterson, Bradley S; Simpson, H Blair

2015-04-01

The authors assessed the functioning of mesolimbic and striatal areas involved in reward-based spatial learning in unmedicated adults with obsessive-compulsive disorder (OCD). Functional MRI blood-oxygen-level-dependent response was compared in 33 unmedicated adults with OCD and 33 healthy, age-matched comparison subjects during a reward-based learning task that required learning to use extramaze cues to navigate a virtual eight-arm radial maze to find hidden rewards. The groups were compared in their patterns of brain activation associated with reward-based spatial learning versus a control condition in which rewards were unexpected because they were allotted pseudorandomly to experimentally prevent learning. Both groups learned to navigate the maze to find hidden rewards, but group differences in neural activity during navigation and reward processing were detected in mesolimbic and striatal areas. During navigation, the OCD group, unlike the healthy comparison group, exhibited activation in the left posterior hippocampus. Unlike healthy subjects, participants in the OCD group did not show activation in the left ventral putamen and amygdala when anticipating rewards or in the left hippocampus, amygdala, and ventral putamen when receiving unexpected rewards (control condition). Signal in these regions decreased relative to baseline during unexpected reward receipt among those in the OCD group, and the degree of activation was inversely associated with doubt/checking symptoms. Participants in the OCD group displayed abnormal recruitment of mesolimbic and ventral striatal circuitry during reward-based spatial learning. Whereas healthy comparison subjects exhibited activation in this circuitry in response to the violation of reward expectations, unmedicated OCD participants did not and instead over-relied on the posterior hippocampus during learning. Thus, dopaminergic innervation of reward circuitry may be altered, and future study of anterior/posterior hippocampal dysfunction in OCD is warranted.

Blunted striatal response to monetary reward anticipation during smoking abstinence predicts lapse during a contingency-managed quit attempt.

PubMed

Sweitzer, Maggie M; Geier, Charles F; Denlinger, Rachel; Forbes, Erika E; Raiff, Bethany R; Dallery, Jesse; McClernon, F J; Donny, Eric C

2016-03-01

Tobacco smoking is associated with dysregulated reward processing within the striatum, characterized by hypersensitivity to smoking rewards and hyposensitivity to non-smoking rewards. This bias toward smoking reward at the expense of alternative rewards is further exacerbated by deprivation from smoking, which may contribute to difficulty maintaining abstinence during a quit attempt. We examined whether abstinence-induced changes in striatal processing of rewards predicted lapse likelihood during a quit attempt supported by contingency management (CM), in which abstinence from smoking was reinforced with money. Thirty-six non-treatment-seeking smokers participated in two functional MRI (fMRI) sessions, one following 24-h abstinence and one following smoking as usual. During each scan, participants completed a rewarded guessing task designed to elicit striatal activation in which they could earn smoking and monetary rewards delivered after the scan. Participants then engaged in a 3-week CM-supported quit attempt. As previously reported, 24-h abstinence was associated with increased striatal activation in anticipation of smoking reward and decreased activation in anticipation of monetary reward. Individuals exhibiting greater decrements in right striatal activation to monetary reward during abstinence (controlling for activation during non-abstinence) were more likely to lapse during CM (p < 0.025), even when controlling for other predictors of lapse outcome (e.g., craving); no association was seen for smoking reward. These results are consistent with a growing number of studies indicating the specific importance of disrupted striatal processing of non-drug reward in nicotine dependence and highlight the importance of individual differences in abstinence-induced deficits in striatal function for smoking cessation.

Neural Reward Processing Mediates the Relationship between Insomnia Symptoms and Depression in Adolescence

PubMed Central

Casement, Melynda D.; Keenan, Kate E.; Hipwell, Alison E.; Guyer, Amanda E.; Forbes, Erika E.

2016-01-01

Study Objectives: Emerging evidence suggests that insomnia may disrupt reward-related brain function—a potentially important factor in the development of depressive disorder. Adolescence may be a period during which such disruption is especially problematic given the rise in the incidence of insomnia and ongoing development of neural systems that support reward processing. The present study uses longitudinal data to test the hypothesis that disruption of neural reward processing is a mechanism by which insomnia symptoms—including nocturnal insomnia symptoms (NIS) and nonrestorative sleep (NRS)—contribute to depressive symptoms in adolescent girls. Method: Participants were 123 adolescent girls and their caregivers from an ongoing longitudinal study of precursors to depression across adolescent development. NIS and NRS were assessed annually from ages 9 to 13 years. Girls completed a monetary reward task during a functional MRI scan at age 16 years. Depressive symptoms were assessed at ages 16 and 17 years. Multivariable regression tested the prospective associations between NIS and NRS, neural response during reward anticipation, and the mean number of depressive symptoms (omitting sleep problems). Results: NRS, but not NIS, during early adolescence was positively associated with late adolescent dorsal medial prefrontal cortex (dmPFC) response to reward anticipation and depressive symptoms. DMPFC response mediated the relationship between early adolescent NRS and late adolescent depressive symptoms. Conclusions: These results suggest that NRS may contribute to depression by disrupting reward processing via altered activity in a region of prefrontal cortex involved in affective control. The results also support the mechanistic differentiation of NIS and NRS. Citation: Casement MD, Keenan KE, Hipwell AE, Guyer AE, Forbes EE. Neural reward processing mediates the relationship between insomnia symptoms and depression in adolescence. SLEEP 2016;39(2):439–447. PMID:26350468

Heightened Activity in Social Reward Networks is Associated with Adolescents’ Risky Sexual Behaviors

PubMed Central

Eckstrand, Kristen L.; Choukas-Bradley, Sophia; Mohanty, Arpita; Cross, Marissa; Allen, Nicholas B.; Silk, Jennifer S.; Jones, Neil P.; Forbes, Erika E.

2018-01-01

Adolescent sexual risk behavior can lead to serious health consequences, yet few investigations have addressed its neurodevelopmental mechanisms. Social neurocircuitry is postulated to underlie the development of risky sexual behavior, and response to social reward may be especially relevant. Typically developing adolescents (N=47; 18M, 29F; 16.3±1.4 years; 42.5% sexual intercourse experience) completed a social reward fMRI task and reported their sexual risk behaviors (e.g., lifetime sexual partners) on the Youth Risk Behavior Survey (YRBS). Neural response and functional connectivity to social reward were compared for adolescents with higher- and lower-risk sexual behavior. Adolescents with higher-risk sexual behaviors demonstrated increased activation in the right precuneus and the right temporoparietal junction during receipt of social reward. Adolescents with higher-risk sexual behaviors also demonstrated greater functional connectivity between the precuneus and the temporoparietal junction bilaterally, dorsal medial prefrontal cortex, and left anterior insula/ventrolateral prefrontal cortex. The greater activation and functional connectivity in self-referential, social reward, and affective processing regions among higher sexual risk adolescents underscores the importance of social influence underlying sexual risk behaviors. Furthermore, results suggest an orientation towards and sensitivity to social rewards among youth engaging in higher-risk sexual behavior, perhaps as a consequence of or vulnerability to such behavior. PMID:28755632

Sleep and Circadian Contributions to Adolescent Alcohol Use Disorder

PubMed Central

Hasler, Brant P.; Soehner, Adriane M.; Clark, Duncan B.

2014-01-01

Adolescence is a time of marked changes across sleep, circadian rhythms, brain function, and alcohol use. Starting at puberty, adolescents’ endogenous circadian rhythms and preferred sleep times shift later, often leading to a mismatch with the schedules imposed by secondary education. This mismatch induces circadian misalignment and sleep loss, which have been associated with affect dysregulation, increased drug and alcohol use, and other risk-taking behaviors in adolescents and adults. In parallel to developmental changes in sleep, adolescent brains are undergoing structural and functional changes in the circuits subserving the pursuit and processing of rewards. These developmental changes in reward processing likely contribute to the initiation of alcohol use during adolescence. Abundant evidence indicates that sleep and circadian rhythms modulate reward function, suggesting that adolescent sleep and circadian disturbance may contribute to altered reward function, and in turn, alcohol involvement. In this review, we summarize the relevant evidence and propose that these parallel developmental changes in sleep, circadian rhythms, and neural processing of reward interact to increase risk for alcohol use disorder (AUD). PMID:25442171

Cholinergic modulation of mesolimbic dopamine function and reward.

PubMed

Mark, Gregory P; Shabani, Shkelzen; Dobbs, Lauren K; Hansen, Stephen T

2011-07-25

The substantial health risk posed by obesity and compulsive drug use has compelled a serious research effort to identify the neurobiological substrates that underlie the development these pathological conditions. Despite substantial progress, an understanding of the neurochemical systems that mediate the motivational aspects of drug-seeking and craving remains incomplete. Important work from the laboratory of Bart Hoebel has provided key information on neurochemical systems that interact with dopamine (DA) as potentially important components in both the development of addiction and the expression of compulsive behaviors such as binge eating. One such modulatory system appears to be cholinergic pathways that interact with DA systems at all levels of the reward circuit. Cholinergic cells in the pons project to DA-rich cell body regions in the ventral tegmental area (VTA) and substantial nigra (SN) where they modulate the activity of dopaminergic neurons and reward processing. The DA terminal region of the nucleus accumbens (NAc) contains a small but particularly important group of cholinergic interneurons, which have extensive dendritic arbors that make synapses with a vast majority of NAc neurons and afferents. Together with acetylcholine (ACh) input onto DA cell bodies, cholinergic systems could serve a vital role in gating information flow concerning the motivational value of stimuli through the mesolimbic system. In this report we highlight evidence that CNS cholinergic systems play a pivotal role in behaviors that are motivated by both natural and drug rewards. We argue that the search for underlying neurochemical substrates of compulsive behaviors, as well as attempts to identify potential pharmacotherapeutic targets to combat them, must include a consideration of central cholinergic systems. Copyright © 2011 Elsevier Inc. All rights reserved.

The alcoholic brain: neural bases of impaired reward-based decision-making in alcohol use disorders.

PubMed

Galandra, Caterina; Basso, Gianpaolo; Cappa, Stefano; Canessa, Nicola

2018-03-01

Neuroeconomics is providing insights into the neural bases of decision-making in normal and pathological conditions. In the neuropsychiatric domain, this discipline investigates how abnormal functioning of neural systems associated with reward processing and cognitive control promotes different disorders, and whether such evidence may inform treatments. This endeavor is crucial when studying different types of addiction, which share a core promoting mechanism in the imbalance between impulsive subcortical neural signals associated with immediate pleasurable outcomes and inhibitory signals mediated by a prefrontal reflective system. The resulting impairment in behavioral control represents a hallmark of alcohol use disorders (AUDs), a chronic relapsing disorder characterized by excessive alcohol consumption despite devastating consequences. This review aims to summarize available magnetic resonance imaging (MRI) evidence on reward-related decision-making alterations in AUDs, and to envision possible future research directions. We review functional MRI (fMRI) studies using tasks involving monetary rewards, as well as MRI studies relating decision-making parameters to neurostructural gray- or white-matter metrics. The available data suggest that excessive alcohol exposure affects neural signaling within brain networks underlying adaptive behavioral learning via the implementation of prediction errors. Namely, weaker ventromedial prefrontal cortex activity and altered connectivity between ventral striatum and dorsolateral prefrontal cortex likely underpin a shift from goal-directed to habitual actions which, in turn, might underpin compulsive alcohol consumption and relapsing episodes despite adverse consequences. Overall, these data highlight abnormal fronto-striatal connectivity as a candidate neurobiological marker of impaired choice in AUDs. Further studies are needed, however, to unveil its implications in the multiple facets of decision-making.

Nalmefene Reduces Reward Anticipation in Alcohol Dependence: An Experimental Functional Magnetic Resonance Imaging Study.

PubMed

Quelch, Darren R; Mick, Inge; McGonigle, John; Ramos, Anna C; Flechais, Remy S A; Bolstridge, Mark; Rabiner, Eugenii; Wall, Matthew B; Newbould, Rexford D; Steiniger-Brach, Björn; van den Berg, Franz; Boyce, Malcolm; Østergaard Nilausen, Dorrit; Breuning Sluth, Lasse; Meulien, Didier; von der Goltz, Christoph; Nutt, David; Lingford-Hughes, Anne

2017-06-01

Nalmefene is a µ and δ opioid receptor antagonist, κ opioid receptor partial agonist that has recently been approved in Europe for treating alcohol dependence. It offers a treatment approach for alcohol-dependent individuals with "high-risk drinking levels" to reduce their alcohol consumption. However, the neurobiological mechanism underpinning its effects on alcohol consumption remains to be determined. Using a randomized, double-blind, placebo-controlled, within-subject crossover design we aimed to determine the effect of a single dose of nalmefene on striatal blood oxygen level-dependent (BOLD) signal change during anticipation of monetary reward using the monetary incentive delay task following alcohol challenge. Twenty-two currently heavy-drinking, non-treatment-seeking alcohol-dependent males were recruited. The effect of single dose nalmefene (18 mg) on changes in a priori defined striatal region of interest BOLD signal change during reward anticipation compared with placebo was investigated using functional magnetic resonance imaging. Both conditions were performed under intravenous alcohol administration (6% vol/vol infusion to achieve a target level of 80 mg/dL). Datasets from 18 participants were available and showed that in the presence of the alcohol infusion, nalmefene significantly reduced the BOLD response in the striatal region of interest compared with placebo. Nalmefene did not alter brain perfusion. Nalmefene blunts BOLD response in the mesolimbic system during anticipation of monetary reward and an alcohol infusion. This is consistent with nalmefene's actions on opioid receptors, which modulate the mesolimbic dopaminergic system, and provides a neurobiological basis for its efficacy. Copyright © 2017 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Neurocomputational mechanisms underlying subjective valuation of effort costs

PubMed Central

Giehl, Kathrin; Sillence, Annie

2017-01-01

In everyday life, we have to decide whether it is worth exerting effort to obtain rewards. Effort can be experienced in different domains, with some tasks requiring significant cognitive demand and others being more physically effortful. The motivation to exert effort for reward is highly subjective and varies considerably across the different domains of behaviour. However, very little is known about the computational or neural basis of how different effort costs are subjectively weighed against rewards. Is there a common, domain-general system of brain areas that evaluates all costs and benefits? Here, we used computational modelling and functional magnetic resonance imaging (fMRI) to examine the mechanisms underlying value processing in both the cognitive and physical domains. Participants were trained on two novel tasks that parametrically varied either cognitive or physical effort. During fMRI, participants indicated their preferences between a fixed low-effort/low-reward option and a variable higher-effort/higher-reward offer for each effort domain. Critically, reward devaluation by both cognitive and physical effort was subserved by a common network of areas, including the dorsomedial and dorsolateral prefrontal cortex, the intraparietal sulcus, and the anterior insula. Activity within these domain-general areas also covaried negatively with reward and positively with effort, suggesting an integration of these parameters within these areas. Additionally, the amygdala appeared to play a unique, domain-specific role in processing the value of rewards associated with cognitive effort. These results are the first to reveal the neurocomputational mechanisms underlying subjective cost–benefit valuation across different domains of effort and provide insight into the multidimensional nature of motivation. PMID:28234892

Acute D3 Antagonist GSK598809 Selectively Enhances Neural Response During Monetary Reward Anticipation in Drug and Alcohol Dependence

PubMed Central

Murphy, Anna; Nestor, Liam J; McGonigle, John; Paterson, Louise; Boyapati, Venkataramana; Ersche, Karen D; Flechais, Remy; Kuchibatla, Shankar; Metastasio, Antonio; Orban, Csaba; Passetti, Filippo; Reed, Laurence; Smith, Dana; Suckling, John; Taylor, Eleanor; Robbins, Trevor W; Lingford-Hughes, Anne; Nutt, David J; Deakin, John FW; Elliott, Rebecca

2017-01-01

Evidence suggests that disturbances in neurobiological mechanisms of reward and inhibitory control maintain addiction and provoke relapse during abstinence. Abnormalities within the dopamine system may contribute to these disturbances and pharmacologically targeting the D3 dopamine receptor (DRD3) is therefore of significant clinical interest. We used functional magnetic resonance imaging to investigate the acute effects of the DRD3 antagonist GSK598809 on anticipatory reward processing, using the monetary incentive delay task (MIDT), and response inhibition using the Go/No-Go task (GNGT). A double-blind, placebo-controlled, crossover design approach was used in abstinent alcohol dependent, abstinent poly-drug dependent and healthy control volunteers. For the MIDT, there was evidence of blunted ventral striatal response to reward in the poly-drug-dependent group under placebo. GSK598809 normalized ventral striatal reward response and enhanced response in the DRD3-rich regions of the ventral pallidum and substantia nigra. Exploratory investigations suggested that the effects of GSK598809 were mainly driven by those with primary dependence on alcohol but not on opiates. Taken together, these findings suggest that GSK598809 may remediate reward deficits in substance dependence. For the GNGT, enhanced response in the inferior frontal cortex of the poly-drug group was found. However, there were no effects of GSK598809 on the neural network underlying response inhibition nor were there any behavioral drug effects on response inhibition. GSK598809 modulated the neural network underlying reward anticipation but not response inhibition, suggesting that DRD3 antagonists may restore reward deficits in addiction. PMID:28042871

Food reward system: current perspectives and future research needs

PubMed Central

Woods, Stephen C.; Pelchat, Marcia; Grigson, Patricia Sue; Stice, Eric; Farooqi, Sadaf; Khoo, Chor San; Mattes, Richard D.; Beauchamp, Gary K.

2015-01-01

This article reviews current research and cross-disciplinary perspectives on the neuroscience of food reward in animals and humans, examines the scientific hypothesis of food addiction, discusses methodological and terminology challenges, and identifies knowledge gaps and future research needs. Topics addressed herein include the role of reward and hedonic aspects in the regulation of food intake, neuroanatomy and neurobiology of the reward system in animals and humans, responsivity of the brain reward system to palatable foods and drugs, translation of craving versus addiction, and cognitive control of food reward. The content is based on a workshop held in 2013 by the North American Branch of the International Life Sciences Institute. PMID:26011903

Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits.

PubMed

Salamone, J D; Correa, M; Farrar, A; Mingote, S M

2007-04-01

Over the last several years, it has become apparent that there are critical problems with the hypothesis that brain dopamine (DA) systems, particularly in the nucleus accumbens, directly mediate the rewarding or primary motivational characteristics of natural stimuli such as food. Hypotheses related to DA function are undergoing a substantial restructuring, such that the classic emphasis on hedonia and primary reward is giving way to diverse lines of research that focus on aspects of instrumental learning, reward prediction, incentive motivation, and behavioral activation. The present review discusses dopaminergic involvement in behavioral activation and, in particular, emphasizes the effort-related functions of nucleus accumbens DA and associated forebrain circuitry. The effects of accumbens DA depletions on food-seeking behavior are critically dependent upon the work requirements of the task. Lever pressing schedules that have minimal work requirements are largely unaffected by accumbens DA depletions, whereas reinforcement schedules that have high work (e.g., ratio) requirements are substantially impaired by accumbens DA depletions. Moreover, interference with accumbens DA transmission exerts a powerful influence over effort-related decision making. Rats with accumbens DA depletions reallocate their instrumental behavior away from food-reinforced tasks that have high response requirements, and instead, these rats select a less-effortful type of food-seeking behavior. Along with prefrontal cortex and the amygdala, nucleus accumbens is a component of the brain circuitry regulating effort-related functions. Studies of the brain systems regulating effort-based processes may have implications for understanding drug abuse, as well as energy-related disorders such as psychomotor slowing, fatigue, or anergia in depression.

A plastic corticostriatal circuit model of adaptation in perceptual decision making

PubMed Central

Hsiao, Pao-Yueh; Lo, Chung-Chuan

2013-01-01

The ability to optimize decisions and adapt them to changing environments is a crucial brain function that increase survivability. Although much has been learned about the neuronal activity in various brain regions that are associated with decision making, and about how the nervous systems may learn to achieve optimization, the underlying neuronal mechanisms of how the nervous systems optimize decision strategies with preference given to speed or accuracy, and how the systems adapt to changes in the environment, remain unclear. Based on extensive empirical observations, we addressed the question by extending a previously described cortico-basal ganglia circuit model of perceptual decisions with the inclusion of a dynamic dopamine (DA) system that modulates spike-timing dependent plasticity (STDP). We found that, once an optimal model setting that maximized the reward rate was selected, the same setting automatically optimized decisions across different task environments through dynamic balancing between the facilitating and depressing components of the DA dynamics. Interestingly, other model parameters were also optimal if we considered the reward rate that was weighted by the subject's preferences for speed or accuracy. Specifically, the circuit model favored speed if we increased the phasic DA response to the reward prediction error, whereas the model favored accuracy if we reduced the tonic DA activity or the phasic DA responses to the estimated reward probability. The proposed model provides insight into the roles of different components of DA responses in decision adaptation and optimization in a changing environment. PMID:24339814

Identifying nurses' rewards: a qualitative categorization study in Belgium

PubMed Central

De Gieter, Sara; De Cooman, Rein; Pepermans, Roland; Caers, Ralf; Du Bois, Cindy; Jegers, Marc

2006-01-01

Background Rewards are important in attracting, motivating and retaining the most qualified employees, and nurses are no exception to this rule. This makes the establishment of an efficient reward system for nurses a true challenge for every hospital manager. A reward does not necessarily have a financial connotation: non-financial rewards may matter too, or may even be more important. Therefore, the present study examines nurses' reward perceptions, in order to identify potential reward options. Methods To answer the research question "What do nurses consider a reward and how can these rewards be categorized?", 20 in-depth semi-structured interviews with nurses were conducted and analysed using discourse and content analyses. In addition, the respondents received a list of 34 rewards (derived from the literature) and were asked to indicate the extent to which they perceived each of them to be rewarding. Results Discourse analysis revealed three major reward categories: financial, non-financial and psychological, each containing different subcategories. In general, nurses more often mentioned financial rewards spontaneously in the interview, compared to non-financial and psychological rewards. The questionnaire results did not, however, indicate a significant difference in the rewarding potential of these three categories. Both the qualitative and quantitative data revealed that a number of psychological and non-financial rewards were important for nurses in addition to their monthly pay and other remunerations. In particular, appreciation for their work by others, compliments from others, presents from others and contact with patients were highly valued. Moreover, some demographical variables influenced the reward perceptions. Younger and less experienced nurses considered promotion possibilities as more rewarding than the older and more senior ones. The latter valued job security and working for a hospital with a good reputation higher than their younger and more junior colleagues. Conclusion When trying to establish an efficient reward system for nurses, hospital managers should not concentrate on the financial reward possibilities alone. They also ought to consider non-financial and psychological rewards (in combination with financial rewards), since nurses value these as well and they may lead to a more personalized reward system. PMID:16824227

Category Learning in the Brain

PubMed Central

Seger, Carol A.; Miller, Earl K.

2013-01-01

The ability to group items and events into functional categories is a fundamental characteristic of sophisticated thought. It is subserved by plasticity in many neural systems, including neocortical regions (sensory, prefrontal, parietal, and motor cortex), the medial temporal lobe, the basal ganglia, and midbrain dopaminergic systems. These systems interact during category learning. Corticostriatal loops may mediate recursive, bootstrapping interactions between fast reward-gated plasticity in the basal ganglia and slow reward-shaded plasticity in the cortex. This can provide a balance between acquisition of details of experiences and generalization across them. Interactions between the corticostriatal loops can integrate perceptual, response, and feedback-related aspects of the task and mediate the shift from novice to skilled performance. The basal ganglia and medial temporal lobe interact competitively or cooperatively, depending on the demands of the learning task. PMID:20572771

Running is rewarding and antidepressive.

PubMed

Brené, Stefan; Bjørnebekk, Astrid; Aberg, Elin; Mathé, Aleksander A; Olson, Lars; Werme, Martin

2007-09-10

Natural behaviors such as eating, drinking, reproduction and exercise activate brain reward pathways and consequently the individual engages in these behaviors to receive the reward. However, drugs of abuse are even more potent in activating the reward pathways. Rewarding behaviors and addictive drugs also affect other parts of the brain not directly involved in the mediation of reward. For instance, running increases neurogenesis in hippocampus and is beneficial as an antidepressant in a genetic animal model of depression and in depressed humans. Here we discuss and compare neurochemical and functional changes in the brain after addictive drugs and exercise with a focus on brain reward pathways and hippocampus.

Running is rewarding and antidepressive

PubMed Central

Brené, Stefan; Bjørnebekk, Astrid; Åberg, Elin; Mathé, Aleksander A; Olson, Lars; Werme, Martin

2007-01-01

Natural behaviors such as eating, drinking, reproduction and exercise activate brain reward pathways and consequently the individual engages in these behaviors to receive the reward. However, drugs of abuse are even more potent to activate the reward pathways. Rewarding behaviors and addictive drugs also affect other parts of the brain not directly involved in the mediation of reward. For instance, running increases neurogenesis in hippocampus and is beneficial as an antidepressant in a genetic animal model of depression and in depressed humans. Here we discuss and compare neurochemical and functional changes in the brain after addictive drugs and exercise with a focus on brain reward pathways and hippocampus. PMID:17561174

Regulation of brain reward by the endocannabinoid system: a critical review of behavioral studies in animals.

PubMed

Vlachou, S; Panagis, G

2014-01-01

The endocannabinoid system has been implicated in the regulation of a variety of physiological processes, including a crucial involvement in brain reward systems and the regulation of motivational processes. Behavioral studies have shown that cannabinoid reward may involve the same brain circuits and similar brain mechanisms with other drugs of abuse, such as nicotine, cocaine, alcohol and heroin, as well as natural rewards, such as food, water and sucrose, although the conditions under which cannabinoids exert their rewarding effects may be more limited. The purpose of the present review is to briefly describe and evaluate the behavioral and pharmacological research concerning the major components of the endocannabinoid system and reward processes. Special emphasis is placed on data received from four procedures used to test the effects of the endocannabinoid system on brain reward in animals; namely, the intracranial self-stimulation paradigm, the self-administration procedure, the conditioned place preference procedure and the drug-discrimination procedure. The effects of cannabinoid 1 (CB1) and cannabinoid 2 (CB2) receptor agonists, antagonists and endocannabinoid modulators in these procedures are examined. Further, the involvement of CB1 and CB2 receptors, as well the fatty acid amid hydrolase (FAAH) enzyme in reward processes is investigated through presentation of respective genetic ablation studies in mice. We suggest that the endocannabinoid system plays a major role in modulating motivation and reward processes. Further research will provide us with a better understanding of these processes and, thus, could lead to the development of potential therapeutic compounds for the treatment of reward-related disorders.

Enriched encoding: reward motivation organizes cortical networks for hippocampal detection of unexpected events.

PubMed

Murty, Vishnu P; Adcock, R Alison

2014-08-01

Learning how to obtain rewards requires learning about their contexts and likely causes. How do long-term memory mechanisms balance the need to represent potential determinants of reward outcomes with the computational burden of an over-inclusive memory? One solution would be to enhance memory for salient events that occur during reward anticipation, because all such events are potential determinants of reward. We tested whether reward motivation enhances encoding of salient events like expectancy violations. During functional magnetic resonance imaging, participants performed a reaction-time task in which goal-irrelevant expectancy violations were encountered during states of high- or low-reward motivation. Motivation amplified hippocampal activation to and declarative memory for expectancy violations. Connectivity of the ventral tegmental area (VTA) with medial prefrontal, ventrolateral prefrontal, and visual cortices preceded and predicted this increase in hippocampal sensitivity. These findings elucidate a novel mechanism whereby reward motivation can enhance hippocampus-dependent memory: anticipatory VTA-cortical-hippocampal interactions. Further, the findings integrate literatures on dopaminergic neuromodulation of prefrontal function and hippocampus-dependent memory. We conclude that during reward motivation, VTA modulation induces distributed neural changes that amplify hippocampal signals and records of expectancy violations to improve predictions-a potentially unique contribution of the hippocampus to reward learning. © The Author 2013. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Disrupted reward circuits is associated with cognitive deficits and depression severity in major depressive disorder.

PubMed

Gong, Liang; Yin, Yingying; He, Cancan; Ye, Qing; Bai, Feng; Yuan, Yonggui; Zhang, Haisan; Lv, Luxian; Zhang, Hongxing; Xie, Chunming; Zhang, Zhijun

2017-01-01

Neuroimaging studies have demonstrated that major depressive disorder (MDD) patients show blunted activity responses to reward-related tasks. However, whether abnormal reward circuits affect cognition and depression in MDD patients remains unclear. Seventy-five drug-naive MDD patients and 42 cognitively normal (CN) subjects underwent a resting-state functional magnetic resonance imaging scan. The bilateral nucleus accumbens (NAc) were selected as seeds to construct reward circuits across all subjects. A multivariate linear regression analysis was employed to investigate the neural substrates of cognitive function and depression severity on the reward circuits in MDD patients. The common pathway underlying cognitive deficits and depression was identified with conjunction analysis. Compared with CN subjects, MDD patients showed decreased reward network connectivity that was primarily located in the prefrontal-striatal regions. Importantly, distinct and common neural pathways underlying cognition and depression were identified, implying the independent and synergistic effects of cognitive deficits and depression severity on reward circuits. This study demonstrated that disrupted topological organization within reward circuits was significantly associated with cognitive deficits and depression severity in MDD patients. These findings suggest that in addition to antidepressant treatment, normalized reward circuits should be a focus and a target for improving depression and cognitive deficits in MDD patients. Copyright © 2016 Elsevier Ltd. All rights reserved.

A computational substrate for incentive salience.

PubMed

McClure, Samuel M; Daw, Nathaniel D; Montague, P Read

2003-08-01

Theories of dopamine function are at a crossroads. Computational models derived from single-unit recordings capture changes in dopaminergic neuron firing rate as a prediction error signal. These models employ the prediction error signal in two roles: learning to predict future rewarding events and biasing action choice. Conversely, pharmacological inhibition or lesion of dopaminergic neuron function diminishes the ability of an animal to motivate behaviors directed at acquiring rewards. These lesion experiments have raised the possibility that dopamine release encodes a measure of the incentive value of a contemplated behavioral act. The most complete psychological idea that captures this notion frames the dopamine signal as carrying 'incentive salience'. On the surface, these two competing accounts of dopamine function seem incommensurate. To the contrary, we demonstrate that both of these functions can be captured in a single computational model of the involvement of dopamine in reward prediction for the purpose of reward seeking.

Missing motoric manipulations: rethinking the imaging of the ventral striatum and dopamine in human reward.

PubMed

Kareken, David A

2018-01-26

Human neuroimaging studies of natural rewards and drugs of abuse frequently assay the brain's response to stimuli that, through Pavlovian learning, have come to be associated with a drug's rewarding properties. This might be characterized as a 'sensorial' view of the brain's reward system, insofar as the paradigms are designed to elicit responses to a reward's (drug's) sight, aroma, or flavor. A different field of research nevertheless suggests that the mesolimbic dopamine system may also be critically involved in the motor behaviors provoked by such stimuli. This brief review and commentary surveys some of the preclinical data supporting this more "efferent" (motoric) view of the brain's reward system, and discusses what such findings might mean for how human brain imaging studies of natural rewards and drugs of abuse are designed.

Neuronal Reward and Decision Signals: From Theories to Data

PubMed Central

Schultz, Wolfram

2015-01-01

Rewards are crucial objects that induce learning, approach behavior, choices, and emotions. Whereas emotions are difficult to investigate in animals, the learning function is mediated by neuronal reward prediction error signals which implement basic constructs of reinforcement learning theory. These signals are found in dopamine neurons, which emit a global reward signal to striatum and frontal cortex, and in specific neurons in striatum, amygdala, and frontal cortex projecting to select neuronal populations. The approach and choice functions involve subjective value, which is objectively assessed by behavioral choices eliciting internal, subjective reward preferences. Utility is the formal mathematical characterization of subjective value and a prime decision variable in economic choice theory. It is coded as utility prediction error by phasic dopamine responses. Utility can incorporate various influences, including risk, delay, effort, and social interaction. Appropriate for formal decision mechanisms, rewards are coded as object value, action value, difference value, and chosen value by specific neurons. Although all reward, reinforcement, and decision variables are theoretical constructs, their neuronal signals constitute measurable physical implementations and as such confirm the validity of these concepts. The neuronal reward signals provide guidance for behavior while constraining the free will to act. PMID:26109341

Fearfulness moderates the link between childhood social withdrawal and adolescent reward response

PubMed Central

Shaw, Daniel S.; Forbes, Erika E.

2015-01-01

Withdrawal from peers during childhood may reflect disruptions in reward functioning that heighten vulnerability to affective disorders during adolescence. The association between socially withdrawn behavior and reward functioning may depend on traits that influence this withdrawal, such as fearfulness or unsociability. In a study of 129 boys, we evaluated how boys’ fearfulness and sociability at age 5 and social withdrawal at school at ages 6 to 10 and during a summer camp at age 9/10 were associated with their neural response to reward at age 20. Greater social withdrawal during childhood was associated with heightened striatal and mPFC activation when anticipating rewards at age 20. Fearfulness moderated this effect to indicate that social withdrawal was associated with heightened reward-related response in the striatum for boys high on fearfulness. Altered striatal response associated with social withdrawal and fearfulness predicted greater likelihood to have a lifetime history of depression and social phobia at age 20. These findings add greater specificity to previous findings that children high in traits related to fear of novelty show altered reward responses, by identifying fearfulness (but not low levels of sociability) as a potential underlying mechanism that contributes to reward alterations in withdrawn children. PMID:25193948

Hedonic and incentive signals for body weight control.

PubMed

Egecioglu, Emil; Skibicka, Karolina P; Hansson, Caroline; Alvarez-Crespo, Mayte; Friberg, P Anders; Jerlhag, Elisabet; Engel, Jörgen A; Dickson, Suzanne L

2011-09-01

Here we review the emerging neurobiological understanding of the role of the brain's reward system in the regulation of body weight in health and in disease. Common obesity is characterized by the over-consumption of palatable/rewarding foods, reflecting an imbalance in the relative importance of hedonic versus homeostatic signals. The popular 'incentive salience theory' of food reward recognises not only a hedonic/pleasure component ('liking') but also an incentive motivation component ('wanting' or 'reward-seeking'). Central to the neurobiology of the reward mechanism is the mesoaccumbal dopamine system that confers incentive motivation not only for natural rewards such as food but also by artificial rewards (eg. addictive drugs). Indeed, this mesoaccumbal dopamine system receives and integrates information about the incentive (rewarding) value of foods with information about metabolic status. Problematic over-eating likely reflects a changing balance in the control exerted by hypothalamic versus reward circuits and/or it could reflect an allostatic shift in the hedonic set point for food reward. Certainly, for obesity to prevail, metabolic satiety signals such as leptin and insulin fail to regain control of appetitive brain networks, including those involved in food reward. On the other hand, metabolic control could reflect increased signalling by the stomach-derived orexigenic hormone, ghrelin. We have shown that ghrelin activates the mesoaccumbal dopamine system and that central ghrelin signalling is required for reward from both chemical drugs (eg alcohol) and also from palatable food. Future therapies for problematic over-eating and obesity may include drugs that interfere with incentive motivation, such as ghrelin antagonists.

Favorite brands as cultural objects modulate reward circuit.

PubMed

Schaefer, Michael; Rotte, Michael

2007-01-22

On the basis of the hypothesis that brands may function as reward stimuli, we investigated brain responses to favorite brands. Participants viewed brand logos while we measured cortical activity with functional magnetic resonance imaging. Results revealed activity in the striatum for favorite brands that positively correlated with sports and luxury characteristics, but negatively with attributions to a brand of rational choice. Reduced activation of a single region in the dorsolateral prefrontal cortex was demonstrated when viewing the most beloved brand, possibly suggesting reduced strategic reasoning on the basis of affect. The results propose that brands that have been associated with appetitive stimuli owing to marketing efforts engage brain networks similar to those engaged by artificially associated reward stimuli. Moreover, social stimuli may function as secondary inducers of reward mechanisms.

Neuropharmacological mechanisms of drug reward: beyond dopamine in the nucleus accumbens.

PubMed

Bardo, M T

1998-01-01

Multiple lines of research have implicated the mesolimbic dopamine system in drug reward measured by either the drug self-administration or conditioned place preference paradigm. The present review summarizes recent work that examines the neuropharmacological mechanisms by which drugs impinge on this dopaminergic neural circuitry, as well as other systems that provide input and output circuits to the mesolimbic dopamine system. Studies examining the effect of selective agonist and antagonist drugs administered systemically have indicated that multiple neurotransmitters are involved, including dopamine, serotonin, acetylcholine, glutamate, GABA, and various peptides. Direct microinjection studies have also provided crucial evidence indicating that, in addition to the mesolimbic dopamine system, other structures play a role in drug reward, including the ventral pallidum, amygdala, hippocampus, hypothalamus, and pedunculopontine tegmental nucleus. GABAergic circuitry descending from the nucleus accumbens to the pedunculopontine tegmental nucleus via the ventral pallidum appears to be especially important in directing the behavioral sequelae associated with reward produced by various drugs of abuse. However, activation of the reward circuitry is achieved differently for various drugs of abuse. With amphetamine and cocaine, initiation of reward is controlled within the nucleus accumbens and prefrontal cortex, respectively. With opiates, initiation of reward involves the ventral tegmental area, nucleus accumbens, hippocampus, and hypothalamus. It is not clear presently if these multiple anatomical structures mediate opiate reward by converging on a single output system or multiple output systems.

Discrete neurochemical coding of distinguishable motivational processes: insights from nucleus accumbens control of feeding.

PubMed

Baldo, Brian A; Kelley, Ann E

2007-04-01

The idea that nucleus accumbens (Acb) dopamine transmission contributes to the neural mediation of reward, at least in a general sense, has achieved wide acceptance. Nevertheless, debate remains over the precise nature of dopamine's role in reward and even over the nature of reward itself. In the present article, evidence is reviewed from studies of food intake, feeding microstructure, instrumental responding for food reinforcement, and dopamine efflux associated with feeding, which suggests that reward processing in the Acb is best understood as an interaction among distinct processes coded by discrete neurotransmitter systems. In agreement with several theories of Acb dopamine function, it is proposed here that allocation of motor effort in seeking food or food-associated conditioned stimuli can be dissociated from computations relevant to the hedonic evaluation of food during the consummatory act. The former appears to depend upon Acb dopamine transmission and the latter upon striatal opioid peptide release. Moreover, dopamine transmission may play a role in 'stamping in' associations between motor acts and goal attainment and perhaps also neural representations corresponding to rewarding outcomes. Finally, evidence is reviewed that amino acid transmission specifically in the Acb shell acts as a central 'circuit breaker' to flexibly enable or terminate the consummatory act, via descending connections to hypothalamic feeding control systems. The heuristic framework outlined above may help explain why dopamine-compromising manipulations that strongly diminish instrumental goal-seeking behaviors leave consummatory activity relatively unaffected.

A hypothesis on the biological origins and social evolution of music and dance

PubMed Central

Wang, Tianyan

2015-01-01

The origins of music and musical emotions is still an enigma, here I propose a comprehensive hypothesis on the origins and evolution of music, dance, and speech from a biological and sociological perspective. I suggest that every pitch interval between neighboring notes in music represents corresponding movement pattern through interpreting the Doppler effect of sound, which not only provides a possible explanation for the transposition invariance of music, but also integrates music and dance into a common form—rhythmic movements. Accordingly, investigating the origins of music poses the question: why do humans appreciate rhythmic movements? I suggest that human appreciation of rhythmic movements and rhythmic events developed from the natural selection of organisms adapting to the internal and external rhythmic environments. The perception and production of, as well as synchronization with external and internal rhythms are so vital for an organism's survival and reproduction, that animals have a rhythm-related reward and emotion (RRRE) system. The RRRE system enables the appreciation of rhythmic movements and events, and is integral to the origination of music, dance and speech. The first type of rewards and emotions (rhythm-related rewards and emotions, RRREs) are evoked by music and dance, and have biological and social functions, which in turn, promote the evolution of music, dance and speech. These functions also evoke a second type of rewards and emotions, which I name society-related rewards and emotions (SRREs). The neural circuits of RRREs and SRREs develop in species formation and personal growth, with congenital and acquired characteristics, respectively, namely music is the combination of nature and culture. This hypothesis provides probable selection pressures and outlines the evolution of music, dance, and speech. The links between the Doppler effect and the RRREs and SRREs can be empirically tested, making the current hypothesis scientifically concrete. PMID:25741232

Reward contingencies and the recalibration of task monitoring and reward systems: a high-density electrical mapping study.

PubMed

Morie, K P; De Sanctis, P; Foxe, J J

2014-07-25

Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task-monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward-seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density electroencephalography (EEG) recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task-preparatory and task-monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task-preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task-monitoring processes are clearly dissociable, but interact across very fast timescales to update reward predictions as information about task success or failure is accrued. Careful delineation of these processes will be useful in future investigations in clinical groups where such processes are suspected of having gone awry. Copyright © 2014 IBRO. Published by Elsevier Ltd. All rights reserved.

Reward Contingencies and the Recalibration of Task Monitoring and Reward Systems: A high-density electrical mapping study

PubMed Central

Morie, Kristen P.; De Sanctis, Pierfilippo; Foxe, John J.

2014-01-01

Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density EEG recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task preparatory and task monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task monitoring processes are clearly dissociable, but interact across very fast timescales to update reward predictions as information about task success or failure is accrued. Careful delineation of these processes will be useful in future investigations in clinical groups where such processes are suspected of having gone awry. PMID:24836852

Reward abnormalities among women with full and subthreshold bulimia nervosa: a functional magnetic resonance imaging study.

PubMed

Bohon, Cara; Stice, Eric

2011-11-01

To test the hypothesis that women with full and subthreshold bulimia nervosa show abnormal neural activation in response to food intake and anticipated food intake relative to healthy control women. Females with and without full/subthreshold bulimia nervosa recruited from the community (N = 26) underwent functional magnetic resonance imaging (fMRI) during receipt and anticipated receipt of chocolate milkshake and a tasteless control solution. Women with bulimia nervosa showed trends for less activation than healthy controls in the right anterior insula in response to anticipated receipt of chocolate milkshake (vs. tasteless solution) and in the left middle frontal gyrus, right posterior insula, right precentral gyrus, and right mid dorsal insula in response to consumptions of milkshake (vs. tasteless solution). Bulimia nervosa may be related to potential hypofunctioning of the brain reward system, which may lead these individuals to binge eat to compensate for this reward deficit, though the hypo-responsivity might be a result of a history of binge eating highly palatable foods. Copyright © 2010 Wiley Periodicals, Inc.

Brain reward circuitry beyond the mesolimbic dopamine system: a neurobiological theory.

PubMed

Ikemoto, Satoshi

2010-11-01

Reductionist attempts to dissect complex mechanisms into simpler elements are necessary, but not sufficient for understanding how biological properties like reward emerge out of neuronal activity. Recent studies on intracranial self-administration of neurochemicals (drugs) found that rats learn to self-administer various drugs into the mesolimbic dopamine structures-the posterior ventral tegmental area, medial shell nucleus accumbens and medial olfactory tubercle. In addition, studies found roles of non-dopaminergic mechanisms of the supramammillary, rostromedial tegmental and midbrain raphe nuclei in reward. To explain intracranial self-administration and related effects of various drug manipulations, I outlined a neurobiological theory claiming that there is an intrinsic central process that coordinates various selective functions (including perceptual, visceral, and reinforcement processes) into a global function of approach. Further, this coordinating process for approach arises from interactions between brain structures including those structures mentioned above and their closely linked regions: the medial prefrontal cortex, septal area, ventral pallidum, bed nucleus of stria terminalis, preoptic area, lateral hypothalamic areas, lateral habenula, periaqueductal gray, laterodorsal tegmental nucleus and parabrachical area. Published by Elsevier Ltd.

The influence of smoking on reward responsiveness and cognitive functions: a natural experiment.

PubMed

al-Adawi, S; Powell, J

1997-12-01

To investigate the effects of (a) nicotine abstinence and (b) cigarette smoking after abstinence, on reward responsiveness and cognitive functions which are putatively dependent on activity in the dopaminergic system implicated in smoking. During Ramadhan, Muslim smokers elected to abstain from smoking either for the whole month (RAMQUIT) or during daylight hours (DAYQUIT). These groups, and non-smokers (NOSMOKE), were assessed on two occasions 6 hours apart (TEST1 and TEST2). DAYQUIT participants had abstained for 6 hours at TEST1 and smoked a single cigarette immediately prior to TEST2. RAMQUIT participants had abstained for at least 10 days prior to TEST1 and remained abstinent at TEST2. NOSMOKE and RAMQUIT participants are a small snack prior to TEST2 to control for non-specific consummatory effects. TEST1 was conducted at the mosque and TEST2 in participants' homes. All were male; mean age was 26.7 years. Modal cigarette consumption prior to Ramadhan by both the 13 DAYQUIT and the 11 RAMQUIT smokers was 21-30 per day. DAYQUIT subjects rated themselves as more dependent. The Card Arranging Reward Responsivity Objective Test (CARROT), testing behavioural responsiveness to small financial incentive; digit span, measuring attention; verbal fluency, indexing frontal lobe function; and the two-choice guessing test (2CGT; at TEST1 only), measuring response stereotypy. At TEST1, compared with non-smokers, both smoking groups showed greater stereotypy (2CG) and lower reward responsiveness (CARROT). DAYQUIT participants improved on all measures after smoking a single cigarette. No marked changes were seen in the other groups. These data suggest that (i) abstaining smokers have impaired dopaminergic function and (ii) nicotine consumption may boost their dopaminergic activity.

Human-robot skills transfer interfaces for a flexible surgical robot.

PubMed

Calinon, Sylvain; Bruno, Danilo; Malekzadeh, Milad S; Nanayakkara, Thrishantha; Caldwell, Darwin G

2014-09-01

In minimally invasive surgery, tools go through narrow openings and manipulate soft organs to perform surgical tasks. There are limitations in current robot-assisted surgical systems due to the rigidity of robot tools. The aim of the STIFF-FLOP European project is to develop a soft robotic arm to perform surgical tasks. The flexibility of the robot allows the surgeon to move within organs to reach remote areas inside the body and perform challenging procedures in laparoscopy. This article addresses the problem of designing learning interfaces enabling the transfer of skills from human demonstration. Robot programming by demonstration encompasses a wide range of learning strategies, from simple mimicking of the demonstrator's actions to the higher level imitation of the underlying intent extracted from the demonstrations. By focusing on this last form, we study the problem of extracting an objective function explaining the demonstrations from an over-specified set of candidate reward functions, and using this information for self-refinement of the skill. In contrast to inverse reinforcement learning strategies that attempt to explain the observations with reward functions defined for the entire task (or a set of pre-defined reward profiles active for different parts of the task), the proposed approach is based on context-dependent reward-weighted learning, where the robot can learn the relevance of candidate objective functions with respect to the current phase of the task or encountered situation. The robot then exploits this information for skills refinement in the policy parameters space. The proposed approach is tested in simulation with a cutting task performed by the STIFF-FLOP flexible robot, using kinesthetic demonstrations from a Barrett WAM manipulator. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Motivation and timing: Clues for modeling the reward system

PubMed Central

Galtress, Tiffany; Marshall, Andrew T.; Kirkpatrick, Kimberly

2012-01-01

There is growing evidence that a change in reward magnitude or value alters interval timing, indicating that motivation and timing are not independent processes as was previously believed. The present paper reviews several recent studies, as well as presenting some new evidence with further manipulations of reward value during training vs. testing on a peak procedure. The combined results cannot be accounted for by any of the current psychological timing theories. However, in examining the neural circuitry of the reward system, it is not surprising that motivation has an impact on timing because the motivation/valuation system directly interfaces with the timing system. A new approach is proposed for the development of the next generation of timing models, which utilizes knowledge of the neuroanatomy and neurophysiology of the reward system to guide the development of a neurocomputational model of the reward system. The initial foundation along with heuristics for proceeding with developing such a model is unveiled in an attempt to stimulate new theoretical approaches in the field. PMID:22421220

Genetic Addiction Risk Score (GARS): molecular neurogenetic evidence for predisposition to Reward Deficiency Syndrome (RDS).

PubMed

Blum, Kenneth; Oscar-Berman, Marlene; Demetrovics, Zsolt; Barh, Debmalya; Gold, Mark S

2014-12-01

We have published extensively on the neurogenetics of brain reward systems with reference to the genes related to dopaminergic function in particular. In 1996, we coined "Reward Deficiency Syndrome" (RDS), to portray behaviors found to have gene-based association with hypodopaminergic function. RDS as a useful concept has been embraced in many subsequent studies, to increase our understanding of Substance Use Disorder (SUD), addictions, and other obsessive, compulsive, and impulsive behaviors. Interestingly, albeit others, in one published study, we were able to describe lifetime RDS behaviors in a recovering addict (17 years sober) blindly by assessing resultant Genetic Addiction Risk Score (GARS™) data only. We hypothesize that genetic testing at an early age may be an effective preventive strategy to reduce or eliminate pathological substance and behavioral seeking activity. Here, we consider a select number of genes, their polymorphisms, and associated risks for RDS whereby, utilizing GWAS, there is evidence for convergence to reward candidate genes. The evidence presented serves as a plausible brain-print providing relevant genetic information that will reinforce targeted therapies, to improve recovery and prevent relapse on an individualized basis. The primary driver of RDS is a hypodopaminergic trait (genes) as well as epigenetic states (methylation and deacetylation on chromatin structure). We now have entered a new era in addiction medicine that embraces the neuroscience of addiction and RDS as a pathological condition in brain reward circuitry that calls for appropriate evidence-based therapy and early genetic diagnosis and that requires further intensive investigation.

Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology.

PubMed

Schultz, Wolfram

2004-04-01

Neurons in a small number of brain structures detect rewards and reward-predicting stimuli and are active during the expectation of predictable food and liquid rewards. These neurons code the reward information according to basic terms of various behavioural theories that seek to explain reward-directed learning, approach behaviour and decision-making. The involved brain structures include groups of dopamine neurons, the striatum including the nucleus accumbens, the orbitofrontal cortex and the amygdala. The reward information is fed to brain structures involved in decision-making and organisation of behaviour, such as the dorsolateral prefrontal cortex and possibly the parietal cortex. The neural coding of basic reward terms derived from formal theories puts the neurophysiological investigation of reward mechanisms on firm conceptual grounds and provides neural correlates for the function of rewards in learning, approach behaviour and decision-making.

Oxytocin enhances brain reward system responses in men viewing the face of their female partner.

PubMed

Scheele, Dirk; Wille, Andrea; Kendrick, Keith M; Stoffel-Wagner, Birgit; Becker, Benjamin; Güntürkün, Onur; Maier, Wolfgang; Hurlemann, René

2013-12-10

The biological mechanisms underlying long-term partner bonds in humans are unclear. The evolutionarily conserved neuropeptide oxytocin (OXT) is associated with the formation of partner bonds in some species via interactions with brain dopamine reward systems. However, whether it plays a similar role in humans has as yet not been established. Here, we report the results of a discovery and a replication study, each involving a double-blind, placebo-controlled, within-subject, pharmaco-functional MRI experiment with 20 heterosexual pair-bonded male volunteers. In both experiments, intranasal OXT treatment (24 IU) made subjects perceive their female partner's face as more attractive compared with unfamiliar women but had no effect on the attractiveness of other familiar women. This enhanced positive partner bias was paralleled by an increased response to partner stimuli compared with unfamiliar women in brain reward regions including the ventral tegmental area and the nucleus accumbens (NAcc). In the left NAcc, OXT even augmented the neural response to the partner compared with a familiar woman, indicating that this finding is partner-bond specific rather than due to familiarity. Taken together, our results suggest that OXT could contribute to romantic bonds in men by enhancing their partner's attractiveness and reward value compared with other women.

Oxytocin enhances brain reward system responses in men viewing the face of their female partner

PubMed Central

Scheele, Dirk; Wille, Andrea; Kendrick, Keith M.; Stoffel-Wagner, Birgit; Becker, Benjamin; Güntürkün, Onur; Maier, Wolfgang; Hurlemann, René

2013-01-01

The biological mechanisms underlying long-term partner bonds in humans are unclear. The evolutionarily conserved neuropeptide oxytocin (OXT) is associated with the formation of partner bonds in some species via interactions with brain dopamine reward systems. However, whether it plays a similar role in humans has as yet not been established. Here, we report the results of a discovery and a replication study, each involving a double-blind, placebo-controlled, within-subject, pharmaco-functional MRI experiment with 20 heterosexual pair-bonded male volunteers. In both experiments, intranasal OXT treatment (24 IU) made subjects perceive their female partner's face as more attractive compared with unfamiliar women but had no effect on the attractiveness of other familiar women. This enhanced positive partner bias was paralleled by an increased response to partner stimuli compared with unfamiliar women in brain reward regions including the ventral tegmental area and the nucleus accumbens (NAcc). In the left NAcc, OXT even augmented the neural response to the partner compared with a familiar woman, indicating that this finding is partner-bond specific rather than due to familiarity. Taken together, our results suggest that OXT could contribute to romantic bonds in men by enhancing their partner's attractiveness and reward value compared with other women. PMID:24277856

Prediction-error in the context of real social relationships modulates reward system activity.

PubMed

Poore, Joshua C; Pfeifer, Jennifer H; Berkman, Elliot T; Inagaki, Tristen K; Welborn, Benjamin L; Lieberman, Matthew D

2012-01-01

The human reward system is sensitive to both social (e.g., validation) and non-social rewards (e.g., money) and is likely integral for relationship development and reputation building. However, data is sparse on the question of whether implicit social reward processing meaningfully contributes to explicit social representations such as trust and attachment security in pre-existing relationships. This event-related fMRI experiment examined reward system prediction-error activity in response to a potent social reward-social validation-and this activity's relation to both attachment security and trust in the context of real romantic relationships. During the experiment, participants' expectations for their romantic partners' positive regard of them were confirmed (validated) or violated, in either positive or negative directions. Primary analyses were conducted using predefined regions of interest, the locations of which were taken from previously published research. Results indicate that activity for mid-brain and striatal reward system regions of interest was modulated by social reward expectation violation in ways consistent with prior research on reward prediction-error. Additionally, activity in the striatum during viewing of disconfirmatory information was associated with both increases in post-scan reports of attachment anxiety and decreases in post-scan trust, a finding that follows directly from representational models of attachment and trust.

Neural Networks Involved in Adolescent Reward Processing: An Activation Likelihood Estimation Meta-Analysis of Functional Neuroimaging Studies

PubMed Central

Silverman, Merav H.; Jedd, Kelly; Luciana, Monica

2015-01-01

Behavioral responses to, and the neural processing of, rewards change dramatically during adolescence and may contribute to observed increases in risk-taking during this developmental period. Functional MRI (fMRI) studies suggest differences between adolescents and adults in neural activation during reward processing, but findings are contradictory, and effects have been found in non-predicted directions. The current study uses an activation likelihood estimation (ALE) approach for quantitative meta-analysis of functional neuroimaging studies to: 1) confirm the network of brain regions involved in adolescents’ reward processing, 2) identify regions involved in specific stages (anticipation, outcome) and valence (positive, negative) of reward processing, and 3) identify differences in activation likelihood between adolescent and adult reward-related brain activation. Results reveal a subcortical network of brain regions involved in adolescent reward processing similar to that found in adults with major hubs including the ventral and dorsal striatum, insula, and posterior cingulate cortex (PCC). Contrast analyses find that adolescents exhibit greater likelihood of activation in the insula while processing anticipation relative to outcome and greater likelihood of activation in the putamen and amygdala during outcome relative to anticipation. While processing positive compared to negative valence, adolescents show increased likelihood for activation in the posterior cingulate cortex (PCC) and ventral striatum. Contrasting adolescent reward processing with the existing ALE of adult reward processing (Liu et al., 2011) reveals increased likelihood for activation in limbic, frontolimbic, and striatal regions in adolescents compared with adults. Unlike adolescents, adults also activate executive control regions of the frontal and parietal lobes. These findings support hypothesized elevations in motivated activity during adolescence. PMID:26254587

Differential effects of white noise in cognitive and perceptual tasks

PubMed Central

Herweg, Nora A.; Bunzeck, Nico

2015-01-01

Beneficial effects of noise on higher cognition have recently attracted attention. Hypothesizing an involvement of the mesolimbic dopamine system and its functional interactions with cortical areas, the current study aimed to demonstrate a facilitation of dopamine-dependent attentional and mnemonic functions by externally applying white noise in five behavioral experiments including a total sample of 167 healthy human subjects. During working memory, acoustic white noise impaired accuracy when presented during the maintenance period (Experiments 1–3). In a reward based long-term memory task, white noise accelerated perceptual judgments for scene images during encoding but left subsequent recognition memory unaffected (Experiment 4). In a modified Posner task (Experiment 5), the benefit due to white noise in attentional orienting correlated weakly with reward dependence, a personality trait that has been associated with the dopaminergic system. These results suggest that white noise has no general effect on cognitive functions. Instead, they indicate differential effects on perception and cognition depending on a variety of factors such as task demands and timing of white noise presentation. PMID:26579024

Reward circuit connectivity relates to delay discounting in children with attention-deficit/hyperactivity disorder

PubMed Central

Costa Dias, Taciana G.; Wilson, Vanessa B.; Bathula, Deepti R.; Iyer, Swathi P.; Mills, Kathryn L.; Thurlow, Bria L.; Stevens, Corinne A.; Musser, Erica D.; Carpenter, Samuel D.; Grayson, David S.; Mitchell, Suzanne H.; Nigg, Joel T.; Fair, Damien A.

2012-01-01

Attention-deficit/hyperactivity disorder (ADHD) is a prevalent psychiatric disorder that has poor long-term outcomes and remains a major public health concern. Recent theories have proposed that ADHD arises from alterations in multiple neural pathways. Alterations in reward circuits are hypothesized as one core dysfunction, leading to altered processing of anticipated rewards. The nucleus accumbens (NAcc) is particularly important for reward processes; task-based fMRI studies have found atypical activation of this region while the participants performed a reward task. Understanding how reward circuits are involved with ADHD may be further enhanced by considering how the NAcc interacts with other brain regions. Here we used the technique of resting-state functional connectivity MRI (rs-fcMRI) to examine the alterations in the NAcc interactions and how they relate to impulsive decision making in ADHD. Using rs-fcMRI, this study: examined differences in functional connectivity of the NAcc between children with ADHD and control children; correlated the functional connectivity of NAcc with impulsivity, as measured by a delay discounting task; and combined these two initial segments to identify the atypical NAcc connections that were associated with impulsive decision making in ADHD. We found that functional connectivity of NAcc was atypical in children with ADHD and the ADHD-related increased connectivity between NAcc and the prefrontal cortex was associated with greater impulsivity (steeper delayed-reward discounting). These findings are consistent with the hypothesis that atypical signaling of the NAcc to the prefrontal cortex in ADHD may lead to excessive approach and failure in estimating future consequences; thus, leading to impulsive behavior. PMID:23206930

Physical and cognitive effort discounting across different reward magnitudes: Tests of discounting models

PubMed Central

Ostaszewski, Paweł

2017-01-01

The effort required to obtain a rewarding outcome is an important factor in decision-making. Describing the reward devaluation by increasing effort intensity is substantial to understanding human preferences, because every action and choice that we make is in itself effortful. To investigate how reward valuation is affected by physical and cognitive effort, we compared mathematical discounting functions derived from research on discounting. Seven discounting models were tested across three different reward magnitudes. To test the models, data were collected from a total of 114 participants recruited from the general population. For one-parameter models (hyperbolic, exponential, and parabolic), the data were explained best by the exponential model as given by a percentage of explained variance. However, after introducing an additional parameter, data obtained in the cognitive and physical effort conditions were best described by the power function model. Further analysis, using the second order Akaike and Bayesian Information Criteria, which account for model complexity, allowed us to identify the best model among all tested. We found that the power function best described the data, which corresponds to conventional analyses based on the R2 measure. This supports the conclusion that the function best describing reward devaluation by physical and cognitive effort is a concave one and is different from those that describe delay or probability discounting. In addition, consistent magnitude effects were observed that correspond to those in delay discounting research. PMID:28759631

Heightened activity in social reward networks is associated with adolescents' risky sexual behaviors.

PubMed

Eckstrand, Kristen L; Choukas-Bradley, Sophia; Mohanty, Arpita; Cross, Marissa; Allen, Nicholas B; Silk, Jennifer S; Jones, Neil P; Forbes, Erika E

2017-10-01

Adolescent sexual risk behavior can lead to serious health consequences, yet few investigations have addressed its neurodevelopmental mechanisms. Social neurocircuitry is postulated to underlie the development of risky sexual behavior, and response to social reward may be especially relevant. Typically developing adolescents (N=47; 18M, 29F; 16.3±1.4years; 42.5% sexual intercourse experience) completed a social reward fMRI task and reported their sexual risk behaviors (e.g., lifetime sexual partners) on the Youth Risk Behavior Survey (YRBS). Neural response and functional connectivity to social reward were compared for adolescents with higher- and lower-risk sexual behavior. Adolescents with higher-risk sexual behaviors demonstrated increased activation in the right precuneus and the right temporoparietal junction during receipt of social reward. Adolescents with higher-risk sexual behaviors also demonstrated greater functional connectivity between the precuneus and the temporoparietal junction bilaterally, dorsal medial prefrontal cortex, and left anterior insula/ventrolateral prefrontal cortex. The greater activation and functional connectivity in self-referential, social reward, and affective processing regions among higher sexual risk adolescents underscores the importance of social influence underlying sexual risk behaviors. Furthermore, results suggest an orientation towards and sensitivity to social rewards among youth engaging in higher-risk sexual behavior, perhaps as a consequence of or vulnerability to such behavior. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Neural Processing of Calories in Brain Reward Areas Can be Modulated by Reward Sensitivity

PubMed Central

van Rijn, Inge; Griffioen-Roose, Sanne; de Graaf, Cees; Smeets, Paul A. M.

2016-01-01

A food's reward value is dependent on its caloric content. Furthermore, a food's acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity), however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015), in which participants (n = 30) tasted simple solutions of a non-caloric sweetener with or without a non-sweet carbohydrate (maltodextrin) during hunger and satiety. Secondly, we expanded these analyses to regular drinks by assessing the same relationship in data from a study in which soft drinks sweetened with either sucrose or a non-caloric sweetener were administered during hunger (n = 18) (Griffioen-Roose et al., 2013). First, taste activation by the non-caloric solution/soft drink was subtracted from that by the caloric solution/soft drink to eliminate sweetness effects and retain activation induced by calories. Subsequently, this difference in taste activation was correlated with reward sensitivity as measured with the BAS drive subscale of the Behavioral Activation System (BAS) questionnaire. When participants were hungry and tasted calories from the simple solution, brain activation in the right ventral striatum (caudate), right amygdala and anterior cingulate cortex (bilaterally) correlated negatively with BAS drive scores. In contrast, when participants were satiated, taste responses correlated positively with BAS drive scores in the left caudate. These results were not replicated for soft drinks. Thus, neural responses to oral calories from maltodextrin were modulated by reward sensitivity in reward-related brain areas. This was not the case for sucrose. This may be due to the direct detection of maltodextrin, but not sucrose in the oral cavity. Also, in a familiar beverage, detection of calories per se may be overruled by a conditioned response to its flavor. In conclusion, the brain reward response to calories from a long chain starch sugar (maltodextrin) varies with trait reward sensitivity. The absence of this effect in a familiar beverage warrants further research into its relevance for real life ingestive behavior. PMID:26834598

An Analysis of the Civilian Employee Reward System in use at Naval Air Warfare Center, Patuxent River, Maryland

DTIC Science & Technology

1999-12-01

relative deprivation. If A and B have different rewards, distributive justice may still exist as long as person A feels that their level of investment to...example could be rewarding an assembly line for number of units produced (outcome) versus the degree of quality control (process). Even if quotas are...between reward preferences of one job type versus another. Perhaps most relevant to this thesis are the studies which have examined reward system

Online Bahavior Aquisition of an Agent based on Coaching as Learning Assistance

NASA Astrophysics Data System (ADS)

Hirokawa, Masakazu; Suzuki, Kenji

This paper describes a novel methodology, namely ``Coaching'', which allows humans to give a subjective evaluation to an agent in an iterative manner. This is an interactive learning method to improve the reinforcement learning by modifying a reward function dynamically according to given evaluations by a trainer and the learning situation of the agent. We demonstrate that the agent can learn different reward functions by given instructions such as ``good or bad'' by human's observation, and can also obtain a set of behavior based on the learnt reward functions through several experiments.

Impaired Feedback Processing for Symbolic Reward in Individuals with Internet Game Overuse

PubMed Central

Kim, Jinhee; Kim, Hackjin; Kang, Eunjoo

2017-01-01

Reward processing, which plays a critical role in adaptive behavior, is impaired in addiction disorders, which are accompanied by functional abnormalities in brain reward circuits. Internet gaming disorder, like substance addiction, is thought to be associated with impaired reward processing, but little is known about how it affects learning, especially when feedback is conveyed by less-salient motivational events. Here, using both monetary (±500 KRW) and symbolic (Chinese characters “right” or “wrong”) rewards and penalties, we investigated whether behavioral performance and feedback-related neural responses are altered in Internet game overuse (IGO) group. Using functional MRI, brain responses for these two types of reward/penalty feedback were compared between young males with problems of IGO (IGOs, n = 18, mean age = 22.2 ± 2.0 years) and age-matched control subjects (Controls, n = 20, mean age = 21.2 ± 2.1) during a visuomotor association task where associations were learned between English letters and one of four responses. No group difference was found in adjustment of error responses following the penalty or in brain responses to penalty, for either monetary or symbolic penalties. The IGO individuals, however, were more likely to fail to choose the response previously reinforced by symbolic (but not monetary) reward. A whole brain two-way ANOVA analysis for reward revealed reduced activations in the IGO group in the rostral anterior cingulate cortex/ventromedial prefrontal cortex (vmPFC) in response to both reward types, suggesting impaired reward processing. However, the responses to reward in the inferior parietal region and medial orbitofrontal cortex/vmPFC were affected by the types of reward in the IGO group. Unlike the control group, in the IGO group the reward response was reduced only for symbolic reward, suggesting lower attentional and value processing specific to symbolic reward. Furthermore, the more severe the Internet gaming overuse symptoms in the IGO group, the greater the activations of the ventral striatum for monetary relative to symbolic reward. These findings suggest that IGO is associated with bias toward motivationally salient reward, which would lead to poor goal-directed behavior in everyday life. PMID:29051739

Assessing and Rewarding Excellent Academic Teachers for the Benefit of an Organization

ERIC Educational Resources Information Center

Olsson, Thomas; Roxå, Torgny

2013-01-01

In this article we describe and analyse a system for rewarding excellence in university teaching developed at the Faculty of Engineering at Lund University in Sweden. Individual teachers are rewarded for the effort they invest in the support of student learning. However, it is the organization that establishes a reward system and it does so for…

Dopamine modulates reward system activity during subconscious processing of sexual stimuli.

PubMed

Oei, Nicole Y L; Rombouts, Serge Arb; Soeter, Roelof P; van Gerven, Joop M; Both, Stephanie

2012-06-01

Dopaminergic medication influences conscious processing of rewarding stimuli, and is associated with impulsive-compulsive behaviors, such as hypersexuality. Previous studies have shown that subconscious subliminal presentation of sexual stimuli activates brain areas known to be part of the 'reward system'. In this study, it was hypothesized that dopamine modulates activation in key areas of the reward system, such as the nucleus accumbens, during subconscious processing of sexual stimuli. Young healthy males (n=53) were randomly assigned to two experimental groups or a control group, and were administered a dopamine antagonist (haloperidol), a dopamine agonist (levodopa), or placebo. Brain activation was assessed during a backward-masking task with subliminally presented sexual stimuli. Results showed that levodopa significantly enhanced the activation in the nucleus accumbens and dorsal anterior cingulate when subliminal sexual stimuli were shown, whereas haloperidol decreased activations in those areas. Dopamine thus enhances activations in regions thought to regulate 'wanting' in response to potentially rewarding sexual stimuli that are not consciously perceived. This running start of the reward system might explain the pull of rewards in individuals with compulsive reward-seeking behaviors such as hypersexuality and patients who receive dopaminergic medication.

Neural alterations of fronto-striatal circuitry during reward anticipation in euthymic bipolar disorder.

PubMed

Schreiter, S; Spengler, S; Willert, A; Mohnke, S; Herold, D; Erk, S; Romanczuk-Seiferth, N; Quinlivan, E; Hindi-Attar, C; Banzhaf, C; Wackerhagen, C; Romund, L; Garbusow, M; Stamm, T; Heinz, A; Walter, H; Bermpohl, F

2016-11-01

Bipolar disorder (BD), with the hallmark symptoms of elevated and depressed mood, is thought to be characterized by underlying alterations in reward-processing networks. However, to date the neural circuitry underlying abnormal responses during reward processing in BD remains largely unexplored. The aim of this study was to investigate whether euthymic BD is characterized by aberrant ventral striatal (VS) activation patterns and altered connectivity with the prefrontal cortex in response to monetary gains and losses. During functional magnetic resonance imaging 20 euthymic BD patients and 20 age-, gender- and intelligence quotient-matched healthy controls completed a monetary incentive delay paradigm, to examine neural processing of reward and loss anticipation. A priori defined regions of interest (ROIs) included the VS and the anterior prefrontal cortex (aPFC). Psychophysiological interactions (PPIs) between these ROIs were estimated and tested for group differences for reward and loss anticipation separately. BD participants, relative to healthy controls, displayed decreased activation selectively in the left and right VS during anticipation of reward, but not during loss anticipation. PPI analyses showed decreased functional connectivity between the left VS and aPFC in BD patients compared with healthy controls during reward anticipation. This is the first study showing decreased VS activity and aberrant connectivity in the reward-processing circuitry in euthymic, medicated BD patients during reward anticipation. Our findings contrast with research supporting a reward hypersensitivity model of BD, and add to the body of literature suggesting that blunted activation of reward processing circuits may be a vulnerability factor for mood disorders.

Habit formation coincides with shifts in reinforcement representations in the sensorimotor striatum.

PubMed

Smith, Kyle S; Graybiel, Ann M

2016-03-01

Evaluating outcomes of behavior is a central function of the striatum. In circuits engaging the dorsomedial striatum, sensitivity to goal value is accentuated during learning, whereas outcome sensitivity is thought to be minimal in the dorsolateral striatum and its habit-related corticostriatal circuits. However, a distinct population of projection neurons in the dorsolateral striatum exhibits selective sensitivity to rewards. Here, we evaluated the outcome-related signaling in such neurons as rats performed an instructional T-maze task for two rewards. As the rats formed maze-running habits and then changed behavior after reward devaluation, we detected outcome-related spike activity in 116 units out of 1,479 recorded units. During initial training, nearly equal numbers of these units fired preferentially either after rewarded runs or after unrewarded runs, and the majority were responsive at only one of two reward locations. With overtraining, as habits formed, firing in nonrewarded trials almost disappeared, and reward-specific firing declined. Thus error-related signaling was lost, and reward signaling became generalized. Following reward devaluation, in an extinction test, postgoal activity was nearly undetectable, despite accurate running. Strikingly, when rewards were then returned, postgoal activity reappeared and recapitulated the original early response pattern, with nearly equal numbers responding to rewarded and unrewarded runs and to single rewards. These findings demonstrate that outcome evaluation in the dorsolateral striatum is highly plastic and tracks stages of behavioral exploration and exploitation. These signals could be a new target for understanding compulsive behaviors that involve changes to dorsal striatum function. Copyright © 2016 the American Physiological Society.

Waiting to win: elevated striatal and orbitofrontal cortical activity during reward anticipation in euthymic bipolar disorder adults

PubMed Central

Nusslock, Robin; Almeida, Jorge RC; Forbes, Erika E; Versace, Amelia; Frank, Ellen; LaBarbara, Edmund J; Klein, Crystal R; Phillips, Mary L

2012-01-01

Objective Bipolar disorder may be characterized by a hypersensitivity to reward-relevant stimuli, potentially underlying the emotional lability and dysregulation that characterizes the illness. In parallel, research highlights the predominant role of striatal and orbitofrontal cortical (OFC) regions in reward-processing and approach-related affect. We aimed to examine whether bipolar disorder, relative to healthy, participants displayed elevated activity in these regions during reward processing. Methods Twenty-one euthymic bipolar I disorder and 20 healthy control participants with no lifetime history of psychiatric disorder underwent functional magnetic resonance imaging (fMRI) scanning during a card-guessing paradigm designed to examine reward-related brain function to anticipation and receipt of monetary reward and loss. Data were collected using a 3T Siemens Trio scanner. Results Region-of-interest analyses revealed that bipolar disorder participants displayed greater ventral striatal and right-sided orbitofrontal [Brodmann area (BA) 11] activity during anticipation, but not outcome, of monetary reward, relative to healthy controls (p < 0.05, corrected). Wholebrain analyses indicated that bipolar disorder, relative to healthy, participants also displayed elevated left-lateral OFC activity (BA 47) activity during reward anticipation (p < 0.05, corrected). Conclusions Elevated ventral striatal and OFC activity during reward anticipation may represent a neural mechanism for predisposition to expansive mood and hypo/mania in response to reward-relevant cues that characterizes bipolar disorder. Our findings contrast with research reporting blunted activity in the ventral striatum during reward processing in unipolar depressed individuals, relative to healthy controls. Examination of reward-related neural activity in bipolar disorder is a promising research focus to facilitate identification of biological markers of the illness. PMID:22548898

Hormonal contraceptives suppress oxytocin-induced brain reward responses to the partner's face.

PubMed

Scheele, Dirk; Plota, Jessica; Stoffel-Wagner, Birgit; Maier, Wolfgang; Hurlemann, René

2016-05-01

The hypothalamic peptide oxytocin (OXT) has been identified as a key modulator of pair-bonding in men, but its effects in women are still elusive. Moreover, there is substantial evidence that hormonal contraception (HC) influences partner preferences and sexual satisfaction, which constitute core domains of OXT function. We thus hypothesized that OXT effects on partner-related behavioral and neural responses could be significantly altered in women using HC. In this functional magnetic resonance imaging study involving 40 pair-bonded women, 21 of whom were using HC, we investigated whether a 24-IU nasal dose of OXT would modulate brain reward responses evoked by the romantic partner's face relative to the faces of familiar and unfamiliar people. Treatment with OXT increased the perceived attractiveness of the partner relative to other men, which was paralleled by elevated responses in reward-associated regions, including the nucleus accumbens. These effects of OXT were absent in women using HC. Our results confirm and extend previous findings in men that OXT interacts with the brain reward system to reinforce partner value representations, indicating a common OXT-dependent mechanism underlying partner attraction in both sexes. This mechanism may be disturbed in women using HC, suggesting that gonadal steroids could alter partner-specific OXT effects. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Distinct patterns of outcome valuation and amygdala-prefrontal cortex synaptic remodeling in adolescence and adulthood

PubMed Central

Stolyarova, Alexandra; Izquierdo, Alicia

2015-01-01

Adolescent behavior is typified by increased risk-taking, reward- and novelty-seeking, as well as an augmented need for social and environmental stimulation. This behavioral phenotype may result from alterations in outcome valuation or reward learning. In the present set of experiments, we directly compared adult and adolescent animals on tasks measuring both of these processes. Additionally, we examined developmental differences in dopamine D1-like receptor (D1R), dopamine D2-like receptor (D2R), and polysialylated neural cell adhesion molecule (PSA-NCAM) expression in animals that were trained on an effortful reward valuation task, given that these proteins play an important role in the functional development of the amygdala-prefrontocortical (PFC) circuit and mesocorticolimbic dopamine system. We found that adolescent animals were not different from adults in appetitive associative learning, but exhibited distinct pattern of responses to differences in outcome values, which was paralleled by an enhanced motivation to invest effort to obtain larger rewards. There were no differences in D2 receptor expression, but D1 receptor expression was significantly reduced in the striatum of animals that had experiences with reward learning during adolescence compared to animals that went through the same experiences in adulthood. We observed increased levels of PSA-NCAM expression in both PFC and amygdala of late adolescents compared to adults that were previously trained on an effortful reward valuation task. PSA-NCAM levels in PFC were strongly and positively associated with high effort/reward (HER) choices in adolescents, but not in adult animals. Increased levels of PSA-NCAM expression in adolescents may index increased structural plasticity and represent a neural correlate of a reward sensitive endophenotype. PMID:25999830

Classical Information Storage in an n-Level Quantum System

NASA Astrophysics Data System (ADS)

Frenkel, Péter E.; Weiner, Mihály

2015-12-01

A game is played by a team of two—say Alice and Bob—in which the value of a random variable x is revealed to Alice only, who cannot freely communicate with Bob. Instead, she is given a quantum n-level system, respectively a classical n-state system, which she can put in possession of Bob in any state she wishes. We evaluate how successfully they managed to store and recover the value of x by requiring Bob to specify a value z and giving a reward of value f ( x, z) to the team. We show that whatever the probability distribution of x and the reward function f are, when using a quantum n-level system, the maximum expected reward obtainable with the best possible team strategy is equal to that obtainable with the use of a classical n-state system. The proof relies on mixed discriminants of positive matrices and—perhaps surprisingly—an application of the Supply-Demand Theorem for bipartite graphs. As a corollary, we get an infinite set of new, dimension dependent inequalities regarding positive operator valued measures and density operators on complex n-space. As a further corollary, we see that the greatest value, with respect to a given distribution of x, of the mutual information I ( x; z) that is obtainable using an n-level quantum system equals the analogous maximum for a classical n-state system.

Individual Variation in Incentive Salience Attribution and Accumbens Dopamine Transporter Expression and Function

PubMed Central

Singer, Bryan F.; Guptaroy, Bipasha; Austin, Curtis J.; Wohl, Isabella; Lovic, Vedran; Seiler, Jillian L; Vaughan, Roxanne A.; Gnegy, Margaret E.; Robinson, Terry E.; Aragona, Brandon J.

2015-01-01

Cues (conditioned stimuli; CSs) associated with rewards can come to motivate behavior, but there is considerable individual variation in their ability to do so. For example, a lever-CS that predicts food reward becomes attractive, wanted, and elicits reward-seeking behavior to a greater extent in some rats (“sign-trackers”; STs), than others (“goal-trackers”; GTs). Variation in dopamine (DA) neurotransmission in the nucleus accumbens (NAc) core is thought to contribute to such individual variation. Given that the DA transporter (DAT) exerts powerful regulation over DA signaling, we characterized the expression and function of the DAT in the accumbens of STs and GTs. STs showed greater DAT surface expression in ventral striatal synaptosomes than GTs, and ex vivo fast-scan cyclic voltammetry recordings of electrically-evoked DA release confirmed enhanced DAT function in STs, as indicated by faster DA uptake, specifically in the NAc core. Consistent with this, systemic amphetamine (AMPH) produced greater inhibition of DA uptake in STs than in GTs. Furthermore, injection of AMPH directly into the NAc core enhanced lever-directed approach in STs, presumably by amplifying the incentive value of the CS, but had no effect on goal tracking behavior. On the other hand, there were no differences between STs and GTs in electrically-evoked DA release in slices, or in total ventral striatal DA content. We conclude that greater DAT surface expression may facilitate the attribution of incentive salience to discrete reward cues. Investigating this variability in animal sub-populations may help explain why some people abuse drugs, while others do not. PMID:26613374

The influence of playing a non-reward game on motor ability and executive function in Parkinson's disease.

PubMed

Araújo Lima, Alisson Menezes; Cordeiro Hirata, Fabiana de Campos; Sales de Bruin, Gabriela; Salani Mota, Rosa Maria; Bruin, Veralice Meireles Sales de

2012-01-01

The aim of this study is to evaluate the acute effect of playing games on executive function and motor ability in Parkinson's disease (PD). Consecutive cases with PD were studied with the Unified Parkinson Disease Rating Scale (UPDRS), Mini-Mental State examination (MMSE), Beck Depression Inventory (BDI), Stroop test, finger tapping and 14-meter walk test. After randomization, patients performed a game of dominoes and were tested before and after experiment being further categorized as control, winners or non-winners. Forty patients, 27 male (67.5%), aged 48 to 84 years (63.2 ± 8.5), Hoehn & Yahr I to III were included. Twenty-eight (70%) presented depressive symptoms (BDI > 10). Groups (Control N = 13; Winners = 14 and Non-winners = 13) were not different regarding age, disease duration, age at onset, BMI, MMSE scores, depressive symptoms, levodopa dose, and previous practice of games. Winners presented significantly better results on executive function (Stroop test, p = 0.002) and on motor activity (Finger tapping, p = 0.01). Non-winners showed a trend of better performance in the 14-meter-walk test. This study shows that the practice of a non-reward game acutely improved memory and motor skills in PD. Our results suggest a role for the reward system in the modulation of the dopaminergic function of the basal ganglia in these patients.

On the distinction between open and closed economies.

PubMed Central

Timberlake, W; Peden, B F

1987-01-01

Open and closed economies have been assumed to produce opposite relations between responding and the programmed density of reward (the amount of reward divided by its cost). Experimental procedures that are treated as open economies typically dissociate responding and total reward by providing supplemental income outside the experimental session; procedures construed as closed economies do not. In an open economy responding is assumed to be directly related to reward density, whereas in a closed economy responding is assumed to be inversely related to reward density. In contrast to this predicted correlation between response-reward relations and type of economy, behavior regulation theory predicts both direct and inverse relations in both open and closed economies. Specifically, responding should be a bitonic function of reward density regardless of the type of economy and is dependent only on the ratio of the schedule terms rather than on their absolute size. These predictions were tested by four experiments in which pigeons' key pecking produced food on fixed-ratio and variable-interval schedules over a range of reward magnitudes and under several open- and closed-economy procedures. The results better supported the behavior regulation view by showing a general bitonic function between key pecking and food density in all conditions. In most cases, the absolute size of the schedule requirement and the magnitude of reward had no effect; equal ratios of these terms produced approximately equal responding. PMID:3625103

Fronto-striatal Dysfunction During Reward Processing in Unaffected Siblings of Schizophrenia Patients

PubMed Central

de Leeuw, Max; Kahn, René S.; Vink, Matthijs

2015-01-01

Schizophrenia is a psychiatric disorder that is associated with impaired functioning of the fronto-striatal network, in particular during reward processing. However, it is unclear whether this dysfunction is related to the illness itself or whether it reflects a genetic vulnerability to develop schizophrenia. Here, we examined reward processing in unaffected siblings of schizophrenia patients using functional magnetic resonance imaging. Brain activity was measured during reward anticipation and reward outcome in 27 unaffected siblings of schizophrenia patients and 29 healthy volunteers using a modified monetary incentive delay task. Task performance was manipulated online so that all subjects won the same amount of money. Despite equal performance, siblings showed reduced activation in the ventral striatum, insula, and supplementary motor area (SMA) during reward anticipation compared to controls. Decreased ventral striatal activation in siblings was correlated with sub-clinical negative symptoms. During the outcome of reward, siblings showed increased activation in the ventral striatum and orbitofrontal cortex compared to controls. Our finding of decreased activity in the ventral striatum during reward anticipation and increased activity in this region during receiving reward may indicate impaired cue processing in siblings. This is consistent with the notion of dopamine dysfunction typically associated with schizophrenia. Since unaffected siblings share on average 50% of their genes with their ill relatives, these deficits may be related to the genetic vulnerability for schizophrenia. PMID:25368371

Food reward system: current perspectives and future research needs.

PubMed

Alonso-Alonso, Miguel; Woods, Stephen C; Pelchat, Marcia; Grigson, Patricia Sue; Stice, Eric; Farooqi, Sadaf; Khoo, Chor San; Mattes, Richard D; Beauchamp, Gary K

2015-05-01

This article reviews current research and cross-disciplinary perspectives on the neuroscience of food reward in animals and humans, examines the scientific hypothesis of food addiction, discusses methodological and terminology challenges, and identifies knowledge gaps and future research needs. Topics addressed herein include the role of reward and hedonic aspects in the regulation of food intake, neuroanatomy and neurobiology of the reward system in animals and humans, responsivity of the brain reward system to palatable foods and drugs, translation of craving versus addiction, and cognitive control of food reward. The content is based on a workshop held in 2013 by the North American Branch of the International Life Sciences Institute. © The Author(s) 2015. Published by Oxford University Press on behalf of the International Life Sciences Institute.

Study of gamma detection capabilities of the REWARD mobile spectroscopic system

NASA Astrophysics Data System (ADS)

Balbuena, J. P.; Baptista, M.; Barros, S.; Dambacher, M.; Disch, C.; Fiederle, M.; Kuehn, S.; Parzefall, U.

2017-07-01

REWARD is a novel mobile spectroscopic radiation detector system for Homeland Security applications. The system integrates gamma and neutron detection equipped with wireless communication. A comprehensive simulation study on its gamma detection capabilities in different radioactive scenarios is presented in this work. The gamma detection unit consists of a precise energy resolution system based on two stacked (Cd,Zn)Te sensors working in coincidence sum mode. The volume of each of these CZT sensors is 1 cm3. The investigated energy windows used to determine the detection capabilities of the detector correspond to the gamma emissions from 137Cs and 60Co radioactive sources (662 keV and 1173/1333 keV respectively). Monte Carlo and Technology Computer-Aided Design (TCAD) simulations are combined to determine its sensing capabilities for different radiation sources and estimate the limits of detection of the sensing unit as a function of source activity for several shielding materials.

Dimensional psychiatry: reward dysfunction and depressive mood across psychiatric disorders.

PubMed

Hägele, Claudia; Schlagenhauf, Florian; Rapp, Michael; Sterzer, Philipp; Beck, Anne; Bermpohl, Felix; Stoy, Meline; Ströhle, Andreas; Wittchen, Hans-Ulrich; Dolan, Raymond J; Heinz, Andreas

2015-01-01

A dimensional approach in psychiatry aims to identify core mechanisms of mental disorders across nosological boundaries. We compared anticipation of reward between major psychiatric disorders, and investigated whether reward anticipation is impaired in several mental disorders and whether there is a common psychopathological correlate (negative mood) of such an impairment. We used functional magnetic resonance imaging (fMRI) and a monetary incentive delay (MID) task to study the functional correlates of reward anticipation across major psychiatric disorders in 184 subjects, with the diagnoses of alcohol dependence (n = 26), schizophrenia (n = 44), major depressive disorder (MDD, n = 24), bipolar disorder (acute manic episode, n = 13), attention deficit/hyperactivity disorder (ADHD, n = 23), and healthy controls (n = 54). Subjects' individual Beck Depression Inventory-and State-Trait Anxiety Inventory-scores were correlated with clusters showing significant activation during reward anticipation. During reward anticipation, we observed significant group differences in ventral striatal (VS) activation: patients with schizophrenia, alcohol dependence, and major depression showed significantly less ventral striatal activation compared to healthy controls. Depressive symptoms correlated with dysfunction in reward anticipation regardless of diagnostic entity. There was no significant correlation between anxiety symptoms and VS functional activation. Our findings demonstrate a neurobiological dysfunction related to reward prediction that transcended disorder categories and was related to measures of depressed mood. The findings underline the potential of a dimensional approach in psychiatry and strengthen the hypothesis that neurobiological research in psychiatric disorders can be targeted at core mechanisms that are likely to be implicated in a range of clinical entities.

One pair of hands is not like another: caudate BOLD response in dogs depends on signal source and canine temperament

PubMed Central

Cook, Peter F.; Spivak, Mark

2014-01-01

Having previously used functional MRI to map the response to a reward signal in the ventral caudate in awake unrestrained dogs, here we examined the importance of signal source to canine caudate activation. Hand signals representing either incipient reward or no reward were presented by a familiar human (each dog’s respective handler), an unfamiliar human, and via illustrated images of hands on a computer screen to 13 dogs undergoing voluntary fMRI. All dogs had received extensive training with the reward and no-reward signals from their handlers and with the computer images and had minimal exposure to the signals from strangers. All dogs showed differentially higher BOLD response in the ventral caudate to the reward versus no reward signals, and there was a robust effect at the group level. Further, differential response to the signal source had a highly significant interaction with a dog’s general aggressivity as measured by the C-BARQ canine personality assessment. Dogs with greater aggressivity showed a higher differential response to the reward signal versus no-reward signal presented by the unfamiliar human and computer, while dogs with lower aggressivity showed a higher differential response to the reward signal versus no-reward signal from their handler. This suggests that specific facets of canine temperament bear more strongly on the perceived reward value of relevant communication signals than does reinforcement history, as each of the dogs were reinforced similarly for each signal, regardless of the source (familiar human, unfamiliar human, or computer). A group-level psychophysiological interaction (PPI) connectivity analysis showed increased functional coupling between the caudate and a region of cortex associated with visual discrimination and learning on reward versus no-reward trials. Our findings emphasize the sensitivity of the domestic dog to human social interaction, and may have other implications and applications pertinent to the training and assessment of working and pet dogs. PMID:25289182

Modeling effects of intrinsic and extrinsic rewards on the competition between striatal learning systems.

PubMed

Boedecker, Joschka; Lampe, Thomas; Riedmiller, Martin

2013-01-01

A common assumption in psychology, economics, and other fields holds that higher performance will result if extrinsic rewards (such as money) are offered as an incentive. While this principle seems to work well for tasks that require the execution of the same sequence of steps over and over, with little uncertainty about the process, in other cases, especially where creative problem solving is required due to the difficulty in finding the optimal sequence of actions, external rewards can actually be detrimental to task performance. Furthermore, they have the potential to undermine intrinsic motivation to do an otherwise interesting activity. In this work, we extend a computational model of the dorsomedial and dorsolateral striatal reinforcement learning systems to account for the effects of extrinsic and intrinsic rewards. The model assumes that the brain employs both a goal-directed and a habitual learning system, and competition between both is based on the trade-off between the cost of the reasoning process and value of information. The goal-directed system elicits internal rewards when its models of the environment improve, while the habitual system, being model-free, does not. Our results account for the phenomena that initial extrinsic reward leads to reduced activity after extinction compared to the case without any initial extrinsic rewards, and that performance in complex task settings drops when higher external rewards are promised. We also test the hypothesis that external rewards bias the competition in favor of the computationally efficient, but cruder and less flexible habitual system, which can negatively influence intrinsic motivation and task performance in the class of tasks we consider.

Registered nurses' experiences of rewarding in a Finnish University Hospital - an interview study.

PubMed

Seitovirta, Jaana; Partanen, Pirjo; Vehviläinen-Julkunen, Katri; Kvist, Tarja

2015-10-01

The purpose was to describe Finnish registered nurses' experiences of rewarding. The aim was to gather detailed information on the rewarding of nurses to help nurse managers and leaders to update existing reward strategy and to develop an effective reward system. Rewarding has been found positively to influence nurses' occupational well-being and commitment to their work, and the attractiveness of the health care field. A series of focused interviews with 10 registered nurses was conducted in 2011. Qualitative content analysis method was used. The nurses reported positive experiences with rewarding in the form of monetary compensation and other benefits, the positive aspects of nursing work and opportunities for professional development. The experiences of unsatisfactory rewarding generally stemmed from negative emotional experiences, lacking rewards and inequality in rewarding. It is essential to listen to nurses and to provide appropriate acknowledgement and appreciation of their work in order to develop an effective reward system. It is important to listen to nurses' experiences of rewarding because it enables nurse managers to maintain and increase the attractiveness of nursing and health care work in general. © 2014 John Wiley & Sons Ltd.

Functional specialization within the striatum along both the dorsal/ventral and anterior/posterior axes during associative learning via reward and punishment

PubMed Central

Mattfeld, Aaron T.; Gluck, Mark A.; Stark, Craig E.L.

2011-01-01

The goal of the present study was to elucidate the role of the human striatum in learning via reward and punishment during an associative learning task. Previous studies have identified the striatum as a critical component in the neural circuitry of reward-related learning. It remains unclear, however, under what task conditions, and to what extent, the striatum is modulated by punishment during an instrumental learning task. Using high-resolution functional magnetic resonance imaging (fMRI) during a reward- and punishment-based probabilistic associative learning task, we observed activity in the ventral putamen for stimuli learned via reward regardless of whether participants were correct or incorrect (i.e., outcome). In contrast, activity in the dorsal caudate was modulated by trials that received feedback—either correct reward or incorrect punishment trials. We also identified an anterior/posterior dissociation reflecting reward and punishment prediction error estimates. Additionally, differences in patterns of activity that correlated with the amount of training were identified along the anterior/posterior axis of the striatum. We suggest that unique subregions of the striatum—separated along both a dorsal/ventral and anterior/posterior axis— differentially participate in the learning of associations through reward and punishment. PMID:22021252

Imbalanced functional link between executive control network and reward network explain the online-game seeking behaviors in Internet gaming disorder.

PubMed

Dong, Guangheng; Lin, Xiao; Hu, Yanbo; Xie, Chunming; Du, Xiaoxia

2015-03-17

Literatures have shown that Internet gaming disorder (IGD) subjects show impaired executive control and enhanced reward sensitivities than healthy controls. However, how these two networks jointly affect the valuation process and drive IGD subjects' online-game-seeking behaviors remains unknown. Thirty-five IGD and 36 healthy controls underwent a resting-states scan in the MRI scanner. Functional connectivity (FC) was examined within control and reward network seeds regions, respectively. Nucleus accumbens (NAcc) was selected as the node to find the interactions between these two networks. IGD subjects show decreased FC in the executive control network and increased FC in the reward network when comparing with the healthy controls. When examining the correlations between the NAcc and the executive control/reward networks, the link between the NAcc - executive control network is negatively related with the link between NAcc - reward network. The changes (decrease/increase) in IGD subjects' brain synchrony in control/reward networks suggest the inefficient/overly processing within neural circuitry underlying these processes. The inverse proportion between control network and reward network in IGD suggest that impairments in executive control lead to inefficient inhibition of enhanced cravings to excessive online game playing. This might shed light on the mechanistic understanding of IGD.

Fearfulness moderates the link between childhood social withdrawal and adolescent reward response.

PubMed

Morgan, Judith K; Shaw, Daniel S; Forbes, Erika E

2015-06-01

Withdrawal from peers during childhood may reflect disruptions in reward functioning that heighten vulnerability to affective disorders during adolescence. The association between socially withdrawn behavior and reward functioning may depend on traits that influence this withdrawal, such as fearfulness or unsociability. In a study of 129 boys, we evaluated how boys' fearfulness and sociability at age 5 and social withdrawal at school at ages 6 to 10 and during a summer camp at age 9/10 were associated with their neural response to reward at age 20. Greater social withdrawal during childhood was associated with heightened striatal and mPFC activation when anticipating rewards at age 20. Fearfulness moderated this effect to indicate that social withdrawal was associated with heightened reward-related response in the striatum for boys high on fearfulness. Altered striatal response associated with social withdrawal and fearfulness predicted greater likelihood to have a lifetime history of depression and social phobia at age 20. These findings add greater specificity to previous findings that children high in traits related to fear of novelty show altered reward responses, by identifying fearfulness (but not low levels of sociability) as a potential underlying mechanism that contributes to reward alterations in withdrawn children. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Major depressive disorder is characterized by greater reward network activation to monetary than pleasant image rewards.

PubMed

Smoski, Moria J; Rittenberg, Alison; Dichter, Gabriel S

2011-12-30

Anhedonia, the loss of interest or pleasure in normally rewarding activities, is a hallmark feature of unipolar Major Depressive Disorder (MDD). A growing body of literature has identified frontostriatal dysfunction during reward anticipation and outcomes in MDD. However, no study to date has directly compared responses to different types of rewards such as pleasant images and monetary rewards in MDD. To investigate the neural responses to monetary and pleasant image rewards in MDD, a modified Monetary Incentive Delay task was used during functional magnetic resonance imaging to assess neural responses during anticipation and receipt of monetary and pleasant image rewards. Participants included nine adults with MDD and 13 affectively healthy controls. The MDD group showed lower activation than controls when anticipating monetary rewards in right orbitofrontal cortex and subcallosal cortex, and when anticipating pleasant image rewards in paracingulate and supplementary motor cortex. The MDD group had relatively greater activation in right putamen when anticipating monetary versus pleasant image rewards, relative to the control group. Results suggest reduced reward network activation in MDD when anticipating rewards, as well as relatively greater hypoactivation to pleasant image than monetary rewards. 2011 Elsevier Ireland Ltd. All rights reserved.

Problematic internet use is associated with structural alterations in the brain reward system in females.

PubMed

Altbäcker, Anna; Plózer, Enikő; Darnai, Gergely; Perlaki, Gábor; Horváth, Réka; Orsi, Gergely; Nagy, Szilvia Anett; Bogner, Péter; Schwarcz, Attila; Kovács, Norbert; Komoly, Sámuel; Clemens, Zsófia; Janszky, József

2016-12-01

Neuroimaging findings suggest that excessive Internet use shows functional and structural brain changes similar to substance addiction. Even though it is still under debate whether there are gender differences in case of problematic use, previous studies by-passed this question by focusing on males only or by using gender matched approach without controlling for potential gender effects. We designed our study to find out whether there are structural correlates in the brain reward system of problematic Internet use in habitual Internet user females. T1-weighted Magnetic Resonance (MR) images were collected in 82 healthy habitual Internet user females. Structural brain measures were investigated using both automated MR volumetry and voxel based morphometry (VBM). Self-reported measures of problematic Internet use and hours spent online were also assessed. According to MR volumetry, problematic Internet use was associated with increased grey matter volume of bilateral putamen and right nucleus accumbens while decreased grey matter volume of orbitofrontal cortex (OFC). Similarly, VBM analysis revealed a significant negative association between the absolute amount of grey matter OFC and problematic Internet use. Our findings suggest structural brain alterations in the reward system usually related to addictions are present in problematic Internet use.

Sweet Taste and Nutrient Value Subdivide Rewarding Dopaminergic Neurons in Drosophila

PubMed Central

Huetteroth, Wolf; Perisse, Emmanuel; Lin, Suewei; Klappenbach, Martín; Burke, Christopher; Waddell, Scott

2015-01-01

Summary Dopaminergic neurons provide reward learning signals in mammals and insects [1–4]. Recent work in Drosophila has demonstrated that water-reinforcing dopaminergic neurons are different to those for nutritious sugars [5]. Here, we tested whether the sweet taste and nutrient properties of sugar reinforcement further subdivide the fly reward system. We found that dopaminergic neurons expressing the OAMB octopamine receptor [6] specifically convey the short-term reinforcing effects of sweet taste [4]. These dopaminergic neurons project to the β′2 and γ4 regions of the mushroom body lobes. In contrast, nutrient-dependent long-term memory requires different dopaminergic neurons that project to the γ5b regions, and it can be artificially reinforced by those projecting to the β lobe and adjacent α1 region. Surprisingly, whereas artificial implantation and expression of short-term memory occur in satiated flies, formation and expression of artificial long-term memory require flies to be hungry. These studies suggest that short-term and long-term sugar memories have different physiological constraints. They also demonstrate further functional heterogeneity within the rewarding dopaminergic neuron population. PMID:25728694

A Quantitative Relationship between Signal Detection in Attention and Approach/Avoidance Behavior

PubMed Central

Viswanathan, Vijay; Sheppard, John P.; Kim, Byoung W.; Plantz, Christopher L.; Ying, Hao; Lee, Myung J.; Raman, Kalyan; Mulhern, Frank J.; Block, Martin P.; Calder, Bobby; Lee, Sang; Mortensen, Dale T.; Blood, Anne J.; Breiter, Hans C.

2017-01-01

This study examines how the domains of reward and attention, which are often studied as independent processes, in fact interact at a systems level. We operationalize divided attention with a continuous performance task and variables from signal detection theory (SDT), and reward/aversion with a keypress task measuring approach/avoidance in the framework of relative preference theory (RPT). Independent experiments with the same subjects showed a significant association between one SDT and two RPT variables, visualized as a three-dimensional structure. Holding one of these three variables constant, further showed a significant relationship between a loss aversion-like metric from the approach/avoidance task, and the response bias observed during the divided attention task. These results indicate that a more liberal response bias under signal detection (i.e., a higher tolerance for noise, resulting in a greater proportion of false alarms) is associated with higher “loss aversion.” Furthermore, our functional model suggests a mechanism for processing constraints with divided attention and reward/aversion. Together, our results argue for a systematic relationship between divided attention and reward/aversion processing in humans. PMID:28270776

A Quantitative Relationship between Signal Detection in Attention and Approach/Avoidance Behavior.

PubMed

Viswanathan, Vijay; Sheppard, John P; Kim, Byoung W; Plantz, Christopher L; Ying, Hao; Lee, Myung J; Raman, Kalyan; Mulhern, Frank J; Block, Martin P; Calder, Bobby; Lee, Sang; Mortensen, Dale T; Blood, Anne J; Breiter, Hans C

2017-01-01

This study examines how the domains of reward and attention, which are often studied as independent processes, in fact interact at a systems level. We operationalize divided attention with a continuous performance task and variables from signal detection theory (SDT), and reward/aversion with a keypress task measuring approach/avoidance in the framework of relative preference theory (RPT). Independent experiments with the same subjects showed a significant association between one SDT and two RPT variables, visualized as a three-dimensional structure. Holding one of these three variables constant, further showed a significant relationship between a loss aversion-like metric from the approach/avoidance task, and the response bias observed during the divided attention task. These results indicate that a more liberal response bias under signal detection (i.e., a higher tolerance for noise, resulting in a greater proportion of false alarms) is associated with higher "loss aversion." Furthermore, our functional model suggests a mechanism for processing constraints with divided attention and reward/aversion. Together, our results argue for a systematic relationship between divided attention and reward/aversion processing in humans.

Learning-dependent plasticity in human auditory cortex during appetitive operant conditioning.

PubMed

Puschmann, Sebastian; Brechmann, André; Thiel, Christiane M

2013-11-01

Animal experiments provide evidence that learning to associate an auditory stimulus with a reward causes representational changes in auditory cortex. However, most studies did not investigate the temporal formation of learning-dependent plasticity during the task but rather compared auditory cortex receptive fields before and after conditioning. We here present a functional magnetic resonance imaging study on learning-related plasticity in the human auditory cortex during operant appetitive conditioning. Participants had to learn to associate a specific category of frequency-modulated tones with a reward. Only participants who learned this association developed learning-dependent plasticity in left auditory cortex over the course of the experiment. No differential responses to reward predicting and nonreward predicting tones were found in auditory cortex in nonlearners. In addition, learners showed similar learning-induced differential responses to reward-predicting and nonreward-predicting tones in the ventral tegmental area and the nucleus accumbens, two core regions of the dopaminergic neurotransmitter system. This may indicate a dopaminergic influence on the formation of learning-dependent plasticity in auditory cortex, as it has been suggested by previous animal studies. Copyright © 2012 Wiley Periodicals, Inc.

Dynamics of neuronal circuits in addiction: reward, antireward, and emotional memory.

PubMed

Koob, G F

2009-05-01

Drug addiction is conceptualized as chronic, relapsing compulsive use of drugs with significant dysregulation of brain hedonic systems. Compulsive drug use is accompanied by decreased function of brain substrates for drug positive reinforcement and recruitment of brain substrates mediating the negative reinforcement of motivational withdrawal. The neural substrates for motivational withdrawal ("dark side" of addiction) involve recruitment of elements of the extended amygdala and the brain stress systems, including corticotropin-releasing factor and norepinephrine. These changes, combined with decreased reward function, are hypothesized to persist in the form of an allostatic state that forms a powerful motivational background for relapse. Relapse also involves a key role for the basolateral amygdala in mediating the motivational effects of stimuli previously paired with drug seeking and drug motivational withdrawal. The basolateral amygdala has a key role in mediating emotional memories in general. The hypothesis argued here is that brain stress systems activated by the motivational consequences of drug withdrawal can not only form the basis for negative reinforcement that drives drug seeking, but also potentiate associative mechanisms that perpetuate the emotional state and help drive the allostatic state of addiction.

Pay attention to your manipulation checks! Reward impact on cardiac reactivity is moderated by task context.

PubMed

Richter, Michael

2010-05-01

Two experiments assessed the moderating impact of task context on the relationship between reward and cardiovascular response. Randomly assigned to the cells of a 2 (task context: reward vs. demand) x 2 (reward value: low vs. high) between-persons design, participants performed either a memory task with an unclear performance standard (Experiment 1) or a visual scanning task with an unfixed performance standard (Experiment 2). Before performing the task--where participants could earn either a low or a high reward--participants responded to questions about either task reward or task demand. In accordance with the theoretical predictions derived from Wright's (1996) integrative model, reactivity of pre-ejection period increased with reward value if participants had rated aspects of task reward before performing the task. If they had rated task demand, pre-ejection period did not differ as a function of reward. Copyright 2010 Elsevier B.V. All rights reserved.

Delay, probability, and social discounting in a public goods game.

PubMed

Jones, Bryan A; Rachlin, Howard

2009-01-01

A human social discount function measures the value to a person of a reward to another person at a given social distance. Just as delay discounting is a hyperbolic function of delay, and probability discounting is a hyperbolic function of odds-against, social discounting is a hyperbolic function of social distance. Experiment 1 obtained individual social, delay, and probability discount functions for a hypothetical $75 reward; participants also indicated how much of an initial $100 endowment they would contribute to a common investment in a public good. Steepness of discounting correlated, across participants, among all three discount dimensions. However, only social and probability discounting were correlated with the public-good contribution; high public-good contributors were more altruistic and also less risk averse than low contributors. Experiment 2 obtained social discount functions with hypothetical $75 rewards and delay discount functions with hypothetical $1,000 rewards, as well as public-good contributions. The results replicated those of Experiment 1; steepness of the two forms of discounting correlated with each other across participants but only social discounting correlated with the public-good contribution. Most participants in Experiment 2 predicted that the average contribution would be lower than their own contribution.

Listening to music in a risk-reward context: The roles of the temporoparietal junction and the orbitofrontal/insular cortices in reward-anticipation, reward-gain, and reward-loss.

PubMed

Li, Chia-Wei; Chen, Jyh-Horng; Tsai, Chen-Gia

2015-12-10

Artificial rewards, such as visual arts and music, produce pleasurable feelings. Popular songs in the verse-chorus form provide a useful model for understanding the neural mechanisms underlying the processing of artificial rewards, because the chorus is usually the most rewarding element of a song. In this functional magnetic resonance imaging (fMRI) study, the stimuli were excerpts of 10 popular songs with a tensioned verse-to-chorus transition. We examined the neural correlates of three phases of reward processing: (1) reward-anticipation during the verse-to-chorus transition, (2) reward-gain during the first phrase of the chorus, and (3) reward-loss during the unexpected noise followed by the verse-to-chorus transition. Participants listened to these excerpts in a risk-reward context because the verse was followed by either the chorus or noise with equal probability. The results showed that reward-gain and reward-loss were associated with left- and right-biased temporoparietal junction activation, respectively. The bilateral temporoparietal junctions were active during reward-anticipation. Moreover, we observed left-biased lateral orbitofrontal activation during reward-anticipation, whereas the medial orbitofrontal cortex was activated during reward-gain. The findings are discussed in relation to the cognitive and emotional aspects of reward processing. Copyright © 2015 Elsevier B.V. All rights reserved.

Monetary reward magnitude effects on behavior and brain function during goal-directed behavior.

PubMed

Rosell-Negre, P; Bustamante, J C; Fuentes-Claramonte, P; Costumero, V; Benabarre, S; Barrós-Loscertales, A

2017-08-01

Reward may modulate the cognitive processes required for goal achievement, while individual differences in personality may affect reward modulation. Our aim was to test how different monetary reward magnitudes modulate brain activation and performance during goal-directed behavior, and whether individual differences in reward sensitivity affect this modulation. For this purpose, we scanned 37 subjects with a parametric design in which we varied the magnitude of monetary rewards (€0, €0.01, €0.5, €1 or €1.5) in a blocked fashion while participants performed an interference counting-Stroop condition. The results showed that the brain activity of left dorsolateral prefrontal cortex (DLPFC) and the striatum were modulated by increasing and decreasing reward magnitudes, respectively. Behavioral performance improved as the magnitude of monetary reward increased while comparing the non reward (€0) condition to any other reward condition, or the lower €0.01 to any other reward condition, and this improvement was related with individual differences in reward sensitivity. In conclusion, the locus of influence of monetary incentives overlaps the activity of the regions commonly involved in cognitive control.

Adaptive neural reward processing during anticipation and receipt of monetary rewards in mindfulness meditators.

PubMed

Kirk, Ulrich; Brown, Kirk Warren; Downar, Jonathan

2015-05-01

Reward seeking is ubiquitous and adaptive in humans. But excessive reward seeking behavior, such as chasing monetary rewards, may lead to diminished subjective well-being. This study examined whether individuals trained in mindfulness meditation show neural evidence of lower susceptibility to monetary rewards. Seventy-eight participants (34 meditators, 44 matched controls) completed the monetary incentive delay task while undergoing functional magnetic resonance imaging. The groups performed equally on the task, but meditators showed lower neural activations in the caudate nucleus during reward anticipation, and elevated bilateral posterior insula activation during reward anticipation. Meditators also evidenced reduced activations in the ventromedial prefrontal cortex during reward receipt compared with controls. Connectivity parameters between the right caudate and bilateral anterior insula were attenuated in meditators during incentive anticipation. In summary, brain regions involved in reward processing-both during reward anticipation and receipt of reward-responded differently in mindfulness meditators than in nonmeditators, indicating that the former are less susceptible to monetary incentives. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Common and distinct networks underlying reward valence and processing stages: A meta-analysis of functional neuroimaging studies

PubMed Central

Liu, Xun; Hairston, Jacqueline; Schrier, Madeleine; Fan, Jin

2011-01-01

To better understand the reward circuitry in human brain, we conducted activation likelihood estimation (ALE) and parametric voxel-based meta-analyses (PVM) on 142 neuroimaging studies that examined brain activation in reward-related tasks in healthy adults. We observed several core brain areas that participated in reward-related decision making, including the nucleus accumbens (NAcc), caudate, putamen, thalamus, orbitofrontal cortex (OFC), bilateral anterior insula, anterior (ACC) and posterior (PCC) cingulate cortex, as well as cognitive control regions in the inferior parietal lobule and prefrontal cortex (PFC). The NAcc was commonly activated by both positive and negative rewards across various stages of reward processing (e.g., anticipation, outcome, and evaluation). In addition, the medial OFC and PCC preferentially responded to positive rewards, whereas the ACC, bilateral anterior insula, and lateral PFC selectively responded to negative rewards. Reward anticipation activated the ACC, bilateral anterior insula, and brain stem, whereas reward outcome more significantly activated the NAcc, medial OFC, and amygdala. Neurobiological theories of reward-related decision making should therefore distributed and interrelated representations of reward valuation and valence assessment into account. PMID:21185861

Dynamics of rapid dopamine release in the nucleus accumbens during goal-directed behaviors for cocaine versus natural rewards

PubMed Central

Cameron, Courtney M.; Wightman, R. Mark; Carelli, Regina M.

2014-01-01

Electrophysiological studies show that distinct subsets of nucleus accumbens (NAc) neurons differentially encode information about goal-directed behaviors for intravenous cocaine versus natural (food/water) rewards. Further, NAc rapid dopamine signaling occurs on a timescale similar to phasic cell firing during cocaine and natural reward-seeking behaviors. However, it is not known whether dopamine signaling is reinforcer specific (i.e., is released during responding for only one type of reinforcer) within discrete NAc locations, similar to neural firing dynamics. Here, fast-scan cyclic voltammetry (FSCV) was used to measure rapid dopamine release during multiple schedules involving sucrose reward and cocaine self-administration (n=8 rats) and, in a separate group of rats (n = 6), during a sucrose/food multiple schedule. During the sucrose/cocaine multiple schedule, dopamine increased within seconds of operant responding for both reinforcers. Although dopamine release was not reinforcer specific, more subtle differences were observed in peak dopamine concentration [DA] across reinforcer conditions. Specifically, peak [DA] was higher during the first phase of the multiple schedule, regardless of reinforcer type. Further, the time to reach peak [DA] was delayed during cocaine-responding compared to sucrose. During the sucrose/food multiple schedule, increases in dopamine release were also observed relative to operant responding for both natural rewards. However, peak [DA] was higher relative to responding for sucrose than food, regardless of reinforcer order. Overall, the results reveal the dynamics of rapid dopamine signaling in discrete locations in the NAc across reward conditions, and provide novel insight into the functional role of this system in reward-seeking behaviors. PMID:25174553

Reward Contingencies Improve Goal-Directed Behavior by Enhancing Posterior Brain Attentional Regions and Increasing Corticostriatal Connectivity in Cocaine Addicts.

PubMed

Rosell-Negre, Patricia; Bustamante, Juan-Carlos; Fuentes-Claramonte, Paola; Costumero, Víctor; Llopis-Llacer, Juan-José; Barrós-Loscertales, Alfonso

2016-01-01

The dopaminergic system provides the basis for the interaction between motivation and cognition. It is triggered by the possibility of obtaining rewards to initiate the neurobehavioral adaptations necessary to achieve them by directing the information from motivational circuits to cognitive and action circuits. In drug addiction, the altered dopamine (DA) modulation of the meso-cortico-limbic reward circuitry, such as the prefrontal cortex (PFC), underlies the disproportionate motivational value of drug use at the expense of other non-drug reinforcers and the user's loss of control over his/her drug intake. We examine how the magnitude of the reward affects goal-directed processes in healthy control (HC) subjects and abstinent cocaine dependent (ACD) patients by using functional magnetic resonance imaging (fMRI) during a counting Stroop task with blocked levels of monetary incentives of different magnitudes (€0, €0.01, €0.5, €1 or €1.5). Our results showed that increasing reward magnitude enhances (1) performance facilitation in both groups; (2) left dorsolateral prefrontal cortex (DLPFC) activity in HC and left superior occipital cortex activity in ACD; and (3) left DLPFC and left putamen connectivity in ACD compared to HC. Moreover, we observed that (4) dorsal striatal and pallidum activity was associated with craving and addiction severity during the parametric increases in the monetary reward. In conclusion, the brain response to gradients in monetary value was different in HC and ACD, but both groups showed improved task performance due to the possibility of obtaining greater monetary rewards.

Reward Contingencies Improve Goal-Directed Behavior by Enhancing Posterior Brain Attentional Regions and Increasing Corticostriatal Connectivity in Cocaine Addicts

PubMed Central

Rosell-Negre, Patricia; Bustamante, Juan-Carlos; Fuentes-Claramonte, Paola; Costumero, Víctor; Llopis-Llacer, Juan-José; Barrós-Loscertales, Alfonso

2016-01-01

The dopaminergic system provides the basis for the interaction between motivation and cognition. It is triggered by the possibility of obtaining rewards to initiate the neurobehavioral adaptations necessary to achieve them by directing the information from motivational circuits to cognitive and action circuits. In drug addiction, the altered dopamine (DA) modulation of the meso-cortico-limbic reward circuitry, such as the prefrontal cortex (PFC), underlies the disproportionate motivational value of drug use at the expense of other non-drug reinforcers and the user’s loss of control over his/her drug intake. We examine how the magnitude of the reward affects goal-directed processes in healthy control (HC) subjects and abstinent cocaine dependent (ACD) patients by using functional magnetic resonance imaging (fMRI) during a counting Stroop task with blocked levels of monetary incentives of different magnitudes (€0, €0.01, €0.5, €1 or €1.5). Our results showed that increasing reward magnitude enhances (1) performance facilitation in both groups; (2) left dorsolateral prefrontal cortex (DLPFC) activity in HC and left superior occipital cortex activity in ACD; and (3) left DLPFC and left putamen connectivity in ACD compared to HC. Moreover, we observed that (4) dorsal striatal and pallidum activity was associated with craving and addiction severity during the parametric increases in the monetary reward. In conclusion, the brain response to gradients in monetary value was different in HC and ACD, but both groups showed improved task performance due to the possibility of obtaining greater monetary rewards. PMID:27907134

Neural Effects of Cannabinoid CB1 Neutral Antagonist Tetrahydrocannabivarin on Food Reward and Aversion in Healthy Volunteers

PubMed Central

Tudge, Luke; Williams, Clare; Cowen, Philip J.

2015-01-01

Background: Disturbances in the regulation of reward and aversion in the brain may underlie disorders such as obesity and eating disorders. We previously showed that the cannabis receptor subtype (CB1) inverse agonist rimonabant, an antiobesity drug withdrawn due to depressogenic side effects, diminished neural reward responses yet increased aversive responses (Horder et al., 2010). Unlike rimonabant, tetrahydrocannabivarin is a neutral CB1 receptor antagonist (Pertwee, 2005) and may therefore produce different modulations of the neural reward system. We hypothesized that tetrahydrocannabivarin would, unlike rimonabant, leave intact neural reward responses but augment aversive responses. Methods: We used a within-subject, double-blind design. Twenty healthy volunteers received a single dose of tetrahydrocannabivarin (10mg) and placebo in randomized order on 2 separate occasions. We measured the neural response to rewarding (sight and/or flavor of chocolate) and aversive stimuli (picture of moldy strawberries and/or a less pleasant strawberry taste) using functional magnetic resonance imaging. Volunteers rated pleasantness, intensity, and wanting for each stimulus. Results: There were no significant differences between groups in subjective ratings. However, tetrahydrocannabivarin increased responses to chocolate stimuli in the midbrain, anterior cingulate cortex, caudate, and putamen. Tetrahydrocannabivarin also increased responses to aversive stimuli in the amygdala, insula, mid orbitofrontal cortex, caudate, and putamen. Conclusions: Our findings are the first to show that treatment with the CB1 neutral antagonist tetrahydrocannabivarin increases neural responding to rewarding and aversive stimuli. This effect profile suggests therapeutic activity in obesity, perhaps with a lowered risk of depressive side effects. PMID:25542687

Neural effects of cannabinoid CB1 neutral antagonist tetrahydrocannabivarin on food reward and aversion in healthy volunteers.

PubMed

Tudge, Luke; Williams, Clare; Cowen, Philip J; McCabe, Ciara

2014-12-25

Disturbances in the regulation of reward and aversion in the brain may underlie disorders such as obesity and eating disorders. We previously showed that the cannabis receptor subtype (CB1) inverse agonist rimonabant, an antiobesity drug withdrawn due to depressogenic side effects, diminished neural reward responses yet increased aversive responses (Horder et al., 2010). Unlike rimonabant, tetrahydrocannabivarin is a neutral CB1 receptor antagonist (Pertwee, 2005) and may therefore produce different modulations of the neural reward system. We hypothesized that tetrahydrocannabivarin would, unlike rimonabant, leave intact neural reward responses but augment aversive responses. We used a within-subject, double-blind design. Twenty healthy volunteers received a single dose of tetrahydrocannabivarin (10mg) and placebo in randomized order on 2 separate occasions. We measured the neural response to rewarding (sight and/or flavor of chocolate) and aversive stimuli (picture of moldy strawberries and/or a less pleasant strawberry taste) using functional magnetic resonance imaging. Volunteers rated pleasantness, intensity, and wanting for each stimulus. There were no significant differences between groups in subjective ratings. However, tetrahydrocannabivarin increased responses to chocolate stimuli in the midbrain, anterior cingulate cortex, caudate, and putamen. Tetrahydrocannabivarin also increased responses to aversive stimuli in the amygdala, insula, mid orbitofrontal cortex, caudate, and putamen. Our findings are the first to show that treatment with the CB1 neutral antagonist tetrahydrocannabivarin increases neural responding to rewarding and aversive stimuli. This effect profile suggests therapeutic activity in obesity, perhaps with a lowered risk of depressive side effects. © The Author 2015. Published by Oxford University Press on behalf of CINP.

Brain responses to erotic and other emotional stimuli in breast cancer survivors with and without distress about low sexual desire: a preliminary fMRI study.

PubMed

Versace, Francesco; Engelmann, Jeffrey M; Jackson, Edward F; Slapin, Aurelija; Cortese, Kristin M; Bevers, Therese B; Schover, Leslie R

2013-12-01

Many breast cancer survivors report a loss of sexual desire and arousability, consonant with the new DSM-V category of female sexual interest/arousal disorder. The cause of decreased sexual desire and pleasure after treatment for cancer is unknown. One possibility is that cancer, or treatment for cancer, damages brain circuits that are involved in reward-seeking. To test the hypothesis that brain reward systems are involved in decreased sexual desire in breast cancer survivors, we used functional magnetic resonance imaging (fMRI) to compare brain responses to erotica and other emotional stimuli in two groups of women previously treated for breast cancer with chemotherapy: those who were distressed about a perceived loss of sexual desire and those who may have had low desire, but were not distressed about it. Women distressed about their desire had reduced brain responses to erotica in the anterior cingulate and dorsolateral prefrontal cortex, which are part of the brain reward system. This study is the first to demonstrate, in cancer survivors, that problems with sexual desire/arousability are associated with blunted brain responses to erotica in reward systems. Future research is necessary to determine whether brain responses differ as a result of chemotherapy, hormone therapy, and menopausal status. This may contribute to the development of new, evidence-based interventions for one of the most prevalent and enduring side effects of cancer treatment.

The endocannabinoid system and appetite: relevance for food reward.

PubMed

Jager, Gerry; Witkamp, Renger F

2014-06-01

Mounting evidence substantiates the central role of the endocannabinoid system (ECS) in the modulation of both homeostatic and hedonic elements of appetite and food intake. Conversely, feeding status and dietary patterns directly influence activity of the ECS. Following a general introduction on the functioning of the ECS, the present review specifically addresses its role in the modulation of hedonic eating. Humans possess strong motivational systems triggered by rewarding aspects of food. Food reward is comprised of two components: one appetitive (orienting towards food); the other consummatory (hedonic evaluation), also referred to as 'wanting' and 'liking', respectively. Endocannabinoid tone seems to influence both the motivation to feed and the hedonic value of foods, probably by modifying palatability. Human physiology underlying hedonic eating is still not fully understood. A better understanding of the role of the ECS in the rewarding value of specific foods or diets could offer new possibilities to optimise the balance between energy and nutrient intake for different target groups. These groups include the obese and overweight, and potentially individuals suffering from malnutrition. Examples for the latter group are patients with disease-related anorexia, as well as the growing population of frail elderly suffering from persistent loss of food enjoyment and appetite resulting in malnutrition and involuntary weight loss. It has become clear that the psychobiology of food hedonics is extremely complex and the clinical failure of CB1 inverse agonists including rimonabant (Accomplia®) has shown that 'quick wins' in this field are unlikely.

The role of the central ghrelin system in reward from food and chemical drugs.

PubMed

Dickson, Suzanne L; Egecioglu, Emil; Landgren, Sara; Skibicka, Karolina P; Engel, Jörgen A; Jerlhag, Elisabet

2011-06-20

Here we review recent advances that identify a role for the central ghrelin signalling system in reward from both natural rewards (such as food) and artificial rewards (that include alcohol and drugs of abuse). Whereas ghrelin emerged as a stomach-derived hormone involved in energy balance, hunger and meal initiation via hypothalamic circuits, it now seems clear that it also has a role in motivated reward-driven behaviours via activation of the so-called "cholinergic-dopaminergic reward link". This reward link comprises a dopamine projection from the ventral tegmental area (VTA) to the nucleus accumbens together with a cholinergic input, arising primarily from the laterodorsal tegmental area. Ghrelin administration into the VTA or LDTg activates the "cholinergic-dopaminergic" reward link, suggesting that ghrelin may increase the incentive value of motivated behaviours such as reward-seeking behaviour ("wanting" or "incentive motivation"). Further, direct injection of ghrelin into the brain ventricles or into the VTA increases the consumption of rewarding foods as well as alcohol in mice and rats. Studies in rodents show beneficial effects of ghrelin receptor (GHS-R1A) antagonists to suppress the intake of palatable food, to reduce preference for caloric foods, to suppress food reward and motivated behaviour for food. They have also been shown to reduce alcohol consumption, suppress reward induced by alcohol, cocaine and amphetamine. Furthermore, variations in the GHS-R1A and pro-ghrelin genes have been associated with high alcohol consumption, smoking and increased weight gain in alcohol dependent individuals as well as with bulimia nervosa and obesity. Thus, the central ghrelin signalling system interfaces neurobiological circuits involved in reward from food as well as chemical drugs; agents that directly or indirectly suppress this system emerge as potential candidate drugs for suppressing problematic over-eating that leads to obesity as well as for the treatment of substance use disorder. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Motivation and timing: clues for modeling the reward system.

PubMed

Galtress, Tiffany; Marshall, Andrew T; Kirkpatrick, Kimberly

2012-05-01

There is growing evidence that a change in reward magnitude or value alters interval timing, indicating that motivation and timing are not independent processes as was previously believed. The present paper reviews several recent studies, as well as presenting some new evidence with further manipulations of reward value during training vs. testing on a peak procedure. The combined results cannot be accounted for by any of the current psychological timing theories. However, in examining the neural circuitry of the reward system, it is not surprising that motivation has an impact on timing because the motivation/valuation system directly interfaces with the timing system. A new approach is proposed for the development of the next generation of timing models, which utilizes knowledge of the neuroanatomy and neurophysiology of the reward system to guide the development of a neurocomputational model of the reward system. The initial foundation along with heuristics for proceeding with developing such a model is unveiled in an attempt to stimulate new theoretical approaches in the field. Copyright © 2012 Elsevier B.V. All rights reserved.

Ventral striatal activity links adversity and reward processing in children.

PubMed

Kamkar, Niki H; Lewis, Daniel J; van den Bos, Wouter; Morton, J Bruce

2017-08-01

Adversity impacts many aspects of psychological and physical development including reward-based learning and decision-making. Mechanisms relating adversity and reward processing in children, however, remain unclear. Here, we show that adversity is associated with potentiated learning from positive outcomes and impulsive decision-making, but unrelated to learning from negative outcomes. We then show via functional magnetic resonance imaging that the link between adversity and reward processing is partially mediated by differences in ventral striatal response to rewards. The findings suggest that early-life adversity is associated with alterations in the brain's sensitivity to rewards accounting, in part, for the link between adversity and altered reward processing in children. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Neurobiology of Decision Making in Depressed Adolescents: A Functional Magnetic Resonance Imaging Study

ERIC Educational Resources Information Center

Shad, Mujeeb U.; Bidesi, Anup P.; Chen, Li-Ann; Ernst, Monique; Rao, Uma

2011-01-01

Objective: Despite evidence that impaired reward- and risk-related behavior during adolescence can have potentially serious short- and long-term consequences, few studies have investigated the impact of depression on reward-related selection in adolescents. This study examined the relationship between reward-related behavior and prefrontal…

Framework for robot skill learning using reinforcement learning

NASA Astrophysics Data System (ADS)

Wei, Yingzi; Zhao, Mingyang

2003-09-01

Robot acquiring skill is a process similar to human skill learning. Reinforcement learning (RL) is an on-line actor critic method for a robot to develop its skill. The reinforcement function has become the critical component for its effect of evaluating the action and guiding the learning process. We present an augmented reward function that provides a new way for RL controller to incorporate prior knowledge and experience into the RL controller. Also, the difference form of augmented reward function is considered carefully. The additional reward beyond conventional reward will provide more heuristic information for RL. In this paper, we present a strategy for the task of complex skill learning. Automatic robot shaping policy is to dissolve the complex skill into a hierarchical learning process. The new form of value function is introduced to attain smooth motion switching swiftly. We present a formal, but practical, framework for robot skill learning and also illustrate with an example the utility of method for learning skilled robot control on line.

Motivational state, reward value, and Pavlovian cues differentially affect skilled forelimb grasping in rats

PubMed Central

de Clauser, Larissa; Kasper, Hansjörg; Schwab, Martin E.

2016-01-01

Motor skills represent high-precision movements performed at optimal speed and accuracy. Such motor skills are learned with practice over time. Besides practice, effects of motivation have also been shown to influence speed and accuracy of movements, suggesting that fast movements are performed to maximize gained reward over time as noted in previous studies. In rodents, skilled motor performance has been successfully modeled with the skilled grasping task, in which animals use their forepaw to grasp for sugar pellet rewards through a narrow window. Using sugar pellets, the skilled grasping task is inherently tied to motivation processes. In the present study, we performed three experiments modulating animals’ motivation during skilled grasping by changing the motivational state, presenting different reward value ratios, and displaying Pavlovian stimuli. We found in all three studies that motivation affected the speed of skilled grasping movements, with the strongest effects seen due to motivational state and reward value. Furthermore, accuracy of the movement, measured in success rate, showed a strong dependence on motivational state as well. Pavlovian cues had only minor effects on skilled grasping, but results indicate an inverse Pavlovian-instrumental transfer effect on movement speed. These findings have broad implications considering the increasing use of skilled grasping in studies of motor system structure, function, and recovery after injuries. PMID:27194796

Automatic honesty forgoing reward acquisition and punishment avoidance: a functional MRI investigation

PubMed Central

Yoneda, Mei; Ueda, Ryuhei; Ashida, Hiroshi

2017-01-01

Recent neuroimaging investigations into human honesty suggest that honest moral decisions in individuals who consistently behave honestly occur automatically, without the need for active self-control. However, it remains unclear whether this observation can be applied to two different types of honesty: honesty forgoing dishonest reward acquisition and honesty forgoing dishonest punishment avoidance. To address this issue, a functional MRI study, using an incentivized prediction task in which participants were confronted with real and repeated opportunities for dishonest gain leading to reward acquisition and punishment avoidance, was conducted. Behavioral data revealed that the frequency of dishonesty was equivalent between the opportunities for dishonest reward acquisition and for punishment avoidance. Reaction time data demonstrated that two types of honest decisions in the opportunity for dishonest reward acquisition and punishment avoidance required no additional cognitive control. Neuroimaging data revealed that honest decisions in the opportunity for dishonest reward acquisition and those for punishment avoidance required no additional control-related activity compared with a control condition in which no opportunity for dishonest behavior was given. These results suggest that honesty flows automatically, irrespective of the concomitant motivation for dishonesty leading to reward acquisition and punishment avoidance. PMID:28746066

Automatic honesty forgoing reward acquisition and punishment avoidance: a functional MRI investigation.

PubMed

Yoneda, Mei; Ueda, Ryuhei; Ashida, Hiroshi; Abe, Nobuhito

2017-09-27

Recent neuroimaging investigations into human honesty suggest that honest moral decisions in individuals who consistently behave honestly occur automatically, without the need for active self-control. However, it remains unclear whether this observation can be applied to two different types of honesty: honesty forgoing dishonest reward acquisition and honesty forgoing dishonest punishment avoidance. To address this issue, a functional MRI study, using an incentivized prediction task in which participants were confronted with real and repeated opportunities for dishonest gain leading to reward acquisition and punishment avoidance, was conducted. Behavioral data revealed that the frequency of dishonesty was equivalent between the opportunities for dishonest reward acquisition and for punishment avoidance. Reaction time data demonstrated that two types of honest decisions in the opportunity for dishonest reward acquisition and punishment avoidance required no additional cognitive control. Neuroimaging data revealed that honest decisions in the opportunity for dishonest reward acquisition and those for punishment avoidance required no additional control-related activity compared with a control condition in which no opportunity for dishonest behavior was given. These results suggest that honesty flows automatically, irrespective of the concomitant motivation for dishonesty leading to reward acquisition and punishment avoidance.

Neuropsychotoxicity of abused drugs: involvement of matrix metalloproteinase-2 and -9 and tissue inhibitor of matrix metalloproteinase-2 in methamphetamine-induced behavioral sensitization and reward in rodents.

PubMed

Mizoguchi, Hiroyuki; Yamada, Kiyofumi; Nabeshima, Toshitaka

2008-01-01

Matrix metalloproteinases (MMPs) and their inhibitors (TIMPs) function to remodel the pericellular environment. We have investigated the role of the MMP/TIMP system in methamphetamine (METH) dependence in rodents, in which the remodeling of neural circuits may be crucial. Repeated METH treatment induced behavioral sensitization, which was accompanied by an increase in MMP-2/-9/TIMP-2 activity in the brain. An antisense TIMP-2 oligonucleotide enhanced the sensitization, which was associated with a potentiation of the METH-induced release of dopamine in the nucleus accumbens (NAc). MMP-2/-9 inhibitors blocked the METH-induced behavioral sensitization and conditioned place preference (CPP), a measure of the rewarding effect of a drug, and reduced the METH-increased dopamine release in the NAc. In MMP-2- and MMP-9-deficient mice, METH-induced behavioral sensitization and CPP as well as dopamine release were attenuated. The MMP/TIMP system may be involved in METH-induced sensitization and reward by regulating extracellular dopamine levels.

Sexual orientation and spatial memory.

PubMed

Cánovas, Ma Rosa; Cimadevilla, José Manuel

2011-11-01

The present study aimed at determining the influence of sexual orientation in human spatial learning and memory. Participants performed the Boxes Room, a virtual reality version of the Holeboard. In Experiment I, a reference memory task, the position of the hidden rewards remained constant during the whole experiment. In Experiment II, a working memory task, the position of rewards changed between blocks. Each block consisted of two trials: One trial for acquisition and another for retrieval. The results of Experiment I showed that heterosexual men performed better than homosexual men and heterosexual women. They found the rewarded boxes faster. Moreover, homosexual participants committed more errors than heterosexuals. Experiment II showed that working memory abilities are the same in groups of different sexual orientation. These results suggest that sexual orientation is related to spatial navigation abilities, but mostly in men, and limited to reference memory, which depends more on the function of the hippocampal system.

Rewards and advancements for clinical pharmacists.

PubMed

Goodwin, S Diane; Kane-Gill, Sandra L; Ng, Tien M H; Melroy, Joel T; Hess, Mary M; Tallian, Kimberly; Trujillo, Toby C; Vermeulen, Lee C

2010-01-01

The American College of Clinical Pharmacy charged the Clinical Practice Affairs Committee to review and update the College's 1995 White Paper, "Rewards and Advancements for Clinical Pharmacy Practitioners." Because of the limited data on the present state of rewards and advancements for clinical pharmacists, an online survey of "front-line" clinical pharmacists and pharmacy managers was conducted (1126 total respondents, 14% response rate). The resulting White Paper discusses motivators and existing systems of rewards and advancements for clinical pharmacists, as well as perceived barriers to implementation of these systems. Clinical pharmacists reported work-life balance, a challenging position, and opportunities for professional advancement as the most important factors for career success. At the time of the survey, financial rewards appeared not to be a major motivator for clinical pharmacists. Managers underestimated the importance that clinical pharmacists place on work-life balance and favorable work schedules. Although almost two thirds of the clinical pharmacists surveyed had not developed a professional development plan, 84% indicated an interest in career planning. Both clinical pharmacists and managers rated the lack of a clear reward and advancement structure as the most important barrier to effective systems of rewards and advancements. Pharmacy managers and administrators are encouraged to develop effective systems of rewards and advancements for clinical pharmacists that positively impact patient care and the institution's mission; these systems will benefit the clinical pharmacist, the health care institution, and the patient.

Failure analysis and modeling of a multicomputer system. M.S. Thesis

NASA Technical Reports Server (NTRS)

Subramani, Sujatha Srinivasan

1990-01-01

This thesis describes the results of an extensive measurement-based analysis of real error data collected from a 7-machine DEC VaxCluster multicomputer system. In addition to evaluating basic system error and failure characteristics, we develop reward models to analyze the impact of failures and errors on the system. The results show that, although 98 percent of errors in the shared resources recover, they result in 48 percent of all system failures. The analysis of rewards shows that the expected reward rate for the VaxCluster decreases to 0.5 in 100 days for a 3 out of 7 model, which is well over a 100 times that for a 7-out-of-7 model. A comparison of the reward rates for a range of k-out-of-n models indicates that the maximum increase in reward rate (0.25) occurs in going from the 6-out-of-7 model to the 5-out-of-7 model. The analysis also shows that software errors have the lowest reward (0.2 vs. 0.91 for network errors). The large loss in reward rate for software errors is due to the fact that a large proportion (94 percent) of software errors lead to failure. In comparison, the high reward rate for network errors is due to fast recovery from a majority of these errors (median recovery duration is 0 seconds).

Prefrontal cortical regulation of brainwide circuit dynamics and reward-related behavior

PubMed Central

Grosenick, Logan; Warden, Melissa R.; Amatya, Debha; Katovich, Kiefer; Mehta, Hershel; Patenaude, Brian; Ramakrishnan, Charu; Kalanithi, Paul; Etkin, Amit; Knutson, Brian; Glover, Gary H.; Deisseroth, Karl

2016-01-01

Motivation for reward drives adaptive behaviors, whereas impairment of reward perception and experience (anhedonia) can contribute to psychiatric diseases, including depression and schizophrenia. We sought to test the hypothesis that the medial prefrontal cortex (mPFC) controls interactions among specific subcortical regions that govern hedonic responses. By using optogenetic functional magnetic resonance imaging to locally manipulate but globally visualize neural activity in rats, we found that dopamine neuron stimulation drives striatal activity, whereas locally increased mPFC excitability reduces this striatal response and inhibits the behavioral drive for dopaminergic stimulation. This chronic mPFC overactivity also stably suppresses natural reward-motivated behaviors and induces specific new brainwide functional interactions, which predict the degree of anhedonia in individuals. These findings describe a mechanism by which mPFC modulates expression of reward-seeking behavior, by regulating the dynamical interactions between specific distant subcortical regions. PMID:26722001

Hypothesizing dopaminergic genetic antecedents in schizophrenia and substance seeking behavior.

PubMed

Blum, Kenneth; Oscar-Berman, Marlene; Badgaiyan, Rajendra D; Palomo, Tomas; Gold, Mark S

2014-05-01

The dopamine system has been implicated in both substance use disorder (SUD) and schizophrenia. A recent meta-analysis suggests that A1 allele of the DRD2 gene imposes genetic risk for SUD, especially alcoholism and has been implicated in Reward Deficiency Syndrome (RDS). We hypothesize that dopamine D2 receptor (DRD2) gene Taq1 A2 allele is associated with a subtype of non-SUD schizophrenics and as such may act as a putative protective agent against the development of addiction to alcohol or other drugs of abuse. Schizophrenics with SUD may be carriers of the DRD2 Taq1 A1 allele, and/or other RDS reward polymorphisms and have hypodopaminergic reward function. One plausible mechanism for alcohol seeking in schizophrenics with SUD, based on previous research, may be a deficiency of gamma type endorphins that has been linked to schizophrenic type psychosis. We also propose that alcohol seeking behavior in schizophrenics, may serve as a physiological self-healing process linked to the increased function of the gamma endorphins, thereby reducing abnormal dopaminergic activity at the nucleus accumbens (NAc). These hypotheses warrant further investigation and cautious interpretation. We, therefore, encourage research involving neuroimaging, genome wide association studies (GWAS), and epigenetic investigation into the relationship between neurogenetics and systems biology to unravel the role of dopamine in psychiatric illness and SUD. Copyright © 2014 Elsevier Ltd. All rights reserved.