The neuroscience of investing: fMRI of the reward system.

PubMed

Peterson, Richard L

2005-11-15

Functional magnetic resonance imaging (fMRI) has proven a useful tool for observing neural BOLD signal changes during complex cognitive and emotional tasks. Yet the meaning and applicability of the fMRI data being gathered is still largely unknown. The brain's reward system underlies the fundamental neural processes of goal evaluation, preference formation, positive motivation, and choice behavior. fMRI technology allows researchers to dynamically visualize reward system processes. Experimenters can then correlate reward system BOLD activations with experimental behavior from carefully controlled experiments. In the SPAN lab at Stanford University, directed by Brian Knutson Ph.D., researchers have been using financial tasks during fMRI scanning to correlate emotion, behavior, and cognition with the reward system's fundamental neural activations. One goal of the SPAN lab is the development of predictive models of behavior. In this paper we extrapolate our fMRI results toward understanding and predicting individual behavior in the uncertain and high-risk environment of the financial markets. The financial market price anomalies of "value versus glamour" and "momentum" may be real-world examples of reward system activation biasing collective behavior. On the individual level, the investor's bias of overconfidence may similarly be related to reward system activation. We attempt to understand selected "irrational" investor behaviors and anomalous financial market price patterns through correlations with findings from fMRI research of the reward system.

Food reward system: current perspectives and future research needs

PubMed Central

Woods, Stephen C.; Pelchat, Marcia; Grigson, Patricia Sue; Stice, Eric; Farooqi, Sadaf; Khoo, Chor San; Mattes, Richard D.; Beauchamp, Gary K.

2015-01-01

This article reviews current research and cross-disciplinary perspectives on the neuroscience of food reward in animals and humans, examines the scientific hypothesis of food addiction, discusses methodological and terminology challenges, and identifies knowledge gaps and future research needs. Topics addressed herein include the role of reward and hedonic aspects in the regulation of food intake, neuroanatomy and neurobiology of the reward system in animals and humans, responsivity of the brain reward system to palatable foods and drugs, translation of craving versus addiction, and cognitive control of food reward. The content is based on a workshop held in 2013 by the North American Branch of the International Life Sciences Institute. PMID:26011903

Identifying nurses' rewards: a qualitative categorization study in Belgium

PubMed Central

De Gieter, Sara; De Cooman, Rein; Pepermans, Roland; Caers, Ralf; Du Bois, Cindy; Jegers, Marc

2006-01-01

Background Rewards are important in attracting, motivating and retaining the most qualified employees, and nurses are no exception to this rule. This makes the establishment of an efficient reward system for nurses a true challenge for every hospital manager. A reward does not necessarily have a financial connotation: non-financial rewards may matter too, or may even be more important. Therefore, the present study examines nurses' reward perceptions, in order to identify potential reward options. Methods To answer the research question "What do nurses consider a reward and how can these rewards be categorized?", 20 in-depth semi-structured interviews with nurses were conducted and analysed using discourse and content analyses. In addition, the respondents received a list of 34 rewards (derived from the literature) and were asked to indicate the extent to which they perceived each of them to be rewarding. Results Discourse analysis revealed three major reward categories: financial, non-financial and psychological, each containing different subcategories. In general, nurses more often mentioned financial rewards spontaneously in the interview, compared to non-financial and psychological rewards. The questionnaire results did not, however, indicate a significant difference in the rewarding potential of these three categories. Both the qualitative and quantitative data revealed that a number of psychological and non-financial rewards were important for nurses in addition to their monthly pay and other remunerations. In particular, appreciation for their work by others, compliments from others, presents from others and contact with patients were highly valued. Moreover, some demographical variables influenced the reward perceptions. Younger and less experienced nurses considered promotion possibilities as more rewarding than the older and more senior ones. The latter valued job security and working for a hospital with a good reputation higher than their younger and more junior colleagues. Conclusion When trying to establish an efficient reward system for nurses, hospital managers should not concentrate on the financial reward possibilities alone. They also ought to consider non-financial and psychological rewards (in combination with financial rewards), since nurses value these as well and they may lead to a more personalized reward system. PMID:16824227

A Systematic Review of fMRI Reward Paradigms in Adolescents versus Adults: The Impact of Task Design and Implications for Understanding Neurodevelopment

PubMed Central

Richards, Jessica M.; Plate, Rista C.; Ernst, Monique

2013-01-01

The neural systems underlying reward-related behaviors across development have recently generated a great amount of interest. Yet, the neurodevelopmental literature on reward processing is marked by inconsistencies due to the heterogeneity of the reward paradigms used, the complexity of the behaviors being studied, and the developing brain itself as a moving target. The present review will examine task design as one source of variability across findings by compiling this literature along three dimensions: (1) task structures, (2) cognitive processes, and (3) neural systems. We start with the presentation of a heuristic neural systems model, the Triadic Model, as a way to provide a theoretical framework for the neuroscience research on motivated behaviors. We then discuss the principles guiding reward task development. Finally, we review the extant developmental neuroimaging literature on reward-related processing, organized by reward task type. We hope that this approach will help to clarify the literature on the functional neurodevelopment of reward-related neural systems, and to identify the role of the experimental parameters that significantly influence these findings. PMID:23518270

Reward and Aversion.

PubMed

Hu, Hailan

2016-07-08

To benefit from opportunities and cope with challenges in the environment, animals must adapt their behavior to acquire rewards and to avoid punishments. Maladaptive changes in the neuromodulatory systems and neural circuits for reward and aversion can lead to manifestation of several prominent psychiatric disorders including addiction and depression. Recent progress is pushing the boundaries of knowledge on two major fronts in research on reward and aversion: First, new layers of complexity have been reported on the functions of dopamine (DA) and serotonin (5-HT) neuromodulatory systems in reward and aversion. Second, specific circuit components in the neural pathways that encode reward and aversion have begun to be identified. This review aims to outline historic perspectives and new insights into the functions of DA and 5-HT systems in coding the distinct components of rewards. It also highlights recent advances in neural circuit studies enabled by new technologies, such as cell-type-specific electrophysiology and tracing, and optogenetics-based behavioral manipulation. This knowledge may provide guidance for developing novel treatment strategies for neuropsychiatric diseases related to the malfunction of the reward system.

Regulation of brain reward by the endocannabinoid system: a critical review of behavioral studies in animals.

PubMed

Vlachou, S; Panagis, G

2014-01-01

The endocannabinoid system has been implicated in the regulation of a variety of physiological processes, including a crucial involvement in brain reward systems and the regulation of motivational processes. Behavioral studies have shown that cannabinoid reward may involve the same brain circuits and similar brain mechanisms with other drugs of abuse, such as nicotine, cocaine, alcohol and heroin, as well as natural rewards, such as food, water and sucrose, although the conditions under which cannabinoids exert their rewarding effects may be more limited. The purpose of the present review is to briefly describe and evaluate the behavioral and pharmacological research concerning the major components of the endocannabinoid system and reward processes. Special emphasis is placed on data received from four procedures used to test the effects of the endocannabinoid system on brain reward in animals; namely, the intracranial self-stimulation paradigm, the self-administration procedure, the conditioned place preference procedure and the drug-discrimination procedure. The effects of cannabinoid 1 (CB1) and cannabinoid 2 (CB2) receptor agonists, antagonists and endocannabinoid modulators in these procedures are examined. Further, the involvement of CB1 and CB2 receptors, as well the fatty acid amid hydrolase (FAAH) enzyme in reward processes is investigated through presentation of respective genetic ablation studies in mice. We suggest that the endocannabinoid system plays a major role in modulating motivation and reward processes. Further research will provide us with a better understanding of these processes and, thus, could lead to the development of potential therapeutic compounds for the treatment of reward-related disorders.

Individual Variation in Incentive Salience Attribution and Accumbens Dopamine Transporter Expression and Function

PubMed Central

Singer, Bryan F.; Guptaroy, Bipasha; Austin, Curtis J.; Wohl, Isabella; Lovic, Vedran; Seiler, Jillian L; Vaughan, Roxanne A.; Gnegy, Margaret E.; Robinson, Terry E.; Aragona, Brandon J.

2015-01-01

Cues (conditioned stimuli; CSs) associated with rewards can come to motivate behavior, but there is considerable individual variation in their ability to do so. For example, a lever-CS that predicts food reward becomes attractive, wanted, and elicits reward-seeking behavior to a greater extent in some rats (“sign-trackers”; STs), than others (“goal-trackers”; GTs). Variation in dopamine (DA) neurotransmission in the nucleus accumbens (NAc) core is thought to contribute to such individual variation. Given that the DA transporter (DAT) exerts powerful regulation over DA signaling, we characterized the expression and function of the DAT in the accumbens of STs and GTs. STs showed greater DAT surface expression in ventral striatal synaptosomes than GTs, and ex vivo fast-scan cyclic voltammetry recordings of electrically-evoked DA release confirmed enhanced DAT function in STs, as indicated by faster DA uptake, specifically in the NAc core. Consistent with this, systemic amphetamine (AMPH) produced greater inhibition of DA uptake in STs than in GTs. Furthermore, injection of AMPH directly into the NAc core enhanced lever-directed approach in STs, presumably by amplifying the incentive value of the CS, but had no effect on goal tracking behavior. On the other hand, there were no differences between STs and GTs in electrically-evoked DA release in slices, or in total ventral striatal DA content. We conclude that greater DAT surface expression may facilitate the attribution of incentive salience to discrete reward cues. Investigating this variability in animal sub-populations may help explain why some people abuse drugs, while others do not. PMID:26613374

Missing motoric manipulations: rethinking the imaging of the ventral striatum and dopamine in human reward.

PubMed

Kareken, David A

2018-01-26

Human neuroimaging studies of natural rewards and drugs of abuse frequently assay the brain's response to stimuli that, through Pavlovian learning, have come to be associated with a drug's rewarding properties. This might be characterized as a 'sensorial' view of the brain's reward system, insofar as the paradigms are designed to elicit responses to a reward's (drug's) sight, aroma, or flavor. A different field of research nevertheless suggests that the mesolimbic dopamine system may also be critically involved in the motor behaviors provoked by such stimuli. This brief review and commentary surveys some of the preclinical data supporting this more "efferent" (motoric) view of the brain's reward system, and discusses what such findings might mean for how human brain imaging studies of natural rewards and drugs of abuse are designed.

Effects of motivation on reward and attentional networks: an fMRI study.

PubMed

Ivanov, Iliyan; Liu, Xun; Clerkin, Suzanne; Schulz, Kurt; Friston, Karl; Newcorn, Jeffrey H; Fan, Jin

2012-11-01

Existing evidence suggests that reward and attentional networks function in concert and that activation in one system influences the other in a reciprocal fashion; however, the nature of these influences remains poorly understood. We therefore developed a three-component task to assess the interaction effects of reward anticipation and conflict resolution on the behavioral performance and the activation of brain reward and attentional systems. Sixteen healthy adult volunteers aged 21-45 years were scanned with functional magnetic resonance imaging (fMRI) while performing the task. A two-way repeated measures analysis of variance (ANOVA) with cue (reward vs. non-reward) and target (congruent vs. incongruent) as within-subjects factors was used to test for main and interaction effects. Neural responses to anticipation, conflict, and reward outcomes were tested. Behaviorally there were main effects of both reward cue and target congruency on reaction time. Neuroimaging results showed that reward anticipation and expected reward outcomes activated components of the attentional networks, including the inferior parietal and occipital cortices, whereas surprising non-rewards activated the frontoinsular cortex bilaterally and deactivated the ventral striatum. In turn, conflict activated a broad network associated with cognitive control and motor functions. Interaction effects showed decreased activity in the thalamus, anterior cingulated gyrus, and middle frontal gyrus bilaterally when difficult conflict trials (e.g., incongruent targets) were preceded by reward cues; in contrast, the ventral striatum and orbitofrontal cortex showed greater activation during congruent targets preceded by reward cues. These results suggest that reward anticipation is associated with lower activation in attentional networks, possibly due to increased processing efficiency, whereas more difficult, conflict trials are associated with lower activity in regions of the reward system, possibly because such trials are experienced as less rewarding.

Hedonic and incentive signals for body weight control.

PubMed

Egecioglu, Emil; Skibicka, Karolina P; Hansson, Caroline; Alvarez-Crespo, Mayte; Friberg, P Anders; Jerlhag, Elisabet; Engel, Jörgen A; Dickson, Suzanne L

2011-09-01

Here we review the emerging neurobiological understanding of the role of the brain's reward system in the regulation of body weight in health and in disease. Common obesity is characterized by the over-consumption of palatable/rewarding foods, reflecting an imbalance in the relative importance of hedonic versus homeostatic signals. The popular 'incentive salience theory' of food reward recognises not only a hedonic/pleasure component ('liking') but also an incentive motivation component ('wanting' or 'reward-seeking'). Central to the neurobiology of the reward mechanism is the mesoaccumbal dopamine system that confers incentive motivation not only for natural rewards such as food but also by artificial rewards (eg. addictive drugs). Indeed, this mesoaccumbal dopamine system receives and integrates information about the incentive (rewarding) value of foods with information about metabolic status. Problematic over-eating likely reflects a changing balance in the control exerted by hypothalamic versus reward circuits and/or it could reflect an allostatic shift in the hedonic set point for food reward. Certainly, for obesity to prevail, metabolic satiety signals such as leptin and insulin fail to regain control of appetitive brain networks, including those involved in food reward. On the other hand, metabolic control could reflect increased signalling by the stomach-derived orexigenic hormone, ghrelin. We have shown that ghrelin activates the mesoaccumbal dopamine system and that central ghrelin signalling is required for reward from both chemical drugs (eg alcohol) and also from palatable food. Future therapies for problematic over-eating and obesity may include drugs that interfere with incentive motivation, such as ghrelin antagonists.

Neuropharmacological mechanisms of drug reward: beyond dopamine in the nucleus accumbens.

PubMed

Bardo, M T

1998-01-01

Multiple lines of research have implicated the mesolimbic dopamine system in drug reward measured by either the drug self-administration or conditioned place preference paradigm. The present review summarizes recent work that examines the neuropharmacological mechanisms by which drugs impinge on this dopaminergic neural circuitry, as well as other systems that provide input and output circuits to the mesolimbic dopamine system. Studies examining the effect of selective agonist and antagonist drugs administered systemically have indicated that multiple neurotransmitters are involved, including dopamine, serotonin, acetylcholine, glutamate, GABA, and various peptides. Direct microinjection studies have also provided crucial evidence indicating that, in addition to the mesolimbic dopamine system, other structures play a role in drug reward, including the ventral pallidum, amygdala, hippocampus, hypothalamus, and pedunculopontine tegmental nucleus. GABAergic circuitry descending from the nucleus accumbens to the pedunculopontine tegmental nucleus via the ventral pallidum appears to be especially important in directing the behavioral sequelae associated with reward produced by various drugs of abuse. However, activation of the reward circuitry is achieved differently for various drugs of abuse. With amphetamine and cocaine, initiation of reward is controlled within the nucleus accumbens and prefrontal cortex, respectively. With opiates, initiation of reward involves the ventral tegmental area, nucleus accumbens, hippocampus, and hypothalamus. It is not clear presently if these multiple anatomical structures mediate opiate reward by converging on a single output system or multiple output systems.

Reward contingencies and the recalibration of task monitoring and reward systems: a high-density electrical mapping study.

PubMed

Morie, K P; De Sanctis, P; Foxe, J J

2014-07-25

Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task-monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward-seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density electroencephalography (EEG) recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task-preparatory and task-monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task-preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task-monitoring processes are clearly dissociable, but interact across very fast timescales to update reward predictions as information about task success or failure is accrued. Careful delineation of these processes will be useful in future investigations in clinical groups where such processes are suspected of having gone awry. Copyright © 2014 IBRO. Published by Elsevier Ltd. All rights reserved.

Reward Contingencies and the Recalibration of Task Monitoring and Reward Systems: A high-density electrical mapping study

PubMed Central

Morie, Kristen P.; De Sanctis, Pierfilippo; Foxe, John J.

2014-01-01

Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density EEG recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task preparatory and task monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task monitoring processes are clearly dissociable, but interact across very fast timescales to update reward predictions as information about task success or failure is accrued. Careful delineation of these processes will be useful in future investigations in clinical groups where such processes are suspected of having gone awry. PMID:24836852

Reward sensitivity is associated with brain activity during erotic stimulus processing.

PubMed

Costumero, Victor; Barrós-Loscertales, Alfonso; Bustamante, Juan Carlos; Ventura-Campos, Noelia; Fuentes, Paola; Rosell-Negre, Patricia; Ávila, César

2013-01-01

The behavioral approach system (BAS) from Gray's reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray's theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men completed the Sensitivity to Reward scale (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire) to measure BAS-related traits. Results showed that Sensitivity to Reward scores correlated positively with brain activity during reactivity to erotic pictures in the left orbitofrontal cortex, left insula, and right ventral striatum. These results demonstrated a relationship between the BAS and reward sensitivity during the processing of erotic stimuli, filling the gap of previous reports that identified the dopaminergic system as a neural substrate for the BAS during the processing of other rewarding stimuli such as money and food.

Reward Sensitivity Is Associated with Brain Activity during Erotic Stimulus Processing

PubMed Central

Costumero, Victor; Barrós-Loscertales, Alfonso; Bustamante, Juan Carlos; Ventura-Campos, Noelia; Fuentes, Paola; Rosell-Negre, Patricia; Ávila, César

2013-01-01

The behavioral approach system (BAS) from Gray’s reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray’s theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men completed the Sensitivity to Reward scale (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire) to measure BAS-related traits. Results showed that Sensitivity to Reward scores correlated positively with brain activity during reactivity to erotic pictures in the left orbitofrontal cortex, left insula, and right ventral striatum. These results demonstrated a relationship between the BAS and reward sensitivity during the processing of erotic stimuli, filling the gap of previous reports that identified the dopaminergic system as a neural substrate for the BAS during the processing of other rewarding stimuli such as money and food. PMID:23840558

Motivation and timing: Clues for modeling the reward system

PubMed Central

Galtress, Tiffany; Marshall, Andrew T.; Kirkpatrick, Kimberly

2012-01-01

There is growing evidence that a change in reward magnitude or value alters interval timing, indicating that motivation and timing are not independent processes as was previously believed. The present paper reviews several recent studies, as well as presenting some new evidence with further manipulations of reward value during training vs. testing on a peak procedure. The combined results cannot be accounted for by any of the current psychological timing theories. However, in examining the neural circuitry of the reward system, it is not surprising that motivation has an impact on timing because the motivation/valuation system directly interfaces with the timing system. A new approach is proposed for the development of the next generation of timing models, which utilizes knowledge of the neuroanatomy and neurophysiology of the reward system to guide the development of a neurocomputational model of the reward system. The initial foundation along with heuristics for proceeding with developing such a model is unveiled in an attempt to stimulate new theoretical approaches in the field. PMID:22421220

Prediction-error in the context of real social relationships modulates reward system activity.

PubMed

Poore, Joshua C; Pfeifer, Jennifer H; Berkman, Elliot T; Inagaki, Tristen K; Welborn, Benjamin L; Lieberman, Matthew D

2012-01-01

The human reward system is sensitive to both social (e.g., validation) and non-social rewards (e.g., money) and is likely integral for relationship development and reputation building. However, data is sparse on the question of whether implicit social reward processing meaningfully contributes to explicit social representations such as trust and attachment security in pre-existing relationships. This event-related fMRI experiment examined reward system prediction-error activity in response to a potent social reward-social validation-and this activity's relation to both attachment security and trust in the context of real romantic relationships. During the experiment, participants' expectations for their romantic partners' positive regard of them were confirmed (validated) or violated, in either positive or negative directions. Primary analyses were conducted using predefined regions of interest, the locations of which were taken from previously published research. Results indicate that activity for mid-brain and striatal reward system regions of interest was modulated by social reward expectation violation in ways consistent with prior research on reward prediction-error. Additionally, activity in the striatum during viewing of disconfirmatory information was associated with both increases in post-scan reports of attachment anxiety and decreases in post-scan trust, a finding that follows directly from representational models of attachment and trust.

Brain reward system's alterations in response to food and monetary stimuli in overweight and obese individuals.

PubMed

Verdejo-Román, Juan; Vilar-López, Raquel; Navas, Juan F; Soriano-Mas, Carles; Verdejo-García, Antonio

2017-02-01

The brain's reward system is crucial to understand obesity in modern society, as increased neural responsivity to reward can fuel the unhealthy food choices that are driving the growing obesity epidemic. Brain's reward system responsivity to food and monetary rewards in individuals with excessive weight (overweight and obese) versus normal weight controls, along with the relationship between this responsivity and body mass index (BMI) were tested. The sample comprised 21 adults with obesity (BMI > 30), 21 with overweight (BMI between 25 and 30), and 39 with normal weight (BMI < 25). Participants underwent a functional magnetic resonance imaging (fMRI) session while performing two tasks that involve the processing of food (Willing to Pay) and monetary rewards (Monetary Incentive Delay). Neural activations within the brain reward system were compared across the three groups. Curve fit analyses were conducted to establish the association between BMI and brain reward system's response. Individuals with obesity had greater food-evoked responsivity in the dorsal and ventral striatum compared with overweight and normal weight groups. There was an inverted U-shape association between BMI and monetary-evoked responsivity in the ventral striatum, medial frontal cortex, and amygdala; that is, individuals with BMIs between 27 and 32 had greater responsivity to monetary stimuli. Obesity is associated with greater food-evoked responsivity in the ventral and dorsal striatum, and overweight is associated with greater monetary-evoked responsivity in the ventral striatum, the amygdala, and the medial frontal cortex. Findings suggest differential reactivity of the brain's reward system to food versus monetary rewards in obesity and overweight. Hum Brain Mapp 38:666-677, 2017. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

An Analysis of the Civilian Employee Reward System in use at Naval Air Warfare Center, Patuxent River, Maryland

DTIC Science & Technology

1999-12-01

relative deprivation. If A and B have different rewards, distributive justice may still exist as long as person A feels that their level of investment to...example could be rewarding an assembly line for number of units produced (outcome) versus the degree of quality control (process). Even if quotas are...between reward preferences of one job type versus another. Perhaps most relevant to this thesis are the studies which have examined reward system

Assessing and Rewarding Excellent Academic Teachers for the Benefit of an Organization

ERIC Educational Resources Information Center

Olsson, Thomas; Roxå, Torgny

2013-01-01

In this article we describe and analyse a system for rewarding excellence in university teaching developed at the Faculty of Engineering at Lund University in Sweden. Individual teachers are rewarded for the effort they invest in the support of student learning. However, it is the organization that establishes a reward system and it does so for…

Dopamine modulates reward system activity during subconscious processing of sexual stimuli.

PubMed

Oei, Nicole Y L; Rombouts, Serge Arb; Soeter, Roelof P; van Gerven, Joop M; Both, Stephanie

2012-06-01

Dopaminergic medication influences conscious processing of rewarding stimuli, and is associated with impulsive-compulsive behaviors, such as hypersexuality. Previous studies have shown that subconscious subliminal presentation of sexual stimuli activates brain areas known to be part of the 'reward system'. In this study, it was hypothesized that dopamine modulates activation in key areas of the reward system, such as the nucleus accumbens, during subconscious processing of sexual stimuli. Young healthy males (n=53) were randomly assigned to two experimental groups or a control group, and were administered a dopamine antagonist (haloperidol), a dopamine agonist (levodopa), or placebo. Brain activation was assessed during a backward-masking task with subliminally presented sexual stimuli. Results showed that levodopa significantly enhanced the activation in the nucleus accumbens and dorsal anterior cingulate when subliminal sexual stimuli were shown, whereas haloperidol decreased activations in those areas. Dopamine thus enhances activations in regions thought to regulate 'wanting' in response to potentially rewarding sexual stimuli that are not consciously perceived. This running start of the reward system might explain the pull of rewards in individuals with compulsive reward-seeking behaviors such as hypersexuality and patients who receive dopaminergic medication.

A systematic review of fMRI reward paradigms used in studies of adolescents vs. adults: the impact of task design and implications for understanding neurodevelopment.

PubMed

Richards, Jessica M; Plate, Rista C; Ernst, Monique

2013-06-01

The neural systems underlying reward-related behaviors across development have recently generated a great amount of interest. Yet, the neurodevelopmental literature on reward processing is marked by inconsistencies due to the heterogeneity of the reward paradigms used, the complexity of the behaviors being studied, and the developing brain itself as a moving target. The present review will examine task design as one source of variability across findings by compiling this literature along three dimensions: (1) task structures, (2) cognitive processes, and (3) neural systems. We start with the presentation of a heuristic neural systems model, the Triadic Model, as a way to provide a theoretical framework for the neuroscience research on motivated behaviors. We then discuss the principles guiding reward task development. Finally, we review the extant developmental neuroimaging literature on reward-related processing, organized by reward task type. We hope that this approach will help to clarify the literature on the functional neurodevelopment of reward-related neural systems, and to identify the role of the experimental parameters that significantly influence these findings. Published by Elsevier Ltd.

Food reward system: current perspectives and future research needs.

PubMed

Alonso-Alonso, Miguel; Woods, Stephen C; Pelchat, Marcia; Grigson, Patricia Sue; Stice, Eric; Farooqi, Sadaf; Khoo, Chor San; Mattes, Richard D; Beauchamp, Gary K

2015-05-01

This article reviews current research and cross-disciplinary perspectives on the neuroscience of food reward in animals and humans, examines the scientific hypothesis of food addiction, discusses methodological and terminology challenges, and identifies knowledge gaps and future research needs. Topics addressed herein include the role of reward and hedonic aspects in the regulation of food intake, neuroanatomy and neurobiology of the reward system in animals and humans, responsivity of the brain reward system to palatable foods and drugs, translation of craving versus addiction, and cognitive control of food reward. The content is based on a workshop held in 2013 by the North American Branch of the International Life Sciences Institute. © The Author(s) 2015. Published by Oxford University Press on behalf of the International Life Sciences Institute.

Modeling effects of intrinsic and extrinsic rewards on the competition between striatal learning systems.

PubMed

Boedecker, Joschka; Lampe, Thomas; Riedmiller, Martin

2013-01-01

A common assumption in psychology, economics, and other fields holds that higher performance will result if extrinsic rewards (such as money) are offered as an incentive. While this principle seems to work well for tasks that require the execution of the same sequence of steps over and over, with little uncertainty about the process, in other cases, especially where creative problem solving is required due to the difficulty in finding the optimal sequence of actions, external rewards can actually be detrimental to task performance. Furthermore, they have the potential to undermine intrinsic motivation to do an otherwise interesting activity. In this work, we extend a computational model of the dorsomedial and dorsolateral striatal reinforcement learning systems to account for the effects of extrinsic and intrinsic rewards. The model assumes that the brain employs both a goal-directed and a habitual learning system, and competition between both is based on the trade-off between the cost of the reasoning process and value of information. The goal-directed system elicits internal rewards when its models of the environment improve, while the habitual system, being model-free, does not. Our results account for the phenomena that initial extrinsic reward leads to reduced activity after extinction compared to the case without any initial extrinsic rewards, and that performance in complex task settings drops when higher external rewards are promised. We also test the hypothesis that external rewards bias the competition in favor of the computationally efficient, but cruder and less flexible habitual system, which can negatively influence intrinsic motivation and task performance in the class of tasks we consider.

Registered nurses' experiences of rewarding in a Finnish University Hospital - an interview study.

PubMed

Seitovirta, Jaana; Partanen, Pirjo; Vehviläinen-Julkunen, Katri; Kvist, Tarja

2015-10-01

The purpose was to describe Finnish registered nurses' experiences of rewarding. The aim was to gather detailed information on the rewarding of nurses to help nurse managers and leaders to update existing reward strategy and to develop an effective reward system. Rewarding has been found positively to influence nurses' occupational well-being and commitment to their work, and the attractiveness of the health care field. A series of focused interviews with 10 registered nurses was conducted in 2011. Qualitative content analysis method was used. The nurses reported positive experiences with rewarding in the form of monetary compensation and other benefits, the positive aspects of nursing work and opportunities for professional development. The experiences of unsatisfactory rewarding generally stemmed from negative emotional experiences, lacking rewards and inequality in rewarding. It is essential to listen to nurses and to provide appropriate acknowledgement and appreciation of their work in order to develop an effective reward system. It is important to listen to nurses' experiences of rewarding because it enables nurse managers to maintain and increase the attractiveness of nursing and health care work in general. © 2014 John Wiley & Sons Ltd.

Pain and suicidality: insights from reward and addiction neuroscience.

PubMed

Elman, Igor; Borsook, David; Volkow, Nora D

2013-10-01

Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system's role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward circuitry); both are relevant etiologic factors in pain, suicide and social attachments. A comprehensive literature search on neurobiology of pain and suicidality was performed. The collected articles were critically reviewed and relevant data were extracted and summarized within four key areas: (1) physical and emotional pain, (2) emotional pain and social attachments, (3) pain- and suicide-related alterations of the reward and anti-reward circuits as compared to addiction, which is the premier probe for dysfunction of these circuits and (4) mechanistically informed treatments of co-occurring pain and suicidality. Pain-, stress- and analgesic drugs-induced opponent and proponent states of the mesolimbic dopaminergic pathways may render reward and anti-reward systems vulnerable to sensitization, cross-sensitization and aberrant learning of contents and contexts associated with suicidal acts and behaviors. These findings suggest that pain patients exhibit alterations in the brain circuits mediating reward (depressed function) and anti-reward (sensitized function) that may affect their proclivity for suicide and support pain and suicidality classification among other "reward deficiency syndromes" and a new proposal for "enhanced anti-reward syndromes". We suggest that interventions aimed at restoring the balance between the reward and anti-reward networks in patients with chronic pain may help decreasing their suicide risk. Published by Elsevier Ltd.

Regulating task-monitoring systems in response to variable reward contingencies and outcomes in cocaine addicts.

PubMed

Morie, Kristen P; De Sanctis, Pierfilippo; Garavan, Hugh; Foxe, John J

2016-03-01

We investigated anticipatory and consummatory reward processing in cocaine addiction. In addition, we set out to assess whether task-monitoring systems were appropriately recalibrated in light of variable reward schedules. We also examined neural measures of task-monitoring and reward processing as a function of hedonic tone, since anhedonia is a vulnerability marker for addiction that is obviously germane in the context of reward processing. High-density event-related potentials were recorded while participants performed a speeded response task that systematically varied anticipated probabilities of reward receipt. The paradigm dissociated feedback regarding task success (or failure) from feedback regarding the value of reward (or loss), so that task-monitoring and reward processing could be examined in partial isolation. Twenty-three active cocaine abusers and 23 age-matched healthy controls participated. Cocaine abusers showed amplified anticipatory responses to reward predictive cues, but crucially, these responses were not as strongly modulated by reward probability as in controls. Cocaine users also showed blunted responses to feedback about task success or failure and did not use this information to update predictions about reward. In turn, they showed clearly blunted responses to reward feedback. In controls and users, measures of anhedonia were associated with reward motivation. In cocaine users, anhedonia was also associated with diminished monitoring and reward feedback responses. Findings imply that reward anticipation and monitoring deficiencies in addiction are associated with increased responsiveness to reward cues but impaired ability to predict reward in light of task contingencies, compounded by deficits in responding to actual reward outcomes.

A performability solution method for degradable nonrepairable systems

NASA Technical Reports Server (NTRS)

Furchtgott, D. G.; Meyer, J. F.

1984-01-01

The present performability model-solving algorithm identifies performance with 'reward', representing the state behavior of a system S by a finite-state stochastic process and determining reward by means of reward rates that are associated with the states of the base model. A general method is obtained for determining the probability distribution function of the performance (reward) variable, and therefore the performability, of the corresponding system. This is done for bounded utilization periods, and the result is an integral expression which is either analytically or numerically solvable.

The role of the central ghrelin system in reward from food and chemical drugs.

PubMed

Dickson, Suzanne L; Egecioglu, Emil; Landgren, Sara; Skibicka, Karolina P; Engel, Jörgen A; Jerlhag, Elisabet

2011-06-20

Here we review recent advances that identify a role for the central ghrelin signalling system in reward from both natural rewards (such as food) and artificial rewards (that include alcohol and drugs of abuse). Whereas ghrelin emerged as a stomach-derived hormone involved in energy balance, hunger and meal initiation via hypothalamic circuits, it now seems clear that it also has a role in motivated reward-driven behaviours via activation of the so-called "cholinergic-dopaminergic reward link". This reward link comprises a dopamine projection from the ventral tegmental area (VTA) to the nucleus accumbens together with a cholinergic input, arising primarily from the laterodorsal tegmental area. Ghrelin administration into the VTA or LDTg activates the "cholinergic-dopaminergic" reward link, suggesting that ghrelin may increase the incentive value of motivated behaviours such as reward-seeking behaviour ("wanting" or "incentive motivation"). Further, direct injection of ghrelin into the brain ventricles or into the VTA increases the consumption of rewarding foods as well as alcohol in mice and rats. Studies in rodents show beneficial effects of ghrelin receptor (GHS-R1A) antagonists to suppress the intake of palatable food, to reduce preference for caloric foods, to suppress food reward and motivated behaviour for food. They have also been shown to reduce alcohol consumption, suppress reward induced by alcohol, cocaine and amphetamine. Furthermore, variations in the GHS-R1A and pro-ghrelin genes have been associated with high alcohol consumption, smoking and increased weight gain in alcohol dependent individuals as well as with bulimia nervosa and obesity. Thus, the central ghrelin signalling system interfaces neurobiological circuits involved in reward from food as well as chemical drugs; agents that directly or indirectly suppress this system emerge as potential candidate drugs for suppressing problematic over-eating that leads to obesity as well as for the treatment of substance use disorder. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Motivation and timing: clues for modeling the reward system.

PubMed

Galtress, Tiffany; Marshall, Andrew T; Kirkpatrick, Kimberly

2012-05-01

There is growing evidence that a change in reward magnitude or value alters interval timing, indicating that motivation and timing are not independent processes as was previously believed. The present paper reviews several recent studies, as well as presenting some new evidence with further manipulations of reward value during training vs. testing on a peak procedure. The combined results cannot be accounted for by any of the current psychological timing theories. However, in examining the neural circuitry of the reward system, it is not surprising that motivation has an impact on timing because the motivation/valuation system directly interfaces with the timing system. A new approach is proposed for the development of the next generation of timing models, which utilizes knowledge of the neuroanatomy and neurophysiology of the reward system to guide the development of a neurocomputational model of the reward system. The initial foundation along with heuristics for proceeding with developing such a model is unveiled in an attempt to stimulate new theoretical approaches in the field. Copyright © 2012 Elsevier B.V. All rights reserved.

The endocannabinoid system and nondrug rewarding behaviours.

PubMed

Fattore, Liana; Melis, Miriam; Fadda, Paola; Pistis, Marco; Fratta, Walter

2010-07-01

Rewarding behaviours such as sexual activity, eating, nursing, parenting, social interactions, and play activity are conserved strongly in evolution, and they are essential for development and survival. All of these behaviours are enjoyable and represent pleasant experiences with a high reward value. Remarkably, rewarding behaviours activate the same brain circuits that mediate the positive reinforcing effects of drugs of abuse and of other forms of addiction, such as gambling and food addiction. Given the involvement of the endocannabinoid system in a variety of physiological functions of the nervous system, it is not surprising that it takes part in the complex machinery that regulates gratification and perception of pleasure. In this review, we focus first on the role of the endocannabinoid system in the modulation of neural activity and synaptic functions in brain regions that are involved in natural and nonnatural rewards (namely, the ventral tegmental area, striatum, amygdala, and prefrontal cortex). Then, we examine the role of the endocannabinoid system in modulating behaviours that directly or indirectly activate these brain reward pathways. More specifically, current knowledge of the effects of the pharmacological manipulation of the endocannabinoid system on natural (eating, sexual behaviour, parenting, and social play) and pathological (gambling) rewarding behaviours is summarised and discussed. Copyright 2010 Elsevier Inc. All rights reserved.

Rewards and advancements for clinical pharmacists.

PubMed

Goodwin, S Diane; Kane-Gill, Sandra L; Ng, Tien M H; Melroy, Joel T; Hess, Mary M; Tallian, Kimberly; Trujillo, Toby C; Vermeulen, Lee C

2010-01-01

The American College of Clinical Pharmacy charged the Clinical Practice Affairs Committee to review and update the College's 1995 White Paper, "Rewards and Advancements for Clinical Pharmacy Practitioners." Because of the limited data on the present state of rewards and advancements for clinical pharmacists, an online survey of "front-line" clinical pharmacists and pharmacy managers was conducted (1126 total respondents, 14% response rate). The resulting White Paper discusses motivators and existing systems of rewards and advancements for clinical pharmacists, as well as perceived barriers to implementation of these systems. Clinical pharmacists reported work-life balance, a challenging position, and opportunities for professional advancement as the most important factors for career success. At the time of the survey, financial rewards appeared not to be a major motivator for clinical pharmacists. Managers underestimated the importance that clinical pharmacists place on work-life balance and favorable work schedules. Although almost two thirds of the clinical pharmacists surveyed had not developed a professional development plan, 84% indicated an interest in career planning. Both clinical pharmacists and managers rated the lack of a clear reward and advancement structure as the most important barrier to effective systems of rewards and advancements. Pharmacy managers and administrators are encouraged to develop effective systems of rewards and advancements for clinical pharmacists that positively impact patient care and the institution's mission; these systems will benefit the clinical pharmacist, the health care institution, and the patient.

Failure analysis and modeling of a multicomputer system. M.S. Thesis

NASA Technical Reports Server (NTRS)

Subramani, Sujatha Srinivasan

1990-01-01

This thesis describes the results of an extensive measurement-based analysis of real error data collected from a 7-machine DEC VaxCluster multicomputer system. In addition to evaluating basic system error and failure characteristics, we develop reward models to analyze the impact of failures and errors on the system. The results show that, although 98 percent of errors in the shared resources recover, they result in 48 percent of all system failures. The analysis of rewards shows that the expected reward rate for the VaxCluster decreases to 0.5 in 100 days for a 3 out of 7 model, which is well over a 100 times that for a 7-out-of-7 model. A comparison of the reward rates for a range of k-out-of-n models indicates that the maximum increase in reward rate (0.25) occurs in going from the 6-out-of-7 model to the 5-out-of-7 model. The analysis also shows that software errors have the lowest reward (0.2 vs. 0.91 for network errors). The large loss in reward rate for software errors is due to the fact that a large proportion (94 percent) of software errors lead to failure. In comparison, the high reward rate for network errors is due to fast recovery from a majority of these errors (median recovery duration is 0 seconds).

Individual variation in incentive salience attribution and accumbens dopamine transporter expression and function.

PubMed

Singer, Bryan F; Guptaroy, Bipasha; Austin, Curtis J; Wohl, Isabella; Lovic, Vedran; Seiler, Jillian L; Vaughan, Roxanne A; Gnegy, Margaret E; Robinson, Terry E; Aragona, Brandon J

2016-03-01

Cues (conditioned stimuli; CSs) associated with rewards can come to motivate behavior, but there is considerable individual variation in their ability to do so. For example, a lever-CS that predicts food reward becomes attractive and wanted, and elicits reward-seeking behavior, to a greater extent in some rats ('sign-trackers'; STs) than others ('goal-trackers'; GTs). Variation in dopamine (DA) neurotransmission in the nucleus accumbens (NAc) core is thought to contribute to such individual variation. Given that the DA transporter (DAT) exerts powerful regulation over DA signaling, we characterized the expression and function of the DAT in the accumbens of STs and GTs. STs showed greater DAT surface expression in ventral striatal synaptosomes than GTs, and ex vivo fast-scan cyclic voltammetry recordings of electrically evoked DA release confirmed enhanced DAT function in STs, as indicated by faster DA uptake, specifically in the NAc core. Consistent with this, systemic amphetamine (AMPH) produced greater inhibition of DA uptake in STs than in GTs. Furthermore, injection of AMPH directly into the NAc core enhanced lever-directed approach in STs, presumably by amplifying the incentive value of the CS, but had no effect on goal-tracking behavior. On the other hand, there were no differences between STs and GTs in electrically-evoked DA release in slices, or in total ventral striatal DA content. We conclude that greater DAT surface expression may facilitate the attribution of incentive salience to discrete reward cues. Investigating this variability in animal sub-populations may help explain why some people abuse drugs while others do not. © 2015 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

The effects of AMPA receptor blockade in the prelimbic cortex on systemic and ventral tegmental area opiate reward sensitivity.

PubMed

De Jaeger, Xavier; Bishop, Stephanie F; Ahmad, Tasha; Lyons, Danika; Ng, Garye Ami; Laviolette, Steven R

2013-02-01

The medial prefrontal cortex (mPFC) is a key neural region involved in opiate-related reward memory processing. AMPA receptor transmission in the mPFC modulates opiate-related reward memory processing, and chronic opiate exposure is associated with alterations in intra-mPFC AMPA receptor function. The objectives of this study were to examine how pharmacological blockade of AMPA receptor transmission in the prelimbic (PLC) division of the mPFC may modulate opiate reward memory acquisition and whether opiate exposure state may modulate the functional role of intra-PLC AMPA receptor transmission during opiate reward learning. Using an unbiased conditioned place preference (CPP) procedure in rats, we performed discrete, bilateral intra-PLC microinfusions of the AMPA receptor antagonist, 6,7-dinitroquinoxaline-2,3-dione, prior to behavioral morphine CPP conditioning, using sub-reward threshold conditioning doses of either systemic (0.05 mg/kg; i.p.) or intra-ventral tegmental area (VTA) morphine (250 ng/0.5 μl). We show that, in both opiate-naïve and opiate-dependent states, intra-PLC blockade of AMPA receptor transmission, but not the infralimbic cortex, increases the behavioral reward magnitude of systemic or intra-VTA morphine. This effect is dependent on dopamine (DA)ergic signaling because pre-administration of cis-(Z)-flupenthixol-dihydrochloride (α-flu), a broad-spectrum dopamine receptor antagonist, blocked the morphine-reward potentiating effects of AMPA receptor blockade. These findings suggest a critical role for intra-PLC AMPA receptor transmission in the processing of opiate reward signaling. Furthermore, blockade of AMPA transmission specifically within the PLC is capable of switching opiate reward processing to a DA-dependent reward system, independently of previous opiate exposure history.

Reward-centricity and attenuated aversions: An adolescent phenotype emerging from studies in laboratory animals

PubMed Central

Doremus-Fitzwater, Tamara L.; Spear, Linda P.

2016-01-01

Adolescence is an evolutionarily conserved developmental period, with neural circuits and behaviors contributing to the detection, procurement, and receipt of rewards bearing similarity across species. Studies with laboratory animals suggest that adolescence is typified by a “reward-centric” phenotype—an increased sensitivity to rewards relative to adults. In contrast, adolescent rodents are reportedly less sensitive to the aversive properties of many drugs and naturally aversive stimuli. Alterations within the mesocorticolimbic dopamine and endocannabinoid systems likely contribute to an adolescent reward-sensitive, yet aversion-resistant, phenotype. Although early hypotheses postulated that developmental changes in dopaminergic circuitry would result in a “reward deficiency” syndrome, evidence now suggests the opposite: that adolescents are uniquely poised to seek out hedonic stimuli, experience greater “pleasure” from rewards, and consume rewarding stimuli in excess. Future studies that more clearly define the role of specific brain regions and neurotransmitter systems in the expression of behaviors toward reward- and aversive-related cues and stimuli are necessary to more fully understand an adolescent-proclivity for and vulnerability to rewards and drugs of potential abuse. PMID:27524639

Reward-centricity and attenuated aversions: An adolescent phenotype emerging from studies in laboratory animals.

PubMed

Doremus-Fitzwater, Tamara L; Spear, Linda P

2016-11-01

Adolescence is an evolutionarily conserved developmental period, with neural circuits and behaviors contributing to the detection, procurement, and receipt of rewards bearing similarity across species. Studies with laboratory animals suggest that adolescence is typified by a "reward-centric" phenotype-an increased sensitivity to rewards relative to adults. In contrast, adolescent rodents are reportedly less sensitive to the aversive properties of many drugs and naturally aversive stimuli. Alterations within the mesocorticolimbic dopamine and endocannabinoid systems likely contribute to an adolescent reward-sensitive, yet aversion-resistant, phenotype. Although early hypotheses postulated that developmental changes in dopaminergic circuitry would result in a "reward deficiency" syndrome, evidence now suggests the opposite: that adolescents are uniquely poised to seek out hedonic stimuli, experience greater "pleasure" from rewards, and consume rewarding stimuli in excess. Future studies that more clearly define the role of specific brain regions and neurotransmitter systems in the expression of behaviors toward reward- and aversive-related cues and stimuli are necessary to more fully understand an adolescent-proclivity for and vulnerability to rewards and drugs of potential abuse. Copyright © 2016 Elsevier Ltd. All rights reserved.

5 CFR 9701.409 - Rating and rewarding performance.

Code of Federal Regulations, 2014 CFR

2014-01-01

... MANAGEMENT SYSTEM (DEPARTMENT OF HOMELAND SECURITY-OFFICE OF PERSONNEL MANAGEMENT) DEPARTMENT OF HOMELAND SECURITY HUMAN RESOURCES MANAGEMENT SYSTEM Performance Management § 9701.409 Rating and rewarding... 5 Administrative Personnel 3 2014-01-01 2014-01-01 false Rating and rewarding performance. 9701...

5 CFR 9701.409 - Rating and rewarding performance.

Code of Federal Regulations, 2012 CFR

2012-01-01

... MANAGEMENT SYSTEM (DEPARTMENT OF HOMELAND SECURITY-OFFICE OF PERSONNEL MANAGEMENT) DEPARTMENT OF HOMELAND SECURITY HUMAN RESOURCES MANAGEMENT SYSTEM Performance Management § 9701.409 Rating and rewarding... 5 Administrative Personnel 3 2012-01-01 2012-01-01 false Rating and rewarding performance. 9701...

5 CFR 9701.409 - Rating and rewarding performance.

Code of Federal Regulations, 2011 CFR

2011-01-01

... MANAGEMENT SYSTEM (DEPARTMENT OF HOMELAND SECURITY-OFFICE OF PERSONNEL MANAGEMENT) DEPARTMENT OF HOMELAND SECURITY HUMAN RESOURCES MANAGEMENT SYSTEM Performance Management § 9701.409 Rating and rewarding... 5 Administrative Personnel 3 2011-01-01 2011-01-01 false Rating and rewarding performance. 9701...

5 CFR 9901.412 - Rating and rewarding performance.

Code of Federal Regulations, 2011 CFR

2011-01-01

... LABOR RELATIONS SYSTEMS (DEPARTMENT OF DEFENSE-OFFICE OF PERSONNEL MANAGEMENT) DEPARTMENT OF DEFENSE NATIONAL SECURITY PERSONNEL SYSTEM (NSPS) Performance Management § 9901.412 Rating and rewarding... 5 Administrative Personnel 3 2011-01-01 2011-01-01 false Rating and rewarding performance. 9901...

5 CFR 9701.409 - Rating and rewarding performance.

Code of Federal Regulations, 2013 CFR

2013-01-01

... MANAGEMENT SYSTEM (DEPARTMENT OF HOMELAND SECURITY-OFFICE OF PERSONNEL MANAGEMENT) DEPARTMENT OF HOMELAND SECURITY HUMAN RESOURCES MANAGEMENT SYSTEM Performance Management § 9701.409 Rating and rewarding... 5 Administrative Personnel 3 2013-01-01 2013-01-01 false Rating and rewarding performance. 9701...

5 CFR 9901.412 - Rating and rewarding performance.

Code of Federal Regulations, 2010 CFR

2010-01-01

... LABOR RELATIONS SYSTEMS (DEPARTMENT OF DEFENSE-OFFICE OF PERSONNEL MANAGEMENT) DEPARTMENT OF DEFENSE NATIONAL SECURITY PERSONNEL SYSTEM (NSPS) Performance Management § 9901.412 Rating and rewarding... 5 Administrative Personnel 3 2010-01-01 2010-01-01 false Rating and rewarding performance. 9901...

Altered resting-state functional connectivity of the frontal-striatal reward system in social anxiety disorder.

PubMed

Manning, Joshua; Reynolds, Gretchen; Saygin, Zeynep M; Hofmann, Stefan G; Pollack, Mark; Gabrieli, John D E; Whitfield-Gabrieli, Susan

2015-01-01

We investigated differences in the intrinsic functional brain organization (functional connectivity) of the human reward system between healthy control participants and patients with social anxiety disorder. Functional connectivity was measured in the resting-state via functional magnetic resonance imaging (fMRI). 53 patients with social anxiety disorder and 33 healthy control participants underwent a 6-minute resting-state fMRI scan. Functional connectivity of the reward system was analyzed by calculating whole-brain temporal correlations with a bilateral nucleus accumbens seed and a ventromedial prefrontal cortex seed. Patients with social anxiety disorder, relative to the control group, had (1) decreased functional connectivity between the nucleus accumbens seed and other regions associated with reward, including ventromedial prefrontal cortex; (2) decreased functional connectivity between the ventromedial prefrontal cortex seed and lateral prefrontal regions, including the anterior and dorsolateral prefrontal cortices; and (3) increased functional connectivity between both the nucleus accumbens seed and the ventromedial prefrontal cortex seed with more posterior brain regions, including anterior cingulate cortex. Social anxiety disorder appears to be associated with widespread differences in the functional connectivity of the reward system, including markedly decreased functional connectivity between reward regions and between reward regions and lateral prefrontal cortices, and markedly increased functional connectivity between reward regions and posterior brain regions.

Deficits in context-dependent adaptive coding of reward in schizophrenia

PubMed Central

Kirschner, Matthias; Hager, Oliver M; Bischof, Martin; Hartmann-Riemer, Matthias N; Kluge, Agne; Seifritz, Erich; Tobler, Philippe N; Kaiser, Stefan

2016-01-01

Theoretical principles of information processing and empirical findings suggest that to efficiently represent all possible rewards in the natural environment, reward-sensitive neurons have to adapt their coding range dynamically to the current reward context. Adaptation ensures that the reward system is most sensitive for the most likely rewards, enabling the system to efficiently represent a potentially infinite range of reward information. A deficit in neural adaptation would prevent precise representation of rewards and could have detrimental effects for an organism’s ability to optimally engage with its environment. In schizophrenia, reward processing is known to be impaired and has been linked to different symptom dimensions. However, despite the fundamental significance of coding reward adaptively, no study has elucidated whether adaptive reward processing is impaired in schizophrenia. We therefore studied patients with schizophrenia (n=27) and healthy controls (n=25), using functional magnetic resonance imaging in combination with a variant of the monetary incentive delay task. Compared with healthy controls, patients with schizophrenia showed less efficient neural adaptation to the current reward context, which leads to imprecise neural representation of reward. Importantly, the deficit correlated with total symptom severity. Our results suggest that some of the deficits in reward processing in schizophrenia might be due to inefficient neural adaptation to the current reward context. Furthermore, because adaptive coding is a ubiquitous feature of the brain, we believe that our findings provide an avenue in defining a general impairment in neural information processing underlying this debilitating disorder. PMID:27430009

Personality correlates of individual differences in the recruitment of cognitive mechanisms when rewards are at stake.

PubMed

Heritage, Allan J; Long, Laura J; Woodman, Geoffrey F; Zald, David H

2018-02-01

Individuals differ greatly in their sensitivity to rewards and punishments. In the extreme, these differences are implicated in a range of psychiatric disorders from addiction to depression. However, it is unclear how these differences influence the recruitment of attention, working memory, and long-term memory when responding to potential rewards. Here, we used a rewarded memory-guided visual search task and ERPs to examine the influence of individual differences in self-reported reward/punishment sensitivity, as measured by the Behavioral Inhibition System (BIS)/Behavioral Activation System (BAS) scales, on the recruitment of cognitive mechanisms in conditions of potential reward. Select subscales of the BAS, including the fun seeking and reward responsiveness scales, showed unique relationships with context updating to reward cues and working memory maintenance of potentially rewarded stimuli. In contrast, BIS scores showed unique relationships with deployment of attention at different points in the task. These results suggest that sensitivity to rewards (i.e., BAS) and to punishment (i.e., BIS) may play an important role in the recruitment of specific and distinct cognitive mechanisms in conditions of potential rewards. © 2017 Society for Psychophysiological Research.

Modeling effects of intrinsic and extrinsic rewards on the competition between striatal learning systems

PubMed Central

Boedecker, Joschka; Lampe, Thomas; Riedmiller, Martin

2013-01-01

A common assumption in psychology, economics, and other fields holds that higher performance will result if extrinsic rewards (such as money) are offered as an incentive. While this principle seems to work well for tasks that require the execution of the same sequence of steps over and over, with little uncertainty about the process, in other cases, especially where creative problem solving is required due to the difficulty in finding the optimal sequence of actions, external rewards can actually be detrimental to task performance. Furthermore, they have the potential to undermine intrinsic motivation to do an otherwise interesting activity. In this work, we extend a computational model of the dorsomedial and dorsolateral striatal reinforcement learning systems to account for the effects of extrinsic and intrinsic rewards. The model assumes that the brain employs both a goal-directed and a habitual learning system, and competition between both is based on the trade-off between the cost of the reasoning process and value of information. The goal-directed system elicits internal rewards when its models of the environment improve, while the habitual system, being model-free, does not. Our results account for the phenomena that initial extrinsic reward leads to reduced activity after extinction compared to the case without any initial extrinsic rewards, and that performance in complex task settings drops when higher external rewards are promised. We also test the hypothesis that external rewards bias the competition in favor of the computationally efficient, but cruder and less flexible habitual system, which can negatively influence intrinsic motivation and task performance in the class of tasks we consider. PMID:24137146

Bidirectional interactions between the circadian and reward systems: is restricted food access a unique zeitgeber?

PubMed

Webb, Ian C; Baltazar, Ricardo M; Lehman, Michael N; Coolen, Lique M

2009-11-01

Reward is mediated by a distributed series of midbrain and basal forebrain structures collectively referred to as the brain reward system. Recent evidence indicates that an additional regulatory system, the circadian system, can modulate reward-related learning. Diurnal or circadian changes in drug self-administration, responsiveness to drugs of abuse and reward to natural stimuli have been reported. These variations are associated with daily rhythms in mesolimbic electrical activity, dopamine synthesis and metabolism, and local clock gene oscillations. Conversely, the presentation of rewards appears capable of influencing circadian timing. Rodents can anticipate a daily mealtime by the entrainment of a series of oscillators that are anatomically distinct from the suprachiasmatic nucleus. Other work has indicated that restricted access to non-nutritive reinforcers (e.g. drugs of abuse, sex) or to palatable food in the absence of an energy deficit is capable of inducing relatively weak anticipatory activity, suggesting that reward alone is sufficient to induce anticipation. Recent attempts to elucidate the neural correlates of anticipation have revealed that both restricted feeding and restricted palatable food access can entrain clock gene expression in many reward-related corticolimbic structures. By contrast, restricted feeding alone can induce or entrain clock gene expression in hypothalamic nuclei involved in energy homeostasis. Thus, under ad libitum feeding conditions, the weak anticipatory activity induced by restricted reward presentation may result from the entrainment of reward-associated corticolimbic structures. The additional induction or entrainment of oscillators in hypothalamic regulatory areas may contribute to the more robust anticipatory activity associated with restricted feeding schedules.

Improved memory for reward cues following acute buprenorphine administration in humans.

PubMed

Syal, Supriya; Ipser, Jonathan; Terburg, David; Solms, Mark; Panksepp, Jaak; Malcolm-Smith, Susan; Bos, Peter A; Montoya, Estrella R; Stein, Dan J; van Honk, Jack

2015-03-01

In rodents, there is abundant evidence for the involvement of the opioid system in the processing of reward cues, but this system has remained understudied in humans. In humans, the happy facial expression is a pivotal reward cue. Happy facial expressions activate the brain's reward system and are disregarded by subjects scoring high on depressive mood who are low in reward drive. We investigated whether a single 0.2mg administration of the mixed mu-opioid agonist/kappa-antagonist, buprenorphine, would influence short-term memory for happy, angry or fearful expressions relative to neutral faces. Healthy human subjects (n38) participated in a randomized placebo-controlled within-subject design, and performed an emotional face relocation task after administration of buprenorphine and placebo. We show that, compared to placebo, buprenorphine administration results in a significant improvement of memory for happy faces. Our data demonstrate that acute manipulation of the opioid system by buprenorphine increases short-term memory for social reward cues. Copyright © 2015. Published by Elsevier Ltd.

International pharmaceutical social risk regulation: An ethical perspective.

PubMed

Gordon, Cameron

2011-03-01

Pharmaceutical production and distribution constitute big business. For the companies the rewards can be substantial. Rates of return on drug company investments tend to be higher than many other manufacturing enterprises. But reward is only one side of the story. There is also the issue of social risk, the focus of this article. Social risk for pharmaceutical production is especially pronounced. An ineffective or, worse, dangerous drug, can have dire consequences for the population at large. For this reason, there is elaborate government regulation and oversight of drug safety and risk. These systems, especially in the US and Europe, will be the main focus of this paper. The two systems will be described, and then compared and contrasted in terms of their framing of social risk and actions governments take to limit it. Systems elsewhere, especially in the developing world, are increasing in relative importance and these will be briefly discussed as well. Ethical issues that have arisen in these various systems will be surfaced and analysed. The paper will close with some conclusions and suggestions for further research.

Two spatiotemporally distinct value systems shape reward-based learning in the human brain.

PubMed

Fouragnan, Elsa; Retzler, Chris; Mullinger, Karen; Philiastides, Marios G

2015-09-08

Avoiding repeated mistakes and learning to reinforce rewarding decisions is critical for human survival and adaptive actions. Yet, the neural underpinnings of the value systems that encode different decision-outcomes remain elusive. Here coupling single-trial electroencephalography with simultaneously acquired functional magnetic resonance imaging, we uncover the spatiotemporal dynamics of two separate but interacting value systems encoding decision-outcomes. Consistent with a role in regulating alertness and switching behaviours, an early system is activated only by negative outcomes and engages arousal-related and motor-preparatory brain structures. Consistent with a role in reward-based learning, a later system differentially suppresses or activates regions of the human reward network in response to negative and positive outcomes, respectively. Following negative outcomes, the early system interacts and downregulates the late system, through a thalamic interaction with the ventral striatum. Critically, the strength of this coupling predicts participants' switching behaviour and avoidance learning, directly implicating the thalamostriatal pathway in reward-based learning.

Autistic traits modulate frontostriatal connectivity during processing of rewarding faces

PubMed Central

Neufeld, Janina; Johnstone, Tom; Chakrabarti, Bhismadev

2014-01-01

Deficits in facial mimicry have been widely reported in autism. Some studies have suggested that these deficits are restricted to spontaneous mimicry and do not extend to volitional mimicry. We bridge these apparently inconsistent observations by testing the impact of reward value on neural indices of mimicry and how autistic traits modulate this impact. Neutral faces were conditioned with high and low reward. Subsequently, functional connectivity between the ventral striatum (VS) and inferior frontal gyrus (IFG) was measured while neurotypical adults (n = 30) watched happy expressions made by these conditioned faces. We found greater VS–IFG connectivity in response to high reward vs low reward happy faces. This difference was negatively proportional to autistic traits, suggesting that reduced spontaneous mimicry of social stimuli seen in autism, may be related to a failure in the modulation of the mirror system by the reward system rather than a circumscribed deficit in the mirror system. PMID:24493838

The Impact of Corporate Culture, the Reward System, and Perceived Moral Intensity on Marketing Students' Ethical Decision Making

ERIC Educational Resources Information Center

Nill, Alexander; Schibrowsky, John A.

2005-01-01

An experiment was conducted to study how marketing students' ethical decision making was influenced by their perceived moral intensity (PMI), corporate culture, and the reward system. The findings indicate that levels of awareness of the ethical consequences of a decision, the corporate culture, and the reward system all significantly affect…

Self-administration of the synthetic cathinone MPDV enhances reward function via a nicotinic receptor dependent mechanism.

PubMed

Geste, Jean R; Pompilus, Marjory; Febo, Marcelo; Bruijnzeel, Adriaan W

2018-05-09

Methylenedioxypyrovalerone (MDPV) is an addictive synthetic drug with severe side effects. Previous studies have shown that MDPV has positive reinforcing properties. However, little is known about the effect of MDPV self-administration on the state of the brain reward system and the neuronal mechanisms by which MDPV mediates its effects. The goal of the present studies was to determine the effect of MDPV self-administration on reward function and the role of cholinergic neurotransmission in the reinforcing effects of MDPV. To study the effect of MDPV self-administration on the brain reward system, rats were prepared with intravenous catheters and intracranial self-stimulation electrodes (ICSS). For 10 days, the reward thresholds were assessed immediately before (23 h post prior session) and after 1 h of MDPV self-administration. The reward thresholds were decreased immediately after MDPV self-administration, which is indicative of a potentiation of brain reward function. The reward thresholds 23 h after MDPV intake gradually increased over time, which is indicative of anhedonia. Pretreatment with the nicotinic acetylcholine receptor (nAChR) antagonist mecamylamine decreased the self-administration of MDPV and completely prevented the decrease in reward thresholds. A control study with palatable chocolate pellets showed that responding for a natural reinforcer does not affect the state of the brain reward system. Furthermore, mecamylamine did not affect responding for food pellets. In conclusion, the self-administration of MDPV potentiates reward function and nAChR blockade prevents the reward enhancing effects of MDPV self-administration. Preventing the MDPV-induced increase in cholinergic neurotransmission might be a safe approach to diminish MDPV abuse. Copyright © 2018. Published by Elsevier Ltd.

Beyond Rewards

ERIC Educational Resources Information Center

Hall, Philip S.

2009-01-01

Using rewards to impact students' behavior has long been common practice. However, using reward systems to enhance student learning conveniently masks the larger and admittedly more difficult task of finding and implementing the structure and techniques that children with special needs require to learn. More important, rewarding the child for good…

Reward Systems in the Brain and Nutrition.

PubMed

Rolls, Edmund T

2016-07-17

The taste cortex in the anterior insula provides separate and combined representations of the taste, temperature, and texture of food in the mouth independently of hunger and thus of reward value and pleasantness. One synapse on, in the orbitofrontal cortex, these sensory inputs are combined by associative learning with olfactory and visual inputs for some neurons, and these neurons encode food reward value in that they respond to food only when hunger is present and in that activations correlate linearly with subjective pleasantness. Cognitive factors, including word-level descriptions and selective attention to affective value, modulate the representation of the reward value of taste, olfactory, and flavor stimuli in the orbitofrontal cortex and a region to which it projects, the anterior cingulate cortex. These food reward representations are important in the control of appetite and food intake. Individual differences in reward representations may contribute to obesity, and there are age-related differences in these reward representations. Implications of how reward systems in the brain operate for understanding, preventing, and treating obesity are described.

Motivating forces of human actions. Neuroimaging reward and social interaction.

PubMed

Walter, Henrik; Abler, Birgit; Ciaramidaro, Angela; Erk, Susanne

2005-11-15

In neuroeconomics, reward and social interaction are central concepts to understand what motivates human behaviour. Both concepts are investigated in humans using neuroimaging methods. In this paper, we provide an overview about these results and discuss their relevance for economic behaviour. For reward it has been shown that a system exists in humans that is involved in predicting rewards and thus guides behaviour, involving a circuit including the striatum, the orbitofrontal cortex and the amygdala. Recent studies on social interaction revealed a mentalizing system representing the mental states of others. A central part of this system is the medial prefrontal cortex, in particular the anterior paracingulate cortex. The reward as well as the mentalizing system is engaged in economic decision-making. We will discuss implications of this study for neuromarketing as well as general implications of these results that may help to provide deeper insights into the motivating forces of human behaviour.

Menstrual cycle phase modulates reward-related neural function in women.

PubMed

Dreher, Jean-Claude; Schmidt, Peter J; Kohn, Philip; Furman, Daniella; Rubinow, David; Berman, Karen Faith

2007-02-13

There is considerable evidence from animal studies that the mesolimbic and mesocortical dopamine systems are sensitive to circulating gonadal steroid hormones. Less is known about the influence of estrogen and progesterone on the human reward system. To investigate this directly, we used functional MRI and an event-related monetary reward paradigm to study women with a repeated-measures, counterbalanced design across the menstrual cycle. Here we show that during the midfollicular phase (days 4-8 after onset of menses) women anticipating uncertain rewards activated the orbitofrontal cortex and amygdala more than during the luteal phase (6-10 days after luteinizing hormone surge). At the time of reward delivery, women in the follicular phase activated the midbrain, striatum, and left fronto-polar cortex more than during the luteal phase. These data demonstrate augmented reactivity of the reward system in women during the midfollicular phase when estrogen is unopposed by progesterone. Moreover, investigation of between-sex differences revealed that men activated ventral putamen more than women during anticipation of uncertain rewards, whereas women more strongly activated the anterior medial prefrontal cortex at the time of reward delivery. Correlation between brain activity and gonadal steroid levels also revealed that the amygdalo-hippocampal complex was positively correlated with estradiol level, regardless of menstrual cycle phase. Together, our findings provide evidence of neurofunctional modulation of the reward system by gonadal steroid hormones in humans and establish a neurobiological foundation for understanding their impact on vulnerability to drug abuse, neuropsychiatric diseases with differential expression across males and females, and hormonally mediated mood disorders.

Real time wide area radiation surveillance system (REWARD) based on 3d silicon and (CD,ZN)Te for neutron and gamma-ray detection

NASA Astrophysics Data System (ADS)

Disch, C.

2014-09-01

Mobile surveillance systems are used to find lost radioactive sources and possible nuclear threats in urban areas. The REWARD collaboration [1] aims to develop such a complete radiation monitoring system that can be installed in mobile or stationary setups across a wide area. The scenarios include nuclear terrorism threats, lost radioactive sources, radioactive contamination and nuclear accidents. This paper will show the performance capabilities of the REWARD system in different scnarios. The results include both Monte Carlo simulations as well as neutron and gamma-ray detection performances in terms of efficiency and nuclide identification. The outcomes of several radiation mapping survey with the entire REWARD system will also be presented.

Performance-Based Rewards and Work Stress

ERIC Educational Resources Information Center

Ganster, Daniel C.; Kiersch, Christa E.; Marsh, Rachel E.; Bowen, Angela

2011-01-01

Even though reward systems play a central role in the management of organizations, their impact on stress and the well-being of workers is not well understood. We review the literature linking performance-based reward systems to various indicators of employee stress and well-being. Well-controlled experiments in field settings suggest that certain…

Selectivity in Postencoding Connectivity with High-Level Visual Cortex Is Associated with Reward-Motivated Memory

PubMed Central

Murty, Vishnu P.; Tompary, Alexa; Adcock, R. Alison

2017-01-01

Reward motivation has been demonstrated to enhance declarative memory by facilitating systems-level consolidation. Although high-reward information is often intermixed with lower reward information during an experience, memory for high value information is prioritized. How is this selectivity achieved? One possibility is that postencoding consolidation processes bias memory strengthening to those representations associated with higher reward. To test this hypothesis, we investigated the influence of differential reward motivation on the selectivity of postencoding markers of systems-level memory consolidation. Human participants encoded intermixed, trial-unique memoranda that were associated with either high or low-value during fMRI acquisition. Encoding was interleaved with periods of rest, allowing us to investigate experience-dependent changes in connectivity as they related to later memory. Behaviorally, we found that reward motivation enhanced 24 h associative memory. Analysis of patterns of postencoding connectivity showed that, even though learning trials were intermixed, there was significantly greater connectivity with regions of high-level, category-selective visual cortex associated with high-reward trials. Specifically, increased connectivity of category-selective visual cortex with both the VTA and the anterior hippocampus predicted associative memory for high- but not low-reward memories. Critically, these results were independent of encoding-related connectivity and univariate activity measures. Thus, these findings support a model by which the selective stabilization of memories for salient events is supported by postencoding interactions with sensory cortex associated with reward. SIGNIFICANCE STATEMENT Reward motivation is thought to promote memory by supporting memory consolidation. Yet, little is known as to how brain selects relevant information for subsequent consolidation based on reward. We show that experience-dependent changes in connectivity of both the anterior hippocampus and the VTA with high-level visual cortex selectively predicts memory for high-reward memoranda at a 24 h delay. These findings provide evidence for a novel mechanism guiding the consolidation of memories for valuable events, namely, postencoding interactions between neural systems supporting mesolimbic dopamine activation, episodic memory, and perception. PMID:28100737

Reward-Related Decision-Making in Pediatric Major Depressive Disorder: An fMRI Study

ERIC Educational Resources Information Center

Forbes, Erika E.; Christopher May, J.; Siegle, Greg J.; Ladouceur, Cecile D.; Ryan, Neal D.; Carter, Cameron S.; Birmaher, Boris; Axelson, David A.; Dahl, Ronald E.

2006-01-01

Background: Although reward processing is considered an important part of affective functioning, few studies have investigated reward-related decisions or responses in young people with affective disorders. Depression is postulated to involve decreased activity in reward-related affective systems. Methods: Using functional magnetic resonance…

Accelerated iTBS treatment in depressed patients differentially modulates reward system activity based on anhedonia.

PubMed

Duprat, Romain; Wu, Guo-Rong; De Raedt, Rudi; Baeken, Chris

2017-08-09

Accelerated intermittent theta-burst stimulation (aiTBS) anti-depressive working mechanisms are still unclear. Because aiTBS may work through modulating the reward system and the level of anhedonia may influence this modulation, we investigated the effect of aiTBS on reward responsiveness in high and low anhedonic MDD patients. In this registered RCT (NCT01832805), 50 MDD patients were randomised to a sham-controlled cross-over aiTBS treatment protocol over the left dorsolateral prefrontal cortex (DLPFC). Patients performed a probabilistic learning task in fMRI before and after each week of stimulation. Task performance analyses did not show any significant effects of aiTBS on reward responsiveness, nor differences between both groups of MDD patients. However, at baseline, low anhedonic patients displayed higher neural activity in the caudate and putamen. After the first week of aiTBS treatment, in low anhedonic patients we found a decreased neural activity within the reward system, in contrast to an increased activity observed in high anhedonic patients. No changes were observed in reward related neural regions after the first week of sham stimulation. Although both MDD groups showed no differences in task performance, our brain imaging findings suggest that left DLPFC aiTBS treatment modulates the reward system differently according to anhedonia severity.

The role of orexin-A in food motivation, reward-based feeding behavior and food-induced neuronal activation in rats.

PubMed

Choi, D L; Davis, J F; Fitzgerald, M E; Benoit, S C

2010-04-28

Consumption beyond homeostatic needs, referred to here as reward-based feeding behavior, is a central contributor to the current obesity epidemic worldwide. Importantly, reward-based feeding can be driven by palatability, the taste and texture of the food, as well as cues associated with the consumption of palatable foods. The hypothalamic orexin system regulates both diet preference and anticipation of food rewards making it a likely target to modulate reward-based feeding behavior. In the current manuscript we hypothesized that orexin signaling mediates food-motivated behaviors and reward-based feeding behavior. We further hypothesized that orexin neurons and targets of the orexin system become activated in response to cues associated with the consumption of palatable food. Data from these studies suggest that orexin signaling promotes progressive ratio responding for palatable foods while blockade of orexin signaling attenuates reward-based feeding of a high fat diet. In addition, cues linked to the consumption of chocolate, or the receipt of a daily meal, activate the orexin system and its target regions differentially. Collectively, these data suggest that orexin signaling mediates reward-based feeding behavior and, within specific target regions, may regulate cue-induced overconsumption of palatable foods. Copyright 2010 IBRO. Published by Elsevier Ltd. All rights reserved.

Distinct Reward Properties are Encoded via Corticostriatal Interactions

PubMed Central

Smith, David V.; Rigney, Anastasia E.; Delgado, Mauricio R.

2016-01-01

The striatum serves as a critical brain region for reward processing. Yet, understanding the link between striatum and reward presents a challenge because rewards are composed of multiple properties. Notably, affective properties modulate emotion while informative properties help obtain future rewards. We approached this problem by emphasizing affective and informative reward properties within two independent guessing games. We found that both reward properties evoked activation within the nucleus accumbens, a subregion of the striatum. Striatal responses to informative, but not affective, reward properties predicted subsequent utilization of information for obtaining monetary reward. We hypothesized that activation of the striatum may be necessary but not sufficient to encode distinct reward properties. To investigate this possibility, we examined whether affective and informative reward properties were differentially encoded in corticostriatal interactions. Strikingly, we found that the striatum exhibited dissociable connectivity patterns with the ventrolateral prefrontal cortex, with increasing connectivity for affective reward properties and decreasing connectivity for informative reward properties. Our results demonstrate that affective and informative reward properties are encoded via corticostriatal interactions. These findings highlight how corticostriatal systems contribute to reward processing, potentially advancing models linking striatal activation to behavior. PMID:26831208

Distinct Reward Properties are Encoded via Corticostriatal Interactions.

PubMed

Smith, David V; Rigney, Anastasia E; Delgado, Mauricio R

2016-02-02

The striatum serves as a critical brain region for reward processing. Yet, understanding the link between striatum and reward presents a challenge because rewards are composed of multiple properties. Notably, affective properties modulate emotion while informative properties help obtain future rewards. We approached this problem by emphasizing affective and informative reward properties within two independent guessing games. We found that both reward properties evoked activation within the nucleus accumbens, a subregion of the striatum. Striatal responses to informative, but not affective, reward properties predicted subsequent utilization of information for obtaining monetary reward. We hypothesized that activation of the striatum may be necessary but not sufficient to encode distinct reward properties. To investigate this possibility, we examined whether affective and informative reward properties were differentially encoded in corticostriatal interactions. Strikingly, we found that the striatum exhibited dissociable connectivity patterns with the ventrolateral prefrontal cortex, with increasing connectivity for affective reward properties and decreasing connectivity for informative reward properties. Our results demonstrate that affective and informative reward properties are encoded via corticostriatal interactions. These findings highlight how corticostriatal systems contribute to reward processing, potentially advancing models linking striatal activation to behavior.

fMRI of alterations in reward selection, anticipation, and feedback in major depressive disorder.

PubMed

Smoski, Moria J; Felder, Jennifer; Bizzell, Joshua; Green, Steven R; Ernst, Monique; Lynch, Thomas R; Dichter, Gabriel S

2009-11-01

The purpose of the present investigation was to evaluate reward processing in unipolar major depressive disorder (MDD). Specifically, we investigated whether adults with MDD demonstrated hyporesponsivity in striatal brain regions and/or hyperresponsivity in cortical brain regions involved in conflict monitoring using a Wheel of Fortune task designed to probe responses during reward selection, reward anticipation, and reward feedback. Functional magnetic resonance imaging (fMRI) data indicated that the MDD group was characterized by reduced activation of striatal reward regions during reward selection, reward anticipation, and reward feedback, supporting previous data indicating hyporesponsivity of reward systems in MDD. Support was not found for hyperresponsivity of cognitive control regions during reward selection or reward anticipation. Instead, MDD participants showed hyperresponsivity in orbitofrontal cortex, a region associated with assessment of risk and reward, during reward selection, as well as decreased activation of the middle frontal gyrus and the rostral cingulate gyrus during reward selection and anticipation. Finally, depression severity was predicted by activation in bilateral midfrontal gyrus during reward selection. Results indicate that MDD is characterized by striatal hyporesponsivity, and that future studies of MDD treatments that seek to improve responses to rewarding stimuli should assess striatal functioning.

Reward loss and addiction: Opportunities for cross-pollination.

PubMed

Ortega, Leonardo A; Solano, José L; Torres, Carmen; Papini, Mauricio R

2017-03-01

Paradigms used to study the response to and consequences of exposure to reward loss have been underutilized in approaches to the psychobiology of substance use disorders. We propose here that bringing these two areas into contact will help expanding our understanding of both reward loss and addictive behavior, hence opening up opportunities for cross-pollination. This review focuses on two lines of research that point to parallels. First, several neurochemical systems involved in addiction are also involved in the modulation of the behavioral effects of reward loss, including opioid, GABA, and dopamine receptors. Second, there are extensive overlaps in the brain circuitry underlying both reward loss and addiction. Common components of this system include, at least, the amygdala, ventral and dorsal striatum, and various prefrontal cortex regions. Four emerging avenues of research that benefit from emphasis on the common ground between reward loss and addiction are reviewed, namely, the neural circuitry involved in reward devaluation, the influence of genetic and reward history on the behavioral vulnerability and resilience, the role of competing natural rewards, and emotional self-medication. An understanding of the role of reward loss in addiction will point to a deeper understanding of the initiation and maintenance of substance use disorders. Copyright © 2017 Elsevier Inc. All rights reserved.

Reward Processing, Neuroeconomics, and Psychopathology.

PubMed

Zald, David H; Treadway, Michael T

2017-05-08

Abnormal reward processing is a prominent transdiagnostic feature of psychopathology. The present review provides a framework for considering the different aspects of reward processing and their assessment, and highlights recent insights from the field of neuroeconomics that may aid in understanding these processes. Although altered reward processing in psychopathology has often been treated as a general hypo- or hyperresponsivity to reward, increasing data indicate that a comprehensive understanding of reward dysfunction requires characterization within more specific reward-processing domains, including subjective valuation, discounting, hedonics, reward anticipation and facilitation, and reinforcement learning. As such, more nuanced models of the nature of these abnormalities are needed. We describe several processing abnormalities capable of producing the types of selective alterations in reward-related behavior observed in different forms of psychopathology, including (mal)adaptive scaling and anchoring, dysfunctional weighting of reward and cost variables, competition between valuation systems, and reward prediction error signaling.

Cerebral interactions of pain and reward and their relevance for chronic pain.

PubMed

Becker, Susanne; Gandhi, Wiebke; Schweinhardt, Petra

2012-06-29

Pain and reward are opponent, interacting processes. Such interactions are enabled by neuroanatomical and neurochemical overlaps of brain systems that process pain and reward. Cerebral processing of hedonic ('liking') and motivational ('wanting') aspects of reward can be separated: the orbitofrontal cortex and opioids play an important role for the hedonic experience, and the ventral striatum and dopamine predominantly process motivation for reward. Supported by neuroimaging studies, we present here the hypothesis that the orbitofrontal cortex and opioids are responsible for pain modulation by hedonic experience, while the ventral striatum and dopamine mediate motivational effects on pain. A rewarding stimulus that appears to be particularly important in the context of pain is pain relief. Further, reward, including pain relief, leads to operant learning, which can affect pain sensitivity. Indirect evidence points at brain mechanisms that might underlie pain relief as a reward and related operant learning but studies are scarce. Investigating the cerebral systems underlying pain-reward interactions as well as related operant learning holds the potential of better understanding mechanisms that contribute to the development and maintenance of chronic pain, as detailed in the last section of this review. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Reward deficiency and anti-reward in pain chronification.

PubMed

Borsook, D; Linnman, C; Faria, V; Strassman, A M; Becerra, L; Elman, I

2016-09-01

Converging lines of evidence suggest that the pathophysiology of pain is mediated to a substantial degree via allostatic neuroadaptations in reward- and stress-related brain circuits. Thus, reward deficiency (RD) represents a within-system neuroadaptation to pain-induced protracted activation of the reward circuits that leads to depletion-like hypodopaminergia, clinically manifested anhedonia, and diminished motivation for natural reinforcers. Anti-reward (AR) conversely pertains to a between-systems neuroadaptation involving over-recruitment of key limbic structures (e.g., the central and basolateral amygdala nuclei, the bed nucleus of the stria terminalis, the lateral tegmental noradrenergic nuclei of the brain stem, the hippocampus and the habenula) responsible for massive outpouring of stressogenic neurochemicals (e.g., norepinephrine, corticotropin releasing factor, vasopressin, hypocretin, and substance P) giving rise to such negative affective states as anxiety, fear and depression. We propose here the Combined Reward deficiency and Anti-reward Model (CReAM), in which biopsychosocial variables modulating brain reward, motivation and stress functions can interact in a 'downward spiral' fashion to exacerbate the intensity, chronicity and comorbidities of chronic pain syndromes (i.e., pain chronification). Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Aging Affects Acquisition and Reversal of Reward-Based Associative Learning

ERIC Educational Resources Information Center

Weiler, Julia A.; Bellebaum, Christian; Daum, Irene

2008-01-01

Reward-based associative learning is mediated by a distributed network of brain regions that are dependent on the dopaminergic system. Age-related changes in key regions of this system, the striatum and the prefrontal cortex, may adversely affect the ability to use reward information for the guidance of behavior. The present study investigated the…

Pain and suicidality: Insights from reward and addiction neuroscience

PubMed Central

Elman, Igor; Borsook, David; Volkow, Nora D.

2016-01-01

Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system’s role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward circuitry); both are relevant etiologic factors in pain, suicide and social attachments. A comprehensive literature search on neurobiology of pain and suicidality was performed. The collected articles were critically reviewed and relevant data were extracted and summarized within four key areas: (1) physical and emotional pain, (2) emotional pain and social attachments, (3) pain-and suicide-related alterations of the reward and anti-reward circuits as compared to addiction, which is the premier probe for dysfunction of these circuits and (4) mechanistically informed treatments of co-occurring pain and suicidality. Pain-, stress- and analgesic drugs-induced opponent and proponent states of the mesolimbic dopaminergic pathways may render reward and anti-reward systems vulnerable to sensitization, cross-sensitization and aberrant learning of contents and contexts associated with suicidal acts and behaviors. These findings suggest that pain patients exhibit alterations in the brain circuits mediating reward (depressed function) and anti-reward (sensitized function) that may affect their proclivity for suicide and support pain and suicidality classification among other “reward deficiency syndromes” and a new proposal for “enhanced anti-reward syndromes”. We suggest that interventions aimed at restoring the balance between the reward and anti-reward networks in patients with chronic pain may help decreasing their suicide risk. PMID:23827972

Evidences from Rewarding System, FRN and P300 Effect in Internet-Addiction in Young People SHORT TITLE: Rewarding System and EEG in Internet-Addiction

PubMed Central

Venturella, Irene; Finocchiaro, Roberta

2017-01-01

The present research explored rewarding bias and attentional deficits in Internet addiction (IA) based on the IAT (Internet Addiction Test) construct, during an attentional inhibitory task (Go/NoGo task). Event-related Potentials (ERPs) effects (Feedback Related Negativity (FRN) and P300) were monitored in concomitance with Behavioral Activation System (BAS) modulation. High-IAT young participants showed specific responses to IA-related cues (videos representing online gambling and videogames) in terms of cognitive performance (decreased Response Times, RTs; and Error Rates, ERs) and ERPs modulation (decreased FRN and increased P300). Consistent reward and attentional biases was adduced to explain the cognitive “gain” effect and the anomalous response in terms of both feedback behavior (FRN) and attentional (P300) mechanisms in high-IAT. In addition, BAS and BAS-Reward subscales measures were correlated with both IAT and ERPs variations. Therefore, high sensitivity to IAT may be considered as a marker of dysfunctional reward processing (reduction of monitoring) and cognitive control (higher attentional values) for specific IA-related cues. More generally, a direct relationship among reward-related behavior, Internet addiction and BAS attitude was suggested. PMID:28704978

Methylphenidate and brain activity in a reward/conflict paradigm: role of the insula in task performance.

PubMed

Ivanov, Iliyan; Liu, Xun; Clerkin, Suzanne; Schulz, Kurt; Fan, Jin; Friston, Karl; London, Edythe D; Schwartz, Jeffrey; Newcorn, Jeffrey H

2014-06-01

Psychostimulants, such as methylphenidate, are thought to improve information processing in motivation-reward and attention-activation networks by enhancing the effects of more relevant signals and suppressing those of less relevant ones; however the nature of such reciprocal influences remains poorly understood. To explore this question, we tested the effect of methylphenidate on performance and associated brain activity in the Anticipation, Conflict, Reward (ACR) task. Sixteen healthy adult volunteers, ages 21-45, were scanned twice using functional magnetic resonance imaging (fMRI) as they performed the ACR task under placebo and methylphenidate conditions. A three-way repeated measures analysis of variance, with cue (reward vs. non-reward), target (congruent vs. incongruent) and medication condition (methylphenidate vs. placebo) as the factors, was used to analyze behaviors on the task. Blood oxygen level dependent (BOLD) signals, reflecting task-related neural activity, were evaluated using linear contrasts. Participants exhibited significantly greater accuracy in the methylphenidate condition than the placebo condition. Compared with placebo, the methylphenidate condition also was associated with lesser task-related activity in components of attention-activation systems irrespective of the reward cue, and less task-related activity in components of the reward-motivation system, particularly the insula, during reward trials irrespective of target difficulty. These results suggest that methylphenidate enhances task performance by improving efficiency of information processing in both reward-motivation and in attention-activation systems. Published by Elsevier B.V.

Investigating the Impact of a Genome-Wide Supported Bipolar Risk Variant of MAD1L1 on the Human Reward System.

PubMed

Trost, Sarah; Diekhof, Esther K; Mohr, Holger; Vieker, Henning; Krämer, Bernd; Wolf, Claudia; Keil, Maria; Dechent, Peter; Binder, Elisabeth B; Gruber, Oliver

2016-10-01

Recent genome-wide association studies have identified MAD1L1 (mitotic arrest deficient-like 1) as a susceptibility gene for bipolar disorder and schizophrenia. The minor allele of the single-nucleotide polymorphism (SNP) rs11764590 in MAD1L1 was associated with bipolar disorder. Both diseases, bipolar disorder and schizophrenia, are linked to functional alterations in the reward system. We aimed at investigating possible effects of the MAD1L1 rs11764590 risk allele on reward systems functioning in healthy adults. A large homogenous sample of 224 young (aged 18-31 years) participants was genotyped and underwent functional magnetic resonance imaging (fMRI). All participants performed the 'Desire-Reason Dilemma' paradigm investigating the neural correlates that underlie reward processing and active reward dismissal in favor of a long-term goal. We found significant hypoactivations of the ventral tegmental area (VTA), the bilateral striatum and bilateral frontal and parietal cortices in response to conditioned reward stimuli in the risk allele carriers compared with major allele carriers. In the dilemma situation, functional connectivity between prefrontal brain regions and the ventral striatum was significantly diminished in the risk allele carriers. Healthy risk allele carriers showed a significant deficit of their bottom-up response to conditioned reward stimuli in the bilateral VTA and striatum. Furthermore, functional connectivity between the ventral striatum and prefrontal areas exerting top-down control on the mesolimbic reward system was reduced in this group. Similar alterations in reward processing and disturbances of prefrontal control mechanisms on mesolimbic brain circuits have also been reported in bipolar disorder and schizophrenia. Together, these findings suggest the existence of an intermediate phenotype associated with MAD1L1.

Adaptive scaling of reward in episodic memory: a replication study.

PubMed

Mason, Alice; Ludwig, Casimir; Farrell, Simon

2017-11-01

Reward is thought to enhance episodic memory formation via dopaminergic consolidation. Bunzeck, Dayan, Dolan, and Duzel [(2010). A common mechanism for adaptive scaling of reward and novelty. Human Brain Mapping, 31, 1380-1394] provided functional magnetic resonance imaging (fMRI) and behavioural evidence that reward and episodic memory systems are sensitive to the contextual value of a reward-whether it is relatively higher or lower-as opposed to absolute value or prediction error. We carried out a direct replication of their behavioural study and did not replicate their finding that memory performance associated with reward follows this pattern of adaptive scaling. An effect of reward outcome was in the opposite direction to that in the original study, with lower reward outcomes leading to better memory than higher outcomes. There was a marginal effect of reward context, suggesting that expected value affected memory performance. We discuss the robustness of the reward memory relationship to variations in reward context, and whether other reward-related factors have a more reliable influence on episodic memory.

Changing reward systems for team-based systems.

PubMed

Barksdale, G T

1998-12-01

With the rapidly changing pace in health care, hospitals are struggling to keep costs under control and to remain competitive. Leadership is increasingly convinced that old methods of compensation are no longer valid and thus are turning to innovative approaches to pay and reward systems. This article describes some of the new pay methods, with an emphasis on team rewards, showing that compensation can keep pace with the evolving needs of health care.

A Fly's Eye View of Natural and Drug Reward.

PubMed

Lowenstein, Eve G; Velazquez-Ulloa, Norma A

2018-01-01

Animals encounter multiple stimuli each day. Some of these stimuli are innately appetitive or aversive, while others are assigned valence based on experience. Drugs like ethanol can elicit aversion in the short term and attraction in the long term. The reward system encodes the predictive value for different stimuli, mediating anticipation for attractive or punishing stimuli and driving animal behavior to approach or avoid conditioned stimuli. The neurochemistry and neurocircuitry of the reward system is partly evolutionarily conserved. In both vertebrates and invertebrates, including Drosophila melanogaster , dopamine is at the center of a network of neurotransmitters and neuromodulators acting in concert to encode rewards. Behavioral assays in D. melanogaster have become increasingly sophisticated, allowing more direct comparison with mammalian research. Moreover, recent evidence has established the functional modularity of the reward neural circuits in Drosophila . This functional modularity resembles the organization of reward circuits in mammals. The powerful genetic and molecular tools for D. melanogaster allow characterization and manipulation at the single-cell level. These tools are being used to construct a detailed map of the neural circuits mediating specific rewarding stimuli and have allowed for the identification of multiple genes and molecular pathways that mediate the effects of reinforcing stimuli, including their rewarding effects. This report provides an overview of the research on natural and drug reward in D. melanogaster , including natural rewards such as sugar and other food nutrients, and drug rewards including ethanol, cocaine, amphetamine, methamphetamine, and nicotine. We focused mainly on the known genetic and neural mechanisms underlying appetitive reward for sugar and reward for ethanol. We also include genes, molecular pathways, and neural circuits that have been identified using assays that test the palatability of the rewarding stimulus, the preference for the rewarding stimulus, or other effects of the stimulus that indicate how it can modify behavior. Commonalities between mechanisms of natural and drug reward are highlighted and future directions are presented, putting forward questions best suited for research using D. melanogaster as a model organism.

Trial-by-Trial Modulation of Associative Memory Formation by Reward Prediction Error and Reward Anticipation as Revealed by a Biologically Plausible Computational Model.

PubMed

Aberg, Kristoffer C; Müller, Julia; Schwartz, Sophie

2017-01-01

Anticipation and delivery of rewards improves memory formation, but little effort has been made to disentangle their respective contributions to memory enhancement. Moreover, it has been suggested that the effects of reward on memory are mediated by dopaminergic influences on hippocampal plasticity. Yet, evidence linking memory improvements to actual reward computations reflected in the activity of the dopaminergic system, i.e., prediction errors and expected values, is scarce and inconclusive. For example, different previous studies reported that the magnitude of prediction errors during a reinforcement learning task was a positive, negative, or non-significant predictor of successfully encoding simultaneously presented images. Individual sensitivities to reward and punishment have been found to influence the activation of the dopaminergic reward system and could therefore help explain these seemingly discrepant results. Here, we used a novel associative memory task combined with computational modeling and showed independent effects of reward-delivery and reward-anticipation on memory. Strikingly, the computational approach revealed positive influences from both reward delivery, as mediated by prediction error magnitude, and reward anticipation, as mediated by magnitude of expected value, even in the absence of behavioral effects when analyzed using standard methods, i.e., by collapsing memory performance across trials within conditions. We additionally measured trait estimates of reward and punishment sensitivity and found that individuals with increased reward (vs. punishment) sensitivity had better memory for associations encoded during positive (vs. negative) prediction errors when tested after 20 min, but a negative trend when tested after 24 h. In conclusion, modeling trial-by-trial fluctuations in the magnitude of reward, as we did here for prediction errors and expected value computations, provides a comprehensive and biologically plausible description of the dynamic interplay between reward, dopamine, and associative memory formation. Our results also underline the importance of considering individual traits when assessing reward-related influences on memory.

A Fly’s Eye View of Natural and Drug Reward

PubMed Central

Lowenstein, Eve G.; Velazquez-Ulloa, Norma A.

2018-01-01

Animals encounter multiple stimuli each day. Some of these stimuli are innately appetitive or aversive, while others are assigned valence based on experience. Drugs like ethanol can elicit aversion in the short term and attraction in the long term. The reward system encodes the predictive value for different stimuli, mediating anticipation for attractive or punishing stimuli and driving animal behavior to approach or avoid conditioned stimuli. The neurochemistry and neurocircuitry of the reward system is partly evolutionarily conserved. In both vertebrates and invertebrates, including Drosophila melanogaster, dopamine is at the center of a network of neurotransmitters and neuromodulators acting in concert to encode rewards. Behavioral assays in D. melanogaster have become increasingly sophisticated, allowing more direct comparison with mammalian research. Moreover, recent evidence has established the functional modularity of the reward neural circuits in Drosophila. This functional modularity resembles the organization of reward circuits in mammals. The powerful genetic and molecular tools for D. melanogaster allow characterization and manipulation at the single-cell level. These tools are being used to construct a detailed map of the neural circuits mediating specific rewarding stimuli and have allowed for the identification of multiple genes and molecular pathways that mediate the effects of reinforcing stimuli, including their rewarding effects. This report provides an overview of the research on natural and drug reward in D. melanogaster, including natural rewards such as sugar and other food nutrients, and drug rewards including ethanol, cocaine, amphetamine, methamphetamine, and nicotine. We focused mainly on the known genetic and neural mechanisms underlying appetitive reward for sugar and reward for ethanol. We also include genes, molecular pathways, and neural circuits that have been identified using assays that test the palatability of the rewarding stimulus, the preference for the rewarding stimulus, or other effects of the stimulus that indicate how it can modify behavior. Commonalities between mechanisms of natural and drug reward are highlighted and future directions are presented, putting forward questions best suited for research using D. melanogaster as a model organism. PMID:29720947

Peripheral temperature drop in response to anticipation and consumption of a signaled palatable reward in laying hens (Gallus domesticus).

PubMed

Moe, Randi Oppermann; Stubsjøen, Solveig Marie; Bohlin, Jon; Flø, Andreas; Bakken, Morten

2012-06-25

The present study describes effects of anticipation and consumption of a palatable reward on comb surface temperature. The purpose was to investigate temperature responses as a potential physiological indicator of positive emotional states in laying hens. A rise in body temperature in response to stimuli predictive of or during exposure to unpleasant events has been interpreted as evidence of emotions in mammals and avians. However, this phenomenon has so far only been studied during anticipation of or exposure to negative events; i.e., emotions of a negative valence. Infrared thermography was used to record potential alterations in comb surface temperature to a conditioned cue signaling a reward (mealworms) and during reward delivery. On average, comb temperature dropped 1.5 °C (95% CI: +/-1.2 °C) after exposure to CS and consumption of reward (p~0.0014) when initial comb temperature was above 30 °C. Such temperature drop indicates a peripheral vasoconstriction and has clear resemblances to emotional fever as seen during negative emotional states. Thus, we propose that a drop in peripheral temperature reflects emotional arousal more than emotional valence. Substantial temperature responses due to diet-induced thermogenesis were found, further emphasizing a cautious interpretation of altered comb temperature in studies of animal welfare. Copyright © 2012 Elsevier Inc. All rights reserved.

Longitudinal Changes in Behavioral Approach System Sensitivity and Brain Structures Involved in Reward Processing during Adolescence

ERIC Educational Resources Information Center

Urosevic, Snezana; Collins, Paul; Muetzel, Ryan; Lim, Kelvin; Luciana, Monica

2012-01-01

Adolescence is a period of radical normative changes and increased risk for substance use, mood disorders, and physical injury. Researchers have proposed that increases in reward sensitivity (i.e., sensitivity of the behavioral approach system [BAS]) and/or increases in reactivity to all emotional stimuli (i.e., reward and threat sensitivities)…

Using Rewards and Sanctions in the Classroom: Pupils' Perceptions of Their Own Responses to Current Behaviour Management Strategies

ERIC Educational Resources Information Center

Payne, Ruth

2015-01-01

The use of systems of rewards and sanctions within behaviour policies has now been adopted formally in UK schools. Such systems potentially represent competing theoretical ideas when considered alongside current approaches to teaching and learning. There is also opportunity for inconsistent use of rewards and sanctions resulting from the absence…

Reward System Activation in Response to Alcohol Advertisements Predicts College Drinking.

PubMed

Courtney, Andrea L; Rapuano, Kristina M; Sargent, James D; Heatherton, Todd F; Kelley, William M

2018-01-01

In this study, we assess whether activation of the brain's reward system in response to alcohol advertisements is associated with college drinking. Previous research has established a relationship between exposure to alcohol marketing and underage drinking. Within other appetitive domains, the relationship between cue exposure and behavioral enactment is known to rely on activation of the brain's reward system. However, the relationship between neural activation to alcohol advertisements and alcohol consumption has not been studied in a nondisordered population. In this cross-sectional study, 53 college students (32 women) completed a functional magnetic resonance imaging scan while viewing alcohol, food, and control (car and technology) advertisements. Afterward, they completed a survey about their alcohol consumption (including frequency of drinking, typical number of drinks consumed, and frequency of binge drinking) over the previous month. In 43 participants (24 women) meeting inclusion criteria, viewing alcohol advertisements elicited activation in the left orbitofrontal cortex and bilateral ventral striatum-regions of the reward system that typically activate to other appetitive rewards and relate to consumption behaviors. Moreover, the level of self-reported drinking correlated with the magnitude of activation in the left orbitofrontal cortex. Results suggest that alcohol cues are processed within the reward system in a way that may motivate drinking behavior.

A biased activation theory of the cognitive and attentional modulation of emotion.

PubMed

Rolls, Edmund T

2013-01-01

Cognition can influence emotion by biasing neural activity in the first cortical region in which the reward value and subjective pleasantness of stimuli is made explicit in the representation, the orbitofrontal cortex (OFC). The same effect occurs in a second cortical tier for emotion, the anterior cingulate cortex (ACC). Similar effects are found for selective attention, to for example the pleasantness vs. the intensity of stimuli, which modulates representations of reward value and affect in the orbitofrontal and anterior cingulate cortices. The mechanisms for the effects of cognition and attention on emotion are top-down biased competition and top-down biased activation. Affective and mood states can in turn influence memory and perception, by backprojected biasing influences. Emotion-related decision systems operate to choose between gene-specified rewards such as taste, touch, and beauty. Reasoning processes capable of planning ahead with multiple steps held in working memory in the explicit system can allow the gene-specified rewards not to be selected, or to be deferred. The stochastic, noisy, dynamics of decision-making systems in the brain may influence whether decisions are made by the selfish-gene-specified reward emotion system, or by the cognitive reasoning system that explicitly calculates reward values that are in the interests of the individual, the phenotype.

Reward Processing, Neuroeconomics, and Psychopathology

PubMed Central

Zald, David H.; Treadway, Michael

2018-01-01

Abnormal reward processing is a prominent transdiagnostic feature of psychopathology. The present review provides a framework for considering the different aspects of reward processing and their assessment and highlight recent insights from the field of neuroeconomics that may aid in understanding these processes. Although altered reward processing in psychopathology has often been treated as a general hypo- or hyper-responsivity to reward, increasing data indicate that a comprehensive understanding of reward dysfunction requires characterization within more specific reward processing domains, including subjective valuation, discounting, hedonics, reward anticipation and facilitation, and reinforcement learning. As such, more nuanced models of the nature of these abnormalities are needed. We describe several processing abnormalities capable of producing the types of selective alterations in reward related behavior observed in different forms of psychopathology, including (mal)adaptive scaling and anchoring, dysfunctional weighting of reward and cost variables, completion between valuation systems, and positive prediction error signaling. PMID:28301764

Plasticity of reward neurocircuitry and the 'dark side' of drug addiction.

PubMed

Koob, George F; Le Moal, Michel

2005-11-01

Drug seeking is associated with activation of reward neural circuitry. Here we argue that drug addiction also involves a 'dark side'--a decrease in the function of normal reward-related neurocircuitry and persistent recruitment of anti-reward systems. Understanding the neuroplasticity of the dark side of this circuitry is the key to understanding vulnerability to addiction.

Pupil and Staff Perceptions of Rewards at a Pupil Referral Unit

ERIC Educational Resources Information Center

Capstick, Joanna

2005-01-01

The present study investigated the perceptions of both pupils and staff at a pupil referral unit (PRU) towards the reward system currently in use. The main aims were to establish whether teachers and pupils perceived the same rewards as effective, to determine whether staff and pupils perceived that rewards changed behaviour, and finally whether…

A universal role of the ventral striatum in reward-based learning: Evidence from human studies

PubMed Central

Daniel, Reka; Pollmann, Stefan

2014-01-01

Reinforcement learning enables organisms to adjust their behavior in order to maximize rewards. Electrophysiological recordings of dopaminergic midbrain neurons have shown that they code the difference between actual and predicted rewards, i.e., the reward prediction error, in many species. This error signal is conveyed to both the striatum and cortical areas and is thought to play a central role in learning to optimize behavior. However, in human daily life rewards are diverse and often only indirect feedback is available. Here we explore the range of rewards that are processed by the dopaminergic system in human participants, and examine whether it is also involved in learning in the absence of explicit rewards. While results from electrophysiological recordings in humans are sparse, evidence linking dopaminergic activity to the metabolic signal recorded from the midbrain and striatum with functional magnetic resonance imaging (fMRI) is available. Results from fMRI studies suggest that the human ventral striatum (VS) receives valuation information for a diverse set of rewarding stimuli. These range from simple primary reinforcers such as juice rewards over abstract social rewards to internally generated signals on perceived correctness, suggesting that the VS is involved in learning from trial-and-error irrespective of the specific nature of provided rewards. In addition, we summarize evidence that the VS can also be implicated when learning from observing others, and in tasks that go beyond simple stimulus-action-outcome learning, indicating that the reward system is also recruited in more complex learning tasks. PMID:24825620

Paradoxical Decrease in Striatal Activation on an fMRI Reward Task Following Treatment in Youth with Co-morbid Cannabis Dependence/Major Depression.

PubMed

Cornelius, Jack R; Aizenstein, Howard J; Chung, Tammy A; Douaihy, Antoine; Hayes, Jeanine; Daley, Dennis; Salloum, Ihsan M

Reward behavior, including reward behavior involving drugs, has been shown to be mediated by the ventral striatum and related structures of the reward system. The aim of this study was to assess reward-related activity as shown by fMRI before and after treatment among youth with comorbid cannabis dependence and major depression. We hypothesized that the reward task (Delgado et al., 2003) would elicit activation in the reward system, and that the level of activation in response to reward would increase from the beginning to the end of the 12-week treatment study as levels of depressive symptoms and cannabis use decreased. Six subjects were recruited from a larger treatment study in which all received Cognitive Behavioral Therapy/Motivational Enhancement Therapy (CBT/MET), and also were randomized to receive either fluoxetine or placebo. Each of the six subjects completed an fMRI card- guessing/reward task both before and after the 12-week treatment study. As hypothesized, the expected activation was noted for the reward task in the insula, prefrontal, and striatal areas, both before and after treatment. However, the participants showed lower reward-related activation after treatment relative to pre-treatment, which is opposite of what would be expected in depressed subjects who did not demonstrate a comorbid substance use disorder. These paradoxical findings suggest that the expected increase in activity for reward associated with treatment for depression was overshadowed by a decrease in reward-related activation associated with treatment of pathological cannabis use in these comorbid youth. These findings emphasize the importance of comorbid disorders in fMRI studies.

A longitudinal high-risk study of adolescent anxiety, depression and parent-severity on the developmental course of risk-adjustment.

PubMed

Rawal, Adhip; Riglin, Lucy; Ng-Knight, Terry; Collishaw, Stephan; Thapar, Anita; Rice, Frances

2014-11-01

Adolescence is associated with developments in the reward system and increased rates of emotional disorders. Familial risk for depression may be associated with disruptions in the reward system. However, it is unclear how symptoms of depression and anxiety influence the development of reward-processing over adolescence and whether variation in the severity of parental depression is associated with hyposensitivity to reward in a high-risk sample. We focused on risk-adjustment (adjusting decisions about reward according to the probability of obtaining reward) as this was hypothesized to improve over adolescence. In a one-year longitudinal sample (N = 197) of adolescent offspring of depressed parents, we examined how symptoms of depression and anxiety (generalized anxiety and social anxiety) influenced the development of risk-adjustment. We also examined how parental depression severity influenced adolescent risk-adjustment. Risk-adjustment improved over the course of the study indicating improved adjustment of reward-seeking to shifting contingencies. Depressive symptoms were associated with decreases in risk-adjustment over time while social anxiety symptoms were associated with increases in risk-adjustment over time. Specifically, depression was associated with reductions in reward-seeking at favourable reward probabilities only, whereas social anxiety (but not generalized anxiety) led to reductions in reward-seeking at low reward probabilities only. Parent depression severity was associated with lowered risk-adjustment in offspring and also influenced the longitudinal relationship between risk-adjustment and offspring depression. Anxiety and depression distinctly alter the pattern of longitudinal change in reward-processing. Severity of parent depression was associated with alterations in adolescent offspring reward-processing in a high-risk sample. © 2014 The Authors. Journal of Child Psychology and Psychiatry published by John Wiley & Sons Ltd on behalf of Association for Child and Adolescent Mental Health.

The CB1 Receptor as an Important Mediator of Hedonic Reward Processing

PubMed Central

Friemel, Chris M; Zimmer, Andreas; Schneider, Miriam

2014-01-01

The endocannabinoid (ECB) system has emerged recently as a key mediator for reward processing. It is well known that cannabinoids affect appetitive learning processes and can induce reinforcing and rewarding effects. However, the involvement of the ECB system in hedonic aspects of reward-related behavior is not completely understood. With the present study, we investigated the modulatory role of the ECB system on hedonic perception, measured by the pleasure attenuated startle (PAS) paradigm for a palatable food reward. Here, a conditioned odor is thought to induce a pleasant affective state that attenuates an aversive reflex—the acoustic startle response. Modulatory effects of the CB1 receptor antagonist/inverse agonist SR1411716 and the cannabinoid agonist WIN 55 212-2 on PAS were examined in rats. PAS was also measured in CB1 receptor knockout (KO) and wild-type (WT) mice. Pharmacological inhibition as well as the absence of CB1 receptors was found to reduce PAS, whereas WIN 55 212-2 administration increased PAS. Finally, presentation of a conditioned reward cue was found to induce striatal FosB/ΔFosB expression in WT mice, but not in KO mice, indicating a reduced stimulation of reward-related brain regions in conditioned KO mice by odor presentation. We here show that in addition to our previous studies in rats, PAS may also serve as a valuable and suitable measure to assess hedonic processing in mice. Our data further indicate that the ECB system, and in particular CB1 receptor signaling, appears to be highly important for the mediation of hedonic aspects of reward processing. PMID:24718372

Selectivity in Postencoding Connectivity with High-Level Visual Cortex Is Associated with Reward-Motivated Memory.

PubMed

Murty, Vishnu P; Tompary, Alexa; Adcock, R Alison; Davachi, Lila

2017-01-18

Reward motivation has been demonstrated to enhance declarative memory by facilitating systems-level consolidation. Although high-reward information is often intermixed with lower reward information during an experience, memory for high value information is prioritized. How is this selectivity achieved? One possibility is that postencoding consolidation processes bias memory strengthening to those representations associated with higher reward. To test this hypothesis, we investigated the influence of differential reward motivation on the selectivity of postencoding markers of systems-level memory consolidation. Human participants encoded intermixed, trial-unique memoranda that were associated with either high or low-value during fMRI acquisition. Encoding was interleaved with periods of rest, allowing us to investigate experience-dependent changes in connectivity as they related to later memory. Behaviorally, we found that reward motivation enhanced 24 h associative memory. Analysis of patterns of postencoding connectivity showed that, even though learning trials were intermixed, there was significantly greater connectivity with regions of high-level, category-selective visual cortex associated with high-reward trials. Specifically, increased connectivity of category-selective visual cortex with both the VTA and the anterior hippocampus predicted associative memory for high- but not low-reward memories. Critically, these results were independent of encoding-related connectivity and univariate activity measures. Thus, these findings support a model by which the selective stabilization of memories for salient events is supported by postencoding interactions with sensory cortex associated with reward. Reward motivation is thought to promote memory by supporting memory consolidation. Yet, little is known as to how brain selects relevant information for subsequent consolidation based on reward. We show that experience-dependent changes in connectivity of both the anterior hippocampus and the VTA with high-level visual cortex selectively predicts memory for high-reward memoranda at a 24 h delay. These findings provide evidence for a novel mechanism guiding the consolidation of memories for valuable events, namely, postencoding interactions between neural systems supporting mesolimbic dopamine activation, episodic memory, and perception. Copyright © 2017 the authors 0270-6474/17/370537-09$15.00/0.

Video game training and the reward system.

PubMed

Lorenz, Robert C; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

2015-01-01

Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training.

Diurnal rhythms in psychological reward functioning in healthy young men: 'Wanting', liking, and learning.

PubMed

Byrne, Jamie E M; Murray, Greg

2017-01-01

A range of evidence suggests that human reward functioning is partly driven by the endogenous circadian system, generating 24-hour rhythms in behavioural measures of reward activation. Reward functioning is multifaceted but literature to date is largely limited to measures of self-reported positive mood states. The aim of this study was to advance the field by testing for hypothesised diurnal variation in previously unexplored components of psychological reward: 'wanting', liking, and learning using subjective and behavioural measures. Risky decision making (automatic Balloon Analogue Risk Task), affective responsivity to positive images (International Affective Pictures System), uncued self-reported discrete emotions, and learning-contingent reward (Iowa Gambling Task) were measured at 10.00 hours, 14.00 hours, and 19.00 hours in a counterbalanced repeated measures design with 50 healthy male participants (aged 18-30). As hypothesised, risky decision making (unconscious 'wanting') and ratings of arousal towards positive images (conscious wanting) exhibited a diurnal waveform with indices highest at 14.00 hours. No diurnal rhythm was observed for liking (pleasure ratings to positive images, discrete uncued positive emotions) or in a learning-contingent reward task. Findings reaffirm that diurnal variation in human reward functioning is most pronounced in the motivational 'wanting' components of reward.

Video game training and the reward system

PubMed Central

Lorenz, Robert C.; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

2015-01-01

Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training. PMID:25698962

Dopaminergic modulation of the human reward system: a placebo-controlled dopamine depletion fMRI study.

PubMed

da Silva Alves, Fabiana; Schmitz, Nicole; Figee, Martijn; Abeling, Nico; Hasler, Gregor; van der Meer, Johan; Nederveen, Aart; de Haan, Lieuwe; Linszen, Don; van Amelsvoort, Therese

2011-04-01

Reward related behaviour is linked to dopaminergic neurotransmission. Our aim was to gain insight into dopaminergic involvement in the human reward system. Combining functional magnetic resonance imaging with dopaminergic depletion by α-methylparatyrosine we measured dopamine-related brain activity in 10 healthy volunteers. In addition to blood-oxygen-level-dependent (BOLD) contrast we assessed the effect of dopaminergic depletion on prolactin response, peripheral markers for dopamine and norepinephrine. In the placebo condition we found increased activation in the left caudate and left cingulate gyrus during anticipation of reward. In the α-methylparatyrosine condition there was no significant brain activation during anticipation of reward or loss. In α-methylparatyrosine, anticipation of reward vs. loss increased activation in the right insula, left frontal, right parietal cortices and right cingulate gyrus. Comparing placebo versus α-methylparatyrosine showed increased activation in the left cingulate gyrus during anticipation of reward and the left medial frontal gyrus during anticipation of loss. α-methylparatyrosine reduced levels of dopamine in urine and homovanillic acid in plasma and increased prolactin. No significant effect of α-methylparatyrosine was found on norepinephrine markers. Our findings implicate distinct patterns of BOLD underlying reward processing following dopamine depletion, suggesting a role of dopaminergic neurotransmission for anticipation of monetary reward.

Ghrelin receptor antagonism attenuates cocaine- and amphetamine-induced locomotor stimulation, accumbal dopamine release, and conditioned place preference.

PubMed

Jerlhag, Elisabet; Egecioglu, Emil; Dickson, Suzanne L; Engel, Jörgen A

2010-09-01

Recently we demonstrated that genetic or pharmacological suppression of the central ghrelin signaling system, involving the growth hormone secretagogue receptor 1A (GHS-R1A), lead to a reduced reward profile from alcohol. As the target circuits for ghrelin in the brain include a mesolimbic reward pathway that is intimately associated with reward-seeking behaviour, we sought to determine whether the central ghrelin signaling system is required for reward from drugs of abuse other than alcohol, namely cocaine or amphetamine. We found that amphetamine-as well as cocaine-induced locomotor stimulation and accumbal dopamine release were reduced in mice treated with a GHS-R1A antagonist. Moreover, the ability of these drugs to condition a place preference was also attenuated by the GHS-R1A antagonist. Thus GHS-R1A appears to be required not only for alcohol-induced reward, but also for reward induced by psychostimulant drugs. Our data suggest that the central ghrelin signaling system constitutes a novel potential target for treatment of addictive behaviours such as drug dependence.

Reward in the mirror neuron system, social context, and the implications on psychopathology.

PubMed

Brown, Elliot C; Brüne, Martin

2014-04-01

Positive and negative reinforcers guide our behaviors as we interact with others in our social environment. Here, we present evidence that highlights a central role for reward in the general functioning of the mirror neuron system (MNS). We also discuss the relevance of reward-related modulation on other previous findings revealing certain properties of the MNS, and on social context and psychopathology.

78 FR 18384 - Self-Regulatory Organizations; BATS Exchange, Inc.; Order Approving Proposed Rule Change To...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-03-26

... rewards would go to the market maker with the highest number of winning tests and 20% of the total rewards... to allocate the rewards differently. Instead of a fixed dollar amount, the Exchange would reward the... and to perfect the mechanism for a free and open market and a national market system, and, in general...

Changes in reward-induced brain activation in opiate addicts.

PubMed

Martin-Soelch, C; Chevalley, A F; Künig, G; Missimer, J; Magyar, S; Mino, A; Schultz, W; Leenders, K L

2001-10-01

Many studies indicate a role of the cerebral dopaminergic reward system in addiction. Motivated by these findings, we examined in opiate addicts whether brain regions involved in the reward circuitry also react to human prototypical rewards. We measured regional cerebral blood flow (rCBF) with H(2)(15)O positron emission tomography (PET) during a visuo-spatial recognition task with delayed response in control subjects and in opiate addicts participating in a methadone program. Three conditions were defined by the types of feedback: nonsense feedback; nonmonetary reinforcement; or monetary reward, received by the subjects for a correct response. We found in the control subjects rCBF increases in regions associated with the meso-striatal and meso-corticolimbic circuits in response to both monetary reward and nonmonetary reinforcement. In opiate addicts, these regions were activated only in response to monetary reward. Furthermore, nonmonetary reinforcement elicited rCBF increases in limbic regions of the opiate addicts that were not activated in the control subjects. Because psychoactive drugs serve as rewards and directly affect regions of the dopaminergic system like the striatum, we conclude that the differences in rCBF increases between controls and addicts can be attributed to an adaptive consequence of the addiction process.

Amygdala mu-opioid receptors mediate the motivating influence of cue-triggered reward expectations.

PubMed

Lichtenberg, Nina T; Wassum, Kate M

2017-02-01

Environmental reward-predictive stimuli can retrieve from memory a specific reward expectation that allows them to motivate action and guide choice. This process requires the basolateral amygdala (BLA), but little is known about the signaling systems necessary within this structure. Here we examined the role of the neuromodulatory opioid receptor system in the BLA in such cue-directed action using the outcome-specific Pavlovian-to-instrumental transfer (PIT) test in rats. Inactivation of BLA mu-, but not delta-opioid receptors was found to dose-dependently attenuate the ability of a reward-predictive cue to selectively invigorate the performance of actions directed at the same unique predicted reward (i.e. to express outcome-specific PIT). BLA mu-opioid receptor inactivation did not affect the ability of a reward itself to similarly motivate action (outcome-specific reinstatement), suggesting a more selective role for the BLA mu-opioid receptor in the motivating influence of currently unobservable rewarding events. These data reveal a new role for BLA mu-opioid receptor activation in the cued recall of precise reward memories and the use of this information to motivate specific action plans. © 2016 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

Serotonergic modulation of reward and punishment: evidence from pharmacological fMRI studies.

PubMed

Macoveanu, Julian

2014-03-27

Until recently, the bulk of research on the human reward system was focused on studying the dopaminergic and opioid neurotransmitter systems. However, extending the initial data from animal studies on reward, recent pharmacological brain imaging studies on human participants bring a new line of evidence on the key role serotonin plays in reward processing. The reviewed research has revealed how central serotonin availability and receptor specific transmission modulates the neural response to both appetitive (rewarding) and aversive (punishing) stimuli in putative reward-related brain regions. Thus, serotonin is suggested to be involved in behavioral control when there is a prospect of reward or punishment. The new findings may have implications in understanding psychiatric disorders such as major depression which is characterized by abnormal serotonergic function and reward-related processing and may also provide a neural correlated for the emotional blunting observed in the clinical treatment of psychiatric disorders with selective serotonin reuptake inhibitors. Given the unique profile of action of each serotonergic receptor subtype, future pharmacological studies may favor receptor specific investigations to complement present research mainly focused on global serotonergic manipulations. Copyright © 2014 Elsevier B.V. All rights reserved.

Neural correlates of reward-based spatial learning in persons with cocaine dependence.

PubMed

Tau, Gregory Z; Marsh, Rachel; Wang, Zhishun; Torres-Sanchez, Tania; Graniello, Barbara; Hao, Xuejun; Xu, Dongrong; Packard, Mark G; Duan, Yunsuo; Kangarlu, Alayar; Martinez, Diana; Peterson, Bradley S

2014-02-01

Dysfunctional learning systems are thought to be central to the pathogenesis of and impair recovery from addictions. The functioning of the brain circuits for episodic memory or learning that support goal-directed behavior has not been studied previously in persons with cocaine dependence (CD). Thirteen abstinent CD and 13 healthy participants underwent MRI scanning while performing a task that requires the use of spatial cues to navigate a virtual-reality environment and find monetary rewards, allowing the functional assessment of the brain systems for spatial learning, a form of episodic memory. Whereas both groups performed similarly on the reward-based spatial learning task, we identified disturbances in brain regions involved in learning and reward in CD participants. In particular, CD was associated with impaired functioning of medial temporal lobe (MTL), a brain region that is crucial for spatial learning (and episodic memory) with concomitant recruitment of striatum (which normally participates in stimulus-response, or habit, learning), and prefrontal cortex. CD was also associated with enhanced sensitivity of the ventral striatum to unexpected rewards but not to expected rewards earned during spatial learning. We provide evidence that spatial learning in CD is characterized by disturbances in functioning of an MTL-based system for episodic memory and a striatum-based system for stimulus-response learning and reward. We have found additional abnormalities in distributed cortical regions. Consistent with findings from animal studies, we provide the first evidence in humans describing the disruptive effects of cocaine on the coordinated functioning of multiple neural systems for learning and memory.

Viewing pictures of a romantic partner reduces experimental pain: involvement of neural reward systems.

PubMed

Younger, Jarred; Aron, Arthur; Parke, Sara; Chatterjee, Neil; Mackey, Sean

2010-10-13

The early stages of a new romantic relationship are characterized by intense feelings of euphoria, well-being, and preoccupation with the romantic partner. Neuroimaging research has linked those feelings to activation of reward systems in the human brain. The results of those studies may be relevant to pain management in humans, as basic animal research has shown that pharmacologic activation of reward systems can substantially reduce pain. Indeed, viewing pictures of a romantic partner was recently demonstrated to reduce experimental thermal pain. We hypothesized that pain relief evoked by viewing pictures of a romantic partner would be associated with neural activations in reward-processing centers. In this functional magnetic resonance imaging (fMRI) study, we examined fifteen individuals in the first nine months of a new, romantic relationship. Participants completed three tasks under periods of moderate and high thermal pain: 1) viewing pictures of their romantic partner, 2) viewing pictures of an equally attractive and familiar acquaintance, and 3) a word-association distraction task previously demonstrated to reduce pain. The partner and distraction tasks both significantly reduced self-reported pain, although only the partner task was associated with activation of reward systems. Greater analgesia while viewing pictures of a romantic partner was associated with increased activity in several reward-processing regions, including the caudate head, nucleus accumbens, lateral orbitofrontal cortex, amygdala, and dorsolateral prefrontal cortex--regions not associated with distraction-induced analgesia. The results suggest that the activation of neural reward systems via non-pharmacologic means can reduce the experience of pain.

5 CFR 9701.409 - Rating and rewarding performance.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 5 Administrative Personnel 3 2010-01-01 2010-01-01 false Rating and rewarding performance. 9701.409 Section 9701.409 Administrative Personnel DEPARTMENT OF HOMELAND SECURITY HUMAN RESOURCES... SECURITY HUMAN RESOURCES MANAGEMENT SYSTEM Performance Management § 9701.409 Rating and rewarding...

The influence of motherhood on neural systems for reward processing in low income, minority, young women.

PubMed

Moses-Kolko, Eydie L; Forbes, Erika E; Stepp, Stephanie; Fraser, David; Keenan, Kate E; Guyer, Amanda E; Chase, Henry W; Phillips, Mary L; Zevallos, Carlos R; Guo, Chaohui; Hipwell, Alison E

2016-04-01

Given the association between maternal caregiving behavior and heightened neural reward activity in experimental animal studies, the present study examined whether motherhood in humans positively modulates reward-processing neural circuits, even among mothers exposed to various life stressors and depression. Subjects were 77 first-time mothers and 126 nulliparous young women from the Pittsburgh Girls Study, a longitudinal study beginning in childhood. Subjects underwent a monetary reward task during functional magnetic resonance imaging in addition to assessment of current depressive symptoms. Life stress was measured by averaging data collected between ages 8-15 years. Using a region-of-interest approach, we conducted hierarchical regression to examine the relationship of psychosocial factors (life stress and current depression) and motherhood with extracted ventral striatal (VST) response to reward anticipation. Whole-brain regression analyses were performed post-hoc to explore non-striatal regions associated with reward anticipation in mothers vs nulliparous women. Anticipation of monetary reward was associated with increased neural activity in expected regions including caudate, orbitofrontal, occipital, superior and middle frontal cortices. There was no main effect of motherhood nor motherhood-by-psychosocial factor interaction effect on VST response during reward anticipation. Depressive symptoms were associated with increased VST activity across the entire sample. In exploratory whole brain analysis, motherhood was associated with increased somatosensory cortex activity to reward (FWE cluster forming threshold p<0.001). These findings indicate that motherhood is not associated with reward anticipation-related VST activity nor does motherhood modulate the impact of depression or life stress on VST activity. Future studies are needed to evaluate whether earlier postpartum assessment of reward function, inclusion of mothers with more severe depressive symptoms, and use of reward tasks specific for social reward might reveal an impact of motherhood on reward system activity. Copyright © 2016 Elsevier Ltd. All rights reserved.

The effects of intranasal oxytocin on reward circuitry responses in children with autism spectrum disorder.

PubMed

Greene, R K; Spanos, M; Alderman, C; Walsh, E; Bizzell, J; Mosner, M G; Kinard, J L; Stuber, G D; Chandrasekhar, T; Politte, L C; Sikich, L; Dichter, G S

2018-03-27

Intranasal oxytocin (OT) has been shown to improve social communication functioning of individuals with autism spectrum disorder (ASD) and, thus, has received considerable interest as a potential ASD therapeutic agent. Although preclinical research indicates that OT modulates the functional output of the mesocorticolimbic dopamine system that processes rewards, no clinical brain imaging study to date has examined the effects of OT on this system using a reward processing paradigm. To address this, we used an incentive delay task to examine the effects of a single dose of intranasal OT, versus placebo (PLC), on neural responses to social and nonsocial rewards in children with ASD. In this placebo-controlled double-blind study, 28 children and adolescents with ASD (age: M = 13.43 years, SD = 2.36) completed two fMRI scans, one after intranasal OT administration and one after PLC administration. During both scanning sessions, participants completed social and nonsocial incentive delay tasks. Task-based neural activation and connectivity were examined to assess the impact of OT relative to PLC on mesocorticolimbic brain responses to social and nonsocial reward anticipation and outcomes. Central analyses compared the OT and PLC conditions. During nonsocial reward anticipation, there was greater activation in the right nucleus accumbens (NAcc), left anterior cingulate cortex (ACC), bilateral orbital frontal cortex (OFC), left superior frontal cortex, and right frontal pole (FP) during the OT condition relative to PLC. Alternatively, during social reward anticipation and outcomes, there were no significant increases in brain activation during the OT condition relative to PLC. A Treatment Group × Reward Condition interaction revealed relatively greater activation in the right NAcc, right caudate nucleus, left ACC, and right OFC during nonsocial relative to social reward anticipation during the OT condition relative to PLC. Additionally, these analyses revealed greater activation during nonsocial reward outcomes during the OT condition relative to PLC in the right OFC and left FP. Finally, functional connectivity analyses generally revealed changes in frontostriatal connections during the OT condition relative to PLC in response to nonsocial, but not social, rewards. The effects of intranasal OT administration on mesocorticolimbic brain systems that process rewards in ASD were observable primarily during the processing of nonsocial incentive salience stimuli. These findings have implications for understanding the effects of OT on neural systems that process rewards, as well as for experimental trials of novel ASD treatments developed to ameliorate social communication impairments in ASD.

Mechanisms of Habitual Approach

PubMed Central

Anderson, Brian A.; Folk, Charles L.; Garrison, Rebecca; Rogers, Leeland

2016-01-01

Reward learning has a powerful influence on the attention system, causing previously reward-associated stimuli to automatically capture attention. Difficulty ignoring stimuli associated with drug reward has been linked to addiction relapse, and the attention system of drug-dependent patients seems especially influenced by reward history. This and other evidence suggests that value-driven attention has consequences for behavior and decision-making, facilitating a bias to approach and consume the previously reward-associated stimulus even when doing so runs counter to current goals and priorities. Yet, a mechanism linking value-driven attention to behavioral responding and a general approach bias is lacking. Here we show that previously reward-associated stimuli escape inhibitory processing in a go/no-go task. Control experiments confirmed that this value-dependent failure of goal-directed inhibition could not be explained by search history or residual motivation, but depended specifically on the learned association between particular stimuli and reward outcome. When a previously high-value stimulus is encountered, the response codes generated by that stimulus are automatically afforded high priority, bypassing goal-directed cognitive processes involved in suppressing task-irrelevant behavior. PMID:27054684

Reward Dependent Invigoration Relates to Theta Oscillations and Is Predicted by Dopaminergic Midbrain Integrity in Healthy Elderly.

PubMed

Steiger, Tineke K; Bunzeck, Nico

2017-01-01

Motivation can have invigorating effects on behavior via dopaminergic neuromodulation. While this relationship has mainly been established in theoretical models and studies in younger subjects, the impact of structural declines of the dopaminergic system during healthy aging remains unclear. To investigate this issue, we used electroencephalography (EEG) in healthy young and elderly humans in a reward-learning paradigm. Specifically, scene images were initially encoded by combining them with cues predicting monetary reward (high vs. low reward). Subsequently, recognition memory for the scenes was tested. As a main finding, we can show that response times (RTs) during encoding were faster for high reward predicting images in the young but not elderly participants. This pattern was resembled in power changes in the theta-band (4-7 Hz). Importantly, analyses of structural MRI data revealed that individual reward-related differences in the elderlies' response time could be predicted by the structural integrity of the dopaminergic substantia nigra (SN; as measured by magnetization transfer (MT)). These findings suggest a close relationship between reward-based invigoration, theta oscillations and age-dependent changes of the dopaminergic system.

Individual differences in anticipatory activity to food rewards predict cue-induced appetitive 50-kHz calls in rats.

PubMed

Brenes, Juan C; Schwarting, Rainer K W

2015-10-01

Reward-related stimuli come to acquire incentive salience through Pavlovian learning and become capable of controlling reward-oriented behaviors. Here, we examined individual differences in anticipatory activity elicited by reward-related cues as indicative of how animals attribute incentive salience to otherwise neutral stimuli. Since adult rats can signal incentive motivation states through ultrasonic vocalizations (USVs) at around 50-kHz, such calls were recorded in food-deprived rats trained to associate cues with food rewards, which were subsequently devalued by satiation.We found that the extent to which animals developed conditioned anticipatory activity to food cues while food deprived determined the level of cue-induced appetitive USVs while sated. Re-exposure to reward cues after a free-testing period reinstated USVs, invigorated reward seeking and consumption, and again, increases in calling occurred only in animals with high levels of cue-induced anticipatory activity. Reward-experienced rats systemically challenged with the catecholamine agonist amphetamine or with the dopamine receptor antagonist flupenthixol showed attenuated responses to these drugs, especially for USVs and in subjects with high levels of cue-induced anticipatory activity. Our results suggest that individuals prone to attribute incentive salience to reward cues showed heightened reward-induced USVs which were reliably expressed over time and persisted despite physiological needs being fulfilled. Also, prone subjects seemed to undergo particular adaptations in their dopaminergic system related with incentive learning. Our findings may have translational relevance in preclinical research modeling compulsive disorders, which may be due to excessive attribution of incentive salience to reward cues, such as overeating, pathological gambling, and drug addiction.

Mechanisms Underlying the Risk to Develop Drug Addiction, Insights From Studies in Drosophila melanogaster.

PubMed

Ryvkin, Julia; Bentzur, Assa; Zer-Krispil, Shir; Shohat-Ophir, Galit

2018-01-01

The ability to adapt to environmental changes is an essential feature of biological systems, achieved in animals by a coordinated crosstalk between neuronal and hormonal programs that allow rapid and integrated organismal responses. Reward systems play a key role in mediating this adaptation by reinforcing behaviors that enhance immediate survival, such as eating or drinking, or those that ensure long-term survival, such as sexual behavior or caring for offspring. Drugs of abuse co-opt neuronal and molecular pathways that mediate natural rewards, which under certain circumstances can lead to addiction. Many factors can contribute to the transition from drug use to drug addiction, highlighting the need to discover mechanisms underlying the progression from initial drug use to drug addiction. Since similar responses to natural and drug rewards are present in very different animals, it is likely that the central systems that process reward stimuli originated early in evolution, and that common ancient biological principles and genes are involved in these processes. Thus, the neurobiology of natural and drug rewards can be studied using simpler model organisms that have their systems stripped of some of the immense complexity that exists in mammalian brains. In this paper we review studies in Drosophila melanogaster that model different aspects of natural and drug rewards, with an emphasis on how motivational states shape the value of the rewarding experience, as an entry point to understanding the mechanisms that contribute to the vulnerability of drug addiction.

Dopamine signaling in reward-related behaviors.

PubMed

Baik, Ja-Hyun

2013-01-01

Dopamine (DA) regulates emotional and motivational behavior through the mesolimbic dopaminergic pathway. Changes in DA mesolimbic neurotransmission have been found to modify behavioral responses to various environmental stimuli associated with reward behaviors. Psychostimulants, drugs of abuse, and natural reward such as food can cause substantial synaptic modifications to the mesolimbic DA system. Recent studies using optogenetics and DREADDs, together with neuron-specific or circuit-specific genetic manipulations have improved our understanding of DA signaling in the reward circuit, and provided a means to identify the neural substrates of complex behaviors such as drug addiction and eating disorders. This review focuses on the role of the DA system in drug addiction and food motivation, with an overview of the role of D1 and D2 receptors in the control of reward-associated behaviors.

CLEANing the Reward: Counterfactual Actions to Remove Exploratory Action Noise in Multiagent Learning

NASA Technical Reports Server (NTRS)

HolmesParker, Chris; Taylor, Mathew E.; Tumer, Kagan; Agogino, Adrian

2014-01-01

Learning in multiagent systems can be slow because agents must learn both how to behave in a complex environment and how to account for the actions of other agents. The inability of an agent to distinguish between the true environmental dynamics and those caused by the stochastic exploratory actions of other agents creates noise in each agent's reward signal. This learning noise can have unforeseen and often undesirable effects on the resultant system performance. We define such noise as exploratory action noise, demonstrate the critical impact it can have on the learning process in multiagent settings, and introduce a reward structure to effectively remove such noise from each agent's reward signal. In particular, we introduce Coordinated Learning without Exploratory Action Noise (CLEAN) rewards and empirically demonstrate their benefits

Addiction is a Reward Deficit and Stress Surfeit Disorder

PubMed Central

Koob, George F.

2013-01-01

Drug addiction can be defined by a three-stage cycle – binge/intoxication, withdrawal/negative affect, and preoccupation/anticipation – that involves allostatic changes in the brain reward and stress systems. Two primary sources of reinforcement, positive and negative reinforcement, have been hypothesized to play a role in this allostatic process. The negative emotional state that drives negative reinforcement is hypothesized to derive from dysregulation of key neurochemical elements involved in the brain reward and stress systems. Specific neurochemical elements in these structures include not only decreases in reward system function (within-system opponent processes) but also recruitment of the brain stress systems mediated by corticotropin-releasing factor (CRF) and dynorphin-κ opioid systems in the ventral striatum, extended amygdala, and frontal cortex (both between-system opponent processes). CRF antagonists block anxiety-like responses associated with withdrawal, block increases in reward thresholds produced by withdrawal from drugs of abuse, and block compulsive-like drug taking during extended access. Excessive drug taking also engages the activation of CRF in the medial prefrontal cortex, paralleled by deficits in executive function that may facilitate the transition to compulsive-like responding. Neuropeptide Y, a powerful anti-stress neurotransmitter, has a profile of action on compulsive-like responding for ethanol similar to a CRF1 antagonist. Blockade of the κ opioid system can also block dysphoric-like effects associated with withdrawal from drugs of abuse and block the development of compulsive-like responding during extended access to drugs of abuse, suggesting another powerful brain stress system that contributes to compulsive drug seeking. The loss of reward function and recruitment of brain systems provide a powerful neurochemical basis that drives the compulsivity of addiction. PMID:23914176

Cannabinoid Regulation of Brain Reward Processing with an Emphasis on the Role of CB1 Receptors: A Step Back into the Future.

PubMed

Panagis, George; Mackey, Brian; Vlachou, Styliani

2014-01-01

Over the last decades, the endocannabinoid system has been implicated in a large variety of functions, including a crucial modulation of brain-reward circuits and the regulation of motivational processes. Importantly, behavioral studies have shown that cannabinoid compounds activate brain reward mechanisms and circuits in a similar manner to other drugs of abuse, such as nicotine, alcohol, cocaine, and heroin, although the conditions under which cannabinoids exert their rewarding effects may be more limited. Furthermore, there is evidence on the involvement of the endocannabinoid system in the regulation of cue- and drug-induced relapsing phenomena in animal models. The aim of this review is to briefly present the available data obtained using diverse behavioral experimental approaches in experimental animals, namely, the intracranial self-stimulation paradigm, the self-administration procedure, the conditioned place preference procedure, and the reinstatement of drug-seeking behavior procedure, to provide a comprehensive picture of the current status of what is known about the endocannabinoid system mechanisms that underlie modification of brain-reward processes. Emphasis is placed on the effects of cannabinoid 1 (CB1) receptor agonists, antagonists, and endocannabinoid modulators. Further, the role of CB1 receptors in reward processes is investigated through presentation of respective genetic ablation studies in mice. The vast majority of studies in the existing literature suggest that the endocannabinoid system plays a major role in modulating motivation and reward processes. However, much remains to be done before we fully understand these interactions. Further research in the future will shed more light on these processes and, thus, could lead to the development of potential pharmacotherapies designed to treat reward-dysfunction-related disorders.

Reward-Dependent Modulation of Movement Variability

PubMed Central

Izawa, Jun; Shadmehr, Reza

2015-01-01

Movement variability is often considered an unwanted byproduct of a noisy nervous system. However, variability can signal a form of implicit exploration, indicating that the nervous system is intentionally varying the motor commands in search of actions that yield the greatest success. Here, we investigated the role of the human basal ganglia in controlling reward-dependent motor variability as measured by trial-to-trial changes in performance during a reaching task. We designed an experiment in which the only performance feedback was success or failure and quantified how reach variability was modulated as a function of the probability of reward. In healthy controls, reach variability increased as the probability of reward decreased. Control of variability depended on the history of past rewards, with the largest trial-to-trial changes occurring immediately after an unrewarded trial. In contrast, in participants with Parkinson's disease, a known example of basal ganglia dysfunction, reward was a poor modulator of variability; that is, the patients showed an impaired ability to increase variability in response to decreases in the probability of reward. This was despite the fact that, after rewarded trials, reach variability in the patients was comparable to healthy controls. In summary, we found that movement variability is partially a form of exploration driven by the recent history of rewards. When the function of the human basal ganglia is compromised, the reward-dependent control of movement variability is impaired, particularly affecting the ability to increase variability after unsuccessful outcomes. PMID:25740529

Hyperresponsivity and impaired prefrontal control of the mesolimbic reward system in schizophrenia.

PubMed

Richter, Anja; Petrovic, Aleksandra; Diekhof, Esther K; Trost, Sarah; Wolter, Sarah; Gruber, Oliver

2015-12-01

Schizophrenia is characterized by substantial dysfunctions of reward processing, leading to detrimental consequences for decision-making. The neurotransmitter dopamine is responsible for the transmission of reward signals and also known to be involved in the mechanism of psychosis. Using functional magnetic resonance imaging (fMRI), sixteen medicated patients with schizophrenia and sixteen healthy controls performed the 'desire-reason dilemma' (DRD) paradigm. This paradigm allowed us to directly investigate reward-related brain activations depending on the interaction of bottom-up and top-down mechanisms, when a previously conditioned reward stimulus had to be rejected to achieve a superordinate long-term goal. Both patients and controls showed significant activations in the mesolimbic reward system. In patients with schizophrenia, however, we found a significant hyperactivation of the left ventral striatum (vStr) when they were allowed to accept the conditioned reward stimuli, and a reduced top-down regulation of activation in the ventral striatum (vStr) and ventral tegmental area (VTA) while having to reject the immediate reward to pursue the superordinate task-goal. Moreover, while healthy subjects exhibited a negative functional coupling of the vStr with both the anteroventral prefrontal cortex (avPFC) and the ventromedial prefrontal cortex (VMPFC) in the dilemma situation, this functional coupling was significantly impaired in the patient group. These findings provide evidence for an increased ventral striatal activation to reward stimuli and an impaired top-down control of reward signals by prefrontal brain regions in schizophrenia. Copyright © 2015 Elsevier Ltd. All rights reserved.

Reward inference by primate prefrontal and striatal neurons.

PubMed

Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru; Sakagami, Masamichi

2014-01-22

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus-reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning.

Reward Inference by Primate Prefrontal and Striatal Neurons

PubMed Central

Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru

2014-01-01

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus–reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning. PMID:24453328

Response of the REWARD detection system to the presence of a Radiological Dispersal Device

DOE Office of Scientific and Technical Information (OSTI.GOV)

Luis, R.; Baptista, M.; Barros, S.

2015-07-01

In recent years an increased international concern has emerged about the radiological and nuclear (RN) threats associated with the illicit trafficking of nuclear and radioactive materials that could be potentially used for terrorist attacks. The objective of the REWARD (Real Time Wide Area Radiation Surveillance System) project, co-funded by the European Union 7. Framework Programme Security, consisted in building a mobile system for real time, wide area radiation surveillance, using a CdZnTe detector for gamma radiation and a neutron detector based on novel silicon technologies. The sensing unit includes a GPS system and a wireless communication interface to send themore » data remotely to a monitoring base station, where it will be analyzed in real time and correlated with historical data from the tag location, in order to generate an alarm when an abnormal situation is detected. Due to its portability and accuracy, the system will be extremely useful in many different scenarios such as nuclear terrorism, lost radioactive sources, radioactive contamination or nuclear accidents. This paper shortly introduces the REWARD detection system, depicts some terrorist threat scenarios involving radioactive sources and special nuclear materials and summarizes the simulation work undertaken during the past three years in the framework of the REWARD project. The main objective consisted in making predictions regarding the behavior of the REWARD system in the presence of a Radiological Dispersion Device (RDD), one of the reference scenarios foreseen for REWARD, using the Monte Carlo simulation program MCNP6. The reference scenario is characterized in detail, from the i) radiological protection, ii) radiation detection requirements and iii) communications points of view. Experimental tests were performed at the Fire Brigades Facilities in Rome and at the Naples Fire Brigades, and the results, which validate the simulation work, are presented and analyzed. The response of the REWARD detection system to the presence of an RDD is predicted and discussed. (authors)« less

Addiction and the brain antireward system.

PubMed

Koob, George F; Le Moal, Michel

2008-01-01

A neurobiological model of the brain emotional systems has been proposed to explain the persistent changes in motivation that are associated with vulnerability to relapse in addiction, and this model may generalize to other psychopathology associated with dysregulated motivational systems. In this framework, addiction is conceptualized as a cycle of decreased function of brain reward systems and recruitment of antireward systems that progressively worsen, resulting in the compulsive use of drugs. Counteradaptive processes, such as opponent process, that are part of the normal homeostatic limitation of reward function fail to return within the normal homeostatic range and are hypothesized to repeatedly drive the allostatic state. Excessive drug taking thus results in not only the short-term amelioration of the reward deficit but also suppression of the antireward system. However, in the long term, there is worsening of the underlying neurochemical dysregulations that ultimately form an allostatic state (decreased dopamine and opioid peptide function, increased corticotropin-releasing factor activity). This allostatic state is hypothesized to be reflected in a chronic deviation of reward set point that is fueled not only by dysregulation of reward circuits per se but also by recruitment of brain and hormonal stress responses. Vulnerability to addiction may involve genetic comorbidity and developmental factors at the molecular, cellular, or neurocircuitry levels that sensitize the brain antireward systems.

Aerobic exercise modulates anticipatory reward processing via the μ-opioid receptor system.

PubMed

Saanijoki, Tiina; Nummenmaa, Lauri; Tuulari, Jetro J; Tuominen, Lauri; Arponen, Eveliina; Kalliokoski, Kari K; Hirvonen, Jussi

2018-06-08

Physical exercise modulates food reward and helps control body weight. The endogenous µ-opioid receptor (MOR) system is involved in rewarding aspects of both food and physical exercise, yet interaction between endogenous opioid release following exercise and anticipatory food reward remains unresolved. Here we tested whether exercise-induced opioid release correlates with increased anticipatory reward processing in humans. We scanned 24 healthy lean men after rest and after a 1 h session of aerobic exercise with positron emission tomography (PET) using MOR-selective radioligand [ 11 C]carfentanil. After both PET scans, the subjects underwent a functional magnetic resonance imaging (fMRI) experiment where they viewed pictures of palatable versus nonpalatable foods to trigger anticipatory food reward responses. Exercise-induced changes in MOR binding in key regions of reward circuit (amygdala, thalamus, ventral and dorsal striatum, and orbitofrontal and cingulate cortices) were used to predict the changes in anticipatory reward responses in fMRI. Exercise-induced changes in MOR binding correlated negatively with the exercise-induced changes in neural anticipatory food reward responses in orbitofrontal and cingulate cortices, insula, ventral striatum, amygdala, and thalamus: higher exercise-induced opioid release predicted higher brain responses to palatable versus nonpalatable foods. We conclude that MOR activation following exercise may contribute to the considerable interindividual variation in food craving and consumption after exercise, which might promote compensatory eating and compromise weight control. © 2018 Wiley Periodicals, Inc.

Impairments in learning by monetary rewards and alcohol-associated rewards in detoxified alcoholic patients.

PubMed

Jokisch, Daniel; Roser, Patrik; Juckel, Georg; Daum, Irene; Bellebaum, Christian

2014-07-01

Excessive alcohol consumption has been linked to structural and functional brain changes associated with cognitive, emotional, and behavioral impairments. It has been suggested that neural processing in the reward system is also affected by alcoholism. The present study aimed at further investigating reward-based associative learning and reversal learning in detoxified alcohol-dependent patients. Twenty-one detoxified alcohol-dependent patients and 26 healthy control subjects participated in a probabilistic learning task using monetary and alcohol-associated rewards as feedback stimuli indicating correct responses. Performance during acquisition and reversal learning in the different feedback conditions was analyzed. Alcohol-dependent patients and healthy control subjects showed an increase in learning performance over learning blocks during acquisition, with learning performance being significantly lower in alcohol-dependent patients. After changing the contingencies, alcohol-dependent patients exhibited impaired reversal learning and showed, in contrast to healthy controls, different learning curves for different types of rewards with no increase in performance for high monetary and alcohol-associated feedback. The present findings provide evidence that dysfunctional processing in the reward system in alcohol-dependent patients leads to alterations in reward-based learning resulting in a generally reduced performance. In addition, the results suggest that alcohol-dependent patients are, in particular, more impaired in changing an established behavior originally reinforced by high rewards. Copyright © 2014 by the Research Society on Alcoholism.

Abnormal Reward System Activation in Mania

PubMed Central

Abler, Birgit; Greenhouse, Ian; Ongur, Dost; Walter, Henrik; Heckers, Stephan

2008-01-01

Transmission of reward signals is a function of dopamine, a neurotransmitter known to be involved in the mechanism of psychosis. Using functional magnetic resonance imaging (fMRI), we investigated how expectation and receipt of monetary rewards modulate brain activation in patients with bipolar mania and schizophrenia. We studied 12 acutely manic patients with a history of bipolar disorder, 12 patients with a current episode of schizoaffective disorder or schizophrenia and 12 healthy subjects. All patients were treated with dopamine antagonists at the time of the study. Subjects performed a delayed incentive paradigm with monetary reward in the scanner that allowed for investigating effects of expectation, receipt, and omission of rewards. Patients with schizophrenia and healthy control subjects showed the expected activation of dopaminergic brain areas, that is, ventral tegmentum activation upon expectation of monetary rewards and nucleus accumbens activation during receipt vs omission of rewards. In manic patients, however, we did not find a similar pattern of brain activation and the differential signal in the nucleus accumbens upon receipt vs omission of rewards was significantly lower compared to the healthy control subjects. Our findings provide evidence for abnormal function of the dopamine system during receipt or omission of expected rewards in bipolar disorder. These deficits in prediction error processing in acute mania may help to explain symptoms of disinhibition and abnormal goal pursuit regulation. PMID:17987058

The role of the dopaminergic projections in MFB self-stimulation.

PubMed

Gallistel, C R

1986-11-01

Psychophysical experiments indicate that the first stage of the reward pathway in medial forebrain bundle self-stimulation consists of small myelinated descending axons. Pharmacological experiments show that neuroleptics attenuate or abolish the rewarding effect. This had led to the hypothesis that the descending myelinated axons synapse on an ascending dopaminergic second stage projection. 2-Deoxy-[14C]glucose autoradiography in self-stimulating animals or animals receiving automatically administered rewarding stimulation after treatment with reward-blocking doses of pimozide reveals activation of a descending myelinated system but no stimulation-produced activation of an ascending dopaminergic projection system, even though the autoradiographic method reveals the mild elevations and depressions of activity in dopaminergic terminal fields consequent upon injections of neuroleptics and amphetamine, respectively, and the strong activation of the nigrostriatal projection produced by stimulating directly in the substantia nigra. When the effects of neuroleptics and clonidine are measured by the psychophysical method (that is, by lateral shifts in the rate-frequency function), it is found that both drugs produce only gradual and rather small attenuations of rewarding efficacy up to doses at which it is no longer possible to measure their effects. It is suggested that, for neuroleptics at least, the rewarding effect abruptly fails at these doses. It is further suggested that these drugs do not act on the rewarding pathway itself, but on the process by which the rewarding signal is converted to an enduring rewarding effect.

The role of the dopaminergic projections in MFB self-stimulation.

PubMed

Gallistel, C R

1986-06-01

Psychophysical experiments indicate that the first stage of the reward pathway in medial forebrain bundle self-stimulation consists of small myelinated descending axons. Pharmacological experiments show that neuroleptics attenuate or abolish the rewarding effect. This had led to the hypothesis that the descending myelinated axons synapse on an ascending dopaminergic second stage projection. 2-Deoxy-[14C]glucose autoradiography in self-stimulating animals or animals receiving automatically administered rewarding stimulation after treatment with reward-blocking doses of pimozide reveals activation of a descending myelinated system but no stimulation-produced activation of an ascending dopaminergic projection system, even though the autoradiographic method reveals the mild elevations and depressions of activity in dopaminergic terminal fields consequent upon injections of neuroleptics and amphetamine, respectively, and the strong activation of the nigrostriatal projection produced by stimulating directly in the substantia nigra. When the effects of neuroleptics and clonidine are measured by the psychophysical method (that is, by lateral shifts in the rate-frequency function), it is found that both drugs produce only gradual and rather small attenuations of rewarding efficacy up to doses at which it is no longer possible to measure their effects. It is suggested that, for neuroleptics at least, the rewarding effect abruptly fails at these doses. It is further suggested that these drugs do not act on the rewarding pathway itself, but on the process by which the rewarding signal is converted to an enduring rewarding effect.

D-amphetamine stimulates unconditioned exploration/approach behaviors in crayfish: towards a conserved evolutionary function of ancestral drug reward

PubMed Central

Alcaro, Antonio; Panksepp, Jaak; Huber, Robert

2012-01-01

In mammals, rewarding properties of drugs depend on their capacity to activate a dopamine-mediated appetitive motivational seeking state—a system that allows animals to pursue and find all kinds of objects and events needed for survival. With such states strongly conserved in evolution, invertebrates have recently been developed into a powerful model in addiction research, where a shared ancestral brain system for the acquisition of reward can mediate drug addiction in many species. A conditioned place preference paradigm has illustrated that crayfish seek out environments that had previously been paired with psychostimulant and opioid administration. The present work demonstrates that the administration of d-amphetamine stimulates active explorative behaviors in crayfish through the action of the drug within their head ganglion. Crayfish, with a modularly organized and experimentally accessible, ganglionic nervous system offers a unique model to investigate (1) the fundamental, biological mechanisms of addictive drug reward; (2) how an appetitive/seeking disposition is implemented in a simple neural system, and (3) how it mediates the rewarding actions of major drugs of abuse. PMID:21504757

An Examination of the Multi-Faceted Motivation System in Healthy Young Adults.

PubMed

Da Silva, Susana; Apatsidou, Areti; Saperia, Sarah; Siddiqui, Ishraq; Jeffay, Eliyas; Voineskos, Aristotle N; Daskalakis, Zafiris J; Remington, Gary; Zakzanis, Konstantine K; Foussias, George

2018-01-01

Background: Amotivation is a prevalent symptom in schizophrenia (SZ) and depression (MDD), and is linked to poor functional outcomes in affected individuals. Conceptualizations of motivation have outlined a multi-faceted construct comprised of reward responsiveness, reward expectancy, reward valuation, effort valuation, and action selection/preference-based decision making. To date, findings from studies utilizing variable-centered approaches to examining isolated facets of motivation in SZ and MDD have been inconsistent. Thus, the present study adopted a person-centered approach, and comprehensively examined the reward system in a non-clinical sample in an attempt to explore potential subtypes of motivation impairments, while minimizing the effects of illness-related confounds. Methods: Ninety-six healthy undergraduate students were evaluated for amotivation, schizotypal traits, depressive symptoms, and cognition, and administered objective computerized tasks to measure the different facets of motivation. Cluster analysis was performed to explore subgroups of individuals based on similar motivation task performance. Additionally, correlational analyses were conducted in order to examine inter-relationships between motivation facets, and relations between clinical measures and facets of motivation. Results: Cluster analysis identified two subgroups of individuals with differential motivation performance profiles. Correlational analyses revealed that reward responsiveness was associated with amotivation, depressive symptoms, and negative schizotypy. Further, significant inter-correlations were found between reward responsiveness and reward expectancy, as well as between reward valuation and effort valuation. Conclusions: Our results mark important steps forward in understanding motivation in a non-clinical sample, and guide future dimensional and comprehensive analyses of the multi-faceted reward system. It remains to be seen whether these patterns of results will be similar in clinical populations such as SZ and MDD.

An Examination of the Multi-Faceted Motivation System in Healthy Young Adults

PubMed Central

Da Silva, Susana; Apatsidou, Areti; Saperia, Sarah; Siddiqui, Ishraq; Jeffay, Eliyas; Voineskos, Aristotle N.; Daskalakis, Zafiris J.; Remington, Gary; Zakzanis, Konstantine K.; Foussias, George

2018-01-01

Background: Amotivation is a prevalent symptom in schizophrenia (SZ) and depression (MDD), and is linked to poor functional outcomes in affected individuals. Conceptualizations of motivation have outlined a multi-faceted construct comprised of reward responsiveness, reward expectancy, reward valuation, effort valuation, and action selection/preference-based decision making. To date, findings from studies utilizing variable-centered approaches to examining isolated facets of motivation in SZ and MDD have been inconsistent. Thus, the present study adopted a person-centered approach, and comprehensively examined the reward system in a non-clinical sample in an attempt to explore potential subtypes of motivation impairments, while minimizing the effects of illness-related confounds. Methods: Ninety-six healthy undergraduate students were evaluated for amotivation, schizotypal traits, depressive symptoms, and cognition, and administered objective computerized tasks to measure the different facets of motivation. Cluster analysis was performed to explore subgroups of individuals based on similar motivation task performance. Additionally, correlational analyses were conducted in order to examine inter-relationships between motivation facets, and relations between clinical measures and facets of motivation. Results: Cluster analysis identified two subgroups of individuals with differential motivation performance profiles. Correlational analyses revealed that reward responsiveness was associated with amotivation, depressive symptoms, and negative schizotypy. Further, significant inter-correlations were found between reward responsiveness and reward expectancy, as well as between reward valuation and effort valuation. Conclusions: Our results mark important steps forward in understanding motivation in a non-clinical sample, and guide future dimensional and comprehensive analyses of the multi-faceted reward system. It remains to be seen whether these patterns of results will be similar in clinical populations such as SZ and MDD.

Use of multiple-site performance-contingent SEMG reward programming in pediatric rehabilitation: a retrospective review.

PubMed

Bolek, Jeffrey E

2006-09-01

We completed a retrospective review of the effectiveness of multi-site, performance-contingent reward programming on functional change in motor performance of 16 treatment resistant children. Patients were previously treated in physical or occupational therapy for head control, standing balance training, sitting and upper extremity use (brachial plexus injury). They then participated in a program that utilized multiple surface electromyography sites the use of which was rewarded with videos for performing the correct constellation of recruitment pattern (e.g., contracting some muscles while relaxing others). Onset of reward was calibrated for each patient and transfer of skill to outside the clinic was encouraged by linking a verbal cue to the correct motor plan. Fourteen of the 16 patients improved. The implications of the use of this technique in the treatment of motor dysfunction is discussed.

A balance of activity in brain control and reward systems predicts self-regulatory outcomes

PubMed Central

Chen, Pin-Hao A.; Huckins, Jeremy F.; Hofmann, Wilhelm; Kelley, William M.; Heatherton, Todd F.

2017-01-01

Abstract Previous neuroimaging work has shown that increased reward-related activity following exposure to food cues is predictive of self-control failure. The balance model suggests that self-regulation failures result from an imbalance in reward and executive control mechanisms. However, an open question is whether the relative balance of activity in brain systems associated with executive control (vs reward) supports self-regulatory outcomes when people encounter tempting cues in daily life. Sixty-nine chronic dieters, a population known for frequent lapses in self-control, completed a food cue-reactivity task during an fMRI scanning session, followed by a weeklong sampling of daily eating behaviors via ecological momentary assessment. We related participants’ food cue activity in brain systems associated with executive control and reward to real-world eating patterns. Specifically, a balance score representing the amount of activity in brain regions associated with self-regulatory control, relative to automatic reward-related activity, predicted dieters’ control over their eating behavior during the following week. This balance measure may reflect individual self-control capacity and be useful for examining self-regulation success in other domains and populations. PMID:28158874

A balance of activity in brain control and reward systems predicts self-regulatory outcomes.

PubMed

Lopez, Richard B; Chen, Pin-Hao A; Huckins, Jeremy F; Hofmann, Wilhelm; Kelley, William M; Heatherton, Todd F

2017-05-01

Previous neuroimaging work has shown that increased reward-related activity following exposure to food cues is predictive of self-control failure. The balance model suggests that self-regulation failures result from an imbalance in reward and executive control mechanisms. However, an open question is whether the relative balance of activity in brain systems associated with executive control (vs reward) supports self-regulatory outcomes when people encounter tempting cues in daily life. Sixty-nine chronic dieters, a population known for frequent lapses in self-control, completed a food cue-reactivity task during an fMRI scanning session, followed by a weeklong sampling of daily eating behaviors via ecological momentary assessment. We related participants' food cue activity in brain systems associated with executive control and reward to real-world eating patterns. Specifically, a balance score representing the amount of activity in brain regions associated with self-regulatory control, relative to automatic reward-related activity, predicted dieters' control over their eating behavior during the following week. This balance measure may reflect individual self-control capacity and be useful for examining self-regulation success in other domains and populations. © The Author (2017). Published by Oxford University Press.

Reward sensitivity predicts ice cream-related attentional bias assessed by inattentional blindness.

PubMed

Li, Xiaoming; Tao, Qian; Fang, Ya; Cheng, Chen; Hao, Yangyang; Qi, Jianjun; Li, Yu; Zhang, Wei; Wang, Ying; Zhang, Xiaochu

2015-06-01

The cognitive mechanism underlying the association between individual differences in reward sensitivity and food craving is unknown. The present study explored the mechanism by examining the role of reward sensitivity in attentional bias toward ice cream cues. Forty-nine college students who displayed high level of ice cream craving (HICs) and 46 who displayed low level of ice cream craving (LICs) performed an inattentional blindness (IB) task which was used to assess attentional bias for ice cream. In addition, reward sensitivity and coping style were assessed by the Behavior Inhibition System/Behavior Activation System Scales and Simplified Coping Style Questionnaire. Results showed significant higher identification rate of the critical stimulus in the HICs than LICs, suggesting greater attentional bias for ice cream in the HICs. It was indicated that attentional bias for food cues persisted even under inattentional condition. Furthermore, a significant correlation was found between the attentional bias and reward sensitivity after controlling for coping style, and reward sensitivity predicted attentional bias for food cues. The mediation analyses showed that attentional bias mediated the relationship between reward sensitivity and food craving. Those findings suggest that the association between individual differences in reward sensitivity and food craving may be attributed to attentional bias for food-related cues. Copyright © 2015 Elsevier Ltd. All rights reserved.

The role of punishment and reward sensitivity in the emotional labor process: a within-person perspective.

PubMed

Schreurs, Bert; Guenter, Hannes; Hülsheger, Ute; van Emmerik, Hetty

2014-01-01

In this diary study, we tested the possibility that dispositional reward and punishment sensitivity, two central constructs of reinforcement sensitivity theory, would modify the relationship between emotional labor and job-related well-being (i.e., work engagement, emotional exhaustion, depersonalization). Specifically, based on a social functional account of emotion, we hypothesized that surface acting entails the risk of social disapproval and therefore may be more detrimental for high than for low punishment-sensitive individuals. In contrast, deep acting is hypothesized to hold the promise of social approval and therefore may be more beneficial for high than for low reward-sensitive individuals. Hypotheses were tested in a sample of 237 service workers (N = 1,584 daily reports) who completed a general survey and daily surveys over the course of 10 working days. Multilevel analyses showed that surface acting was detrimental to well-being, and more strongly so for high than for low punishment-sensitive individuals. The results are consistent with the idea that heightened sensitivity to social disapproval aggravates the negative effects of surface acting. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Activation of the cannabinoid system in the nucleus accumbens affects effort-based decision making.

PubMed

Fatahi, Zahra; Haghparast, Abbas

2018-02-01

Effort-based decision making addresses how we make an action choice based on an integration of action and goal values. The nucleus accumbens (NAc) is implicated in allowing an animal to overcome effort constraints to obtain greater benefits, and it has been previously shown that cannabis derivatives may affect such processes. Therefore, in this study, we intend to evaluate the involvement of the cannabinoid system in the entire NAc on effort-based decision making. Rats were trained in a T-maze cost-benefit decision making the task in which they could choose either to climb a barrier to obtain a large reward in one arm or run into the other arm without a barrier to obtaining a small reward. Following training, the animals were bilaterally implanted with guide cannulae in the NAc. On test day, rats received cannabinoid agonist (Win 55,212-2; 2, 10 and 50μM) and/or antagonist (AM251; 45μM), afterward percentage of large reward choice and latency of reward attainment were investigated. Results revealed that the administration of cannabinoid agonist led to decrease of large reward choice percentage such that the animals preferred to receive a small reward with low effort instead of receiving a large reward with high effort. The administration of antagonist solely did not affect effort-based decision making, but did attenuate the Win 55,212-2-induced impairments in effort allocation. In agonist-treated animals, the latency of reward collection increased. Moreover, when the effort was equated on both arms, the animals returned to choosing large reward showing that obtained results were not caused by spatial memory impairment. Our finding suggested that activation of the cannabinoid system in the NAc impaired effort-based decision making and led to rats were less willing to invest the physical effort to gain large reward. Copyright © 2017 Elsevier Inc. All rights reserved.

Immaturities in Reward Processing and Its Influence on Inhibitory Control in Adolescence

PubMed Central

Terwilliger, R.; Teslovich, T.; Velanova, K.; Luna, B.

2010-01-01

The nature of immature reward processing and the influence of rewards on basic elements of cognitive control during adolescence are currently not well understood. Here, during functional magnetic resonance imaging, healthy adolescents and adults performed a modified antisaccade task in which trial-by-trial reward contingencies were manipulated. The use of a novel fast, event-related design enabled developmental differences in brain function underlying temporally distinct stages of reward processing and response inhibition to be assessed. Reward trials compared with neutral trials resulted in faster correct inhibitory responses across ages and in fewer inhibitory errors in adolescents. During reward trials, the blood oxygen level–dependent signal was attenuated in the ventral striatum in adolescents during cue assessment, then overactive during response preparation, suggesting limitations during adolescence in reward assessment and heightened reactivity in anticipation of reward compared with adults. Importantly, heightened activity in the frontal cortex along the precentral sulcus was also observed in adolescents during reward-trial response preparation, suggesting reward modulation of oculomotor control regions supporting correct inhibitory responding. Collectively, this work characterizes specific immaturities in adolescent brain systems that support reward processing and describes the influence of reward on inhibitory control. In sum, our findings suggest mechanisms that may underlie adolescents’ vulnerability to poor decision-making and risk-taking behavior. PMID:19875675

Neural substrates of reward magnitude, probability, and risk during a wheel of fortune decision-making task.

PubMed

Smith, Bruce W; Mitchell, Derek G V; Hardin, Michael G; Jazbec, Sandra; Fridberg, Daniel; Blair, R James R; Ernst, Monique

2009-01-15

Economic decision-making involves the weighting of magnitude and probability of potential gains/losses. While previous work has examined the neural systems involved in decision-making, there is a need to understand how the parameters associated with decision-making (e.g., magnitude of expected reward, probability of expected reward and risk) modulate activation within these neural systems. In the current fMRI study, we modified the monetary wheel of fortune (WOF) task [Ernst, M., Nelson, E.E., McClure, E.B., Monk, C.S., Munson, S., Eshel, N., et al. (2004). Choice selection and reward anticipation: an fMRI study. Neuropsychologia 42(12), 1585-1597.] to examine in 25 healthy young adults the neural responses to selections of different reward magnitudes, probabilities, or risks. Selection of high, relative to low, reward magnitude increased activity in insula, amygdala, middle and posterior cingulate cortex, and basal ganglia. Selection of low-probability, as opposed to high-probability reward, increased activity in anterior cingulate cortex, as did selection of risky, relative to safe reward. In summary, decision-making that did not involve conflict, as in the magnitude contrast, recruited structures known to support the coding of reward values, and those that integrate motivational and perceptual information for behavioral responses. In contrast, decision-making under conflict, as in the probability and risk contrasts, engaged the dorsal anterior cingulate cortex whose role in conflict monitoring is well established. However, decision-making under conflict failed to activate the structures that track reward values per se. Thus, the presence of conflict in decision-making seemed to significantly alter the pattern of neural responses to simple rewards. In addition, this paradigm further clarifies the functional specialization of the cingulate cortex in processes of decision-making.

Promoting Instructional Excellence through a Teacher Reward System: Herzberg's Theory Applied.

ERIC Educational Resources Information Center

Frase, Larry E.; And Others

1982-01-01

An Arizona school district's program to reward teaching excellence uses as an incentive, instead of merit pay, something that will enhance the teacher's ability to assist children in the classroom. Rewards include attendance at conferences or computers and other classroom instructional materials. (Author/JM)

Neural Correlates of Impaired Reward-Effort Integration in Remitted Bulimia Nervosa.

PubMed

Mueller, Stefanie Verena; Morishima, Yosuke; Schwab, Simon; Wiest, Roland; Federspiel, Andrea; Hasler, Gregor

2018-03-01

The integration of reward magnitudes and effort costs is required for an effective behavioral guidance. This reward-effort integration was reported to be dependent on dopaminergic neurotransmission. As bulimia nervosa has been associated with a dysregulated dopamine system and catecholamine depletion led to reward-processing deficits in remitted bulimia nervosa, the purpose of this study was to identify the role of catecholamine dysfunction and its relation to behavioral and neural reward-effort integration in bulimia nervosa. To investigate the interaction between catecholamine functioning and behavioral, and neural responses directly, 17 remitted bulimic (rBN) and 21 healthy individuals (HC) received alpha-methyl-paratyrosine (AMPT) over 24 h to achieve catecholamine depletion in a randomized, crossover study design. We used functional magnetic resonance imaging (fMRI) and the monetary incentive delay (MID) task to assess reward-effort integration in relation to catecholaminergic neurotransmission at the behavioral and neural level. AMPT reduced the ability to integrate rewards and efforts effectively in HC participants. In contrast, in rBN participants, the reduced reward-effort integration was associated with illness duration in the sham condition and unrelated to catecholamine depletion. Regarding neural activation, AMPT decreased the reward anticipation-related neural activation in the anteroventral striatum. This decrease was associated with the AMPT-induced reduction of monetary earning in HC in contrast to rBN participants. Our findings contributed to the theory of a desensitized dopaminergic system in bulimia nervosa. A disrupted processing of reward magnitudes and effort costs might increase the probability of maintenance of bulimic symptoms.

Interaction between COMT Val(158)Met polymorphism and childhood adversity affects reward processing in adulthood.

PubMed

Boecker-Schlier, Regina; Holz, Nathalie E; Buchmann, Arlette F; Blomeyer, Dorothea; Plichta, Michael M; Jennen-Steinmetz, Christine; Wolf, Isabella; Baumeister, Sarah; Treutlein, Jens; Rietschel, Marcella; Meyer-Lindenberg, Andreas; Banaschewski, Tobias; Brandeis, Daniel; Laucht, Manfred

2016-05-15

Accumulating evidence suggests that altered dopamine transmission may increase the risk of mental disorders such as ADHD, schizophrenia or depression, possibly mediated by reward system dysfunction. This study aimed to clarify the impact of the COMT Val(158)Met polymorphism in interaction with environmental variation (G×E) on neuronal activity during reward processing. 168 healthy young adults from a prospective study conducted over 25years participated in a monetary incentive delay task measured with simultaneous EEG-fMRI. DNA was genotyped for COMT, and childhood family adversity (CFA) up to age 11 was assessed by a standardized parent interview. At reward delivery, a G×E revealed that fMRI activation for win vs. no-win trials in reward-related regions increased with the level of CFA in Met homozygotes as compared to Val/Met heterozygotes and Val homozygotes, who showed no significant effect. During the anticipation of monetary vs. verbal rewards, activation decreased with the level of CFA, which was also observed for EEG, in which the CNV declined with the level of CFA. These results identify convergent genetic and environmental effects on reward processing in a prospective study. Moreover, G×E effects during reward delivery suggest that stress during childhood is associated with higher reward sensitivity and reduced efficiency in processing rewarding stimuli in genetically at-risk individuals. Together with previous evidence, these results begin to define a specific system mediating interacting effects of early environmental and genetic risk factors, which may be targeted by early intervention and prevention. Copyright © 2016 Elsevier Inc. All rights reserved.

Involvement of cannabinoid system in the nucleus accumbens on delay-based decision making in the rat.

PubMed

Fatahi, Zahra; Sadeghi, Bahman; Haghparast, Abbas

2018-01-30

The nucleus accumbens (NAc) plays a fundamental role in decision making and anticipation of reward. In addition, exogenous cannabinoids affect the behavior of humans and animals including disruption of short-term memory and cognitive impairments. Therefore, in this study, cannabinoid agonist and antagonist were administrated into the NAc to determine the effect of cannabinoid activation in the entire NAc on delay-based decision making. Rats were trained on a cost-benefit T-maze decision making task in which the animals were well-trained to choose between a small/immediate reward and a large/delay reward. After training, the animals were implanted with guide cannulae in the NAc. On test day, they received cannabinoid agonist (Win 55,212-2; 10, 50 and 100μM) and/or antagonist (AM251; 45μM) into the NAc. Percentage of high reward choice and latency of reward achievement were evaluated. Results showed that cannabinoid agonist administration caused a decrease in high reward choice such that rats selected small/immediate reward instead of large/delay reward. Moreover, in agonist-treated animals latency of reward achievement increased. Effects of cannabinoid activation on delay-based decision making with equivalent delays demonstrated that if the delay was equated on both arm goals, animals still had a preference for the high/delay reward, showing the results was not caused by an impairment of spatial preference or memory. These finding clarified that cannabinoid system activation in the entire NAc plays a critical role in the regulation of delay-based decision making. Copyright © 2017 Elsevier B.V. All rights reserved.

Rewards and Supports

ERIC Educational Resources Information Center

Hershberg, Theodore; Robertson-Kraft, Claire

2010-01-01

Pay-for-performance systems in public schools have long been burdened with controversy. Critics of performance pay systems contend that because teachers' impact cannot be measured without error, it is impossible to create fair and accurate systems for evaluating and rewarding performance. By this standard, however, current practice fails on both…

A novel mobile system for radiation detection and monitoring

NASA Astrophysics Data System (ADS)

Biafore, Mauro

2014-05-01

A novel mobile system for real time, wide area radiation surveillance has been developed within the REWARD project, financed within the FP7 programme, theme SEC-2011.1.5-1 (Development of detection capabilities of difficult to detect radioactive sources and nuclear materials - Capability Project). The REWARD sensing units are small, mobile portable units with low energy consumption, which consist of new miniaturized solid-state radiation sensors: a CdZnTe detector for gamma radiation and a high efficiency neutron detector based on novel silicon technologies. The sensing unit is integrated by a wireless communication interface to send the data remotely to a monitoring base station as well as a GPS system to calculate the position of the tag. The system also incorporates middleware and high-level software to provide web-service interfaces for the exchange of information. A central monitoring and decision support system has been designed to process the data from the sensing units and to compare them with historical record in order to generate an alarm when an abnormal situation is detected. A security framework ensures protection against unauthorized access to the network and data, ensuring the privacy of the communications and contributing to the overall robustness and reliability of the REWARD system. The REWARD system has been designed for many different scenarios such as nuclear terrorism threats, lost radioactive sources, radioactive contamination or nuclear accidents. It can be deployed in emergency units and in general in any type of mobile or static equipment, but also inside public/private buildings or infrastructures. The complete system is scalable in terms of complexity and cost and offers very high precision on both the measurement and the location of the radiation. The modularity and flexibility of the system allows for a realistic introduction to the market. Authorities may start with a basic, low cost system and increase the complexity based on their evolving needs and budget constraints. On 24th September 2013, REWARD project received a prize as the best Innovative project related to the Not Conventional Threat (NCT) Chemical Biological Radiological Nuclear explosives (CBRNe) products. A highly distinguished jury stated that "the developed detection and surveillance system offers a perfect solution for end-users to enhance crucial capabilities in RN analysis, risk communication and surveillance in case of a radiation incident". A demonstration of the REWARD system is planned in Naples on September 2014. More information about the REWARD project can be found at www.reward-project.eu.

Agent Reward Shaping for Alleviating Traffic Congestion

NASA Technical Reports Server (NTRS)

Tumer, Kagan; Agogino, Adrian

2006-01-01

Traffic congestion problems provide a unique environment to study how multi-agent systems promote desired system level behavior. What is particularly interesting in this class of problems is that no individual action is intrinsically "bad" for the system but that combinations of actions among agents lead to undesirable outcomes, As a consequence, agents need to learn how to coordinate their actions with those of other agents, rather than learn a particular set of "good" actions. This problem is ubiquitous in various traffic problems, including selecting departure times for commuters, routes for airlines, and paths for data routers. In this paper we present a multi-agent approach to two traffic problems, where far each driver, an agent selects the most suitable action using reinforcement learning. The agent rewards are based on concepts from collectives and aim to provide the agents with rewards that are both easy to learn and that if learned, lead to good system level behavior. In the first problem, we study how agents learn the best departure times of drivers in a daily commuting environment and how following those departure times alleviates congestion. In the second problem, we study how agents learn to select desirable routes to improve traffic flow and minimize delays for. all drivers.. In both sets of experiments,. agents using collective-based rewards produced near optimal performance (93-96% of optimal) whereas agents using system rewards (63-68%) barely outperformed random action selection (62-64%) and agents using local rewards (48-72%) performed worse than random in some instances.

The role of dopamine in reward and pleasure behaviour--review of data from preclinical research.

PubMed

Bressan, R A; Crippa, J A

2005-01-01

The purpose of this article is to review some of the basic aspects of the dopaminergic system and its role in reward and pleasure behaviour. We also discuss the association between dopamine and unpleasant symptoms that are commonly found in neuropsychiatric disorders and may also be side-effects of neuroleptic drugs. A computer-based search of the literature, augmented by extensive bibliography-guided article reviews, were used to find basic information on the dopamine and the reward systems, and symptoms such as dysphoria, anhedonia and depression. Central dopaminergic neurotransmission is complex, having multiple actions at each level of the mesocorticolimbic reward pathway. The role of dopamine in the reward process was classically associated with the ability to experience pleasure; recent data suggest a more motivational role. Dysfunction of the dopamine transmission in the reward circuit is associated with symptoms such as anhedonia, apathy and dysphoria found in several neuropsychiatric disorders, including Parkinson's disease, depression, drug addiction, and neuroleptic-induced dysphoria. Viewing the dysfunctions of the reward pathways within a broader spectrum and exploring its complex relations with the dopaminergic transmission may help understand the pathophysiology of these neuropsychiatric disorders and lead to a rational development of novel treatments.

Music and the nucleus accumbens.

PubMed

Mavridis, Ioannis N

2015-03-01

Music is a universal feature of human societies over time, mainly because it allows expression and regulation of strong emotions, thus influencing moods and evoking pleasure. The nucleus accumbens (NA), the most important pleasure center of the human brain (dominates the reward system), is the 'king of neurosciences' and dopamine (DA) can be rightfully considered as its 'crown' due to the fundamental role that this neurotransmitter plays in the brain's reward system. Purpose of this article was to review the existing literature regarding the relation between music and the NA. Studies have shown that reward value for music can be coded by activity levels in the NA, whose functional connectivity with auditory and frontal areas increases as a function of increasing musical reward. Listening to music strongly modulates activity in a network of mesolimbic structures involved in reward processing including the NA. The functional connectivity between brain regions mediating reward, autonomic and cognitive processing provides insight into understanding why listening to music is one of the most rewarding and pleasurable human experiences. Musical stimuli can significantly increase extracellular DA levels in the NA. NA DA and serotonin were found significantly higher in animals exposed to music. Finally, passive listening to unfamiliar although liked music showed activations in the NA.

The Effects of Stability and Presentation Order of Rewards on Justice Evaluations

PubMed Central

Park, Hyomin; Melamed, David

2016-01-01

Justice research has evolved by elucidating the factors that affect justice evaluations, as well as their consequences. Unfortunately, few researchers have paid attention to the pattern of rewards over time as a predictor of justice evaluations. There are two main objectives of this research. First, it aims to test the effect of reward stability on justice evaluations. Based on justice theory and prospect theory, we assume that an under-reward at one time cannot be fully offset by an equivalent over-reward at another time. Therefore, in unstable reward systems the asymmetry of the effect of unjust rewards with opposite directions will produce a lower level of justice evaluations over time. The second objective of this research is to show the moderating effect of the presentation order (primacy vs. recency) of unstable rewards on justice evaluations. The results from a controlled experiment with five conditions, which presents the instability of rewards in different orders, confirm both the negative effect of unstable rewards and the stronger effect of primacy on justice evaluations. PMID:28005957

Music-related reward responses predict episodic memory performance.

PubMed

Ferreri, Laura; Rodriguez-Fornells, Antoni

2017-12-01

Music represents a special type of reward involving the recruitment of the mesolimbic dopaminergic system. According to recent theories on episodic memory formation, as dopamine strengthens the synaptic potentiation produced by learning, stimuli triggering dopamine release could result in long-term memory improvements. Here, we behaviourally test whether music-related reward responses could modulate episodic memory performance. Thirty participants rated (in terms of arousal, familiarity, emotional valence, and reward) and encoded unfamiliar classical music excerpts. Twenty-four hours later, their episodic memory was tested (old/new recognition and remember/know paradigm). Results revealed an influence of music-related reward responses on memory: excerpts rated as more rewarding were significantly better recognized and remembered. Furthermore, inter-individual differences in the ability to experience musical reward, measured through the Barcelona Music Reward Questionnaire, positively predicted memory performance. Taken together, these findings shed new light on the relationship between music, reward and memory, showing for the first time that music-driven reward responses are directly implicated in higher cognitive functions and can account for individual differences in memory performance.

"I won, but I’m not getting my hopes up": Depression Moderates the Relationship Outcomes and Reward Anticipation

PubMed Central

Olino, Thomas M.; McMakin, Dana L.; Dahl, Ronald E.; Ryan, Neal D.; Silk, Jennifer S.; Birmaher, Boris; Axelson, David A.; Forbes, Erika E.

2011-01-01

Major Depressive Disorder (MDD) in adolescents is characterized by alterations in positive emotions and reward processing. Recent investigations using functional magnetic resonance imaging (fMRI) find depression-related differences in reward anticipation. However, it is unknown whether feedback influences subsequent reward anticipation, which may highlight the context of reward processing. Ten youth with MDD and sixteen youth with no history of MDD completed an fMRI assessment using a reward task. Reward anticipation was indexed by blood oxygen level dependent signal change in the striatum following winning; losing; non-winning; and non-losing outcomes. A significant interaction between diagnostic status and outcome condition predicted reward anticipation in the caudate. Decomposition of the interaction indicated that following winning outcomes, depressed youth demonstrated reduced reward anticipation relative to healthy youth. However, no significant differences between depressed and healthy youth were found after other outcomes. Reward anticipation is altered following winning outcomes. This finding has implications for understanding the developmental pathophysiology of MDD and suggests specific contexts where altered motivational system functioning may play a role in maintaining depression. PMID:22079656

Goal or gold: overlapping reward processes in soccer players upon scoring and winning money.

PubMed

Häusler, Alexander Niklas; Becker, Benjamin; Bartling, Marcel; Weber, Bernd

2015-01-01

Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning, i.e., reward probability (RP), reward reception (RR) and reward prediction errors (RPE) showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes.

Goal or Gold: Overlapping Reward Processes in Soccer Players upon Scoring and Winning Money

PubMed Central

Häusler, Alexander Niklas; Becker, Benjamin; Bartling, Marcel; Weber, Bernd

2015-01-01

Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning i.e. reward probability (RP), reward reception (RR) and reward prediction errors (RPE) showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes. PMID:25875594

Rewards for Inventors: A Review of Current Practice in UK Universities.

ERIC Educational Resources Information Center

Handscombe, R. D.

1996-01-01

Since the British government began allowing universities to exploit the products of their research, universities have developed cash reward systems for inventors. For many researchers, job satisfaction and peer recognition appear more important than monetary rewards. The money is often reinvested in further research. (SK)

Influence of ventral tegmental area input on cortico-subcortical networks underlying action control and decision making.

PubMed

Richter, Anja; Gruber, Oliver

2018-02-01

It is argued that the mesolimbic system has a more general function in processing all salient events, including and extending beyond rewards. Saliency was defined as an event that is unexpected due to its frequency of occurrence and elicits an attentional-behavioral switch. Using functional magnetic resonance imaging (fMRI), signals were measured in response to the modulation of salience of rewarding and nonrewarding events during a reward-based decision making task, the so called desire-reason dilemma paradigm (DRD). Replicating previous findings, both frequent and infrequent, and therefore salient, reward stimuli elicited reliable activation of the ventral tegmental area (VTA) and ventral striatum (vStr). When immediate reward desiring contradicted the superordinate task-goal, we found an increased activation of the VTA and vStr when the salient reward stimuli were presented compared to the nonsalient reward stimuli, indicating a boosting of activation in these brain regions. Furthermore, we found a significantly increased functional connectivity between the VTA and vStr, confirming the boosting of vStr activation via VTA input. Moreover, saliency per se without a reward association led to an increased activation of brain regions in the mesolimbic reward system as well as the orbitofrontal cortex (OFC), inferior frontal gyrus (IFG), and anterior cingulate cortex (ACC). Finally, findings uncovered multiple increased functional interactions between cortical saliency-processing brain areas and the VTA and vStr underlying detection and processing of salient events and adaptive decision making. © 2017 Wiley Periodicals, Inc.

Distinct medial temporal networks encode surprise during motivation by reward versus punishment

PubMed Central

Murty, Vishnu P.; LaBar, Kevin S.; Adcock, R. Alison

2016-01-01

Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment. PMID:26854903

Distinct medial temporal networks encode surprise during motivation by reward versus punishment.

PubMed

Murty, Vishnu P; LaBar, Kevin S; Adcock, R Alison

2016-10-01

Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment. Copyright © 2016 Elsevier Inc. All rights reserved.

A reward-centred model of anorexia nervosa: a focussed narrative review of the neurological and psychophysiological literature.

PubMed

O'Hara, Caitlin B; Campbell, Iain C; Schmidt, Ulrike

2015-05-01

This focussed narrative review examines neurobiological and psychophysiological evidence supporting a role for altered reward processes in the development and maintenance of anorexia nervosa (AN). In AN, there does not appear to be a generalised inability to experience reward. Rather, data suggest that a reluctance to gain weight leads to an aversive appraisal of food- and taste-related stimuli. As a result, cues compatible with this aberrant mode of thinking become rewarding for the individual. Evidence also suggests that attribution of motivational salience to such cues promotes anorectic behaviours. These findings are consistent with models in which interactions between cognition and reward are important in eliciting the anorectic "habit". A model is proposed which is consistent with elements of other theoretical frameworks, but differs in that its emphasis is towards neural overlaps between AN and addiction. It is consistent with AN being a reward-based learned behaviour in which aberrant cognitions related to eating and shape alter functioning of central reward systems. It proposes that the primary neural problem responsible for the development, maintenance, and treatment resistance is centred in the striatal reward system. This helps shift the emphasis of aetiological models towards reward processing, particularly in the context of illness-compatible cues. Furthermore, it suggests that continuing to explore the utility and valued nature of AN in the patient's life would be a useful inclusion in treatment and prevention models. Copyright © 2015. Published by Elsevier Ltd.

Decision making in the reward and punishment variants of the iowa gambling task: evidence of "foresight" or "framing"?

PubMed

Singh, Varsha; Khan, Azizuddin

2012-01-01

Surface-level differences in the reward and punishment variants, specifically greater long-term decision making in the punishment variant of the Iowa Gambling Task (IGT) observed in previous studies led to the present comparison of long-term decision making in the two IGT variants (n = 320, male = 160). It was contended that risk aversion triggered by a positive frame of the reward variant and risk seeking triggered by a negative frame of the punishment variant appears as long-term decision making in the two IGT variants. Apart from the frame of the variant as a within-subjects factor (variant type: reward and punishment), the order in which the frame was triggered (order type: reward-punishment or punishment-reward), and the four types of instructions that delineated motivation toward reward from that of punishment (reward, punishment, reward and punishment, and no-hint) were hypothesized to have an effect on foresighted decision making in the IGT. As expected, long-term decision making differed across the two IGT variants suggesting that the frame of the variant has an effect on long-term decision making in the IGT (p < 0.001). The order in which a variant was presented, and the type of the instructions that were used both had an effect on long-term decision making in the two IGT variants (p < 0.05). A post hoc test suggested that the instructions that differentiated between reward and punishment resulted in greater foresight than the commonly used IGT instructions that fail to distinguish between reward and punishment. As observed in previous studies, there were more number of participants (60%) who showed greater foresight in the punishment variant than in the reward variant (p < 0.001). The results suggest that foresight in IGT decision making is sensitive to reward and punishment frame in an asymmetric manner, an observation that is aligned with the behavioral decision making framework. Benefits of integrating findings from behavioral studies in decision neuroscience are discussed, and a need to investigate cultural differences in the IGT studies is pointed out.

Reward system dysfunction in autism spectrum disorders

PubMed Central

Schulte-Rüther, Martin; Nehrkorn, Barbara; Müller, Kristin; Fink, Gereon R.; Kamp-Becker, Inge; Herpertz-Dahlmann, Beate; Schultz, Robert T.; Konrad, Kerstin

2013-01-01

Although it has been suggested that social deficits of autism spectrum disorders (ASDs) are related to reward circuitry dysfunction, very little is known about the neural reward mechanisms in ASD. In the current functional magnetic resonance imaging study, we investigated brain activations in response to both social and monetary reward in a group of children with ASD, relative to matched controls. Participants with ASD showed the expected hypoactivation in the mesocorticolimbic circuitry in response to both reward types. In particular, diminished activation in the nucleus accumbens was observed when money, but not when social reward, was at stake, whereas the amygdala and anterior cingulate cortex were hypoactivated within the ASD group in response to both rewards. These data indicate that the reward circuitry is compromised in ASD in social as well as in non-social, i.e. monetary conditions, which likely contributes to atypical motivated behaviour. Taken together, with incentives used in this study sample, there is evidence for a general reward dysfunction in ASD. However, more ecologically valid social reward paradigms are needed to fully understand, whether there is any domain specificity to the reward deficit that appears evident in ASD, which would be most consistent with the ASD social phenotype. PMID:22419119

A computational substrate for incentive salience.

PubMed

McClure, Samuel M; Daw, Nathaniel D; Montague, P Read

2003-08-01

Theories of dopamine function are at a crossroads. Computational models derived from single-unit recordings capture changes in dopaminergic neuron firing rate as a prediction error signal. These models employ the prediction error signal in two roles: learning to predict future rewarding events and biasing action choice. Conversely, pharmacological inhibition or lesion of dopaminergic neuron function diminishes the ability of an animal to motivate behaviors directed at acquiring rewards. These lesion experiments have raised the possibility that dopamine release encodes a measure of the incentive value of a contemplated behavioral act. The most complete psychological idea that captures this notion frames the dopamine signal as carrying 'incentive salience'. On the surface, these two competing accounts of dopamine function seem incommensurate. To the contrary, we demonstrate that both of these functions can be captured in a single computational model of the involvement of dopamine in reward prediction for the purpose of reward seeking.

How Has the Internet Reshaped Human Cognition?

PubMed

Loh, Kep Kee; Kanai, Ryota

2016-10-01

Throughout our evolutionary history, our cognitive systems have been altered by the advent of technological inventions such as primitive tools, spoken language, writing, and arithmetic systems. Thirty years ago, the Internet surfaced as the latest technological invention poised to deeply reshape human cognition. With its multifaceted affordances, the Internet environment has profoundly transformed our thoughts and behaviors. Growing up with Internet technologies, "Digital Natives" gravitate toward "shallow" information processing behaviors characterized by rapid attention shifting and reduced deliberations. They engage in increased multitasking behaviors that are linked to increased distractibility and poor executive control abilities. Digital natives also exhibit higher prevalence of Internet-related addictive behaviors that reflect altered reward-processing and self-control mechanisms. Recent neuroimaging investigations have suggested associations between these Internet-related cognitive impacts and structural changes in the brain. Against mounting apprehension over the Internet's consequences on our cognitive systems, several researchers have lamented that these concerns were often exaggerated beyond existing scientific evidence. In the present review, we aim to provide an objective overview of the Internet's impacts on our cognitive systems. We critically discuss current empirical evidence about how the Internet environment has altered the cognitive behaviors and structures involved in information processing, executive control, and reward-processing. © The Author(s) 2015.

An Update on the Role of Serotonin and its Interplay with Dopamine for Reward.

PubMed

Fischer, Adrian G; Ullsperger, Markus

2017-01-01

The specific role of serotonin and its interplay with dopamine (DA) in adaptive, reward guided behavior as well as drug dependance, still remains elusive. Recently, novel methods allowed cell type specific anatomical, functional and interventional analyses of serotonergic and dopaminergic circuits, promising significant advancement in understanding their functional roles. Furthermore, it is increasingly recognized that co-release of neurotransmitters is functionally relevant, understanding of which is required in order to interpret results of pharmacological studies and their relationship to neural recordings. Here, we review recent animal studies employing such techniques with the aim to connect their results to effects observed in human pharmacological studies and subjective effects of drugs. It appears that the additive effect of serotonin and DA conveys significant reward related information and is subjectively highly euphorizing. Neither DA nor serotonin alone have such an effect. This coincides with optogenetically targeted recordings in mice, where the dopaminergic system codes reward prediction errors (PE), and the serotonergic system mainly unsigned PE. Overall, this pattern of results indicates that joint activity between both systems carries essential reward information and invites parallel investigation of both neurotransmitter systems.

Ghrelin signalling on food reward: a salient link between the gut and the mesolimbic system.

PubMed

Perello, M; Dickson, S L

2015-06-01

'Hunger is the best spice' is an old and wise saying that acknowledges the fact that almost any food tastes better when we are hungry. The neurobiological underpinnings of this lore include activation of the brain's reward system and the stimulation of this system by the hunger-promoting hormone ghrelin. Ghrelin is produced largely from the stomach and levels are higher preprandially. The ghrelin receptor is expressed in many brain areas important for feeding control, including not only the hypothalamic nuclei involved in energy balance regulation, but also reward-linked areas such as the ventral tegmental area. By targeting the mesoaccumbal dopamine neurones of the ventral tegmental area, ghrelin recruits pathways important for food reward-related behaviours that show overlap with but are also distinct from those important for food intake. We review a variety of studies that support the notion that ghrelin signalling at the level of the mesolimbic system is one of the key molecular substrates that provides a physiological signal connecting gut and reward pathways. © 2014 The Authors. Journal of Neuroendocrinology published by John Wiley & Sons Ltd on behalf of British Society for Neuroendocrinology.

Rewarding overproductivity: an incentive or disincentive for staff?

PubMed

Olsen, A G

1991-04-01

A rapidly growing home care agency implemented a productivity system designed to reward its staff for "overproductive" visits rather than rely on temporary staff. While the system was positively received, it actually became more of a disincentive than a motivator.

Quality management of human resources. Providers should begin by focusing on education, performance management, and reward systems.

PubMed

Blair, C S; Fordyce, M; Barney, S M

1993-10-01

For a quality management transformation to occur, a healthcare organization must focus on education and development, performance management, and recognition and reward systems during the first years of implementation. Education and development are perhaps the most important human resource management functions when implementing quality management principles and processes because behavioral changes will be required at all organizational levels. Specific programs that support an organization's quality management effort will vary but should include the conceptual, cultural, and technical aspects of quality management. The essence of quality management is to always satisfy the customer and to continuously improve the services and products the organization offers. The approach to performance management should therefore rely on customer feedback and satisfaction. An organization committed to quality management should base its performance management approach on customer orientation, process improvement, employee involvement, decision making with data, and continuous improvement. Managers and trustees are being challenged to provide innovative recognition and reward systems that reinforce the values and behaviors consistent with quality management. Such systems must also be aligned with the behaviors and outcomes that support the philosophy, mission, and values of the Catholic healthcare ministry. The following components should be considered for a recognition and reward system: base pay, incentives, benefits, and nonmonetary rewards.

Individual differences in regulatory focus predict neural response to reward.

PubMed

Scult, Matthew A; Knodt, Annchen R; Hanson, Jamie L; Ryoo, Minyoung; Adcock, R Alison; Hariri, Ahmad R; Strauman, Timothy J

2017-08-01

Although goal pursuit is related to both functioning of the brain's reward circuits and psychological factors, the literatures surrounding these concepts have often been separate. Here, we use the psychological construct of regulatory focus to investigate individual differences in neural response to reward. Regulatory focus theory proposes two motivational orientations for personal goal pursuit: (1) promotion, associated with sensitivity to potential gain, and (2) prevention, associated with sensitivity to potential loss. The monetary incentive delay task was used to manipulate reward circuit function, along with instructional framing corresponding to promotion and prevention in a within-subject design. We observed that the more promotion oriented an individual was, the lower their ventral striatum response to gain cues. Follow-up analyses revealed that greater promotion orientation was associated with decreased ventral striatum response even to no-value cues, suggesting that promotion orientation may be associated with relatively hypoactive reward system function. The findings are also likely to represent an interaction between the cognitive and motivational characteristics of the promotion system with the task demands. Prevention orientation did not correlate with ventral striatum response to gain cues, supporting the discriminant validity of regulatory focus theory. The results highlight a dynamic association between individual differences in self-regulation and reward system function.

Quicker Q-Learning in Multi-Agent Systems

NASA Technical Reports Server (NTRS)

Agogino, Adrian K.; Tumer, Kagan

2005-01-01

Multi-agent learning in Markov Decisions Problems is challenging because of the presence ot two credit assignment problems: 1) How to credit an action taken at time step t for rewards received at t' greater than t; and 2) How to credit an action taken by agent i considering the system reward is a function of the actions of all the agents. The first credit assignment problem is typically addressed with temporal difference methods such as Q-learning OK TD(lambda) The second credit assi,onment problem is typically addressed either by hand-crafting reward functions that assign proper credit to an agent, or by making certain independence assumptions about an agent's state-space and reward function. To address both credit assignment problems simultaneously, we propose the Q Updates with Immediate Counterfactual Rewards-learning (QUICR-learning) designed to improve both the convergence properties and performance of Q-learning in large multi-agent problems. Instead of assuming that an agent s value function can be made independent of other agents, this method suppresses the impact of other agents using counterfactual rewards. Results on multi-agent grid-world problems over multiple topologies show that QUICR-learning can achieve up to thirty fold improvements in performance over both conventional and local Q-learning in the largest tested systems.

Lighting the darkness of addiction: can phototherapy enhance contingency-management-based treatment of substance-related and addictive disorders?

PubMed

Siporin, Sheldon

2014-01-01

Maladaptive patterns of substance use are serious social problems. Both pharmacological and nonpharmacological treatments are available, but nondrug options may be preferable because they avoid the expense and adverse side effects of psychotropic medication. Contingency management (CM) and nondrug social and recreational activities (NDSRAs) are based on operant conditioning principles and seek to decrease substance use by means of nondrug rewards. However, their efficacy may be hindered where brain reward circuitry is dysfunctional. Research shows that substance abuse biases neural reward systems in favor of drug-induced highs, while disrupting circadian-based rhythms. Circadian systems also have been found to influence human reward pathways. Possibly, a bidirectional relationship exists between circadian disturbance and substance abuse effects. If so, repair of abnormal circadian rhythms might help normalize reward response in substance abusers, with positive effects on CM or NDSRA treatment outcomes. Phototherapy has been effective in repairing circadian rhythms in persons with seasonal affective disorder and other chronobiological conditions. This article proposes that it similarly may repair circadian response in substance abusers, thereby normalizing brain reward systems. By doing so, it would enhance the efficacy of CM and NDSRA therapies and may also help prevent relapse. Given its low cost and ease of administration, phototherapy seems a promising avenue to pursue.

Increased frequency of social interaction is associated with enjoyment enhancement and reward system activation

PubMed Central

Kawamichi, Hiroaki; Sugawara, Sho K.; Hamano, Yuki H.; Makita, Kai; Kochiyama, Takanori; Sadato, Norihiro

2016-01-01

Positive social interactions contribute to the sense that one’s life has meaning. Enjoyment of feelings associated through social interaction motivates humans to build social connections according to their personal preferences. Therefore, we hypothesized that social interaction itself activates the reward system in a manner that depends upon individual interaction preferences. To test this hypothesis, we conducted a functional magnetic resonance imaging (fMRI) study in which 38 participants played a virtual ball-toss game in which the number of ball tosses to the participant was either similar to (normal-frequency condition) or higher than (high-frequency condition) the number of tosses to the other players. Participants reported greater-than-anticipated enjoyment during the high-frequency condition, suggesting that receiving a social reward led to unexpected positive feelings. Consistent with this, the high-frequency condition produced stronger activation in the ventral striatum, which is part of the reward system, and the precuneus, representing positive self-image, which might be translated to social reward. Furthermore, ventral striatal activation covaried with individual participants’ preference for interactions with others. These findings suggest that an elevated frequency of social interaction is represented as a social reward, which might motivate individuals to promote social interaction in a manner that is modulated by personal preference. PMID:27090501

Increased frequency of social interaction is associated with enjoyment enhancement and reward system activation.

PubMed

Kawamichi, Hiroaki; Sugawara, Sho K; Hamano, Yuki H; Makita, Kai; Kochiyama, Takanori; Sadato, Norihiro

2016-04-19

Positive social interactions contribute to the sense that one's life has meaning. Enjoyment of feelings associated through social interaction motivates humans to build social connections according to their personal preferences. Therefore, we hypothesized that social interaction itself activates the reward system in a manner that depends upon individual interaction preferences. To test this hypothesis, we conducted a functional magnetic resonance imaging (fMRI) study in which 38 participants played a virtual ball-toss game in which the number of ball tosses to the participant was either similar to (normal-frequency condition) or higher than (high-frequency condition) the number of tosses to the other players. Participants reported greater-than-anticipated enjoyment during the high-frequency condition, suggesting that receiving a social reward led to unexpected positive feelings. Consistent with this, the high-frequency condition produced stronger activation in the ventral striatum, which is part of the reward system, and the precuneus, representing positive self-image, which might be translated to social reward. Furthermore, ventral striatal activation covaried with individual participants' preference for interactions with others. These findings suggest that an elevated frequency of social interaction is represented as a social reward, which might motivate individuals to promote social interaction in a manner that is modulated by personal preference.

The efficacy of (+)-Naltrexone on alcohol preference and seeking behaviour is dependent on light-cycle.

PubMed

Jacobsen, Jonathan Henry W; Buisman-Pijlman, Femke T A; Mustafa, Sanam; Rice, Kenner C; Hutchinson, Mark R

2018-01-01

Circadian rhythm affects drug-induced reward behaviour and the innate immune system. Peaks in reward-associated behaviour and immune responses typically occur during the active (dark) phase of rodents. While the role of the immune system, specifically, Toll-like receptor 4 (TLR4, an innate immune receptor) in drug-induced reward is becoming increasingly appreciated, it is unclear whether its effects vary according to light-cycle. Therefore, the aim of this study was to characterise the effects of the phase of the light-cycle and the state of the innate immune system on alcohol reward behaviour and subsequently determine whether the efficacy of targeting the immune component of drug reward depends upon the light-cycle. This study demonstrates that mice exhibit greater alcohol-induced conditioned place preference and alcohol two-bottle choice preference during the dark cycle. This effect overlapped with elevations in reward-, thirst- and immune-related genes. Administration of (+)-Naltrexone, a TLR4 antagonist, reduced immune-related gene mRNA expression and alcohol preference with its effects most pronounced during the dark cycle. However, (+)-Naltrexone, like other TLR4 antagonists exhibited off-target side effects, with a significant reduction in overall saccharin intake - an effect likely attributable to a reduction in tyrosine hydroxylase (Th) mRNA expression levels. Collectively, the study highlights a link between a time-of-day dependent influence of TLR4 on natural and alcohol reward-like behaviour in mice. Copyright © 2017 Elsevier Inc. All rights reserved.

Modulation of frontostriatal interaction aligns with reduced primary reward processing under serotonergic drugs.

PubMed

Abler, Birgit; Grön, Georg; Hartmann, Antonie; Metzger, Coraline; Walter, Martin

2012-01-25

Recently, functional interactions between anteroventral prefrontal cortex and nucleus accumbens (NAcc) have been shown to relate to behavior counteracting reward-desiring (Diekhof and Gruber, 2010). Downregulation of the reward system by serotonin has also been suggested as the mode of action accounting for unsatisfactory effects of serotonin reuptake inhibitors (SSRIs) such as insufficient alleviation or even increase of anhedonia, and loss of interest. However, understanding of the in vivo mechanisms of SSRI-related alteration of the human reward system is still incomplete. Using functional magnetic resonance imaging (fMRI) within a double-blind cross-over within-subjects study design and administering the SSRI paroxetine, the dopamine/norepinephrine reuptake inhibitor bupropione, and placebo for 7 d each, we investigated a group of 18 healthy male subjects. Under paroxetine, subjects showed significantly decreased activation of the bilateral NAcc during processing of primary rewards (erotic videos), but not under bupropion. Similar to the previous study, analysis of psychophysiological interactions revealed that this downregulation relied on negative interactions between left and right NAcc fMRI signals and the bilateral anteroventral prefrontal cortex that now were significantly enhanced under paroxetine and reduced under bupropion. Individual drug-dependent modulations of interacting brain regions were significantly associated with individual expressions of impulsivity as a personality trait. Our results corroborate and extend previous insights on interregional crosstalk from secondary to primary rewards and demonstrate parallels between active inhibitory control of and serotonergic effects on the dopaminergic reward system's activity.

Minority Sub-cultures and the Laws of Learning.

ERIC Educational Resources Information Center

Havighurst, Robert J.

Comparative motivational studies of middle class and lower class children show that different economic and ethnic groups vary in their reward-punishment systems. Teachers should have a systematic theory of the working of reward and punishment in learning. Their theory should include the concept of a hierarchy of reward levels, and they should…

When Rewards Go Wrong: A Tale of Five Motivational Misdirects

ERIC Educational Resources Information Center

Steel, Piers; MacDonnell, Rhiannon

2012-01-01

At the heart of most performance management systems is a reward program. However, even when we are doing everything else right, rewards can go wrong. Here, we explore five ways that external incentives can damage performance, from destroying altruistic behavior to distracting people from the task. Fortunately, most of these downfalls are…

Reducing Absenteeism and Rescheduling among Grocery Store Employees with Point-Contingent Rewards

ERIC Educational Resources Information Center

Camden, Matt C.; Price, Virginia A.; Ludwig, Timothy D.

2011-01-01

The purpose of this research was to evaluate a reward program designed to reduce absenteeism among staff (N = 38) at a grocery store. The intervention included public feedback and a credit reward system whereby participants got store dollars for attendance and authorized rescheduling of work assignments. Results showed that absenteeism decreased…

The role of reward in word learning and its implications for language acquisition.

PubMed

Ripollés, Pablo; Marco-Pallarés, Josep; Hielscher, Ulrike; Mestres-Missé, Anna; Tempelmann, Claus; Heinze, Hans-Jochen; Rodríguez-Fornells, Antoni; Noesselt, Toemme

2014-11-03

The exact neural processes behind humans' drive to acquire a new language--first as infants and later as second-language learners--are yet to be established. Recent theoretical models have proposed that during human evolution, emerging language-learning mechanisms might have been glued to phylogenetically older subcortical reward systems, reinforcing human motivation to learn a new language. Supporting this hypothesis, our results showed that adult participants exhibited robust fMRI activation in the ventral striatum (VS)--a core region of reward processing--when successfully learning the meaning of new words. This activation was similar to the VS recruitment elicited using an independent reward task. Moreover, the VS showed enhanced functional and structural connectivity with neocortical language areas during successful word learning. Together, our results provide evidence for the neural substrate of reward and motivation during word learning. We suggest that this strong functional and anatomical coupling between neocortical language regions and the subcortical reward system provided a crucial advantage in humans that eventually enabled our lineage to successfully acquire linguistic skills. Copyright © 2014 Elsevier Ltd. All rights reserved.

Comparing the effects of food restriction and overeating on brain reward systems

PubMed Central

Avena, Nicole M.; Murray, Susan; Gold, Mark S.

2014-01-01

Both caloric restriction and overeating have been shown to affect neural processes associated with reinforcement. Both preclinical and some clinical studies have provided evidence that food restriction may increase reward sensitivity, and while there are mixed findings regarding the effects of overeating on reward sensitivity, there is strong evidence linking this behavior with changes in reward-related brain regions. Evidence of these changes comes in part from findings that show that such eating patterns are associated with increased drug use. The data discussed here regarding the differential effects of various eating patterns on reward systems may be particularly relevant to the aging population, as this population has been shown to exhibit altered reward sensitivity and decreased caloric consumption. Moreover, members of this population appear to be increasingly affected by the current obesity epidemic. Food, like alcohol or drugs, can stimulate its own consumption and produce similar neurochemical changes in the brain. Age-related loss of appetite, decreased eating, and caloric restriction are hypothesized to be associated with changes in the prevalence of substance misuse, abuse, and dependence seen in this cohort. PMID:23535488

Reward sensitivity, decisional bias, and metacognitive deficits in cocaine drug addiction.

PubMed

Balconi, Michela; Finocchiaro, Roberta; Campanella, Salvatore

2014-01-01

The present research explored the effect of reward sensitivity bias and metacognitive deficits on substance use disorder (SUD) in the decision-making process. The behavioral activation system (BAS) was used as a predictive marker of dysfunctional behavior during the Iowa gambling task (IGT). We also tried to relate this motivational system bias to self-reported metacognitive measures (self-knowledge, strategic planning, flexibility, and efficacy) in the decision processes. Thirty-four SUD participants (cocaine dependent) and 39 participants in the control group underwent the IGT. The SUD group was associated with a poorer performance on the IGT and a dysfunctional metacognition ability (unrealistic representation). An increase in the reward sensitivity (higher BAS, BAS reward responsiveness, and BAS reward) was observed in the SUD group compared with the control group and explained (through a regression analysis) the main behavioral deficits. More generally, an increase in the BAS reward responsiveness may be considered a predictive measure of risk-taking and dysfunctional behavior, not only in pathological (SUD) individuals, but also in subclinical individuals (controls). We discuss the likely cognitive, brain, and neurotransmitter contributions to this phenomenon.

Intermittent Theta Burst Stimulation Increases Reward Responsiveness in Individuals with Higher Hedonic Capacity.

PubMed

Duprat, Romain; De Raedt, Rudi; Wu, Guo-Rong; Baeken, Chris

2016-01-01

Repetitive transcranial magnetic stimulation over the left dorsolateral prefrontal cortex (DLPFC) has been documented to influence striatal and orbitofrontal dopaminergic activity implicated in reward processing. However, the exact neuropsychological mechanisms of how DLPFC stimulation may affect the reward system and how trait hedonic capacity may interact with the effects remains to be elucidated. In this sham-controlled study in healthy individuals, we investigated the effects of a single session of neuronavigated intermittent theta burst stimulation (iTBS) on reward responsiveness, as well as the influence of trait hedonic capacity. We used a randomized crossover single session iTBS design with an interval of 1 week. We assessed reward responsiveness using a rewarded probabilistic learning task and measured individual trait hedonic capacity (the ability to experience pleasure) with the temporal experience of pleasure scale questionnaire. As expected, the participants developed a response bias toward the most rewarded stimulus (rich stimulus). Reaction time and accuracy for the rich stimulus were respectively shorter and higher as compared to the less rewarded stimulus (lean stimulus). Active or sham stimulation did not seem to influence the outcome. However, when taking into account individual trait hedonic capacity, we found an early significant increase in the response bias only after active iTBS. The higher the individual's trait hedonic capacity, the more the response bias toward the rich stimulus increased after the active stimulation. When taking into account trait hedonic capacity, one active iTBS session over the left DLPFC improved reward responsiveness in healthy male participants with higher hedonic capacity. This suggests that individual differences in hedonic capacity may influence the effects of iTBS on the reward system.

NMDA receptor blockade in the prelimbic cortex activates the mesolimbic system and dopamine-dependent opiate reward signaling.

PubMed

Tan, Huibing; Rosen, Laura G; Ng, Garye A; Rushlow, Walter J; Laviolette, Steven R

2014-12-01

N-Methyl-D-aspartate (NMDA) receptors in the medial prefrontal cortex (mPFC) are involved in opiate reward processing and modulate sub-cortical dopamine (DA) activity. NMDA receptor blockade in the prelimbic (PLC) division of the mPFC strongly potentiates the rewarding behavioural properties of normally sub-reward threshold doses of opiates. However, the possible functional interactions between cortical NMDA and sub-cortical DAergic motivational neural pathways underlying these effects are not understood. This study examines how NMDA receptor modulation in the PLC influences opiate reward processing via interactions with sub-cortical DAergic transmission. We further examined whether direct intra-PLC NMDA receptor modulation may activate DA-dependent opiate reward signaling via interactions with the ventral tegmental area (VTA). Using an unbiased place conditioning procedure (CPP) in rats, we performed bilateral intra-PLC microinfusions of the competitive NMDA receptor antagonist, (2R)-amino-5-phosphonovaleric acid (AP-5), prior to behavioural morphine place conditioning and challenged the rewarding effects of morphine with DA receptor blockade. We next examined the effects of intra-PLC NMDA receptor blockade on the spontaneous activity patterns of presumptive VTA DA or GABAergic neurons, using single-unit, extracellular in vivo neuronal recordings. We show that intra-PLC NMDA receptor blockade strongly activates sub-cortical DA neurons within the VTA while inhibiting presumptive non-DA GABAergic neurons. Behaviourally, NMDA receptor blockade activates a DA-dependent opiate reward system, as pharmacological blockade of DA transmission blocked morphine reward only in the presence of intra-PLC NMDA receptor antagonism. These findings demonstrate a cortical NMDA-mediated mechanism controlling mesolimbic DAergic modulation of opiate reward processing.

Elevated cognitive control over reward processing in recovered female patients with anorexia nervosa.

PubMed

Ehrlich, Stefan; Geisler, Daniel; Ritschel, Franziska; King, Joseph A; Seidel, Maria; Boehm, Ilka; Breier, Marion; Clas, Sabine; Weiss, Jessika; Marxen, Michael; Smolka, Michael N; Roessner, Veit; Kroemer, Nils B

2015-09-01

Individuals with anorexia nervosa are thought to exert excessive self-control to inhibit primary drives. This study used functional MRI (fMRI) to interrogate interactions between the neural correlates of cognitive control and motivational processes in the brain reward system during the anticipation of monetary reward and reward-related feedback. In order to avoid confounding effects of undernutrition, we studied female participants recovered from anorexia nervosa and closely matched healthy female controls. The fMRI analysis (including node-to-node functional connectivity) followed a region of interest approach based on models of the brain reward system and cognitive control regions implicated in anorexia nervosa: the ventral striatum, medial orbitofrontal cortex (mOFC) and dorsolateral prefrontal cortex (DLPFC). We included 30 recovered patients and 30 controls in our study. There were no behavioural differences and no differences in hemodynamic responses of the ventral striatum and the mOFC in the 2 phases of the task. However, relative to controls, recovered patients showed elevated DLPFC activity during the anticipation phase, failed to deactivate this region during the feedback phase and displayed greater functional coupling between the DLPFC and mOFC. Recovered patients also had stronger associations than controls between anticipation-related DLPFC responses and instrumental responding. The results we obtained using monetary stimuli might not generalize to other forms of reward. Unaltered neural responses in ventral limbic reward networks but increased recruitment of and connectivity with lateral-frontal brain circuitry in recovered patients suggests an elevated degree of selfregulatory processes in response to rewarding stimuli. An imbalance between brain systems subserving bottom-up and top-down processes may be a trait marker of the disorder.

Further support for association between GWAS variant for positive emotion and reward systems.

PubMed

Lancaster, T M; Ihssen, N; Brindley, L M; Linden, D E J

2017-01-31

A recent genome-wide association study (GWAS) identified a significant single-nucleotide polymorphism (SNP) for trait-positive emotion at rs322931 on chromosome 1, which was also associated with brain activation in the reward system of healthy individuals when observing positive stimuli in a functional magnetic resonance imaging (fMRI) study. In the current study, we aimed to further validate the role of variation at rs322931 in reward processing. Using a similar fMRI approach, we use two paradigms that elicit a strong ventral striatum (VS) blood oxygen-level dependency (BOLD) response in a sample of young, healthy individuals (N=82). In the first study we use a similar picture-viewing task to the discovery sample (positive>neutral stimuli) to replicate an effect of the variant on emotion processing. In the second study we use a probabilistic reversal learning procedure to identify reward processing during decision-making under uncertainly (reward>punishment). In a region of interest (ROI) analysis of the bilateral VS, we show that the rs322931 genotype was associated with BOLD in the left VS during the positive>neutral contrast (P ROI-CORRECTED =0.045) and during the reward>punishment contrast (P ROI-CORRECTED =0.018), although the effect of passive picture viewing was in the opposite direction from that reported in the discovery sample. These findings suggest that the recently identified GWAS hit may influence positive emotion via individual differences in activity in the key hubs of the brain's reward system. Furthermore, these effects may not be limited to the passive viewing of positive emotional scenes, but may also be observed during dynamic decision-making. This study suggests that future studies of this GWAS locus may yield further insight into the biological mechanisms of psychopathologies characterised by deficits in reward processing and positive emotion.

Neural correlates of reward processing in adults with 22q11 deletion syndrome.

PubMed

van Duin, Esther D A; Goossens, Liesbet; Hernaus, Dennis; da Silva Alves, Fabiana; Schmitz, Nicole; Schruers, Koen; van Amelsvoort, Therese

2016-01-01

22q11.2 deletion syndrome (22q11DS) is caused by a microdeletion on chromosome 22q11.2 and associated with an increased risk to develop psychosis. The gene coding for catechol-O-methyl-transferase (COMT) is located at the deleted region, resulting in disrupted dopaminergic neurotransmission in 22q11DS, which may contribute to the increased vulnerability for psychosis. A dysfunctional motivational reward system is considered one of the salient features in psychosis and thought to be related to abnormal dopaminergic neurotransmission. The functional anatomy of the brain reward circuitry has not yet been investigated in 22q11DS. This study aims to investigate neural activity during anticipation of reward and loss in adult patients with 22q11DS. We measured blood-oxygen-level dependent (BOLD) activity in 16 patients with 22q11DS and 12 healthy controls during a monetary incentive delay task using a 3T Philips Intera MRI system. Data were analysed using SPM8. During anticipation of reward, the 22q11DS group alone displayed significant activation in bilateral middle frontal and temporal brain regions. Compared to healthy controls, significantly less activation in bilateral cingulate gyrus extending to premotor, primary motor and somatosensory areas was found. During anticipation of loss, the 22q11DS group displayed activity in the left middle frontal gyrus and anterior cingulate cortex, and relative to controls, they showed reduced brain activation in bilateral (pre)cuneus and left posterior cingulate. Within the 22q11DS group, COMT Val hemizygotes displayed more activation compared to Met hemizygotes in right posterior cingulate and bilateral parietal regions during anticipation of reward. During anticipation of loss, COMT Met hemizygotes compared to Val hemizygotes showed more activation in bilateral insula, striatum and left anterior cingulate. This is the first study to investigate reward processing in 22q11DS. Our preliminary results suggest that people with 22q11DS engage a fronto-temporal neural network. Compared to healthy controls, people with 22q11DS primarily displayed reduced activity in medial frontal regions during reward anticipation. COMT hemizygosity affects responsivity of the reward system in this condition. Alterations in reward processing partly underlain by the dopamine system may play a role in susceptibility for psychosis in 22q11DS.

Animal models of cannabinoid reward

PubMed Central

Panlilio, Leigh V; Justinova, Zuzana; Goldberg, Steven R

2010-01-01

The endogenous cannabinoid system is involved in numerous physiological and neuropsychological functions. Medications that target this system hold promise for the treatment of a wide variety of disorders. However, as reward is one of the most prominent of these functions, medications that activate this system must be evaluated for abuse potential. Meanwhile, cannabis is already being used chronically by millions of people, many of whom eventually seek treatment for cannabis dependence. Therefore, there is a need for procedures that can be used to: (i) better understand the mechanisms of cannabinoid reward; (ii) evaluate the abuse potential of new medications; and (iii) evaluate the effectiveness of medications developed for treating cannabis dependence. Animal models of cannabinoid reward provide a means of accomplishing these goals. In this review, we briefly describe and evaluate these models, their advantages and their shortcomings. Special emphasis is placed on intravenous cannabinoid self-administration in squirrel monkeys, a valid, reliable and flexible model that we have developed over the past decade. Although the conditions under which cannabinoid drugs have rewarding effects may be more restricted than with other drugs of abuse such as cocaine and heroin, work with these models indicates that cannabinoid reward involves similar brain mechanisms and produces the same kinds of reward-related behaviour. By continuing to use these animal models as tools in the development of new medications, it should be possible to take advantage of the potential benefits provided by the endocannabinoid system while minimizing its potential for harm. This article is part of a themed issue on Cannabinoids. To view the editorial for this themed issue visit http://dx.doi.org/10.1111/j.1476-5381.2010.00831.x PMID:20590560

Memory and reward systems coproduce 'nostalgic' experiences in the brain.

PubMed

Oba, Kentaro; Noriuchi, Madoka; Atomi, Tomoaki; Moriguchi, Yoshiya; Kikuchi, Yoshiaki

2016-07-01

People sometimes experience an emotional state known as 'nostalgia', which involves experiencing predominantly positive emotions while remembering autobiographical events. Nostalgia is thought to play an important role in psychological resilience. Previous neuroimaging studies have shown involvement of memory and reward systems in such experiences. However, it remains unclear how these two systems are collaboratively involved with nostalgia experiences. Here, we conducted a functional magnetic resonance imaging study of healthy females to investigate the relationship between memory-reward co-activation and nostalgia, using childhood-related visual stimuli. Moreover, we examined the factors constituting nostalgia and their neural correlates. We confirmed the presence of nostalgia-related activity in both memory and reward systems, including the hippocampus (HPC), substantia nigra/ventral tegmental area (SN/VTA), and ventral striatum (VS). We also found significant HPC-VS co-activation, with its strength correlating with individual 'nostalgia tendencies'. Factor analyses showed that two dimensions underlie nostalgia: emotional and personal significance and chronological remoteness, with the former correlating with caudal SN/VTA and left anterior HPC activity, and the latter correlating with rostral SN/VTA activity. These findings demonstrate the cooperative activity of memory and reward systems, where each system has a specific role in the construction of the factors that underlie the experience of nostalgia. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Faculty Compensation in Continuing Education: Theory versus Practice.

ERIC Educational Resources Information Center

Scott, Joyce A.

1984-01-01

Lawler's Motivation Model and other studies of reward systems are used to develop a policy assessment and development checklist for compensating continuing education faculty. The checklist includes institutional, reward system, and motivation factors that should be considered to encourage faculty participation. (SK)

Neural Reward and Punishment Sensitivity in Cigarette Smokers

PubMed Central

Potts, Geoffrey F.; Bloom, Erika; Evans, David E.; Drobes, David J.

2014-01-01

Background Nicotine addiction remains a major public health problem but the neural substrates of addictive behavior remain unknown. One characteristic of smoking behavior is impulsive choice, selecting the immediate reward of smoking despite the potential long-term negative consequences. This suggests that drug users, including cigarette smokers, may be more sensitive to rewards and less sensitive to punishment. Methods We used event-related potentials (ERPs) to test the hypothesis that smokers are more responsive to reward signals and less responsive to punishment, potentially predisposing them to risky behavior. We conducted two experiments, one using a reward prediction design to elicit a Medial Frontal Negativity (MFN) and one using a reward- and punishment-motivated flanker task to elicit an Error Related Negativity (ERN), ERP components thought to index activity in the cortical projection of the dopaminergic reward system. Results and Conclusions The smokers had a greater MFN response to unpredicted rewards, and non-smokers, but not smokers, had a larger ERN on punishment motivated trials indicating that smokers are more reward sensitive and less punishment sensitive than nonsmokers, overestimating the appetitive value and underestimating aversive outcomes of stimuli and actions. PMID:25292454

Functional requirements for reward-modulated spike-timing-dependent plasticity.

PubMed

Frémaux, Nicolas; Sprekeler, Henning; Gerstner, Wulfram

2010-10-06

Recent experiments have shown that spike-timing-dependent plasticity is influenced by neuromodulation. We derive theoretical conditions for successful learning of reward-related behavior for a large class of learning rules where Hebbian synaptic plasticity is conditioned on a global modulatory factor signaling reward. We show that all learning rules in this class can be separated into a term that captures the covariance of neuronal firing and reward and a second term that presents the influence of unsupervised learning. The unsupervised term, which is, in general, detrimental for reward-based learning, can be suppressed if the neuromodulatory signal encodes the difference between the reward and the expected reward-but only if the expected reward is calculated for each task and stimulus separately. If several tasks are to be learned simultaneously, the nervous system needs an internal critic that is able to predict the expected reward for arbitrary stimuli. We show that, with a critic, reward-modulated spike-timing-dependent plasticity is capable of learning motor trajectories with a temporal resolution of tens of milliseconds. The relation to temporal difference learning, the relevance of block-based learning paradigms, and the limitations of learning with a critic are discussed.

Overlapping neural systems represent cognitive effort and reward anticipation.

PubMed

Vassena, Eliana; Silvetti, Massimo; Boehler, Carsten N; Achten, Eric; Fias, Wim; Verguts, Tom

2014-01-01

Anticipating a potential benefit and how difficult it will be to obtain it are valuable skills in a constantly changing environment. In the human brain, the anticipation of reward is encoded by the Anterior Cingulate Cortex (ACC) and Striatum. Naturally, potential rewards have an incentive quality, resulting in a motivational effect improving performance. Recently it has been proposed that an upcoming task requiring effort induces a similar anticipation mechanism as reward, relying on the same cortico-limbic network. However, this overlapping anticipatory activity for reward and effort has only been investigated in a perceptual task. Whether this generalizes to high-level cognitive tasks remains to be investigated. To this end, an fMRI experiment was designed to investigate anticipation of reward and effort in cognitive tasks. A mental arithmetic task was implemented, manipulating effort (difficulty), reward, and delay in reward delivery to control for temporal confounds. The goal was to test for the motivational effect induced by the expectation of bigger reward and higher effort. The results showed that the activation elicited by an upcoming difficult task overlapped with higher reward prospect in the ACC and in the striatum, thus highlighting a pivotal role of this circuit in sustaining motivated behavior.

Pervasive competition between threat and reward in the brain

PubMed Central

Choi, Jong Moon; Padmala, Srikanth; Spechler, Philip

2014-01-01

In the current functional MRI study, we investigated interactions between reward and threat processing. Visual cues at the start of each trial informed participants about the chance of winning monetary reward and/or receiving a mild aversive shock. We tested two competing hypothesis: according to the ‘salience hypothesis’, in the condition involving both reward and threat, enhanced activation would be observed because of increased salience; according to the ‘competition hypothesis’, the processing of reward and threat would trade-off against each other, leading to reduced activation. Analysis of skin conductance data during a delay phase revealed an interaction between reward and threat processing, such that the effect of reward was reduced during threat and the effect of threat was reduced during reward. Analysis of imaging data during the same task phase revealed interactions between reward and threat processing in several regions, including the midbrain/ventral tegmental area, caudate, putamen, bed nucleus of the stria terminalis, anterior insula, middle frontal gyrus and dorsal anterior cingulate cortex. Taken together, our findings reveal conditions during which reward and threat trade-off against each other across multiple sites. Such interactions are suggestive of competitive processes and may reflect the organization of opponent systems in the brain. PMID:23547242

Decision Making in the Reward and Punishment Variants of the Iowa Gambling Task: Evidence of “Foresight” or “Framing”?

PubMed Central

Singh, Varsha; Khan, Azizuddin

2012-01-01

Surface-level differences in the reward and punishment variants, specifically greater long-term decision making in the punishment variant of the Iowa Gambling Task (IGT) observed in previous studies led to the present comparison of long-term decision making in the two IGT variants (n = 320, male = 160). It was contended that risk aversion triggered by a positive frame of the reward variant and risk seeking triggered by a negative frame of the punishment variant appears as long-term decision making in the two IGT variants. Apart from the frame of the variant as a within-subjects factor (variant type: reward and punishment), the order in which the frame was triggered (order type: reward–punishment or punishment–reward), and the four types of instructions that delineated motivation toward reward from that of punishment (reward, punishment, reward and punishment, and no-hint) were hypothesized to have an effect on foresighted decision making in the IGT. As expected, long-term decision making differed across the two IGT variants suggesting that the frame of the variant has an effect on long-term decision making in the IGT (p < 0.001). The order in which a variant was presented, and the type of the instructions that were used both had an effect on long-term decision making in the two IGT variants (p < 0.05). A post hoc test suggested that the instructions that differentiated between reward and punishment resulted in greater foresight than the commonly used IGT instructions that fail to distinguish between reward and punishment. As observed in previous studies, there were more number of participants (60%) who showed greater foresight in the punishment variant than in the reward variant (p < 0.001). The results suggest that foresight in IGT decision making is sensitive to reward and punishment frame in an asymmetric manner, an observation that is aligned with the behavioral decision making framework. Benefits of integrating findings from behavioral studies in decision neuroscience are discussed, and a need to investigate cultural differences in the IGT studies is pointed out. PMID:22833714

The genetic basis of individual differences in reward processing and the link to addictive behavior and social cognition.

PubMed

Yacubian, J; Büchel, C

2009-11-24

Dopaminergic neurotransmission is widely recognized to be critical to the neurobiology of reward, motivation and addiction. Interestingly, social interactions and related behavior also activate the same neuronal system. Consequently, genetic variations of dopamine neurotransmission are thought influence reward processing that in turn may affect distinctive social behavior and susceptibility to addiction. This review focuses on advances made to date in an effort to link genetic individual variations and reward processing as a possible basis for addictive behaviors.

Neural systems underlying reward and approach behaviors in childhood and adolescence.

PubMed

Galván, Adriana

2014-01-01

Transitions into and out of adolescence are critical developmental periods of reward-seeking and approach behaviors. Converging evidence suggests that intriguing reward-related behavioral shifts are mediated by developmental changes in frontostriatal circuitry. This chapter explores how the conceptual frameworks and empirical studies in the field of developmental cognitive neuroscience have contributed to understanding reward-related behavior across development.The chapter concludes with some implications for adaptive and maladaptive behaviors that arise from these behaviors as children transition from childhood to adolescence.

Altered Reward Function in Adolescent Depression: What, When, and How?

PubMed Central

Forbes, Erika E.; Dahl, Ronald E.

2011-01-01

Background Conceptual models and recent evidence indicate that neural response to reward is altered in depression. Taking a developmental approach to investigating reward function in adolescent depression can elucidate the etiology, pathophysiology, and course of depression, a disorder that typically begins during adolescence and has high rates of recurrence. Methods This conceptual review describes the what, when, and how of altered reward function in adolescent depression. With the goal of generating new, testable hypotheses within a developmental affective neuroscience framework, we critically review findings and suggest future directions. Peer-reviewed empirical papers for inclusion in this critical review were obtained by searching PubMed, PsycInfo, and ScienceDirect for the years 1990–2010. Results A pattern of low striatal response and high medial prefrontal response to reward is evident in adolescents and adults with depression. Given the salience of social stimuli for positive affect and depression, reward function might be especially disrupted in response to social rewards. Because of changes in the dopamine system and reward function with aging, altered reward function in depression might be more evident during adolescence than later in life; however, low reward function may also be a stable characteristic of people who experience depression. Mechanisms of altered reward function in depression could include disrupted balance of corticostriatal circuit function, with disruption occurring as aberrant adolescent brain development. Conclusions Future studies should examine responses to social rewards; employ longitudinal and prospective designs; and investigate patterns of functional connectivity in reward circuits. Understanding altered reward function in depression has potential implications for treatment development. A more rigorous approach to investigating anhedonia, threat-reward interactions, and comorbid anxiety will be valuable to future progress in describing the role of reward function in the pathophysiology of depression. PMID:22117893

Frontal theta and beta synchronizations for monetary reward increase visual working memory capacity

PubMed Central

Yamaguchi, Yoko

2013-01-01

Visual working memory (VWM) capacity is affected by motivational influences; however, little is known about how reward-related brain activities facilitate the VWM systems. To investigate the dynamic relationship between VWM- and reward-related brain activities, we conducted time–frequency analyses using electroencephalograph (EEG) data obtained during a monetary-incentive delayed-response task that required participants to memorize the position of colored disks. In case of a correct answer, participants received a monetary reward (0, 10 or 50 Japanese yen) announced at the beginning of each trial. Behavioral results showed that VWM capacity under high-reward condition significantly increased compared with that under low- or no-reward condition. EEG results showed that frontal theta (6 Hz) amplitudes enhanced during delay periods and positively correlated with VWM capacity, indicating involvement of theta local synchronizations in VWM. Moreover, frontal beta activities (24 Hz) were identified as reward-related activities, because delay-period amplitudes correlated with increases in VWM capacity between high-reward and no-reward conditions. Interestingly, cross-frequency couplings between frontal theta and beta phases were observed only under high-reward conditions. These findings suggest that the functional dynamic linking between VWM-related theta and reward-related beta activities on the frontal regions plays an integral role in facilitating increases in VWM capacity. PMID:22349800

Frontal theta and beta synchronizations for monetary reward increase visual working memory capacity.

PubMed

Kawasaki, Masahiro; Yamaguchi, Yoko

2013-06-01

Visual working memory (VWM) capacity is affected by motivational influences; however, little is known about how reward-related brain activities facilitate the VWM systems. To investigate the dynamic relationship between VWM- and reward-related brain activities, we conducted time-frequency analyses using electroencephalograph (EEG) data obtained during a monetary-incentive delayed-response task that required participants to memorize the position of colored disks. In case of a correct answer, participants received a monetary reward (0, 10 or 50 Japanese yen) announced at the beginning of each trial. Behavioral results showed that VWM capacity under high-reward condition significantly increased compared with that under low- or no-reward condition. EEG results showed that frontal theta (6 Hz) amplitudes enhanced during delay periods and positively correlated with VWM capacity, indicating involvement of theta local synchronizations in VWM. Moreover, frontal beta activities (24 Hz) were identified as reward-related activities, because delay-period amplitudes correlated with increases in VWM capacity between high-reward and no-reward conditions. Interestingly, cross-frequency couplings between frontal theta and beta phases were observed only under high-reward conditions. These findings suggest that the functional dynamic linking between VWM-related theta and reward-related beta activities on the frontal regions plays an integral role in facilitating increases in VWM capacity.

A test of the reward-value hypothesis.

PubMed

Smith, Alexandra E; Dalecki, Stefan J; Crystal, Jonathon D

2017-03-01

Rats retain source memory (memory for the origin of information) over a retention interval of at least 1 week, whereas their spatial working memory (radial maze locations) decays within approximately 1 day. We have argued that different forgetting functions dissociate memory systems. However, the two tasks, in our previous work, used different reward values. The source memory task used multiple pellets of a preferred food flavor (chocolate), whereas the spatial working memory task provided access to a single pellet of standard chow-flavored food at each location. Thus, according to the reward-value hypothesis, enhanced performance in the source memory task stems from enhanced encoding/memory of a preferred reward. We tested the reward-value hypothesis by using a standard 8-arm radial maze task to compare spatial working memory accuracy of rats rewarded with either multiple chocolate or chow pellets at each location using a between-subjects design. The reward-value hypothesis predicts superior accuracy for high-valued rewards. We documented equivalent spatial memory accuracy for high- and low-value rewards. Importantly, a 24-h retention interval produced equivalent spatial working memory accuracy for both flavors. These data are inconsistent with the reward-value hypothesis and suggest that reward value does not explain our earlier findings that source memory survives unusually long retention intervals.

Reward bias and lateralization in gambling behavior: behavioral activation system and alpha band analysis.

PubMed

Balconi, Michela; Finocchiaro, Roberta; Canavesio, Ylenia; Messina, Rossella

2014-11-30

The present research explored the main factors that can influence subjects' choices in the case of decisions. In order to elucidate the individual differences that influence the decisional processes, making their strategies more or less advantageous, we tested the effect of a reward sensitivity in the behavioral activation system (BAS-Reward) constructed on the ability to distinguish between high- and low-risk decisions. Secondly, the lateralization effect, related to increased activation of the left (BAS-related) hemisphere, was explored. Thirty-one subjects were tested using the Iowa Gambling Task, and the BAS-Reward measure was applied to distinguish between high-BAS and low-BAS groups. Behavioral responses (gain/loss options) and alpha-band modulation were considered. It was found that high-BAS group increased their tendency to opt in favor of the immediate reward (loss strategy) rather than the long-term option (win strategy). Secondly, high-BAS subjects showed an increased left-hemisphere activation in response to losing (with immediate reward) choices in comparison with low-BAS subjects. A "reward bias" effect was supposed to explain both the bad strategy and the unbalanced hemispheric activation for high-BAS and more risk-taking subjects. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Lateral habenula neurons signal errors in the prediction of reward information

PubMed Central

Bromberg-Martin, Ethan S.; Hikosaka, Okihide

2011-01-01

Humans and animals have a remarkable ability to predict future events, which they achieve by persistently searching their environment for sources of predictive information. Yet little is known about the neural systems that motivate this behavior. We hypothesized that information-seeking is assigned value by the same circuits that support reward-seeking, so that neural signals encoding conventional “reward prediction errors” include analogous “information prediction errors”. To test this we recorded from neurons in the lateral habenula, a nucleus which encodes reward prediction errors, while monkeys chose between cues that provided different amounts of information about upcoming rewards. We found that a subpopulation of lateral habenula neurons transmitted signals resembling information prediction errors, responding when reward information was unexpectedly cued, delivered, or denied. Their signals evaluated information sources reliably even when the animal’s decisions did not. These neurons could provide a common instructive signal for reward-seeking and information-seeking behavior. PMID:21857659

Quantifying familial influences on brain activation during the monetary incentive delay task: an adolescent monozygotic twin study.

PubMed

Silverman, Merav H; Krueger, Robert F; Iacono, William G; Malone, Stephen M; Hunt, Ruskin H; Thomas, Kathleen M

2014-12-01

Although altered brain activation during reward tasks has been found in a number of heritable psychiatric disorders and health outcomes, the familial nature of reward-related brain activation remains unexplored. In this study, we investigated the degree to which the magnitude of mesocorticolimbic reward system signal intensities in anticipation of reward during the monetary incentive delay (MID) task was similar within 46 pairs of adolescent, monozygotic twins. Significant within-pair correlations in brain activation during anticipation of gain were found in one third of the 18 reward-related regions investigated. These regions were the right nucleus accumbens, left and right posterior caudate, right anterior caudate, left insula, and anterior cingulate cortex. This serves as evidence for a shared familial contribution to individual differences in reward related brain activity in certain key reward processing regions. Copyright © 2014 Elsevier B.V. All rights reserved.

A Positive Affective Neuroendocrinology Approach to Reward and Behavioral Dysregulation

PubMed Central

Welker, Keith M.; Gruber, June; Mehta, Pranjal H.

2015-01-01

Emerging lines of research suggest that both testosterone and maladaptive reward processing can modulate behavioral dysregulation. Yet, to date, no integrative account has been provided that systematically explains neuroendocrine function, dysregulation of reward, and behavioral dysregulation in a unified perspective. This is particularly important given specific neuroendocrine systems are potential mechanisms underlying and giving rise to reward-relevant behaviors. In this review, we propose a forward-thinking approach to study the mechanisms of reward and behavioral dysregulation from a positive affective neuroendocrinology (PANE) perspective. This approach holds that testosterone increases reward processing and motivation, which increase the likelihood of behavioral dysregulation. Additionally, the PANE framework holds that reward processing mediates the effects of testosterone on behavioral dysregulation. We also explore sources of potential sex differences and the roles of age, cortisol, and individual differences within the PANE framework. Finally, we discuss future prospects for research questions and methodology in the emerging field of affective neuroendocrinology. PMID:26191007

Food Approach and Food Avoidance in Young Children: Relation with Reward Sensitivity and Punishment Sensitivity

PubMed Central

Vandeweghe, Laura; Vervoort, Leentje; Verbeken, Sandra; Moens, Ellen; Braet, Caroline

2016-01-01

It has recently been suggested that individual differences in Reward Sensitivity and Punishment Sensitivity may determine how children respond to food. These temperamental traits reflect activity in two basic brain systems that respond to rewarding and punishing stimuli, respectively, with approach and avoidance. Via parent-report questionnaires, we investigate the associations of the general motivational temperamental traits Reward Sensitivity and Punishment Sensitivity with Food Approach and Food Avoidance in 98 preschool children. Consistent with the conceptualization of Reward Sensitivity in terms of approach behavior and Punishment Sensitivity in terms of avoidance behavior, Reward Sensitivity was positively related to Food Approach, while Punishment Sensitivity was positively related to Food Avoidance. Future research should integrate these perspectives (i.e., general temperamental traits Reward Sensitivity and Punishment Sensitivity, and Food Approach and Avoidance) to get a better understanding of eating behavior and related body weight. PMID:27445898

Acute stress-induced cortisol elevations mediate reward system activity during subconscious processing of sexual stimuli.

PubMed

Oei, Nicole Y L; Both, Stephanie; van Heemst, Diana; van der Grond, Jeroen

2014-01-01

Stress is thought to alter motivational processes by increasing dopamine (DA) secretion in the brain's "reward system", and its key region, the nucleus accumbens (NAcc). However, stress studies using functional magnetic resonance imaging (fMRI), mainly found evidence for stress-induced decreases in NAcc responsiveness toward reward cues. Results from both animal and human PET studies indicate that the stress hormone cortisol may be crucial in the interaction between stress and dopaminergic actions. In the present study we therefore investigated whether cortisol mediated the effect of stress on DA-related responses to -subliminal-presentation of reward cues using the Trier Social Stress Test (TSST), which is known to reliably enhance cortisol levels. Young healthy males (n = 37) were randomly assigned to the TSST or control condition. After stress induction, brain activation was assessed using fMRI during a backward-masking paradigm in which potentially rewarding (sexual), emotionally negative and neutral stimuli were presented subliminally, masked by pictures of inanimate objects. A region of interest analysis showed that stress decreased activation in the NAcc in response to masked sexual cues (voxel-corrected, p<05). Furthermore, with mediation analysis it was found that high cortisol levels were related to stronger NAcc activation, showing that cortisol acted as a suppressor variable in the negative relation between stress and NAcc activation. The present findings indicate that cortisol is crucially involved in the relation between stress and the responsiveness of the reward system. Although generally stress decreases activation in the NAcc in response to rewarding stimuli, high stress-induced cortisol levels suppress this relation, and are associated with stronger NAcc activation. Individuals with a high cortisol response to stress might on one hand be protected against reductions in reward sensitivity, which has been linked to anhedonia and depression, but they may ultimately be more vulnerable to increased reward sensitivity, and addictions. Future studies investigating effects of stress on reward sensitivity should take into account the severity of the stressor and the individual cortisol response to stress. Copyright © 2013 Elsevier Ltd. All rights reserved.

Reward and aversion in a heterogeneous midbrain dopamine system.

PubMed

Lammel, Stephan; Lim, Byung Kook; Malenka, Robert C

2014-01-01

The ventral tegmental area (VTA) is a heterogeneous brain structure that serves a central role in motivation and reward processing. Abnormalities in the function of VTA dopamine (DA) neurons and the targets they influence are implicated in several prominent neuropsychiatric disorders including addiction and depression. Recent studies suggest that the midbrain DA system is composed of anatomically and functionally heterogeneous DA subpopulations with different axonal projections. These findings may explain a number of previously confusing observations that suggested a role for DA in processing both rewarding as well as aversive events. Here we will focus on recent advances in understanding the neural circuits mediating reward and aversion in the VTA and how stress as well as drugs of abuse, in particular cocaine, alter circuit function within a heterogeneous midbrain DA system. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'. Copyright © 2013 Elsevier Ltd. All rights reserved.

Incentive-Elicited Mesolimbic Activation and Externalizing Symptomatology in Adolescents

ERIC Educational Resources Information Center

Bjork, James M.; Chen, Gang; Smith, Ashley R.; Hommer, Daniel W.

2010-01-01

Background: Opponent-process theories of externalizing disorders (ExD) attribute them to some combination of overactive reward processing systems and/or underactive behavior inhibition systems. Reward processing has been indexed by recruitment of incentive-motivational neurocircuitry of the ventral striatum (VS), including nucleus accumbens…

The anticipation and outcome phases of reward and loss processing: A neuroimaging meta-analysis of the monetary incentive delay task.

PubMed

Oldham, Stuart; Murawski, Carsten; Fornito, Alex; Youssef, George; Yücel, Murat; Lorenzetti, Valentina

2018-04-25

The processing of rewards and losses are crucial to everyday functioning. Considerable interest has been attached to investigating the anticipation and outcome phases of reward and loss processing, but results to date have been inconsistent. It is unclear if anticipation and outcome of a reward or loss recruit similar or distinct brain regions. In particular, while the striatum has widely been found to be active when anticipating a reward, whether it activates in response to the anticipation of losses as well remains ambiguous. Furthermore, concerning the orbitofrontal/ventromedial prefrontal regions, activation is often observed during reward receipt. However, it is unclear if this area is active during reward anticipation as well. We ran an Activation Likelihood Estimation meta-analysis of 50 fMRI studies, which used the Monetary Incentive Delay Task (MIDT), to identify which brain regions are implicated in the anticipation of rewards, anticipation of losses, and the receipt of reward. Anticipating rewards and losses recruits overlapping areas including the striatum, insula, amygdala and thalamus, suggesting that a generalised neural system initiates motivational processes independent of valence. The orbitofrontal/ventromedial prefrontal regions were recruited only during the reward outcome, likely representing the value of the reward received. Our findings help to clarify the neural substrates of the different phases of reward and loss processing, and advance neurobiological models of these processes. © 2018 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Behavioral Management of Exceptional Children Using Video Games as Reward.

ERIC Educational Resources Information Center

Buckalew, L.W.; Buckalew, Patricia Bowman

1983-01-01

Seventeen children ranging in age from 9 to 15 years and from grades four and eight in five classes for students with emotional conflicts were placed on a video game reward system. The observation of enhanced classroom decorum and individual performance of students suggest the effectiveness of this reward in modifying behavior. (Author/PN)

Faculty Issues Pertaining to Institutional Support and Reward Practices in Distance Education.

ERIC Educational Resources Information Center

Wolcott, Linda L.

This paper presents an overview of eight issues that are central to the discussion of distance education and its relationship to institutional support and reward systems. Each section provides a brief description of the issue and a summary of what is currently known about reward practices and policies in distance education. The issues discussed…

Reward Retroactively Enhances Memory Consolidation for Related Items

ERIC Educational Resources Information Center

Patil, Anuya; Murty, Vishnu P.; Dunsmoor, Joseph E.; Phelps, Elizabeth A.; Davachi, Lila

2017-01-01

Reward motivation has been shown to modulate episodic memory processes in order to support future adaptive behavior. However, for a memory system to be truly adaptive, it should enhance memory for rewarded events as well as for neutral events that may seem inconsequential at the time of encoding but can gain importance later. Here, we investigated…

Social defeat disrupts reward learning and potentiates striatal nociceptin/orphanin FQ mRNA in rats.

PubMed

Der-Avakian, Andre; D'Souza, Manoranjan S; Potter, David N; Chartoff, Elena H; Carlezon, William A; Pizzagalli, Diego A; Markou, Athina

2017-05-01

Mood disorders can be triggered by stress and are characterized by deficits in reward processing, including disrupted reward learning (the ability to modulate behavior according to past rewards). Reward learning is regulated by the anterior cingulate cortex (ACC) and striatal circuits, both of which are implicated in the pathophysiology of mood disorders. Here, we assessed in rats the effects of a potent stressor (social defeat) on reward learning and gene expression in the ACC, ventral tegmental area (VTA), and striatum. Adult male Wistar rats were trained on an operant probabilistic reward task (PRT) and then exposed to 3 days of social defeat before assessment of reward learning. After testing, the ACC, VTA, and striatum were dissected, and expression of genes previously implicated in stress was assessed. Social defeat blunted reward learning (manifested as reduced response bias toward a more frequently rewarded stimulus) and was associated with increased nociceptin/orphanin FQ (N/OFQ) peptide mRNA levels in the striatum and decreased Fos mRNA levels in the VTA. Moreover, N/OFQ peptide and nociceptin receptor mRNA levels in the ACC, VTA and striatum were inversely related to reward learning. The behavioral findings parallel previous data in humans, suggesting that stress similarly disrupts reward learning in both species. Increased striatal N/OFQ mRNA in stressed rats characterized by impaired reward learning is consistent with accumulating evidence that antagonism of nociceptin receptors, which bind N/OFQ, has antidepressant-like effects. These results raise the possibility that nociceptin systems represent a molecular substrate through which stress produces reward learning deficits in mood disorders.

Reward system and temporal pole contributions to affective evaluation during a first person shooter video game.

PubMed

Mathiak, Krystyna A; Klasen, Martin; Weber, René; Ackermann, Hermann; Shergill, Sukhwinder S; Mathiak, Klaus

2011-07-12

Violent content in video games evokes many concerns but there is little research concerning its rewarding aspects. It was demonstrated that playing a video game leads to striatal dopamine release. It is unclear, however, which aspects of the game cause this reward system activation and if violent content contributes to it. We combined functional Magnetic Resonance Imaging (fMRI) with individual affect measures to address the neuronal correlates of violence in a video game. Thirteen male German volunteers played a first-person shooter game (Tactical Ops: Assault on Terror) during fMRI measurement. We defined success as eliminating opponents, and failure as being eliminated themselves. Affect was measured directly before and after game play using the Positive and Negative Affect Schedule (PANAS). Failure and success events evoked increased activity in visual cortex but only failure decreased activity in orbitofrontal cortex and caudate nucleus. A negative correlation between negative affect and responses to failure was evident in the right temporal pole (rTP). The deactivation of the caudate nucleus during failure is in accordance with its role in reward-prediction error: it occurred whenever subject missed an expected reward (being eliminated rather than eliminating the opponent). We found no indication that violence events were directly rewarding for the players. We addressed subjective evaluations of affect change due to gameplay to study the reward system. Subjects reporting greater negative affect after playing the game had less rTP activity associated with failure. The rTP may therefore be involved in evaluating the failure events in a social context, to regulate the players' mood.

Within-subject neural reactivity to reward and threat is inverted in young adolescents.

PubMed

Thomason, M E; Marusak, H A

2017-07-01

As children mature, they become increasingly independent and less reliant on caregiver support. Changes in brain systems are likely to stimulate and guide this process. One mechanistic hypothesis suggests that changes in neural systems that process reward and threat support the increase in exploratory behavior observed in the transition to adolescence. This study examines the basic tenets of this hypothesis by performing functional magnetic resonance imaging (fMRI) during well-established reward and threat processing tasks in 40 children and adolescents, aged 9-15 years. fMRI responses in the striatum and amygdala are fit to a model predicting that striatal reward and amygdala threat-responses will be unrelated in younger participants (aged 9-12 years), while older participants (aged 13-15 years) will differentially engage these structures. Our data are consistent with this model. Activity in the striatum and amygdala are comparable in younger children, but in older children, they are inversely related; those more responsive to reward show a reduced threat-response. Analyses testing age as a continuous variable yield consistent results. In addition, the proportion of threat to reward-response relates to self-reported approach behavior in older but not younger youth, exposing behavioral relevance in the relative level of activity in these structures. Results are consistent with the notion that both individual and developmental differences drive reward-seeking behavior in adolescence. While these response patterns may serve adaptive functions in the shift to independence, skew in these systems may relate to increased rates of emotional psychopathology and risk-taking observed in adolescence.

Précis of The brain and emotion.

PubMed

Rolls, E T

2000-04-01

The topics treated in The brain and emotion include the definition, nature, and functions of emotion (Ch. 3); the neural bases of emotion (Ch. 4); reward, punishment, and emotion in brain design (Ch. 10); a theory of consciousness and its application to understanding emotion and pleasure (Ch. 9); and neural networks and emotion-related learning (Appendix). The approach is that emotions can be considered as states elicited by reinforcers (rewards and punishers). This approach helps with understanding the functions of emotion, with classifying different emotions, and in understanding what information-processing systems in the brain are involved in emotion, and how they are involved. The hypothesis is developed that brains are designed around reward- and punishment-evaluation systems, because this is the way that genes can build a complex system that will produce appropriate but flexible behavior to increase fitness (Ch. 10). By specifying goals rather than particular behavioral patterns of responses, genes leave much more open the possible behavioral strategies that might be required to increase fitness. The importance of reward and punishment systems in brain design also provides a basis for understanding the brain mechanisms of motivation, as described in Chapters 2 for appetite and feeding, 5 for brain-stimulation reward, 6 for addiction, 7 for thirst, and 8 for sexual behavior.

Comorbidity of Alcohol Use Disorder and Chronic Pain: Genetic Influences on Brain Reward and Stress Systems.

PubMed

Yeung, Ellen W; Craggs, Jason G; Gizer, Ian R

2017-11-01

Alcohol use disorder (AUD) is highly comorbid with chronic pain (CP). Evidence has suggested that neuroadaptive processes characterized by reward deficit and stress surfeit are involved in the development of AUD and pain chronification. Neurological data suggest that shared genetic architecture associated with the reward and stress systems may contribute to the comorbidity of AUD and CP. This monograph first delineates the prevailing theories of the development of AUD and pain chronification focusing on the reward and stress systems. It then provides a brief summary of relevant neurological findings followed by an evaluation of evidence documented by molecular genetic studies. Candidate gene association studies have provided some initial support for the genetic overlap between AUD and CP; however, these results must be interpreted with caution until studies with sufficient statistical power are conducted and replications obtained. Genomewide association studies have suggested a number of genes (e.g., TBX19, HTR7, and ADRA1A) that are either directly or indirectly related to the reward and stress systems in the AUD and CP literature. Evidence reviewed in this monograph suggests that shared genetic liability underlying the comorbidity between AUD and CP, if present, is likely to be complex. As the advancement in molecular genetic methods continues, future studies may show broader central nervous system involvement in AUD-CP comorbidity. Copyright © 2017 by the Research Society on Alcoholism.

Appetitive Motivation and Negative Emotion Reactivity among Remitted Depressed Youth

PubMed Central

Hankin, Benjamin L.; Wetter, Emily K.; Flory, Kate

2012-01-01

Depression has been characterized as involving altered appetitive motivation and emotional reactivity. Yet no study has examined objective indices of emotional reactivity when the appetitive/approach system is suppressed in response to failure to attain a self-relevant goal and desired reward. Three groups of youth (N = 98, ages 9–15; remitted depressed, n = 34; externalizing disordered without depression, n = 30, and healthy controls, n = 34) participated in a novel reward striving task designed to activate the appetitive/approach motivation system. Objective facial expressions of emotion were videotaped and coded throughout both failure (i.e., nonreward) and control (success and reward) conditions. Observational coding of facial expressions as well as youths’ subjective emotion reports showed that the remitted depressed youth specifically exhibited more negative emotional reactivity to failure in the reward striving task, but not the control condition. Neither externalizing disordered (i.e., ADHD, CD, and/ or ODD) nor control youth displayed greater negative emotional reactivity in either the failure or control condition. Findings suggest that depression among youth is related to dysregulated appetitive motivation and associated negative emotional reactivity after failing to achieve an important, self-relevant goal and not attaining reward. These deficits in reward processing appear to be specific to depression as externalizing disordered youth did not display negative emotional reactivity to failure after their appetitive motivation system was activated. PMID:22901275

Appetitive motivation and negative emotion reactivity among remitted depressed youth.

PubMed

Hankin, Benjamin L; Wetter, Emily K; Flory, Kate

2012-01-01

Depression has been characterized as involving altered appetitive motivation and emotional reactivity. Yet no study has examined objective indices of emotional reactivity when the appetitive/approach system is suppressed in response to failure to attain a self-relevant goal and desired reward. Three groups of youth (N = 98, ages 9-15; remitted depressed, n = 34; externalizing disordered without depression, n = 30; and healthy controls, n = 34) participated in a novel reward striving task designed to activate the appetitive/approach motivation system. Objective facial expressions of emotion were videotaped and coded throughout both failure (i.e., nonreward) and control (success and reward) conditions. Observational coding of facial expressions as well as youths' subjective emotion reports showed that the remitted depressed youth specifically exhibited more negative emotional reactivity to failure in the reward striving task, but not the control condition. Neither externalizing disordered (i.e., attention deficit hyperactivity disorder, conduct disorder, and/or oppositional defiant disorder) nor control youth displayed greater negative emotional reactivity in either the failure or control condition. Findings suggest that depression among youth is related to dysregulated appetitive motivation and associated negative emotional reactivity after failing to achieve an important, self-relevant goal and not attaining reward. These deficits in reward processing appear to be specific to depression as externalizing disordered youth did not display negative emotional reactivity to failure after their appetitive motivation system was activated.

The roles of valuation and reward processing in cognitive function and psychiatric disorders

PubMed Central

Hélie, Sébastien; Shamloo, Farzin; Novak, Keisha; Foti, Dan

2017-01-01

In neuroeconomics, valuation refers to the process of assigning values to states and actions based on the animal’s current representation of the environment while reward processing corresponds to processing the feedback received from the environment to update the values of states and actions. In this article, we review the brain circuits associated with valuation and reward processing and argue that these are fundamental processes critical in many cognitive functions. Specifically, we focus on the role of valuation and reward processing in attention, memory, decision–making, and learning. Next, the extant neuroimaging literature on a number of psychiatric disorders is reviewed (i.e., addiction, pathological gambling, schizophrenia, and mood disorders), and an argument is made that associated deficits in cognitive functions can be explained in terms of abnormal valuation and reward processing. The review concludes with the impact of this framework in clinical settings and prescriptions for future research, in particular with regards to the conversions of qualitatively different valuation systems into a system of common currency. PMID:28415138

Dopamine homeostasis: brain functional connectivity in reward deficiency syndrome.

PubMed

Febo, Marcelo; Blum, Kenneth; Badgaiyan, Rajendra D; Baron, David; Thanos, Panayotis K; Colon-Perez, Luis M; Demortrovics, Zsolt; Gold, Mark S

2017-01-01

Reward deficiency syndrome (RDS) was first proposed by Kenneth Blum in 1995 to provide a clinically relevant and predictive term for conditions involving deficits in mesocorticolimbic dopamine function. Genetic, molecular, and neuronal alterations in key components of this circuitry contribute to a reward deficit state that can drive drug-seeking, consumption, and relapse. Among the dysfunctions observed in RDS are dysregulated resting state networks, which recently have been assessed in detail in chronic drug users by, positron emission tomography, functional magnetic resonance imaging, and functional connectivity analysis. A growing number of studies are helping to determine the putative roles of dopamine and glutamatergic neurotransmission in the regulation of activity in resting state networks, particularly in brain reward circuitry affected in drug use disorders. Indeed, we hypothesize in the present review that loss of homeostasis of these systems may lead to 'unbalanced' functional networks that might be both cause and outcome of disrupted synaptic communication between cortical and subcortical systems essential for controlling reward, emotional control, sensation seeking, and chronic drug use.

Distinct Roles of Opioid and Dopamine Systems in Lateral Hypothalamic Intracranial Self-Stimulation.

PubMed

Ide, Soichiro; Takahashi, Takehiro; Takamatsu, Yukio; Uhl, George R; Niki, Hiroaki; Sora, Ichiro; Ikeda, Kazutaka

2017-05-01

Opioid and dopamine systems play crucial roles in reward. Similarities and differences in the neural mechanisms of reward that are mediated by these 2 systems have remained largely unknown. Thus, in the present study, we investigated the differences in reward function in both µ-opioid receptor knockout mice and dopamine transporter knockout mice, important molecules in the opioid and dopamine systems. Mice were implanted with electrodes into the right lateral hypothalamus (l hour). Mice were then trained to put their muzzle into the hole in the head-dipping chamber for intracranial electrical stimulation, and the influences of gene knockout were assessed. Significant differences are observed between opioid and dopamine systems in reward function. µ-Opioid receptor knockout mice exhibited enhanced intracranial electrical stimulation, which induced dopamine release. They also exhibited greater motility under conditions of "despair" in both the tail suspension test and water wheel test. In contrast, dopamine transporter knockout mice maintained intracranial electrical stimulation responding even when more active efforts were required to obtain the reward. The absence of µ-opioid receptor or dopamine transporter did not lead to the absence of intracranial electrical stimulation responsiveness but rather differentially altered it. The present results in µ-opioid receptor knockout mice are consistent with the suppressive involvement of µ-opioid receptors in both positive incentive motivation associated with intracranial electrical stimulation and negative incentive motivation associated with depressive states. In contrast, the results in dopamine transporter knockout mice are consistent with the involvement of dopamine transporters in positive incentive motivation, especially its persistence. Differences in intracranial electrical stimulation in µ-opioid receptor and dopamine transporter knockout mice underscore the multidimensional nature of reward. © The Author 2016. Published by Oxford University Press on behalf of CINP.

To What Degree Does the Promotion System Reward Faculty Research Productivity?

ERIC Educational Resources Information Center

Tien, Flora F.

2007-01-01

This study explores the research question: Does the promotion system in Taiwan reward faculty research productivity? By conducting event history analyses, I have demonstrated that the simple answer to the question is "yes." After controlling for the effects of demography, education, institutions and seniority, the discrete-time logit…

48 CFR 915.404-4-71-1 - General.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 5 2010-10-01 2010-10-01 false General. 915.404-4-71-1 Section 915.404-4-71-1 Federal Acquisition Regulations System DEPARTMENT OF ENERGY CONTRACTING METHODS AND...) Reward contractors based on the complexity of work; (2) Reward contractors who demonstrate and establish...

WWC Quick Review of the Article "Culture and the Interaction of Student Ethnicity with Reward Structure in Group Learning" Revised

ERIC Educational Resources Information Center

What Works Clearinghouse, 2010

2010-01-01

This paper presents an updated WWC (What Works Clearinghouse) Review of the Article "Culture and the Interaction of Student Ethnicity with Reward Structure in Group Learning". The study examined the effects of different reward systems used in group learning situations on the math skills of African-American and White students. The…

WWC Review of the Article "Culture and the Interaction of Student Ethnicity with Reward Structure in Group Learning"

ERIC Educational Resources Information Center

What Works Clearinghouse, 2010

2010-01-01

"Culture and the Interaction of Student Ethnicity with Reward Structure in Group Learning" examined the effects of different reward systems used in group learning situations on the math skills of African-American and white students. The study analyzed data on 75 African-American and 57 white fourth- and fifth-grade students from urban…

A Stronger Profession through Appropriate Teacher Incentives.

ERIC Educational Resources Information Center

Mitchell, Douglas E.; Peters, Martha Jo

1988-01-01

Effective teacher incentive systems should reflect the principles that intrinsic rewards are more powerful than extrinsic ones and that encouraging collegiality is preferable to rewarding individual teachers. (Author/TE)

Decision Utility, Incentive Salience, and Cue-Triggered “Wanting”

PubMed Central

Berridge, Kent C.; Aldridge, J. Wayne

2010-01-01

This chapter examines brain mechanisms of reward utility operating at particular decision moments in life—moments such as when one encounters an image, sound, scent, or other cue associated in the past with a particular reward or perhaps just when one vividly imagines that cue. Such a cue can often trigger a sudden motivational urge to pursue its reward and sometimes a decision to do so. Drawing on a utility taxonomy that distinguishes among subtypes of reward utility—predicted utility, decision utility, experienced utility, and remembered utility—it is shown how cue-triggered cravings, such as an addict’s surrender to relapse, can hang on special transformations by brain mesolimbic systems of one utility subtype, namely, decision utility. The chapter focuses on a particular form of decision utility called incentive salience, a type of “wanting” for rewards that is amplified by brain mesolimbic systems. Sudden peaks of intensity of incentive salience, caused by neurobiological mechanisms, can elevate the decision utility of a particular reward at the moment its cue occurs. An understanding of what happens at such moments leads to a better understanding of the mechanisms at work in decision making in general. PMID:25309963

Comparing the effects of food restriction and overeating on brain reward systems.

PubMed

Avena, Nicole M; Murray, Susan; Gold, Mark S

2013-10-01

Both caloric restriction and overeating have been shown to affect neural processes associated with reinforcement. Both preclinical and some clinical studies have provided evidence that food restriction may increase reward sensitivity, and while there are mixed findings regarding the effects of overeating on reward sensitivity, there is strong evidence linking this behavior with changes in reward-related brain regions. Evidence of these changes comes in part from findings that show that such eating patterns are associated with increased drug use. The data discussed here regarding the differential effects of various eating patterns on reward systems may be particularly relevant to the aging population, as this population has been shown to exhibit altered reward sensitivity and decreased caloric consumption. Moreover, members of this population appear to be increasingly affected by the current obesity epidemic. Food, like alcohol or drugs, can stimulate its own consumption and produce similar neurochemical changes in the brain. Age-related loss of appetite, decreased eating, and caloric restriction are hypothesized to be associated with changes in the prevalence of substance misuse, abuse, and dependence seen in this cohort. Copyright © 2013 Elsevier Inc. All rights reserved.

Decision Utility, Incentive Salience, and Cue-Triggered "Wanting"

PubMed

Berridge, Kent C; Aldridge, J Wayne

2009-01-01

This chapter examines brain mechanisms of reward utility operating at particular decision moments in life-moments such as when one encounters an image, sound, scent, or other cue associated in the past with a particular reward or perhaps just when one vividly imagines that cue. Such a cue can often trigger a sudden motivational urge to pursue its reward and sometimes a decision to do so. Drawing on a utility taxonomy that distinguishes among subtypes of reward utility-predicted utility, decision utility, experienced utility, and remembered utility-it is shown how cue-triggered cravings, such as an addict's surrender to relapse, can hang on special transformations by brain mesolimbic systems of one utility subtype, namely, decision utility. The chapter focuses on a particular form of decision utility called incentive salience, a type of "wanting" for rewards that is amplified by brain mesolimbic systems. Sudden peaks of intensity of incentive salience, caused by neurobiological mechanisms, can elevate the decision utility of a particular reward at the moment its cue occurs. An understanding of what happens at such moments leads to a better understanding of the mechanisms at work in decision making in general.

Voluntary rewards mediate the evolution of pool punishment for maintaining public goods in large populations

NASA Astrophysics Data System (ADS)

Sasaki, Tatsuya; Uchida, Satoshi; Chen, Xiaojie

2015-03-01

Punishment is a popular tool when governing commons in situations where free riders would otherwise take over. It is well known that sanctioning systems, such as the police and courts, are costly and thus can suffer from those who free ride on other's efforts to maintain the sanctioning systems (second-order free riders). Previous game-theory studies showed that if populations are very large, pool punishment rarely emerges in public good games, even when participation is optional, because of second-order free riders. Here we show that a matching fund for rewarding cooperation leads to the emergence of pool punishment, despite the presence of second-order free riders. We demonstrate that reward funds can pave the way for a transition from a population of free riders to a population of pool punishers. A key factor in promoting the transition is also to reward those who contribute to pool punishment, yet not abstaining from participation. Reward funds eventually vanish in raising pool punishment, which is sustainable by punishing the second-order free riders. This suggests that considering the interdependence of reward and punishment may help to better understand the origins and transitions of social norms and institutions.

Voluntary rewards mediate the evolution of pool punishment for maintaining public goods in large populations.

PubMed

Sasaki, Tatsuya; Uchida, Satoshi; Chen, Xiaojie

2015-03-10

Punishment is a popular tool when governing commons in situations where free riders would otherwise take over. It is well known that sanctioning systems, such as the police and courts, are costly and thus can suffer from those who free ride on other's efforts to maintain the sanctioning systems (second-order free riders). Previous game-theory studies showed that if populations are very large, pool punishment rarely emerges in public good games, even when participation is optional, because of second-order free riders. Here we show that a matching fund for rewarding cooperation leads to the emergence of pool punishment, despite the presence of second-order free riders. We demonstrate that reward funds can pave the way for a transition from a population of free riders to a population of pool punishers. A key factor in promoting the transition is also to reward those who contribute to pool punishment, yet not abstaining from participation. Reward funds eventually vanish in raising pool punishment, which is sustainable by punishing the second-order free riders. This suggests that considering the interdependence of reward and punishment may help to better understand the origins and transitions of social norms and institutions.

Paralimbic system and striatum are involved in motivational behavior.

PubMed

Nishimura, Masahiko; Yoshii, Yoshihiko; Watanabe, Jobu; Ishiuchi, Shogo

2009-10-28

Goal-directed rewarded behavior and goal-directed non-rewarded behavior are concerned with motivation. However, the neural substrates involved in goal-directed non-rewarded behaviors are unknown. Using functional magnetic resonance imaging, we investigated the brain activities of healthy individuals during a novel tool use (turning a screwdriver) to elucidate the relationship between the brain mechanism relevant to goal-directed non-rewarded behavior and motivation. We found that our designed behavioral task evoked activities in the orbitofrontal cortex, striatum, anterior insula, lateral prefrontal cortex, and anterior cingulate cortex compared with a meaningless task. These results suggest that activation in these cerebral regions play important roles in motivational behavior without tangible rewards.

Will the "Fixes" Fall Flat? Prospects for Quality Measures and Payment Incentives to Control Healthcare Spending.

PubMed

Hauswald, Erik; Sklar, David

2017-04-01

Payment systems in the US healthcare system have rewarded physicians for services and attempted to control healthcare spending, with rewards and penalties based upon projected goals for future spending. The incorporation of quality goals and alternatives to fee-for-service was introduced to replace the previous system of rewards and penalties. We describe the history of the US healthcare payment system, focusing on Medicare and the efforts to control spending through the Sustainable Growth Rate. We describe the latest evolution of the payment system, which emphasizes quality measurement and alternative payment models. We conclude with suggestions for how to influence physician behavior through education and payment reform so that their behavior aligns with alternative care models to control spending in the future.

Fidelity of the representation of value in decision-making

PubMed Central

Dowding, Ben A.

2017-01-01

The ability to make optimal decisions depends on evaluating the expected rewards associated with different potential actions. This process is critically dependent on the fidelity with which reward value information can be maintained in the nervous system. Here we directly probe the fidelity of value representation following a standard reinforcement learning task. The results demonstrate a previously-unrecognized bias in the representation of value: extreme reward values, both low and high, are stored significantly more accurately and precisely than intermediate rewards. The symmetry between low and high rewards pertained despite substantially higher frequency of exposure to high rewards, resulting from preferential exploitation of more rewarding options. The observed variation in fidelity of value representation retrospectively predicted performance on the reinforcement learning task, demonstrating that the bias in representation has an impact on decision-making. A second experiment in which one or other extreme-valued option was omitted from the learning sequence showed that representational fidelity is primarily determined by the relative position of an encoded value on the scale of rewards experienced during learning. Both variability and guessing decreased with the reduction in the number of options, consistent with allocation of a limited representational resource. These findings have implications for existing models of reward-based learning, which typically assume defectless representation of reward value. PMID:28248958

Pervasive competition between threat and reward in the brain.

PubMed

Choi, Jong Moon; Padmala, Srikanth; Spechler, Philip; Pessoa, Luiz

2014-06-01

In the current functional MRI study, we investigated interactions between reward and threat processing. Visual cues at the start of each trial informed participants about the chance of winning monetary reward and/or receiving a mild aversive shock. We tested two competing hypothesis: according to the 'salience hypothesis', in the condition involving both reward and threat, enhanced activation would be observed because of increased salience; according to the 'competition hypothesis', the processing of reward and threat would trade-off against each other, leading to reduced activation. Analysis of skin conductance data during a delay phase revealed an interaction between reward and threat processing, such that the effect of reward was reduced during threat and the effect of threat was reduced during reward. Analysis of imaging data during the same task phase revealed interactions between reward and threat processing in several regions, including the midbrain/ventral tegmental area, caudate, putamen, bed nucleus of the stria terminalis, anterior insula, middle frontal gyrus and dorsal anterior cingulate cortex. Taken together, our findings reveal conditions during which reward and threat trade-off against each other across multiple sites. Such interactions are suggestive of competitive processes and may reflect the organization of opponent systems in the brain. © The Author (2013). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

The effects of expected reward on creative problem solving.

PubMed

Cristofori, Irene; Salvi, Carola; Beeman, Mark; Grafman, Jordan

2018-06-12

Creative problem solving involves search processes, and it is known to be hard to motivate. Reward cues have been found to enhance performance across a range of tasks, even when cues are presented subliminally, without being consciously detected. It is uncertain whether motivational processes, such as reward, can influence problem solving. We tested the effect of supraliminal and subliminal reward on participant performance on problem solving that can be solved by deliberate analysis or by insight. Forty-one participants attempted to solve 100 compound remote associate problems. At the beginning of each problem, a potential reward cue (1 or 25 cents) was displayed, either subliminally (17 ms) or supraliminally (100 ms). Participants earned the displayed reward if they solved the problem correctly. Results showed that the higher subliminal reward increased the percentage of problems solved correctly overall. Second, we explored if subliminal rewards preferentially influenced solutions that were achieved via a sudden insight (mostly processed below awareness) or via a deliberate analysis. Participants solved more problems via insight following high subliminal reward when compared with low subliminal reward, and compared with high supraliminal reward, with no corresponding effect on analytic solving. Striatal dopamine (DA) is thought to influence motivation, reinforce behavior, and facilitate cognition. We speculate that subliminal rewards activate the striatal DA system, enhancing the kinds of automatic integrative processes that lead to more creative strategies for problem solving, without increasing the selectivity of attention, which could impede insight.

The effect of pre- vs. post-reward attainment on EEG asymmetry in melancholic depression.

PubMed

Shankman, Stewart A; Sarapas, Casey; Klein, Daniel N

2011-02-01

Clinical investigators have long theorized about the role of reward processing and positive affect in depression. One theory posits that compared to nonmelancholic depressives, melancholic depressives experience less consummatory (i.e., post-reward), but comparably low anticipatory (prior to reward), positive affect. We tested whether frontal EEG asymmetry, a putative marker of the anticipatory reward system, is present only before an individual receives a reward or also after receiving a reward (i.e., during consummatory reward processing). We also examined whether melancholic depression, a condition characterized by a deficit in consummatory reward processing, is associated with abnormal EEG asymmetries in alpha band power. Effects in other frequency bands (delta, theta, or beta) were also explored. EEG was recorded in 34 controls, 48 nonmelancholic depressives, and 17 melancholic depressives during a slot machine task designed to elicit anticipatory and consummatory reward processing. Results indicated that, for alpha, the frontal EEG asymmetry of greater relative left activity was specific to anticipatory reward processing. During the consummatory phase, individuals with melancholic depression exhibited different posterior EEG asymmetries than individuals with nonmelancholic depression (and controls at a trend level). This second finding was largely due to melancholics exhibiting relatively lower right posterior activity and nonmelancholics exhibiting relatively lower left activity. These results suggest that a posterior asymmetry may be a marker for melancholic depression and aberrant consummatory reward processing. Copyright © 2010 Elsevier B.V. All rights reserved.

Divergent Relationship of Depression Severity to Social Reward Responses Among Patients with Bipolar Versus Unipolar Depression

PubMed Central

Sharma, Anup; Satterthwaite, Theodore D.; Vandekar, Lillie; Katchmar, Natalie; Daldal, Aylin; Ruparel, Kosha; A.Elliott, Mark; Baldassano, Claudia; Thase, Michael E.; Gur, Raquel E.; Kable, Joseph W.; Wolf, Daniel H.

2016-01-01

Neuroimaging studies of mood disorders demonstrate abnormalities in brain regions implicated in reward processing. However, there is a paucity of research investigating how social rewards affect reward circuit activity in these disorders. Here, we evaluated the relationship of both diagnostic category and dimensional depression severity to reward system function in bipolar and unipolar depression. In total, 86 adults were included, including 24 patients with bipolar depression, 24 patients with unipolar depression, and 38 healthy comparison subjects. Participants completed a social reward task during 3T BOLD fMRI. On average, diagnostic groups did not differ in activation to social reward. However, greater depression severity significantly correlated with reduced bilateral ventral striatum activation to social reward in the bipolar depressed group, but not the unipolar depressed group. In addition, decreased left orbitofrontal cortical activation correlated with more severe symptoms in bipolar depression, but not unipolar depression. These differential dimensional effects resulted in a significant voxelwise group by depression severity interaction. Taken together, these results provide initial evidence that deficits in social reward processing are differentially related to depression severity in the two disorders. PMID:27295401

Neural reward and punishment sensitivity in cigarette smokers.

PubMed

Potts, Geoffrey F; Bloom, Erika L; Evans, David E; Drobes, David J

2014-11-01

Nicotine addiction remains a major public health problem but the neural substrates of addictive behavior remain unknown. One characteristic of smoking behavior is impulsive choice, selecting the immediate reward of smoking despite the potential long-term negative consequences. This suggests that drug users, including cigarette smokers, may be more sensitive to rewards and less sensitive to punishment. We used event-related potentials (ERPs) to test the hypothesis that smokers are more responsive to reward signals and less responsive to punishment, potentially predisposing them to risky behavior. We conducted two experiments, one using a reward prediction design to elicit a Medial Frontal Negativity (MFN) and one using a reward- and punishment-motivated flanker task to elicit an Error Related Negativity (ERN), ERP components thought to index activity in the cortical projection of the dopaminergic reward system. The smokers had a greater MFN response to unpredicted rewards, and non-smokers, but not smokers, had a larger ERN on punishment motivated trials indicating that smokers are more reward sensitive and less punishment sensitive than nonsmokers, overestimating the appetitive value and underestimating aversive outcomes of stimuli and actions. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Leadership styles, emotion regulation, and burnout.

PubMed

Arnold, Kara A; Connelly, Catherine E; Walsh, Megan M; Martin Ginis, Kathleen A

2015-10-01

This study investigated the potential impact of leadership style on leaders' emotional regulation strategies and burnout. Drawing on the full-range model of leadership and Conservation of Resources (COR) theory, we tested whether transformational, contingent reward, management by exception-active and -passive, or laissez-faire leadership exert direct effects on leaders' reported use of surface acting, deep acting, and genuine emotion. In turn, we hypothesized and tested the indirect effect of leadership on burnout through surface acting. Three waves of data from 205 leaders were analyzed using OLS regression. Transformational leadership predicted deep acting and genuine emotion. Contingent reward predicted both surface and deep acting. Management by exception-active and -passive predicted surface acting, and laissez faire predicted genuine emotion. The indirect effects of management by exception-active and -passive on burnout through surface acting were not significant. Indirect effects of transformational leadership and laissez-faire on burnout through genuine emotion, however, were significant. This study provides empirical evidence for the hypothesized relationships between leadership style, emotion regulation, and burnout, and provides the basis for future research and theory building on this topic. (c) 2015 APA, all rights reserved).

"Liking" and "wanting" linked to Reward Deficiency Syndrome (RDS): hypothesizing differential responsivity in brain reward circuitry.

PubMed

Blum, Kenneth; Gardner, Eliot; Oscar-Berman, Marlene; Gold, Mark

2012-01-01

In an attempt to resolve controversy regarding the causal contributions of mesolimbic dopamine (DA) systems to reward, we evaluate the three main competing explanatory categories: "liking,"learning," and "wanting" [1]. That is, DA may mediate (a) the hedonic impact of reward (liking), (b) learned predictions about rewarding effects (learning), or (c) the pursuit of rewards by attributing incentive salience to reward-related stimuli (wanting). We evaluate these hypotheses, especially as they relate to the Reward Deficiency Syndrome (RDS), and we find that the incentive salience or "wanting" hypothesis of DA function is supported by a majority of the evidence. Neuroimaging studies have shown that drugs of abuse, palatable foods, and anticipated behaviors such as sex and gaming affect brain regions involving reward circuitry, and may not be unidirectional. Drugs of abuse enhance DA signaling and sensitize mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Addictive drugs have in common that they are voluntarily selfadministered, they enhance (directly or indirectly) dopaminergic synaptic function in the nucleus accumbens (NAC), and they stimulate the functioning of brain reward circuitry (producing the "high" that drug users seek). Although originally believed simply to encode the set point of hedonic tone, these circuits now are believed to be functionally more complex, also encoding attention, reward expectancy, disconfirmation of reward expectancy, and incentive motivation. Elevated stress levels, together with polymorphisms of dopaminergic genes and other neurotransmitter genetic variants, may have a cumulative effect on vulnerability to addiction. The RDS model of etiology holds very well for a variety of chemical and behavioral addictions.

Effects of Motivation: Rewarding Hackers for Undetected Attacks Cause Analysts to Perform Poorly.

PubMed

Maqbool, Zahid; Makhijani, Nidhi; Pammi, V S Chandrasekhar; Dutt, Varun

2017-05-01

The aim of this study was to determine how monetary motivations influence decision making of humans performing as security analysts and hackers in a cybersecurity game. Cyberattacks are increasing at an alarming rate. As cyberattacks often cause damage to existing cyber infrastructures, it is important to understand how monetary rewards may influence decision making of hackers and analysts in the cyber world. Currently, only limited attention has been given to this area. In an experiment, participants were randomly assigned to three between-subjects conditions ( n = 26 for each condition): equal payoff, where the magnitude of monetary rewards for hackers and defenders was the same; rewarding hacker, where the magnitude of monetary reward for hacker's successful attack was 10 times the reward for analyst's successful defense; and rewarding analyst, where the magnitude of monetary reward for analyst's successful defense was 10 times the reward for hacker's successful attack. In all conditions, half of the participants were human hackers playing against Nash analysts and half were human analysts playing against Nash hackers. Results revealed that monetary rewards for human hackers and analysts caused a decrease in attack and defend actions compared with the baseline. Furthermore, rewarding human hackers for undetected attacks made analysts deviate significantly from their optimal behavior. If hackers are rewarded for their undetected attack actions, then this causes analysts to deviate from optimal defend proportions. Thus, analysts need to be trained not become overenthusiastic in defending networks. Applications of our results are to networks where the influence of monetary rewards may cause information theft and system damage.

Aberrant mesolimbic dopamine-opiate interaction in obesity.

PubMed

Tuominen, Lauri; Tuulari, Jetro; Karlsson, Henry; Hirvonen, Jussi; Helin, Semi; Salminen, Paulina; Parkkola, Riitta; Hietala, Jarmo; Nuutila, Pirjo; Nummenmaa, Lauri

2015-11-15

Dopamine and opioid neurotransmitter systems share many functions such as regulation of reward and pleasure. μ-Opioid receptors (MOR) modulate the mesolimbic dopamine system in ventral tegmental area and striatum, key areas implicated in reward. We hypothesized that dopamine and opioid receptor availabilities correlate in vivo and that this correlation is altered in obesity, a disease with altered reward processing. Twenty lean females (mean BMI 22) and 25 non-binge eating morbidly obese females (mean BMI 41) underwent two positron emission tomography scans with [(11)C]carfentanil and [(11)C]raclopride to measure the MOR and dopamine D2 receptor (DRD2) availability, respectively. In lean subjects, the MOR and DRD2 availabilities were positively associated in the ventral striatum (r=0.62, p=0.003) and dorsal caudate nucleus (r=0.62, p=0.004). Moreover, DRD2 availability in the ventral striatum was associated with MOR availability in other regions of the reward circuitry, particularly in the ventral tegmental area. In morbidly obese subjects, this receptor interaction was significantly weaker in ventral striatum but unaltered in the caudate nucleus. Finally, the association between DRD2 availability in the ventral striatum and MOR availability in the ventral tegmental area was abolished in the morbidly obese. The study demonstrates a link between DRD2 and MOR availabilities in living human brain. This interaction is selectively disrupted in mesolimbic dopamine system in morbid obesity. We propose that interaction between the dopamine and opioid systems is a prerequisite for normal reward processing and that disrupted cross-talk may underlie altered reward processing in obesity. Copyright © 2015 Elsevier Inc. All rights reserved.

Müllerian and Batesian mimicry out, Darwinian and Wallacian mimicry in, for rewarding/rewardless flowers.

PubMed

Lev-Yadun, Simcha

2018-06-11

Müllerian and Batesian mimicry were originally defined in defensive (anti-predetory) animal systems. Later these terms were adopted by botanists studying pollination that defined rewarding flowers as Müllerian mimics and rewardless flowers as Batesian mimics. The use of these terms concerning pollination predated our recent understanding of how common plant aposematism is and the related defensive Müllerian and Batesian mimicry types. Being non-defensive, using the terms Müllerian and Batesian mimicry for rewarding/rewardless flowers is, however, confusing if not misleading, and is also logically inappropriate. I suggest to first stop using the terms Batesian and Müllerian mimicry concerning rewarding/rewardless flowers and pollination, and second, to define the guild of flowers that reward pollinatiors as Darwinian mimics and those that do not reward pollinators as Wallacian mimics.

Gender Dimorphism of Brain Reward System Volumes in Alcoholism

PubMed Central

Sawyer, Kayle S.; Oscar-Berman, Marlene; Barthelemy, Olivier J.; Papadimitriou, George M.; Harris, Gordon J.; Makris, Nikos

2017-01-01

The brain's reward network has been reported to be smaller in alcoholic men compared to nonalcoholic men, but little is known about the volumes of reward regions in alcoholic women. Morphometric analyses were performed on magnetic resonance brain scans of 60 long-term chronic alcoholics (ALC; 30 men) and 60 nonalcoholic controls (NC; 29 men). We derived volumes of total brain, and cortical and subcortical reward-related structures including the dorsolateral prefrontal (DLPFC), orbitofrontal, and cingulate cortices, and the temporal pole, insula, amygdala, hippocampus, nucleus accumbens septi (NAc), and ventral diencephalon (VDC). We examined the relationships of the volumetric findings to drinking history. Analyses revealed a significant gender interaction for the association between alcoholism and total reward network volumes, with ALC men having smaller reward volumes than NC men and ALC women having larger reward volumes than NC women. Analyses of a priori subregions revealed a similar pattern of reward volume differences with significant gender interactions for DLPFC and VDC. Overall, the volume of the cerebral ventricles in ALC participants was negatively associated with duration of abstinence, suggesting decline in atrophy over time. PMID:28285206

Statistical Mechanics of the Delayed Reward-Based Learning with Node Perturbation

NASA Astrophysics Data System (ADS)

Hiroshi Saito,; Kentaro Katahira,; Kazuo Okanoya,; Masato Okada,

2010-06-01

In reward-based learning, reward is typically given with some delay after a behavior that causes the reward. In machine learning literature, the framework of the eligibility trace has been used as one of the solutions to handle the delayed reward in reinforcement learning. In recent studies, the eligibility trace is implied to be important for difficult neuroscience problem known as the “distal reward problem”. Node perturbation is one of the stochastic gradient methods from among many kinds of reinforcement learning implementations, and it searches the approximate gradient by introducing perturbation to a network. Since the stochastic gradient method does not require a objective function differential, it is expected to be able to account for the learning mechanism of a complex system, like a brain. We study the node perturbation with the eligibility trace as a specific example of delayed reward-based learning, and analyzed it using a statistical mechanics approach. As a result, we show the optimal time constant of the eligibility trace respect to the reward delay and the existence of unlearnable parameter configurations.

Dopamine receptor blockade attenuates the general incentive motivational effects of noncontingently delivered rewards and reward-paired cues without affecting their ability to bias action selection.

PubMed

Ostlund, Sean B; Maidment, Nigel T

2012-01-01

Environmental cues affect our behavior in a variety of ways. Despite playing an invaluable role in guiding our daily activities, such cues also appear to trigger the harmful, compulsive behaviors that characterize addiction and other disorders of behavioral control. In instrumental conditioning, rewards and reward-paired cues bias action selection and invigorate reward-seeking behaviors, and appear to do so through distinct neurobehavioral processes. Although reward-paired cues are known to invigorate performance through a dopamine-dependent incentive motivational process, it is not known if dopamine also mediates the influence of rewards and reward-paired cues over action selection. The current study contrasted the effects of systemic administration of the nonspecific dopamine receptor antagonist flupentixol on response invigoration and action bias in Pavlovian-instrumental transfer, a test of cue-elicited responding, and in instrumental reinstatement, a test of noncontingent reward-elicited responding. Hungry rats were trained on two different stimulus-outcome relationships (eg, tone-grain pellets and noise-sucrose solution) and two different action-outcome relationships (eg, left press-grain and right press-sucrose). At test, we found that flupentixol pretreatment blocked the response invigoration generated by the cues but spared their ability to bias action selection to favor the action whose outcome was signaled by the cue being presented. The response-biasing influence of noncontingent reward deliveries was also unaffected by flupentixol. Interestingly, although flupentixol had a modest effect on the immediate response invigoration produced by those rewards, it was particularly potent in countering the lingering enhancement of responding produced by multiple reward deliveries. These findings indicate that dopamine mediates the general incentive motivational effects of noncontingent rewards and reward-paired cues but does not support their ability to bias action selection.

Drug-sensitive reward in crayfish: an invertebrate model system for the study of SEEKING, reward, addiction, and withdrawal.

PubMed

Huber, Robert; Panksepp, Jules B; Nathaniel, Thomas; Alcaro, Antonio; Panksepp, Jaak

2011-10-01

In mammals, rewarding properties of drugs depend on their capacity to activate appetitive motivational states. With the underlying mechanisms strongly conserved in evolution, invertebrates have recently emerged as a powerful new model in addiction research. In crayfish natural reward has proven surprisingly sensitive to human drugs of abuse, opening an unlikely avenue of research into the basic biological mechanisms of drug addiction. In a series of studies we first examined the presence of natural reward systems in crayfish, then characterized its sensitivity to a wide range of human drugs of abuse. A conditioned place preference (CPP) paradigm was used to demonstrate that crayfish seek out those environments that had previously been paired with the psychostimulants cocaine and amphetamine, and the opioid morphine. The administration of amphetamine exerted its effects at a number of sites, including the stimulation of circuits for active exploratory behaviors (i.e., SEEKING). A further study examined morphine-induced reward, extinction and reinstatement in crayfish. Repeated intra-circulatory infusions of morphine served as a reward when paired with distinct visual or tactile cues. Morphine-induced CPP was extinguished after repeated saline injections. Following this extinction phase, morphine-experienced crayfish were once again challenged with the drug. The priming injections of morphine reinstated CPP at all tested doses, suggesting that morphine-induced CPP is unrelenting. In an exploration of drug-associated behavioral sensitization in crayfish we concurrently mapped measures of locomotion and rewarding properties of morphine. Single and repeated intra-circulatory infusions of morphine resulted in persistent locomotory sensitization, even 5 days following the infusion. Moreover, a single dose of morphine was sufficient to induce long-term behavioral sensitization. CPP for morphine and context-dependent cues could not be disrupted over a drug free period of 5 days. This work demonstrates that crayfish offer a comparative and complementary approach in addiction research. Serving as an invertebrate animal model for the exposure to mammalian drugs of abuse, modularly organized and experimentally accessible nervous systems render crayfish uniquely suited for studying (1) the basic biological mechanisms of drug effects, (2) to explore how the appetitive/seeking disposition is implemented in a simple neural system, and (3) how such a disposition is related to the rewarding action of drugs of abuse. This work aimed to contribute an evolutionary, comparative context to our understanding of a key component in learning, and of natural reward as an important life-sustaining process. Copyright © 2010 Elsevier Ltd. All rights reserved.

Learning to reach by reinforcement learning using a receptive field based function approximation approach with continuous actions.

PubMed

Tamosiunaite, Minija; Asfour, Tamim; Wörgötter, Florentin

2009-03-01

Reinforcement learning methods can be used in robotics applications especially for specific target-oriented problems, for example the reward-based recalibration of goal directed actions. To this end still relatively large and continuous state-action spaces need to be efficiently handled. The goal of this paper is, thus, to develop a novel, rather simple method which uses reinforcement learning with function approximation in conjunction with different reward-strategies for solving such problems. For the testing of our method, we use a four degree-of-freedom reaching problem in 3D-space simulated by a two-joint robot arm system with two DOF each. Function approximation is based on 4D, overlapping kernels (receptive fields) and the state-action space contains about 10,000 of these. Different types of reward structures are being compared, for example, reward-on- touching-only against reward-on-approach. Furthermore, forbidden joint configurations are punished. A continuous action space is used. In spite of a rather large number of states and the continuous action space these reward/punishment strategies allow the system to find a good solution usually within about 20 trials. The efficiency of our method demonstrated in this test scenario suggests that it might be possible to use it on a real robot for problems where mixed rewards can be defined in situations where other types of learning might be difficult.

CRF1 receptor-deficiency increases cocaine reward.

PubMed

Contarino, Angelo; Kitchener, Pierre; Vallée, Monique; Papaleo, Francesco; Piazza, Pier-Vincenzo

2017-05-01

Stimulant drugs produce reward but also activate stress-responsive systems. The corticotropin-releasing factor (CRF) and the related hypothalamus-pituitary-adrenal (HPA) axis stress-responsive systems are activated by stimulant drugs. However, their role in stimulant drug-induced reward remains poorly understood. Herein, we report that CRF 1 receptor-deficient (CRF 1 -/-), but not wild-type, mice show conditioned place preference (CPP) responses to a relatively low cocaine dose (5 mg/kg, i.p.). Conversely, wild-type, but not CRF 1 -/-, mice display CPP responses to a relatively high cocaine dose (20 mg/kg, i.p.), indicating that CRF 1 receptor-deficiency alters the rewarding effects of cocaine. Acute pharmacological antagonism of the CRF 1 receptor by antalarmin also eliminates cocaine reward. Nevertheless, CRF 1 -/- mice display higher stereotypy responses to cocaine than wild-type mice. Despite the very low plasma corticosterone concentration, CRF 1 -/- mice show higher nuclear glucocorticoid receptor (GR) levels in the brain region of the hippocampus than wild-type mice. Full rescue of wild-type-like corticosterone and GR circadian rhythm and level in CRF 1 -/- mice by exogenous corticosterone does not affect CRF 1 receptor-dependent cocaine reward but induces stereotypy responses to cocaine. These results indicate a critical role for the CRF 1 receptor in cocaine reward, independently of the closely related HPA axis activity. Copyright © 2017 Elsevier Ltd. All rights reserved.

The 3Rs of Productivity Improvement: Responsibility, Recognition, Reward.

ERIC Educational Resources Information Center

Training, 1979

1979-01-01

Describes the American Production Center and a productivity improvement system in which people become part of the productivity solution when given responsibility, recognition, and reward for productivity improvement. (LRA)

Research Review: altered reward function in adolescent depression: what, when and how?

PubMed

Forbes, Erika E; Dahl, Ronald E

2012-01-01

Conceptual models and recent evidence indicate that neural response to reward is altered in depression. Taking a developmental approach to investigating reward function in adolescent depression can elucidate the etiology, pathophysiology and course of depression, a disorder that typically begins during adolescence and has high rates of recurrence. This conceptual review describes the what, when and how of altered reward function in adolescent depression. With the goal of generating new, testable hypotheses within a developmental affective neuroscience framework, we critically review findings and suggest future directions. Peer-reviewed empirical papers for inclusion in this critical review were obtained by searching PubMed, PsycInfo and ScienceDirect for the years 1990-2010. A pattern of low striatal response and high medial prefrontal response to reward is evident in adolescents and adults with depression. Given the salience of social stimuli for positive affect and depression, reward function might be especially disrupted in response to social rewards. Because of changes in the dopamine system and reward function with aging, altered reward function in depression might be more evident during adolescence than later in life; however, low reward function may also be a stable characteristic of people who experience depression. Mechanisms of altered reward function in depression could include disrupted balance of corticostriatal circuit function, with disruption occurring as aberrant adolescent brain development. Future studies should examine responses to social rewards; employ longitudinal and prospective designs; and investigate patterns of functional connectivity in reward circuits. Understanding altered reward function in depression has potential implications for treatment development. A more rigorous approach to investigating anhedonia, threat-reward interactions and comorbid anxiety will be valuable to future progress in describing the role of reward function in the pathophysiology of depression. © 2011 The Authors. Journal of Child Psychology and Psychiatry © 2011 Association for Child and Adolescent Mental Health.

Activation of the GLP-1 receptors in the nucleus of the solitary tract reduces food reward behavior and targets the mesolimbic system.

PubMed

Richard, Jennifer E; Anderberg, Rozita H; Göteson, Andreas; Gribble, Fiona M; Reimann, Frank; Skibicka, Karolina P

2015-01-01

The gut/brain peptide, glucagon like peptide 1 (GLP-1), suppresses food intake by acting on receptors located in key energy balance regulating CNS areas, the hypothalamus or the hindbrain. Moreover, GLP-1 can reduce reward derived from food and motivation to obtain food by acting on its mesolimbic receptors. Together these data suggest a neuroanatomical segregation between homeostatic and reward effects of GLP-1. Here we aim to challenge this view and hypothesize that GLP-1 can regulate food reward behavior by acting directly on the hindbrain, the nucleus of the solitary tract (NTS), GLP-1 receptors (GLP-1R). Using two models of food reward, sucrose progressive ratio operant conditioning and conditioned place preference for food in rats, we show that intra-NTS microinjections of GLP-1 or Exendin-4, a stable analogue of GLP-1, inhibit food reward behavior. When the rats were given a choice between palatable food and chow, intra-NTS Exendin-4 treatment preferentially reduced intake of palatable food but not chow. However, chow intake and body weight were reduced by the NTS GLP-1R activation if chow was offered alone. The NTS GLP-1 activation did not alter general locomotor activity and did not induce nausea, measured by PICA. We further show that GLP-1 fibers are in close apposition to the NTS noradrenergic neurons, which were previously shown to provide a monosynaptic connection between the NTS and the mesolimbic system. Central GLP-1R activation also increased NTS expression of dopamine-β-hydroxylase, a key enzyme in noradrenaline synthesis, indicating a biological link between these two systems. Moreover, NTS GLP-1R activation altered the expression of dopamine-related genes in the ventral tegmental area. These data reveal a food reward-suppressing role of the NTS GLP-1R and indicate that the neurobiological targets underlying food reward control are not limited to the mesolimbic system, instead they are distributed throughout the CNS.

A Learning Theory for Reward-Modulated Spike-Timing-Dependent Plasticity with Application to Biofeedback

PubMed Central

Maass, Wolfgang

2008-01-01

Reward-modulated spike-timing-dependent plasticity (STDP) has recently emerged as a candidate for a learning rule that could explain how behaviorally relevant adaptive changes in complex networks of spiking neurons could be achieved in a self-organizing manner through local synaptic plasticity. However, the capabilities and limitations of this learning rule could so far only be tested through computer simulations. This article provides tools for an analytic treatment of reward-modulated STDP, which allows us to predict under which conditions reward-modulated STDP will achieve a desired learning effect. These analytical results imply that neurons can learn through reward-modulated STDP to classify not only spatial but also temporal firing patterns of presynaptic neurons. They also can learn to respond to specific presynaptic firing patterns with particular spike patterns. Finally, the resulting learning theory predicts that even difficult credit-assignment problems, where it is very hard to tell which synaptic weights should be modified in order to increase the global reward for the system, can be solved in a self-organizing manner through reward-modulated STDP. This yields an explanation for a fundamental experimental result on biofeedback in monkeys by Fetz and Baker. In this experiment monkeys were rewarded for increasing the firing rate of a particular neuron in the cortex and were able to solve this extremely difficult credit assignment problem. Our model for this experiment relies on a combination of reward-modulated STDP with variable spontaneous firing activity. Hence it also provides a possible functional explanation for trial-to-trial variability, which is characteristic for cortical networks of neurons but has no analogue in currently existing artificial computing systems. In addition our model demonstrates that reward-modulated STDP can be applied to all synapses in a large recurrent neural network without endangering the stability of the network dynamics. PMID:18846203

Fat and lean tissue accretion in relation to reward motivation in children.

PubMed

De Decker, Annelies; De Clercq, Bart; Verbeken, Sandra; Wells, Jonathan C K; Braet, Caroline; Michels, Nathalie; De Henauw, Stefaan; Sioen, Isabelle

2017-01-01

'Reward sensitivity' explains inter-individual differences in the motivation to obtain rewards when reward cues are perceived. This psychobiological trait has been linked to higher consumption of palatable food when exposed to palatable food cues. The current study aims to examine if reward sensitivity explains differences in patterns of fat and lean tissue accretion over time in children. A longitudinal observational study with measurement waves in 2011 (baseline), 2012, 2013, and 2015 was conducted. The sample was a population-based Flemish cohort of children (n = 446, 50% boys and 5.5-12 years at baseline; 38.8% of the baseline sample also participated in 2015). Baseline reward sensitivity of the children was assessed by parent ratings on the Drive subscale of the Behavioral Inhibition System/Behavioral Approach System scales. Age- and sex-independent Fat and Lean Mass Index z-scores (zFMI and zLMI respectively) were computed for each study wave based on air-displacement plethysmography. In girls, but not boys, reward sensitivity was positively associated with the baseline zFMI and zLMI (95% confidence intervals of unstandardized estimates: 0.01 to 0.11 and 0.01 to 0.10 respectively, P values 0.01 and 0.02 respectively). Further, reward sensitivity explained 14.8% and 11.6% of the change in girls' zFMI and zLMI respectively over four years: the zFMI and zLMI increased and decreased respectively in high reward sensitive girls (95% confidence intervals of unstandardized estimates: 0.01 to 0.11 and -0.12 to -0.01 respectively, P values 0.01 and 0.02 respectively). Hence, girls high in reward sensitivity had significantly higher adiposity gain over four years parallel with lower increase in lean mass than was expected on the basis of their age and height. These results may help to identify appropriate targets for interventions for obesity prevention. Copyright © 2016 Elsevier Ltd. All rights reserved.

Reported maternal tendencies predict the reward value of infant facial cuteness, but not cuteness detection

PubMed Central

Hahn, Amanda C.; DeBruine, Lisa M.; Jones, Benedict C.

2015-01-01

The factors that contribute to individual differences in the reward value of cute infant facial characteristics are poorly understood. Here we show that the effect of cuteness on a behavioural measure of the reward value of infant faces is greater among women reporting strong maternal tendencies. By contrast, maternal tendencies did not predict women's subjective ratings of the cuteness of these infant faces. These results show, for the first time, that the reward value of infant facial cuteness is greater among women who report being more interested in interacting with infants, implicating maternal tendencies in individual differences in the reward value of infant cuteness. Moreover, our results indicate that the relationship between maternal tendencies and the reward value of infant facial cuteness is not due to individual differences in women's ability to detect infant cuteness. This latter result suggests that individual differences in the reward value of infant cuteness are not simply a by-product of low-cost, functionless biases in the visual system. PMID:25740842

Who, what, where, when (and maybe even why)? How the experience of sexual reward connects sexual desire, preference, and performance.

PubMed

Pfaus, James G; Kippin, Tod E; Coria-Avila, Genaro A; Gelez, Hélène; Afonso, Veronica M; Ismail, Nafissa; Parada, Mayte

2012-02-01

Although sexual behavior is controlled by hormonal and neurochemical actions in the brain, sexual experience induces a degree of plasticity that allows animals to form instrumental and Pavlovian associations that predict sexual outcomes, thereby directing the strength of sexual responding. This review describes how experience with sexual reward strengthens the development of sexual behavior and induces sexually-conditioned place and partner preferences in rats. In both male and female rats, early sexual experience with partners scented with a neutral or even noxious odor induces a preference for scented partners in subsequent choice tests. Those preferences can also be induced by injections of morphine or oxytocin paired with a male rat's first exposure to scented females, indicating that pharmacological activation of opioid or oxytocin receptors can "stand in" for the sexual reward-related neurochemical processes normally activated by sexual stimulation. Conversely, conditioned place or partner preferences can be blocked by the opioid receptor antagonist naloxone. A somatosensory cue (a rodent jacket) paired with sexual reward comes to elicit sexual arousal in male rats, such that paired rats with the jacket off show dramatic copulatory deficits. We propose that endogenous opioid activation forms the basis of sexual reward, which also sensitizes hypothalamic and mesolimbic dopamine systems in the presence of cues that predict sexual reward. Those systems act to focus attention on, and activate goal-directed behavior toward, reward-related stimuli. Thus, a critical period exists during an individual's early sexual experience that creates a "love map" or Gestalt of features, movements, feelings, and interpersonal interactions associated with sexual reward.

Reward system and temporal pole contributions to affective evaluation during a first person shooter video game

PubMed Central

2011-01-01

Background Violent content in video games evokes many concerns but there is little research concerning its rewarding aspects. It was demonstrated that playing a video game leads to striatal dopamine release. It is unclear, however, which aspects of the game cause this reward system activation and if violent content contributes to it. We combined functional Magnetic Resonance Imaging (fMRI) with individual affect measures to address the neuronal correlates of violence in a video game. Results Thirteen male German volunteers played a first-person shooter game (Tactical Ops: Assault on Terror) during fMRI measurement. We defined success as eliminating opponents, and failure as being eliminated themselves. Affect was measured directly before and after game play using the Positive and Negative Affect Schedule (PANAS). Failure and success events evoked increased activity in visual cortex but only failure decreased activity in orbitofrontal cortex and caudate nucleus. A negative correlation between negative affect and responses to failure was evident in the right temporal pole (rTP). Conclusions The deactivation of the caudate nucleus during failure is in accordance with its role in reward-prediction error: it occurred whenever subject missed an expected reward (being eliminated rather than eliminating the opponent). We found no indication that violence events were directly rewarding for the players. We addressed subjective evaluations of affect change due to gameplay to study the reward system. Subjects reporting greater negative affect after playing the game had less rTP activity associated with failure. The rTP may therefore be involved in evaluating the failure events in a social context, to regulate the players' mood. PMID:21749711

Failure analysis and modeling of a VAXcluster system

NASA Technical Reports Server (NTRS)

Tang, Dong; Iyer, Ravishankar K.; Subramani, Sujatha S.

1990-01-01

This paper discusses the results of a measurement-based analysis of real error data collected from a DEC VAXcluster multicomputer system. In addition to evaluating basic system dependability characteristics such as error and failure distributions and hazard rates for both individual machines and for the VAXcluster, reward models were developed to analyze the impact of failures on the system as a whole. The results show that more than 46 percent of all failures were due to errors in shared resources. This is despite the fact that these errors have a recovery probability greater than 0.99. The hazard rate calculations show that not only errors, but also failures occur in bursts. Approximately 40 percent of all failures occur in bursts and involved multiple machines. This result indicates that correlated failures are significant. Analysis of rewards shows that software errors have the lowest reward (0.05 vs 0.74 for disk errors). The expected reward rate (reliability measure) of the VAXcluster drops to 0.5 in 18 hours for the 7-out-of-7 model and in 80 days for the 3-out-of-7 model.

White Matter Correlates of Musical Anhedonia: Implications for Evolution of Music.

PubMed

Loui, Psyche; Patterson, Sean; Sachs, Matthew E; Leung, Yvonne; Zeng, Tima; Przysinda, Emily

2017-01-01

Recent theoretical advances in the evolution of music posit that affective communication is an evolutionary function of music through which the mind and brain are transformed. A rigorous test of this view should entail examining the neuroanatomical mechanisms for affective communication of music, specifically by comparing individual differences in the general population with a special population who lacks specific affective responses to music. Here we compare white matter connectivity in BW, a case with severe musical anhedonia, with a large sample of control subjects who exhibit normal variability in reward sensitivity to music. We show for the first time that structural connectivity within the reward system can predict individual differences in musical reward in a large population, but specific patterns in connectivity between auditory and reward systems are special in an extreme case of specific musical anhedonia. Results support and extend the Mixed Origins of Music theory by identifying multiple neural pathways through which music might operate as an affective signaling system.

White Matter Correlates of Musical Anhedonia: Implications for Evolution of Music

PubMed Central

Loui, Psyche; Patterson, Sean; Sachs, Matthew E.; Leung, Yvonne; Zeng, Tima; Przysinda, Emily

2017-01-01

Recent theoretical advances in the evolution of music posit that affective communication is an evolutionary function of music through which the mind and brain are transformed. A rigorous test of this view should entail examining the neuroanatomical mechanisms for affective communication of music, specifically by comparing individual differences in the general population with a special population who lacks specific affective responses to music. Here we compare white matter connectivity in BW, a case with severe musical anhedonia, with a large sample of control subjects who exhibit normal variability in reward sensitivity to music. We show for the first time that structural connectivity within the reward system can predict individual differences in musical reward in a large population, but specific patterns in connectivity between auditory and reward systems are special in an extreme case of specific musical anhedonia. Results support and extend the Mixed Origins of Music theory by identifying multiple neural pathways through which music might operate as an affective signaling system. PMID:28993748

Workload-Based Automated Interface Mode Selection

DTIC Science & Technology

2012-03-22

Process . . . . . . . . . . . . . . . . . . . . . 31 3.5.10 Agent Reward Function . . . . . . . . . . . . . . . . 31 3.5.11 Accelerated Learning... Strategies . . . . . . . . . . . . 31 4. Experimental Methodology . . . . . . . . . . . . . . . . . . . . . . . . 33 4.1 System Engineering Methodology...26 5. Agent state function. . . . . . . . . . . . . . . . . . . . . . . . . . . 28 6. Agent reward function

Developing a Comprehensive Reward System.

ERIC Educational Resources Information Center

Votruba, James C.

1979-01-01

Providing incentives for teachers of adults is an important means of attracting, retaining, and stimulating staff. Developing a variety of extrinsic and intrinsic rewards and incentives and instituting them effectively are important administrative functions. (SK)

Phasic dopamine as a prediction error of intrinsic and extrinsic reinforcements driving both action acquisition and reward maximization: a simulated robotic study.

PubMed

Mirolli, Marco; Santucci, Vieri G; Baldassarre, Gianluca

2013-03-01

An important issue of recent neuroscientific research is to understand the functional role of the phasic release of dopamine in the striatum, and in particular its relation to reinforcement learning. The literature is split between two alternative hypotheses: one considers phasic dopamine as a reward prediction error similar to the computational TD-error, whose function is to guide an animal to maximize future rewards; the other holds that phasic dopamine is a sensory prediction error signal that lets the animal discover and acquire novel actions. In this paper we propose an original hypothesis that integrates these two contrasting positions: according to our view phasic dopamine represents a TD-like reinforcement prediction error learning signal determined by both unexpected changes in the environment (temporary, intrinsic reinforcements) and biological rewards (permanent, extrinsic reinforcements). Accordingly, dopamine plays the functional role of driving both the discovery and acquisition of novel actions and the maximization of future rewards. To validate our hypothesis we perform a series of experiments with a simulated robotic system that has to learn different skills in order to get rewards. We compare different versions of the system in which we vary the composition of the learning signal. The results show that only the system reinforced by both extrinsic and intrinsic reinforcements is able to reach high performance in sufficiently complex conditions. Copyright © 2013 Elsevier Ltd. All rights reserved.

Reward processing by the lateral habenula in normal and depressive behaviors

PubMed Central

Proulx, Christophe D.; Hikosaka, Okihide; Malinow, Roberto

2015-01-01

The brain reward circuit has a central role in reinforcing behaviors that are rewarding and preventing behaviors that lead to punishment. Recent work has shown that the lateral habenula is an important part of the reward circuit by providing ‘negative value’ signals to the dopaminergic and serotonergic systems. Studies also suggest that dysfunction of the lateral habenula is associated with psychiatric disorders including major depression. In this review, we first discuss insights gained from neuronal recordings in monkeys regarding how the lateral habenula processes reward-related information. We next highlight recent optogenetic experiments in rodents addressing normal and abnormal functions of the habenula. Finally, we discuss how deregulation of the lateral habenula may play a role in depressive behaviors. PMID:25157511

Relationship between effort-reward imbalance and hair cortisol concentration in female kindergarten teachers.

PubMed

Qi, Xingliang; Zhang, Jing; Liu, Yapeng; Ji, Shuang; Chen, Zheng; Sluiter, Judith K; Deng, Huihua

2014-04-01

The present study aims to investigate the relationship between effort-reward imbalance and hair cortisol concentration among teachers to examine whether hair cortisol can be a biomarker of chronic work stress. Hair samples were collected from 39 female teachers from three kindergartens. Cortisol was extracted from the hair samples with methanol, and cortisol concentrations were measured with high performance liquid chromatography-tandem mass spectrometry. Work stress was measured using the effort-reward imbalance scale. The ratio of effort to reward showed significantly positive association with hair cortisol concentration. The cortisol concentration in the system increases with the effort-reward imbalance. Measurement of hair cortisol can become a useful biomarker of chronic work stress. Copyright © 2014 Elsevier Inc. All rights reserved.

ILLICIT DOPAMINE TRANSIENTS: RECONCILING ACTIONS OF ABUSED DRUGS

PubMed Central

Covey, Dan P.; Roitman, Mitchell F.; Garris, Paul A.

2014-01-01

Phasic increases in brain dopamine are required for cue-directed reward seeking. While compelling within the framework of appetitive behavior, the view that illicit drugs hijack reward circuits by hyper-activating these dopamine transients is inconsistent with established psychostimulant pharmacology. However, recent work reclassifying amphetamine (AMPH), cocaine, and other addictive dopamine-transporter inhibitors (DAT-Is) supports transient hyper-activation as a unifying hypothesis of abused drugs. We argue here that reclassification also identifies generating burst firing by dopamine neurons as a keystone action. Unlike natural rewards, which are processed by sensory systems, drugs act directly on the brain. Consequently, to mimic natural reward and exploit reward circuits, dopamine transients must be elicited de novo. Of available drug targets, only burst firing achieves this essential outcome. PMID:24656971

75 FR 21080 - Self-Regulatory Organizations; New York Stock Exchange LLC; Notice of Filing and Immediate...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-04-22

... the new fee schedule will continue to reward those who have been using the MatchPoint system for share... into the MatchPoint system. The proposed fee schedule, which will be effective upon filing, rewards all...Point\\SM\\ System April 15, 2010. Pursuant to Section 19(b)(1) \\1\\ of the Securities Exchange Act of 1934...

The role of the opioid system in binge eating disorder.

PubMed

Giuliano, Chiara; Cottone, Pietro

2015-12-01

Binge eating disorder is characterized by excessive, uncontrollable consumption of palatable food within brief periods of time. Excessive intake of palatable food is thought to be driven by hedonic, rather than energy homeostatic, mechanisms. However, reward processing does not only comprise consummatory actions; a key component is represented by the anticipatory phase directed at procuring the reward. This phase is highly influenced by environmental food-associated stimuli, which can robustly enhance the desire to eat even in the absence of physiological needs. The opioid system (endogenous peptides and their receptors) has been strongly linked to the rewarding aspects of palatable food intake, and perhaps represents the key system involved in hedonic overeating. Here we review evidence suggesting that the opioid system can also be regarded as one of the systems that regulates the anticipatory incentive processes preceding binge eating hedonic episodes.

Integration of homeostatic signaling and food reward processing in the human brain.

PubMed

Simon, Joe J; Wetzel, Anne; Sinno, Maria Hamze; Skunde, Mandy; Bendszus, Martin; Preissl, Hubert; Enck, Paul; Herzog, Wolfgang; Friederich, Hans-Christoph

2017-08-03

Food intake is guided by homeostatic needs and by the reward value of food, yet the exact relation between the two remains unclear. The aim of this study was to investigate the influence of different metabolic states and hormonal satiety signaling on responses in neural reward networks. Twenty-three healthy participants underwent functional magnetic resonance imaging while performing a task distinguishing between the anticipation and the receipt of either food- or monetary-related reward. Every participant was scanned twice in a counterbalanced fashion, both during a fasted state (after 24 hours fasting) and satiety. A functional connectivity analysis was performed to investigate the influence of satiety signaling on activation in neural reward networks. Blood samples were collected to assess hormonal satiety signaling. Fasting was associated with sensitization of the striatal reward system to the anticipation of food reward irrespective of reward magnitude. Furthermore, during satiety, individual ghrelin levels were associated with increased neural processing during the expectation of food-related reward. Our findings show that physiological hunger stimulates food consumption by specifically increasing neural processing during the expectation (i.e., incentive salience) but not the receipt of food-related reward. In addition, these findings suggest that ghrelin signaling influences hedonic-driven food intake by increasing neural reactivity during the expectation of food-related reward. These results provide insights into the neurobiological underpinnings of motivational processing and hedonic evaluation of food reward. ClinicalTrials.gov NCT03081585. This work was supported by the German Competence Network on Obesity, which is funded by the German Federal Ministry of Education and Research (FKZ 01GI1122E).

“Liking” and “Wanting” Linked to Reward Deficiency Syndrome (RDS): Hypothesizing Differential Responsivity in Brain Reward Circuitry

PubMed Central

Blum, Kenneth; Gardner, Eliot; Oscar-Berman, Marlene; Gold, Mark

2013-01-01

In an attempt to resolve controversy regarding the causal contributions of mesolimbic dopamine (DA) systems to reward, we evaluate the three main competing explanatory categories: “liking,” “learning,” and “wanting” [1]. That is, DA may mediate (a) the hedonic impact of reward (liking), (b) learned predictions about rewarding effects (learning), or (c) the pursuit of rewards by attributing incentive salience to reward-related stimuli (wanting). We evaluate these hypotheses, especially as they relate to the Reward Deficiency Syndrome (RDS), and we find that the incentive salience or “wanting” hypothesis of DA function is supported by a majority of the evidence. Neuroimaging studies have shown that drugs of abuse, palatable foods, and anticipated behaviors such as sex and gaming affect brain regions involving reward circuitry, and may not be unidirectional. Drugs of abuse enhance DA signaling and sensitize mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Addictive drugs have in common that they are voluntarily self-administered, they enhance (directly or indirectly) dopaminergic synaptic function in the nucleus accumbens, and they stimulate the functioning of brain reward circuitry (producing the “high” that drug users seek). Although originally believed simply to encode the set point of hedonic tone, these circuits now are believed to be functionally more complex, also encoding attention, reward expectancy, disconfirmation of reward expectancy, and incentive motivation. Elevated stress levels, together with polymorphisms of dopaminergic genes and other neurotransmitter genetic variants, may have a cumulative effect on vulnerability to addiction. The RDS model of etiology holds very well for a variety of chemical and behavioral addictions. PMID:22236117

An Upside to Reward Sensitivity: The Hippocampus Supports Enhanced Reinforcement Learning in Adolescence.

PubMed

Davidow, Juliet Y; Foerde, Karin; Galván, Adriana; Shohamy, Daphna

2016-10-05

Adolescents are notorious for engaging in reward-seeking behaviors, a tendency attributed to heightened activity in the brain's reward systems during adolescence. It has been suggested that reward sensitivity in adolescence might be adaptive, but evidence of an adaptive role has been scarce. Using a probabilistic reinforcement learning task combined with reinforcement learning models and fMRI, we found that adolescents showed better reinforcement learning and a stronger link between reinforcement learning and episodic memory for rewarding outcomes. This behavioral benefit was related to heightened prediction error-related BOLD activity in the hippocampus and to stronger functional connectivity between the hippocampus and the striatum at the time of reinforcement. These findings reveal an important role for the hippocampus in reinforcement learning in adolescence and suggest that reward sensitivity in adolescence is related to adaptive differences in how adolescents learn from experience. Copyright © 2016 Elsevier Inc. All rights reserved.

Evidence for deficits in reward responsivity in antisocial youth with callous-unemotional traits.

PubMed

Marini, Victoria A; Stickle, Timothy R

2010-10-01

This study investigated reward responsivity in youth with high levels of callous-unemotional (CU) traits using a cross-sectional design. Whereas deficits in responding to punishment cues are well established in youth with CU traits, it is unclear whether responsivity to rewarding stimuli is impaired as well. Participants were 148 predominantly Caucasian, adjudicated adolescents between the ages of 11 and 17 (M = 15.1, SD = 1.4) who completed the Balloon Analogue Risk Task as part of a larger battery investigating aggression and social information processing. A Reward Responsivity variable was created to capture changes in participants' responding after receiving a reward. A hierarchical regression analysis indicated that higher levels of CU traits significantly predicted less reward responsivity, above and beyond gender, sensation seeking, and impulsivity. Results support Blair's (2004) Integrated Emotion Systems model that proposes individuals with CU traits are impaired in their responsivity to both appetitive and aversive stimuli.

Neural and personality correlates of individual differences related to the effects of acute tryptophan depletion on future reward evaluation.

PubMed

Demoto, Yoshihiko; Okada, Go; Okamoto, Yasumasa; Kunisato, Yoshihiko; Aoyama, Shiori; Onoda, Keiichi; Munakata, Ayumi; Nomura, Michio; Tanaka, Saori C; Schweighofer, Nicolas; Doya, Kenji; Yamawaki, Shigeto

2012-01-01

In general, humans tend to discount the value of delayed reward. An increase in the rate of discounting leads to an inability to select a delayed reward over a smaller immediate reward (reward-delay impulsivity). Although deficits in the serotonergic system are implicated in this reward-delay impulsivity, there is individual variation in response to serotonin depletion. The aim of the present study was to investigate whether the effects of serotonin depletion on the ability to evaluate future reward are affected by individual personality traits or brain activation. Personality traits were assessed using the NEO-Five Factor Inventory and Temperament and Character Inventory. The central serotonergic levels of 16 healthy volunteers were manipulated by dietary tryptophan depletion. Subjects performed a delayed reward choice task that required the continuous estimation of reward value during functional magnetic resonance imaging scanning. Discounting rates were increased in 9 participants, but were unchanged or decreased in 7 participants in response to tryptophan depletion. Participants whose discounting rate was increased by tryptophan depletion had significantly higher neuroticism and lower self-directedness. Furthermore, tryptophan depletion differentially affected the groups in terms of hemodynamic responses to the value of predicted future reward in the right insula. These results suggest that individuals who have high neuroticism and low self-directedness as personality traits are particularly vulnerable to the effect of low serotonin on future reward evaluation accompanied by altered brain activation patterns. Copyright © 2012 S. Karger AG, Basel.

Abnormal reward functioning across substance use disorders and major depressive disorder: Considering reward as a transdiagnostic mechanism.

PubMed

Baskin-Sommers, Arielle R; Foti, Dan

2015-11-01

A common criticism of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 2013) is that its criteria are based more on behavioral descriptions than on underlying biological mechanisms. Increasingly, calls have intensified for a more biologically-based approach to conceptualizing, studying, and treating psychological disorders, as exemplified by the Research Domain Criteria Project (RDoC). Among the most well-studied neurobiological mechanisms is reward processing. Moreover, individual differences in reward sensitivity are related to risk for substance abuse and depression. The current review synthesizes the available preclinical, electrophysiological, and neuroimaging literature on reward processing from a transdiagnostic, multidimensional perspective. Findings are organized with respect to key reward constructs within the Positive Valence Systems domain of the RDoC matrix, including initial responsiveness to reward (physiological 'liking'), approach motivation (physiological 'wanting'), and reward learning/habit formation. In the current review, we (a) describe the neural basis of reward, (b) elucidate differences in reward activity in substance abuse and depression, and (c) suggest a framework for integrating these disparate literatures and discuss the utility of shifting focus from diagnosis to process for understanding liability and co-morbidity. Ultimately, we believe that an integrative focus on abnormal reward functioning across the full continuum of clinically heterogeneous samples, rather than within circumscribed diagnostic categories, might actually help to refine the phenotypes and improve the prediction of onset and recovery of these disorders. Copyright © 2015 Elsevier B.V. All rights reserved.

Dissociable effects of surprising rewards on learning and memory.

PubMed

Rouhani, Nina; Norman, Kenneth A; Niv, Yael

2018-03-19

Reward-prediction errors track the extent to which rewards deviate from expectations, and aid in learning. How do such errors in prediction interact with memory for the rewarding episode? Existing findings point to both cooperative and competitive interactions between learning and memory mechanisms. Here, we investigated whether learning about rewards in a high-risk context, with frequent, large prediction errors, would give rise to higher fidelity memory traces for rewarding events than learning in a low-risk context. Experiment 1 showed that recognition was better for items associated with larger absolute prediction errors during reward learning. Larger prediction errors also led to higher rates of learning about rewards. Interestingly we did not find a relationship between learning rate for reward and recognition-memory accuracy for items, suggesting that these two effects of prediction errors were caused by separate underlying mechanisms. In Experiment 2, we replicated these results with a longer task that posed stronger memory demands and allowed for more learning. We also showed improved source and sequence memory for items within the high-risk context. In Experiment 3, we controlled for the difficulty of reward learning in the risk environments, again replicating the previous results. Moreover, this control revealed that the high-risk context enhanced item-recognition memory beyond the effect of prediction errors. In summary, our results show that prediction errors boost both episodic item memory and incremental reward learning, but the two effects are likely mediated by distinct underlying systems. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

A new prize system for drug innovation.

PubMed

Gandjour, Afschin; Chernyak, Nadja

2011-10-01

We propose a new prize (reward) system for drug innovation which pays a price based on the value of health benefits accrued over time. Willingness to pay for a unit of health benefit is determined based on the cost-effectiveness ratio of palliative/nursing care. We solve the problem of limited information on the value of health benefits by mathematically relating reward size to the uncertainty of information including information on potential drug overuse. The proposed prize system offers optimal incentives to invest in research and development because it rewards the innovator for the social value of drug innovation. The proposal is envisaged as a non-voluntary alternative to the current patent system and reduces excessive marketing of innovators and generic drug producers. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Reward processing in the value-driven attention network: reward signals tracking cue identity and location.

PubMed

Anderson, Brian A

2017-03-01

Through associative reward learning, arbitrary cues acquire the ability to automatically capture visual attention. Previous studies have examined the neural correlates of value-driven attentional orienting, revealing elevated activity within a network of brain regions encompassing the visual corticostriatal loop [caudate tail, lateral occipital complex (LOC) and early visual cortex] and intraparietal sulcus (IPS). Such attentional priority signals raise a broader question concerning how visual signals are combined with reward signals during learning to create a representation that is sensitive to the confluence of the two. This study examines reward signals during the cued reward training phase commonly used to generate value-driven attentional biases. High, compared with low, reward feedback preferentially activated the value-driven attention network, in addition to regions typically implicated in reward processing. Further examination of these reward signals within the visual system revealed information about the identity of the preceding cue in the caudate tail and LOC, and information about the location of the preceding cue in IPS, while early visual cortex represented both location and identity. The results reveal teaching signals within the value-driven attention network during associative reward learning, and further suggest functional specialization within different regions of this network during the acquisition of an integrated representation of stimulus value. © The Author (2016). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Upregulation of gene expression in reward-modulatory striatal opioid systems by sleep loss.

PubMed

Baldo, Brian A; Hanlon, Erin C; Obermeyer, William; Bremer, Quentin; Paletz, Elliott; Benca, Ruth M

2013-12-01

Epidemiological studies have shown a link between sleep loss and the obesity 'epidemic,' and several observations indicate that sleep curtailment engenders positive energy balance via increased palatable-food 'snacking.' These effects suggest alterations in reward-modulatory brain systems. We explored the effects of 10 days of sleep deprivation in rats on the expression of striatal opioid peptide (OP) genes that subserve food motivation and hedonic reward, and compared effects with those seen in hypothalamic energy balance-regulatory systems. Sleep-deprived (Sleep-Dep) rats were compared with yoked forced-locomotion apparatus controls (App-Controls), food-restricted rats (Food-Restrict), and unmanipulated controls (Home-Cage). Detection of mRNA levels with in situ hybridization revealed a subregion-specific upregulation of striatal preproenkephalin and prodynorhin gene expression in the Sleep-Dep group relative to all other groups. Neuropeptide Y (NPY) gene expression in the hippocampal dentate gyrus and throughout neocortex was also robustly upregulated selectively in the Sleep-Dep group. In contrast, parallel gene expression changes were observed in the Sleep-Dep and Food-Restrict groups in hypothalamic energy-sensing systems (arcuate nucleus NPY was upregulated, and cocaine- and amphetamine-regulated transcript was downregulated), in alignment with leptin suppression in both groups. Together, these results reveal a novel set of sleep deprivation-induced transcriptional changes in reward-modulatory peptide systems, which are dissociable from the energy-balance perturbations of sleep loss or the potentially stressful effects of the forced-locomotion procedure. The recruitment of telencephalic food-reward systems may provide a feeding drive highly resistant to feedback control, which could engender obesity through the enhancement of palatable feeding.

Balancing Risk and Reward: A Rat Model of Risky Decision-Making

PubMed Central

Simon, Nicholas W.; Gilbert, Ryan J.; Mayse, Jeffrey D.; Bizon, Jennifer L.; Setlow, Barry

2009-01-01

We developed a behavioral task in rats to assess the influence of risk of punishment on decision-making. Male Long-Evans rats were given choices between pressing a lever to obtain a small, “safe” food reward and a large food reward associated with risk of punishment (footshock). Each test session consisted of 5 blocks of 10 choice trials, with punishment risk increasing with each consecutive block (0, 25, 50, 75, 100%). Preference for the large, “risky” reward declined with both increased probability and increased magnitude of punishment, and reward choice was not affected by the level of satiation or the order of risk presentation. Performance in this risky decision-making task was correlated with the degree to which the rats discounted the value of probabilistic rewards, but not delayed rewards. Finally, the acute effects of different doses of amphetamine and cocaine on risky decision-making were assessed. Systemic amphetamine administration caused a dose-dependent decrease in choice of the large risky reward (i.e. – it made rats more risk-averse). Cocaine did not cause a shift in reward choice, but instead impaired rats’ sensitivity to changes in punishment risk. These results should prove useful for investigating neuropsychiatric disorders in which risk taking is a prominent feature, such as attention deficit/hyperactivity disorder and addiction. PMID:19440192

Balancing risk and reward: a rat model of risky decision making.

PubMed

Simon, Nicholas W; Gilbert, Ryan J; Mayse, Jeffrey D; Bizon, Jennifer L; Setlow, Barry

2009-09-01

We developed a behavioral task in rats to assess the influence of risk of punishment on decision making. Male Long-Evans rats were given choices between pressing a lever to obtain a small, 'safe' food reward and a large food reward associated with risk of punishment (footshock). Each test session consisted of 5 blocks of 10 choice trials, with punishment risk increasing with each consecutive block (0, 25, 50, 75, 100%). Preference for the large, 'risky' reward declined with both increased probability and increased magnitude of punishment, and reward choice was not affected by the level of satiation or the order of risk presentation. Performance in this risky decision-making task was correlated with the degree to which the rats discounted the value of probabilistic rewards, but not delayed rewards. Finally, the acute effects of different doses of amphetamine and cocaine on risky decision making were assessed. Systemic amphetamine administration caused a dose-dependent decrease in choice of the large risky reward (ie, it made rats more risk averse). Cocaine did not cause a shift in reward choice, but instead impaired the rats' sensitivity to changes in punishment risk. These results should prove useful for investigating neuropsychiatric disorders in which risk taking is a prominent feature, such as attention deficit/hyperactivity disorder and addiction.

Needs and Rewards. Supervising: Principles and Practice of Supervision. The Choice Series #11. A Self Learning Opportunity.

ERIC Educational Resources Information Center

Ellingham, Richard

This learning unit on needs and rewards is one in the Choice Series, a self-learning development program for supervisors. Purpose stated for the approximately eight-hour-long unit is to enable the supervisor to understand and list the needs that influence work behavior and devise ways in which a work system can be both productive and rewarding for…

When Reward Is Punishment: How Health Care Support Personnel View Supervisor Actions.

DTIC Science & Technology

1981-11-30

from all organizations--tho need to create a work climate that encourages optimum performance . Most health care managers are keenly aware of the basic...principle that performance is improved when organizational rewards are clearly linked to individual success in accomplishing specific work goals (1...Like most organizations, the Naval hospital has developed formal systems to reward superior performers with incentives such as medals, plaques

Achievers, Confidence-Builders, Advocates, Relationship-Developers and System-Changers: What "Making a Difference" Means to Those Who Work with Children with Special Educational Needs -- A Typology of Rewards

ERIC Educational Resources Information Center

Mackenzie, Suzanne

2013-01-01

Previous research on the rewards found that teachers gain satisfaction in a sense of vocation, "making a difference", and the emotional rewards of "care" and "love", especially in whole-class teaching. The meaning of "making a difference" often remains unexplored however, and this article is an attempt to…

QUICR-learning for Multi-Agent Coordination

NASA Technical Reports Server (NTRS)

Agogino, Adrian K.; Tumer, Kagan

2006-01-01

Coordinating multiple agents that need to perform a sequence of actions to maximize a system level reward requires solving two distinct credit assignment problems. First, credit must be assigned for an action taken at time step t that results in a reward at time step t > t. Second, credit must be assigned for the contribution of agent i to the overall system performance. The first credit assignment problem is typically addressed with temporal difference methods such as Q-learning. The second credit assignment problem is typically addressed by creating custom reward functions. To address both credit assignment problems simultaneously, we propose the "Q Updates with Immediate Counterfactual Rewards-learning" (QUICR-learning) designed to improve both the convergence properties and performance of Q-learning in large multi-agent problems. QUICR-learning is based on previous work on single-time-step counterfactual rewards described by the collectives framework. Results on a traffic congestion problem shows that QUICR-learning is significantly better than a Q-learner using collectives-based (single-time-step counterfactual) rewards. In addition QUICR-learning provides significant gains over conventional and local Q-learning. Additional results on a multi-agent grid-world problem show that the improvements due to QUICR-learning are not domain specific and can provide up to a ten fold increase in performance over existing methods.

Dramatic decreases in brain reward function during nicotine withdrawal.

PubMed

Epping-Jordan, M P; Watkins, S S; Koob, G F; Markou, A

1998-05-07

Tobacco smoking is a worldwide public health problem. In the United States alone, over 400,000 deaths and $50 billion in medical costs annually are directly attributed to smoking. Accumulated evidence indicates that nicotine is the component of tobacco smoke that leads to addiction, but the means by which nicotine produces addiction remain unclear. Nicotine is less effective as a positive reinforcer than other drugs of abuse in non-dependent animals. Nevertheless, nicotine-withdrawal symptoms, including depressed mood, anxiety, irritability and craving in dependent subjects may contribute to the addictive liability of nicotine. We show here that spontaneous nicotine withdrawal in rats resulted in a significant decrease in brain reward function, as measured by elevations in brain reward thresholds, which persisted for four days. Further, systemic injections of a competitive nicotinic-receptor antagonist led to a dose-dependent increase in brain reward thresholds in chronic nicotine-treated rats. The decreased function in brain reward systems during nicotine withdrawal is comparable in magnitude and duration to that of other major drugs of abuse, and may constitute an important motivational factor that contributes to craving, relapse and continued tobacco consumption in humans.

Neural basis of the undermining effect of monetary reward on intrinsic motivation

PubMed Central

Murayama, Kou; Matsumoto, Madoka; Izuma, Keise; Matsumoto, Kenji

2010-01-01

Contrary to the widespread belief that people are positively motivated by reward incentives, some studies have shown that performance-based extrinsic reward can actually undermine a person's intrinsic motivation to engage in a task. This “undermining effect” has timely practical implications, given the burgeoning of performance-based incentive systems in contemporary society. It also presents a theoretical challenge for economic and reinforcement learning theories, which tend to assume that monetary incentives monotonically increase motivation. Despite the practical and theoretical importance of this provocative phenomenon, however, little is known about its neural basis. Herein we induced the behavioral undermining effect using a newly developed task, and we tracked its neural correlates using functional MRI. Our results show that performance-based monetary reward indeed undermines intrinsic motivation, as assessed by the number of voluntary engagements in the task. We found that activity in the anterior striatum and the prefrontal areas decreased along with this behavioral undermining effect. These findings suggest that the corticobasal ganglia valuation system underlies the undermining effect through the integration of extrinsic reward value and intrinsic task value. PMID:21078974

Hyporesponsive reward anticipation in the basal ganglia following severe institutional deprivation early in life.

PubMed

Mehta, Mitul A; Gore-Langton, Emma; Golembo, Nicole; Colvert, Emma; Williams, Steven C R; Sonuga-Barke, Edmund

2010-10-01

Severe deprivation in the first few years of life is associated with multiple difficulties in cognition and behavior. However, the brain basis for these difficulties is poorly understood. Structural and functional neuroimaging studies have implicated limbic system structures as dysfunctional, and one functional imaging study in a heterogeneous group of maltreated individuals has confirmed the presence of abnormalities in the basal ganglia. Based on these studies and known dopaminergic abnormalities from studies in experimental animals using social isolation, we used a task of monetary reward anticipation to examine the functional integrity of brain regions previously shown to be implicated in reward processing. Our sample included a group of adolescents (n = 12) who had experienced global deprivation early in their lives in Romania prior to adoption into UK families. In contrast to a nonadopted comparison group (n = 11), the adoptees did not recruit the striatum during reward anticipation despite comparable performance accuracy and latency. These results show, for the first time, an association between early institutional deprivation and brain reward systems in humans and highlight potential neural vulnerabilities resulting from such exposures.

Neural basis of the undermining effect of monetary reward on intrinsic motivation.

PubMed

Murayama, Kou; Matsumoto, Madoka; Izuma, Keise; Matsumoto, Kenji

2010-12-07

Contrary to the widespread belief that people are positively motivated by reward incentives, some studies have shown that performance-based extrinsic reward can actually undermine a person's intrinsic motivation to engage in a task. This "undermining effect" has timely practical implications, given the burgeoning of performance-based incentive systems in contemporary society. It also presents a theoretical challenge for economic and reinforcement learning theories, which tend to assume that monetary incentives monotonically increase motivation. Despite the practical and theoretical importance of this provocative phenomenon, however, little is known about its neural basis. Herein we induced the behavioral undermining effect using a newly developed task, and we tracked its neural correlates using functional MRI. Our results show that performance-based monetary reward indeed undermines intrinsic motivation, as assessed by the number of voluntary engagements in the task. We found that activity in the anterior striatum and the prefrontal areas decreased along with this behavioral undermining effect. These findings suggest that the corticobasal ganglia valuation system underlies the undermining effect through the integration of extrinsic reward value and intrinsic task value.

Modulation of Food Reward by Endocrine and Environmental Factors: Update and Perspective.

PubMed

Figlewicz, Dianne P

2015-01-01

Palatable foods are frequently high in energy density. Chronic consumption of high-energy density foods can contribute to the development of cardiometabolic pathology including obesity, diabetes, and cardiovascular disease. This article reviews the contributions of extrinsic and intrinsic factors that influence the reward components of food intake. A narrative review was conducted to determine the behavioral and central nervous system (CNS) related processes involved in the reward components of high-energy density food intake. The rewarding aspects of food, particularly palatable and preferred foods, are regulated by CNS circuitry. Overlaying this regulation is modulation by intrinsic endocrine systems and metabolic hormones relating to energy homeostasis, developmental stage, or gender. It is now recognized that extrinsic or environmental factors, including ambient diet composition and the provocation of stress or anxiety, also contribute substantially to the expression of food reward behaviors such as motivation for, and seeking of, preferred foods. High-energy density food intake is influenced by both physiological and pathophysiological processes. Contextual, behavioral, and psychological factors and CNS-related processes represent potential targets for multiple types of therapeutic intervention.

Time of Day Differences in Neural Reward Functioning in Healthy Young Men.

PubMed

Byrne, Jamie E M; Hughes, Matthew E; Rossell, Susan L; Johnson, Sheri L; Murray, Greg

2017-09-13

Reward function appears to be modulated by the circadian system, but little is known about the neural basis of this interaction. Previous research suggests that the neural reward response may be different in the afternoon; however, the direction of this effect is contentious. Reward response may follow the diurnal rhythm in self-reported positive affect, peaking in the early afternoon. An alternative is that daily reward response represents a type of prediction error, with neural reward activation relatively high at times of day when rewards are unexpected (i.e., early and late in the day). The present study measured neural reward activation in the context of a validated reward task at 10.00 h, 14.00 h, and 19.00 h in healthy human males. A region of interest BOLD fMRI protocol was used to investigate the diurnal waveform of activation in reward-related brain regions. Multilevel modeling found, as expected, a highly significant quadratic time-of-day effect focusing on the left putamen ( p < 0.001). Consistent with the "prediction error" hypothesis, activation was significantly higher at 10.00 h and 19.00 h compared with 14.00 h. It is provisionally concluded that the putamen may be particularly important in endogenous priming of reward motivation at different times of day, with the pattern of activation consistent with circadian-modulated reward expectancies in neural pathways (i.e., greater activation to reward stimuli at unexpected times of day). This study encourages further research into circadian modulation of reward and underscores the methodological importance of accounting for time of day in fMRI protocols. SIGNIFICANCE STATEMENT This is one of the first studies to use a repeated-measures imaging procedure to explore the diurnal rhythm of reward activation. Although self-reported reward (most often operationalized as positive affect) peaks in the afternoon, the present findings indicate that neural activation is lowest at this time. We conclude that the diurnal neural activation pattern may reflect a prediction error of the brain, where rewards at unexpected times (10.00 h and 19.00 h) elicit higher activation in reward brain regions than at expected (14.00 h) times. These data also have methodological significance, suggesting that there may be a time of day influence, which should be accounted for in neural reward studies. Copyright © 2017 the authors 0270-6474/17/378895-06$15.00/0.

The impact of cognitive load on reward evaluation.

PubMed

Krigolson, Olave E; Hassall, Cameron D; Satel, Jason; Klein, Raymond M

2015-11-19

The neural systems that afford our ability to evaluate rewards and punishments are impacted by a variety of external factors. Here, we demonstrate that increased cognitive load reduces the functional efficacy of a reward processing system within the human medial-frontal cortex. In our paradigm, two groups of participants used performance feedback to estimate the exact duration of one second while electroencephalographic (EEG) data was recorded. Prior to performing the time estimation task, both groups were instructed to keep their eyes still and avoid blinking in line with well established EEG protocol. However, during performance of the time-estimation task, one of the two groups was provided with trial-to-trial-feedback about their performance on the time-estimation task and their eye movements to induce a higher level of cognitive load relative to participants in the other group who were solely provided with feedback about the accuracy of their temporal estimates. In line with previous work, we found that the higher level of cognitive load reduced the amplitude of the feedback-related negativity, a component of the human event-related brain potential associated with reward evaluation within the medial-frontal cortex. Importantly, our results provide further support that increased cognitive load reduces the functional efficacy of a neural system associated with reward processing. Copyright © 2015 Elsevier B.V. All rights reserved.

Reward, motivation, and emotion systems associated with early-stage intense romantic love.

PubMed

Aron, Arthur; Fisher, Helen; Mashek, Debra J; Strong, Greg; Li, Haifang; Brown, Lucy L

2005-07-01

Early-stage romantic love can induce euphoria, is a cross-cultural phenomenon, and is possibly a developed form of a mammalian drive to pursue preferred mates. It has an important influence on social behaviors that have reproductive and genetic consequences. To determine which reward and motivation systems may be involved, we used functional magnetic resonance imaging and studied 10 women and 7 men who were intensely "in love" from 1 to 17 mo. Participants alternately viewed a photograph of their beloved and a photograph of a familiar individual, interspersed with a distraction-attention task. Group activation specific to the beloved under the two control conditions occurred in dopamine-rich areas associated with mammalian reward and motivation, namely the right ventral tegmental area and the right postero-dorsal body and medial caudate nucleus. Activation in the left ventral tegmental area was correlated with facial attractiveness scores. Activation in the right anteromedial caudate was correlated with questionnaire scores that quantified intensity of romantic passion. In the left insula-putamen-globus pallidus, activation correlated with trait affect intensity. The results suggest that romantic love uses subcortical reward and motivation systems to focus on a specific individual, that limbic cortical regions process individual emotion factors, and that there is localization heterogeneity for reward functions in the human brain.

Cocaine affects foraging behaviour and biogenic amine modulated behavioural reflexes in honey bees.

PubMed

Søvik, Eirik; Even, Naïla; Radford, Catherine W; Barron, Andrew B

2014-01-01

In humans and other mammals, drugs of abuse alter the function of biogenic amine pathways in the brain leading to the subjective experience of reward and euphoria. Biogenic amine pathways are involved in reward processing across diverse animal phyla, however whether cocaine acts on these neurochemical pathways to cause similar rewarding behavioural effects in animal phyla other than mammals is unclear. Previously, it has been shown that bees are more likely to dance (a signal of perceived reward) when returning from a sucrose feeder after cocaine treatment. Here we examined more broadly whether cocaine altered reward-related behaviour, and biogenic amine modulated behavioural responses in bees. Bees developed a preference for locations at which they received cocaine, and when foraging at low quality sucrose feeders increase their foraging rate in response to cocaine treatment. Cocaine also increased reflexive proboscis extension to sucrose, and sting extension to electric shock. Both of these simple reflexes are modulated by biogenic amines. This shows that systemic cocaine treatment alters behavioural responses that are modulated by biogenic amines in insects. Since insect reward responses involve both octopamine and dopamine signalling, we conclude that cocaine treatment altered diverse reward-related aspects of behaviour in bees. We discuss the implications of these results for understanding the ecology of cocaine as a plant defence compound. Our findings further validate the honey bee as a model system for understanding the behavioural impacts of cocaine, and potentially other drugs of abuse.

Potential effects of reward and loss avoidance in overweight adolescents.

PubMed

Reyes, Sussanne; Peirano, Patricio; Luna, Beatriz; Lozoff, Betsy; Algarín, Cecilia

2015-08-01

Reward system and inhibitory control are brain functions that exert an influence on eating behavior regulation. We studied the differences in inhibitory control and sensitivity to reward and loss avoidance between overweight/obese and normal-weight adolescents. We assessed 51 overweight/obese and 52 normal-weight 15-y-old Chilean adolescents. The groups were similar regarding sex and intelligence quotient. Using Antisaccade and Incentive tasks, we evaluated inhibitory control and the effect of incentive trials (neutral, loss avoidance, and reward) on generating correct and incorrect responses (latency and error rate). Compared to normal-weight group participants, overweight/obese adolescents showed shorter latency for incorrect antisaccade responses (186.0 (95% CI: 176.8-195.2) vs. 201.3 ms (95% CI: 191.2-211.5), P < 0.05) and better performance reflected by lower error rate in incentive trials (43.6 (95% CI: 37.8-49.4) vs. 53.4% (95% CI: 46.8-60.0), P < 0.05). Overweight/obese adolescents were more accurate on loss avoidance (40.9 (95% CI: 33.5-47.7) vs. 49.8% (95% CI: 43.0-55.1), P < 0.05) and reward (41.0 (95% CI: 34.5-47.5) vs. 49.8% (95% CI: 43.0-55.1), P < 0.05) compared to neutral trials. Overweight/obese adolescents showed shorter latency for incorrect responses and greater accuracy in reward and loss avoidance trials. These findings could suggest that an imbalance of inhibition and reward systems influence their eating behavior.

Gender dimorphism of brain reward system volumes in alcoholism.

PubMed

Sawyer, Kayle S; Oscar-Berman, Marlene; Barthelemy, Olivier J; Papadimitriou, George M; Harris, Gordon J; Makris, Nikos

2017-05-30

The brain's reward network has been reported to be smaller in alcoholic men compared to nonalcoholic men, but little is known about the volumes of reward regions in alcoholic women. Morphometric analyses were performed on magnetic resonance brain scans of 60 long-term chronic alcoholics (ALC; 30 men) and 60 nonalcoholic controls (NC; 29 men). We derived volumes of total brain, and cortical and subcortical reward-related structures including the dorsolateral prefrontal (DLPFC), orbitofrontal, and cingulate cortices, and the temporal pole, insula, amygdala, hippocampus, nucleus accumbens septi (NAc), and ventral diencephalon (VDC). We examined the relationships of the volumetric findings to drinking history. Analyses revealed a significant gender interaction for the association between alcoholism and total reward network volumes, with ALC men having smaller reward volumes than NC men and ALC women having larger reward volumes than NC women. Analyses of a priori subregions revealed a similar pattern of reward volume differences with significant gender interactions for DLPFC and VDC. Overall, the volume of the cerebral ventricles in ALC participants was negatively associated with duration of abstinence, suggesting decline in atrophy with greater length of sobriety. Copyright © 2017 Elsevier Ireland Ltd. All rights reserved.

Independent functional connectivity networks underpin food and monetary reward sensitivity in excess weight.

PubMed

Verdejo-Román, Juan; Fornito, Alex; Soriano-Mas, Carles; Vilar-López, Raquel; Verdejo-García, Antonio

2017-02-01

Overvaluation of palatable food is a primary driver of obesity, and is associated with brain regions of the reward system. However, it remains unclear if this network is specialized in food reward, or generally involved in reward processing. We used functional magnetic resonance imaging (fMRI) to characterize functional connectivity during processing of food and monetary rewards. Thirty-nine adults with excess weight and 37 adults with normal weight performed the Willingness to Pay for Food task and the Monetary Incentive Delay task in the fMRI scanner. A data-driven graph approach was applied to compare whole-brain, task-related functional connectivity between groups. Excess weight was associated with decreased functional connectivity during the processing of food rewards in a network involving primarily frontal and striatal areas, and increased functional connectivity during the processing of monetary rewards in a network involving principally frontal and parietal areas. These two networks were topologically and anatomically distinct, and were independently associated with BMI. The processing of food and monetary rewards involve segregated neural networks, and both are altered in individuals with excess weight. Copyright © 2016 Elsevier Inc. All rights reserved.

Taking the Show on the Road: The Multiple Rewards of Teaching Information Systems Abroad.

ERIC Educational Resources Information Center

Chepaitis, Elia

This paper discusses the multiple rewards of teaching information systems (IS) abroad, drawing on the experience of an IS professor who has been awarded three Fulbright scholarships in the 1990s. The author draws extensively upon personal experiences in Russia to illustrate the challenges and benefits of teaching in foreign institutions. The…

Rewarding Community-Engaged Scholarship: A State University System Approach

ERIC Educational Resources Information Center

Saltmarsh, John; Wooding, John

2016-01-01

The need for new and revised structures to reward new forms of scholarship is being examined nationally and globally. It is also being examined on campuses that make up the University of Massachusetts system, all which are classified by the Carnegie Foundation for Community Engagement. This paper reports on the collective exploration by the five…

A Grand Bargain for Education Reform: New Rewards and Supports for New Accountability

ERIC Educational Resources Information Center

Hershberg, Theodore, Ed.; Robertson-Kraft, Claire, Ed.

2009-01-01

This book offers an ambitious new system for evaluating, compensating, and providing professional development for school teachers and administrators. In this realigned system, new forms of accountability are introduced, but they go hand in hand with new rewards and access to enhanced forms of professional development to help educators succeed in…

A Computer-Assisted Learning Model Based on the Digital Game Exponential Reward System

ERIC Educational Resources Information Center

Moon, Man-Ki; Jahng, Surng-Gahb; Kim, Tae-Yong

2011-01-01

The aim of this research was to construct a motivational model which would stimulate voluntary and proactive learning using digital game methods offering players more freedom and control. The theoretical framework of this research lays the foundation for a pedagogical learning model based on digital games. We analyzed the game reward system, which…

Supporting and Rewarding Accomplished Teaching: Insights from Austin, Texas

ERIC Educational Resources Information Center

Lussier, David F.; Forgione, Pascal D., Jr.

2010-01-01

This article explores the strategic compensation efforts of the Austin Independent School District (AISD) in Texas, which is piloting a system of supports and rewards for teachers and administrators. The article highlights the key components of this system, what it took to put a 4-year pilot program in place, and what results are emerging from…

Prefrontal cortex as a meta-reinforcement learning system.

PubMed

Wang, Jane X; Kurth-Nelson, Zeb; Kumaran, Dharshan; Tirumala, Dhruva; Soyer, Hubert; Leibo, Joel Z; Hassabis, Demis; Botvinick, Matthew

2018-06-01

Over the past 20 years, neuroscience research on reward-based learning has converged on a canonical model, under which the neurotransmitter dopamine 'stamps in' associations between situations, actions and rewards by modulating the strength of synaptic connections between neurons. However, a growing number of recent findings have placed this standard model under strain. We now draw on recent advances in artificial intelligence to introduce a new theory of reward-based learning. Here, the dopamine system trains another part of the brain, the prefrontal cortex, to operate as its own free-standing learning system. This new perspective accommodates the findings that motivated the standard model, but also deals gracefully with a wider range of observations, providing a fresh foundation for future research.

Social reward: interactions with social status, social communication, aggression, and associated neural activation in the ventral tegmental area.

PubMed

Gil, Mario; Nguyen, Ngoc-Thao; McDonald, Mark; Albers, H Elliott

2013-07-01

Nearly all species engage in a variety of intraspecific social interactions, and there is evidence that these interactions are rewarding. Less is known, however, about the factors that influence social reward. Using the conditioned place preference paradigm, we tested whether social interactions are rewarding for male Syrian hamsters. We also tested whether social stimuli increase neural activation in the ventral tegmental area (VTA), a component of the mesolimbic reward system, and how individual differences in social behavior and experience influence neural activation. In the present study, we found that hamsters developed a conditioned place preference for social interactions, but the effects were significantly stronger in dominant animals compared with subordinates. The number of Fos-immunoreactive cells in the VTA was significantly higher in hamsters that had engaged in a direct social encounter compared with hamsters exposed to a caged stimulus hamster or controls. Interestingly, socially experienced males had more Fos-immunoreactive cells in the VTA than socially naive males after exposure to a social stimulus. Surprisingly, the amount of Fos immunoreactivity in the VTA induced by a social stimulus was correlated with the amount of aggressive/dominance behaviors that had been observed during interactions that had occurred 2 months earlier. Our results indicate that social interactions between males are rewarding, and that social dominance increases the reward value. Social interactions stimulate the mesolimbic reward system, and social experience enhances its response to novel social stimuli and may produce long-term changes in the neural mechanisms that mediate the maintenance of dominance over long periods of time. © 2013 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

Preserved reward outcome processing in ASD as revealed by event-related potentials.

PubMed

McPartland, James C; Crowley, Michael J; Perszyk, Danielle R; Mukerji, Cora E; Naples, Adam J; Wu, Jia; Mayes, Linda C

2012-05-31

Problems with reward system function have been posited as a primary difficulty in autism spectrum disorders. The current study examined an electrophysiological marker of feedback monitoring, the feedback-related negativity (FRN), during a monetary reward task. The study advanced prior understanding by focusing exclusively on a developmental sample, applying rigorous diagnostic characterization and introducing an experimental paradigm providing more subtly different feedback valence (reward versus non-reward instead of reward versus loss). Twenty-six children with autism spectrum disorder and 28 typically developing peers matched on age and full-scale IQ played a guessing game resulting in monetary gain ("win") or neutral outcome ("draw"). ERP components marking early visual processing (N1, P2) and feedback appraisal (FRN) were contrasted between groups in each condition, and their relationships to behavioral measures of social function and dysfunction, social anxiety, and autism symptomatology were explored. FRN was observed on draw trials relative to win trials. Consistent with prior research, children with ASD exhibited a FRN to suboptimal outcomes that was comparable to typical peers. ERP parameters were unrelated to behavioral measures. Results of the current study indicate typical patterns of feedback monitoring in the context of monetary reward in ASD. The study extends prior findings of normative feedback monitoring to a sample composed exclusively of children and demonstrates that, as in typical development, individuals with autism exhibit a FRN to suboptimal outcomes, irrespective of neutral or negative valence. Results do not support a pervasive problem with reward system function in ASD, instead suggesting any dysfunction lies in more specific domains, such as social perception, or in response to particular feedback-monitoring contexts, such as self-evaluation of one's errors.

The "proactive" model of learning: Integrative framework for model-free and model-based reinforcement learning utilizing the associative learning-based proactive brain concept.

PubMed

Zsuga, Judit; Biro, Klara; Papp, Csaba; Tajti, Gabor; Gesztelyi, Rudolf

2016-02-01

Reinforcement learning (RL) is a powerful concept underlying forms of associative learning governed by the use of a scalar reward signal, with learning taking place if expectations are violated. RL may be assessed using model-based and model-free approaches. Model-based reinforcement learning involves the amygdala, the hippocampus, and the orbitofrontal cortex (OFC). The model-free system involves the pedunculopontine-tegmental nucleus (PPTgN), the ventral tegmental area (VTA) and the ventral striatum (VS). Based on the functional connectivity of VS, model-free and model based RL systems center on the VS that by integrating model-free signals (received as reward prediction error) and model-based reward related input computes value. Using the concept of reinforcement learning agent we propose that the VS serves as the value function component of the RL agent. Regarding the model utilized for model-based computations we turned to the proactive brain concept, which offers an ubiquitous function for the default network based on its great functional overlap with contextual associative areas. Hence, by means of the default network the brain continuously organizes its environment into context frames enabling the formulation of analogy-based association that are turned into predictions of what to expect. The OFC integrates reward-related information into context frames upon computing reward expectation by compiling stimulus-reward and context-reward information offered by the amygdala and hippocampus, respectively. Furthermore we suggest that the integration of model-based expectations regarding reward into the value signal is further supported by the efferent of the OFC that reach structures canonical for model-free learning (e.g., the PPTgN, VTA, and VS). (c) 2016 APA, all rights reserved).

State-based versus reward-based motivation in younger and older adults.

PubMed

Worthy, Darrell A; Cooper, Jessica A; Byrne, Kaileigh A; Gorlick, Marissa A; Maddox, W Todd

2014-12-01

Recent decision-making work has focused on a distinction between a habitual, model-free neural system that is motivated toward actions that lead directly to reward and a more computationally demanding goal-directed, model-based system that is motivated toward actions that improve one's future state. In this article, we examine how aging affects motivation toward reward-based versus state-based decision making. Participants performed tasks in which one type of option provided larger immediate rewards but the alternative type of option led to larger rewards on future trials, or improvements in state. We predicted that older adults would show a reduced preference for choices that led to improvements in state and a greater preference for choices that maximized immediate reward. We also predicted that fits from a hybrid reinforcement-learning model would indicate greater model-based strategy use in younger than in older adults. In line with these predictions, older adults selected the options that maximized reward more often than did younger adults in three of the four tasks, and modeling results suggested reduced model-based strategy use. In the task where older adults showed similar behavior to younger adults, our model-fitting results suggested that this was due to the utilization of a win-stay-lose-shift heuristic rather than a more complex model-based strategy. Additionally, within older adults, we found that model-based strategy use was positively correlated with memory measures from our neuropsychological test battery. We suggest that this shift from state-based to reward-based motivation may be due to age related declines in the neural structures needed for more computationally demanding model-based decision making.

An Automated Motion Detection and Reward System for Animal Training.

PubMed

Miller, Brad; Lim, Audrey N; Heidbreder, Arnold F; Black, Kevin J

2015-12-04

A variety of approaches has been used to minimize head movement during functional brain imaging studies in awake laboratory animals. Many laboratories expend substantial effort and time training animals to remain essentially motionless during such studies. We could not locate an "off-the-shelf" automated training system that suited our needs.  We developed a time- and labor-saving automated system to train animals to hold still for extended periods of time. The system uses a personal computer and modest external hardware to provide stimulus cues, monitor movement using commercial video surveillance components, and dispense rewards. A custom computer program automatically increases the motionless duration required for rewards based on performance during the training session but allows changes during sessions. This system was used to train cynomolgus monkeys (Macaca fascicularis) for awake neuroimaging studies using positron emission tomography (PET) and functional magnetic resonance imaging (fMRI). The automated system saved the trainer substantial time, presented stimuli and rewards in a highly consistent manner, and automatically documented training sessions. We have limited data to prove the training system's success, drawn from the automated records during training sessions, but we believe others may find it useful. The system can be adapted to a range of behavioral training/recording activities for research or commercial applications, and the software is freely available for non-commercial use.

Illicit dopamine transients: reconciling actions of abused drugs.

PubMed

Covey, Dan P; Roitman, Mitchell F; Garris, Paul A

2014-04-01

Phasic increases in brain dopamine are required for cue-directed reward seeking. Although compelling within the framework of appetitive behavior, the view that illicit drugs hijack reward circuits by hyperactivating these dopamine transients is inconsistent with established psychostimulant pharmacology. However, recent work reclassifying amphetamine (AMPH), cocaine, and other addictive dopamine-transporter inhibitors (DAT-Is) supports transient hyperactivation as a unifying hypothesis of abused drugs. We argue here that reclassification also identifies generating burst firing by dopamine neurons as a keystone action. Unlike natural rewards, which are processed by sensory systems, drugs act directly on the brain. Consequently, to mimic natural rewards and exploit reward circuits, dopamine transients must be elicited de novo. Of available drug targets, only burst firing achieves this essential outcome. Copyright © 2014 Elsevier Ltd. All rights reserved.

Tsallis’ non-extensive free energy as a subjective value of an uncertain reward

NASA Astrophysics Data System (ADS)

Takahashi, Taiki

2009-03-01

Recent studies in neuroeconomics and econophysics revealed the importance of reward expectation in decision under uncertainty. Behavioral neuroeconomic studies have proposed that the unpredictability and the probability of an uncertain reward are distinctly encoded as entropy and a distorted probability weight, respectively, in the separate neural systems. However, previous behavioral economic and decision-theoretic models could not quantify reward-seeking and uncertainty aversion in a theoretically consistent manner. In this paper, we have: (i) proposed that generalized Helmholtz free energy in Tsallis’ non-extensive thermostatistics can be utilized to quantify a perceived value of an uncertain reward, and (ii) empirically examined the explanatory powers of the models. Future study directions in neuroeconomics and econophysics by utilizing the Tsallis’ free energy model are discussed.

Shared neural coding for social hierarchy and reward value in primate amygdala.

PubMed

Munuera, Jérôme; Rigotti, Mattia; Salzman, C Daniel

2018-03-01

The social brain hypothesis posits that dedicated neural systems process social information. In support of this, neurophysiological data have shown that some brain regions are specialized for representing faces. It remains unknown, however, whether distinct anatomical substrates also represent more complex social variables, such as the hierarchical rank of individuals within a social group. Here we show that the primate amygdala encodes the hierarchical rank of individuals in the same neuronal ensembles that encode the rewards associated with nonsocial stimuli. By contrast, orbitofrontal and anterior cingulate cortices lack strong representations of hierarchical rank while still representing reward values. These results challenge the conventional view that dedicated neural systems process social information. Instead, information about hierarchical rank-which contributes to the assessment of the social value of individuals within a group-is linked in the amygdala to representations of rewards associated with nonsocial stimuli.

Integration of homeostatic signaling and food reward processing in the human brain

PubMed Central

Simon, Joe J.; Wetzel, Anne; Sinno, Maria Hamze; Skunde, Mandy; Bendszus, Martin; Enck, Paul; Herzog, Wolfgang; Friederich, Hans-Christoph

2017-01-01

BACKGROUND. Food intake is guided by homeostatic needs and by the reward value of food, yet the exact relation between the two remains unclear. The aim of this study was to investigate the influence of different metabolic states and hormonal satiety signaling on responses in neural reward networks. METHODS. Twenty-three healthy participants underwent functional magnetic resonance imaging while performing a task distinguishing between the anticipation and the receipt of either food- or monetary-related reward. Every participant was scanned twice in a counterbalanced fashion, both during a fasted state (after 24 hours fasting) and satiety. A functional connectivity analysis was performed to investigate the influence of satiety signaling on activation in neural reward networks. Blood samples were collected to assess hormonal satiety signaling. RESULTS. Fasting was associated with sensitization of the striatal reward system to the anticipation of food reward irrespective of reward magnitude. Furthermore, during satiety, individual ghrelin levels were associated with increased neural processing during the expectation of food-related reward. CONCLUSIONS. Our findings show that physiological hunger stimulates food consumption by specifically increasing neural processing during the expectation (i.e., incentive salience) but not the receipt of food-related reward. In addition, these findings suggest that ghrelin signaling influences hedonic-driven food intake by increasing neural reactivity during the expectation of food-related reward. These results provide insights into the neurobiological underpinnings of motivational processing and hedonic evaluation of food reward. TRIAL REGISTRATION. ClinicalTrials.gov NCT03081585. FUNDING. This work was supported by the German Competence Network on Obesity, which is funded by the German Federal Ministry of Education and Research (FKZ 01GI1122E). PMID:28768906

Occupational safety and health as an element of a complex compensation system evaluation within an organization.

PubMed

Beck-Krala, Ewa; Klimkiewicz, Katarzyna

2016-12-01

Occupational safety and health (OSH) plays a significant role in today's organizations, because it helps in attracting and retaining employees as well as molding their attitudes and behaviors at work. This is why the issue of OSH is stressed in a comprehensive approach to employee rewards: the total reward concept. This article explains how OSH may be included in a complex evaluation process of the compensation system. Although the literature on the effectiveness of employee compensation refers mainly to financial and non-financial components, there is a need for inclusion of working conditions in such analyses. An evaluation of the compensation system that incorporates OSH can drive many benefits for both the organization and employees. Obtaining such benefits, however, requires systematic evaluation of the reward system, including OSH. Incorporation of OSH issue within the comprehensive analysis of compensation systems promotes responsible behavior of all stakeholders.

Detecting Cyber Attacks On Nuclear Power Plants

NASA Astrophysics Data System (ADS)

Rrushi, Julian; Campbell, Roy

This paper proposes an unconventional anomaly detection approach that provides digital instrumentation and control (I&C) systems in a nuclear power plant (NPP) with the capability to probabilistically discern between legitimate protocol frames and attack frames. The stochastic activity network (SAN) formalism is used to model the fusion of protocol activity in each digital I&C system and the operation of physical components of an NPP. SAN models are employed to analyze links between protocol frames as streams of bytes, their semantics in terms of NPP operations, control data as stored in the memory of I&C systems, the operations of I&C systems on NPP components, and NPP processes. Reward rates and impulse rewards are defined in the SAN models based on the activity-marking reward structure to estimate NPP operation profiles. These profiles are then used to probabilistically estimate the legitimacy of the semantics and payloads of protocol frames received by I&C systems.

Value-driven attentional capture in the auditory domain.

PubMed

Anderson, Brian A

2016-01-01

It is now well established that the visual attention system is shaped by reward learning. When visual features are associated with a reward outcome, they acquire high priority and can automatically capture visual attention. To date, evidence for value-driven attentional capture has been limited entirely to the visual system. In the present study, I demonstrate that previously reward-associated sounds also capture attention, interfering more strongly with the performance of a visual task. This finding suggests that value-driven attention reflects a broad principle of information processing that can be extended to other sensory modalities and that value-driven attention can bias cross-modal stimulus competition.

Impulsive actions and choices in laboratory animals and humans: effects of high vs. low dopamine states produced by systemic treatments given to neurologically intact subjects

PubMed Central

D’Amour-Horvat, Valérie; Leyton, Marco

2014-01-01

Increases and decreases in dopamine (DA) transmission have both been suggested to influence reward-related impulse-control. The present literature review suggests that, in laboratory animals, the systemic administration of DA augmenters preferentially increases susceptibility to premature responding; with continued DA transmission, reward approach behaviors are sustained. Decreases in DA transmission, in comparison, diminish the appeal of distal and difficult to obtain rewards, thereby increasing susceptibility to temporal discounting and other forms of impulsive choice. The evidence available in humans is not incompatible with this model but is less extensive. PMID:25566001

Motivational orientation modulates the neural response to reward.

PubMed

Linke, Julia; Kirsch, Peter; King, Andrea V; Gass, Achim; Hennerici, Michael G; Bongers, André; Wessa, Michèle

2010-02-01

Motivational orientation defines the source of motivation for an individual to perform a particular action and can either originate from internal desires (e.g., interest) or external compensation (e.g., money). To this end, motivational orientation should influence the way positive or negative feedback is processed during learning situations and this might in turn have an impact on the learning process. In the present study, we thus investigated whether motivational orientation, i.e., extrinsic and intrinsic motivation modulates the neural response to reward and punishment as well as learning from reward and punishment in 33 healthy individuals. To assess neural responses to reward, punishment and learning of reward contingencies we employed a probabilistic reversal learning task during functional magnetic resonance imaging. Extrinsic and intrinsic motivation were assessed with a self-report questionnaire. Rewarding trials fostered activation in the medial orbitofrontal cortex and anterior cingulate gyrus (ACC) as well as the amygdala and nucleus accumbens, whereas for punishment an increased neural response was observed in the medial and inferior prefrontal cortex, the superior parietal cortex and the insula. High extrinsic motivation was positively correlated to increased neural responses to reward in the ACC, amygdala and putamen, whereas a negative relationship between intrinsic motivation and brain activation in these brain regions was observed. These findings show that motivational orientation indeed modulates the responsiveness to reward delivery in major components of the human reward system and therefore extends previous results showing a significant influence of individual differences in reward-related personality traits on the neural processing of reward. Copyright (c) 2009 Elsevier Inc. All rights reserved.

Reward Selectively Modulates the Lingering Neural Representation of Recently Attended Objects in Natural Scenes.

PubMed

Hickey, Clayton; Peelen, Marius V

2017-08-02

Theories of reinforcement learning and approach behavior suggest that reward can increase the perceptual salience of environmental stimuli, ensuring that potential predictors of outcome are noticed in the future. However, outcome commonly follows visual processing of the environment, occurring even when potential reward cues have long disappeared. How can reward feedback retroactively cause now-absent stimuli to become attention-drawing in the future? One possibility is that reward and attention interact to prime lingering visual representations of attended stimuli that sustain through the interval separating stimulus and outcome. Here, we test this idea using multivariate pattern analysis of fMRI data collected from male and female humans. While in the scanner, participants searched for examples of target categories in briefly presented pictures of cityscapes and landscapes. Correct task performance was followed by reward feedback that could randomly have either high or low magnitude. Analysis showed that high-magnitude reward feedback boosted the lingering representation of target categories while reducing the representation of nontarget categories. The magnitude of this effect in each participant predicted the behavioral impact of reward on search performance in subsequent trials. Other analyses show that sensitivity to reward-as expressed in a personality questionnaire and in reactivity to reward feedback in the dopaminergic midbrain-predicted reward-elicited variance in lingering target and nontarget representations. Credit for rewarding outcome thus appears to be assigned to the target representation, causing the visual system to become sensitized for similar objects in the future. SIGNIFICANCE STATEMENT How do reward-predictive visual stimuli become salient and attention-drawing? In the real world, reward cues precede outcome and reward is commonly received long after potential predictors have disappeared. How can the representation of environmental stimuli be affected by outcome that occurs later in time? Here, we show that reward acts on lingering representations of environmental stimuli that sustain through the interval between stimulus and outcome. Using naturalistic scene stimuli and multivariate pattern analysis of fMRI data, we show that reward boosts the representation of attended objects and reduces the representation of unattended objects. This interaction of attention and reward processing acts to prime vision for stimuli that may serve to predict outcome. Copyright © 2017 the authors 0270-6474/17/377297-08$15.00/0.

Neurobiological constraints on behavioral models of motivation.

PubMed

Nader, K; Bechara, A; van der Kooy, D

1997-01-01

The application of neurobiological tools to behavioral questions has produced a number of working models of the mechanisms mediating the rewarding and aversive properties of stimuli. The authors review and compare three models that differ in the nature and number of the processes identified. The dopamine hypothesis, a single system model, posits that the neurotransmitter dopamine plays a fundamental role in mediating the rewarding properties of all classes of stimuli. In contrast, both nondeprived/deprived and saliency attribution models claim that separate systems make independent contributions to reward. The former identifies the psychological boundary defined by the two systems as being between states of nondeprivation (e.g. food sated) and deprivation (e.g. hunger). The latter identifies a boundary between liking and wanting systems. Neurobiological dissociations provide tests of and explanatory power for behavioral theories of goal-directed behavior.

Greater effort increases perceived value in an invertebrate.

PubMed

Czaczkes, Tomer J; Brandstetter, Birgit; di Stefano, Isabella; Heinze, Jürgen

2018-05-01

Expending effort is generally considered to be undesirable. However, both humans and vertebrates will work for a reward they could also get for free. Moreover, cues associated with high-effort rewards are preferred to low-effort associated cues. Many explanations for these counterintuitive findings have been suggested, including cognitive dissonance (self-justification) or a greater contrast in state (e.g., energy or frustration level) before and after an effort-linked reward. Here, we test whether effort expenditure also increases perceived value in ants, using both classical cue-association methods and pheromone deposition, which correlates with perceived value. In 2 separate experimental setups, we show that pheromone deposition is higher toward the reward that requires more effort: 47% more pheromone deposition was performed for rewards reached via a vertical runway (high effort) compared with ones reached via a horizontal runway (low effort), and deposition rates were 28% higher on rough (high effort) versus smooth (low effort) runways. Using traditional cue-association methods, 63% of ants trained on different surface roughness, and 70% of ants trained on different runway elevations, preferred the high-effort related cues on a Y maze. Finally, pheromone deposition to feeders requiring memorization of one path bifurcation was up to 29% higher than to an identical feeder requiring no learning. Our results suggest that effort affects value perception in ants. This effect may stem from a cognitive process, which monitors the change in a generalized hedonic state before and after reward. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

A Leptin-Mediated Central Mechanism in Analgesia-Enhanced Opioid Reward in Rats

PubMed Central

Lim, Grewo; Kim, Hyangin; McCabe, Michael F.; Chou, Chiu-Wen; Wang, Shuxing; Chen, Lucy L.; Marota, John J.A.; Blood, Anne; Breiter, Hans C.

2014-01-01

Opioid analgesics are commonly used in chronic pain management despite a potential risk of rewarding. However, it remains unclear whether opioid analgesia would enhance the opioid rewarding effect thereby contributing to opioid rewarding. Utilizing a rat paradigm of conditioned place preference (CPP) combined with ankle monoarthritis as a condition of persistent nociception, we showed that analgesia induced by either morphine or the nonsteroid anti-inflammatory drug ibuprofen increased CPP scores in arthritic rats, suggesting that analgesia itself had a rewarding effect. However, arthritic rats exhibited a significantly higher CPP score in response to morphine than ibuprofen. Thus, the rewarding effect of morphine was enhanced in the presence of persistent nociception, producing a phenomenon of analgesia-enhanced opioid reward. At the cellular level, administration of morphine activated a cascade of leptin expression, glial activation, and dopamine receptor upregulation in the nucleus accumbens (NAc), while administration of ibuprofen decreased glial activation with no effect on leptin expression in the NAc. Furthermore, the morphine rewarding effect was blocked in leptin deficient ob/ob mice or by neutralizing leptin or interleukin-1β in the NAc without diminishing morphine analgesia. The data indicate that systemic opioid can activate a leptin-mediated central mechanism in the NAc that led to the enhanced opioid rewarding effect. These findings provide evidence for an interaction between opioid analgesia and opioid rewarding, which may have implications in clinical opioid dose escalation in chronic pain management. PMID:25031415

Reward-based learning under hardware constraints-using a RISC processor embedded in a neuromorphic substrate.

PubMed

Friedmann, Simon; Frémaux, Nicolas; Schemmel, Johannes; Gerstner, Wulfram; Meier, Karlheinz

2013-01-01

In this study, we propose and analyze in simulations a new, highly flexible method of implementing synaptic plasticity in a wafer-scale, accelerated neuromorphic hardware system. The study focuses on globally modulated STDP, as a special use-case of this method. Flexibility is achieved by embedding a general-purpose processor dedicated to plasticity into the wafer. To evaluate the suitability of the proposed system, we use a reward modulated STDP rule in a spike train learning task. A single layer of neurons is trained to fire at specific points in time with only the reward as feedback. This model is simulated to measure its performance, i.e., the increase in received reward after learning. Using this performance as baseline, we then simulate the model with various constraints imposed by the proposed implementation and compare the performance. The simulated constraints include discretized synaptic weights, a restricted interface between analog synapses and embedded processor, and mismatch of analog circuits. We find that probabilistic updates can increase the performance of low-resolution weights, a simple interface between analog synapses and processor is sufficient for learning, and performance is insensitive to mismatch. Further, we consider communication latency between wafer and the conventional control computer system that is simulating the environment. This latency increases the delay, with which the reward is sent to the embedded processor. Because of the time continuous operation of the analog synapses, delay can cause a deviation of the updates as compared to the not delayed situation. We find that for highly accelerated systems latency has to be kept to a minimum. This study demonstrates the suitability of the proposed implementation to emulate the selected reward modulated STDP learning rule. It is therefore an ideal candidate for implementation in an upgraded version of the wafer-scale system developed within the BrainScaleS project.

The Effect of Incentives and Meta-incentives on the Evolution of Cooperation.

PubMed

Okada, Isamu; Yamamoto, Hitoshi; Toriumi, Fujio; Sasaki, Tatsuya

2015-05-01

Although positive incentives for cooperators and/or negative incentives for free-riders in social dilemmas play an important role in maintaining cooperation, there is still the outstanding issue of who should pay the cost of incentives. The second-order free-rider problem, in which players who do not provide the incentives dominate in a game, is a well-known academic challenge. In order to meet this challenge, we devise and analyze a meta-incentive game that integrates positive incentives (rewards) and negative incentives (punishments) with second-order incentives, which are incentives for other players' incentives. The critical assumption of our model is that players who tend to provide incentives to other players for their cooperative or non-cooperative behavior also tend to provide incentives to their incentive behaviors. In this paper, we solve the replicator dynamics for a simple version of the game and analytically categorize the game types into four groups. We find that the second-order free-rider problem is completely resolved without any third-order or higher (meta) incentive under the assumption. To do so, a second-order costly incentive, which is given individually (peer-to-peer) after playing donation games, is needed. The paper concludes that (1) second-order incentives for first-order reward are necessary for cooperative regimes, (2) a system without first-order rewards cannot maintain a cooperative regime, (3) a system with first-order rewards and no incentives for rewards is the worst because it never reaches cooperation, and (4) a system with rewards for incentives is more likely to be a cooperative regime than a system with punishments for incentives when the cost-effect ratio of incentives is sufficiently large. This solution is general and strong in the sense that the game does not need any centralized institution or proactive system for incentives.

Reward-based learning under hardware constraints—using a RISC processor embedded in a neuromorphic substrate

PubMed Central

Friedmann, Simon; Frémaux, Nicolas; Schemmel, Johannes; Gerstner, Wulfram; Meier, Karlheinz

2013-01-01

In this study, we propose and analyze in simulations a new, highly flexible method of implementing synaptic plasticity in a wafer-scale, accelerated neuromorphic hardware system. The study focuses on globally modulated STDP, as a special use-case of this method. Flexibility is achieved by embedding a general-purpose processor dedicated to plasticity into the wafer. To evaluate the suitability of the proposed system, we use a reward modulated STDP rule in a spike train learning task. A single layer of neurons is trained to fire at specific points in time with only the reward as feedback. This model is simulated to measure its performance, i.e., the increase in received reward after learning. Using this performance as baseline, we then simulate the model with various constraints imposed by the proposed implementation and compare the performance. The simulated constraints include discretized synaptic weights, a restricted interface between analog synapses and embedded processor, and mismatch of analog circuits. We find that probabilistic updates can increase the performance of low-resolution weights, a simple interface between analog synapses and processor is sufficient for learning, and performance is insensitive to mismatch. Further, we consider communication latency between wafer and the conventional control computer system that is simulating the environment. This latency increases the delay, with which the reward is sent to the embedded processor. Because of the time continuous operation of the analog synapses, delay can cause a deviation of the updates as compared to the not delayed situation. We find that for highly accelerated systems latency has to be kept to a minimum. This study demonstrates the suitability of the proposed implementation to emulate the selected reward modulated STDP learning rule. It is therefore an ideal candidate for implementation in an upgraded version of the wafer-scale system developed within the BrainScaleS project. PMID:24065877

The Effect of Incentives and Meta-incentives on the Evolution of Cooperation

PubMed Central

Okada, Isamu; Yamamoto, Hitoshi; Toriumi, Fujio; Sasaki, Tatsuya

2015-01-01

Although positive incentives for cooperators and/or negative incentives for free-riders in social dilemmas play an important role in maintaining cooperation, there is still the outstanding issue of who should pay the cost of incentives. The second-order free-rider problem, in which players who do not provide the incentives dominate in a game, is a well-known academic challenge. In order to meet this challenge, we devise and analyze a meta-incentive game that integrates positive incentives (rewards) and negative incentives (punishments) with second-order incentives, which are incentives for other players’ incentives. The critical assumption of our model is that players who tend to provide incentives to other players for their cooperative or non-cooperative behavior also tend to provide incentives to their incentive behaviors. In this paper, we solve the replicator dynamics for a simple version of the game and analytically categorize the game types into four groups. We find that the second-order free-rider problem is completely resolved without any third-order or higher (meta) incentive under the assumption. To do so, a second-order costly incentive, which is given individually (peer-to-peer) after playing donation games, is needed. The paper concludes that (1) second-order incentives for first-order reward are necessary for cooperative regimes, (2) a system without first-order rewards cannot maintain a cooperative regime, (3) a system with first-order rewards and no incentives for rewards is the worst because it never reaches cooperation, and (4) a system with rewards for incentives is more likely to be a cooperative regime than a system with punishments for incentives when the cost-effect ratio of incentives is sufficiently large. This solution is general and strong in the sense that the game does not need any centralized institution or proactive system for incentives. PMID:25974684

Dopaminergic stimulation increases selfish behavior in the absence of punishment threat.

PubMed

Pedroni, Andreas; Eisenegger, Christoph; Hartmann, Matthias N; Fischbacher, Urs; Knoch, Daria

2014-01-01

People often face decisions that pit self-interested behavior aimed at maximizing personal reward against normative behavior such as acting cooperatively, which benefits others. The threat of social sanctions for defying the fairness norm prevents people from behaving overly selfish. Thus, normative behavior is influenced by both seeking rewards and avoiding punishment. However, the neurochemical processes mediating the impact of these influences remain unknown. Several lines of evidence link the dopaminergic system to reward and punishment processing, respectively, but this evidence stems from studies in non-social contexts. The present study investigates dopaminergic drug effects on individuals' reward seeking and punishment avoidance in social interaction. Two-hundred one healthy male participants were randomly assigned to receive 300 mg of L-3,4-dihydroxyphenylalanine (L-DOPA) or a placebo before playing an economic bargaining game. This game involved two conditions, one in which unfair behavior could be punished and one in which unfair behavior could not be punished. In the absence of punishment threats, L-DOPA administration led to more selfish behavior, likely mediated through an increase in reward seeking. In contrast, L-DOPA administration had no significant effect on behavior when faced with punishment threats. The results of this study broaden the role of the dopaminergic system in reward seeking to human social interactions. We could show that even a single dose of a dopaminergic drug may bring selfish behavior to the fore, which in turn may shed new light on potential causal relationships between the dopaminergic system and norm abiding behaviors in certain clinical subpopulations.

A mechanistic hypothesis of the factors that enhance vulnerability to nicotine use in females

PubMed Central

O'Dell, Laura E.; Torres, Oscar V.

2013-01-01

Women are particularly more vulnerable to tobacco use than men. This review proposes a unifying hypothesis that females experience greater rewarding effects of nicotine and more intense stress produced by withdrawal than males. We also provide a neural framework whereby estrogen promotes greater rewarding effects of nicotine in females via enhanced dopamine release in the nucleus accumbens (NAcc). During withdrawal, we suggest that corticotropin-releasing factor (CRF) stress systems are sensitized and promote a greater suppression of dopamine release in the NAcc of females versus males. Taken together, females display enhanced nicotine reward via estrogen and amplified effects of withdrawal via stress systems. Although this framework focuses on sex differences in adult rats, it is also applied to adolescent females who display enhanced rewarding effects of nicotine, but reduced effects of withdrawal from this drug. Since females experience strong rewarding effects of nicotine, a clinical implication of our hypothesis is that specific strategies to prevent smoking initiation among females are critical. Also, anxiolytic medications may be more effective in females that experience intense stress during withdrawal. Furthermore, medications that target withdrawal should not be applied in a unilateral manner across age and sex, given that nicotine withdrawal is lower during adolescence. This review highlights key factors that promote nicotine use in females, and future studies on sex-dependent interactions of stress and reward systems are needed to test our mechanistic hypotheses. Future studies in this area will have important translational value toward reducing health disparities produced by nicotine use in females. PMID:23684991

Listening to Rhythmic Music Reduces Connectivity within the Basal Ganglia and the Reward System.

PubMed

Brodal, Hans P; Osnes, Berge; Specht, Karsten

2017-01-01

Music can trigger emotional responses in a more direct way than any other stimulus. In particular, music-evoked pleasure involves brain networks that are part of the reward system. Furthermore, rhythmic music stimulates the basal ganglia and may trigger involuntary movements to the beat. In the present study, we created a continuously playing rhythmic, dance floor-like composition where the ambient noise from the MR scanner was incorporated as an additional instrument of rhythm. By treating this continuous stimulation paradigm as a variant of resting-state, the data was analyzed with stochastic dynamic causal modeling (sDCM), which was used for exploring functional dependencies and interactions between core areas of auditory perception, rhythm processing, and reward processing. The sDCM model was a fully connected model with the following areas: auditory cortex, putamen/pallidum, and ventral striatum/nucleus accumbens of both hemispheres. The resulting estimated parameters were compared to ordinary resting-state data, without an additional continuous stimulation. Besides reduced connectivity within the basal ganglia, the results indicated a reduced functional connectivity of the reward system, namely the right ventral striatum/nucleus accumbens from and to the basal ganglia and auditory network while listening to rhythmic music. In addition, the right ventral striatum/nucleus accumbens demonstrated also a change in its hemodynamic parameter, reflecting an increased level of activation. These converging results may indicate that the dopaminergic reward system reduces its functional connectivity and relinquishing its constraints on other areas when we listen to rhythmic music.

Listening to Rhythmic Music Reduces Connectivity within the Basal Ganglia and the Reward System

PubMed Central

Brodal, Hans P.; Osnes, Berge; Specht, Karsten

2017-01-01

Music can trigger emotional responses in a more direct way than any other stimulus. In particular, music-evoked pleasure involves brain networks that are part of the reward system. Furthermore, rhythmic music stimulates the basal ganglia and may trigger involuntary movements to the beat. In the present study, we created a continuously playing rhythmic, dance floor-like composition where the ambient noise from the MR scanner was incorporated as an additional instrument of rhythm. By treating this continuous stimulation paradigm as a variant of resting-state, the data was analyzed with stochastic dynamic causal modeling (sDCM), which was used for exploring functional dependencies and interactions between core areas of auditory perception, rhythm processing, and reward processing. The sDCM model was a fully connected model with the following areas: auditory cortex, putamen/pallidum, and ventral striatum/nucleus accumbens of both hemispheres. The resulting estimated parameters were compared to ordinary resting-state data, without an additional continuous stimulation. Besides reduced connectivity within the basal ganglia, the results indicated a reduced functional connectivity of the reward system, namely the right ventral striatum/nucleus accumbens from and to the basal ganglia and auditory network while listening to rhythmic music. In addition, the right ventral striatum/nucleus accumbens demonstrated also a change in its hemodynamic parameter, reflecting an increased level of activation. These converging results may indicate that the dopaminergic reward system reduces its functional connectivity and relinquishing its constraints on other areas when we listen to rhythmic music. PMID:28400717

Rewarding Teachers without Pay Increases.

ERIC Educational Resources Information Center

Hayden, Gary

1993-01-01

Today's educational institutions should establish a system of intrinsic rewards for teachers and other staff. This article reviews research on intrinsic motivators, including Deming's total quality concepts, and recommends providing teachers with more individualized instruction, reorganizing faculty supervision practices, giving teachers greater…

Goal-Directed Decision Making as Probabilistic Inference: A Computational Framework and Potential Neural Correlates

ERIC Educational Resources Information Center

Solway, Alec; Botvinick, Matthew M.

2012-01-01

Recent work has given rise to the view that reward-based decision making is governed by two key controllers: a habit system, which stores stimulus-response associations shaped by past reward, and a goal-oriented system that selects actions based on their anticipated outcomes. The current literature provides a rich body of computational theory…

The neurobiology of reward and cognitive control systems and their role in incentivizing health behavior.

PubMed

Garavan, Hugh; Weierstall, Karen

2012-11-01

This article reviews the neurobiology of cognitive control and reward processes and addresses their role in the treatment of addiction. We propose that the neurobiological mechanisms involved in treatment may differ from those involved in the etiology of addiction and consequently are worthy of increased investigation. We review the literature on reward and control processes and evidence of differences in these systems in drug addicted individuals. We also review the relatively small literature on neurobiological predictors of abstinence. We conclude that prefrontal control systems may be central to a successful recovery from addiction. The frontal lobes have been shown to regulate striatal reward-related processes, to be among the regions that predict treatment outcome, and to show elevated functioning in those who have succeeded in maintaining abstinence. The evidence of the involvement of the frontal lobes in recovery is consistent with the hypothesis that recovery is a distinct process that is more than the undoing of those processes involved in becoming addicted and a return to the pre-addiction state of the individual. The extent to which these frontal systems are engaged by treatment interventions may contribute to their efficacy. Copyright © 2012 Elsevier Inc. All rights reserved.

Abstinent adult daily smokers show reduced anticipatory but elevated saccade-related brain responses during a rewarded antisaccade task.

PubMed

Geier, Charles F; Sweitzer, Maggie M; Denlinger, Rachel; Sparacino, Gina; Donny, Eric C

2014-08-30

Chronic smoking may result in reduced sensitivity to non-drug rewards (e.g., money), a phenomenon particularly salient during abstinence. During a quit attempt, this effect may contribute to biased decision-making (smoking>alternative reinforcers) and relapse. Although relevant for quitting, characterization of reduced reward function in abstinent smokers remains limited. Moreover, how attenuated reward function affects other brain systems supporting decision-making has not been established. Here, we use a rewarded antisaccade (rAS) task to characterize non-drug reward processing and its influence on inhibitory control, key elements underlying decision-making, in abstinent smokers vs. non-smokers. Abstinent (12-hours) adult daily smokers (N=23) and non-smokers (N=11) underwent fMRI while performing the rAS. Behavioral performances improved on reward vs. neutral trials. Smokers showed attenuated activation in ventral striatum during the reward cue and in superior precentral sulcus and posterior parietal cortex during response preparation, but greater responses during the saccade response in posterior cingulate and parietal cortices. Smokers' attenuated anticipatory responses suggest reduced motivation from monetary reward, while heightened activation during the saccade response suggests that additional circuitry may be engaged later to enhance inhibitory task performance. Overall, this preliminary study highlights group differences in decision-making components and the utility of the rAS to characterize these effects. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Comparing the neural basis of monetary reward and cognitive feedback during information-integration category learning.

PubMed

Daniel, Reka; Pollmann, Stefan

2010-01-06

The dopaminergic system is known to play a central role in reward-based learning (Schultz, 2006), yet it was also observed to be involved when only cognitive feedback is given (Aron et al., 2004). Within the domain of information-integration category learning, in which information from several stimulus dimensions has to be integrated predecisionally (Ashby and Maddox, 2005), the importance of contingent feedback is well established (Maddox et al., 2003). We examined the common neural correlates of reward anticipation and prediction error in this task. Sixteen subjects performed two parallel information-integration tasks within a single event-related functional magnetic resonance imaging session but received a monetary reward only for one of them. Similar functional areas including basal ganglia structures were activated in both task versions. In contrast, a single structure, the nucleus accumbens, showed higher activation during monetary reward anticipation compared with the anticipation of cognitive feedback in information-integration learning. Additionally, this activation was predicted by measures of intrinsic motivation in the cognitive feedback task and by measures of extrinsic motivation in the rewarded task. Our results indicate that, although all other structures implicated in category learning are not significantly affected by altering the type of reward, the nucleus accumbens responds to the positive incentive properties of an expected reward depending on the specific type of the reward.

Lipopolysaccharide Alters Motivated Behavior in a Monetary Reward Task: a Randomized Trial.

PubMed

Lasselin, Julie; Treadway, Michael T; Lacourt, Tamara E; Soop, Anne; Olsson, Mats J; Karshikoff, Bianka; Paues-Göranson, Sofie; Axelsson, John; Dantzer, Robert; Lekander, Mats

2017-03-01

Inflammation-induced sickness is associated with a large set of behavioral alterations; however, its motivational aspects remain poorly explored in humans. The present study assessed the effect of lipopolysaccharide (LPS) administration at a dose of 2 ng/kg of body weight on motivation in 21 healthy human subjects in a double-blinded, placebo (saline)-controlled, cross-over design. Incentive motivation and reward sensitivity were measured using the Effort Expenditure for Rewards Task (EEfRT), in which motivation for high-effort/high-reward trials vs low-effort/low-reward trials are manipulated by variations in reward magnitude and probability to win. Because of the strong interactions between sleepiness and motivation, the role of sleepiness was also determined. As expected, the probability to win predicted the choice to engage in high-effort/high-reward trials; however, this occurred at a greater extent after LPS than after saline administration. This effect was related to the level of sleepiness. Sleepiness increased motivation to choose the high-effort/high-reward mode of response, but only when the probability to win was the highest. LPS had no effect on reward sensitivity either directly or via sleepiness. These results indicate that systemic inflammation induced by LPS administration causes motivational changes in young healthy subjects, which are associated with sleepiness. Thus, despite its association with energy-saving behaviors, sickness allows increased incentive motivation when the effort is deemed worthwhile.

Toward an autonomous brain machine interface: integrating sensorimotor reward modulation and reinforcement learning.

PubMed

Marsh, Brandi T; Tarigoppula, Venkata S Aditya; Chen, Chen; Francis, Joseph T

2015-05-13

For decades, neurophysiologists have worked on elucidating the function of the cortical sensorimotor control system from the standpoint of kinematics or dynamics. Recently, computational neuroscientists have developed models that can emulate changes seen in the primary motor cortex during learning. However, these simulations rely on the existence of a reward-like signal in the primary sensorimotor cortex. Reward modulation of the primary sensorimotor cortex has yet to be characterized at the level of neural units. Here we demonstrate that single units/multiunits and local field potentials in the primary motor (M1) cortex of nonhuman primates (Macaca radiata) are modulated by reward expectation during reaching movements and that this modulation is present even while subjects passively view cursor motions that are predictive of either reward or nonreward. After establishing this reward modulation, we set out to determine whether we could correctly classify rewarding versus nonrewarding trials, on a moment-to-moment basis. This reward information could then be used in collaboration with reinforcement learning principles toward an autonomous brain-machine interface. The autonomous brain-machine interface would use M1 for both decoding movement intention and extraction of reward expectation information as evaluative feedback, which would then update the decoding algorithm as necessary. In the work presented here, we show that this, in theory, is possible. Copyright © 2015 the authors 0270-6474/15/357374-14$15.00/0.

Reward-related frontostriatal activity and smoking behavior among adolescents in treatment for smoking cessation.

PubMed

Garrison, Kathleen A; Yip, Sarah W; Balodis, Iris M; Carroll, Kathleen M; Potenza, Marc N; Krishnan-Sarin, Suchitra

2017-08-01

Tobacco use is often initiated during adolescence and continued into adulthood despite desires to quit. A better understanding of the neural correlates of abstinence from smoking in adolescents may inform more effective smoking cessation interventions. Neural reward systems are implicated in tobacco use disorder, and adolescent smokers have shown reduced reward-related ventral striatal activation related to increased smoking. The current study evaluated nondrug reward anticipation in adolescent smokers using a monetary incentive delay task in fMRI pre- and post- smoking cessation treatment (n=14). This study tested how changes in neural responses to reward anticipation pre- to post-treatment were related to reduced smoking. An exploratory analysis in a larger sample of adolescents with only pre-treatment fMRI (n=28) evaluated how neural responses to reward anticipation were related to behavioral inhibition and behavioral activation scales. Adolescent smokers showed pre- to post-treatment increases in reward anticipation-related activity in the bilateral nucleus accumbens and insula, and medial prefrontal cortex, and greater increases in reward anticipation-related activity were correlated with larger percent days of smoking abstinence during treatment. These findings suggest that reduced smoking during smoking cessation treatment is associated with a "recovery of function" in frontostriatal responses to nondrug reward anticipation in adolescent smokers, although comparison with a developmental control group of adolescent nonsmokers is warranted. Copyright © 2017 Elsevier B.V. All rights reserved.

Lipopolysaccharide Alters Motivated Behavior in a Monetary Reward Task: a Randomized Trial

PubMed Central

Lasselin, Julie; Treadway, Michael T; Lacourt, Tamara E; Soop, Anne; Olsson, Mats J; Karshikoff, Bianka; Paues-Göranson, Sofie; Axelsson, John; Dantzer, Robert; Lekander, Mats

2017-01-01

Inflammation-induced sickness is associated with a large set of behavioral alterations; however, its motivational aspects remain poorly explored in humans. The present study assessed the effect of lipopolysaccharide (LPS) administration at a dose of 2 ng/kg of body weight on motivation in 21 healthy human subjects in a double-blinded, placebo (saline)-controlled, cross-over design. Incentive motivation and reward sensitivity were measured using the Effort Expenditure for Rewards Task (EEfRT), in which motivation for high-effort/high-reward trials vs low-effort/low-reward trials are manipulated by variations in reward magnitude and probability to win. Because of the strong interactions between sleepiness and motivation, the role of sleepiness was also determined. As expected, the probability to win predicted the choice to engage in high-effort/high-reward trials; however, this occurred at a greater extent after LPS than after saline administration. This effect was related to the level of sleepiness. Sleepiness increased motivation to choose the high-effort/high-reward mode of response, but only when the probability to win was the highest. LPS had no effect on reward sensitivity either directly or via sleepiness. These results indicate that systemic inflammation induced by LPS administration causes motivational changes in young healthy subjects, which are associated with sleepiness. Thus, despite its association with energy-saving behaviors, sickness allows increased incentive motivation when the effort is deemed worthwhile. PMID:27620550

Neuronal correlates of reward and loss in Cluster B personality disorders: a functional magnetic resonance imaging study.

PubMed

Völlm, Birgit; Richardson, Paul; McKie, Shane; Elliott, Rebecca; Dolan, Mairead; Deakin, Bill

2007-11-15

Decision making is guided by the likely consequences of behavioural choices. Neuronal correlates of financial reward have been described in a number of functional imaging studies in humans. Areas implicated in reward include ventral striatum, dopaminergic midbrain, amygdala and orbitofrontal cortex. Response to loss has not been as extensively studied but may involve prefrontal and medial temporal cortices. It has been proposed that increased sensitivity to reward and reduced sensitivity to punishment underlie some of the psychopathology in impulsive personality disordered individuals. However, few imaging studies using reinforcement tasks have been conducted in this group. In this fMRI study, we investigate the effects of positive (monetary reward) and negative (monetary loss) outcomes on BOLD responses in two target selection tasks. The experimental group comprised eight people with Cluster B (antisocial and borderline) personality disorder, whilst the control group contained fourteen healthy participants. A key finding was the absence of prefrontal responses and reduced BOLD signal in the subcortical reward system in the PD group during positive reinforcement. Impulsivity scores correlated negatively with prefrontal responses in the PD but not the control group during both, reward and loss. Our results suggest dysfunctional responses to rewarding and aversive stimuli in Cluster B personality disordered individuals but do not support the notion of hypersensitivity to reward and hyposensitivity to loss.

Parental substance abuse and function of the motivation and behavioral inhibition systems in drug-naïve youth.

PubMed

Ivanov, Iliyan; Liu, Xun; Shulz, Kurt; Fan, Jin; London, Edythe; Friston, Karl; Halperin, Jeffrey M; Newcorn, Jeffrey H

2012-02-28

It is hypothesized that the development of substance abuse (SA) may be due to imbalance in functions of the motivation-reward and behavioral inhibition systems in the brain. This speaks to the search for biological risk factors for SA in drug-naïve children who also exhibit motivational and inhibitory control deficits; however, this type of research is currently lacking. The objective of this study was to establish a neurobiological basis for addiction vulnerability using functional magnetic resonance imaging (fMRI) in drug-naïve youth with attention deficit/hyperactivity disorder (ADHD). We hypothesized that children with ADHD alone would show higher activity in regions of the motivation-reward and behavioral inhibition systems than children with ADHD and a parental history of SA. Toward this goal we scanned 20 drug-naïve children with ADHD ages 8-13 while performing an event-related reward task. High (N=10) and low (N=10) risk subjects were identified, based on parental history of SA. The effects of anticipation, conflict, and reward were assessed with appropriate linear contrasts, and between-group differences were assessed using statistical parametric mapping. The two groups did not differ on behavioral measures of the task. The fMRI results show heightened activation in the brain motivational-reward system and reduced activation of the inhibitory control system in high-risk compared to low-risk children. These results suggest that a functional mismatch between these two systems may represent one possible biological underpinning of SA risk, which is conferred by a parental history of addiction. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Value-modulated oculomotor capture by task-irrelevant stimuli is a consequence of early competition on the saccade map.

PubMed

Pearson, Daniel; Osborn, Raphaella; Whitford, Thomas J; Failing, Michel; Theeuwes, Jan; Le Pelley, Mike E

2016-10-01

Recent research has shown that reward learning can modulate oculomotor and attentional capture by physically salient and task-irrelevant distractor stimuli, even when directing gaze to those stimuli is directly counterproductive to receiving reward. This value-modulated oculomotor capture effect may reflect biased competition in the oculomotor system, such that the relationship between a stimulus feature and reward enhances that feature's representation on an internal priority map. However, it is also possible that this effect is a result of reward reducing the threshold for a saccade to be made to salient items. Here, we demonstrate value-modulated oculomotor capture when two reward-associated distractor stimuli are presented simultaneously in the same search display. The influence of reward on oculomotor capture is found to be most prominent at the shortest saccade latencies. We conclude that the value-modulated oculomotor capture effect is a consequence of biased competition on the saccade priority map and cannot be explained by a general reduction in saccadic threshold.

Looking for reward in all the wrong places: dopamine receptor gene polymorphisms indirectly affect aggression through sensation-seeking.

PubMed

Chester, David S; DeWall, C Nathan; Derefinko, Karen J; Estus, Steven; Lynam, Donald R; Peters, Jessica R; Jiang, Yang

2016-10-01

Individuals with genotypes that code for reduced dopaminergic brain activity often exhibit a predisposition toward aggression. However, it remains largely unknown how dopaminergic genotypes may increase aggression. Lower-functioning dopamine systems motivate individuals to seek reward from external sources such as illicit drugs and other risky experiences. Based on emerging evidence that aggression is a rewarding experience, we predicted that the effect of lower-functioning dopaminergic functioning on aggression would be mediated by tendencies to seek the environment for rewards. Caucasian female and male undergraduates (N = 277) were genotyped for five polymorphisms of the dopamine D2 receptor (DRD2) gene; they reported their previous history of aggression and their dispositional reward-seeking. Lower-functioning DRD2 profiles were associated with greater sensation-seeking, which then predicted greater aggression. Our findings suggest that lower-functioning dopaminergic activity puts individuals at risk for violence because it motivates them to experience aggression's hedonically rewarding qualities.

Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feedback error-related negativity and N200.

PubMed

Baker, Travis E; Holroyd, Clay B

2011-04-01

The reinforcement learning theory of the error-related negativity (ERN) holds that the impact of reward signals carried by the midbrain dopamine system modulates activity of the anterior cingulate cortex (ACC), alternatively disinhibiting and inhibiting the ACC following unpredicted error and reward events, respectively. According to a recent formulation of the theory, activity that is intrinsic to the ACC produces a component of the event-related brain potential (ERP) called the N200, and following unpredicted rewards, the N200 is suppressed by extrinsically applied positive dopamine reward signals, resulting in an ERP component called the feedback-ERN (fERN). Here we demonstrate that, despite extensive spatial and temporal overlap between the two ERP components, the functional processes indexed by the N200 (conflict) and the fERN (reward) are dissociable. These results point toward avenues for future investigation. Copyright © 2011 Elsevier B.V. All rights reserved.

A review of reward processing and motivational impairment in schizophrenia.

PubMed

Strauss, Gregory P; Waltz, James A; Gold, James M

2014-03-01

This article reviews and synthesizes research on reward processing in schizophrenia, which has begun to provide important insights into the cognitive and neural mechanisms associated with motivational impairments. Aberrant cortical-striatal interactions may be involved with multiple reward processing abnormalities, including: (1) dopamine-mediated basal ganglia systems that support reinforcement learning and the ability to predict cues that lead to rewarding outcomes; (2) orbitofrontal cortex-driven deficits in generating, updating, and maintaining value representations; (3) aberrant effort-value computations, which may be mediated by disrupted anterior cingulate cortex and midbrain dopamine functioning; and (4) altered activation of the prefrontal cortex, which is important for generating exploratory behaviors in environments where reward outcomes are uncertain. It will be important for psychosocial interventions targeting negative symptoms to account for abnormalities in each of these reward processes, which may also have important interactions; suggestions for novel behavioral intervention strategies that make use of external cues, reinforcers, and mobile technology are discussed.

Reward-based spatial crowdsourcing with differential privacy preservation

NASA Astrophysics Data System (ADS)

Xiong, Ping; Zhang, Lefeng; Zhu, Tianqing

2017-11-01

In recent years, the popularity of mobile devices has transformed spatial crowdsourcing (SC) into a novel mode for performing complicated projects. Workers can perform tasks at specified locations in return for rewards offered by employers. Existing methods ensure the efficiency of their systems by submitting the workers' exact locations to a centralised server for task assignment, which can lead to privacy violations. Thus, implementing crowsourcing applications while preserving the privacy of workers' location is a key issue that needs to be tackled. We propose a reward-based SC method that achieves acceptable utility as measured by task assignment success rates, while efficiently preserving privacy. A differential privacy model ensures rigorous privacy guarantee, and Laplace noise is introduced to protect workers' exact locations. We then present a reward allocation mechanism that adjusts each piece of the reward for a task using the distribution of the workers' locations. Through experimental results, we demonstrate that this optimised-reward method is efficient for SC applications.

Potential effects of reward and loss avoidance in overweight adolescents

PubMed Central

Reyes, Sussanne; Peirano, Patricio; Luna, Beatriz; Lozoff, Betsy; Algarín, Cecilia

2015-01-01

Background Reward system and inhibitory control are brain functions that exert an influence on eating behavior regulation. We studied the differences in inhibitory control and sensitivity to reward and loss avoidance between overweight/obese and normal-weight adolescents. Methods We assessed 51 overweight/obese and 52 normal-weight 15-y-old Chilean adolescents. The groups were similar regarding sex and intelligence quotient. Using Antisaccade and Incentive tasks, we evaluated inhibitory control and the effect of incentive trials (neutral, loss avoidance, and reward) on generating correct and incorrect responses (latency and error rate). Results Compared to normal-weight group participants, overweight/obese adolescents showed shorter latency for incorrect antisaccade responses (186.0 (95% CI: 176.8–195.2) vs. 201.3 ms (95% CI: 191.2–211.5), P < 0.05) and better performance reflected by lower error rate in incentive trials (43.6 (95% CI: 37.8–49.4) vs. 53.4% (95% CI: 46.8–60.0), P < 0.05). Overweight/obese adolescents were more accurate on loss avoidance (40.9 (95% CI: 33.5–47.7) vs. 49.8% (95% CI: 43.0–55.1), P < 0.05) and reward (41.0 (95% CI: 34.5–47.5) vs. 49.8% (95% CI: 43.0–55.1), P < 0.05) compared to neutral trials. Conclusion Overweight/obese adolescents showed shorter latency for incorrect responses and greater accuracy in reward and loss avoidance trials. These findings could suggest that an imbalance of inhibition and reward systems influence their eating behavior. PMID:25927543

Limbic responses to reward cues correlate with antisocial trait density in heavy drinkers.

PubMed

Oberlin, Brandon G; Dzemidzic, Mario; Bragulat, Veronique; Lehigh, Cari A; Talavage, Thomas; O'Connor, Sean J; Kareken, David A

2012-03-01

Antisocial traits are common among alcoholics- particularly in certain subtypes. Although people with antisocial tendencies show atypical brain activation in some emotion and reward paradigms, how the brain reward systems of heavy drinkers (HD) are influenced by antisocial traits remains unclear. We used subjects' preferred alcohol drink odors (AO), appetitive (ApCO) and non-appetitive (NApO) control odors in functional magnetic resonance imaging (fMRI) to determine if reward system responses varied as a function of antisocial trait density (ASD). In this retrospective analysis, we examined 30 HD who had participated in imaging twice: once while exposed to clamped intravenous alcohol infusion targeted to 50mg%, and once during placebo saline infusion. Under placebo, there were positive correlations between ASD and blood oxygenation level dependent (BOLD) activation in the [AO>ApCO] contrast in the left dorsal putamen, while negative correlations were present in medial orbitofrontal cortex (OFC) and the bilateral amygdala. A similar pattern was observed in the correlation with the [AO>NApO] contrast. This inverse relationship between ASD and activation in OFC and amygdala was specific to AO. However, negative correlations between ASD and the [ApCO>NApO] contrast were also present in the insula, putamen, and medial frontal cortex. These data suggest that frontal and limbic reward circuits of those with significant ASD are less responsive to reward cues in general, and particularly to alcohol cues in medial OFC and amygdala. These findings are broadly consistent with the reward deficiency syndrome hypothesis, although positive correlation in the striatum suggests regional variability. Copyright © 2011 Elsevier Inc. All rights reserved.

Reward-prospect interacts with trial-by-trial preparation for potential distraction

PubMed Central

Marini, Francesco; van den Berg, Berry; Woldorff, Marty G.

2015-01-01

When attending for impending visual stimuli, cognitive systems prepare to identify relevant information while ignoring irrelevant, potentially distracting input. Recent work (Marini et al., 2013) showed that a supramodal distracter-filtering mechanism is invoked in blocked designs involving expectation of possible distracter stimuli, although this entails a cost (distraction-filtering cost) on speeded performance when distracters are expected but not presented. Here we used an arrow-flanker task to study whether an analogous cost, potentially reflecting the recruitment of a specific distraction-filtering mechanism, occurs dynamically when potential distraction is cued trial-to-trial (cued distracter-expectation cost). In order to promote the maximal utilization of cue information by participants, in some experimental conditions the cue also signaled the possibility of earning a monetary reward for fast and accurate performance. This design also allowed us to investigate the interplay between anticipation for distracters and anticipation of reward, which is known to engender attentional preparation. Only in reward contexts did participants show a cued distracter-expectation cost, which was larger with higher reward prospect and when anticipation for both distracters and reward were manipulated trial-to-trial. Thus, these results indicate that reward prospect interacts with the distracter expectation during trial-by-trial preparatory processes for potential distraction. These findings highlight how reward guides cue-driven attentional preparation. PMID:26180506

Reward-prospect interacts with trial-by-trial preparation for potential distraction.

PubMed

Marini, Francesco; van den Berg, Berry; Woldorff, Marty G

2015-02-01

When attending for impending visual stimuli, cognitive systems prepare to identify relevant information while ignoring irrelevant, potentially distracting input. Recent work (Marini et al., 2013) showed that a supramodal distracter-filtering mechanism is invoked in blocked designs involving expectation of possible distracter stimuli, although this entails a cost ( distraction-filtering cost ) on speeded performance when distracters are expected but not presented. Here we used an arrow-flanker task to study whether an analogous cost, potentially reflecting the recruitment of a specific distraction-filtering mechanism, occurs dynamically when potential distraction is cued trial-to-trial ( cued distracter-expectation cost ). In order to promote the maximal utilization of cue information by participants, in some experimental conditions the cue also signaled the possibility of earning a monetary reward for fast and accurate performance. This design also allowed us to investigate the interplay between anticipation for distracters and anticipation of reward, which is known to engender attentional preparation. Only in reward contexts did participants show a cued distracter-expectation cost, which was larger with higher reward prospect and when anticipation for both distracters and reward were manipulated trial-to-trial. Thus, these results indicate that reward prospect interacts with the distracter expectation during trial-by-trial preparatory processes for potential distraction. These findings highlight how reward guides cue-driven attentional preparation.

Disentangling reward anticipation with simultaneous pupillometry / fMRI.

PubMed

Schneider, Max; Leuchs, Laura; Czisch, Michael; Sämann, Philipp G; Spoormaker, Victor I

2018-05-05

The reward system may provide an interesting intermediate phenotype for anhedonia in affective disorders. Reward anticipation is characterized by an increase in arousal, and previous studies have linked the anterior cingulate cortex (ACC) to arousal responses such as dilation of the pupil. Here, we examined pupil dynamics during a reward anticipation task in forty-six healthy human subjects and evaluated its neural correlates using functional magnetic resonance imaging (fMRI). Pupil size showed a strong increase during monetary reward anticipation, a moderate increase during verbal reward anticipation and a decrease during control trials. For fMRI analyses, average pupil size and pupil change were computed in 1-s time bins during the anticipation phase. Activity in the ventral striatum was inversely related to the pupil size time course, indicating an early onset of activation and a role in reward prediction processing. Pupil dilations were linked to increased activity in the salience network (dorsal ACC and bilateral insula), which likely triggers an increase in arousal to enhance task performance. Finally, increased pupil size preceding the required motor response was associated with activity in the ventral attention network. In sum, pupillometry provides an effective tool for disentangling different phases of reward anticipation, with relevance for affective symptomatology. Copyright © 2018 Elsevier Inc. All rights reserved.

Do Event-Related Evoked Potentials Reflect Apathy Tendency and Motivation?

PubMed Central

Takayoshi, Hiroyuki; Onoda, Keiichi; Yamaguchi, Shuhei

2018-01-01

Apathy is a mental state of diminished motivation. Although the reward system as the foundation of the motivation in the human brain has been studied extensively with neuroimaging techniques, the electrophysiological correlates of motivation and apathy have not been fully explored. Thus, in 14 healthy volunteers, we examined whether event-related evoked potentials (ERP) obtained during a simple number discrimination task with/without rewards reflected apathy tendency and a reward-dependent tendency, which were assessed separately using the apathy scale and the temperament and character inventory (TCI). Participants were asked to judge the size of a number, and received feedback based on their performance in each trial. The P3 amplitudes related to the feedback stimuli increased only in the reward condition. Furthermore, the P2 amplitudes related to the negative feedback stimuli in the reward condition had a positive correlation with the reward-dependent tendency in TCI, whereas the P3 amplitudes related to the positive feedback stimuli had a negative correlation with the apathy score. Our result suggests that the P2 and P3 ERPs to reward-related feedback stimuli are modulated in a distinctive manner by the motivational reward dependence and apathy tendency, and thus the current paradigm may be useful for investigating the brain activity associated with motivation. PMID:29445331

Cortisol alters reward processing in the human brain.

PubMed

Kinner, Valerie L; Wolf, Oliver T; Merz, Christian J

2016-08-01

Dysfunctional reward processing is known to play a central role for the development of psychiatric disorders. Glucocorticoids that are secreted in response to stress have been shown to attenuate reward sensitivity and thereby might promote the onset of psychopathology. However, the underlying neurobiological mechanisms mediating stress hormone effects on reward processing as well as potential sex differences remain elusive. In this neuroimaging study, we administered 30mg cortisol or a placebo to 30 men and 30 women and subsequently tested them in the Monetary Incentive Delay Task. Cortisol attenuated anticipatory neural responses to a verbal and a monetary reward in the left pallidum and the right anterior parahippocampal gyrus. Furthermore, in men, activation in the amygdala, the precuneus, the anterior cingulate, and in hippocampal regions was reduced under cortisol, whereas in cortisol-treated women a signal increase was observed in these regions. Behavioral performance also indicated that reward learning in men is impaired under high cortisol concentrations, while it is augmented in women. These findings illustrate that the stress hormone cortisol substantially diminishes reward anticipation and provide first evidence that cortisol effects on the neural reward system are sensitive to sex differences, which might translate into different vulnerabilities for psychiatric disorders. Copyright © 2016 Elsevier Inc. All rights reserved.

A systematic review of effort-reward imbalance among health workers.

PubMed

Nguyen Van, Huy; Dinh Le, Mai; Nguyen Van, Thanh; Nguyen Ngoc, Dung; Tran Thi Ngoc, Anh; Nguyen The, Phuong

2018-05-03

The purpose of this article is to systematically collate effort-reward imbalance (ERI) rates among health workers internationally and to assess gender differences. The effort-reward (ER) ratio ranges quite widely from 0.47 up to 1.32 and the ERI rate from 3.5% to 80.7%. Many studies suggested that health workers contribute more than they are rewarded, especially in Japan, Vietnam, Greece, and Germany-with ERI rates of 57.1%, 32.3%, 80.7%, and 22.8% to 27.6%, respectively. Institutions can utilize systems such as the new appraisal and reward system, which is based on performance rather than the traditional system, seniority, which creates a more competitive working climate and generates insecurity. Additionally, an increased workload and short stay patients are realities for workers in a health care environment, while the structure of human resources for health care remains inadequate. Gender differences within the ER ratio can be explained by the continued impact of traditional gender roles on attitudes and motivations that place more pressure to succeed for men rather than for women. This systematic review provides some valued evidence for public health strategies to improve the ER balance among health workers in general as well as between genders in particular. An innovative approach for managing human resources for health care is necessary to motivate and value contributions made by health workers. Copyright © 2018 John Wiley & Sons, Ltd.

Convergent evolution of floral signals underlies the success of Neotropical orchids.

PubMed

Papadopulos, Alexander S T; Powell, Martyn P; Pupulin, Franco; Warner, Jorge; Hawkins, Julie A; Salamin, Nicolas; Chittka, Lars; Williams, Norris H; Whitten, W Mark; Loader, Deniz; Valente, Luis M; Chase, Mark W; Savolainen, Vincent

2013-08-22

The great majority of plant species in the tropics require animals to achieve pollination, but the exact role of floral signals in attraction of animal pollinators is often debated. Many plants provide a floral reward to attract a guild of pollinators, and it has been proposed that floral signals of non-rewarding species may converge on those of rewarding species to exploit the relationship of the latter with their pollinators. In the orchid family (Orchidaceae), pollination is almost universally animal-mediated, but a third of species provide no floral reward, which suggests that deceptive pollination mechanisms are prevalent. Here, we examine floral colour and shape convergence in Neotropical plant communities, focusing on certain food-deceptive Oncidiinae orchids (e.g. Trichocentrum ascendens and Oncidium nebulosum) and rewarding species of Malpighiaceae. We show that the species from these two distantly related families are often more similar in floral colour and shape than expected by chance and propose that a system of multifarious floral mimicry--a form of Batesian mimicry that involves multiple models and is more complex than a simple one model-one mimic system--operates in these orchids. The same mimetic pollination system has evolved at least 14 times within the species-rich Oncidiinae throughout the Neotropics. These results help explain the extraordinary diversification of Neotropical orchids and highlight the complexity of plant-animal interactions.

Reward and relief dimensions of temptation to drink: construct validity and role in predicting differential benefit from acamprosate and naltrexone.

PubMed

Roos, Corey R; Mann, Karl; Witkiewitz, Katie

2017-11-01

Researchers have sought to distinguish between individuals whose alcohol use disorder (AUD) is maintained by drinking to relieve negative affect ('relief drinkers') and those whose AUD is maintained by the rewarding effects of alcohol ('reward drinkers'). As an opioid receptor antagonist, naltrexone may be particularly effective for reward drinkers. Acamprosate, which has been shown to down-regulate the glutamatergic system, may be particularly effective for relief drinkers. This study sought to replicate and extend prior work (PREDICT study; Glöckner-Rist et al. ) by examining dimensions of reward and relief temptation to drink and subtypes of individuals with distinct patterns of reward/relief temptation. We utilized data from two randomized clinical trials for AUD (Project MATCH, n = 1726 and COMBINE study, n = 1383). We also tested whether classes of reward/relief temptation would predict differential response to naltrexone and acamprosate in COMBINE. Results replicated prior work by identifying reward and relief temptation factors, which had excellent reliability and construct validity. Using factor mixture modeling, we identified five distinct classes of reward/relief temptation that replicated across studies. In COMBINE, we found a significant class-by-acamprosate interaction effect. Among those most likely classified in the high relief/moderate reward temptation class, individuals had better drinking outcomes if assigned to acamprosate versus placebo. We did not find a significant class-by-naltrexone interaction effect. Our study questions the orthogonal classification of drinkers into only two types (reward or relief drinkers) and adds to the body of research on moderators of acamprosate, which may inform clinical decision making in the treatment of AUD. © 2016 Society for the Study of Addiction.

Cannabinoid transmission in the prelimbic cortex bidirectionally controls opiate reward and aversion signaling through dissociable kappa versus μ-opiate receptor dependent mechanisms.

PubMed

Ahmad, Tasha; Lauzon, Nicole M; de Jaeger, Xavier; Laviolette, Steven R

2013-09-25

Cannabinoid, dopamine (DA), and opiate receptor pathways play integrative roles in emotional learning, associative memory, and sensory perception. Modulation of cannabinoid CB1 receptor transmission within the medial prefrontal cortex (mPFC) regulates the emotional valence of both rewarding and aversive experiences. Furthermore, CB1 receptor substrates functionally interact with opiate-related motivational processing circuits, particularly in the context of reward-related learning and memory. Considerable evidence demonstrates functional interactions between CB1 and DA signaling pathways during the processing of motivationally salient information. However, the role of mPFC CB1 receptor transmission in the modulation of behavioral opiate-reward processing is not currently known. Using an unbiased conditioned place preference paradigm with rats, we examined the role of intra-mPFC CB1 transmission during opiate reward learning. We report that activation or inhibition of CB1 transmission within the prelimbic cortical (PLC) division of the mPFC bidirectionally regulates the motivational valence of opiates; whereas CB1 activation switched morphine reward signaling into an aversive stimulus, blockade of CB1 transmission potentiated the rewarding properties of normally sub-reward threshold conditioning doses of morphine. Both of these effects were dependent upon DA transmission as systemic blockade of DAergic transmission prevented CB1-dependent modulation of morphine reward and aversion behaviors. We further report that CB1-mediated intra-PLC opiate motivational signaling is mediated through a μ-opiate receptor-dependent reward pathway, or a κ-opiate receptor-dependent aversion pathway, directly within the ventral tegmental area. Our results provide evidence for a novel CB1-mediated motivational valence switching mechanism within the PLC, controlling dissociable subcortical reward and aversion pathways.

Association of Elevated Reward Prediction Error Response With Weight Gain in Adolescent Anorexia Nervosa.

PubMed

DeGuzman, Marisa; Shott, Megan E; Yang, Tony T; Riederer, Justin; Frank, Guido K W

2017-06-01

Anorexia nervosa is a psychiatric disorder of unknown etiology. Understanding associations between behavior and neurobiology is important in treatment development. Using a novel monetary reward task during functional magnetic resonance brain imaging, the authors tested how brain reward learning in adolescent anorexia nervosa changes with weight restoration. Female adolescents with anorexia nervosa (N=21; mean age, 16.4 years [SD=1.9]) underwent functional MRI (fMRI) before and after treatment; similarly, healthy female control adolescents (N=21; mean age, 15.2 years [SD=2.4]) underwent fMRI on two occasions. Brain function was tested using the reward prediction error construct, a computational model for reward receipt and omission related to motivation and neural dopamine responsiveness. Compared with the control group, the anorexia nervosa group exhibited greater brain response 1) for prediction error regression within the caudate, ventral caudate/nucleus accumbens, and anterior and posterior insula, 2) to unexpected reward receipt in the anterior and posterior insula, and 3) to unexpected reward omission in the caudate body. Prediction error and unexpected reward omission response tended to normalize with treatment, while unexpected reward receipt response remained significantly elevated. Greater caudate prediction error response when underweight was associated with lower weight gain during treatment. Punishment sensitivity correlated positively with ventral caudate prediction error response. Reward system responsiveness is elevated in adolescent anorexia nervosa when underweight and after weight restoration. Heightened prediction error activity in brain reward regions may represent a phenotype of adolescent anorexia nervosa that does not respond well to treatment. Prediction error response could be a neurobiological marker of illness severity that can indicate individual treatment needs.

Association of Elevated Reward Prediction Error Response With Weight Gain in Adolescent Anorexia Nervosa

PubMed Central

DeGuzman, Marisa; Shott, Megan E.; Yang, Tony T.; Riederer, Justin; Frank, Guido K.W.

2017-01-01

Objective Anorexia nervosa is a psychiatric disorder of unknown etiology. Understanding associations between behavior and neurobiology is important in treatment development. Using a novel monetary reward task during functional magnetic resonance brain imaging, the authors tested how brain reward learning in adolescent anorexia nervosa changes with weight restoration. Method Female adolescents with anorexia nervosa (N=21; mean age, 15.2 years [SD=2.4]) underwent functional MRI (fMRI) before and after treatment; similarly, healthy female control adolescents (N=21; mean age, 16.4 years [SD=1.9]) underwent fMRI on two occasions. Brain function was tested using the reward prediction error construct, a computational model for reward receipt and omission related to motivation and neural dopamine responsiveness. Results Compared with the control group, the anorexia nervosa group exhibited greater brain response 1) for prediction error regression within the caudate, ventral caudate/nucleus accumbens, and anterior and posterior insula, 2) to unexpected reward receipt in the anterior and posterior insula, and 3) to unexpected reward omission in the caudate body. Prediction error and unexpected reward omission response tended to normalize with treatment, while unexpected reward receipt response remained significantly elevated. Greater caudate prediction error response when underweight was associated with lower weight gain during treatment. Punishment sensitivity correlated positively with ventral caudate prediction error response. Conclusions Reward system responsiveness is elevated in adolescent anorexia nervosa when underweight and after weight restoration. Heightened prediction error activity in brain reward regions may represent a phenotype of adolescent anorexia nervosa that does not respond well to treatment. Prediction error response could be a neurobiological marker of illness severity that can indicate individual treatment needs. PMID:28231717

Ejaculation Induced by the Activation of Crz Neurons Is Rewarding to Drosophila Males.

PubMed

Zer-Krispil, Shir; Zak, Hila; Shao, Lisha; Ben-Shaanan, Shir; Tordjman, Lea; Bentzur, Assa; Shmueli, Anat; Shohat-Ophir, Galit

2018-05-07

The reward system is a collection of circuits that reinforce behaviors necessary for survival [1, 2]. Given the importance of reproduction for survival, actions that promote successful mating induce pleasurable feeling and are positively reinforced [3, 4]. This principle is conserved in Drosophila, where successful copulation is naturally rewarding to male flies, induces long-term appetitive memories [5], increases brain levels of neuropeptide F (NPF, the fly homolog of neuropeptide Y), and prevents ethanol, known otherwise as rewarding to flies [6, 7], from being rewarding [5]. It is not clear which of the multiple sensory and motor responses performed during mating induces perception of reward. Sexual interactions with female flies that do not reach copulation are not sufficient to reduce ethanol consumption [5], suggesting that only successful mating encounters are rewarding. Here, we uncoupled the initial steps of mating from its final steps and tested the ability of ejaculation to mimic the rewarding value of full copulation. We induced ejaculation by activating neurons that express the neuropeptide corazonin (CRZ) [8] and subsequently measured different aspects of reward. We show that activating Crz-expressing neurons is rewarding to male flies, as they choose to reside in a zone that triggers optogenetic stimulation of Crz neurons and display conditioned preference for an odor paired with the activation. Reminiscent of successful mating, repeated activation of Crz neurons increases npf levels and reduces ethanol consumption. Our results demonstrate that ejaculation stimulated by Crz/Crz-receptor signaling serves as an essential part of the mating reward mechanism in Drosophila. VIDEO ABSTRACT. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

Model-based learning and the contribution of the orbitofrontal cortex to the model-free world

PubMed Central

McDannald, Michael A.; Takahashi, Yuji K.; Lopatina, Nina; Pietras, Brad W.; Jones, Josh L.; Schoenbaum, Geoffrey

2012-01-01

Learning is proposed to occur when there is a discrepancy between reward prediction and reward receipt. At least two separate systems are thought to exist: one in which predictions are proposed to be based on model-free or cached values; and another in which predictions are model-based. A basic neural circuit for model-free reinforcement learning has already been described. In the model-free circuit the ventral striatum (VS) is thought to supply a common-currency reward prediction to midbrain dopamine neurons that compute prediction errors and drive learning. In a model-based system, predictions can include more information about an expected reward, such as its sensory attributes or current, unique value. This detailed prediction allows for both behavioral flexibility and learning driven by changes in sensory features of rewards alone. Recent evidence from animal learning and human imaging suggests that, in addition to model-free information, the VS also signals model-based information. Further, there is evidence that the orbitofrontal cortex (OFC) signals model-based information. Here we review these data and suggest that the OFC provides model-based information to this traditional model-free circuitry and offer possibilities as to how this interaction might occur. PMID:22487030

Physiological Response to Reward and Extinction Predicts Alcohol, Marijuana, and Cigarette Use Two Years Later

PubMed Central

Derefinko, Karen J.; Eisenlohr-Moul, Tory A.; Peters, Jessica R.; Roberts, Walter; Walsh, Erin C.; Milich, Richard; Lynam, Donald R.

2017-01-01

Background Physiological responses to reward and extinction are believed to represent the Behavioral Activation System (BAS) and Behavioral Inhibition System (BIS) constructs of Reinforcement Sensitivity Theory and underlie externalizing behaviors, including substance use. However, little research has examined these relations directly. Methods We assessed individuals’ cardiac pre-ejection periods (PEP) and electrodermal responses (EDR) during reward and extinction trials through the “Number Elimination Game” paradigm. Responses represented BAS and BIS, respectively. We then examined whether these responses provided incremental utility in the prediction of future alcohol, marijuana, and cigarette use. Results Zero-inflated Poisson (ZIP) regression models were used to examine the predictive utility of physiological BAS and BIS responses above and beyond previous substance use. Physiological responses accounted for incremental variance over previous use. Low BAS responses during reward predicted frequency of alcohol use at year 3. Low BAS responses during reward and extinction and high BIS responses during extinction predicted frequency of marijuana use at year 3. For cigarette use, low BAS response during extinction predicted use at year 3. Conclusions These findings suggest that the constructs of Reinforcement Sensitivity Theory, as assessed through physiology, contribute to the longitudinal maintenance of substance use. PMID:27306728

Nucleus Accumbens Acetylcholine Receptors Modulate Dopamine and Motivation.

PubMed

Collins, Anne L; Aitken, Tara J; Greenfield, Venuz Y; Ostlund, Sean B; Wassum, Kate M

2016-11-01

Environmental reward-predictive cues can motivate reward-seeking behaviors. Although this influence is normally adaptive, it can become maladaptive in disordered states, such as addiction. Dopamine release in the nucleus accumbens core (NAc) is known to mediate the motivational impact of reward-predictive cues, but little is known about how other neuromodulatory systems contribute to cue-motivated behavior. Here, we examined the role of the NAc cholinergic receptor system in cue-motivated behavior using a Pavlovian-to-instrumental transfer task designed to assess the motivating influence of a reward-predictive cue over an independently-trained instrumental action. Disruption of NAc muscarinic acetylcholine receptor activity attenuated, whereas blockade of nicotinic receptors augmented cue-induced invigoration of reward seeking. We next examined a potential dopaminergic mechanism for this behavioral effect by combining fast-scan cyclic voltammetry with local pharmacological acetylcholine receptor manipulation. The data show evidence of opposing modulation of cue-evoked dopamine release, with muscarinic and nicotinic receptor antagonists causing suppression and augmentation, respectively, consistent with the behavioral effects of these manipulations. In addition to demonstrating cholinergic modulation of naturally-evoked and behaviorally-relevant dopamine signaling, these data suggest that NAc cholinergic receptors may gate the expression of cue-motivated behavior through modulation of phasic dopamine release.

Mapping brain functional alterations in betel-quid chewers using resting-state fMRI and network analysis.

PubMed

Weng, Jun-Cheng; Chou, Yu-Syuan; Huang, Guo-Joe; Tyan, Yeu-Sheng; Ho, Ming-Chou

2018-04-01

The World Health Organization regards betel quid (BQ) as a human carcinogen, and DSM-IV and ICD-10 dependence symptoms may develop with its heavy use. BQ's possible effects of an enhanced reward system and disrupted inhibitory control may increase the likelihood of habitual substance use. The current study aimed to employ resting-state fMRI to examine the hypothesized enhanced reward system (e.g., the basal forebrain system) and disrupted inhibitory control (e.g., the prefrontal system) in BQ chewers. The current study recruited three groups of 48 male participants: 16 BQ chewers, 15 tobacco- and alcohol-user controls, and 17 healthy controls. We used functional connectivity (FC), mean fractional amplitude of low-frequency fluctuations (mfALFF), and mean regional homogeneity (mReHo) to evaluate functional alternations in BQ chewers. Graph theoretical analysis (GTA) and network-based statistical (NBS) analysis were also performed to identify the functional network differences among the three groups. Our hypothesis was partially supported: the enhanced reward system for the BQ chewers (e.g., habitual drug-seeking behavior) was supported; however, their inhibitory control was relatively preserved. In addition, we reported that the BQ chewers may have enhanced visuospatial processing and decreased local segregation. The current results (showing an enhanced reward system in the chewers) provided the clinicians with important insight for the future development of an effective abstinence treatment.

Stress and reward processing in bipolar disorder: an fMRI study

PubMed Central

Berghorst, Lisa H; Kumar, Poornima; Greve, Doug N; Deckersbach, Thilo; Ongur, Dost; Dutra, Sunny; Pizzagalli, Diego A

2016-01-01

Objectives A link between negative life stress and the onset of mood episodes in bipolar disorder (BD) has been established, but processes underlying such a link remain unclear. Growing evidence suggests that stress can negatively affect reward processing and related neurobiological substrates, indicating that a dysregulated reward system may provide a partial explanation. The aim of this study was to test the impact of stress on reward-related neural functioning in BD. Methods Thirteen euthymic or mildly depressed individuals with BD and 15 controls performed a Monetary Incentive Delay task while undergoing functional magnetic resonance imaging during no-stress and stress (negative psychosocial stressor involving poor performance feedback and threat of monetary deductions) conditions. Results In hypothesis-driven region-of- interest-based analyses, a significant group by condition interaction emerged in the amygdala during reward anticipation. Relative to controls, while anticipating a potential reward, subjects with BD were characterized by amygdalar hyperactivation in the no-stress condition but hypoactivation during stress. Moreover, relative to controls, subjects with BD had significantly larger amygdala volumes. After controlling for structural differences, the effects of stress on amygdalar function remained, whereas groups no longer differed during the no-stress condition. During reward consumption, a group by condition interaction emerged in the putamen due to increased putamen activation to rewards in participants with BD during stress, but an opposite pattern in controls. Conclusions Overall, findings highlight possible impairments in using reward-predicting cues to adaptively engage in goal-directed actions in BD, combined with stress-induced hypersensitivity to reward consumption. Potential clinical implications are discussed. PMID:27870507

A transient dopamine signal encodes subjective value and causally influences demand in an economic context

PubMed Central

Schelp, Scott A.; Pultorak, Katherine J.; Rakowski, Dylan R.; Gomez, Devan M.; Krzystyniak, Gregory; Das, Raibatak; Oleson, Erik B.

2017-01-01

The mesolimbic dopamine system is strongly implicated in motivational processes. Currently accepted theories suggest that transient mesolimbic dopamine release events energize reward seeking and encode reward value. During the pursuit of reward, critical associations are formed between the reward and cues that predict its availability. Conditioned by these experiences, dopamine neurons begin to fire upon the earliest presentation of a cue, and again at the receipt of reward. The resulting dopamine concentration scales proportionally to the value of the reward. In this study, we used a behavioral economics approach to quantify how transient dopamine release events scale with price and causally alter price sensitivity. We presented sucrose to rats across a range of prices and modeled the resulting demand curves to estimate price sensitivity. Using fast-scan cyclic voltammetry, we determined that the concentration of accumbal dopamine time-locked to cue presentation decreased with price. These data confirm and extend the notion that dopamine release events originating in the ventral tegmental area encode subjective value. Using optogenetics to augment dopamine concentration, we found that enhancing dopamine release at cue made demand more sensitive to price and decreased dopamine concentration at reward delivery. From these observations, we infer that value is decreased because of a negative reward prediction error (i.e., the animal receives less than expected). Conversely, enhancing dopamine at reward made demand less sensitive to price. We attribute this finding to a positive reward prediction error, whereby the animal perceives they received a better value than anticipated. PMID:29109253

Reward processing and mood-related symptoms: An RDoC and translational neuroscience perspective.

PubMed

Nusslock, Robin; Alloy, Lauren B

2017-07-01

Two objectives of the NIMH Research Domain Criteria (RDoC) initiative are to identify (a) mechanisms that are common to multiple psychiatric disorders, and (b) mechanisms that are unique to specific psychiatric symptoms, and that reflect markers of differential risk for these symptoms. With respect to these objectives, a brain-behavior dimension that has received considerable attention and that is directly relevant to the Positive Valence Systems domain of the RDoC initiative involves reward processing. The present review paper first examines the relationship between reward processing and mood-related symptoms from an RDoC perspective. We then place this work in a larger context by examining the relationship between reward processing abnormalities and psychiatric symptoms defined broadly, including mood-related symptoms, schizophrenia, and addiction. Our review suggests that reward hyposensitivity relates to a subtype of anhedonia characterized by motivational deficits in unipolar depression, and reward hypersensitivity relates to a cluster of hypo/manic symptoms characterized by excessive approach motivation in the context of bipolar disorder. Integrating this perspective with research on reward processing abnormalities in schizophrenia and addiction, we further argue that the principles of equifinality and multifinality may be preferable to a transdiagnostic perspective for conceptualizing the relationship between reward processing and psychiatric symptoms defined broadly. We propose that vulnerability to either motivational anhedonia or approach-related hypo/manic symptoms involve extreme and opposite profiles of reward processing. We further propose that an equifinality and multifinality perspective may serve as a useful framework for future research on reward processing abnormalities and psychiatric symptoms. Copyright © 2017. Published by Elsevier B.V.

Improving Teaching Effectiveness: Merit Pay vs. Organizational Culture.

ERIC Educational Resources Information Center

Bushardt, Stephen C.; Fowler, Aubrey R.

1987-01-01

Identifies four conditions which cause merit pay systems to fail to increase teacher performance: lack of skills, the poor timing of rewards, an inability to measure performance; and competing reinforcers. Explains why organizational culture is a more effective mediator of rewards. (SD)

Sensitivity to reward: implications for overeating and overweight.

PubMed

Davis, Caroline; Strachan, Shaelyn; Berkson, Marni

2004-04-01

Sensitivity to reward (STR)-a personality trait firmly rooted in the neurobiology of the mesolimbic dopamine system-has been strongly implicated in the risk for addiction. This construct describes the ability to derive pleasure or reward from natural reinforcers like food, and from pharmacologic rewards like addictive drugs. Recently experts in the field of addiction research have acknowledged that psychomotor stimulant drugs are no longer at the heart of all addictions, and that brain circuits can also be deranged with natural rewards like food. The present study tested a model in which STR was expected to relate positively to overeating, which in turn would be associated with higher body weight in woman aged 25-45 years. As predicted, STR was correlated positively with measures of emotional overeating. Also, overweight woman were significantly more sensitive to reward than those of normal weight. Interestingly, however, the obese woman (Body Mass Index>30) were more anhedonic than the overweight woman (Body Mass Index>25<30). These findings are discussed in the context of neuroadaptations to overactivity of brain reward circuits. Results also indicate that STR may serve as a risk factor for overeating and overweight, especially in cultures such as ours where palatable, calorically-dense food is plentiful.

Active and observational reward learning in adults with autism spectrum disorder: relationship with empathy in an atypical sample.

PubMed

Bellebaum, Christian; Brodmann, Katja; Thoma, Patrizia

2014-01-01

Autism spectrum disorders (ASDs) are characterised by disturbances in social behaviour. A prevailing hypothesis suggests that these problems are related to deficits in assigning rewarding value to social stimuli. The present study aimed to examine monetary reward processing in adults with ASDs by means of event-related potentials (ERPs). Ten individuals with mild ASDs (Asperger's syndrome and high-functioning autism) and 12 healthy control subjects performed an active and an observational probabilistic reward-learning task. Both groups showed similar overall learning performance. With respect to reward processing, subjects with ASDs exhibited a general reduction in feedback-related negativity (FRN) amplitude, irrespective of feedback valence and type of learning (active or observational). Individuals with ASDs showed lower scores for cognitive empathy, while affective empathy did not differ between groups. Correlation analyses revealed that higher empathy (both cognitive and affective) negatively affected performance in observational learning in controls and in active learning in ASDs (only cognitive empathy). No relationships were seen between empathy and ERPs. Reduced FRN amplitudes are discussed in terms of a deficit in fast reward processing in ASDs, which may indicate altered reward system functioning.

Reward-based contextual learning supported by anterior cingulate cortex.

PubMed

Umemoto, Akina; HajiHosseini, Azadeh; Yates, Michael E; Holroyd, Clay B

2017-06-01

The anterior cingulate cortex (ACC) is commonly associated with cognitive control and decision making, but its specific function is highly debated. To explore a recent theory that the ACC learns the reward values of task contexts (Holroyd & McClure in Psychological Review, 122, 54-83, 2015; Holroyd & Yeung in Trends in Cognitive Sciences, 16, 122-128, 2012), we recorded the event-related brain potentials (ERPs) from participants as they played a novel gambling task. The participants were first required to select from among three games in one "virtual casino," and subsequently they were required to select from among three different games in a different virtual casino; unbeknownst to them, the payoffs for the games were higher in one casino than in the other. Analysis of the reward positivity, an ERP component believed to reflect reward-related signals carried to the ACC by the midbrain dopamine system, revealed that the ACC is sensitive to differences in the reward values associated with both the casinos and the games inside the casinos, indicating that participants learned the values of the contexts in which rewards were delivered. These results highlight the importance of the ACC in learning the reward values of task contexts in order to guide action selection.

Incentive-Rewarding Mechanism for User-position Control in Mobile Services

NASA Astrophysics Data System (ADS)

Yoshino, Makoto; Sato, Kenichiro; Shinkuma, Ryoichi; Takahashi, Tatsuro

When the number of users in a service area increases in mobile multimedia services, no individual user can obtain satisfactory radio resources such as bandwidth and signal power because the resources are limited and shared. A solution for such a problem is user-position control. In the user-position control, the operator informs users of better communication areas (or spots) and navigates them to these positions. However, because of subjective costs caused by subjects moving from their original to a new position, they do not always attempt to move. To motivate users to contribute their resources in network services that require resource contributions for users, incentive-rewarding mechanisms have been proposed. However, there are no mechanisms that distribute rewards appropriately according to various subjective factors involving users. Furthermore, since the conventional mechanisms limit how rewards are paid, they are applicable only for the network service they targeted. In this paper, we propose a novel incentive-rewarding mechanism to solve these problems, using an external evaluator and interactive learning agents. We also investigated ways of appropriately controlling rewards based on user contributions and system service quality. We applied the proposed mechanism and reward control to the user-position control, and demonstrated its validity.

A test of the reward-contrast hypothesis.

PubMed

Dalecki, Stefan J; Panoz-Brown, Danielle E; Crystal, Jonathon D

2017-12-01

Source memory, a facet of episodic memory, is the memory of the origin of information. Whereas source memory in rats is sustained for at least a week, spatial memory degraded after approximately a day. Different forgetting functions may suggest that two memory systems (source memory and spatial memory) are dissociated. However, in previous work, the two tasks used baiting conditions consisting of chocolate and chow flavors; notably, the source memory task used the relatively better flavor. Thus, according to the reward-contrast hypothesis, when chocolate and chow were presented within the same context (i.e., within a single radial maze trial), the chocolate location was more memorable than the chow location because of contrast. We tested the reward-contrast hypothesis using baiting configurations designed to produce reward-contrast. The reward-contrast hypothesis predicts that under these conditions, spatial memory will survive a 24-h retention interval. We documented elimination of spatial memory performance after a 24-h retention interval using a reward-contrast baiting pattern. These data suggest that reward contrast does not explain our earlier findings that source memory survives unusually long retention intervals. Copyright © 2017 Elsevier B.V. All rights reserved.

Advances in studying phasic dopamine signaling in brain reward mechanisms

PubMed Central

Wickham, Robert J.; Solecki, Wojciech; Rathbun, Liza R.; Neugebauer, Nichole M.; Wightman, R. Mark; Addy, Nii A.

2013-01-01

The last sixty years of research have provided extraordinary advances of our knowledge of the reward system. Since its initial discovery as a neurotransmitter by Carlsson and colleagues (Carlsson et al., 1957), dopamine (DA) has emerged as an important mediator of reward processing. As a result, a number of electrochemical techniques have been developed to directly measure DA levels in the brain using various preparations. Many of these techniques and preparations differ in the types of questions that they can address. Together, these techniques have begun to elucidate the complex roles of tonic and phasic DA signaling in reward processing and in addiction. In this review, we will first provide a guide for the most commonly used electrochemical methods for DA detection and describe their utility in furthering our knowledge about DA's role in reward and addiction. Second, we will review the value of common in vitro and in vivo preparations and describe their ability to address different types of questions. Last, we will review recent data that has provided new insight of the mechanisms of in vivo phasic DA signaling and its role in reward processing and reward-mediated behavior. PMID:23747914

Revealing the paradox of drug reward in human evolution

PubMed Central

Sullivan, Roger J; Hagen, Edward H; Hammerstein, Peter

2008-01-01

Neurobiological models of drug abuse propose that drug use is initiated and maintained by rewarding feedback mechanisms. However, the most commonly used drugs are plant neurotoxins that evolved to punish, not reward, consumption by animal herbivores. Reward models therefore implicitly assume an evolutionary mismatch between recent drug-profligate environments and a relatively drug-free past in which a reward centre, incidentally vulnerable to neurotoxins, could evolve. By contrast, emerging insights from plant evolutionary ecology and the genetics of hepatic enzymes, particularly cytochrome P450, indicate that animal and hominid taxa have been exposed to plant toxins throughout their evolution. Specifically, evidence of conserved function, stabilizing selection, and population-specific selection of human cytochrome P450 genes indicate recent evolutionary exposure to plant toxins, including those that affect animal nervous systems. Thus, the human propensity to seek out and consume plant neurotoxins is a paradox with far-reaching implications for current drug-reward theory. We sketch some potential resolutions of the paradox, including the possibility that humans may have evolved to counter-exploit plant neurotoxins. Resolving the paradox of drug reward will require a synthesis of ecological and neurobiological perspectives of drug seeking and use. PMID:18353749

Trading Later Rewards for Current Pleasure: Pornography Consumption and Delay Discounting.

PubMed

Negash, Sesen; Sheppard, Nicole Van Ness; Lambert, Nathaniel M; Fincham, Frank D

2016-01-01

Internet pornography is a multi-billion-dollar industry that has grown increasingly accessible. Delay discounting involves devaluing larger, later rewards in favor of smaller, more immediate rewards. The constant novelty and primacy of sexual stimuli as particularly strong natural rewards make Internet pornography a unique activator of the brain's reward system, thereby having implications for decision-making processes. Based on theoretical studies of evolutionary psychology and neuroeconomics, two studies tested the hypothesis that consuming Internet pornography would relate to higher rates of delay discounting. Study 1 used a longitudinal design. Participants completed a pornography use questionnaire and a delay discounting task at Time 1 and then again four weeks later. Participants reporting higher initial pornography use demonstrated a higher delay discounting rate at Time 2, controlling for initial delay discounting. Study 2 tested for causality with an experimental design. Participants were randomly assigned to abstain from either their favorite food or pornography for three weeks. Participants who abstained from pornography use demonstrated lower delay discounting than participants who abstained from their favorite food. The finding suggests that Internet pornography is a sexual reward that contributes to delay discounting differently than other natural rewards. Theoretical and clinical implications of these studies are highlighted.

Association Between Reward Reactivity and Drug Use Severity is Substance Dependent: Preliminary Evidence From the Human Connectome Project.

PubMed

Peechatka, Alyssa L; Janes, Amy C

2017-06-01

Blunted nucleus accumbens (NAc) reactivity to reward is common across drug users. One theory is that individuals abuse substances due to this reward deficit. However, whether there is a relationship between the amount an individual uses and the severity of NAc dysfunction is unclear. It also is possible that such a relationship is substance specific, as nicotine transiently increases reward system sensitivity while alcohol, another commonly used substance, does not. As smokers may use nicotine to bolster NAc reward function, we hypothesize that NAc reactivity to reward will be related to volume of cigarette use, but not volume of alcohol use. A functional magnetic resonance imaging incentive-processing task collected by the Human Connectome Project was assessed in a cohort of tobacco smokers who reported smoking between 5-20 cigarettes/day and a cohort of alcohol users who reported drinking 7-25 drinks/wk. Number of cigarettes/day and drinks/wk were correlated with right and left NAc reactivity to the receipt of a monetary reward relative to baseline. Individuals who smoke greater numbers of cigarettes/day showed lower right NAc reactivity to reward (r = 0.853, p ≤ .001). Left NAc reactivity was not correlated with cigarettes/day. No association was found with drinks/wk. A negative association was found between NAc reactivity to reward and cigarettes/day, but not alcohol drinks/wk. Given nicotine's unique ability to increase sensitivity to rewards, these findings suggest that individuals who smoke more cigarettes/day may be compensating for more dysfunctional NAc reward reactivity. The present study demonstrates that a relationship between NAc reactivity to nondrug reward and volume of substance use is present in nicotine but not alcohol use. While prior work has implicated dysfunctional reward processing in addictions, these findings clarify a substance-specific role that blunted reward function has in determining patterns of use among chronic users. © The Author 2017. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

The ghrelin signalling system is involved in the consumption of sweets.

PubMed

Landgren, Sara; Simms, Jeffrey A; Thelle, Dag S; Strandhagen, Elisabeth; Bartlett, Selena E; Engel, Jörgen A; Jerlhag, Elisabet

2011-03-23

The gastric-derived orexigenic peptide ghrelin affects brain circuits involved in energy balance as well as in reward. Indeed, ghrelin activates an important reward circuit involved in natural- as well as drug-induced reward, the cholinergic-dopaminergic reward link. It has been hypothesized that there is a common reward mechanism for alcohol and sweet substances in both animals and humans. Alcohol dependent individuals have higher craving for sweets than do healthy controls and the hedonic response to sweet taste may, at least in part, depend on genetic factors. Rat selectively bred for high sucrose intake have higher alcohol consumption than non-sucrose preferring rats and vice versa. In the present study a group of alcohol-consuming individuals selected from a population cohort was investigated for genetic variants of the ghrelin signalling system in relation to both their alcohol and sucrose consumption. Moreover, the effects of GHS-R1A antagonism on voluntary sucrose-intake and operant self-administration, as well as saccharin intake were investigated in preclinical studies using rodents. The effects of peripheral grelin administration on sucrose intake were also examined. Here we found associations with the ghrelin gene haplotypes and increased sucrose consumption, and a trend for the same association was seen in the high alcohol consumers. The preclinical data show that a GHS-R1A antagonist reduces the intake and self-administration of sucrose in rats as well as saccharin intake in mice. Further, ghrelin increases the intake of sucrose in rats. Collectively, our data provide a clear indication that the GHS-R1A antagonists reduces and ghrelin increases the intake of rewarding substances and hence, the central ghrelin signalling system provides a novel target for the development of drug strategies to treat addictive behaviours.

The Ghrelin Signalling System Is Involved in the Consumption of Sweets

PubMed Central

Landgren, Sara; Simms, Jeffrey A.; Thelle, Dag S.; Strandhagen, Elisabeth; Bartlett, Selena E.; Engel, Jörgen A.; Jerlhag, Elisabet

2011-01-01

The gastric-derived orexigenic peptide ghrelin affects brain circuits involved in energy balance as well as in reward. Indeed, ghrelin activates an important reward circuit involved in natural- as well as drug-induced reward, the cholinergic-dopaminergic reward link. It has been hypothesized that there is a common reward mechanism for alcohol and sweet substances in both animals and humans. Alcohol dependent individuals have higher craving for sweets than do healthy controls and the hedonic response to sweet taste may, at least in part, depend on genetic factors. Rat selectively bred for high sucrose intake have higher alcohol consumption than non-sucrose preferring rats and vice versa. In the present study a group of alcohol-consuming individuals selected from a population cohort was investigated for genetic variants of the ghrelin signalling system in relation to both their alcohol and sucrose consumption. Moreover, the effects of GHS-R1A antagonism on voluntary sucrose- intake and operant self-administration, as well as saccharin intake were investigated in preclinical studies using rodents. The effects of peripheral grelin administration on sucrose intake were also examined. Here we found associations with the ghrelin gene haplotypes and increased sucrose consumption, and a trend for the same association was seen in the high alcohol consumers. The preclinical data show that a GHS-R1A antagonist reduces the intake and self-administration of sucrose in rats as well as saccharin intake in mice. Further, ghrelin increases the intake of sucrose in rats. Collectively, our data provide a clear indication that the GHS-R1A antagonists reduces and ghrelin increases the intake of rewarding substances and hence, the central ghrelin signalling system provides a novel target for the development of drug strategies to treat addictive behaviours. PMID:21448464

Effort, anhedonia, and function in schizophrenia: reduced effort allocation predicts amotivation and functional impairment.

PubMed

Barch, Deanna M; Treadway, Michael T; Schoen, Nathan

2014-05-01

One of the most debilitating aspects of schizophrenia is an apparent interest in or ability to exert effort for rewards. Such "negative symptoms" may prevent individuals from obtaining potentially beneficial outcomes in educational, occupational, or social domains. In animal models, dopamine abnormalities decrease willingness to work for rewards, implicating dopamine (DA) function as a candidate substrate for negative symptoms given that schizophrenia involves dysregulation of the dopamine system. We used the effort-expenditure for rewards task (EEfRT) to assess the degree to which individuals with schizophrenia were wiling to exert increased effort for either larger magnitude rewards or for rewards that were more probable. Fifty-nine individuals with schizophrenia and 39 demographically similar controls performed the EEfRT task, which involves making choices between "easy" and "hard" tasks to earn potential rewards. Individuals with schizophrenia showed less of an increase in effort allocation as either reward magnitude or probability increased. In controls, the frequency of choosing the hard task in high reward magnitude and probability conditions was negatively correlated with depression severity and anhedonia. In schizophrenia, fewer hard task choices were associated with more severe negative symptoms and worse community and work function as assessed by a caretaker. Consistent with patterns of disrupted dopamine functioning observed in animal models of schizophrenia, these results suggest that 1 mechanism contributing to impaired function and motivational drive in schizophrenia may be a reduced allocation of greater effort for higher magnitude or higher probability rewards.

Dopamine Depletion Reduces Food-Related Reward Activity Independent of BMI

PubMed Central

Frank, Sabine; Veit, Ralf; Sauer, Helene; Enck, Paul; Friederich, Hans-Christoph; Unholzer, Theresa; Bauer, Ute-Maria; Linder, Katarzyna; Heni, Martin; Fritsche, Andreas; Preissl, Hubert

2016-01-01

Reward sensitivity and possible alterations in the dopaminergic-reward system are associated with obesity. We therefore aimed to investigate the influence of dopamine depletion on food-reward processing. We investigated 34 female subjects in a randomized placebo-controlled, within-subject design (body mass index (BMI)=27.0 kg/m2 ±4.79 SD; age=28 years ±4.97 SD) using an acute phenylalanine/tyrosine depletion drink representing dopamine depletion and a balanced amino acid drink as the control condition. Brain activity was measured with functional magnetic resonance imaging during a ‘wanting' and ‘liking' rating of food items. Eating behavior-related traits and states were assessed on the basis of questionnaires. Dopamine depletion resulted in reduced activation in the striatum and higher activation in the superior frontal gyrus independent of BMI. Brain activity during the wanting task activated a more distributed network than during the liking task. This network included gustatory, memory, visual, reward, and frontal regions. An interaction effect of dopamine depletion and the wanting/liking task was observed in the hippocampus. The interaction with the covariate BMI was significant in motor and control regions but not in the striatum. Our results support the notion of altered brain activity in the reward and prefrontal network with blunted dopaminergic action during food-reward processing. This effect is, however, independent of BMI, which contradicts the reward-deficiency hypothesis. This hints to the hypothesis suggesting a different or more complex mechanism underlying the dopaminergic reward function in obesity. PMID:26450814

Abnormal Social Reward Responses in Anorexia Nervosa: An fMRI Study.

PubMed

Via, Esther; Soriano-Mas, Carles; Sánchez, Isabel; Forcano, Laura; Harrison, Ben J; Davey, Christopher G; Pujol, Jesús; Martínez-Zalacaín, Ignacio; Menchón, José M; Fernández-Aranda, Fernando; Cardoner, Narcís

2015-01-01

Patients with anorexia nervosa (AN) display impaired social interactions, implicated in the development and prognosis of the disorder. Importantly, social behavior is modulated by reward-based processes, and dysfunctional at-brain-level reward responses have been involved in AN neurobiological models. However, no prior evidence exists of whether these neural alterations would be equally present in social contexts. In this study, we conducted a cross-sectional social-judgment functional magnetic resonance imaging (fMRI) study of 20 restrictive-subtype AN patients and 20 matched healthy controls. Brain activity during acceptance and rejection was investigated and correlated with severity measures (Eating Disorder Inventory -EDI-2) and with personality traits of interest known to modulate social behavior (The Sensitivity to Punishment and Sensitivity to Reward Questionnaire). Patients showed hypoactivation of the dorsomedial prefrontal cortex (DMPFC) during social acceptance and hyperactivation of visual areas during social rejection. Ventral striatum activation during rejection was positively correlated in patients with clinical severity scores. During acceptance, activation of the frontal opercula-anterior insula and dorsomedial/dorsolateral prefrontal cortices was differentially associated with reward sensitivity between groups. These results suggest an abnormal motivational drive for social stimuli, and involve overlapping social cognition and reward systems leading to a disruption of adaptive responses in the processing of social reward. The specific association of reward-related regions with clinical and psychometric measures suggests the putative involvement of reward structures in the maintenance of pathological behaviors in AN.

The Dopamine Prediction Error: Contributions to Associative Models of Reward Learning

PubMed Central

Nasser, Helen M.; Calu, Donna J.; Schoenbaum, Geoffrey; Sharpe, Melissa J.

2017-01-01

Phasic activity of midbrain dopamine neurons is currently thought to encapsulate the prediction-error signal described in Sutton and Barto’s (1981) model-free reinforcement learning algorithm. This phasic signal is thought to contain information about the quantitative value of reward, which transfers to the reward-predictive cue after learning. This is argued to endow the reward-predictive cue with the value inherent in the reward, motivating behavior toward cues signaling the presence of reward. Yet theoretical and empirical research has implicated prediction-error signaling in learning that extends far beyond a transfer of quantitative value to a reward-predictive cue. Here, we review the research which demonstrates the complexity of how dopaminergic prediction errors facilitate learning. After briefly discussing the literature demonstrating that phasic dopaminergic signals can act in the manner described by Sutton and Barto (1981), we consider how these signals may also influence attentional processing across multiple attentional systems in distinct brain circuits. Then, we discuss how prediction errors encode and promote the development of context-specific associations between cues and rewards. Finally, we consider recent evidence that shows dopaminergic activity contains information about causal relationships between cues and rewards that reflect information garnered from rich associative models of the world that can be adapted in the absence of direct experience. In discussing this research we hope to support the expansion of how dopaminergic prediction errors are thought to contribute to the learning process beyond the traditional concept of transferring quantitative value. PMID:28275359

Evidence for opioid involvement in the motivation to sing

PubMed Central

Riters, Lauren V.

2009-01-01

Songbirds produce high rates of song within multiple social contexts, suggesting that they are highly motivated to sing and that song production itself may be rewarding. Progress has been made in understanding the neural basis of song learning and sensorimotor processing, however little is known about neurobiological mechanisms regulating the motivation to sing. Neural systems involved in motivation and reward have been conserved across species and in songbirds are neuroanatomically well-positioned to influence the song control system. Opioid neuropeptides within these systems play a primary role in hedonic reward, at least in mammals. In songbirds, opioid neuropeptides and receptors are found throughout the song control system and within several brain regions implicated in both motivation and reward, including the medial preoptic nucleus (POM) and ventral tegmental area (VTA). Growing research shows these regions to play a role in birdsong that differs depending upon whether song is sexually-motivated in response to a female, used for territorial defense or sung as part of a flock but not directed towards an individual (undirected song). Opioid pharmacological manipulations and immunocytochemical data demonstrate a role for opioid activity possibly within VTA and POM in the regulation of song production. Although future research is needed, data suggest that opioids may be most critically involved in reinforcing song that does not result in any obvious form of immediate externally-mediated reinforcement, such as undirected song produced in large flocks or during song learning. Data are reviewed supporting the idea that dopamine activity underlies the motivation or drive to sing, but that opioid release is what makes song production rewarding. PMID:19995531

Cannabinoid modulation of drug reward and the implications of marijuana legalization.

PubMed

Covey, Dan P; Wenzel, Jennifer M; Cheer, Joseph F

2015-12-02

Marijuana is the most popular illegal drug worldwide. Recent trends indicate that this may soon change; not due to decreased marijuana use, but to an amendment in marijuana's illegal status. The cannabinoid type 1 (CB1) receptor mediates marijuana's psychoactive and reinforcing properties. CB1 receptors are also part of the brain endocannabinoid (eCB) system and support numerous forms of learning and memory, including the conditioned reinforcing properties of cues predicting reward or punishment. This is accomplished via eCB-dependent alterations in mesolimbic dopamine function, which plays an obligatory role in reward learning and motivation. Presynaptic CB1 receptors control midbrain dopamine neuron activity and thereby shape phasic dopamine release in target regions, particularly the nucleus accumbens (NAc). By also regulating synaptic input to the NAc, CB1 receptors modulate NAc output onto downstream neurons of the basal ganglia motor circuit, and thereby support goal-directed behaviors. Abused drugs promote short- and long-term adaptations in eCB-regulation of mesolimbic dopamine function, and thereby hijack neural systems related to the pursuit of rewards to promote drug abuse. By pharmacologically targeting the CB1 receptors, marijuana has preferential access to this neuronal system and can potently alter eCB-dependent processing of reward-related stimuli. As marijuana legalization progresses, greater access to this drug should increase the utility of marijuana as a research tool to better understand the eCB system, which has the potential to advance cannabinoid-based treatments for drug addiction. Copyright © 2014 Elsevier B.V. All rights reserved.

Rash impulsiveness and reward sensitivity in relation to risky drinking by university students: potential roles of frontal systems.

PubMed

Lyvers, Michael; Duff, Helen; Basch, Vanessa; Edwards, Mark S

2012-08-01

Two forms of impulsivity, rash impulsiveness and reward sensitivity, have been proposed to reflect aspects of frontal lobe functioning and promote substance use. The present study examined these two forms of impulsivity as well as frontal lobe symptoms in relation to risky drinking by university students. University undergraduates aged 18-26years completed the Alcohol Use Disorders Identification Test (AUDIT), Barratt Impulsiveness Scale (BIS-11), Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ), Frontal Systems Behavior Scale (FrSBe), and a demographics questionnaire assessing age, gender, and age of onset of weekly drinking (AOD). AUDIT-defined harmful drinkers reported earlier AOD and scored higher on BIS-11, the Sensitivity to Reward (SR) scale of the SPSRQ, and the Disinhibition and Executive Dysfunction scales of the FrSBe compared to lower risk groups. Differences remained significant after controlling for duration of alcohol exposure. Path analyses indicated that the influence of SR on AUDIT was mediated by FrSBe Disinhibition, whereas the influence of BIS-11 on AUDIT was mediated by both Disinhibition and Executive Dysfunction scales of the FrSBe. Findings tentatively suggest that the influence of rash impulsiveness on drinking may reflect dysfunction in dorsolateral prefrontal and orbitofrontal systems, whereas the influence of reward sensitivity on drinking may primarily reflect orbitofrontal dysfunction. Irrespective of the underlying functional brain systems involved, results appear to be more consistent with a pre-drinking trait interpretation than effects of alcohol exposure. Copyright © 2012 Elsevier Ltd. All rights reserved.

Oscillatory rhythm of reward: anticipation and processing of rewards in children with and without autism.

PubMed

Stavropoulos, Katherine Kuhl-Meltzoff; Carver, Leslie J

2018-01-01

Autism spectrum disorder (ASD) is a complex neurodevelopmental condition, and multiple theories have emerged concerning core social deficits. While the social motivation hypothesis proposes that deficits in the social reward system cause individuals with ASD to engage less in social interaction, the overly intense world hypothesis (sensory over-responsivity) proposes that individuals with ASD find stimuli to be too intense and may have hypersensitivity to social interaction, leading them to avoid these interactions. EEG was recorded during reward anticipation and reward processing. Reward anticipation was measured using alpha asymmetry, and post-feedback theta was utilized to measure reward processing. Additionally, we calculated post-feedback alpha suppression to measure attention and salience. Participants were 6- to 8-year-olds with ( N  = 20) and without ( N  = 23) ASD. Children with ASD showed more left-dominant alpha suppression when anticipating rewards accompanied by nonsocial stimuli compared to social stimuli. During reward processing, children with ASD had less theta activity than typically developing (TD) children. Alpha activity after feedback showed the opposite pattern: children with ASD had greater alpha suppression than TD children. Significant correlations were observed between behavioral measures of autism severity and EEG activity in both the reward anticipation and reward processing time periods. The findings provide evidence that children with ASD have greater approach motivation prior to nonsocial (compared to social) stimuli. Results after feedback suggest that children with ASD evidence less robust activity thought to reflect evaluation and processing of rewards (e.g., theta) compared to TD children. However, children with ASD evidence greater alpha suppression after feedback compared to TD children. We hypothesize that post-feedback alpha suppression reflects general cognitive engagement-which suggests that children with ASD may experience feedback as overly intense. Taken together, these results suggest that aspects of both the social motivation hypothesis and the overly intense world hypothesis may be occurring simultaneously.

Belief state representation in the dopamine system.

PubMed

Babayan, Benedicte M; Uchida, Naoshige; Gershman, Samuel J

2018-05-14

Learning to predict future outcomes is critical for driving appropriate behaviors. Reinforcement learning (RL) models have successfully accounted for such learning, relying on reward prediction errors (RPEs) signaled by midbrain dopamine neurons. It has been proposed that when sensory data provide only ambiguous information about which state an animal is in, it can predict reward based on a set of probabilities assigned to hypothetical states (called the belief state). Here we examine how dopamine RPEs and subsequent learning are regulated under state uncertainty. Mice are first trained in a task with two potential states defined by different reward amounts. During testing, intermediate-sized rewards are given in rare trials. Dopamine activity is a non-monotonic function of reward size, consistent with RL models operating on belief states. Furthermore, the magnitude of dopamine responses quantitatively predicts changes in behavior. These results establish the critical role of state inference in RL.

Journal Impact Factor Shapes Scientists’ Reward Signal in the Prospect of Publication

PubMed Central

Paulus, Frieder Michel; Rademacher, Lena; Schäfer, Theo Alexander Jose; Müller-Pinzler, Laura; Krach, Sören

2015-01-01

The incentive structure of a scientist’s life is increasingly mimicking economic principles. While intensely criticized, the journal impact factor (JIF) has taken a role as the new currency for scientists. Successful goal-directed behavior in academia thus requires knowledge about the JIF. Using functional neuroimaging we examined how the JIF, as a powerful incentive in academia, has shaped the behavior of scientists and the reward signal in the striatum. We demonstrate that the reward signal in the nucleus accumbens increases with higher JIF during the anticipation of a publication and found a positive correlation with the personal publication record (pJIF) supporting the notion that scientists have incorporated the predominant reward principle of the scientific community in their reward system. The implications of this behavioral adaptation within the ecological niche of the scientist’s habitat remain unknown, but may also have effects which were not intended by the community. PMID:26555725

Homeostatic reinforcement learning for integrating reward collection and physiological stability.

PubMed

Keramati, Mehdi; Gutkin, Boris

2014-12-02

Efficient regulation of internal homeostasis and defending it against perturbations requires adaptive behavioral strategies. However, the computational principles mediating the interaction between homeostatic and associative learning processes remain undefined. Here we use a definition of primary rewards, as outcomes fulfilling physiological needs, to build a normative theory showing how learning motivated behaviors may be modulated by internal states. Within this framework, we mathematically prove that seeking rewards is equivalent to the fundamental objective of physiological stability, defining the notion of physiological rationality of behavior. We further suggest a formal basis for temporal discounting of rewards by showing that discounting motivates animals to follow the shortest path in the space of physiological variables toward the desired setpoint. We also explain how animals learn to act predictively to preclude prospective homeostatic challenges, and several other behavioral patterns. Finally, we suggest a computational role for interaction between hypothalamus and the brain reward system.

Brain connectivity reflects human aesthetic responses to music

PubMed Central

Sachs, Matthew E.; Ellis, Robert J.; Schlaug, Gottfried

2016-01-01

Abstract Humans uniquely appreciate aesthetics, experiencing pleasurable responses to complex stimuli that confer no clear intrinsic value for survival. However, substantial variability exists in the frequency and specificity of aesthetic responses. While pleasure from aesthetics is attributed to the neural circuitry for reward, what accounts for individual differences in aesthetic reward sensitivity remains unclear. Using a combination of survey data, behavioral and psychophysiological measures and diffusion tensor imaging, we found that white matter connectivity between sensory processing areas in the superior temporal gyrus and emotional and social processing areas in the insula and medial prefrontal cortex explains individual differences in reward sensitivity to music. Our findings provide the first evidence for a neural basis of individual differences in sensory access to the reward system, and suggest that social–emotional communication through the auditory channel may offer an evolutionary basis for music making as an aesthetically rewarding function in humans. PMID:26966157

Effects of fictive reward on rat's choice behavior

PubMed Central

Kim, Ko-Un; Huh, Namjung; Jang, Yunsil; Lee, Daeyeol; Jung, Min Whan

2015-01-01

Choices of humans and non-human primates are influenced by both actually experienced and fictive outcomes. To test whether this is also the case in rodents, we examined rat's choice behavior in a binary choice task in which variable magnitudes of actual and fictive rewards were delivered. We found that the animal's choice was significantly influenced by the magnitudes of both actual and fictive rewards in the previous trial. A model-based analysis revealed, however, that the effect of fictive reward was more transient and influenced mostly the choice in the next trial, whereas the effect of actual reward was more sustained, consistent with incremental learning of action values. Our results suggest that the capacity to modify future choices based on fictive outcomes might be shared by many different animal species, but fictive outcomes are less effective than actual outcomes in the incremental value learning system. PMID:25623929

The Trouble with Pay for Performance.

ERIC Educational Resources Information Center

Young, I. Phillip

2003-01-01

Structured interviews with 575 administrators and supervisors in 6 school districts finds 8 impediments to school board implementation of an effective merit pay system for these employees: Lack of knowledge, teacher heritage, supervisor's ability, supervisor's motivation, managerial prerogatives, amount of rewards, and type of rewards. Offers…

Obesity and the Neurocognitive Basis of Food Reward and the Control of Intake12

PubMed Central

Ziauddeen, Hisham; Alonso-Alonso, Miguel; Hill, James O; Kelley, Michael; Khan, Naiman A

2015-01-01

With the rising prevalence of obesity, hedonic eating has become an important theme in obesity research. Hedonic eating is thought to be that driven by the reward of food consumption and not metabolic need, and this has focused attention on the brain reward system and how its dysregulation may cause overeating and obesity. Here, we begin by examining the brain reward system and the evidence for its dysregulation in human obesity. We then consider the issue of how individuals are able to control their hedonic eating in the present obesogenic environment and compare 2 contrasting perspectives on the control of hedonic eating, specifically, enhanced control of intake via higher cognitive control and loss of control over intake as captured by the food addiction model. We conclude by considering what these perspectives offer in terms of directions for future research and for potential interventions to improve control over food intake at the population and the individual levels. PMID:26178031

Ranking of priorities in employees' reward and recognition schemes: from the perspective of UAE health care employees.

PubMed

Younies, Hassan; Barhem, Belal; Younis, Mustafa Z

2008-01-01

A reward and recognition (RR) system is a tool widely applied by organizations to motivate their employees. Outstanding employees expect their effort to be acknowledged by the organization. However, the variety of rewards and recognitions systems used by organizations may be perceived differently by different employees. The diverse workforce structure in the United Arab Emirates (UAE) poses various challenges for organization managers. Managers need to implement the shrewd RR system which best fits their diverse workforce. This research studied how medical sector employees in the private and public health sector view the RR systems in the UAE. Two lists, comprising 26 major approaches to RR, were prepared and its items prioritized by taking inputs from 250 employees working in more than 30 varied public and private health care organizations in the UAE. The findings of the research are expected to provide guidelines for developing appropriate RR systems for organizations in general, and UAE health care organizations in particular.

Paraventricular Thalamus Balances Danger and Reward.

PubMed

Choi, Eun A; McNally, Gavan P

2017-03-15

Foraging animals balance the need to seek food and energy against the accompanying dangers of injury and predation. To do so, they rely on learning systems encoding reward and danger. Whereas much is known about these separate learning systems, little is known about how they interact to shape and guide behavior. Here we show a key role for the rat paraventricular nucleus of the thalamus (PVT), a nucleus of the dorsal midline thalamus, in this interaction. First, we show behavioral competition between reward and danger: the opportunity to seek food reward negatively modulates expression of species-typical defensive behavior. Then, using a chemogenetic approach expressing the inhibitory hM4Di designer receptor exclusively activated by a designer drug in PVT neurons, we show that the PVT is central to this behavioral competition. Chemogenetic PVT silencing biases behavior toward either defense or reward depending on the experimental conditions, but does not consistently favor expression of one over the other. This bias could not be attributed to changes in fear memory retrieval, learned safety, or memory interference. Rather, our results demonstrate that the PVT is essential for balancing conflicting behavioral tendencies toward danger and reward, enabling adaptive responding under this basic selection pressure. SIGNIFICANCE STATEMENT Among the most basic survival problems faced by animals is balancing the need to seek food and energy against the accompanying dangers of injury and predation. Although much is known about the brain mechanisms that underpin learning about reward and danger, little is known about how these interact to solve basic survival problems. Here we show competition between defensive (to avoid predatory detection) and approach (to obtain food) behavior. We show that the paraventricular thalamus, a nucleus of the dorsal midline thalamus, is integral to this behavioral competition. The paraventricular thalamus balances the competing behavioral demands of danger and reward, enabling adaptive responding under this selection pressure. Copyright © 2017 the authors 0270-6474/17/373018-12$15.00/0.

Developmental changes in autonomic responses are associated with future reward/punishment expectations: A study of sympathetic skin responses in the Markov decision task.

PubMed

Hosaka, Hiromi; Aoyagi, Kakuro; Kaga, Yoshimi; Kanemura, Hideaki; Sugita, Kanji; Aihara, Masao

2017-08-01

Autonomic nervous system activity is recognized as a major component of emotional responses. Future reward/punishment expectations depend upon the process of decision making in the frontal lobe, which is considered to play an important role in executive function. The aim of this study was to investigate the relationship between autonomic responses and decision making during reinforcement tasks using sympathetic skin responses (SSR). Nine adult and 9 juvenile (mean age, 10.2years) volunteers were enrolled in this study. SSRs were measured during the Markov decision task (MDT), which is a reinforcement task. In this task, subjects must endure a small immediate loss to ultimately get a large reward. The subjects had to undergo three sets of tests and their scores in these tests were assessed and evaluated. All adults showed gradually increasing scores for the MDT from the first to third set. As the trial progressed from the first to second set in adults, SSR appearance ratios remarkably increased for both punishment and reward expectations. In comparison with adults, children showed decreasing scores from the first to second set. There were no significant inter-target differences in the SSR appearance ratio in the first and second set in children. In the third set, the SSR appearance ratio for reward expectations was higher than that in the neutral condition. In reinforcement tasks, such as MDT, autonomic responses play an important role in decision making. We assume that SSRs are elicited during efficient decision making tasks associated with future reward/punishment expectations, which demonstrates the importance of autonomic function. In contrast, in children around the age of 10years, the autonomic system does not react as an organized response specific to reward/punishment expectations. This suggests the immaturity of the future reward/punishment expectations process in children. Copyright © 2017 The Japanese Society of Child Neurology. Published by Elsevier B.V. All rights reserved.

Link Between Increased Satiety Gut Hormones and Reduced Food Reward After Gastric Bypass Surgery for Obesity.

PubMed

Goldstone, Anthony P; Miras, Alexander D; Scholtz, Samantha; Jackson, Sabrina; Neff, Karl J; Pénicaud, Luc; Geoghegan, Justin; Chhina, Navpreet; Durighel, Giuliana; Bell, Jimmy D; Meillon, Sophie; le Roux, Carel W

2016-02-01

Roux-en-Y gastric bypass (RYGB) surgery is an effective long-term intervention for weight loss maintenance, reducing appetite, and also food reward, via unclear mechanisms. To investigate the role of elevated satiety gut hormones after RYGB, we examined food hedonic-reward responses after their acute post-prandial suppression. These were randomized, placebo-controlled, double-blind, crossover experimental medicine studies. Two groups, more than 5 months after RYGB for obesity (n = 7-11), compared with nonobese controls (n = 10), or patients after gastric banding (BAND) surgery (n = 9) participated in the studies. Studies were performed after acute administration of the somatostatin analog octreotide or saline. In one study, patients after RYGB, and nonobese controls, performed a behavioral progressive ratio task for chocolate sweets. In another study, patients after RYGB, and controls after BAND surgery, performed a functional magnetic resonance imaging food picture evaluation task. Octreotide increased both appetitive food reward (breakpoint) in the progressive ratio task (n = 9), and food appeal (n = 9) and reward system blood oxygen level-dependent signal (n = 7) in the functional magnetic resonance imaging task, in the RYGB group, but not in the control groups. Octreotide suppressed postprandial plasma peptide YY, glucagon-like peptide-1, and fibroblast growth factor-19 after RYGB. The reduction in plasma peptide YY with octreotide positively correlated with the increase in brain reward system blood oxygen level-dependent signal in RYGB/BAND subjects, with a similar trend for glucagon-like peptide-1. Enhanced satiety gut hormone responses after RYGB may be a causative mechanism by which anatomical alterations of the gut in obesity surgery modify behavioral and brain reward responses to food.

Effects of selective serotonin reuptake inhibition on neural activity related to risky decisions and monetary rewards in healthy males.

PubMed

Macoveanu, Julian; Fisher, Patrick M; Haahr, Mette E; Frokjaer, Vibe G; Knudsen, Gitte M; Siebner, Hartwig R

2014-10-01

Selective serotonin reuptake inhibitors (SSRIs) such as fluoxetine are commonly prescribed antidepressant drugs targeting the dysfunctional serotonin (5-HT) system, yet little is known about the functional effects of prolonged serotonin reuptake inhibition in healthy individuals. Here we used functional MRI (fMRI) to investigate how a three-week fluoxetine intervention influences neural activity related to risk taking and reward processing. Employing a double-blinded parallel-group design, 29 healthy young males were randomly assigned to receive 3 weeks of a daily dose of 40 mg fluoxetine or placebo. Participants underwent task-related fMRI prior to and after the three-week intervention while performing a card gambling task. The task required participants to choose between two decks of cards. Choices were associated with different risk levels and potential reward magnitudes. Relative to placebo, the SSRI intervention did not alter individual risk-choice preferences, but modified neural activity during decision-making and reward processing: During the choice phase, SSRI reduced the neural response to increasing risk in lateral orbitofrontal cortex, a key structure for value-based decision-making. During the outcome phase, a midbrain region showed an independent decrease in the responsiveness to rewarding outcomes. This midbrain cluster included the raphe nuclei from which serotonergic modulatory projections originate to both cortical and subcortical regions. The findings corroborate the involvement of the normally functioning 5HT-system in decision-making under risk and processing of monetary rewards. The data suggest that prolonged SSRI treatment might reduce emotional engagement by reducing the impact of risk during decision-making or the impact of reward during outcome evaluation. Copyright © 2014 Elsevier Inc. All rights reserved.

Mechanisms Underlying Motivational Deficits in Psychopathology: Similarities and Differences in Depression and Schizophrenia.

PubMed

Barch, Deanna M; Pagliaccio, David; Luking, Katherine

2016-01-01

Motivational and hedonic impairments are core aspects of a variety of types of psychopathology. These impairments cut across diagnostic categories and may be critical to understanding major aspects of the functional impairments accompanying psychopathology. Given the centrality of motivational and hedonic systems to psychopathology, the Research Domain Criteria (RDoC) initiative includes a "positive valence" systems domain that outlines a number of constructs that may be key to understanding the nature and mechanisms of motivational and hedonic impairments in psychopathology. These component constructs include initial responsiveness to reward, reward anticipation or expectancy, incentive or reinforcement learning, effort valuation, and action selection. Here, we review behavioral and neuroimaging studies providing evidence for impairments in these constructs in individuals with psychosis versus in individuals with depressive pathology. There are important differences in the nature of reward-related and hedonic deficits associated with psychosis versus depression that have major implications for our understanding of etiology and treatment development. In particular, the literature strongly suggests the presence of impairments in in-the-moment hedonics or "liking" in individuals with depressive pathology, particularly among those who experience anhedonia. Such deficits may propagate forward and contribute to impairments in other constructs that are dependent on hedonic responses, such as anticipation, learning, effort, and action selection. Such hedonic impairments could reflect alterations in dopamine and/or opioid signaling in the striatum related to depression or specifically to anhedonia in depressed populations. In contrast, the literature points to relatively intact in-the-moment hedonic processing in psychosis, but provides much evidence for impairments in other components involved in translating reward to action selection. Particularly, individuals with schizophrenia exhibit altered reward prediction and associated striatal and prefrontal activation, impaired reward learning, and impaired reward-modulated action selection.

Ghrelin interacts with neuropeptide Y Y1 and opioid receptors to increase food reward.

PubMed

Skibicka, Karolina P; Shirazi, Rozita H; Hansson, Caroline; Dickson, Suzanne L

2012-03-01

Ghrelin, a stomach-derived hormone, is an orexigenic peptide that was recently shown to potently increase food reward behavior. The neurochemical circuitry that links ghrelin to the mesolimbic system and food reward behavior remains unclear. Here we examined the contribution of neuropeptide Y (NPY) and opioids to ghrelin's effects on food motivation and intake. Both systems have well-established links to the mesolimbic ventral tegmental area (VTA) and reward/motivation control. NPY mediates the effect of ghrelin on food intake via activation of NPY-Y1 receptor (NPY-Y1R); their connection with respect to motivated behavior is unexplored. The role of opioids in any aspect of ghrelin's action on food-oriented behaviors is unknown. Rats were trained in a progressive ratio sucrose-induced operant schedule to measure food reward/motivation behavior. Chow intake was measured immediately after the operant test. In separate experiments, we explored the suppressive effects of a selective NPY-Y1R antagonist or opioid receptor antagonist naltrexone, injected either intracerebroventricularly or intra-VTA, on ghrelin-induced food reward behavior. The ventricular ghrelin-induced increase in sucrose-motivated behavior and chow intake were completely blocked by intracerebroventricular pretreatment with either an NPY-Y1R antagonist or naltrexone. The intra-VTA ghrelin-induced sucrose-motivated behavior was blocked only by intra-VTA naltrexone. In contrast, the intra-VTA ghrelin-stimulated chow intake was attenuated only by intra-VTA NPY-Y1 blockade. Finally, ghrelin infusion was associated with an elevated VTA μ-opioid receptor expression. Thus, we identify central NPY and opioid signaling as the necessary mediators of food intake and reward effects of ghrelin and localize these interactions to the mesolimbic VTA.

Point Reward System: A Method of Assessment That Accommodates a Diversity of Student Abilities and Interests and Enhances Learning

ERIC Educational Resources Information Center

Derado, Josip; Garner, Mary L.; Tran, Thu-Hang

2016-01-01

Students' abilities and interests vary dramatically in the college mathematics classroom. How do we teach all of these students effectively? In this paper, we present the Point Reward System (PRS), a new method of assessment that addresses this problem. We designed the PRS with three main goals in mind: to increase the retention rates; to keep all…

Decreasing Off-Task Behavior through a Dot/Point Reward System and Portfolio Reflection with Second, Fifth, and Sixth Graders

ERIC Educational Resources Information Center

Butera, Lisa M.; Giacone, Maria V.; Wagner, Kelly A.

2008-01-01

The purpose of this action research project report was to decrease off-task behavior through a dot/point reward system and portfolio reflections. Students involved in this research were in second, fifth, and sixth grade. There were a total of 85 student participants and 35 teacher participants. The dates of this research began on September 4, 2007…

Reward-related genes and personality traits in alcohol-dependent individuals: a pilot case control study.

PubMed

Landgren, Sara; Berglund, Kristina; Jerlhag, Elisabet; Fahlke, Claudia; Balldin, Jan; Berggren, Ulf; Zetterberg, Henrik; Blennow, Kaj; Engel, Jörgen A

2011-01-01

Components of the brain reward system, i.e. the mesolimbic dopamine, laterodorsal cholinergic and ghrelin signaling systems, have been implicated in alcohol reward in preclinical studies. Genetic variants of these systems have previously been linked to alcohol dependence. Here, we genotyped 31 single nucleotide polymorphisms (SNPs): 1 SNP in the dopamine D₂ receptor (DRD2) gene, 20 SNPs in 5 different nicotinic acetylcholine receptor subunit (CHRN*) genes, and 10 SNPs in the genes encoding pro-ghrelin (GHRL) and its receptor (GHSR), in a pilot study of type 1 alcoholics (n = 84) and healthy controls (n = 32). These individuals were characterized using the Temperament and Character Inventory. None of the SNPs were associated with risk of alcohol dependence in this population. The GG genotype of SNP rs13261190 in the CHRNB3 was associated with increased novelty seeking, while SNPs of the ghrelin signaling system were associated with decreased self-directedness (AA of rs495225, GHSR) and alterations in self-transcendence (AA of both rs42451 and rs35680, GHRL). In conclusion, this pilot study suggests that reward-related genes are associated with altered personality scores in type 1 alcohol dependence, which warrants future studies of these associations in larger study samples. Copyright © 2011 S. Karger AG, Basel.

A Simple Network Architecture Accounts for Diverse Reward Time Responses in Primary Visual Cortex

PubMed Central

Hussain Shuler, Marshall G.; Shouval, Harel Z.

2015-01-01

Many actions performed by animals and humans depend on an ability to learn, estimate, and produce temporal intervals of behavioral relevance. Exemplifying such learning of cued expectancies is the observation of reward-timing activity in the primary visual cortex (V1) of rodents, wherein neural responses to visual cues come to predict the time of future reward as behaviorally experienced in the past. These reward-timing responses exhibit significant heterogeneity in at least three qualitatively distinct classes: sustained increase or sustained decrease in firing rate until the time of expected reward, and a class of cells that reach a peak in firing at the expected delay. We elaborate upon our existing model by including inhibitory and excitatory units while imposing simple connectivity rules to demonstrate what role these inhibitory elements and the simple architectures play in sculpting the response dynamics of the network. We find that simply adding inhibition is not sufficient for obtaining the different distinct response classes, and that a broad distribution of inhibitory projections is necessary for obtaining peak-type responses. Furthermore, although changes in connection strength that modulate the effects of inhibition onto excitatory units have a strong impact on the firing rate profile of these peaked responses, the network exhibits robustness in its overall ability to predict the expected time of reward. Finally, we demonstrate how the magnitude of expected reward can be encoded at the expected delay in the network and how peaked responses express this reward expectancy. SIGNIFICANCE STATEMENT Heterogeneity in single-neuron responses is a common feature of neuronal systems, although sometimes, in theoretical approaches, it is treated as a nuisance and seldom considered as conveying a different aspect of a signal. In this study, we focus on the heterogeneous responses in the primary visual cortex of rodents trained with a predictable delayed reward time. We describe under what conditions this heterogeneity can arise by self-organization, and what information it can convey. This study, while focusing on a specific system, provides insight onto how heterogeneity can arise in general while also shedding light onto mechanisms of reinforcement learning using realistic biological assumptions. PMID:26377457

A Genetic Polymorphism of the Endogenous Opioid Dynorphin Modulates Monetary Reward Anticipation in the Corticostriatal Loop

PubMed Central

Votinov, Mikhail; Pripfl, Juergen; Windischberger, Christian; Kalcher, Klaudius; Zimprich, Alexander; Zimprich, Fritz; Moser, Ewald

2014-01-01

The dynorphin/κ-opioid receptor (KOP-R) system has been shown to play a role in different types of behavior regulation, including reward-related behavior and drug craving. It has been shown that alleles with 3 or 4 repeats (HH genotype) of the variable nucleotide tandem repeat (68-bp VNTR) functional polymorphism of the prodynorphin (PDYN) gene are associated with higher levels of dynorphin peptides than alleles with 1 or 2 repeats (LL genotype). We used fMRI on N = 71 prescreened healthy participants to investigate the effect of this polymorphism on cerebral activation in the limbic-corticostriatal loop during reward anticipation. Individuals with the HH genotype showed higher activation than those with the LL genotype in the medial orbitofrontal cortex (mOFC) when anticipating a possible monetary reward. In addition, the HH genotype showed stronger functional coupling (as assessed by effective connectivity analyses) of mOFC with VMPFC, subgenual anterior cingulate cortex, and ventral striatum during reward anticipation. This hints at a larger sensitivity for upcoming rewards in individuals with the HH genotype, resulting in a higher motivation to attain these rewards. These findings provide first evidence in humans that the PDYN polymorphism modulates neural processes associated with the anticipation of rewards, which ultimately may help to explain differences between genotypes with respect to addiction and drug abuse. PMID:24587148

Neural responses to various rewards and feedback in the brains of adolescent Internet addicts detected by functional magnetic resonance imaging.

PubMed

Kim, Ji-Eun; Son, Jung-Woo; Choi, Won-Hee; Kim, Yeoung-Rang; Oh, Jong-Hyun; Lee, Seungbok; Kim, Jang-Kyu

2014-06-01

This study aimed to examine differences in brain activation for various types of reward and feedback in adolescent Internet addicts (AIA) and normal adolescents (NA) using functional magnetic resonance imaging (fMRI). AIA (n = 15) and NA (n = 15) underwent fMRI while performing easy tasks for which performance feedback (PF), social reward (SR) (such as compliments), or monetary reward (MR) was given. Using the no reward (NR) condition, three types of contrasts (PF-NR, SR-NR, and MR-NR) were analyzed. In NA, we observed activation in the reward-related subcortical system, self-related brain region, and other brain areas for the three contrasts, but these brain areas showed almost no activation in AIA. Instead, AIA showed significant activation in the dorsolateral prefrontal cortex for the PF-NR contrast and the negative correlation was found between the level of activation in the left superior temporal gyrus (BA 22) and the duration of Internet game use per day in AIA. These findings suggest that AIA show reduced levels of self-related brain activation and decreased reward sensitivity irrespective of the type of reward and feedback. AIA may be only sensitive to error monitoring regardless of positive feelings, such as sense of satisfaction or achievement. © 2014 The Authors. Psychiatry and Clinical Neurosciences © 2014 Japanese Society of Psychiatry and Neurology.

A genetic polymorphism of the endogenous opioid dynorphin modulates monetary reward anticipation in the corticostriatal loop.

PubMed

Votinov, Mikhail; Pripfl, Juergen; Windischberger, Christian; Kalcher, Klaudius; Zimprich, Alexander; Zimprich, Fritz; Moser, Ewald; Lamm, Claus; Sailer, Uta

2014-01-01

The dynorphin/κ-opioid receptor (KOP-R) system has been shown to play a role in different types of behavior regulation, including reward-related behavior and drug craving. It has been shown that alleles with 3 or 4 repeats (HH genotype) of the variable nucleotide tandem repeat (68-bp VNTR) functional polymorphism of the prodynorphin (PDYN) gene are associated with higher levels of dynorphin peptides than alleles with 1 or 2 repeats (LL genotype). We used fMRI on N = 71 prescreened healthy participants to investigate the effect of this polymorphism on cerebral activation in the limbic-corticostriatal loop during reward anticipation. Individuals with the HH genotype showed higher activation than those with the LL genotype in the medial orbitofrontal cortex (mOFC) when anticipating a possible monetary reward. In addition, the HH genotype showed stronger functional coupling (as assessed by effective connectivity analyses) of mOFC with VMPFC, subgenual anterior cingulate cortex, and ventral striatum during reward anticipation. This hints at a larger sensitivity for upcoming rewards in individuals with the HH genotype, resulting in a higher motivation to attain these rewards. These findings provide first evidence in humans that the PDYN polymorphism modulates neural processes associated with the anticipation of rewards, which ultimately may help to explain differences between genotypes with respect to addiction and drug abuse.

Mechanisms of value-learning in the guidance of spatial attention.

PubMed

Anderson, Brian A; Kim, Haena

2018-05-11

The role of associative reward learning in the guidance of feature-based attention is well established. The extent to which reward learning can modulate spatial attention has been much more controversial. At least one demonstration of a persistent spatial attention bias following space-based associative reward learning has been reported. At the same time, multiple other experiments have been published failing to demonstrate enduring attentional biases towards locations at which a target, if found, yields high reward. This is in spite of evidence that participants use reward structures to inform their decisions where to search, leading some to suggest that, unlike feature-based attention, spatial attention may be impervious to the influence of learning from reward structures. Here, we demonstrate a robust bias towards regions of a scene that participants were previously rewarded for selecting. This spatial bias relies on representations that are anchored to the configuration of objects within a scene. The observed bias appears to be driven specifically by reinforcement learning, and can be observed with equal strength following non-reward corrective feedback. The time course of the bias is consistent with a transient shift of attention, rather than a strategic search pattern, and is evident in eye movement patterns during free viewing. Taken together, our findings reconcile previously conflicting reports and offer an integrative account of how learning from feedback shapes the spatial attention system. Copyright © 2018 Elsevier B.V. All rights reserved.

The "highs and lows" of the human brain on dopaminergics: Evidence from neuropharmacology.

PubMed

Martins, Daniel; Mehta, Mitul A; Prata, Diana

2017-09-01

Rewards are appetitive events that elicit approach. Ground-breaking findings from neurophysiological experiments in animals, alongside neuropharmacology and neuroimaging research in human samples have identified dopamine as the main neurochemical messenger of global reward processing in the brain. However, dopamine's contribution to the different components of reward processing remains to be precisely defined. To facilitate the informed design and interpretation of reward studies in humans, we have systematically reviewed all existing human pharmacological studies investigating how drug manipulation of the dopamine system affects reward-related behaviour and its neural correlates. Pharmacological experiments in humans face methodological challenges in terms of the: 1) specificity and safety of the available drugs for administration in humans, 2) uncertainties about pre- or post-synaptic modes of action, and 3) possible interactions with inter-individual neuropsychological or genotypic variables. In order to circumvent some of these limitations, future research should rely on the combination of different levels of observation, in integrative pharmaco-genetics-neurobehavioral approaches, to more completely characterize dopamine's role in both general and modality-specific processing of reward. Copyright © 2017 Elsevier Ltd. All rights reserved.

When Does Reward Maximization Lead to Matching Law?

PubMed Central

Sakai, Yutaka; Fukai, Tomoki

2008-01-01

What kind of strategies subjects follow in various behavioral circumstances has been a central issue in decision making. In particular, which behavioral strategy, maximizing or matching, is more fundamental to animal's decision behavior has been a matter of debate. Here, we prove that any algorithm to achieve the stationary condition for maximizing the average reward should lead to matching when it ignores the dependence of the expected outcome on subject's past choices. We may term this strategy of partial reward maximization “matching strategy”. Then, this strategy is applied to the case where the subject's decision system updates the information for making a decision. Such information includes subject's past actions or sensory stimuli, and the internal storage of this information is often called “state variables”. We demonstrate that the matching strategy provides an easy way to maximize reward when combined with the exploration of the state variables that correctly represent the crucial information for reward maximization. Our results reveal for the first time how a strategy to achieve matching behavior is beneficial to reward maximization, achieving a novel insight into the relationship between maximizing and matching. PMID:19030101

Extrinsic Reward and Intrinsic Motivation: A Review with Implications for the Classroom.

ERIC Educational Resources Information Center

Bates, John A.

1979-01-01

The notion that certain systems of reward may inhibit children's desire to participate in educational activities was investigated by reviewing recent research on intrinsic motivation. This research was critiqued from four theoretical perspectives: self-perception theory, personal causation, the overjustification hypothesis, and behavioral…

Interplay between cooperation-enhancing mechanisms in evolutionary games with tag-mediated interactions

NASA Astrophysics Data System (ADS)

Hadzibeganovic, Tarik; Stauffer, Dietrich; Han, Xiao-Pu

2018-04-01

Cooperation is fundamental for the long-term survival of biological, social, and technological networks. Previously, mechanisms for the enhancement of cooperation, such as network reciprocity, have largely been studied in isolation and with often inconclusive findings. Here, we present an evolutionary, multiagent-based, and spatially explicit computer model to specifically address the interactive interplay between such mechanisms. We systematically investigate the effects of phenotypic diversity, network structure, and rewards on cooperative behavior emerging in a population of reproducing artificial decision makers playing tag-mediated evolutionary games. Cooperative interactions are rewarded such that both the benefits of recipients and costs of donators are affected by the reward size. The reward size is determined by the number of cooperative acts occurring within a given reward time frame. Our computational experiments reveal that small reward frames promote unconditional cooperation in populations with both low and high diversity, whereas large reward frames lead to cycles of conditional and unconditional strategies at high but not at low diversity. Moreover, an interaction between rewards and spatial structure shows that relative to small reward frames, there is a strong difference between the frequency of conditional cooperators populating rewired versus non-rewired networks when the reward frame is large. Notably, in a less diverse population, the total number of defections is comparable across different network topologies, whereas in more diverse environments defections become more frequent in a regularly structured than in a rewired, small-world network of contacts. Acknowledging the importance of such interaction effects in social dilemmas will have inevitable consequences for the future design of cooperation-enhancing protocols in large-scale, distributed, and decentralized systems such as peer-to-peer networks.

Human prosaccades and antisaccades under risk: effects of penalties and rewards on visual selection and the value of actions.

PubMed

Ross, M; Lanyon, L J; Viswanathan, J; Manoach, D S; Barton, J J S

2011-11-24

Monkey studies report greater activity in the lateral intraparietal area and more efficient saccades when targets coincide with the location of prior reward cues, even when cue location does not indicate which responses will be rewarded. This suggests that reward can modulate spatial attention and visual selection independent of the "action value" of the motor response. Our goal was first to determine whether reward modulated visual selection similarly in humans, and next, to discover whether reward and penalty differed in effect, if cue effects were greater for cognitively demanding antisaccades, and if financial consequences that were contingent on stimulus location had spatially selective effects. We found that motivational cues reduced all latencies, more for reward than penalty. There was an "inhibition-of-return"-like effect at the location of the cue, but unlike the results in monkeys, cue valence did not modify this effect in prosaccades, and the inhibition-of-return effect was slightly increased rather than decreased in antisaccades. When financial consequences were contingent on target location, locations without reward or penalty consequences lost the benefits seen in noncontingent trials, whereas locations with consequences maintained their gains. We conclude that unlike monkeys, humans show reward effects not on visual selection but on the value of actions. The human saccadic system has both the capacity to enhance responses to multiple locations simultaneously, and the flexibility to focus motivational enhancement only on locations with financial consequences. Reward is more effective than penalty, and both interact with the additional attentional demands of the antisaccade task. Copyright © 2011 IBRO. Published by Elsevier Ltd. All rights reserved.

Stress and reward processing in bipolar disorder: a functional magnetic resonance imaging study.

PubMed

Berghorst, Lisa H; Kumar, Poornima; Greve, Doug N; Deckersbach, Thilo; Ongur, Dost; Dutra, Sunny J; Pizzagalli, Diego A

2016-11-01

A link between negative life stress and the onset of mood episodes in bipolar disorder (BD) has been established, but processes underlying such a link remain unclear. Growing evidence suggests that stress can negatively affect reward processing and related neurobiological substrates, indicating that a dysregulated reward system may provide a partial explanation. The aim of this study was to test the impact of stress on reward-related neural functioning in BD. Thirteen euthymic or mildly depressed individuals with BD and 15 controls performed a Monetary Incentive Delay (MID) task while undergoing functional magnetic resonance imaging during no-stress and stress (negative psychosocial stressor involving poor performance feedback and threat of monetary deductions) conditions. In hypothesis-driven region-of-interest analyses, a significant group-by-condition interaction emerged in the amygdala during reward anticipation. Relative to controls, while anticipating a potential reward, subjects with BD were characterized by amygdalar hyperactivation in the no-stress condition but hypoactivation during stress. Moreover, relative to controls, subjects with BD had significantly larger amygdala volumes. After controlling for structural differences, the effects of stress on amygdalar function remained, whereas groups no longer differed during the no-stress condition. During reward consumption, a group-by-condition interaction emerged in the putamen due to increased putamen activation in response to rewards in participants with BD during stress, but an opposite pattern in controls. Overall, findings highlight possible impairments in using reward-predicting cues to adaptively engage in goal-directed actions in BD, combined with stress-induced hypersensitivity to reward consumption. Potential clinical implications are discussed. © 2016 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Reward anticipation revisited- evidence from an fMRI study in euthymic bipolar I patients and healthy first-degree relatives.

PubMed

Kollmann, Bianca; Scholz, Vanessa; Linke, Julia; Kirsch, Peter; Wessa, Michèle

2017-09-01

Symptomatic phases in bipolar disorder (BD) are hypothesized to result from a hypersensitive behavioral activation system (BAS) being sensitive to potential rewards. However, studies on the neuronal underpinnings of reward anticipation in BD are scarce with contradictory findings and possibly confounded by effects of dopaminergic medication, necessitating further research on dysfunctional motivation in BD. Moreover, its role as vulnerability marker for BD is unclear. Functional imaging was conducted in 16 euthymic BD-I patients free from dopaminergic medication and 19 healthy first-degree relatives using a monetary incentive delay task and compared to parallelized control groups. Further, reward proneness, using the BIS/BAS questionnaire, and its relationship to neural reward anticipation was investigated. BD-I patients displayed greater anterior cingulate cortex (ACC) activity during reward anticipation and higher BIS total scores compared to controls, with a positive relationship between the two measures. There were no neural or self-report group differences between relatives and controls. Due to the experimental design, the role of the ACC during receipt of reward remains unknown, sample sizes were rather small, and patients were not naïve to dopaminergic drugs, making an exclusion of medication effects on findings impossible. Our findings give new insights on reward anticipation in BD. BD-I patients rated themselves as more risk avoidant and showed larger recruitment of the ACC rather than ventral striatum compared to controls during reward anticipation, possibly to down-regulate hyperactive limbic reward regions. This activation seems to be a consequence of rather than a vulnerability marker for the disorder. Copyright © 2017 Elsevier B.V. All rights reserved.

Association between the oxytocin receptor (OXTR) gene and mesolimbic responses to rewards.

PubMed

Damiano, Cara R; Aloi, Joseph; Dunlap, Kaitlyn; Burrus, Caley J; Mosner, Maya G; Kozink, Rachel V; McLaurin, Ralph Edward; Mullette-Gillman, O'Dhaniel A; Carter, Ronald McKell; Huettel, Scott A; McClernon, Francis Joseph; Ashley-Koch, Allison; Dichter, Gabriel S

2014-01-31

There has been significant progress in identifying genes that confer risk for autism spectrum disorders (ASDs). However, the heterogeneity of symptom presentation in ASDs impedes the detection of ASD risk genes. One approach to understanding genetic influences on ASD symptom expression is to evaluate relations between variants of ASD candidate genes and neural endophenotypes in unaffected samples. Allelic variations in the oxytocin receptor (OXTR) gene confer small but significant risk for ASDs for which the underlying mechanisms may involve associations between variability in oxytocin signaling pathways and neural response to rewards. The purpose of this preliminary study was to investigate the influence of allelic variability in the OXTR gene on neural responses to monetary rewards in healthy adults using functional magnetic resonance imaging (fMRI). The moderating effects of three single nucleotide polymorphisms (SNPs) (rs1042778, rs2268493 and rs237887) of the OXTR gene on mesolimbic responses to rewards were evaluated using a monetary incentive delay fMRI task. T homozygotes of the rs2268493 SNP demonstrated relatively decreased activation in mesolimbic reward circuitry (including the nucleus accumbens, amygdala, insula, thalamus and prefrontal cortical regions) during the anticipation of rewards but not during the outcome phase of the task. Allelic variation of the rs1042778 and rs237887 SNPs did not moderate mesolimbic activation during either reward anticipation or outcomes. This preliminary study suggests that the OXTR SNP rs2268493, which has been previously identified as an ASD risk gene, moderates mesolimbic responses during reward anticipation. Given previous findings of decreased mesolimbic activation during reward anticipation in ASD, the present results suggest that OXTR may confer ASD risk via influences on the neural systems that support reward anticipation.

Reward and vocal production: song-associated place preference in songbirds.

PubMed

Riters, Lauren V; Stevenson, Sharon A

2012-05-15

Vocal production is crucial for successful social interactions in multiple species. Reward can strongly influence behavior; however, the extent to which reward systems influence vocal behavior is unknown. In songbirds, singing occurs in different contexts. It can be spontaneous and undirected (e.g., song produced alone or as part of a large flock) or directed towards a conspecific (e.g., song used to attract a mate or influence a competitor). In this study, we developed a conditioned place preference paradigm to measure reward associated with different types of singing behavior in two songbird species. Both male zebra finches and European starlings developed a preference for a chamber associated with production of undirected song, suggesting that the production of undirected song is tightly coupled to intrinsic reward. In contrast, neither starlings nor zebra finches developed a place preference in association with directed song; however, male starlings singing directed song that failed to attract a female developed a place aversion. Unsuccessful contact calling behavior was also associated with a place aversion. These findings suggest that directed vocal behavior is not tightly linked to intrinsic reward but may be externally reinforced by social interactions. Data across two species thus support the hypothesis that the production of undirected but not directed song is tightly coupled to intrinsic reward. This study is the first to identify song-associated reward and suggests that reward associated with vocal production differs depending upon the context in which communication occurs. The findings have implications for understanding what motivates animals to engage in social behaviors and ways in which distinct reward mechanisms function to direct socially appropriate behaviors. Copyright © 2012 Elsevier Inc. All rights reserved.

Song-associated reward correlates with endocannabinoid-related gene expression in male European starlings (Sturnus vulgaris).

PubMed

Hahn, Allison H; Merullo, Devin P; Spool, Jeremy A; Angyal, Caroline S; Stevenson, Sharon A; Riters, Lauren V

2017-03-27

Vocal communication is required for successful social interactions in numerous species. During the breeding season, songbirds produce songs that are reinforced by behavioral consequences (e.g., copulation). However, some songbirds also produce songs not obviously directed at other individuals. The consequences maintaining or reinforcing these songs are less obvious and the neural mechanisms associated with undirected communication are not well-understood. Previous studies indicate that undirected singing is intrinsically rewarding and mediated by opioid or dopaminergic systems; however, endocannabinoids are also involved in regulating reward and singing behavior. We used a conditioned place preference paradigm to examine song-associated reward in European starlings and quantitative real-time PCR to measure expression of endocannabinoid-related neural markers (CB 1 , FABP7, FABP5, FAAH, DAGLα), in brain regions involved in social behavior, reward and motivation (ventral tegmental area [VTA], periaqueductal gray [PAG], and medial preoptic nucleus [POM]), and a song control region (Area X). Our results indicate that starlings producing high rates of song developed a conditioned place preference, suggesting that undirected song is associated with a positive affective state. We found a significant positive relationship between song-associated reward and CB 1 receptors in VTA and a significant negative relationship between song-associated reward and CB 1 in PAG. There was a significant positive relationship between reward and the cannabinoid transporter FABP7 in POM and a significant negative relationship between reward and FABP7 in PAG. In Area X, FABP5 and DAGLα correlated positively with singing. These results suggest a role for endocannabinoid signaling in vocal production and reward associated with undirected communication. Copyright © 2017 IBRO. Published by Elsevier Ltd. All rights reserved.

Song-associated reward correlates with endocannabinoid-related gene expression in male European starlings (Sturnus vulgaris)

PubMed Central

Hahn, Allison H.; Merullo, Devin P.; Spool, Jeremy A.; Angyal, Caroline S.; Stevenson, Sharon A.; Riters, Lauren V.

2017-01-01

Vocal communication is required for successful social interactions in numerous species. During the breeding season, songbirds produce songs that are reinforced by behavioral consequences (e.g., copulation). However, some songbirds also produce songs not obviously directed at other individuals. The consequences maintaining or reinforcing these songs are less obvious and the neural mechanisms associated with undirected communication are not well-understood. Previous studies indicate that undirected singing is intrinsically rewarding and mediated by opioid or dopaminergic systems; however, endocannabinoids are also involved in regulating reward and singing behavior. We used a conditioned place preference paradigm to examine song-associated reward in European starlings and quantitative real-time PCR to measure expression of endocannabinoid-related neural markers (CB1, FABP7, FABP5, FAAH, DAGLα), in brain regions involved in social behavior, reward and motivation (ventral tegmental area [VTA], periaqueductal gray [PAG], and medial preoptic nucleus [POM]), and a song control region (Area X). Our results indicate that starlings producing high rates of song developed a conditioned place preference, suggesting that undirected song is associated with a positive affective state. We found a significant positive relationship between song-associated reward and CB1 receptors in VTA and a significant negative relationship between song-associated reward and CB1 in PAG. There was a significant positive relationship between reward and the cannabinoid transporter FABP7 in POM and a significant negative relationship between reward and FABP7 in PAG. In Area X, FABP5 and DAGLα correlated positively with singing. These results suggest a role for endocannabinoid signaling in vocal production and reward associated with undirected communication. PMID:28147243

[Cognitive Functions in the Prefrontal Association Cortex; Transitive Inference and the Lateral Prefrontal Cortex].

PubMed

Tanaka, Shingo; Oguchi, Mineki; Sakagami, Masamichi

2016-11-01

To behave appropriately in a complex and uncertain world, the brain makes use of several distinct learning systems. One such system is called the "model-free process", via which conditioning allows the association between a stimulus or response and a given reward to be learned. Another system is called the "model-based process". Via this process, the state transition between a stimulus and a response is learned so that the brain is able to plan actions prior to their execution. Several studies have tried to relate the difference between model-based and model-free processes to the difference in functions of the lateral prefrontal cortex (LPFC) and the striatum. Here, we describe a series of studies that demonstrate the ability of LPFC neurons to categorize visual stimuli by their associated behavioral responses and to generate abstract information. If LPFC neurons utilize abstract code to associate a stimulus with a reward, they should be able to infer similar relationships between other stimuli of the same category and their rewards without direct experience of these stimulus-reward contingencies. We propose that this ability of LPFC neurons to utilize abstract information can contribute to the model-based learning process.

Nicotine Withdrawal Induces Neural Deficits in Reward Processing.

PubMed

Oliver, Jason A; Evans, David E; Addicott, Merideth A; Potts, Geoffrey F; Brandon, Thomas H; Drobes, David J

2017-06-01

Nicotine withdrawal reduces neurobiological responses to nonsmoking rewards. Insight into these reward deficits could inform the development of targeted interventions. This study examined the effect of withdrawal on neural and behavioral responses during a reward prediction task. Smokers (N = 48) attended two laboratory sessions following overnight abstinence. Withdrawal was manipulated by having participants smoke three regular nicotine (0.6 mg yield; satiation) or very low nicotine (0.05 mg yield; withdrawal) cigarettes. Electrophysiological recordings of neural activity were obtained while participants completed a reward prediction task that involved viewing four combinations of predictive and reward-determining stimuli: (1) Unexpected Reward; (2) Predicted Reward; (3) Predicted Punishment; (4) Unexpected Punishment. The task evokes a medial frontal negativity that mimics the phasic pattern of dopaminergic firing in ventral tegmental regions associated with reward prediction errors. Nicotine withdrawal decreased the amplitude of the medial frontal negativity equally across all trial types (p < .001). Exploratory analyses indicated withdrawal increased time to initiate the next trial following unexpected punishment trials (p < .001) and response time on reward trials during withdrawal was positively related to nicotine dependence (p < .001). Nicotine withdrawal had equivocal impact across trial types, suggesting reward processing deficits are unlikely to stem from changes in phasic dopaminergic activity during prediction errors. Effects on tonic activity may be more pronounced. Pharmacological interventions directly targeting the dopamine system and behavioral interventions designed to increase reward motivation and responsiveness (eg, behavioral activation) may aid in mitigating withdrawal symptoms and potentially improving smoking cessation outcomes. Findings from this study indicate nicotine withdrawal impacts reward processing signals that are observable in smokers' neural activity. This may play a role in the subjective aversive experience of nicotine withdrawal and potentially contribute to smoking relapse. Interventions that address abnormal responding to both pleasant and unpleasant stimuli may be particularly effective for alleviating nicotine withdrawal. © The Author 2017. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Peril and Pleasure: An RDoC-inspired examination of threat responses and reward processing in anxiety and depression

PubMed Central

Dillon, Daniel G.; Rosso, Isabelle M.; Pechtel, Pia; Killgore, William D. S.; Rauch, Scott L.; Pizzagalli, Diego A.

2014-01-01

As a step toward addressing limitations in the current psychiatric diagnostic system, the NIMH recently developed the Research Domain Criteria (RDoC) to stimulate integrative research—spanning self-report, behavior, neural circuitry, and molecular/genetic mechanisms—on core psychological processes implicated in mental illness. Here, we use the RDoC conceptualization to review research on threat responses, reward processing, and their interaction. The first section of the manuscript highlights the pivotal role of exaggerated threat responses—mediated by circuits connecting the frontal cortex, amygdala, and midbrain—in anxiety, and reviews data indicating that genotypic variation in the serotonin system is associated with hyperactivity in this circuitry, which elevates the risk for anxiety and mood disorders. In the second section, we describe mounting evidence linking anhedonic behavior to deficits in psychological functions that rely heavily on dopamine signaling, especially cost/benefit decision-making and reward learning. The third section covers recent studies that document negative effects of acute threats and chronic stress on reward responses in humans. The mechanisms underlying such effects are unclear, but new optogenetic data in rodents indicate that GABAergic inhibition of midbrain dopamine neurons, driven by activation of the habenula, may play a fundamental role in stress-induced anhedonia. In addition to its basic scientific value, a better understanding of interactions between the neural systems that mediate threat and reward responses may offer relief from the burdensome condition of anxious depression. PMID:24151118

Antireward, compulsivity, and addiction: seminal contributions of Dr. Athina Markou to motivational dysregulation in addiction.

PubMed

Koob, George F

2017-05-01

Addiction is defined as a chronically relapsing disorder characterized by compulsive drug seeking that is hypothesized to derive from multiple sources of motivational dysregulation. Dr. Athina Markou made seminal contributions to our understanding of the neurobiology of addiction with her studies on the dysregulation of reward function using animal models with construct validity. Repeated overstimulation of the reward systems with drugs of abuse decreases reward function, characterized by brain stimulation reward and presumbably reflecting dysphoria-like states. The construct of negative reinforcement, defined as drug taking that alleviates a negative emotional state that is created by drug abstinence, is particularly relevant as a driving force in both the withdrawal/negative affect and preoccupation/anticipation stages of the addiction cycle. The negative emotional state that drives such negative reinforcement is hypothesized to derive from the dysregulation of key neurochemical circuits that drive incentive-salience/reward systems (dopamine, opioid peptides) in the ventral striatum and from the recruitment of brain stress systems (corticotropin-releasing factor, dynorphin) within the extended amygdala. As drug taking becomes compulsive-like, the factors that motivate behavior are hypothesized to shift to drug-seeking behavior that is driven not only by positive reinforcement but also by negative reinforcement. This shift in motivation is hypothesized to reflect the allostatic misregulation of hedonic tone such that drug taking makes the hedonic negative emotional state worse during the process of seeking temporary relief with compulsive drug taking.

Opioid Modulation of Value-Based Decision-Making in Healthy Humans.

PubMed

Eikemo, Marie; Biele, Guido; Willoch, Frode; Thomsen, Lotte; Leknes, Siri

2017-08-01

Modifying behavior to maximize reward is integral to adaptive decision-making. In rodents, the μ-opioid receptor (MOR) system encodes motivation and preference for high-value rewards. Yet it remains unclear whether and how human MORs contribute to value-based decision-making. We reasoned that if the human MOR system modulates value-based choice, this would be reflected by opposite effects of agonist and antagonist drugs. In a double-blind pharmacological cross-over study, 30 healthy men received morphine (10 mg), placebo, and the opioid antagonist naltrexone (50 mg). They completed a two-alternative decision-making task known to induce a considerable bias towards the most frequently rewarded response option. To quantify MOR involvement in this bias, we fitted accuracy and reaction time data with the drift-diffusion model (DDM) of decision-making. The DDM analysis revealed the expected bidirectional drug effects for two decision subprocesses. MOR stimulation with morphine increased the preference for the stimulus with high-reward probability (shift in starting point). Compared to placebo, morphine also increased, and naltrexone reduced, the efficiency of evidence accumulation. Since neither drug affected motor-coordination, speed-accuracy trade-off, or subjective state (indeed participants were still blinded after the third session), we interpret the MOR effects on evidence accumulation efficiency as a consequence of changes in effort exerted in the task. Together, these findings support a role for the human MOR system in value-based choice by tuning decision-making towards high-value rewards across stimulus domains.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Volkow N. D.; Wang G.; Volkow, N.D.

The ability to resist the urge to eat requires the proper functioning of neuronal circuits involved in top-down control to oppose the conditioned responses that predict reward from eating the food and the desire to eat the food. Imaging studies show that obese subjects might have impairments in dopaminergic pathways that regulate neuronal systems associated with reward sensitivity, conditioning and control. It is known that the neuropeptides that regulate energy balance (homeostatic processes) through the hypothalamus also modulate the activity of dopamine cells and their projections into regions involved in the rewarding processes underlying food intake. It is postulated thatmore » this could also be a mechanism by which overeating and the resultant resistance to homoeostatic signals impairs the function of circuits involved in reward sensitivity, conditioning and cognitive control.« less

Adolescent cannabinoid exposure effects on natural reward seeking and learning in rats.

PubMed

Schoch, H; Huerta, M Y; Ruiz, C M; Farrell, M R; Jung, K M; Huang, J J; Campbell, R R; Piomelli, D; Mahler, S V

2018-01-01

Adolescence is characterized by endocannabinoid (ECB)-dependent refinement of neural circuits underlying emotion, learning, and motivation. As a result, adolescent cannabinoid receptor stimulation (ACRS) with phytocannabinoids or synthetic agonists like "Spice" cause robust and persistent changes in both behavior and circuit architecture in rodents, including in reward-related regions like medial prefrontal cortex and nucleus accumbens (NAc). Here, we examine persistent effects of ACRS with the cannabinoid receptor 1/2 specific agonist WIN55-212,2 (WIN; 1.2 mg/kg/day, postnatal day (PD) 30-43), on natural reward-seeking behaviors and ECB system function in adult male Long Evans rats (PD 60+). WIN ACRS increased palatable food intake, and altered attribution of incentive salience to food cues in a sign-/goal-tracking paradigm. ACRS also blunted hunger-induced sucrose intake, and resulted in increased anandamide and oleoylethanolamide levels in NAc after acute food restriction not seen in controls. ACRS did not affect food neophobia or locomotor response to a novel environment, but did increase preference for exploring a novel environment. These results demonstrate that ACRS causes long-term increases in natural reward-seeking behaviors and ECB system function that persist into adulthood, potentially increasing liability to excessive natural reward seeking later in life.

Model-free and model-based reward prediction errors in EEG.

PubMed

Sambrook, Thomas D; Hardwick, Ben; Wills, Andy J; Goslin, Jeremy

2018-05-24

Learning theorists posit two reinforcement learning systems: model-free and model-based. Model-based learning incorporates knowledge about structure and contingencies in the world to assign candidate actions with an expected value. Model-free learning is ignorant of the world's structure; instead, actions hold a value based on prior reinforcement, with this value updated by expectancy violation in the form of a reward prediction error. Because they use such different learning mechanisms, it has been previously assumed that model-based and model-free learning are computationally dissociated in the brain. However, recent fMRI evidence suggests that the brain may compute reward prediction errors to both model-free and model-based estimates of value, signalling the possibility that these systems interact. Because of its poor temporal resolution, fMRI risks confounding reward prediction errors with other feedback-related neural activity. In the present study, EEG was used to show the presence of both model-based and model-free reward prediction errors and their place in a temporal sequence of events including state prediction errors and action value updates. This demonstration of model-based prediction errors questions a long-held assumption that model-free and model-based learning are dissociated in the brain. Copyright © 2018 Elsevier Inc. All rights reserved.

Song practice as a rewarding form of play in songbirds.

PubMed

Riters, Lauren V; Spool, Jeremy A; Merullo, Devin P; Hahn, Allison H

2017-10-12

In adult songbirds, the primary functions of song are mate attraction and territory defense; yet, many songbirds sing at high rates as juveniles and outside these primary contexts as adults. Singing outside primary contexts is critical for song learning and maintenance, and ultimately necessary for breeding success. However, this type of singing (i.e., song "practice") occurs even in the absence of immediate or obvious extrinsic reinforcement; that is, it does not attract mates or repel competitors. Here we review studies that support the hypothesis that song practice is stimulated and maintained by intrinsic reward mechanisms (i.e., that it is associated with a positive affective state). Additionally, we propose that song practice can be considered a rewarding form of play behavior similar to forms of play observed in multiple young animals as they practice sequences of motor events that are used later in primary adult reproductive contexts. This review highlights research suggesting at least partially overlapping roles for neural reward systems in birdsong and mammalian play and evidence that steroid hormones modify these systems to shift animals from periods of intrinsically rewarded motor exploration (i.e., singing in birds and play in mammals) to the use of similar motor patterns in primary reproductive contexts. Copyright © 2017 Elsevier B.V. All rights reserved.

Altered prefrontal correlates of monetary anticipation and outcome in chronic pain.

PubMed

Martucci, Katherine T; Borg, Nicholas; MacNiven, Kelly H; Knutson, Brian; Mackey, Sean C

2018-04-04

Chronic pain may alter both affect- and value-related behaviors, which represents a potentially treatable aspect of chronic pain experience. Current understanding of how chronic pain influences the function of brain reward systems, however, is limited. Using a monetary incentive delay task and functional magnetic resonance imaging (fMRI), we measured neural correlates of reward anticipation and outcomes in female participants with the chronic pain condition of fibromyalgia (N = 17) and age-matched, pain-free, female controls (N = 15). We hypothesized that patients would demonstrate lower positive arousal, as well as altered reward anticipation and outcome activity within corticostriatal circuits implicated in reward processing. Patients demonstrated lower arousal ratings as compared with controls, but no group differences were observed for valence, positive arousal, or negative arousal ratings. Group fMRI analyses were conducted to determine predetermined region of interest, nucleus accumbens (NAcc) and medial prefrontal cortex (mPFC), responses to potential gains, potential losses, reward outcomes, and punishment outcomes. Compared with controls, patients demonstrated similar, although slightly reduced, NAcc activity during gain anticipation. Conversely, patients demonstrated dramatically reduced mPFC activity during gain anticipation-possibly related to lower estimated reward probabilities. Further, patients demonstrated normal mPFC activity to reward outcomes, but dramatically heightened mPFC activity to no-loss (nonpunishment) outcomes. In parallel to NAcc and mPFC responses, patients demonstrated slightly reduced activity during reward anticipation in other brain regions, which included the ventral tegmental area, anterior cingulate cortex, and anterior insular cortex. Together, these results implicate altered corticostriatal processing of monetary rewards in chronic pain.

Probabilistic reversal learning is impaired in Parkinson's disease

PubMed Central

Peterson, David A.; Elliott, Christian; Song, David D.; Makeig, Scott; Sejnowski, Terrence J.; Poizner, Howard

2009-01-01

In many everyday settings, the relationship between our choices and their potentially rewarding outcomes is probabilistic and dynamic. In addition, the difficulty of the choices can vary widely. Although a large body of theoretical and empirical evidence suggests that dopamine mediates rewarded learning, the influence of dopamine in probabilistic and dynamic rewarded learning remains unclear. We adapted a probabilistic rewarded learning task originally used to study firing rates of dopamine cells in primate substantia nigra pars compacta (Morris et al. 2006) for use as a reversal learning task with humans. We sought to investigate how the dopamine depletion in Parkinson's disease (PD) affects probabilistic reward learning and adaptation to a reversal in reward contingencies. Over the course of 256 trials subjects learned to choose the more favorable from among pairs of images with small or large differences in reward probabilities. During a subsequent otherwise identical reversal phase, the reward probability contingencies for the stimuli were reversed. Seventeen Parkinson's disease (PD) patients of mild to moderate severity were studied off of their dopaminergic medications and compared to 15 age-matched controls. Compared to controls, PD patients had distinct pre- and post-reversal deficiencies depending upon the difficulty of the choices they had to learn. The patients also exhibited compromised adaptability to the reversal. A computational model of the subjects’ trial-by-trial choices demonstrated that the adaptability was sensitive to the gain with which patients weighted pre-reversal feedback. Collectively, the results implicate the nigral dopaminergic system in learning to make choices in environments with probabilistic and dynamic reward contingencies. PMID:19628022

Putting the brakes on the "drive to eat": Pilot effects of naltrexone and reward based eating on food cravings among obese women

PubMed Central

Mason, Ashley E.; Laraia, Barbara; Daubenmier, Jennifer; Hecht, Frederick M.; Lustig, Robert H.; Puterman, Eli; Adler, Nancy; Dallman, Mary; Kiernan, Michaela; Gearhardt, Ashley N.; Epel, Elissa S.

2015-01-01

Purpose Obese individuals vary in their experience of food cravings and tendency to engage in reward-driven eating, both of which can be modulated by the neural reward system rather than physiological hunger. We examined two predictions in a sample of obese women: (1) whether opioidergic blockade reduced food-craving intensity, and (2) whether opioidergic blockade reduced an association between food-craving intensity and reward-driven eating, which is a trait-like index of three factors (lack of control over eating, lack of satiation, preoccupation with food). Methods Forty-four obese, pre-menopausal women completed the Reward-based Eating Drive (RED) scale at study start and daily food-craving intensity on 5 days on which they ingested either a pill-placebo (2 days), a 25mg naltrexone dose (1 day), or a standard 50mg naltrexone dose (2 days). Results Craving intensity was similar under naltrexone and placebo doses. The association between food-craving intensity and reward-driven eating significantly differed between placebo and 50mg naltrexone doses. Reward-driven eating and craving intensity were significantly positively associated under both placebo doses. As predicted, opioidergic blockade (for both doses 25mg and 50mg naltrexone) reduced this positive association between reward-driven eating and craving intensity to non-significance. Conclusions Opioidergic blockade did not reduce craving intensity; however, blockade reduced an association between trait-like reward-driven eating and daily food-craving intensity, and may help identify an important endophenotype within obesity. PMID:26164674

Brain Systems for Assessing Facial Attractiveness

ERIC Educational Resources Information Center

Winston, Joel S.; O'Doherty, John; Kilner, James M.; Perrett, David I.; Dolan, Raymond J.

2007-01-01

Attractiveness is a facial attribute that shapes human affiliative behaviours. In a previous study we reported a linear response to facial attractiveness in orbitofrontal cortex (OFC), a region involved in reward processing. There are strong theoretical grounds for the hypothesis that coding stimulus reward value also involves the amygdala. The…

Institutionalizing Faculty Mentoring within a Community of Practice Model

ERIC Educational Resources Information Center

Smith, Emily R.; Calderwood, Patricia E.; Storms, Stephanie Burrell; Lopez, Paula Gill; Colwell, Ryan P.

2016-01-01

In higher education, faculty work is typically enacted--and rewarded--on an individual basis. Efforts to promote collaboration run counter to the individual and competitive reward systems that characterize higher education. Mentoring initiatives that promote faculty collaboration and support also defy the structural and cultural norms of higher…

Effect of Prazosin and Naltrexone on Script Induced Alcohol Craving in Veterans with Alcohol Use Disorders with and without Co-occurring PTSD

DTIC Science & Technology

2017-01-01

associated with continued problematic use and relapse is craving. Three different types of craving have been hypothesized, reward , relief, and obsessive...and each is postulated to be mediated by different neurological substrates. The neural networks postulated to subserve reward and relief craving...noradrenergic system with craving-related brain systems , blocking α1 receptors with the noradrenergic antagonist, prazosin, theoretically has the

Interaction of Reward Seeking and Self-Regulation in the Prediction of Risk Taking: A Cross-National Test of the Dual Systems Model

ERIC Educational Resources Information Center

Duell, Natasha; Steinberg, Laurence; Chein, Jason; Al-Hassan, Suha M.; Bacchini, Dario; Lei, Chang; Chaudhary, Nandita; Di Giunta, Laura; Dodge, Kenneth A.; Fanti, Kostas A.; Lansford, Jennifer E.; Malone, Patrick S.; Oburu, Paul; Pastorelli, Concetta; Skinner, Ann T.; Sorbring, Emma; Tapanya, Sombat; Uribe Tirado, Liliana Maria; Alampay, Liane Peña

2016-01-01

In the present analysis, we test the dual systems model of adolescent risk taking in a cross-national sample of over 5,200 individuals aged 10 through 30 (M = 17.05 years, SD = 5.91) from 11 countries. We examine whether reward seeking and self-regulation make independent, additive, or interactive contributions to risk taking, and ask whether…

Sex Differences in Drug-Related Stress-System Changes: Implications for Treatment in Substance-Abusing Women

PubMed Central

Fox, Helen C.; Sinha, Rajita

2009-01-01

Extensive research indicates that chronic substance abuse disrupts stress and reward systems of the brain. Gender variation within these stress-system alterations, including the impact of sex hormones on these changes, may influence sex-specific differences in both the development of, and recovery from, dependency. As such, gender variations in stress-system function may also provide a viable explanation for why women are markedly more vulnerable than men to the negative consequences of drug use. This article therefore initially reviews studies that have examined gender differences in emotional and biophysiological changes to the stress and reward system following the acute administration of drugs, including cocaine, alcohol, and nicotine. The article then reviews studies that have examined gender differences in response to various types of stress in both healthy and drug-abusing populations. Studies examining the impact of sex hormones on these gender-related responses are also reported. The implications of these sex-specific variations in stress and reward system function are discussed in terms of both comorbid psychopathology and treatment outcome. PMID:19373619

Evidence for opioid involvement in the motivation to sing.

PubMed

Riters, Lauren V

2010-03-01

Songbirds produce high rates of song within multiple social contexts, suggesting that they are highly motivated to sing and that song production itself may be rewarding. Progress has been made in understanding the neural basis of song learning and sensorimotor processing, however little is known about neurobiological mechanisms regulating the motivation to sing. Neural systems involved in motivation and reward have been conserved across species and in songbirds are neuroanatomically well-positioned to influence the song control system. Opioid neuropeptides within these systems play a primary role in hedonic reward, at least in mammals. In songbirds, opioid neuropeptides and receptors are found throughout the song control system and within several brain regions implicated in both motivation and reward, including the medial preoptic nucleus (POM) and ventral tegmental area (VTA). Growing research shows these regions to play a role in birdsong that differs depending upon whether song is sexually motivated in response to a female, used for territorial defense or sung as part of a flock but not directed towards an individual (undirected song). Opioid pharmacological manipulations and immunocytochemical data demonstrate a role for opioid activity possibly within VTA and POM in the regulation of song production. Although future research is needed, data suggest that opioids may be most critically involved in reinforcing song that does not result in any obvious form of immediate externally mediated reinforcement, such as undirected song produced in large flocks or during song learning. Data are reviewed supporting the idea that dopamine activity underlies the motivation or drive to sing, but that opioid release is what makes song production rewarding. Copyright 2009 Elsevier B.V. All rights reserved.

Peer Influences on Adolescent Decision Making.

PubMed

Albert, Dustin; Chein, Jason; Steinberg, Laurence

2013-04-01

Research efforts to account for elevated risk behavior among adolescents have arrived at an exciting new stage. Moving beyond laboratory studies of age differences in "cool" cognitive processes related to risk perception and reasoning, new approaches have shifted focus to the influence of social and emotional factors on adolescent neurocognition. We review recent research suggesting that adolescent risk-taking propensity derives in part from a maturational gap between early adolescent remodeling of the brain's socio-emotional reward system and a gradual, prolonged strengthening of the cognitive control system. At a time when adolescents spend an increasing amount of time with their peers, research suggests that peer-related stimuli may sensitize the reward system to respond to the reward value of risky behavior. As the cognitive control system gradually matures over the course of the teenage years, adolescents grow in their capacity to coordinate affect and cognition, and to exercise self-regulation even in emotionally arousing situations. These capacities are reflected in gradual growth in the capacity to resist peer influence.

Deep brain stimulation surgery for alcohol addiction.

PubMed

Voges, Juergen; Müller, Ulf; Bogerts, Bernhard; Münte, Thomas; Heinze, Hans-Jochen

2013-01-01

The consequences of chronic alcohol dependence cause important health and economic burdens worldwide. Relapse rates after standard treatment (medication and psychotherapy) are high. There is evidence from in vivo investigations and from studies in patients that the brain's reward system is critically involved in the development and maintenance of addictive behavior, suggesting that modification of this system could significantly improve the prognosis of addictive patients. Motivated by an accidental observation, we used the nucleus accumbens (NAc), which has a central position in the dopaminergic reward system for deep brain stimulation (DBS) of alcohol addiction. We report our first experiences with NAc DBS for alcohol dependence and review the literature addressing the mechanisms leading to addiction. Five patients were treated off-label with bilateral NAc DBS for severe alcohol addiction (average follow-up 38 months). All patients experienced significant and ongoing improvement of craving. Two patients remained completely abstinent for more than 4 years. NAc stimulation was tolerated without permanent side effects. Simultaneous recording of local field potentials from the target area and surface electroencephalography while patients performed neuropsychological tasks gave a hint on the pivotal role of the NAc in processing alcohol-related cues. To our knowledge, the data presented here reflect the first attempt to treat alcohol-addicted patients with NAc DBS. Electrical NAc stimulation probably counterbalances the effect of drug-related stimuli triggering involuntarily drug-seeking behavior. Meanwhile, two prospective clinical studies using randomized, double-blind, and crossover stimulation protocols for DBS are underway to corroborate these preliminary results. Published by Elsevier Inc.

Anabolic-androgenic steroids and decision making: Probability and effort discounting in male rats.

PubMed

Wallin, Kathryn G; Alves, Jasmin M; Wood, Ruth I

2015-07-01

Anabolic-androgenic steroid (AAS) abuse is implicated in maladaptive behaviors such as increased aggression and risk taking. Impaired judgment due to changes in the mesocorticolimbic dopamine system may contribute to these behavioral changes. While AAS are known to influence dopamine function in mesocorticolimbic circuitry, the effects on decision making are unknown. This was the focus of the present study. Adolescent male Long-Evans rats were treated chronically with high-dose testosterone (7.5 mg/kg) or vehicle (13% cyclodextrin in water), and tested for cost/benefit decision making in two discounting paradigms. Rats chose between a small reward (1 sugar pellet) and a large discounted reward (3 or 4 pellets). Probability discounting (PD) measures sensitivity to reward uncertainty by decreasing the probability (100, 75, 50, 25, 0%) of receiving the large reward in successive blocks of each daily session. Effort discounting (ED) measures sensitivity to a work cost by increasing the lever presses required to earn the large reward (1, 2, 5, 10, 15 presses). In PD, testosterone-treated rats selected the large/uncertain reward significantly less than vehicle-treated controls. However, during ED, testosterone-treated rats selected the large/high effort reward significantly more than controls. These studies show that testosterone has divergent effects on different aspects of decision making. Specifically, testosterone increases aversion to uncertainty but decreases sensitivity to the output of effort for reward. These results have implications for understanding maladaptive behavioral changes in human AAS users. Copyright © 2015 Elsevier Ltd. All rights reserved.

Brain substrates of reward processing and the μ-opioid receptor: a pathway into pain?

PubMed

Nees, Frauke; Becker, Susanne; Millenet, Sabina; Banaschewski, Tobias; Poustka, Luise; Bokde, Arun; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J; Desrivières, Sylvane; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Heinz, Andreas; Ittermann, Bernd; Martinot, Jean-Luc; Papadopoulos Orfanos, Dimitri; Paus, Tomáš; Smolka, Michael N; Walter, Henrik; Whelan, Rob; Schumann, Gunter; Flor, Herta

2017-02-01

The processing of reward and reinforcement learning seems to be important determinants of pain chronicity. However, reward processing is already altered early in life and if this is related to the development of pain symptoms later on is not known. The aim of this study was first to examine whether behavioural and brain-related indicators of reward processing at the age of 14 to 15 years are significant predictors of pain complaints 2 years later, at 16 to 17 years. Second, we investigated the contribution of genetic variations in the opioidergic system, which is linked to the processing of both, reward and pain, to this prediction. We used the monetary incentive delay task to assess reward processing, the Children's Somatization Inventory as measure of pain complaints and tested the effects of 2 single nucleotide polymorphisms (rs1799971/rs563649) of the human μ-opioid receptor gene. We found a significant prediction of pain complaints by responses in the dorsal striatum during reward feedback, independent of genetic predisposition. The relationship of pain complaints and activation in the periaqueductal gray and ventral striatum depended on the T-allele of rs563649. Carriers of this allele also showed more pain complaints than CC-allele carriers. Therefore, brain responses to reward outcomes and higher sensitivity to pain might be related already early in life and may thus set the course for pain complaints later in life, partly depending on a specific opioidergic genetic predisposition.

Dopamine D2/3- and μ-opioid receptor antagonists reduce cue-induced responding and reward impulsivity in humans.

PubMed

Weber, S C; Beck-Schimmer, B; Kajdi, M-E; Müller, D; Tobler, P N; Quednow, B B

2016-07-05

Increased responding to drug-associated stimuli (cue reactivity) and an inability to tolerate delayed gratification (reward impulsivity) have been implicated in the development and maintenance of drug addiction. Whereas data from animal studies suggest that both the dopamine and opioid system are involved in these two reward-related processes, their role in humans is less clear. Moreover, dopaminergic and opioidergic drugs have not been directly compared with regard to these functions, even though a deeper understanding of the underlying mechanisms might inform the development of specific treatments for elevated cue reactivity and reward impulsivity. In a randomized, double-blind, between-subject design we administered the selective dopamine D2/D3 receptor antagonist amisulpride (400 mg, n=41), the unspecific opioid receptor antagonist naltrexone (50 mg, n=40) or placebo (n=40) to healthy humans and measured cue-induced responding with a Pavlovian-instrumental transfer task and reward impulsivity with a delay discounting task. Mood was assessed using a visual analogue scale. Compared with placebo, amisulpride significantly suppressed cue-induced responding and reward impulsivity. The effects of naltrexone were similar, although less pronounced. Both amisulpride and naltrexone decreased average mood ratings compared with placebo. Our results demonstrate that a selective blockade of dopamine D2/D3 receptors reduces cue-induced responding and reward impulsivity in healthy humans. Antagonizing μ-opioid receptors has similar effects for cue-induced responding and to a lesser extent for reward impulsivity.

Neural Processing of Calories in Brain Reward Areas Can be Modulated by Reward Sensitivity

PubMed Central

van Rijn, Inge; Griffioen-Roose, Sanne; de Graaf, Cees; Smeets, Paul A. M.

2016-01-01

A food's reward value is dependent on its caloric content. Furthermore, a food's acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity), however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015), in which participants (n = 30) tasted simple solutions of a non-caloric sweetener with or without a non-sweet carbohydrate (maltodextrin) during hunger and satiety. Secondly, we expanded these analyses to regular drinks by assessing the same relationship in data from a study in which soft drinks sweetened with either sucrose or a non-caloric sweetener were administered during hunger (n = 18) (Griffioen-Roose et al., 2013). First, taste activation by the non-caloric solution/soft drink was subtracted from that by the caloric solution/soft drink to eliminate sweetness effects and retain activation induced by calories. Subsequently, this difference in taste activation was correlated with reward sensitivity as measured with the BAS drive subscale of the Behavioral Activation System (BAS) questionnaire. When participants were hungry and tasted calories from the simple solution, brain activation in the right ventral striatum (caudate), right amygdala and anterior cingulate cortex (bilaterally) correlated negatively with BAS drive scores. In contrast, when participants were satiated, taste responses correlated positively with BAS drive scores in the left caudate. These results were not replicated for soft drinks. Thus, neural responses to oral calories from maltodextrin were modulated by reward sensitivity in reward-related brain areas. This was not the case for sucrose. This may be due to the direct detection of maltodextrin, but not sucrose in the oral cavity. Also, in a familiar beverage, detection of calories per se may be overruled by a conditioned response to its flavor. In conclusion, the brain reward response to calories from a long chain starch sugar (maltodextrin) varies with trait reward sensitivity. The absence of this effect in a familiar beverage warrants further research into its relevance for real life ingestive behavior. PMID:26834598

A Selective Role for Dopamine in Learning to Maximize Reward But Not to Minimize Effort: Evidence from Patients with Parkinson's Disease.

PubMed

Skvortsova, Vasilisa; Degos, Bertrand; Welter, Marie-Laure; Vidailhet, Marie; Pessiglione, Mathias

2017-06-21

Instrumental learning is a fundamental process through which agents optimize their choices, taking into account various dimensions of available options such as the possible reward or punishment outcomes and the costs associated with potential actions. Although the implication of dopamine in learning from choice outcomes is well established, less is known about its role in learning the action costs such as effort. Here, we tested the ability of patients with Parkinson's disease (PD) to maximize monetary rewards and minimize physical efforts in a probabilistic instrumental learning task. The implication of dopamine was assessed by comparing performance ON and OFF prodopaminergic medication. In a first sample of PD patients ( n = 15), we observed that reward learning, but not effort learning, was selectively impaired in the absence of treatment, with a significant interaction between learning condition (reward vs effort) and medication status (OFF vs ON). These results were replicated in a second, independent sample of PD patients ( n = 20) using a simplified version of the task. According to Bayesian model selection, the best account for medication effects in both studies was a specific amplification of reward magnitude in a Q-learning algorithm. These results suggest that learning to avoid physical effort is independent from dopaminergic circuits and strengthen the general idea that dopaminergic signaling amplifies the effects of reward expectation or obtainment on instrumental behavior. SIGNIFICANCE STATEMENT Theoretically, maximizing reward and minimizing effort could involve the same computations and therefore rely on the same brain circuits. Here, we tested whether dopamine, a key component of reward-related circuitry, is also implicated in effort learning. We found that patients suffering from dopamine depletion due to Parkinson's disease were selectively impaired in reward learning, but not effort learning. Moreover, anti-parkinsonian medication restored the ability to maximize reward, but had no effect on effort minimization. This dissociation suggests that the brain has evolved separate, domain-specific systems for instrumental learning. These results help to disambiguate the motivational role of prodopaminergic medications: they amplify the impact of reward without affecting the integration of effort cost. Copyright © 2017 the authors 0270-6474/17/376087-11$15.00/0.

Cannabis cue-elicited craving and the reward neurocircuitry.

PubMed

Filbey, Francesca M; DeWitt, Samuel J

2012-07-02

Cue-elicited craving or the intense desire to consume a substance following exposure to a conditioned drug cue is one of the primary behavioral symptoms of substance use disorders (SUDs). While the concept of cue-elicited craving is well characterized in alcohol and other substances of abuse, only recently has it been described in cannabis. A review of the extant literature has established that cue-elicited craving is a powerful reinforcer that contributes to drug-seeking for cannabis. Further, emergent research has begun to identify the neurobiological systems and neural mechanisms associated with this behavior. What research shows is that while theories of THC's effects on the dopaminergic-reward system remain divergent, cannabis cues elicit neural activation in the brain's reward network. Copyright © 2011 Elsevier Inc. All rights reserved.

Effective connectivity of a reward network in obese women

PubMed Central

Stoeckel, Luke E.; Kim, Jieun; Weller, Rosalyn E.; Cox, James E.; Cook, Edwin W.; Horwitz, Barry

2012-01-01

Exaggerated reactivity to food cues in obese women appears to be mediated in part by a hyperactive reward system that includes the nucleus accumbens, amygdala, and orbitofrontal cortex. The present study used fMRI to investigate whether differences between 12 obese and 12 normal-weight women in reward-related brain activation in response to food images can be explained by changes in the functional interactions between key reward network regions. A two-step path analysis/General Linear Model approach was used to test whether there were group differences in network connections between nucleus accumbens, amygdala, and orbitofrontal cortex in response to high- and low-calorie food images. There was abnormal connectivity in the obese group in response to both high- and low-calorie food cues compared to normal-weight controls. Compared to controls, the obese group had a relative deficiency in the amygdala’s modulation of activation in both orbitofrontal cortex and nucleus accumbens, but excessive influence of orbitofrontal cortex’s modulation of activation in nucleus accumbens. The deficient projections from the amygdala might relate to suboptimal modulation of the affective/emotional aspects of a food’s reward value or an associated cue’s motivational salience, whereas increased orbitofrontal cortex to nucleus accumbens connectivity might contribute to a heightened drive to eat in response to a food cue. Thus, it is possible that not only greater activation of the reward system, but also differences in the interaction of regions in this network may contribute to the relatively increased motivational value of foods in obese individuals. PMID:19467298

Reward circuitry dysfunction in psychiatric and neurodevelopmental disorders and genetic syndromes: animal models and clinical findings.

PubMed

Dichter, Gabriel S; Damiano, Cara A; Allen, John A

2012-07-06

This review summarizes evidence of dysregulated reward circuitry function in a range of neurodevelopmental and psychiatric disorders and genetic syndromes. First, the contribution of identifying a core mechanistic process across disparate disorders to disease classification is discussed, followed by a review of the neurobiology of reward circuitry. We next consider preclinical animal models and clinical evidence of reward-pathway dysfunction in a range of disorders, including psychiatric disorders (i.e., substance-use disorders, affective disorders, eating disorders, and obsessive compulsive disorders), neurodevelopmental disorders (i.e., schizophrenia, attention-deficit/hyperactivity disorder, autism spectrum disorders, Tourette's syndrome, conduct disorder/oppositional defiant disorder), and genetic syndromes (i.e., Fragile X syndrome, Prader-Willi syndrome, Williams syndrome, Angelman syndrome, and Rett syndrome). We also provide brief overviews of effective psychopharmacologic agents that have an effect on the dopamine system in these disorders. This review concludes with methodological considerations for future research designed to more clearly probe reward-circuitry dysfunction, with the ultimate goal of improved intervention strategies.

Reward circuitry dysfunction in psychiatric and neurodevelopmental disorders and genetic syndromes: animal models and clinical findings

PubMed Central

2012-01-01

This review summarizes evidence of dysregulated reward circuitry function in a range of neurodevelopmental and psychiatric disorders and genetic syndromes. First, the contribution of identifying a core mechanistic process across disparate disorders to disease classification is discussed, followed by a review of the neurobiology of reward circuitry. We next consider preclinical animal models and clinical evidence of reward-pathway dysfunction in a range of disorders, including psychiatric disorders (i.e., substance-use disorders, affective disorders, eating disorders, and obsessive compulsive disorders), neurodevelopmental disorders (i.e., schizophrenia, attention-deficit/hyperactivity disorder, autism spectrum disorders, Tourette’s syndrome, conduct disorder/oppositional defiant disorder), and genetic syndromes (i.e., Fragile X syndrome, Prader–Willi syndrome, Williams syndrome, Angelman syndrome, and Rett syndrome). We also provide brief overviews of effective psychopharmacologic agents that have an effect on the dopamine system in these disorders. This review concludes with methodological considerations for future research designed to more clearly probe reward-circuitry dysfunction, with the ultimate goal of improved intervention strategies. PMID:22958744

Brain connectivity reflects human aesthetic responses to music.

PubMed

Sachs, Matthew E; Ellis, Robert J; Schlaug, Gottfried; Loui, Psyche

2016-06-01

Humans uniquely appreciate aesthetics, experiencing pleasurable responses to complex stimuli that confer no clear intrinsic value for survival. However, substantial variability exists in the frequency and specificity of aesthetic responses. While pleasure from aesthetics is attributed to the neural circuitry for reward, what accounts for individual differences in aesthetic reward sensitivity remains unclear. Using a combination of survey data, behavioral and psychophysiological measures and diffusion tensor imaging, we found that white matter connectivity between sensory processing areas in the superior temporal gyrus and emotional and social processing areas in the insula and medial prefrontal cortex explains individual differences in reward sensitivity to music. Our findings provide the first evidence for a neural basis of individual differences in sensory access to the reward system, and suggest that social-emotional communication through the auditory channel may offer an evolutionary basis for music making as an aesthetically rewarding function in humans. © The Author (2016). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Early Parenting Moderates the Association between Parental Depression and Neural Reactivity to Rewards and Losses in Offspring.

PubMed

Kujawa, Autumn; Proudfit, Greg H; Laptook, Rebecca; Klein, Daniel N

2015-07-01

Children of parents with depression exhibit neural abnormalities in reward processing. Examining contributions of parenting could provide insight into the development of these abnormalities and to the etiology of depression. We evaluated whether early parenting moderates the effects of parental depression on a neural measure of reward and loss processing in mid-late childhood. Parenting was assessed when children were preschoolers. At age nine, children completed an event-related potential assessment and the feedback negativity (FN) was measured following rewards and losses ( N =344). Maternal authoritative parenting moderated the effect of maternal depression; among offspring of mothers with histories of depression, low authoritative parenting predicted a blunted FN. Observed maternal positive parenting interacted with paternal depression in a comparable manner, indicating that maternal parenting may buffer the effects of paternal depression. Early parenting may be important in shaping the neural systems involved in reward processing among children at high risk for depression.

Drug-Induced Alterations of Endocannabinoid-Mediated Plasticity in Brain Reward Regions.

PubMed

Zlebnik, Natalie E; Cheer, Joseph F

2016-10-05

The endocannabinoid (eCB) system has emerged as one of the most important mediators of physiological and pathological reward-related synaptic plasticity. eCBs are retrograde messengers that provide feedback inhibition, resulting in the suppression of neurotransmitter release at both excitatory and inhibitory synapses, and they serve a critical role in the spatiotemporal regulation of both short- and long-term synaptic plasticity that supports adaptive learning of reward-motivated behaviors. However, mechanisms of eCB-mediated synaptic plasticity in reward areas of the brain are impaired following exposure to drugs of abuse. Because of this, it is theorized that maladaptive eCB signaling may contribute to the development and maintenance of addiction-related behavior. Here we review various forms of eCB-mediated synaptic plasticity present in regions of the brain involved in reward and reinforcement and explore the potential physiological relevance of maladaptive eCB signaling to addiction vulnerability. Copyright © 2016 the authors 0270-6474/16/3610230-09$15.00/0.

Homeostatic reinforcement learning for integrating reward collection and physiological stability

PubMed Central

Keramati, Mehdi; Gutkin, Boris

2014-01-01

Efficient regulation of internal homeostasis and defending it against perturbations requires adaptive behavioral strategies. However, the computational principles mediating the interaction between homeostatic and associative learning processes remain undefined. Here we use a definition of primary rewards, as outcomes fulfilling physiological needs, to build a normative theory showing how learning motivated behaviors may be modulated by internal states. Within this framework, we mathematically prove that seeking rewards is equivalent to the fundamental objective of physiological stability, defining the notion of physiological rationality of behavior. We further suggest a formal basis for temporal discounting of rewards by showing that discounting motivates animals to follow the shortest path in the space of physiological variables toward the desired setpoint. We also explain how animals learn to act predictively to preclude prospective homeostatic challenges, and several other behavioral patterns. Finally, we suggest a computational role for interaction between hypothalamus and the brain reward system. DOI: http://dx.doi.org/10.7554/eLife.04811.001 PMID:25457346

Early Parenting Moderates the Association between Parental Depression and Neural Reactivity to Rewards and Losses in Offspring

PubMed Central

Kujawa, Autumn; Proudfit, Greg H.; Laptook, Rebecca; Klein, Daniel N.

2014-01-01

Children of parents with depression exhibit neural abnormalities in reward processing. Examining contributions of parenting could provide insight into the development of these abnormalities and to the etiology of depression. We evaluated whether early parenting moderates the effects of parental depression on a neural measure of reward and loss processing in mid-late childhood. Parenting was assessed when children were preschoolers. At age nine, children completed an event-related potential assessment and the feedback negativity (FN) was measured following rewards and losses (N=344). Maternal authoritative parenting moderated the effect of maternal depression; among offspring of mothers with histories of depression, low authoritative parenting predicted a blunted FN. Observed maternal positive parenting interacted with paternal depression in a comparable manner, indicating that maternal parenting may buffer the effects of paternal depression. Early parenting may be important in shaping the neural systems involved in reward processing among children at high risk for depression. PMID:26167423

Rewarding peer reviewers: maintaining the integrity of science communication.

PubMed

Gasparyan, Armen Yuri; Gerasimov, Alexey N; Voronov, Alexander A; Kitas, George D

2015-04-01

This article overviews currently available options for rewarding peer reviewers. Rewards and incentives may help maintain the quality and integrity of scholarly publications. Publishers around the world implemented a variety of financial and nonfinancial mechanisms for incentivizing their best reviewers. None of these is proved effective on its own. A strategy of combined rewards and credits for the reviewers1 creative contributions seems a workable solution. Opening access to reviews and assigning publication credits to the best reviews is one of the latest achievements of digitization. Reviews, posted on academic networking platforms, such as Publons, add to the transparency of the whole system of peer review. Reviewer credits, properly counted and displayed on individual digital profiles, help distinguish the best contributors, invite them to review and offer responsible editorial posts.

Neurocircuitry of drug reward

PubMed Central

Ikemoto, Satoshi; Bonci, Antonello

2013-01-01

In recent years, neuroscientists have produced profound conceptual and mechanistic advances on the neurocircuitry of reward and substance use disorders. Here, we will provide a brief review of intracranial drug self-administration and optogenetic self-stimulation studies that identified brain regions and neurotransmitter systems involved in drug- and reward-related behaviors. Also discussed is a theoretical framework that helps to understand the functional properties of the circuitry involved in these behaviors. The circuitry appears to be homeostatically regulated and mediate anticipatory processes that regulate behavioral interaction with the environment in response to salient stimuli. That is, abused drugs or, at least, some may act on basic motivation and mood processes, regulating behavior-environment interaction. Optogenetics and related technologies have begun to uncover detailed circuit mechanisms linking key brain regions in which abused drugs act for rewarding effects. PMID:23664810

Rewarding Peer Reviewers: Maintaining the Integrity of Science Communication

PubMed Central

2015-01-01

This article overviews currently available options for rewarding peer reviewers. Rewards and incentives may help maintain the quality and integrity of scholarly publications. Publishers around the world implemented a variety of financial and nonfinancial mechanisms for incentivizing their best reviewers. None of these is proved effective on its own. A strategy of combined rewards and credits for the reviewers1 creative contributions seems a workable solution. Opening access to reviews and assigning publication credits to the best reviews is one of the latest achievements of digitization. Reviews, posted on academic networking platforms, such as Publons, add to the transparency of the whole system of peer review. Reviewer credits, properly counted and displayed on individual digital profiles, help distinguish the best contributors, invite them to review and offer responsible editorial posts. PMID:25829801

Begin Planning this Spring for a Yearlong Program Recognizing and Celebrating Quality.

ERIC Educational Resources Information Center

Caruso, Michael P.

2002-01-01

Outlines a model program for rewarding excellence, primarily in a Catholic elementary school that has discretionary funds for rewards and recognition, though it may be adapted for any school. Presents a monthly award system that utilizes Catholic culture and permeates the entire school year. Cites Disney program as a model. (NB)

When Changing from Merit Pay to Variable/Bonus Pay: What Do Employees Want?

ERIC Educational Resources Information Center

Fox, Jeremy B.; Donohue, Joan M.

2004-01-01

This study examines potential responses to a change in an employee reward system from permanent merit pay increases to one-time bonus payments. Removing long term risks associated with escalating pay is an increasingly common compensation strategy. Often overlooked, however, are employee perceptions of reward fairness under such conditions of…

Rewarding Faculty Scholarship at Two-Year Colleges: Incentive for Change or Perceived Threat?

ERIC Educational Resources Information Center

Padovan, Patricia; Whittington, Dale

1998-01-01

Explores the definition and relevance of faculty scholarship in the community college. Examines positive and negative attitudes toward various scholarship criteria in the faculty-reward (promotion, tenure, salary increase, and release time) systems, and discusses concerns about scholarship as an additional facet of faculty evaluation. (25…

Performance-Based Funding & Online Learning: Maximizing Resources for Student Success

ERIC Educational Resources Information Center

Patrick, Susan; Myers, John; Silverstein, Justin; Brown, Amanda; Watson, John

2015-01-01

There is a new conversation taking place in public education on creating systemic incentives through school finance to encourage schools to innovate and be rewarded for positive student outcomes and performance. What if education funding was not based on seat-time, but on rewarding student performance? Performance-based funding is a term that…

Electrophysiological Evidence of Atypical Motivation and Reward Processing in Children with Attention-Deficit Hyperactivity Disorder

ERIC Educational Resources Information Center

Holroyd, Clay B.; Baker, Travis E.; Kerns, Kimberly A.; Muller, Ulrich

2008-01-01

Behavioral and neurophysiological evidence suggest that attention-deficit hyperactivity disorder (ADHD) is characterized by the impact of abnormal reward prediction error signals carried by the midbrain dopamine system on frontal brain areas that implement cognitive control. To investigate this issue, we recorded the event-related brain potential…

Leveraging New Media in the Scholarship of Engagement: Opportunities and Incentives

ERIC Educational Resources Information Center

LaBelle, Chris; Anderson-Wilk, Mark; Emanuel, Robert

2011-01-01

This article looks at how Extension faculty and administrators perceive digital scholarship in relation to their institutions' reward systems. Our survey data suggest that even when land-grant institutions have policies in place to reward alternative or new forms of scholarship, these policies are often unclear or inaccessible, are not reflected…

Retention and Rewards: Promoting Career Advancement for Effective Leaders. [Federal Policy Platform Series. Brief 5

ERIC Educational Resources Information Center

New Leaders, 2014

2014-01-01

Principals are the leverage point for education reforms and the primary drivers of school improvement. A critical part of maintaining a corps of effective principals is rewarding and retaining the best school leaders. Unfortunately, few systems systematically identify principals that make important contributions to student learning or celebrate…

Executive functions, information sampling, and decision making in narcolepsy with cataplexy.

PubMed

Delazer, Margarete; Högl, Birgit; Zamarian, Laura; Wenter, Johanna; Gschliesser, Viola; Ehrmann, Laura; Brandauer, Elisabeth; Cevikkol, Zehra; Frauscher, Birgit

2011-07-01

Narcolepsy with cataplexy (NC) affects neurotransmitter systems regulating emotions and cognitive functions. This study aimed to assess executive functions, information sampling, reward processing, and decision making in NC. Twenty-one NC patients and 58 healthy participants performed an extensive neuropsychological test battery. NC patients scored as controls in executive function tasks assessing set shifting, reversal learning, working memory, and planning. Group differences appeared in a task measuring information sampling and reward sensitivity. NC patients gathered less information, tolerated a higher level of uncertainty, and were less influenced by reward contingencies than controls. NC patients also showed reduced learning in decision making and had significantly lower scores than controls in the fifth block of the IOWA gambling task. No correlations were found with measures of sleepiness. NC patients may achieve high performance in several neuropsychological domains, including executive functions. Specific differences between NC patients and controls highlight the importance of the hypocretin system in reward processing and decision making and are in line with previous neuroimaging and neurophysiological studies. PsycINFO Database Record (c) 2011 APA, all rights reserved.

From conflict management to reward-based decision making: actors and critics in primate medial frontal cortex.

PubMed

Silvetti, Massimo; Alexander, William; Verguts, Tom; Brown, Joshua W

2014-10-01

The role of the medial prefrontal cortex (mPFC) and especially the anterior cingulate cortex has been the subject of intense debate for the last decade. A number of theories have been proposed to account for its function. Broadly speaking, some emphasize cognitive control, whereas others emphasize value processing; specific theories concern reward processing, conflict detection, error monitoring, and volatility detection, among others. Here we survey and evaluate them relative to experimental results from neurophysiological, anatomical, and cognitive studies. We argue for a new conceptualization of mPFC, arising from recent computational modeling work. Based on reinforcement learning theory, these new models propose that mPFC is an Actor-Critic system. This system is aimed to predict future events including rewards, to evaluate errors in those predictions, and finally, to implement optimal skeletal-motor and visceromotor commands to obtain reward. This framework provides a comprehensive account of mPFC function, accounting for and predicting empirical results across different levels of analysis, including monkey neurophysiology, human ERP, human neuroimaging, and human behavior. Copyright © 2013 Elsevier Ltd. All rights reserved.

Perceived ownership impacts reward evaluation within medial-frontal cortex.

PubMed

Krigolson, Olave E; Hassall, Cameron D; Balcom, Lynsey; Turk, David

2013-06-01

Ownership is a powerful construct. Indeed, in a series of recent studies, perceived ownership has been shown to increase attentional capacity, facilitate a memorial advantage, and elicit positive attitudes. Here, we sought to determine whether self-relevance would bias reward evaluation systems within the brain. To accomplish this, we had participants complete a simple gambling task during which they could "win" or "lose" prizes for themselves or for someone else, while electroencephalographic data were recorded. Our results indicated that the amplitude of the feedback error-related negativity, a component of the event-related brain potential sensitive to reward evaluation, was diminished when participants were not gambling for themselves. Furthermore, our data suggest that the ownership cues that indicated who would win or lose a given gamble either were processed as a potential for an increase in utility (i.e., gain: self-gambles) or were processed in a nonutilitarian manner (other-gambles). Importantly, our results suggest that the medial-frontal reward system is sensitive to perceived ownership, to the extent that it may not process changes in utility when they are not directly relevant to self.

Mood, food, and obesity.

PubMed

Singh, Minati

2014-01-01

Food is a potent natural reward and food intake is a complex process. Reward and gratification associated with food consumption leads to dopamine (DA) production, which in turn activates reward and pleasure centers in the brain. An individual will repeatedly eat a particular food to experience this positive feeling of gratification. This type of repetitive behavior of food intake leads to the activation of brain reward pathways that eventually overrides other signals of satiety and hunger. Thus, a gratification habit through a favorable food leads to overeating and morbid obesity. Overeating and obesity stems from many biological factors engaging both central and peripheral systems in a bi-directional manner involving mood and emotions. Emotional eating and altered mood can also lead to altered food choice and intake leading to overeating and obesity. Research findings from human and animal studies support a two-way link between three concepts, mood, food, and obesity. The focus of this article is to provide an overview of complex nature of food intake where various biological factors link mood, food intake, and brain signaling that engages both peripheral and central nervous system signaling pathways in a bi-directional manner in obesity.

The Interaction Between Punishment Sensitivity and Effortful Control for Emerging Adults' Substance Use Behaviors.

PubMed

Kahn, Rachel E; Chiu, Pearl H; Deater-Deckard, Kirby; Hochgraf, Anna K; King-Casas, Brooks; Kim-Spoon, Jungmeen

2018-01-08

Within the dual systems perspective, high reward sensitivity and low punishment sensitivity in conjunction with deficits in cognitive control may contribute to high levels of risk taking, such as substance use. The current study examined whether the individual components of effortful control (inhibitory control, attentional control, and activation control) serve as regulators and moderate the association between reward or punishment sensitivity and substance use behaviors. A total of 1,808 emerging adults from a university setting (Mean age = 19.48; 72% female) completed self-report measures of reward and punishment sensitivity, effortful control, and substance use. Findings indicated significant two-way interactions for punishment sensitivity and inhibitory control for alcohol and marijuana use. The form of these interactions revealed a significant negative association between punishment sensitivity and alcohol and marijuana use at low levels of inhibitory control. No significant interactions emerged for reward sensitivity or other components of effortful control. The current findings provide preliminary evidence suggesting the dual systems theorized to influence risk taking behavior interact to make joint contributions to health risk behaviors such as substance use in emerging adults.

Rewarding safe behavior: strategies for change.

PubMed

Fell-Carlson, Deborah

2004-12-01

Effective, sustainable safety incentives are integrated into a performance management system designed to encourage long term behavior change. Effective incentive program design integrates the fundamental considerations of compensation (i.e., valence, instrumentality, expectancy, equity) with behavior change theory in the context of a strong merit based performance management system. Clear expectations are established and communicated from the time applicants apply for the position. Feedback and social recognition are leveraged and used as rewards, in addition to financial incentives built into the compensation system and offered periodically as short term incentives. Rewards are tied to specific objectives intended to influence specific behaviors. Objectives are designed to challenge employees, providing opportunities to grow and enhance their sense of belonging. Safety contests and other awareness activities are most effective when used to focus safety improvement efforts on specific behaviors or processes, for a predetermined period of time, in the context of a comprehensive safety system. Safety incentive programs designed around injury outcomes can result in unintended, and undesirable, consequences. Safety performance can be leveraged by integrating safety into corporate cultural indicators. Symbols of safety remind employees of corporate safety goals and objectives (e.g., posted safety goals and integrating safety into corporate mission and vision). Rites and ceremonies provide opportunities for social recognition and feedback and demonstrate safety is a corporate value. Feedback opportunities, rewards, and social recognition all provide content for corporate legends, those stories embellished over time, that punctuate the overall system of organizational norms, and provide examples of the organizational safety culture in action.

The attention habit: how reward learning shapes attentional selection.

PubMed

Anderson, Brian A

2016-04-01

There is growing consensus that reward plays an important role in the control of attention. Until recently, reward was thought to influence attention indirectly by modulating task-specific motivation and its effects on voluntary control over selection. Such an account was consistent with the goal-directed (endogenous) versus stimulus-driven (exogenous) framework that had long dominated the field of attention research. Now, a different perspective is emerging. Demonstrations that previously reward-associated stimuli can automatically capture attention even when physically inconspicuous and task-irrelevant challenge previously held assumptions about attentional control. The idea that attentional selection can be value driven, reflecting a distinct and previously unrecognized control mechanism, has gained traction. Since these early demonstrations, the influence of reward learning on attention has rapidly become an area of intense investigation, sparking many new insights. The result is an emerging picture of how the reward system of the brain automatically biases information processing. Here, I review the progress that has been made in this area, synthesizing a wealth of recent evidence to provide an integrated, up-to-date account of value-driven attention and some of its broader implications. © 2015 New York Academy of Sciences.

Modulation of spatial attention by goals, statistical learning, and monetary reward.

PubMed

Jiang, Yuhong V; Sha, Li Z; Remington, Roger W

2015-10-01

This study documented the relative strength of task goals, visual statistical learning, and monetary reward in guiding spatial attention. Using a difficult T-among-L search task, we cued spatial attention to one visual quadrant by (i) instructing people to prioritize it (goal-driven attention), (ii) placing the target frequently there (location probability learning), or (iii) associating that quadrant with greater monetary gain (reward-based attention). Results showed that successful goal-driven attention exerted the strongest influence on search RT. Incidental location probability learning yielded a smaller though still robust effect. Incidental reward learning produced negligible guidance for spatial attention. The 95 % confidence intervals of the three effects were largely nonoverlapping. To understand these results, we simulated the role of location repetition priming in probability cuing and reward learning. Repetition priming underestimated the strength of location probability cuing, suggesting that probability cuing involved long-term statistical learning of how to shift attention. Repetition priming provided a reasonable account for the negligible effect of reward on spatial attention. We propose a multiple-systems view of spatial attention that includes task goals, search habit, and priming as primary drivers of top-down attention.

Modulation of spatial attention by goals, statistical learning, and monetary reward

PubMed Central

Sha, Li Z.; Remington, Roger W.

2015-01-01

This study documented the relative strength of task goals, visual statistical learning, and monetary reward in guiding spatial attention. Using a difficult T-among-L search task, we cued spatial attention to one visual quadrant by (i) instructing people to prioritize it (goal-driven attention), (ii) placing the target frequently there (location probability learning), or (iii) associating that quadrant with greater monetary gain (reward-based attention). Results showed that successful goal-driven attention exerted the strongest influence on search RT. Incidental location probability learning yielded a smaller though still robust effect. Incidental reward learning produced negligible guidance for spatial attention. The 95 % confidence intervals of the three effects were largely nonoverlapping. To understand these results, we simulated the role of location repetition priming in probability cuing and reward learning. Repetition priming underestimated the strength of location probability cuing, suggesting that probability cuing involved long-term statistical learning of how to shift attention. Repetition priming provided a reasonable account for the negligible effect of reward on spatial attention. We propose a multiple-systems view of spatial attention that includes task goals, search habit, and priming as primary drivers of top-down attention. PMID:26105657

Utilization of reward-prospect enhances preparatory attention and reduces stimulus conflict.

PubMed

van den Berg, Berry; Krebs, Ruth M; Lorist, Monicque M; Woldorff, Marty G

2014-06-01

The prospect of gaining money is an incentive widely at play in the real world. Such monetary motivation might have particularly strong influence when the cognitive system is challenged, such as when needing to process conflicting stimulus inputs. Here, we employed manipulations of reward-prospect and attentional-preparation levels in a cued-Stroop stimulus conflict task, along with the high temporal resolution of electrical brain recordings, to provide insight into the mechanisms by which reward-prospect and attention interact and modulate cognitive task performance. In this task, the cue indicated whether or not the participant needed to prepare for an upcoming Stroop stimulus and, if so, whether there was the potential for monetary reward (dependent on performance on that trial). Both cued attention and cued reward-prospect enhanced preparatory neural activity, as reflected by increases in the hallmark attention-related negative-polarity ERP slow wave (contingent negative variation [CNV]) and reductions in oscillatory Alpha activity, which was followed by enhanced processing of the subsequent Stroop stimulus. In addition, similar modulations of preparatory neural activity (larger CNVs and reduced Alpha) predicted shorter versus longer response times (RTs) to the subsequent target stimulus, consistent with such modulations reflecting trial-to-trial variations in attention. Particularly striking were the individual differences in the utilization of reward-prospect information. In particular, the size of the reward effects on the preparatory neural activity correlated across participants with the degree to which reward-prospect both facilitated overall task performance (shorter RTs) and reduced conflict-related behavioral interference. Thus, the prospect of reward appears to recruit attentional preparation circuits to enhance processing of task-relevant target information.

Neural Reward Processing Mediates the Relationship between Insomnia Symptoms and Depression in Adolescence

PubMed Central

Casement, Melynda D.; Keenan, Kate E.; Hipwell, Alison E.; Guyer, Amanda E.; Forbes, Erika E.

2016-01-01

Study Objectives: Emerging evidence suggests that insomnia may disrupt reward-related brain function—a potentially important factor in the development of depressive disorder. Adolescence may be a period during which such disruption is especially problematic given the rise in the incidence of insomnia and ongoing development of neural systems that support reward processing. The present study uses longitudinal data to test the hypothesis that disruption of neural reward processing is a mechanism by which insomnia symptoms—including nocturnal insomnia symptoms (NIS) and nonrestorative sleep (NRS)—contribute to depressive symptoms in adolescent girls. Method: Participants were 123 adolescent girls and their caregivers from an ongoing longitudinal study of precursors to depression across adolescent development. NIS and NRS were assessed annually from ages 9 to 13 years. Girls completed a monetary reward task during a functional MRI scan at age 16 years. Depressive symptoms were assessed at ages 16 and 17 years. Multivariable regression tested the prospective associations between NIS and NRS, neural response during reward anticipation, and the mean number of depressive symptoms (omitting sleep problems). Results: NRS, but not NIS, during early adolescence was positively associated with late adolescent dorsal medial prefrontal cortex (dmPFC) response to reward anticipation and depressive symptoms. DMPFC response mediated the relationship between early adolescent NRS and late adolescent depressive symptoms. Conclusions: These results suggest that NRS may contribute to depression by disrupting reward processing via altered activity in a region of prefrontal cortex involved in affective control. The results also support the mechanistic differentiation of NIS and NRS. Citation: Casement MD, Keenan KE, Hipwell AE, Guyer AE, Forbes EE. Neural reward processing mediates the relationship between insomnia symptoms and depression in adolescence. SLEEP 2016;39(2):439–447. PMID:26350468

Modulation of cue-induced firing of ventral tegmental area dopamine neurons by leptin and ghrelin

PubMed Central

van der Plasse, G; van Zessen, R; Luijendijk, M C M; Erkan, H; Stuber, G D; Ramakers, G M J; Adan, R A H

2015-01-01

Background/objectives: The rewarding value of palatable foods contributes to overconsumption, even in satiated subjects. Midbrain dopaminergic activity in response to reward-predicting environmental stimuli drives reward-seeking and motivated behavior for food rewards. This mesolimbic dopamine (DA) system is sensitive to changes in energy balance, yet it has thus far not been established whether reward signaling of DA neurons in vivo is under control of hormones that signal appetite and energy balance such as ghrelin and leptin. Subjects/methods: We trained rats (n=11) on an operant task in which they could earn two different food rewards. We then implanted recording electrodes in the ventral tegmental area (VTA), and recorded from DA neurons during behavior. Subsequently, we assessed the effects of mild food restriction and pretreatment with the adipose tissue-derived anorexigenic hormone leptin or the orexigenic hormone ghrelin on VTA DA reward signaling. Results: Animals showed an increase in performance following mild food restriction (P=0.002). Importantly, food-cue induced DA firing increased when animals were food restricted (P=0.02), but was significantly attenuated after leptin pretreatment (P=0.00). While ghrelin did affect baseline DA activity (P=0.025), it did not affect cue-induced firing (P⩾0.353). Conclusions: Metabolic signals, such as leptin, affect food seeking, a process that is dependent on the formation of cue-reward outcomes and involves midbrain DA signaling. These data show that food restriction engages the encoding of food cues by VTA DA neurons at a millisecond level and leptin suppresses this activity. This suggests that leptin is a key in linking metabolic information to reward signaling. PMID:26183405

Utilization of reward-prospect enhances preparatory attention and reduces stimulus conflict

PubMed Central

van den Berg, Berry; Krebs, Ruth M.; Lorist, Monicque M.; Woldorff, Marty G.

2015-01-01

The prospect of gaining money is an incentive widely at play in the real world. Such monetary motivation might have particularly strong influence when the cognitive system is challenged, such as when needing to process conflicting stimulus inputs. Here, we employed manipulations of reward-prospect and attentional-preparation levels in a cued-Stroop stimulus-conflict task, along with the high temporal resolution of electrical brain recordings, to provide insight into the mechanisms by which reward-prospect and attention interact and modulate cognitive-task performance. In this task the cue indicated whether or not the subject needed to prepare for an upcoming Stroop stimulus, and if so, whether there was the potential for monetary reward (dependent on performance on that trial). Both cued-attention and cued-reward-prospect enhanced preparatory neural activity, as reflected by increases in the hallmark attention-related negative-polarity ERP slow wave (CNV) and reductions in oscillatory Alpha activity, which was followed by enhanced processing of the subsequent Stroop stimulus. In addition, similar modulations of preparatory neural activity (larger CNVs and reduced Alpha) predicted faster versus slower response times (RTs) to the subsequent target stimulus, consistent with such modulations reflecting trial-to-trial variations in attention. Particularly striking were the individual differences in the utilization of reward-prospect information. In particular, the size of the reward effects on the preparatory neural activity correlated across-subjects with the degree to which reward-prospect both facilitated overall task performance (faster RTs) and reduced conflict-related behavioral interference. Thus, the prospect of reward appears to recruit attentional preparation circuits to enhance processing of task-relevant target information. PMID:24820263

Prior Haloperidol, but not Olanzapine, Exposure Augments the Pursuit of Reward Cues: Implications for Substance Abuse in Schizophrenia

PubMed Central

Samaha, Anne-Noël

2013-01-01

Drug abuse and addiction are excessively common in schizophrenia. Chronic antipsychotic treatment might contribute to this comorbidity by inducing supersensitivity within the brain’s dopamine system. Dopamine supersensitivity can enhance the incentive motivational properties of reward cues, and reward cues contribute to the maintenance and severity of drug addiction. We have shown previously that rats withdrawn from continuous haloperidol (HAL) treatment (via subcutaneous minipump) develop dopamine supersensitivity and pursue reward cues more vigorously than HAL-naive rats following an amphetamine (AMPH) challenge. Atypical antipsychotic drugs are thought to be less likely than typicals to produce dopamine supersensitivity. Thus, we compared the effects of HAL and the atypical antipsychotic olanzapine (OLZ) on the pursuit of reward cues. Rats were trained to associate a light-tone cue with water then treated with HAL or OLZ. Following antipsychotic withdrawal, we assessed AMPH-induced enhancement of lever pressing for the cue. Withdrawal from HAL, but not from OLZ, enhanced this effect. HAL, but not OLZ, also enhanced AMPH-induced psychomotor activation and c-fos mRNA expression in the caudate-putamen. Thus, prior HAL, but not OLZ, enhanced conditioned reward following an AMPH challenge, and this was potentially linked to enhanced behavioral sensitivity to AMPH and AMPH-induced engagement of the caudate-putamen. These findings suggest that HAL, but not an atypical like OLZ, modifies reward circuitry in ways that increase responsiveness to reward cues. Because enhanced responsiveness to reward cues can promote drug-seeking behavior, it should be investigated whether atypical antipsychotics might be a preferential option in schizophrenic patients at risk for drug abuse or addiction. PMID:22927669

Goal-Directed and Habit-Like Modulations of Stimulus Processing during Reinforcement Learning.

PubMed

Luque, David; Beesley, Tom; Morris, Richard W; Jack, Bradley N; Griffiths, Oren; Whitford, Thomas J; Le Pelley, Mike E

2017-03-15

Recent research has shown that perceptual processing of stimuli previously associated with high-value rewards is automatically prioritized even when rewards are no longer available. It has been hypothesized that such reward-related modulation of stimulus salience is conceptually similar to an "attentional habit." Recording event-related potentials in humans during a reinforcement learning task, we show strong evidence in favor of this hypothesis. Resistance to outcome devaluation (the defining feature of a habit) was shown by the stimulus-locked P1 component, reflecting activity in the extrastriate visual cortex. Analysis at longer latencies revealed a positive component (corresponding to the P3b, from 550-700 ms) sensitive to outcome devaluation. Therefore, distinct spatiotemporal patterns of brain activity were observed corresponding to habitual and goal-directed processes. These results demonstrate that reinforcement learning engages both attentional habits and goal-directed processes in parallel. Consequences for brain and computational models of reinforcement learning are discussed. SIGNIFICANCE STATEMENT The human attentional network adapts to detect stimuli that predict important rewards. A recent hypothesis suggests that the visual cortex automatically prioritizes reward-related stimuli, driven by cached representations of reward value; that is, stimulus-response habits. Alternatively, the neural system may track the current value of the predicted outcome. Our results demonstrate for the first time that visual cortex activity is increased for reward-related stimuli even when the rewarding event is temporarily devalued. In contrast, longer-latency brain activity was specifically sensitive to transient changes in reward value. Therefore, we show that both habit-like attention and goal-directed processes occur in the same learning episode at different latencies. This result has important consequences for computational models of reinforcement learning. Copyright © 2017 the authors 0270-6474/17/373009-09$15.00/0.

The left hemisphere learns what is right: Hemispatial reward learning depends on reinforcement learning processes in the contralateral hemisphere.

PubMed

Aberg, Kristoffer Carl; Doell, Kimberly Crystal; Schwartz, Sophie

2016-08-01

Orienting biases refer to consistent, trait-like direction of attention or locomotion toward one side of space. Recent studies suggest that such hemispatial biases may determine how well people memorize information presented in the left or right hemifield. Moreover, lesion studies indicate that learning rewarded stimuli in one hemispace depends on the integrity of the contralateral striatum. However, the exact neural and computational mechanisms underlying the influence of individual orienting biases on reward learning remain unclear. Because reward-based behavioural adaptation depends on the dopaminergic system and prediction error (PE) encoding in the ventral striatum, we hypothesized that hemispheric asymmetries in dopamine (DA) function may determine individual spatial biases in reward learning. To test this prediction, we acquired fMRI in 33 healthy human participants while they performed a lateralized reward task. Learning differences between hemispaces were assessed by presenting stimuli, assigned to different reward probabilities, to the left or right of central fixation, i.e. presented in the left or right visual hemifield. Hemispheric differences in DA function were estimated through differential fMRI responses to positive vs. negative feedback in the left vs. right ventral striatum, and a computational approach was used to identify the neural correlates of PEs. Our results show that spatial biases favoring reward learning in the right (vs. left) hemifield were associated with increased reward responses in the left hemisphere and relatively better neural encoding of PEs for stimuli presented in the right (vs. left) hemifield. These findings demonstrate that trait-like spatial biases implicate hemisphere-specific learning mechanisms, with individual differences between hemispheres contributing to reinforcing spatial biases. Copyright © 2016 Elsevier Ltd. All rights reserved.

Receptor-specific modulation of risk-based decision making by nucleus accumbens dopamine.

PubMed

Stopper, Colin M; Khayambashi, Shahin; Floresco, Stan B

2013-04-01

The nucleus accumbens (NAc) serves as an integral node within cortico-limbic circuitry that regulates various forms of cost-benefit decision making. The dopamine (DA) system has also been implicated in enabling organisms to overcome a variety of costs to obtain more valuable rewards. However, it remains unclear how DA activity within the NAc may regulate decision making involving reward uncertainty. This study investigated the contribution of different DA receptor subtypes in the NAc to risk-based decision making, assessed with a probabilistic discounting task. In well-trained rats, D1 receptor blockade with SCH 23,390 decreased preference for larger, uncertain rewards, which was associated with enhanced negative-feedback sensitivity (ie, an increased tendency to select a smaller/certain option after an unrewarded risky choice). Treatment with a D1 agonist (SKF 81,297) optimized decision making, increasing choice of the risky option when reward probability was high, and decreasing preference under low probability conditions. In stark contrast, neither blockade of NAc D2 receptors with eticlopride, nor stimulation of these receptors with quinpirole or bromocriptine influenced risky choice. In comparison, infusion of the D3-preferring agonist PD 128,907 decreased reward sensitivity and risky choice. Collectively, these results show that mesoaccumbens DA refines risk-reward decision biases via dissociable mechanisms recruiting D1 and D3, but not D2 receptors. D1 receptor activity mitigates the effect of reward omissions on subsequent choices to promote selection of reward options that may have greater long-term utility, whereas excessive D3 receptor activity blunts the impact that larger/uncertain rewards have in promoting riskier choices.

Pharmaceutical and biomedical applications of surface engineered carbon nanotubes.

PubMed

Mehra, Neelesh Kumar; Jain, Keerti; Jain, Narendra Kumar

2015-06-01

Surface engineered carbon nanotubes (CNTs) are attracting recent attention of scientists owing to their vivid biomedical and pharmaceutical applications. The focus of this review is to highlight the important role of surface engineered CNTs in the highly challenging but rewarding area of nanotechnology. The major strength of this review lies in highlighting the exciting applications of CNTs to boost the research efforts, which unfortunately are otherwise scattered in the literature making the reading non-coherent and non-homogeneous. Copyright © 2015 Elsevier Ltd. All rights reserved.