Sample records for ganglia reward network

  1. Learning Reward Uncertainty in the Basal Ganglia

    PubMed Central

    Bogacz, Rafal

    2016-01-01

    Learning the reliability of different sources of rewards is critical for making optimal choices. However, despite the existence of detailed theory describing how the expected reward is learned in the basal ganglia, it is not known how reward uncertainty is estimated in these circuits. This paper presents a class of models that encode both the mean reward and the spread of the rewards, the former in the difference between the synaptic weights of D1 and D2 neurons, and the latter in their sum. In the models, the tendency to seek (or avoid) options with variable reward can be controlled by increasing (or decreasing) the tonic level of dopamine. The models are consistent with the physiology of and synaptic plasticity in the basal ganglia, they explain the effects of dopaminergic manipulations on choices involving risks, and they make multiple experimental predictions. PMID:27589489

  2. Listening to Rhythmic Music Reduces Connectivity within the Basal Ganglia and the Reward System.

    PubMed

    Brodal, Hans P; Osnes, Berge; Specht, Karsten

    2017-01-01

    Music can trigger emotional responses in a more direct way than any other stimulus. In particular, music-evoked pleasure involves brain networks that are part of the reward system. Furthermore, rhythmic music stimulates the basal ganglia and may trigger involuntary movements to the beat. In the present study, we created a continuously playing rhythmic, dance floor-like composition where the ambient noise from the MR scanner was incorporated as an additional instrument of rhythm. By treating this continuous stimulation paradigm as a variant of resting-state, the data was analyzed with stochastic dynamic causal modeling (sDCM), which was used for exploring functional dependencies and interactions between core areas of auditory perception, rhythm processing, and reward processing. The sDCM model was a fully connected model with the following areas: auditory cortex, putamen/pallidum, and ventral striatum/nucleus accumbens of both hemispheres. The resulting estimated parameters were compared to ordinary resting-state data, without an additional continuous stimulation. Besides reduced connectivity within the basal ganglia, the results indicated a reduced functional connectivity of the reward system, namely the right ventral striatum/nucleus accumbens from and to the basal ganglia and auditory network while listening to rhythmic music. In addition, the right ventral striatum/nucleus accumbens demonstrated also a change in its hemodynamic parameter, reflecting an increased level of activation. These converging results may indicate that the dopaminergic reward system reduces its functional connectivity and relinquishing its constraints on other areas when we listen to rhythmic music.

  3. Listening to Rhythmic Music Reduces Connectivity within the Basal Ganglia and the Reward System

    PubMed Central

    Brodal, Hans P.; Osnes, Berge; Specht, Karsten

    2017-01-01

    Music can trigger emotional responses in a more direct way than any other stimulus. In particular, music-evoked pleasure involves brain networks that are part of the reward system. Furthermore, rhythmic music stimulates the basal ganglia and may trigger involuntary movements to the beat. In the present study, we created a continuously playing rhythmic, dance floor-like composition where the ambient noise from the MR scanner was incorporated as an additional instrument of rhythm. By treating this continuous stimulation paradigm as a variant of resting-state, the data was analyzed with stochastic dynamic causal modeling (sDCM), which was used for exploring functional dependencies and interactions between core areas of auditory perception, rhythm processing, and reward processing. The sDCM model was a fully connected model with the following areas: auditory cortex, putamen/pallidum, and ventral striatum/nucleus accumbens of both hemispheres. The resulting estimated parameters were compared to ordinary resting-state data, without an additional continuous stimulation. Besides reduced connectivity within the basal ganglia, the results indicated a reduced functional connectivity of the reward system, namely the right ventral striatum/nucleus accumbens from and to the basal ganglia and auditory network while listening to rhythmic music. In addition, the right ventral striatum/nucleus accumbens demonstrated also a change in its hemodynamic parameter, reflecting an increased level of activation. These converging results may indicate that the dopaminergic reward system reduces its functional connectivity and relinquishing its constraints on other areas when we listen to rhythmic music. PMID:28400717

  4. A spiking neural network based on the basal ganglia functional anatomy.

    PubMed

    Baladron, Javier; Hamker, Fred H

    2015-07-01

    We introduce a spiking neural network of the basal ganglia capable of learning stimulus-action associations. We model learning in the three major basal ganglia pathways, direct, indirect and hyperdirect, by spike time dependent learning and considering the amount of dopamine available (reward). Moreover, we allow to learn a cortico-thalamic pathway that bypasses the basal ganglia. As a result the system develops new functionalities for the different basal ganglia pathways: The direct pathway selects actions by disinhibiting the thalamus, the hyperdirect one suppresses alternatives and the indirect pathway learns to inhibit common mistakes. Numerical experiments show that the system is capable of learning sets of either deterministic or stochastic rules. Copyright © 2015 Elsevier Ltd. All rights reserved.

  5. Morphological elucidation of basal ganglia circuits contributing reward prediction

    PubMed Central

    Fujiyama, Fumino; Takahashi, Susumu; Karube, Fuyuki

    2015-01-01

    Electrophysiological studies in monkeys have shown that dopaminergic neurons respond to the reward prediction error. In addition, striatal neurons alter their responsiveness to cortical or thalamic inputs in response to the dopamine signal, via the mechanism of dopamine-regulated synaptic plasticity. These findings have led to the hypothesis that the striatum exhibits synaptic plasticity under the influence of the reward prediction error and conduct reinforcement learning throughout the basal ganglia circuits. The reinforcement learning model is useful; however, the mechanism by which such a process emerges in the basal ganglia needs to be anatomically explained. The actor–critic model has been previously proposed and extended by the existence of role sharing within the striatum, focusing on the striosome/matrix compartments. However, this hypothesis has been difficult to confirm morphologically, partly because of the complex structure of the striosome/matrix compartments. Here, we review recent morphological studies that elucidate the input/output organization of the striatal compartments. PMID:25698913

  6. Increased functional connectivity in the resting-state basal ganglia network after acute heroin substitution

    PubMed Central

    Schmidt, A; Denier, N; Magon, S; Radue, E-W; Huber, C G; Riecher-Rossler, A; Wiesbeck, G A; Lang, U E; Borgwardt, S; Walter, M

    2015-01-01

    Reinforcement signals in the striatum are known to be crucial for mediating the subjective rewarding effects of acute drug intake. It is proposed that these effects may be more involved in early phases of drug addiction, whereas negative reinforcement effects may occur more in later stages of the illness. This study used resting-state functional magnetic resonance imaging to explore whether acute heroin substitution also induced positive reinforcement effects in striatal brain regions of protracted heroin-maintained patients. Using independent component analysis and a dual regression approach, we compared resting-state functional connectivity (rsFC) strengths within the basal ganglia/limbic network across a group of heroin-dependent patients receiving both an acute infusion of heroin and placebo and 20 healthy subjects who received placebo only. Subsequent correlation analyses were performed to test whether the rsFC strength under heroin exposure correlated with the subjective rewarding effect and with plasma concentrations of heroin and its main metabolites morphine. Relative to the placebo treatment in patients, heroin significantly increased rsFC of the left putamen within the basal ganglia/limbic network, the extent of which correlated positively with patients' feelings of rush and with the plasma level of morphine. Furthermore, healthy controls revealed increased rsFC of the posterior cingulate cortex/precuneus in this network relative to the placebo treatment in patients. Our results indicate that acute heroin substitution induces a subjective rewarding effect via increased striatal connectivity in heroin-dependent patients, suggesting that positive reinforcement effects in the striatum still occur after protracted maintenance therapy. PMID:25803496

  7. Parallel basal ganglia circuits for voluntary and automatic behaviour to reach rewards

    PubMed Central

    Hikosaka, Okihide

    2015-01-01

    The basal ganglia control body movements, value processing and decision-making. Many studies have shown that the inputs and outputs of each basal ganglia structure are topographically organized, which suggests that the basal ganglia consist of separate circuits that serve distinct functions. A notable example is the circuits that originate from the rostral (head) and caudal (tail) regions of the caudate nucleus, both of which target the superior colliculus. These two caudate regions encode the reward values of visual objects differently: flexible (short-term) values by the caudate head and stable (long-term) values by the caudate tail. These value signals in the caudate guide the orienting of gaze differently: voluntary saccades by the caudate head circuit and automatic saccades by the caudate tail circuit. Moreover, separate groups of dopamine neurons innervate the caudate head and tail and may selectively guide the flexible and stable learning/memory in the caudate regions. Studies focusing on manual handling of objects also suggest that rostrocaudally separated circuits in the basal ganglia control the action differently. These results suggest that the basal ganglia contain parallel circuits for two steps of goal-directed behaviour: finding valuable objects and manipulating the valuable objects. These parallel circuits may underlie voluntary behaviour and automatic skills, enabling animals (including humans) to adapt to both volatile and stable environments. This understanding of the functions and mechanisms of the basal ganglia parallel circuits may inform the differential diagnosis and treatment of basal ganglia disorders. PMID:25981958

  8. Neuromodulatory adaptive combination of correlation-based learning in cerebellum and reward-based learning in basal ganglia for goal-directed behavior control

    PubMed Central

    Dasgupta, Sakyasingha; Wörgötter, Florentin; Manoonpong, Poramate

    2014-01-01

    Goal-directed decision making in biological systems is broadly based on associations between conditional and unconditional stimuli. This can be further classified as classical conditioning (correlation-based learning) and operant conditioning (reward-based learning). A number of computational and experimental studies have well established the role of the basal ganglia in reward-based learning, where as the cerebellum plays an important role in developing specific conditioned responses. Although viewed as distinct learning systems, recent animal experiments point toward their complementary role in behavioral learning, and also show the existence of substantial two-way communication between these two brain structures. Based on this notion of co-operative learning, in this paper we hypothesize that the basal ganglia and cerebellar learning systems work in parallel and interact with each other. We envision that such an interaction is influenced by reward modulated heterosynaptic plasticity (RMHP) rule at the thalamus, guiding the overall goal directed behavior. Using a recurrent neural network actor-critic model of the basal ganglia and a feed-forward correlation-based learning model of the cerebellum, we demonstrate that the RMHP rule can effectively balance the outcomes of the two learning systems. This is tested using simulated environments of increasing complexity with a four-wheeled robot in a foraging task in both static and dynamic configurations. Although modeled with a simplified level of biological abstraction, we clearly demonstrate that such a RMHP induced combinatorial learning mechanism, leads to stabler and faster learning of goal-directed behaviors, in comparison to the individual systems. Thus, in this paper we provide a computational model for adaptive combination of the basal ganglia and cerebellum learning systems by way of neuromodulated plasticity for goal-directed decision making in biological and bio-mimetic organisms. PMID:25389391

  9. Neuromodulatory adaptive combination of correlation-based learning in cerebellum and reward-based learning in basal ganglia for goal-directed behavior control.

    PubMed

    Dasgupta, Sakyasingha; Wörgötter, Florentin; Manoonpong, Poramate

    2014-01-01

    Goal-directed decision making in biological systems is broadly based on associations between conditional and unconditional stimuli. This can be further classified as classical conditioning (correlation-based learning) and operant conditioning (reward-based learning). A number of computational and experimental studies have well established the role of the basal ganglia in reward-based learning, where as the cerebellum plays an important role in developing specific conditioned responses. Although viewed as distinct learning systems, recent animal experiments point toward their complementary role in behavioral learning, and also show the existence of substantial two-way communication between these two brain structures. Based on this notion of co-operative learning, in this paper we hypothesize that the basal ganglia and cerebellar learning systems work in parallel and interact with each other. We envision that such an interaction is influenced by reward modulated heterosynaptic plasticity (RMHP) rule at the thalamus, guiding the overall goal directed behavior. Using a recurrent neural network actor-critic model of the basal ganglia and a feed-forward correlation-based learning model of the cerebellum, we demonstrate that the RMHP rule can effectively balance the outcomes of the two learning systems. This is tested using simulated environments of increasing complexity with a four-wheeled robot in a foraging task in both static and dynamic configurations. Although modeled with a simplified level of biological abstraction, we clearly demonstrate that such a RMHP induced combinatorial learning mechanism, leads to stabler and faster learning of goal-directed behaviors, in comparison to the individual systems. Thus, in this paper we provide a computational model for adaptive combination of the basal ganglia and cerebellum learning systems by way of neuromodulated plasticity for goal-directed decision making in biological and bio-mimetic organisms.

  10. Basal Ganglia Activity Mirrors a Benefit of Action and Reward on Long-Lasting Event Memory.

    PubMed

    Koster, Raphael; Guitart-Masip, Marc; Dolan, Raymond J; Düzel, Emrah

    2015-12-01

    The expectation of reward is known to enhance a consolidation of long-term memory for events. We tested whether this effect is driven by positive valence or action requirements tied to expected reward. Using a functional magnetic resonance imaging (fMRI) paradigm in young adults, novel images predicted gain or loss outcomes, which in turn were either obtained or avoided by action or inaction. After 24 h, memory for these images reflected a benefit of action as well as a congruence of action requirements and valence, namely, action for reward and inaction for avoidance. fMRI responses in the hippocampus, a region known to be critical for long-term memory function, reflected the anticipation of inaction. In contrast, activity in the putamen mirrored the congruence of action requirement and valence, whereas other basal ganglia regions mirrored overall action benefits on long-lasting memory. The findings indicate a novel type of functional division between the hippocampus and the basal ganglia in the motivational regulation of long-term memory consolidation, which favors remembering events that are worth acting for. © The Author 2015. Published by Oxford University Press.

  11. Hyporesponsive reward anticipation in the basal ganglia following severe institutional deprivation early in life.

    PubMed

    Mehta, Mitul A; Gore-Langton, Emma; Golembo, Nicole; Colvert, Emma; Williams, Steven C R; Sonuga-Barke, Edmund

    2010-10-01

    Severe deprivation in the first few years of life is associated with multiple difficulties in cognition and behavior. However, the brain basis for these difficulties is poorly understood. Structural and functional neuroimaging studies have implicated limbic system structures as dysfunctional, and one functional imaging study in a heterogeneous group of maltreated individuals has confirmed the presence of abnormalities in the basal ganglia. Based on these studies and known dopaminergic abnormalities from studies in experimental animals using social isolation, we used a task of monetary reward anticipation to examine the functional integrity of brain regions previously shown to be implicated in reward processing. Our sample included a group of adolescents (n = 12) who had experienced global deprivation early in their lives in Romania prior to adoption into UK families. In contrast to a nonadopted comparison group (n = 11), the adoptees did not recruit the striatum during reward anticipation despite comparable performance accuracy and latency. These results show, for the first time, an association between early institutional deprivation and brain reward systems in humans and highlight potential neural vulnerabilities resulting from such exposures.

  12. Emergence of context-dependent variability across a basal ganglia network.

    PubMed

    Woolley, Sarah C; Rajan, Raghav; Joshua, Mati; Doupe, Allison J

    2014-04-02

    Context dependence is a key feature of cortical-basal ganglia circuit activity, and in songbirds the cortical outflow of a basal ganglia circuit specialized for song, LMAN, shows striking increases in trial-by-trial variability and bursting when birds sing alone rather than to females. To reveal where this variability and its social regulation emerge, we recorded stepwise from corticostriatal (HVC) neurons and their target spiny and pallidal neurons in Area X. We find that corticostriatal and spiny neurons both show precise singing-related firing across both social settings. Pallidal neurons, in contrast, exhibit markedly increased trial-by-trial variation when birds sing alone, created by highly variable pauses in firing. This variability persists even when recurrent inputs from LMAN are ablated. These data indicate that variability and its context sensitivity emerge within the basal ganglia network, suggest a network mechanism for this emergence, and highlight variability generation and regulation as basal ganglia functions. Copyright © 2014 Elsevier Inc. All rights reserved.

  13. Emergence of context-dependent variability across a basal ganglia network

    PubMed Central

    Woolley, Sarah C.; Rajan, Raghav; Joshua, Mati; Doupe, Allison J.

    2014-01-01

    Summary Context-dependence is a key feature of cortical-basal ganglia circuit activity, and in songbirds, the cortical outflow of a basal ganglia circuit specialized for song, LMAN, shows striking increases in trial-by-trial variability and bursting when birds sing alone rather than to females. To reveal where this variability and its social regulation emerge, we recorded stepwise from cortico-striatal (HVC) neurons and their target spiny and pallidal neurons in Area X. We find that cortico-striatal and spiny neurons both show precise singing-related firing across both social settings. Pallidal neurons, in contrast, exhibit markedly increased trial-by-trial variation when birds sing alone, created by highly variable pauses in firing. This variability persists even when recurrent inputs from LMAN are ablated. These data indicate that variability and its context-sensitivity emerge within the basal ganglia network, suggest a network mechanism for this emergence, and highlight variability generation and regulation as basal ganglia functions. PMID:24698276

  14. Dopaminergic Balance between Reward Maximization and Policy Complexity

    PubMed Central

    Parush, Naama; Tishby, Naftali; Bergman, Hagai

    2011-01-01

    Previous reinforcement-learning models of the basal ganglia network have highlighted the role of dopamine in encoding the mismatch between prediction and reality. Far less attention has been paid to the computational goals and algorithms of the main-axis (actor). Here, we construct a top-down model of the basal ganglia with emphasis on the role of dopamine as both a reinforcement learning signal and as a pseudo-temperature signal controlling the general level of basal ganglia excitability and motor vigilance of the acting agent. We argue that the basal ganglia endow the thalamic-cortical networks with the optimal dynamic tradeoff between two constraints: minimizing the policy complexity (cost) and maximizing the expected future reward (gain). We show that this multi-dimensional optimization processes results in an experience-modulated version of the softmax behavioral policy. Thus, as in classical softmax behavioral policies, probability of actions are selected according to their estimated values and the pseudo-temperature, but in addition also vary according to the frequency of previous choices of these actions. We conclude that the computational goal of the basal ganglia is not to maximize cumulative (positive and negative) reward. Rather, the basal ganglia aim at optimization of independent gain and cost functions. Unlike previously suggested single-variable maximization processes, this multi-dimensional optimization process leads naturally to a softmax-like behavioral policy. We suggest that beyond its role in the modulation of the efficacy of the cortico-striatal synapses, dopamine directly affects striatal excitability and thus provides a pseudo-temperature signal that modulates the tradeoff between gain and cost. The resulting experience and dopamine modulated softmax policy can then serve as a theoretical framework to account for the broad range of behaviors and clinical states governed by the basal ganglia and dopamine systems. PMID:21603228

  15. The Basal Ganglia and Adaptive Motor Control

    NASA Astrophysics Data System (ADS)

    Graybiel, Ann M.; Aosaki, Toshihiko; Flaherty, Alice W.; Kimura, Minoru

    1994-09-01

    The basal ganglia are neural structures within the motor and cognitive control circuits in the mammalian forebrain and are interconnected with the neocortex by multiple loops. Dysfunction in these parallel loops caused by damage to the striatum results in major defects in voluntary movement, exemplified in Parkinson's disease and Huntington's disease. These parallel loops have a distributed modular architecture resembling local expert architectures of computational learning models. During sensorimotor learning, such distributed networks may be coordinated by widely spaced striatal interneurons that acquire response properties on the basis of experienced reward.

  16. Reward-Dependent Modulation of Movement Variability

    PubMed Central

    Izawa, Jun; Shadmehr, Reza

    2015-01-01

    Movement variability is often considered an unwanted byproduct of a noisy nervous system. However, variability can signal a form of implicit exploration, indicating that the nervous system is intentionally varying the motor commands in search of actions that yield the greatest success. Here, we investigated the role of the human basal ganglia in controlling reward-dependent motor variability as measured by trial-to-trial changes in performance during a reaching task. We designed an experiment in which the only performance feedback was success or failure and quantified how reach variability was modulated as a function of the probability of reward. In healthy controls, reach variability increased as the probability of reward decreased. Control of variability depended on the history of past rewards, with the largest trial-to-trial changes occurring immediately after an unrewarded trial. In contrast, in participants with Parkinson's disease, a known example of basal ganglia dysfunction, reward was a poor modulator of variability; that is, the patients showed an impaired ability to increase variability in response to decreases in the probability of reward. This was despite the fact that, after rewarded trials, reach variability in the patients was comparable to healthy controls. In summary, we found that movement variability is partially a form of exploration driven by the recent history of rewards. When the function of the human basal ganglia is compromised, the reward-dependent control of movement variability is impaired, particularly affecting the ability to increase variability after unsuccessful outcomes. PMID:25740529

  17. Reward processing in the value-driven attention network: reward signals tracking cue identity and location.

    PubMed

    Anderson, Brian A

    2017-03-01

    Through associative reward learning, arbitrary cues acquire the ability to automatically capture visual attention. Previous studies have examined the neural correlates of value-driven attentional orienting, revealing elevated activity within a network of brain regions encompassing the visual corticostriatal loop [caudate tail, lateral occipital complex (LOC) and early visual cortex] and intraparietal sulcus (IPS). Such attentional priority signals raise a broader question concerning how visual signals are combined with reward signals during learning to create a representation that is sensitive to the confluence of the two. This study examines reward signals during the cued reward training phase commonly used to generate value-driven attentional biases. High, compared with low, reward feedback preferentially activated the value-driven attention network, in addition to regions typically implicated in reward processing. Further examination of these reward signals within the visual system revealed information about the identity of the preceding cue in the caudate tail and LOC, and information about the location of the preceding cue in IPS, while early visual cortex represented both location and identity. The results reveal teaching signals within the value-driven attention network during associative reward learning, and further suggest functional specialization within different regions of this network during the acquisition of an integrated representation of stimulus value. © The Author (2016). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  18. Default mode network, motor network, dorsal and ventral basal ganglia networks in the rat brain: comparison to human networks using resting state-fMRI.

    PubMed

    Sierakowiak, Adam; Monnot, Cyril; Aski, Sahar Nikkhou; Uppman, Martin; Li, Tie-Qiang; Damberg, Peter; Brené, Stefan

    2015-01-01

    Rodent models are developed to enhance understanding of the underlying biology of different brain disorders. However, before interpreting findings from animal models in a translational aspect to understand human disease, a fundamental step is to first have knowledge of similarities and differences of the biological systems studied. In this study, we analyzed and verified four known networks termed: default mode network, motor network, dorsal basal ganglia network, and ventral basal ganglia network using resting state functional MRI (rsfMRI) in humans and rats. Our work supports the notion that humans and rats have common robust resting state brain networks and that rsfMRI can be used as a translational tool when validating animal models of brain disorders. In the future, rsfMRI may be used, in addition to short-term interventions, to characterize longitudinal effects on functional brain networks after long-term intervention in humans and rats.

  19. Default Mode Network, Motor Network, Dorsal and Ventral Basal Ganglia Networks in the Rat Brain: Comparison to Human Networks Using Resting State-fMRI

    PubMed Central

    Sierakowiak, Adam; Monnot, Cyril; Aski, Sahar Nikkhou; Uppman, Martin; Li, Tie-Qiang; Damberg, Peter; Brené, Stefan

    2015-01-01

    Rodent models are developed to enhance understanding of the underlying biology of different brain disorders. However, before interpreting findings from animal models in a translational aspect to understand human disease, a fundamental step is to first have knowledge of similarities and differences of the biological systems studied. In this study, we analyzed and verified four known networks termed: default mode network, motor network, dorsal basal ganglia network, and ventral basal ganglia network using resting state functional MRI (rsfMRI) in humans and rats. Our work supports the notion that humans and rats have common robust resting state brain networks and that rsfMRI can be used as a translational tool when validating animal models of brain disorders. In the future, rsfMRI may be used, in addition to short-term interventions, to characterize longitudinal effects on functional brain networks after long-term intervention in humans and rats. PMID:25789862

  20. Social network modulation of reward-related signals

    PubMed Central

    Fareri, Dominic S.; Niznikiewicz, Michael A.; Lee, Victoria K.; Delgado, Mauricio R.

    2012-01-01

    Everyday goals and experiences are often shared with others who may hold different places within our social networks. We investigated whether the experience of sharing a reward differs with respect to social network. Twenty human participants played a card guessing game for shared monetary outcomes with three partners: a computer, a confederate (out-of-network), and a friend (in-network). Participants subjectively rated the experience of sharing a reward more positively with their friend than the other partners. Neuroimaging results support participants’ subjective reports, as ventral striatal BOLD responses were more robust when sharing monetary gains with a friend, as compared to with the confederate or computer, suggesting a higher value for sharing with an in-network partner. Interestingly, ratings of social closeness co-varied with this activity, resulting in a significant partner × closeness interaction: exploratory analysis showed that only participants reporting higher levels of closeness demonstrated partner-related differences in striatal BOLD response. These results suggest that reward valuation in social contexts is sensitive to distinctions of social network, such that sharing positive experiences with in-network others may carry higher value. PMID:22745503

  1. RM-SORN: a reward-modulated self-organizing recurrent neural network.

    PubMed

    Aswolinskiy, Witali; Pipa, Gordon

    2015-01-01

    Neural plasticity plays an important role in learning and memory. Reward-modulation of plasticity offers an explanation for the ability of the brain to adapt its neural activity to achieve a rewarded goal. Here, we define a neural network model that learns through the interaction of Intrinsic Plasticity (IP) and reward-modulated Spike-Timing-Dependent Plasticity (STDP). IP enables the network to explore possible output sequences and STDP, modulated by reward, reinforces the creation of the rewarded output sequences. The model is tested on tasks for prediction, recall, non-linear computation, pattern recognition, and sequence generation. It achieves performance comparable to networks trained with supervised learning, while using simple, biologically motivated plasticity rules, and rewarding strategies. The results confirm the importance of investigating the interaction of several plasticity rules in the context of reward-modulated learning and whether reward-modulated self-organization can explain the amazing capabilities of the brain.

  2. Global dysrhythmia of cerebro-basal ganglia-cerebellar networks underlies motor tics following striatal disinhibition.

    PubMed

    McCairn, Kevin W; Iriki, Atsushi; Isoda, Masaki

    2013-01-09

    Motor tics, a cardinal symptom of Tourette syndrome (TS), are hypothesized to arise from abnormalities within cerebro-basal ganglia circuits. Yet noninvasive neuroimaging of TS has previously identified robust activation in the cerebellum. To date, electrophysiological properties of cerebellar activation and its role in basal ganglia-mediated tic expression remain unknown. We performed multisite, multielectrode recordings of single-unit activity and local field potentials from the cerebellum, basal ganglia, and primary motor cortex using a pharmacologic monkey model of motor tics/TS. Following microinjections of bicuculline into the sensorimotor putamen, periodic tics occurred predominantly in the orofacial region, and a sizable number of cerebellar neurons showed phasic changes in activity associated with tic episodes. Specifically, 64% of the recorded cerebellar cortex neurons exhibited increases in activity, and 85% of the dentate nucleus neurons displayed excitatory, inhibitory, or multiphasic responses. Critically, abnormal discharges of cerebellar cortex neurons and excitatory-type dentate neurons mostly preceded behavioral tic onset, indicating their central origins. Latencies of pathological activity in the cerebellum and primary motor cortex substantially overlapped, suggesting that aberrant signals may be traveling along divergent pathways to these structures from the basal ganglia. Furthermore, the occurrence of tic movement was most closely associated with local field potential spikes in the cerebellum and primary motor cortex, implying that these structures may function as a gate to release overt tic movements. These findings indicate that tic-generating networks in basal ganglia mediated tic disorders extend beyond classical cerebro-basal ganglia circuits, leading to global network dysrhythmia including cerebellar circuits.

  3. Optogenetic stimulation in a computational model of the basal ganglia biases action selection and reward prediction error.

    PubMed

    Berthet, Pierre; Lansner, Anders

    2014-01-01

    Optogenetic stimulation of specific types of medium spiny neurons (MSNs) in the striatum has been shown to bias the selection of mice in a two choices task. This shift is dependent on the localisation and on the intensity of the stimulation but also on the recent reward history. We have implemented a way to simulate this increased activity produced by the optical flash in our computational model of the basal ganglia (BG). This abstract model features the direct and indirect pathways commonly described in biology, and a reward prediction pathway (RP). The framework is similar to Actor-Critic methods and to the ventral/dorsal distinction in the striatum. We thus investigated the impact on the selection caused by an added stimulation in each of the three pathways. We were able to reproduce in our model the bias in action selection observed in mice. Our results also showed that biasing the reward prediction is sufficient to create a modification in the action selection. However, we had to increase the percentage of trials with stimulation relative to that in experiments in order to impact the selection. We found that increasing only the reward prediction had a different effect if the stimulation in RP was action dependent (only for a specific action) or not. We further looked at the evolution of the change in the weights depending on the stage of learning within a block. A bias in RP impacts the plasticity differently depending on that stage but also on the outcome. It remains to experimentally test how the dopaminergic neurons are affected by specific stimulations of neurons in the striatum and to relate data to predictions of our model.

  4. Effects of motivation on reward and attentional networks: an fMRI study.

    PubMed

    Ivanov, Iliyan; Liu, Xun; Clerkin, Suzanne; Schulz, Kurt; Friston, Karl; Newcorn, Jeffrey H; Fan, Jin

    2012-11-01

    Existing evidence suggests that reward and attentional networks function in concert and that activation in one system influences the other in a reciprocal fashion; however, the nature of these influences remains poorly understood. We therefore developed a three-component task to assess the interaction effects of reward anticipation and conflict resolution on the behavioral performance and the activation of brain reward and attentional systems. Sixteen healthy adult volunteers aged 21-45 years were scanned with functional magnetic resonance imaging (fMRI) while performing the task. A two-way repeated measures analysis of variance (ANOVA) with cue (reward vs. non-reward) and target (congruent vs. incongruent) as within-subjects factors was used to test for main and interaction effects. Neural responses to anticipation, conflict, and reward outcomes were tested. Behaviorally there were main effects of both reward cue and target congruency on reaction time. Neuroimaging results showed that reward anticipation and expected reward outcomes activated components of the attentional networks, including the inferior parietal and occipital cortices, whereas surprising non-rewards activated the frontoinsular cortex bilaterally and deactivated the ventral striatum. In turn, conflict activated a broad network associated with cognitive control and motor functions. Interaction effects showed decreased activity in the thalamus, anterior cingulated gyrus, and middle frontal gyrus bilaterally when difficult conflict trials (e.g., incongruent targets) were preceded by reward cues; in contrast, the ventral striatum and orbitofrontal cortex showed greater activation during congruent targets preceded by reward cues. These results suggest that reward anticipation is associated with lower activation in attentional networks, possibly due to increased processing efficiency, whereas more difficult, conflict trials are associated with lower activity in regions of the reward system, possibly

  5. Imbalanced functional link between executive control network and reward network explain the online-game seeking behaviors in Internet gaming disorder.

    PubMed

    Dong, Guangheng; Lin, Xiao; Hu, Yanbo; Xie, Chunming; Du, Xiaoxia

    2015-03-17

    Literatures have shown that Internet gaming disorder (IGD) subjects show impaired executive control and enhanced reward sensitivities than healthy controls. However, how these two networks jointly affect the valuation process and drive IGD subjects' online-game-seeking behaviors remains unknown. Thirty-five IGD and 36 healthy controls underwent a resting-states scan in the MRI scanner. Functional connectivity (FC) was examined within control and reward network seeds regions, respectively. Nucleus accumbens (NAcc) was selected as the node to find the interactions between these two networks. IGD subjects show decreased FC in the executive control network and increased FC in the reward network when comparing with the healthy controls. When examining the correlations between the NAcc and the executive control/reward networks, the link between the NAcc - executive control network is negatively related with the link between NAcc - reward network. The changes (decrease/increase) in IGD subjects' brain synchrony in control/reward networks suggest the inefficient/overly processing within neural circuitry underlying these processes. The inverse proportion between control network and reward network in IGD suggest that impairments in executive control lead to inefficient inhibition of enhanced cravings to excessive online game playing. This might shed light on the mechanistic understanding of IGD.

  6. Independent functional connectivity networks underpin food and monetary reward sensitivity in excess weight.

    PubMed

    Verdejo-Román, Juan; Fornito, Alex; Soriano-Mas, Carles; Vilar-López, Raquel; Verdejo-García, Antonio

    2017-02-01

    Overvaluation of palatable food is a primary driver of obesity, and is associated with brain regions of the reward system. However, it remains unclear if this network is specialized in food reward, or generally involved in reward processing. We used functional magnetic resonance imaging (fMRI) to characterize functional connectivity during processing of food and monetary rewards. Thirty-nine adults with excess weight and 37 adults with normal weight performed the Willingness to Pay for Food task and the Monetary Incentive Delay task in the fMRI scanner. A data-driven graph approach was applied to compare whole-brain, task-related functional connectivity between groups. Excess weight was associated with decreased functional connectivity during the processing of food rewards in a network involving primarily frontal and striatal areas, and increased functional connectivity during the processing of monetary rewards in a network involving principally frontal and parietal areas. These two networks were topologically and anatomically distinct, and were independently associated with BMI. The processing of food and monetary rewards involve segregated neural networks, and both are altered in individuals with excess weight. Copyright © 2016 Elsevier Inc. All rights reserved.

  7. Untangling Basal Ganglia Network Dynamics and Function: Role of Dopamine Depletion and Inhibition Investigated in a Spiking Network Model

    PubMed Central

    2016-01-01

    Abstract The basal ganglia are a crucial brain system for behavioral selection, and their function is disturbed in Parkinson’s disease (PD), where neurons exhibit inappropriate synchronization and oscillations. We present a spiking neural model of basal ganglia including plausible details on synaptic dynamics, connectivity patterns, neuron behavior, and dopamine effects. Recordings of neuronal activity in the subthalamic nucleus and Type A (TA; arkypallidal) and Type I (TI; prototypical) neurons in globus pallidus externa were used to validate the model. Simulation experiments predict that both local inhibition in striatum and the existence of an indirect pathway are important for basal ganglia to function properly over a large range of cortical drives. The dopamine depletion–induced increase of AMPA efficacy in corticostriatal synapses to medium spiny neurons (MSNs) with dopamine receptor D2 synapses (CTX-MSN D2) and the reduction of MSN lateral connectivity (MSN–MSN) were found to contribute significantly to the enhanced synchrony and oscillations seen in PD. Additionally, reversing the dopamine depletion–induced changes to CTX–MSN D1, CTX–MSN D2, TA–MSN, and MSN–MSN couplings could improve or restore basal ganglia action selection ability. In summary, we found multiple changes of parameters for synaptic efficacy and neural excitability that could improve action selection ability and at the same time reduce oscillations. Identification of such targets could potentially generate ideas for treatments of PD and increase our understanding of the relation between network dynamics and network function. PMID:28101525

  8. Untangling Basal Ganglia Network Dynamics and Function: Role of Dopamine Depletion and Inhibition Investigated in a Spiking Network Model.

    PubMed

    Lindahl, Mikael; Hellgren Kotaleski, Jeanette

    2016-01-01

    The basal ganglia are a crucial brain system for behavioral selection, and their function is disturbed in Parkinson's disease (PD), where neurons exhibit inappropriate synchronization and oscillations. We present a spiking neural model of basal ganglia including plausible details on synaptic dynamics, connectivity patterns, neuron behavior, and dopamine effects. Recordings of neuronal activity in the subthalamic nucleus and Type A (TA; arkypallidal) and Type I (TI; prototypical) neurons in globus pallidus externa were used to validate the model. Simulation experiments predict that both local inhibition in striatum and the existence of an indirect pathway are important for basal ganglia to function properly over a large range of cortical drives. The dopamine depletion-induced increase of AMPA efficacy in corticostriatal synapses to medium spiny neurons (MSNs) with dopamine receptor D2 synapses (CTX-MSN D2) and the reduction of MSN lateral connectivity (MSN-MSN) were found to contribute significantly to the enhanced synchrony and oscillations seen in PD. Additionally, reversing the dopamine depletion-induced changes to CTX-MSN D1, CTX-MSN D2, TA-MSN, and MSN-MSN couplings could improve or restore basal ganglia action selection ability. In summary, we found multiple changes of parameters for synaptic efficacy and neural excitability that could improve action selection ability and at the same time reduce oscillations. Identification of such targets could potentially generate ideas for treatments of PD and increase our understanding of the relation between network dynamics and network function.

  9. Magnetoencephalographic imaging of deep corticostriatal network activity during a rewards paradigm.

    PubMed

    Kanal, Eliezer Y; Sun, Mingui; Ozkurt, Tolga E; Jia, Wenyan; Sclabassi, Robert

    2009-01-01

    The human rewards network is a complex system spanning both cortical and subcortical regions. While much is known about the functions of the various components of the network, research on the behavior of the network as a whole has been stymied due to an inability to detect signals at a high enough temporal resolution from both superficial and deep network components simultaneously. In this paper, we describe the application of magnetoencephalographic imaging (MEG) combined with advanced signal processing techniques to this problem. Using data collected while subjects performed a rewards-related gambling paradigm demonstrated to activate the rewards network, we were able to identify neural signals which correspond to deep network activity. We also show that this signal was not observable prior to filtration. These results suggest that MEG imaging may be a viable tool for the detection of deep neural activity.

  10. Major depressive disorder is characterized by greater reward network activation to monetary than pleasant image rewards

    PubMed Central

    Smoski, Moria J.; Rittenberg, Alison; Dichter, Gabriel S.

    2011-01-01

    Anhedonia, the loss of interest or pleasure in normally rewarding activities, is a hallmark feature of unipolar Major Depressive Disorder (MDD). A growing body of literature has identified frontostriatal dysfunction during reward anticipation and outcomes in MDD. However, no study to date has directly compared responses to different types of rewards such as pleasant images and monetary rewards in MDD. To investigate the neural responses to monetary and pleasant image rewards in MDD, a modified Monetary Incentive Delay task was used during fMRI scanning to assess neural responses during anticipation and receipt of monetary and pleasant image rewards. Participants included nine adults with MDD and thirteen affectively healthy controls. The MDD group showed lower activation than controls when anticipating monetary rewards in right orbitofrontal cortex and subcallosal cortex, and when anticipating pleasant image rewards in paracingulate and supplementary motor cortex. The MDD group had relatively greater activation in right putamen when anticipating monetary versus pleasant image rewards, relative to the control group. Results suggest reduced reward network activation in MDD when anticipating rewards, as well as relatively greater hypoactivation to pleasant image than monetary rewards. PMID:22079658

  11. Major depressive disorder is characterized by greater reward network activation to monetary than pleasant image rewards.

    PubMed

    Smoski, Moria J; Rittenberg, Alison; Dichter, Gabriel S

    2011-12-30

    Anhedonia, the loss of interest or pleasure in normally rewarding activities, is a hallmark feature of unipolar Major Depressive Disorder (MDD). A growing body of literature has identified frontostriatal dysfunction during reward anticipation and outcomes in MDD. However, no study to date has directly compared responses to different types of rewards such as pleasant images and monetary rewards in MDD. To investigate the neural responses to monetary and pleasant image rewards in MDD, a modified Monetary Incentive Delay task was used during functional magnetic resonance imaging to assess neural responses during anticipation and receipt of monetary and pleasant image rewards. Participants included nine adults with MDD and 13 affectively healthy controls. The MDD group showed lower activation than controls when anticipating monetary rewards in right orbitofrontal cortex and subcallosal cortex, and when anticipating pleasant image rewards in paracingulate and supplementary motor cortex. The MDD group had relatively greater activation in right putamen when anticipating monetary versus pleasant image rewards, relative to the control group. Results suggest reduced reward network activation in MDD when anticipating rewards, as well as relatively greater hypoactivation to pleasant image than monetary rewards. 2011 Elsevier Ireland Ltd. All rights reserved.

  12. Differential reward coding in the subdivisions of the primate caudate during an oculomotor task.

    PubMed

    Nakamura, Kae; Santos, Gustavo S; Matsuzaki, Ryuichi; Nakahara, Hiroyuki

    2012-11-07

    The basal ganglia play a pivotal role in reward-oriented behavior. The striatum, an input channel of the basal ganglia, is composed of subdivisions that are topographically connected with different cortical and subcortical areas. To test whether reward information is differentially processed in the different parts of the striatum, we compared reward-related neuronal activity along the dorsolateral-ventromedial axis in the caudate nucleus of monkeys performing an asymmetrically rewarded oculomotor task. In a given block, a target in one position was associated with a large reward, whereas the other target was associated with a small reward. The target position-reward value contingency was switched between blocks. We found the following: (1) activity that reflected the block-wise reward contingency emerged before the appearance of a visual target, and it was more prevalent in the dorsal, rather than central and ventral, caudate; (2) activity that was positively related to the reward size of the current trial was evident, especially after reward delivery, and it was more prevalent in the ventral and central, rather than dorsal, caudate; and (3) activity that was modulated by the memory of the outcomes of the previous trials was evident in the dorsal and central caudate. This multiple reward information, together with the target-direction information, was represented primarily by individual caudate neurons, and the different reward information was represented in caudate subpopulations with distinct electrophysiological properties, e.g., baseline firing and spike width. These results suggest parallel processing of different reward information by the basal ganglia subdivisions defined by extrinsic connections and intrinsic properties.

  13. Basal ganglia and Dopamine Contributions to Probabilistic Category Learning

    PubMed Central

    Shohamy, D.; Myers, C.E.; Kalanithi, J.; Gluck, M.A.

    2009-01-01

    Studies of the medial temporal lobe and basal ganglia memory systems have recently been extended towards understanding the neural systems contributing to category learning. The basal ganglia, in particular, have been linked to probabilistic category learning in humans. A separate parallel literature in systems neuroscience has emerged, indicating a role for the basal ganglia and related dopamine inputs in reward prediction and feedback processing. Here, we review behavioral, neuropsychological, functional neuroimaging, and computational studies of basal ganglia and dopamine contributions to learning in humans. Collectively, these studies implicate the basal ganglia in incremental, feedback-based learning that involves integrating information across multiple experiences. The medial temporal lobes, by contrast, contribute to rapid encoding of relations between stimuli and support flexible generalization of learning to novel contexts and stimuli. By breaking down our understanding of the cognitive and neural mechanisms contributing to different aspects of learning, recent studies are providing insight into how, and when, these different processes support learning, how they may interact with each other, and the consequence of different forms of learning for the representation of knowledge. PMID:18061261

  14. Reward-based training of recurrent neural networks for cognitive and value-based tasks

    PubMed Central

    Song, H Francis; Yang, Guangyu R; Wang, Xiao-Jing

    2017-01-01

    Trained neural network models, which exhibit features of neural activity recorded from behaving animals, may provide insights into the circuit mechanisms of cognitive functions through systematic analysis of network activity and connectivity. However, in contrast to the graded error signals commonly used to train networks through supervised learning, animals learn from reward feedback on definite actions through reinforcement learning. Reward maximization is particularly relevant when optimal behavior depends on an animal’s internal judgment of confidence or subjective preferences. Here, we implement reward-based training of recurrent neural networks in which a value network guides learning by using the activity of the decision network to predict future reward. We show that such models capture behavioral and electrophysiological findings from well-known experimental paradigms. Our work provides a unified framework for investigating diverse cognitive and value-based computations, and predicts a role for value representation that is essential for learning, but not executing, a task. DOI: http://dx.doi.org/10.7554/eLife.21492.001 PMID:28084991

  15. Network effects of subthalamic deep brain stimulation drive a unique mixture of responses in basal ganglia output.

    PubMed

    Humphries, Mark D; Gurney, Kevin

    2012-07-01

    Deep brain stimulation (DBS) is a remarkably successful treatment for the motor symptoms of Parkinson's disease. High-frequency stimulation of the subthalamic nucleus (STN) within the basal ganglia is a main clinical target, but the physiological mechanisms of therapeutic STN DBS at the cellular and network level are unclear. We set out to begin to address the hypothesis that a mixture of responses in the basal ganglia output nuclei, combining regularized firing and inhibition, is a key contributor to the effectiveness of STN DBS. We used our computational model of the complete basal ganglia circuit to show how such a mixture of responses in basal ganglia output naturally arises from the network effects of STN DBS. We replicated the diversification of responses recorded in a primate STN DBS study to show that the model's predicted mixture of responses is consistent with therapeutic STN DBS. We then showed how this 'mixture of response' perspective suggests new ideas for DBS mechanisms: first, that the therapeutic frequency of STN DBS is above 100 Hz because the diversification of responses exhibits a step change above this frequency; and second, that optogenetic models of direct STN stimulation during DBS have proven therapeutically ineffective because they do not replicate the mixture of basal ganglia output responses evoked by electrical DBS. © 2012 The Authors. European Journal of Neuroscience © 2012 Federation of European Neuroscience Societies and Blackwell Publishing Ltd.

  16. Effective connectivity of a reward network in obese women

    PubMed Central

    Stoeckel, Luke E.; Kim, Jieun; Weller, Rosalyn E.; Cox, James E.; Cook, Edwin W.; Horwitz, Barry

    2012-01-01

    Exaggerated reactivity to food cues in obese women appears to be mediated in part by a hyperactive reward system that includes the nucleus accumbens, amygdala, and orbitofrontal cortex. The present study used fMRI to investigate whether differences between 12 obese and 12 normal-weight women in reward-related brain activation in response to food images can be explained by changes in the functional interactions between key reward network regions. A two-step path analysis/General Linear Model approach was used to test whether there were group differences in network connections between nucleus accumbens, amygdala, and orbitofrontal cortex in response to high- and low-calorie food images. There was abnormal connectivity in the obese group in response to both high- and low-calorie food cues compared to normal-weight controls. Compared to controls, the obese group had a relative deficiency in the amygdala’s modulation of activation in both orbitofrontal cortex and nucleus accumbens, but excessive influence of orbitofrontal cortex’s modulation of activation in nucleus accumbens. The deficient projections from the amygdala might relate to suboptimal modulation of the affective/emotional aspects of a food’s reward value or an associated cue’s motivational salience, whereas increased orbitofrontal cortex to nucleus accumbens connectivity might contribute to a heightened drive to eat in response to a food cue. Thus, it is possible that not only greater activation of the reward system, but also differences in the interaction of regions in this network may contribute to the relatively increased motivational value of foods in obese individuals. PMID:19467298

  17. Multi-layer network utilizing rewarded spike time dependent plasticity to learn a foraging task

    PubMed Central

    2017-01-01

    Neural networks with a single plastic layer employing reward modulated spike time dependent plasticity (STDP) are capable of learning simple foraging tasks. Here we demonstrate advanced pattern discrimination and continuous learning in a network of spiking neurons with multiple plastic layers. The network utilized both reward modulated and non-reward modulated STDP and implemented multiple mechanisms for homeostatic regulation of synaptic efficacy, including heterosynaptic plasticity, gain control, output balancing, activity normalization of rewarded STDP and hard limits on synaptic strength. We found that addition of a hidden layer of neurons employing non-rewarded STDP created neurons that responded to the specific combinations of inputs and thus performed basic classification of the input patterns. When combined with a following layer of neurons implementing rewarded STDP, the network was able to learn, despite the absence of labeled training data, discrimination between rewarding patterns and the patterns designated as punishing. Synaptic noise allowed for trial-and-error learning that helped to identify the goal-oriented strategies which were effective in task solving. The study predicts a critical set of properties of the spiking neuronal network with STDP that was sufficient to solve a complex foraging task involving pattern classification and decision making. PMID:28961245

  18. Functional neuroanatomy of the basal ganglia.

    PubMed

    Lanciego, José L; Luquin, Natasha; Obeso, José A

    2012-12-01

    The "basal ganglia" refers to a group of subcortical nuclei responsible primarily for motor control, as well as other roles such as motor learning, executive functions and behaviors, and emotions. Proposed more than two decades ago, the classical basal ganglia model shows how information flows through the basal ganglia back to the cortex through two pathways with opposing effects for the proper execution of movement. Although much of the model has remained, the model has been modified and amplified with the emergence of new data. Furthermore, parallel circuits subserve the other functions of the basal ganglia engaging associative and limbic territories. Disruption of the basal ganglia network forms the basis for several movement disorders. This article provides a comprehensive account of basal ganglia functional anatomy and chemistry and the major pathophysiological changes underlying disorders of movement. We try to answer three key questions related to the basal ganglia, as follows: What are the basal ganglia? What are they made of? How do they work? Some insight on the canonical basal ganglia model is provided, together with a selection of paradoxes and some views over the horizon in the field.

  19. A reverse engineering algorithm for neural networks, applied to the subthalamopallidal network of basal ganglia.

    PubMed

    Floares, Alexandru George

    2008-01-01

    Modeling neural networks with ordinary differential equations systems is a sensible approach, but also very difficult. This paper describes a new algorithm based on linear genetic programming which can be used to reverse engineer neural networks. The RODES algorithm automatically discovers the structure of the network, including neural connections, their signs and strengths, estimates its parameters, and can even be used to identify the biophysical mechanisms involved. The algorithm is tested on simulated time series data, generated using a realistic model of the subthalamopallidal network of basal ganglia. The resulting ODE system is highly accurate, and results are obtained in a matter of minutes. This is because the problem of reverse engineering a system of coupled differential equations is reduced to one of reverse engineering individual algebraic equations. The algorithm allows the incorporation of common domain knowledge to restrict the solution space. To our knowledge, this is the first time a realistic reverse engineering algorithm based on linear genetic programming has been applied to neural networks.

  20. The connectome of the basal ganglia.

    PubMed

    Schmitt, Oliver; Eipert, Peter; Kettlitz, Richard; Leßmann, Felix; Wree, Andreas

    2016-03-01

    The basal ganglia of the laboratory rat consist of a few core regions that are specifically interconnected by efferents and afferents of the central nervous system. In nearly 800 reports of tract-tracing investigations the connectivity of the basal ganglia is documented. The readout of connectivity data and the collation of all the connections of these reports in a database allows to generate a connectome. The collation, curation and analysis of such a huge amount of connectivity data is a great challenge and has not been performed before (Bohland et al. PloS One 4:e7200, 2009) in large connectomics projects based on meta-analysis of tract-tracing studies. Here, the basal ganglia connectome of the rat has been generated and analyzed using the consistent cross-platform and generic framework neuroVIISAS. Several advances of this connectome meta-study have been made: the collation of laterality data, the network-analysis of connectivity strengths and the assignment of regions to a hierarchically organized terminology. The basal ganglia connectome offers differences in contralateral connectivity of motoric regions in contrast to other regions. A modularity analysis of the weighted and directed connectome produced a specific grouping of regions. This result indicates a correlation of structural and functional subsystems. As a new finding, significant reciprocal connections of specific network motifs in this connectome were detected. All three principal basal ganglia pathways (direct, indirect, hyperdirect) could be determined in the connectome. By identifying these pathways it was found that there exist many further equivalent pathways possessing the same length and mean connectivity weight as the principal pathways. Based on the connectome data it is unknown why an excitation pattern may prefer principal rather than other equivalent pathways. In addition to these new findings the local graph-theoretical features of regions of the connectome have been determined. By

  1. Differential reward network functional connectivity in cannabis dependent and non-dependent users☆

    PubMed Central

    Filbey, Francesca M.; Dunlop, Joseph

    2015-01-01

    Background Emergent studies show that similar to other substances of abuse, cue-reactivity to cannabis is also associated with neural response in the brain’s reward pathway (Filbey et al., 2009). However, the inter-relatedness of brain regions during cue-reactivity in cannabis users remains unknown. Methods In this study, we conducted a series of investigations to determine functional connectivity during cue-reactivity in 71 cannabis users. First, we used psychophysiological interaction (PPI) analysis to examine coherent neural response to cannabis cues. Second, we evaluated whether these patterns of network functional connectivity differentiated dependent and non-dependent users. Finally, as an exploratory analysis, we determined the directionality of these connections via Granger connectivity analyses. Results PPI analyses showed reward network functional connectivity with the nucleus accumbens (NAc) seed region during cue exposure. Between-group contrasts found differential effects of dependence status. Dependent users (N = 31) had greater functional connectivity with amygdala and anterior cingulate gyrus (ACG) seeds while the non-dependent users (N = 24) had greater functional connectivity with the NAc, orbitofrontal cortex (OFC) and hippocampus seeds. Granger analyses showed that hippocampal and ACG activation preceded neural response in reward areas. Conclusions Both PPI and Granger analyses demonstrated strong functional coherence in reward regions during exposure to cannabis cues in current cannabis users. Functional connectivity (but not regional activation) in the reward network differentiated dependent from non-dependent cannabis users. Our findings suggest that repeated cannabis exposure causes observable changes in functional connectivity in the reward network and should be considered in intervention strategies. PMID:24838032

  2. Caudate clues to rewarding cues.

    PubMed

    Platt, Michael L

    2002-01-31

    Behavioral studies indicate that prior experience can influence discrimination of subsequent stimuli. The mechanisms responsible for highlighting a particular aspect of the stimulus, such as motion or color, as most relevant and thus deserving further scrutiny, however, remain poorly understood. In the current issue of Neuron, demonstrate that neurons in the caudate nucleus of the basal ganglia signal which dimension of a visual cue, either color or location, is associated with reward in an eye movement task. These findings raise the possibility that this structure participates in the reward-based control of visual attention.

  3. Impact of Social Reward on the Evolution of the Cooperation Behavior in Complex Networks

    NASA Astrophysics Data System (ADS)

    Wu, Yu'E.; Chang, Shuhua; Zhang, Zhipeng; Deng, Zhenghong

    2017-01-01

    Social reward, as a significant mechanism explaining the evolution of cooperation, has attracted great attention both theoretically and experimentally. In this paper, we study the evolution of cooperation by proposing a reward model in network population, where a third strategy, reward, as an independent yet particular type of cooperation is introduced in 2-person evolutionary games. Specifically, a new kind of role corresponding to reward strategy, reward agents, is defined, which is aimed at increasing the income of cooperators by applying to them a social reward. Results from numerical simulations show that consideration of social reward greatly promotes the evolution of cooperation, which is confirmed for different network topologies and two evolutionary games. Moreover, we explore the microscopic mechanisms for the promotion of cooperation in the three-strategy model. As expected, the reward agents play a vital role in the formation of cooperative clusters, thus resisting the aggression of defectors. Our research might provide valuable insights into further exploring the nature of cooperation in the real world.

  4. Opponent and bidirectional control of movement velocity in the basal ganglia

    PubMed Central

    Yttri, Eric A.

    2016-01-01

    For goal-directed behavior it is critical that we can both select the appropriate action and learn to modify the underlying movements (e.g. the pitch of a note or velocity of a reach) to improve outcomes. The basal ganglia are a critical nexus where circuits necessary for the production of behavior, such as neocortex and thalamus, are integrated with reward signaling 1 to reinforce successful, purposive actions 2. Dorsal striatum, a major input structure of basal ganglia is composed of two opponent pathways, direct and indirect, thought to select actions that elicit positive outcomes or suppress actions that do not, respectively 3,4. Activity-dependent plasticity modulated by reward is thought to be sufficient for selecting actions in striatum 5,6. Although perturbations of basal ganglia function produce profound changes in movement 7, it remains unknown whether activity-dependent plasticity is sufficient to produce learned changes in movement kinematics, such as velocity. Here we used cell-type specific stimulation delivered in closed-loop during movement to demonstrate that activity in either the direct or indirect pathway is sufficient to produce specific and sustained increases or decreases in velocity without affecting action selection or motivation. These behavioral changes were a form of learning that accumulated over trials, persisted after the cessation of stimulation, and were abolished in the presence of dopamine antagonists. Our results reveal that the direct and indirect pathways can each bidirectionally control movement velocity, demonstrating unprecedented specificity and flexibility in the control of volition by the basal ganglia. PMID:27135927

  5. An extended reinforcement learning model of basal ganglia to understand the contributions of serotonin and dopamine in risk-based decision making, reward prediction, and punishment learning

    PubMed Central

    Balasubramani, Pragathi P.; Chakravarthy, V. Srinivasa; Ravindran, Balaraman; Moustafa, Ahmed A.

    2014-01-01

    Although empirical and neural studies show that serotonin (5HT) plays many functional roles in the brain, prior computational models mostly focus on its role in behavioral inhibition. In this study, we present a model of risk based decision making in a modified Reinforcement Learning (RL)-framework. The model depicts the roles of dopamine (DA) and serotonin (5HT) in Basal Ganglia (BG). In this model, the DA signal is represented by the temporal difference error (δ), while the 5HT signal is represented by a parameter (α) that controls risk prediction error. This formulation that accommodates both 5HT and DA reconciles some of the diverse roles of 5HT particularly in connection with the BG system. We apply the model to different experimental paradigms used to study the role of 5HT: (1) Risk-sensitive decision making, where 5HT controls risk assessment, (2) Temporal reward prediction, where 5HT controls time-scale of reward prediction, and (3) Reward/Punishment sensitivity, in which the punishment prediction error depends on 5HT levels. Thus the proposed integrated RL model reconciles several existing theories of 5HT and DA in the BG. PMID:24795614

  6. A computational model of Dopamine and Acetylcholine aberrant learning in Basal Ganglia.

    PubMed

    Baston, Chiara; Ursino, Mauro

    2015-01-01

    Basal Ganglia (BG) are implied in many motor and cognitive tasks, such as action selection, and have a central role in many pathologies, primarily Parkinson Disease. In the present work, we use a recently developed biologically inspired BG model to analyze how the dopamine (DA) level can affect the temporal response during action selection, and the capacity to learn new actions following rewards and punishments. The model incorporates the 3 main pathways (direct, indirect and hyperdirect) working in BG functioning. The behavior of 2 alternative networks (the first with normal DA levels, the second with reduced DA) is analyzed both in untrained conditions, and during training performed in different epochs. The results show that reduced DA causes delayed temporal responses in the untrained network, and difficult of learning during training, characterized by the necessity of much more epochs. The results provide interesting hints to understand the behavior of healthy and dopamine depleted subjects, such as parkinsonian patients.

  7. Impact of Social Reward on the Evolution of the Cooperation Behavior in Complex Networks

    PubMed Central

    Wu, Yu’e; Chang, Shuhua; Zhang, Zhipeng; Deng, Zhenghong

    2017-01-01

    Social reward, as a significant mechanism explaining the evolution of cooperation, has attracted great attention both theoretically and experimentally. In this paper, we study the evolution of cooperation by proposing a reward model in network population, where a third strategy, reward, as an independent yet particular type of cooperation is introduced in 2-person evolutionary games. Specifically, a new kind of role corresponding to reward strategy, reward agents, is defined, which is aimed at increasing the income of cooperators by applying to them a social reward. Results from numerical simulations show that consideration of social reward greatly promotes the evolution of cooperation, which is confirmed for different network topologies and two evolutionary games. Moreover, we explore the microscopic mechanisms for the promotion of cooperation in the three-strategy model. As expected, the reward agents play a vital role in the formation of cooperative clusters, thus resisting the aggression of defectors. Our research might provide valuable insights into further exploring the nature of cooperation in the real world. PMID:28112276

  8. Nonlinear predictive control for adaptive adjustments of deep brain stimulation parameters in basal ganglia-thalamic network.

    PubMed

    Su, Fei; Wang, Jiang; Niu, Shuangxia; Li, Huiyan; Deng, Bin; Liu, Chen; Wei, Xile

    2018-02-01

    The efficacy of deep brain stimulation (DBS) for Parkinson's disease (PD) depends in part on the post-operative programming of stimulation parameters. Closed-loop stimulation is one method to realize the frequent adjustment of stimulation parameters. This paper introduced the nonlinear predictive control method into the online adjustment of DBS amplitude and frequency. This approach was tested in a computational model of basal ganglia-thalamic network. The autoregressive Volterra model was used to identify the process model based on physiological data. Simulation results illustrated the efficiency of closed-loop stimulation methods (amplitude adjustment and frequency adjustment) in improving the relay reliability of thalamic neurons compared with the PD state. Besides, compared with the 130Hz constant DBS the closed-loop stimulation methods can significantly reduce the energy consumption. Through the analysis of inter-spike-intervals (ISIs) distribution of basal ganglia neurons, the evoked network activity by the closed-loop frequency adjustment stimulation was closer to the normal state. Copyright © 2017 Elsevier Ltd. All rights reserved.

  9. Parallel basal ganglia circuits for decision making.

    PubMed

    Hikosaka, Okihide; Ghazizadeh, Ali; Griggs, Whitney; Amita, Hidetoshi

    2018-03-01

    The basal ganglia control body movements, mainly, based on their values. Critical for this mechanism is dopamine neurons, which sends unpredicted value signals, mainly, to the striatum. This mechanism enables animals to change their behaviors flexibly, eventually choosing a valuable behavior. However, this may not be the best behavior, because the flexible choice is focused on recent, and, therefore, limited, experiences (i.e., short-term memories). Our old and recent studies suggest that the basal ganglia contain separate circuits that process value signals in a completely different manner. They are insensitive to recent changes in value, yet gradually accumulate the value of each behavior (i.e., movement or object choice). These stable circuits eventually encode values of many behaviors and then retain the value signals for a long time (i.e., long-term memories). They are innervated by a separate group of dopamine neurons that retain value signals, even when no reward is predicted. Importantly, the stable circuits can control motor behaviors (e.g., hand or eye) quickly and precisely, which allows animals to automatically acquire valuable outcomes based on historical life experiences. These behaviors would be called 'skills', which are crucial for survival. The stable circuits are localized in the posterior part of the basal ganglia, separately from the flexible circuits located in the anterior part. To summarize, the flexible and stable circuits in the basal ganglia, working together but independently, enable animals (and humans) to reach valuable goals in various contexts.

  10. Functional Connectivity of Insula, Basal Ganglia, and Prefrontal Executive Control Networks during Hypoglycemia in Type 1 Diabetes

    PubMed Central

    Simonson, Donald C.; Nickerson, Lisa D.; Flores, Veronica L.; Siracusa, Tamar; Hager, Brandon; Lyoo, In Kyoon; Renshaw, Perry F.; Jacobson, Alan M.

    2015-01-01

    Human brain networks mediating interoceptive, behavioral, and cognitive aspects of glycemic control are not well studied. Using group independent component analysis with dual-regression approach of functional magnetic resonance imaging data, we examined the functional connectivity changes of large-scale resting state networks during sequential euglycemic–hypoglycemic clamp studies in patients with type 1 diabetes and nondiabetic controls and how these changes during hypoglycemia were related to symptoms of hypoglycemia awareness and to concurrent glycosylated hemoglobin (HbA1c) levels. During hypoglycemia, diabetic patients showed increased functional connectivity of the right anterior insula and the prefrontal cortex within the executive control network, which was associated with higher HbA1c. Controls showed decreased functional connectivity of the right anterior insula with the cerebellum/basal ganglia network and of temporal regions within the temporal pole network and increased functional connectivity in the default mode and sensorimotor networks. Functional connectivity reductions in the right basal ganglia were correlated with increases of self-reported hypoglycemic symptoms in controls but not in patients. Resting state networks that showed different group functional connectivity during hypoglycemia may be most sensitive to glycemic environment, and their connectivity patterns may have adapted to repeated glycemic excursions present in type 1 diabetes. Our results suggest that basal ganglia and insula mediation of interoceptive awareness during hypoglycemia is altered in type 1 diabetes. These changes could be neuroplastic adaptations to frequent hypoglycemic experiences. Functional connectivity changes in the insula and prefrontal cognitive networks could also reflect an adaptation to changes in brain metabolic pathways associated with chronic hyperglycemia. SIGNIFICANCE STATEMENT The major factor limiting improved glucose control in type 1 diabetes is

  11. The computational neurobiology of learning and reward.

    PubMed

    Daw, Nathaniel D; Doya, Kenji

    2006-04-01

    Following the suggestion that midbrain dopaminergic neurons encode a signal, known as a 'reward prediction error', used by artificial intelligence algorithms for learning to choose advantageous actions, the study of the neural substrates for reward-based learning has been strongly influenced by computational theories. In recent work, such theories have been increasingly integrated into experimental design and analysis. Such hybrid approaches have offered detailed new insights into the function of a number of brain areas, especially the cortex and basal ganglia. In part this is because these approaches enable the study of neural correlates of subjective factors (such as a participant's beliefs about the reward to be received for performing some action) that the computational theories purport to quantify.

  12. Fast oscillations in cortical-striatal networks switch frequency following rewarding events and stimulant drugs.

    PubMed

    Berke, J D

    2009-09-01

    Oscillations may organize communication between components of large-scale brain networks. Although gamma-band oscillations have been repeatedly observed in cortical-basal ganglia circuits, their functional roles are not yet clear. Here I show that, in behaving rats, distinct frequencies of ventral striatal local field potential oscillations show coherence with different cortical inputs. The approximately 50 Hz gamma oscillations that normally predominate in awake ventral striatum are coherent with piriform cortex, whereas approximately 80-100 Hz high-gamma oscillations are coherent with frontal cortex. Within striatum, entrainment to gamma rhythms is selective to fast-spiking interneurons, with distinct fast-spiking interneuron populations entrained to different gamma frequencies. Administration of the psychomotor stimulant amphetamine or the dopamine agonist apomorphine causes a prolonged decrease in approximately 50 Hz power and increase in approximately 80-100 Hz power. The same frequency switch is observed for shorter epochs spontaneously in awake, undrugged animals and is consistently provoked for < 1 s following reward receipt. Individual striatal neurons can participate in these brief high-gamma bursts with, or without, substantial changes in firing rate. Switching between discrete oscillatory states may allow different modes of information processing during decision-making and reinforcement-based learning, and may also be an important systems-level process by which stimulant drugs affect cognition and behavior.

  13. Cognitive-motor interactions of the basal ganglia in development

    PubMed Central

    Leisman, Gerry; Braun-Benjamin, Orit; Melillo, Robert

    2014-01-01

    Neural circuits linking activity in anatomically segregated populations of neurons in subcortical structures and the neocortex throughout the human brain regulate complex behaviors such as walking, talking, language comprehension, and other cognitive functions associated with frontal lobes. The basal ganglia, which regulate motor control, are also crucial elements in the circuits that confer human reasoning and adaptive function. The basal ganglia are key elements in the control of reward-based learning, sequencing, discrete elements that constitute a complete motor act, and cognitive function. Imaging studies of intact human subjects and electrophysiologic and tracer studies of the brains and behavior of other species confirm these findings. We know that the relation between the basal ganglia and the cerebral cortical region allows for connections organized into discrete circuits. Rather than serving as a means for widespread cortical areas to gain access to the motor system, these loops reciprocally interconnect a large and diverse set of cerebral cortical areas with the basal ganglia. Neuronal activity within the basal ganglia associated with motor areas of the cerebral cortex is highly correlated with parameters of movement. Neuronal activity within the basal ganglia and cerebellar loops associated with the prefrontal cortex is related to the aspects of cognitive function. Thus, individual loops appear to be involved in distinct behavioral functions. Damage to the basal ganglia of circuits with motor areas of the cortex leads to motor symptoms, whereas damage to the subcortical components of circuits with non-motor areas of the cortex causes higher-order deficits. In this report, we review some of the anatomic, physiologic, and behavioral findings that have contributed to a reappraisal of function concerning the basal ganglia and cerebellar loops with the cerebral cortex and apply it in clinical applications to attention deficit/hyperactivity disorder (ADHD

  14. Good Vibrations: Cross-Frequency Coupling in the Human Nucleus Accumbens during Reward Processing

    ERIC Educational Resources Information Center

    Cohen, Michael X.; Axmacher, Nikolai; Lenartz, Doris; Elger, Christian E.; Sturm, Volker; Schlaepfer, Thomas E.

    2009-01-01

    The nucleus accumbens is critical for reward-guided learning and decision-making. It is thought to "gate" the flow of a diverse range of information (e.g., rewarding, aversive, and novel events) from limbic afferents to basal ganglia outputs. Gating and information encoding may be achieved via cross-frequency coupling, in which bursts of…

  15. A neuronal reward inequity signal in primate striatum

    PubMed Central

    van Coeverden, Charlotte R.; Schultz, Wolfram

    2015-01-01

    Primates are social animals, and their survival depends on social interactions with others. Especially important for social interactions and welfare is the observation of rewards obtained by other individuals and the comparison with own reward. The fundamental social decision variable for the comparison process is reward inequity, defined by an asymmetric reward distribution among individuals. An important brain structure for coding reward inequity may be the striatum, a component of the basal ganglia involved in goal-directed behavior. Two rhesus monkeys were seated opposite each other and contacted a touch-sensitive table placed between them to obtain specific magnitudes of reward that were equally or unequally distributed among them. Response times in one of the animals demonstrated differential behavioral sensitivity to reward inequity. A group of neurons in the striatum showed distinct signals reflecting disadvantageous and advantageous reward inequity. These neuronal signals occurred irrespective of, or in conjunction with, own reward coding. These data demonstrate that striatal neurons of macaque monkeys sense the differences between other's and own reward. The neuronal activities are likely to contribute crucial reward information to neuronal mechanisms involved in social interactions. PMID:26378202

  16. Ventral striatal network connectivity reflects reward learning and behavior in patients with Parkinson's disease.

    PubMed

    Petersen, Kalen; Van Wouwe, Nelleke; Stark, Adam; Lin, Ya-Chen; Kang, Hakmook; Trujillo-Diaz, Paula; Kessler, Robert; Zald, David; Donahue, Manus J; Claassen, Daniel O

    2018-01-01

    A subgroup of Parkinson's disease (PD) patients treated with dopaminergic therapy develop compulsive reward-driven behaviors, which can result in life-altering morbidity. The mesocorticolimbic dopamine network guides reward-motivated behavior; however, its role in this treatment-related behavioral phenotype is incompletely understood. Here, mesocorticolimbic network function in PD patients who develop impulsive and compulsive behaviors (ICB) in response to dopamine agonists was assessed using BOLD fMRI. The tested hypothesis was that network connectivity between the ventral striatum and the limbic cortex is elevated in patients with ICB and that reward-learning proficiency reflects the extent of mesocorticolimbic network connectivity. To evaluate this hypothesis, 3.0T BOLD-fMRI was applied to measure baseline functional connectivity on and off dopamine agonist therapy in age and sex-matched PD patients with (n = 19) or without (n = 18) ICB. An incentive-based task was administered to a subset of patients (n = 20) to quantify positively or negatively reinforced learning. Whole-brain voxelwise analyses and region-of-interest-based mixed linear effects modeling were performed. Elevated ventral striatal connectivity to the anterior cingulate gyrus (P = 0.013), orbitofrontal cortex (P = 0.034), insula (P = 0.044), putamen (P = 0.014), globus pallidus (P < 0.01), and thalamus (P < 0.01) was observed in patients with ICB. A strong trend for elevated amygdala-to-midbrain connectivity was found in ICB patients on dopamine agonist. Ventral striatum-to-subgenual cingulate connectivity correlated with reward learning (P < 0.01), but not with punishment-avoidance learning. These data indicate that PD-ICB patients have elevated network connectivity in the mesocorticolimbic network. Behaviorally, proficient reward-based learning is related to this enhanced limbic and ventral striatal connectivity. Hum Brain Mapp 39:509-521, 2018. © 2017

  17. Age differences in default and reward networks during processing of personally relevant information.

    PubMed

    Grady, Cheryl L; Grigg, Omer; Ng, Charisa

    2012-06-01

    We recently found activity in default mode and reward-related regions during self-relevant tasks in young adults. Here we examine the effect of aging on engagement of the default network (DN) and reward network (RN) during these tasks. Previous studies have shown reduced engagement of the DN and reward areas in older adults, but the influence of age on these circuits during self-relevant tasks has not been examined. The tasks involved judging personality traits about one's self or a well known other person. There were no age differences in reaction time on the tasks but older adults had more positive Self and Other judgments, whereas younger adults had more negative judgments. Both groups had increased DN and RN activity during the self-relevant tasks, relative to non-self tasks, but this increase was reduced in older compared to young adults. Functional connectivity of both networks during the tasks was weaker in the older relative to younger adults. Intrinsic functional connectivity, measured at rest, also was weaker in the older adults in the DN, but not in the RN. These results suggest that, in younger adults, the processing of personally relevant information involves robust activation of and functional connectivity within these two networks, in line with current models that emphasize strong links between the self and reward. The finding that older adults had more positive judgments, but weaker engagement and less consistent functional connectivity in these networks, suggests potential brain mechanisms for the "positivity bias" with aging. Copyright © 2012 Elsevier Ltd. All rights reserved.

  18. Age differences in default and reward networks during processing of personally relevant information

    PubMed Central

    Grady, Cheryl L.; Grigg, Omer; Ng, Charisa

    2013-01-01

    We recently found activity in default mode and reward-related regions during self-relevant tasks in young adults. Here we examine the effect of aging on engagement of the default network (DN) and reward network (RN) during these tasks. Previous studies have shown reduced engagement of the DN and reward areas in older adults, but the influence of age on these circuits during self-relevant tasks has not been examined. The tasks involved judging personality traits about one’s self or a well known other person. There were no age differences in reaction time on the tasks but older adults had more positive Self and Other judgments, whereas younger adults had more negative judgments. Both groups had increased DN and RN activity during the self-relevant tasks, relative to non-self tasks, but this increase was reduced in older compared to young adults. Functional connectivity of both networks during the tasks was weaker in the older relative to younger adults. Intrinsic functional connectivity, measured at rest, also was weaker in the older adults in the DN, but not in the RN. These results suggest that, in younger adults, the processing of personally relevant information involves robust activation of and functional connectivity within these two networks, in line with current models that emphasize strong links between the self and reward. The finding that older adults had more positive judgments, but weaker engagement and less consistent functional connectivity in these networks, suggests potential brain mechanisms for the “positivity bias” with aging. PMID:22484520

  19. Basal ganglia dysfunction in idiopathic REM sleep behaviour disorder parallels that in early Parkinson's disease.

    PubMed

    Rolinski, Michal; Griffanti, Ludovica; Piccini, Paola; Roussakis, Andreas A; Szewczyk-Krolikowski, Konrad; Menke, Ricarda A; Quinnell, Timothy; Zaiwalla, Zenobia; Klein, Johannes C; Mackay, Clare E; Hu, Michele T M

    2016-08-01

    SEE POSTUMA DOI101093/AWW131 FOR A SCIENTIFIC COMMENTARY ON THIS ARTICLE: Resting state functional magnetic resonance imaging dysfunction within the basal ganglia network is a feature of early Parkinson's disease and may be a diagnostic biomarker of basal ganglia dysfunction. Currently, it is unclear whether these changes are present in so-called idiopathic rapid eye movement sleep behaviour disorder, a condition associated with a high rate of future conversion to Parkinson's disease. In this study, we explore the utility of resting state functional magnetic resonance imaging to detect basal ganglia network dysfunction in rapid eye movement sleep behaviour disorder. We compare these data to a set of healthy control subjects, and to a set of patients with established early Parkinson's disease. Furthermore, we explore the relationship between resting state functional magnetic resonance imaging basal ganglia network dysfunction and loss of dopaminergic neurons assessed with dopamine transporter single photon emission computerized tomography, and perform morphometric analyses to assess grey matter loss. Twenty-six patients with polysomnographically-established rapid eye movement sleep behaviour disorder, 48 patients with Parkinson's disease and 23 healthy control subjects were included in this study. Resting state networks were isolated from task-free functional magnetic resonance imaging data using dual regression with a template derived from a separate cohort of 80 elderly healthy control participants. Resting state functional magnetic resonance imaging parameter estimates were extracted from the study subjects in the basal ganglia network. In addition, eight patients with rapid eye movement sleep behaviour disorder, 10 with Parkinson's disease and 10 control subjects received (123)I-ioflupane single photon emission computerized tomography. We tested for reduction of basal ganglia network connectivity, and for loss of tracer uptake in rapid eye movement sleep

  20. Cytokine effects on the basal ganglia and dopamine function: the subcortical source of inflammatory malaise.

    PubMed

    Felger, Jennifer C; Miller, Andrew H

    2012-08-01

    Data suggest that cytokines released during the inflammatory response target subcortical structures including the basal ganglia as well as dopamine function to acutely induce behavioral changes that support fighting infection and wound healing. However, chronic inflammation and exposure to inflammatory cytokines appears to lead to persisting alterations in the basal ganglia and dopamine function reflected by anhedonia, fatigue, and psychomotor slowing. Moreover, reduced neural responses to hedonic reward, decreased dopamine metabolites in the cerebrospinal fluid and increased presynaptic dopamine uptake and decreased turnover have been described. This multiplicity of changes in the basal ganglia and dopamine function suggest fundamental effects of inflammatory cytokines on dopamine synthesis, packaging, release and/or reuptake, which may sabotage and circumvent the efficacy of current treatment approaches. Thus, examination of the mechanisms by which cytokines alter the basal ganglia and dopamine function will yield novel insights into the treatment of cytokine-induced behavioral changes and inflammatory malaise. Copyright © 2012 Elsevier Inc. All rights reserved.

  1. Altered Effective Connectivity Network of the Basal Ganglia in Low-Grade Hepatic Encephalopathy: A Resting-State fMRI Study with Granger Causality Analysis

    PubMed Central

    Zhong, Jianhui; Zhang, Zhiqiang; Ni, Ling; Jiao, Qing; Liao, Wei; Zheng, Gang; Lu, Guangming

    2013-01-01

    Background The basal ganglia often show abnormal metabolism and intracranial hemodynamics in cirrhotic patients with hepatic encephalopathy (HE). Little is known about how the basal ganglia affect other brain system and is affected by other brain regions in HE. The purpose of this study was to investigate whether the effective connectivity network associated with the basal ganglia is disturbed in HE patients by using resting-state functional magnetic resonance imaging (rs-fMRI). Methodology/Principal Findings Thirty five low-grade HE patients and thirty five age- and gender- matched healthy controls participated in the rs-fMRI scans. The effective connectivity networks associated with the globus pallidus, the primarily affected region within basal ganglia in HE, were characterized by using the Granger causality analysis and compared between HE patients and healthy controls. Pearson correlation analysis was performed between the abnormal effective connectivity and venous blood ammonia levels and neuropsychological performances of all HE patients. Compared with the healthy controls, patients with low-grade HE demonstrated mutually decreased influence between the globus pallidus and the anterior cingulate cortex (ACC), cuneus, bi-directionally increased influence between the globus pallidus and the precuneus, and either decreased or increased influence from and to the globus pallidus in many other frontal, temporal, parietal gyri, and cerebellum. Pearson correlation analyses revealed that the blood ammonia levels in HE patients negatively correlated with effective connectivity from the globus pallidus to ACC, and positively correlated with that from the globus pallidus to precuneus; and the number connectivity test scores in patients negatively correlated with the effective connectivity from the globus pallidus to ACC, and from superior frontal gyrus to globus pallidus. Conclusions/Significance Low-grade HE patients had disrupted effective connectivity network of

  2. Basal ganglia dysfunction in idiopathic REM sleep behaviour disorder parallels that in early Parkinson’s disease

    PubMed Central

    Rolinski, Michal; Griffanti, Ludovica; Piccini, Paola; Roussakis, Andreas A.; Szewczyk-Krolikowski, Konrad; Menke, Ricarda A.; Quinnell, Timothy; Zaiwalla, Zenobia; Klein, Johannes C.; Mackay, Clare E.

    2016-01-01

    Abstract See Postuma (doi:10.1093/aww131) for a scientific commentary on this article. Resting state functional magnetic resonance imaging dysfunction within the basal ganglia network is a feature of early Parkinson’s disease and may be a diagnostic biomarker of basal ganglia dysfunction. Currently, it is unclear whether these changes are present in so-called idiopathic rapid eye movement sleep behaviour disorder, a condition associated with a high rate of future conversion to Parkinson’s disease. In this study, we explore the utility of resting state functional magnetic resonance imaging to detect basal ganglia network dysfunction in rapid eye movement sleep behaviour disorder. We compare these data to a set of healthy control subjects, and to a set of patients with established early Parkinson’s disease. Furthermore, we explore the relationship between resting state functional magnetic resonance imaging basal ganglia network dysfunction and loss of dopaminergic neurons assessed with dopamine transporter single photon emission computerized tomography, and perform morphometric analyses to assess grey matter loss. Twenty-six patients with polysomnographically-established rapid eye movement sleep behaviour disorder, 48 patients with Parkinson’s disease and 23 healthy control subjects were included in this study. Resting state networks were isolated from task-free functional magnetic resonance imaging data using dual regression with a template derived from a separate cohort of 80 elderly healthy control participants. Resting state functional magnetic resonance imaging parameter estimates were extracted from the study subjects in the basal ganglia network. In addition, eight patients with rapid eye movement sleep behaviour disorder, 10 with Parkinson’s disease and 10 control subjects received 123I-ioflupane single photon emission computerized tomography. We tested for reduction of basal ganglia network connectivity, and for loss of tracer uptake in rapid eye

  3. Characterizing individual differences in reward sensitivity from the brain networks involved in response inhibition.

    PubMed

    Fuentes-Claramonte, Paola; Ávila, César; Rodríguez-Pujadas, Aina; Costumero, Víctor; Ventura-Campos, Noelia; Bustamante, Juan Carlos; Rosell-Negre, Patricia; Barrós-Loscertales, Alfonso

    2016-01-01

    A "disinhibited" cognitive profile has been proposed for individuals with high reward sensitivity, characterized by increased engagement in goal-directed responses and reduced processing of negative or unexpected cues, which impairs adequate behavioral regulation after feedback in these individuals. This pattern is manifested through deficits in inhibitory control and/or increases in RT variability. In the present work, we aimed to test whether this profile is associated with the activity of functional networks during a stop-signal task using independent component analysis (ICA). Sixty-one participants underwent fMRI while performing a stop-signal task, during which a manual response had to be inhibited. ICA was used to mainly replicate the functional networks involved in the task (Zhang and Li, 2012): two motor networks involved in the go response, the left and right fronto-parietal networks for stopping, a midline error-processing network, and the default-mode network (DMN), which was further subdivided into its anterior and posterior parts. Reward sensitivity was mainly associated with greater activity of motor networks, reduced activity in the midline network during correct stop trials and, behaviorally, increased RT variability. All these variables explained 36% of variance of the SR scores. This pattern of associations suggests that reward sensitivity involves greater motor engagement in the dominant response, more distractibility and reduced processing of salient or unexpected events, which may lead to disinhibited behavior. Copyright © 2015 Elsevier Inc. All rights reserved.

  4. Reward processing in neurodegenerative disease

    PubMed Central

    Perry, David C.; Kramer, Joel H.

    2015-01-01

    Representation of reward value involves a distributed network including cortical and subcortical structures. Because neurodegenerative illnesses target specific anatomic networks that partially overlap with the reward circuit they would be predicted to have distinct impairments in reward processing. This review presents the existing evidence of reward processing changes in neurodegenerative diseases including mild cognitive impairment, Alzheimer's disease, frontotemporal dementia, amyotrophic lateral sclerosis, Parkinson's disease, and Huntington's disease, as well as in healthy aging. Carefully distinguishing the different aspects of reward processing (primary rewards, secondary rewards, reward-based learning, and reward-based decision-making) and using tasks that differentiate the stages of processing reward will lead to improved understanding of this fundamental process and clarify a contributing cause of behavioral change in these illnesses. PMID:24417286

  5. Disrupted reward and cognitive control networks contribute to anhedonia in depression.

    PubMed

    Gong, Liang; He, Cancan; Zhang, Haisan; Zhang, Hongxing; Zhang, Zhijun; Xie, Chunming

    2018-08-01

    Neuroimaging studies have identified that anhedonia, a core feature of major depressive disorder (MDD), is associated with dysfunction in reward and cognitive control processing. However, it is still not clear how the reward network (β-network) and the cognitive control network (δ-network) are linked to biased anhedonia in MDD patients. Sixty-eight MDD patients and 64 cognitively normal (CN) subjects underwent a resting-state functional magnetic resonance imaging scan. A 2*2 ANCOVA analysis was used to explore the differences in the nucleus accumbens-based, voxelwise functional connectivity (FC) between the groups. Then, the β- and δ-networks were constructed, and the FC intensities were compared within and between theβ- and δ-networks across all subjects. Multiple linear regression analyses were also employed to investigate the relationships between the neural features of the β- and δ-networks and anhedonia in MDD patients. Compared to the CN subjects, the MDD patients showed synergistic functional decoupling in both the β- and δ-networks, as well as decreased FC intensities in the intra- and inter- β- and δ-networks. In addition, the FC in both the β- and δ-networks was significantly correlated with anhedonia severity in the MDD patients. Importantly, the integrated neural features of the β- and δ-networks could more precisely predict anhedonic symptoms. These findings initially demonstrated that the imbalance between β- and δ-network activity successfully predicted anhedonia severity and suggested that the neural features of both the β- and δ-networks could represent a fundamental mechanism that underlies anhedonia in MDD patients. Copyright © 2018 Elsevier Ltd. All rights reserved.

  6. High frequency stimulation of the entopeduncular nucleus sets the cortico-basal ganglia network to a new functional state in the dystonic hamster.

    PubMed

    Reese, René; Charron, Giselle; Nadjar, Agnès; Aubert, Incarnation; Thiolat, Marie-Laure; Hamann, Melanie; Richter, Angelika; Bezard, Erwan; Meissner, Wassilios G

    2009-09-01

    High frequency stimulation (HFS) of the internal pallidum is effective for the treatment of dystonia. Only few studies have investigated the effects of stimulation on the activity of the cortex-basal ganglia network. We here assess within this network the effect of entopeduncular nucleus (EP) HFS on the expression of c-Fos and cytochrome oxidase subunit I (COI) in the dt(sz)-hamster, a well-characterized model of paroxysmal dystonia. In dt(sz)-hamsters, we identified abnormal activity in motor cortex, basal ganglia and thalamus. These structures have already been linked to the pathophysiology of human dystonia. EP-HFS (i) increased striatal c-Fos expression in controls and dystonic hamsters and (ii) reduced thalamic c-Fos expression in dt(sz)-hamsters. EP-HFS had no effect on COI expression. The present results suggest that EP-HFS induces a new network activity state which may improve information processing and finally reduces the severity of dystonic attacks in dt(sz)-hamsters.

  7. A Simple Network Architecture Accounts for Diverse Reward Time Responses in Primary Visual Cortex.

    PubMed

    Huertas, Marco A; Hussain Shuler, Marshall G; Shouval, Harel Z

    2015-09-16

    Many actions performed by animals and humans depend on an ability to learn, estimate, and produce temporal intervals of behavioral relevance. Exemplifying such learning of cued expectancies is the observation of reward-timing activity in the primary visual cortex (V1) of rodents, wherein neural responses to visual cues come to predict the time of future reward as behaviorally experienced in the past. These reward-timing responses exhibit significant heterogeneity in at least three qualitatively distinct classes: sustained increase or sustained decrease in firing rate until the time of expected reward, and a class of cells that reach a peak in firing at the expected delay. We elaborate upon our existing model by including inhibitory and excitatory units while imposing simple connectivity rules to demonstrate what role these inhibitory elements and the simple architectures play in sculpting the response dynamics of the network. We find that simply adding inhibition is not sufficient for obtaining the different distinct response classes, and that a broad distribution of inhibitory projections is necessary for obtaining peak-type responses. Furthermore, although changes in connection strength that modulate the effects of inhibition onto excitatory units have a strong impact on the firing rate profile of these peaked responses, the network exhibits robustness in its overall ability to predict the expected time of reward. Finally, we demonstrate how the magnitude of expected reward can be encoded at the expected delay in the network and how peaked responses express this reward expectancy. Heterogeneity in single-neuron responses is a common feature of neuronal systems, although sometimes, in theoretical approaches, it is treated as a nuisance and seldom considered as conveying a different aspect of a signal. In this study, we focus on the heterogeneous responses in the primary visual cortex of rodents trained with a predictable delayed reward time. We describe under what

  8. A Simple Network Architecture Accounts for Diverse Reward Time Responses in Primary Visual Cortex

    PubMed Central

    Hussain Shuler, Marshall G.; Shouval, Harel Z.

    2015-01-01

    Many actions performed by animals and humans depend on an ability to learn, estimate, and produce temporal intervals of behavioral relevance. Exemplifying such learning of cued expectancies is the observation of reward-timing activity in the primary visual cortex (V1) of rodents, wherein neural responses to visual cues come to predict the time of future reward as behaviorally experienced in the past. These reward-timing responses exhibit significant heterogeneity in at least three qualitatively distinct classes: sustained increase or sustained decrease in firing rate until the time of expected reward, and a class of cells that reach a peak in firing at the expected delay. We elaborate upon our existing model by including inhibitory and excitatory units while imposing simple connectivity rules to demonstrate what role these inhibitory elements and the simple architectures play in sculpting the response dynamics of the network. We find that simply adding inhibition is not sufficient for obtaining the different distinct response classes, and that a broad distribution of inhibitory projections is necessary for obtaining peak-type responses. Furthermore, although changes in connection strength that modulate the effects of inhibition onto excitatory units have a strong impact on the firing rate profile of these peaked responses, the network exhibits robustness in its overall ability to predict the expected time of reward. Finally, we demonstrate how the magnitude of expected reward can be encoded at the expected delay in the network and how peaked responses express this reward expectancy. SIGNIFICANCE STATEMENT Heterogeneity in single-neuron responses is a common feature of neuronal systems, although sometimes, in theoretical approaches, it is treated as a nuisance and seldom considered as conveying a different aspect of a signal. In this study, we focus on the heterogeneous responses in the primary visual cortex of rodents trained with a predictable delayed reward time

  9. Oscillatory activity in the basal ganglia and deep brain stimulation.

    PubMed

    Guridi, Jorge; Alegre, Manuel

    2017-01-01

    Over the past 10 years, research into the neurophysiology of the basal ganglia has provided new insights into the pathophysiology of movement disorders. The presence of pathological oscillations at specific frequencies has been linked to different signs and symptoms in PD and dystonia, suggesting a new model to explain basal ganglia dysfunction. These advances occurred in parallel with improvements in imaging and neurosurgical techniques, both of which having facilitated the more widespread use of DBS to modulate dysfunctional circuits. High-frequency stimulation is thought to disrupt pathological activity in the motor cortex/basal ganglia network; however, it is not easy to explain all of its effects based only on changes in network oscillations. In this viewpoint, we suggest that a return to classic anatomical concepts might help to understand some apparently paradoxical findings. © 2016 International Parkinson and Movement Disorder Society. © 2016 International Parkinson and Movement Disorder Society.

  10. Learning to Select Actions with Spiking Neurons in the Basal Ganglia

    PubMed Central

    Stewart, Terrence C.; Bekolay, Trevor; Eliasmith, Chris

    2012-01-01

    We expand our existing spiking neuron model of decision making in the cortex and basal ganglia to include local learning on the synaptic connections between the cortex and striatum, modulated by a dopaminergic reward signal. We then compare this model to animal data in the bandit task, which is used to test rodent learning in conditions involving forced choice under rewards. Our results indicate a good match in terms of both behavioral learning results and spike patterns in the ventral striatum. The model successfully generalizes to learning the utilities of multiple actions, and can learn to choose different actions in different states. The purpose of our model is to provide both high-level behavioral predictions and low-level spike timing predictions while respecting known neurophysiology and neuroanatomy. PMID:22319465

  11. A review of reward processing and motivational impairment in schizophrenia.

    PubMed

    Strauss, Gregory P; Waltz, James A; Gold, James M

    2014-03-01

    This article reviews and synthesizes research on reward processing in schizophrenia, which has begun to provide important insights into the cognitive and neural mechanisms associated with motivational impairments. Aberrant cortical-striatal interactions may be involved with multiple reward processing abnormalities, including: (1) dopamine-mediated basal ganglia systems that support reinforcement learning and the ability to predict cues that lead to rewarding outcomes; (2) orbitofrontal cortex-driven deficits in generating, updating, and maintaining value representations; (3) aberrant effort-value computations, which may be mediated by disrupted anterior cingulate cortex and midbrain dopamine functioning; and (4) altered activation of the prefrontal cortex, which is important for generating exploratory behaviors in environments where reward outcomes are uncertain. It will be important for psychosocial interventions targeting negative symptoms to account for abnormalities in each of these reward processes, which may also have important interactions; suggestions for novel behavioral intervention strategies that make use of external cues, reinforcers, and mobile technology are discussed.

  12. Basal Ganglia Circuits as Targets for Neuromodulation in Parkinson Disease.

    PubMed

    DeLong, Mahlon R; Wichmann, Thomas

    2015-11-01

    The revival of stereotactic surgery for Parkinson disease (PD) in the 1990s, with pallidotomy and then with high-frequency deep brain stimulation (DBS), has led to a renaissance in functional surgery for movement and other neuropsychiatric disorders. To examine the scientific foundations and rationale for the use of ablation and DBS for treatment of neurologic and psychiatric diseases, using PD as the primary example. A summary of the large body of relevant literature is presented on anatomy, physiology, pathophysiology, and functional surgery for PD and other basal ganglia disorders. The signs and symptoms of movement disorders appear to result largely from signature abnormalities in one of several parallel and largely segregated basal ganglia thalamocortical circuits (ie, the motor circuit). The available evidence suggests that the varied movement disorders resulting from dysfunction of this circuit result from propagated disruption of downstream network activity in the thalamus, cortex, and brainstem. Ablation and DBS act to free downstream networks to function more normally. The basal ganglia thalamocortical circuit may play a key role in the expression of disordered movement, and the basal ganglia-brainstem projections may play roles in akinesia and disturbances of gait. Efforts are under way to target circuit dysfunction in brain areas outside of the traditionally implicated basal ganglia thalamocortical system, in particular, the pedunculopontine nucleus, to address gait disorders that respond poorly to levodopa and conventional DBS targets. Deep brain stimulation is now the treatment of choice for many patients with advanced PD and other movement disorders. The success of DBS and other forms of neuromodulation for neuropsychiatric disorders is the result of the ability to modulate circuit activity in discrete functional domains within the basal ganglia circuitry with highly focused interventions, which spare uninvolved areas that are often disrupted with

  13. A biophysical model of the cortex-basal ganglia-thalamus network in the 6-OHDA lesioned rat model of Parkinson's disease.

    PubMed

    Kumaravelu, Karthik; Brocker, David T; Grill, Warren M

    2016-04-01

    Electrical stimulation of sub-cortical brain regions (the basal ganglia), known as deep brain stimulation (DBS), is an effective treatment for Parkinson's disease (PD). Chronic high frequency (HF) DBS in the subthalamic nucleus (STN) or globus pallidus interna (GPi) reduces motor symptoms including bradykinesia and tremor in patients with PD, but the therapeutic mechanisms of DBS are not fully understood. We developed a biophysical network model comprising of the closed loop cortical-basal ganglia-thalamus circuit representing the healthy and parkinsonian rat brain. The network properties of the model were validated by comparing responses evoked in basal ganglia (BG) nuclei by cortical (CTX) stimulation to published experimental results. A key emergent property of the model was generation of low-frequency network oscillations. Consistent with their putative pathological role, low-frequency oscillations in model BG neurons were exaggerated in the parkinsonian state compared to the healthy condition. We used the model to quantify the effectiveness of STN DBS at different frequencies in suppressing low-frequency oscillatory activity in GPi. Frequencies less than 40 Hz were ineffective, low-frequency oscillatory power decreased gradually for frequencies between 50 Hz and 130 Hz, and saturated at frequencies higher than 150 Hz. HF STN DBS suppressed pathological oscillations in GPe/GPi both by exciting and inhibiting the firing in GPe/GPi neurons, and the number of GPe/GPi neurons influenced was greater for HF stimulation than low-frequency stimulation. Similar to the frequency dependent suppression of pathological oscillations, STN DBS also normalized the abnormal GPi spiking activity evoked by CTX stimulation in a frequency dependent fashion with HF being the most effective. Therefore, therapeutic HF STN DBS effectively suppresses pathological activity by influencing the activity of a greater proportion of neurons in the output nucleus of the BG.

  14. Basal ganglia, movement disorders and deep brain stimulation: advances made through non-human primate research.

    PubMed

    Wichmann, Thomas; Bergman, Hagai; DeLong, Mahlon R

    2018-03-01

    Studies in non-human primates (NHPs) have led to major advances in our understanding of the function of the basal ganglia and of the pathophysiologic mechanisms of hypokinetic movement disorders such as Parkinson's disease and hyperkinetic disorders such as chorea and dystonia. Since the brains of NHPs are anatomically very close to those of humans, disease states and the effects of medical and surgical approaches, such as deep brain stimulation (DBS), can be more faithfully modeled in NHPs than in other species. According to the current model of the basal ganglia circuitry, which was strongly influenced by studies in NHPs, the basal ganglia are viewed as components of segregated networks that emanate from specific cortical areas, traverse the basal ganglia, and ventral thalamus, and return to the frontal cortex. Based on the presumed functional domains of the different cortical areas involved, these networks are designated as 'motor', 'oculomotor', 'associative' and 'limbic' circuits. The functions of these networks are strongly modulated by the release of dopamine in the striatum. Striatal dopamine release alters the activity of striatal projection neurons which, in turn, influences the (inhibitory) basal ganglia output. In parkinsonism, the loss of striatal dopamine results in the emergence of oscillatory burst patterns of firing of basal ganglia output neurons, increased synchrony of the discharge of neighboring basal ganglia neurons, and an overall increase in basal ganglia output. The relevance of these findings is supported by the demonstration, in NHP models of parkinsonism, of the antiparkinsonian effects of inactivation of the motor circuit at the level of the subthalamic nucleus, one of the major components of the basal ganglia. This finding also contributed strongly to the revival of the use of surgical interventions to treat patients with Parkinson's disease. While ablative procedures were first used for this purpose, they have now been largely

  15. Investigating Synchronous Oscillation and Deep Brain Stimulation Treatment in A Model of Cortico-Basal Ganglia Network.

    PubMed

    Lu, Meili; Wei, Xile; Loparo, Kenneth A

    2017-11-01

    Altered firing properties and increased pathological oscillations in the basal ganglia have been proven to be hallmarks of Parkinson's disease (PD). Increasing evidence suggests that abnormal synchronous oscillations and suppression in the cortex may also play a critical role in the pathogenic process and treatment of PD. In this paper, a new closed-loop network including the cortex and basal ganglia using the Izhikevich models is proposed to investigate the synchrony and pathological oscillations in motor circuits and their modulation by deep brain stimulation (DBS). Results show that more coherent dynamics in the cortex may cause stronger effects on the synchrony and pathological oscillations of the subthalamic nucleus (STN). The pathological beta oscillations of the STN can both be efficiently suppressed with DBS applied directly to the STN or to cortical neurons, respectively, but the underlying mechanisms by which DBS suppresses the beta oscillations are different. This research helps to understand the dynamics of pathological oscillations in PD-related motor regions and supports the therapeutic potential of stimulation of cortical neurons.

  16. Comparing Apples and Oranges: Using Reward-Specific and Reward-General Subjective Value Representation in the Brain

    PubMed Central

    Glimcher, Paul W.

    2011-01-01

    The ability of human subjects to choose between disparate kinds of rewards suggests that the neural circuits for valuing different reward types must converge. Economic theory suggests that these convergence points represent the subjective values (SVs) of different reward types on a common scale for comparison. To examine these hypotheses and to map the neural circuits for reward valuation we had food and water-deprived subjects make risky choices for money, food, and water both in and out of a brain scanner. We found that risk preferences across reward types were highly correlated; the level of risk aversion an individual showed when choosing among monetary lotteries predicted their risk aversion toward food and water. We also found that partially distinct neural networks represent the SVs of monetary and food rewards and that these distinct networks showed specific convergence points. The hypothalamic region mainly represented the SV for food, and the posterior cingulate cortex mainly represented the SV for money. In both the ventromedial prefrontal cortex (vmPFC) and striatum there was a common area representing the SV of both reward types, but only the vmPFC significantly represented the SVs of money and food on a common scale appropriate for choice in our data set. A correlation analysis demonstrated interactions across money and food valuation areas and the common areas in the vmPFC and striatum. This may suggest that partially distinct valuation networks for different reward types converge on a unified valuation network, which enables a direct comparison between different reward types and hence guides valuation and choice. PMID:21994386

  17. Massive Submucosal Ganglia in Colonic Inertia.

    PubMed

    Naemi, Kaveh; Stamos, Michael J; Wu, Mark Li-Cheng

    2018-02-01

    - Colonic inertia is a debilitating form of primary chronic constipation with unknown etiology and diagnostic criteria, often requiring pancolectomy. We have occasionally observed massively enlarged submucosal ganglia containing at least 20 perikarya, in addition to previously described giant ganglia with greater than 8 perikarya, in cases of colonic inertia. These massively enlarged ganglia have yet to be formally recognized. - To determine whether such "massive submucosal ganglia," defined as ganglia harboring at least 20 perikarya, characterize colonic inertia. - We retrospectively reviewed specimens from colectomies of patients with colonic inertia and compared the prevalence of massive submucosal ganglia occurring in this setting to the prevalence of massive submucosal ganglia occurring in a set of control specimens from patients lacking chronic constipation. - Seven of 8 specimens affected by colonic inertia harbored 1 to 4 massive ganglia, for a total of 11 massive ganglia. One specimen lacked massive ganglia but had limited sampling and nearly massive ganglia. Massive ganglia occupied both superficial and deep submucosal plexus. The patient with 4 massive ganglia also had 1 mitotically active giant ganglion. Only 1 massive ganglion occupied the entire set of 10 specimens from patients lacking chronic constipation. - We performed the first, albeit distinctly small, study of massive submucosal ganglia and showed that massive ganglia may be linked to colonic inertia. Further, larger studies are necessary to determine whether massive ganglia are pathogenetic or secondary phenomena, and whether massive ganglia or mitotically active ganglia distinguish colonic inertia from other types of chronic constipation.

  18. Focal expression of mutant huntingtin in the songbird basal ganglia disrupts cortico-basal ganglia networks and vocal sequences

    PubMed Central

    Tanaka, Masashi; Singh Alvarado, Jonnathan; Murugan, Malavika; Mooney, Richard

    2016-01-01

    The basal ganglia (BG) promote complex sequential movements by helping to select elementary motor gestures appropriate to a given behavioral context. Indeed, Huntington’s disease (HD), which causes striatal atrophy in the BG, is characterized by hyperkinesia and chorea. How striatal cell loss alters activity in the BG and downstream motor cortical regions to cause these disorganized movements remains unknown. Here, we show that expressing the genetic mutation that causes HD in a song-related region of the songbird BG destabilizes syllable sequences and increases overall vocal activity, but leave the structure of individual syllables intact. These behavioral changes are paralleled by the selective loss of striatal neurons and reduction of inhibitory synapses on pallidal neurons that serve as the BG output. Chronic recordings in singing birds revealed disrupted temporal patterns of activity in pallidal neurons and downstream cortical neurons. Moreover, reversible inactivation of the cortical neurons rescued the disorganized vocal sequences in transfected birds. These findings shed light on a key role of temporal patterns of cortico-BG activity in the regulation of complex motor sequences and show how a genetic mutation alters cortico-BG networks to cause disorganized movements. PMID:26951661

  19. Application research of Ganglia in Hadoop monitoring and management

    NASA Astrophysics Data System (ADS)

    Li, Gang; Ding, Jing; Zhou, Lixia; Yang, Yi; Liu, Lei; Wang, Xiaolei

    2017-03-01

    There are many applications of Hadoop System in the field of large data, cloud computing. The test bench of storage and application in seismic network at Earthquake Administration of Tianjin use with Hadoop system, which is used the open source software of Ganglia to operate and monitor. This paper reviews the function, installation and configuration process, application effect of operating and monitoring in Hadoop system of the Ganglia system. It briefly introduces the idea and effect of Nagios software monitoring Hadoop system. It is valuable for the industry in the monitoring system of cloud computing platform.

  20. Effects of emotional preferences on value-based decision making are mediated by mentalizing not reward networks

    PubMed Central

    Evans, Simon; Fleming, Stephen M.; Dolan, Raymond J.; Averbeck, Bruno B.

    2012-01-01

    Real-world decision-making often involves social considerations. Consequently, the social value of stimuli can induce preferences in choice behavior. However, it is unknown how financial and social values are integrated in the brain. Here, we investigated how smiling and angry face stimuli interacted with financial reward feedback in a stochastically-rewarded decision-making task. Subjects reliably preferred the smiling faces despite equivalent reward feedback, demonstrating a socially driven bias. We fit a Bayesian reinforcement learning model to factor the effects of financial rewards and emotion preferences in individual subjects, and regressed model predictions on the trial-by-trial fMRI signal. Activity in the sub-callosal cingulate and the ventral striatum, both involved in reward learning, correlated with financial reward feedback, whereas the differential contribution of social value activated dorsal temporo-parietal junction and dorsal anterior cingulate cortex, previously proposed as components of a mentalizing network. We conclude that the impact of social stimuli on value-based decision processes is mediated by effects in brain regions partially separable from classical reward circuitry. PMID:20946058

  1. Decision making under uncertainty in a spiking neural network model of the basal ganglia.

    PubMed

    Héricé, Charlotte; Khalil, Radwa; Moftah, Marie; Boraud, Thomas; Guthrie, Martin; Garenne, André

    2016-12-01

    The mechanisms of decision-making and action selection are generally thought to be under the control of parallel cortico-subcortical loops connecting back to distinct areas of cortex through the basal ganglia and processing motor, cognitive and limbic modalities of decision-making. We have used these properties to develop and extend a connectionist model at a spiking neuron level based on a previous rate model approach. This model is demonstrated on decision-making tasks that have been studied in primates and the electrophysiology interpreted to show that the decision is made in two steps. To model this, we have used two parallel loops, each of which performs decision-making based on interactions between positive and negative feedback pathways. This model is able to perform two-level decision-making as in primates. We show here that, before learning, synaptic noise is sufficient to drive the decision-making process and that, after learning, the decision is based on the choice that has proven most likely to be rewarded. The model is then submitted to lesion tests, reversal learning and extinction protocols. We show that, under these conditions, it behaves in a consistent manner and provides predictions in accordance with observed experimental data.

  2. Neural Networks Involved in Adolescent Reward Processing: An Activation Likelihood Estimation Meta-Analysis of Functional Neuroimaging Studies

    PubMed Central

    Silverman, Merav H.; Jedd, Kelly; Luciana, Monica

    2015-01-01

    Behavioral responses to, and the neural processing of, rewards change dramatically during adolescence and may contribute to observed increases in risk-taking during this developmental period. Functional MRI (fMRI) studies suggest differences between adolescents and adults in neural activation during reward processing, but findings are contradictory, and effects have been found in non-predicted directions. The current study uses an activation likelihood estimation (ALE) approach for quantitative meta-analysis of functional neuroimaging studies to: 1) confirm the network of brain regions involved in adolescents’ reward processing, 2) identify regions involved in specific stages (anticipation, outcome) and valence (positive, negative) of reward processing, and 3) identify differences in activation likelihood between adolescent and adult reward-related brain activation. Results reveal a subcortical network of brain regions involved in adolescent reward processing similar to that found in adults with major hubs including the ventral and dorsal striatum, insula, and posterior cingulate cortex (PCC). Contrast analyses find that adolescents exhibit greater likelihood of activation in the insula while processing anticipation relative to outcome and greater likelihood of activation in the putamen and amygdala during outcome relative to anticipation. While processing positive compared to negative valence, adolescents show increased likelihood for activation in the posterior cingulate cortex (PCC) and ventral striatum. Contrasting adolescent reward processing with the existing ALE of adult reward processing (Liu et al., 2011) reveals increased likelihood for activation in limbic, frontolimbic, and striatal regions in adolescents compared with adults. Unlike adolescents, adults also activate executive control regions of the frontal and parietal lobes. These findings support hypothesized elevations in motivated activity during adolescence. PMID:26254587

  3. Simulation of cortico-basal ganglia oscillations and their suppression by closed loop deep brain stimulation.

    PubMed

    Grant, Peadar F; Lowery, Madeleine M

    2013-07-01

    A new model of deep brain stimulation (DBS) is presented that integrates volume conduction effects with a neural model of pathological beta-band oscillations in the cortico-basal ganglia network. The model is used to test the clinical hypothesis that closed-loop control of the amplitude of DBS may be possible, based on the average rectified value of beta-band oscillations in the local field potential. Simulation of closed-loop high-frequency DBS was shown to yield energy savings, with the magnitude of the energy saved dependent on the strength of coupling between the subthalamic nucleus and the remainder of the cortico-basal ganglia network. When closed-loop DBS was applied to a strongly coupled cortico-basal ganglia network, the stimulation energy delivered over a 480 s period was reduced by up to 42%. Greater energy reductions were observed for weakly coupled networks, as the stimulation amplitude reduced to zero once the initial desynchronization had occurred. The results provide support for the application of closed-loop high-frequency DBS based on electrophysiological biomarkers.

  4. Deep Brain Stimulation for Movement Disorders of Basal Ganglia Origin: Restoring Function or Functionality?

    PubMed

    Wichmann, Thomas; DeLong, Mahlon R

    2016-04-01

    Deep brain stimulation (DBS) is highly effective for both hypo- and hyperkinetic movement disorders of basal ganglia origin. The clinical use of DBS is, in part, empiric, based on the experience with prior surgical ablative therapies for these disorders, and, in part, driven by scientific discoveries made decades ago. In this review, we consider anatomical and functional concepts of the basal ganglia relevant to our understanding of DBS mechanisms, as well as our current understanding of the pathophysiology of two of the most commonly DBS-treated conditions, Parkinson's disease and dystonia. Finally, we discuss the proposed mechanism(s) of action of DBS in restoring function in patients with movement disorders. The signs and symptoms of the various disorders appear to result from signature disordered activity in the basal ganglia output, which disrupts the activity in thalamocortical and brainstem networks. The available evidence suggests that the effects of DBS are strongly dependent on targeting sensorimotor portions of specific nodes of the basal ganglia-thalamocortical motor circuit, that is, the subthalamic nucleus and the internal segment of the globus pallidus. There is little evidence to suggest that DBS in patients with movement disorders restores normal basal ganglia functions (e.g., their role in movement or reinforcement learning). Instead, it appears that high-frequency DBS replaces the abnormal basal ganglia output with a more tolerable pattern, which helps to restore the functionality of downstream networks.

  5. Robust Representation of Stable Object Values in the Oculomotor Basal Ganglia

    PubMed Central

    Yasuda, Masaharu; Yamamoto, Shinya; Hikosaka, Okihide

    2012-01-01

    Our gaze tends to be directed to objects previously associated with rewards. Such object values change flexibly or remain stable. Here we present evidence that the monkey substantia nigra pars reticulata (SNr) in the basal ganglia represents stable, rather than flexible, object values. After across-day learning of object–reward association, SNr neurons gradually showed a response bias to surprisingly many visual objects: inhibition to high-valued objects and excitation to low-valued objects. Many of these neurons were shown to project to the ipsilateral superior colliculus. This neuronal bias remained intact even after >100 d without further learning. In parallel with the neuronal bias, the monkeys tended to look at high-valued objects. The neuronal and behavioral biases were present even if no value was associated during testing. These results suggest that SNr neurons bias the gaze toward objects that were consistently associated with high values in one’s history. PMID:23175843

  6. Abnormal structural connectivity between the basal ganglia, thalamus, and frontal cortex in patients with disorders of consciousness.

    PubMed

    Weng, Ling; Xie, Qiuyou; Zhao, Ling; Zhang, Ruibin; Ma, Qing; Wang, Junjing; Jiang, Wenjie; He, Yanbin; Chen, Yan; Li, Changhong; Ni, Xiaoxiao; Xu, Qin; Yu, Ronghao; Huang, Ruiwang

    2017-05-01

    Consciousness loss in patients with severe brain injuries is associated with reduced functional connectivity of the default mode network (DMN), fronto-parietal network, and thalamo-cortical network. However, it is still unclear if the brain white matter connectivity between the above mentioned networks is changed in patients with disorders of consciousness (DOC). In this study, we collected diffusion tensor imaging (DTI) data from 13 patients and 17 healthy controls, constructed whole-brain white matter (WM) structural networks with probabilistic tractography. Afterward, we estimated and compared topological properties, and revealed an altered structural organization in the patients. We found a disturbance in the normal balance between segregation and integration in brain structural networks and detected significantly decreased nodal centralities primarily in the basal ganglia and thalamus in the patients. A network-based statistical analysis detected a subnetwork with uniformly significantly decreased structural connections between the basal ganglia, thalamus, and frontal cortex in the patients. Further analysis indicated that along the WM fiber tracts linking the basal ganglia, thalamus, and frontal cortex, the fractional anisotropy was decreased and the radial diffusivity was increased in the patients compared to the controls. Finally, using the receiver operating characteristic method, we found that the structural connections within the NBS-derived component that showed differences between the groups demonstrated high sensitivity and specificity (>90%). Our results suggested that major consciousness deficits in DOC patients may be related to the altered WM connections between the basal ganglia, thalamus, and frontal cortex. Copyright © 2017 Elsevier Ltd. All rights reserved.

  7. Reward, Attention, and HIV-related Risk in HIV+ Individuals

    PubMed Central

    Anderson, Brian A.; Kronemer, Sharif I.; Rilee, Jessica J.; Sacktor, Ned; Marvel, Cherie L.

    2015-01-01

    Human immunodeficiency virus (HIV) is often contracted through engaging in risky reward-motivated behaviors such as needle sharing and unprotected sex. Understanding the factors that make an individual more vulnerable to succumbing to the temptation to engage in these risky behaviors is important to limiting the spread of HIV. One potential source of this vulnerability concerns the degree to which an individual is able to resist paying attention to irrelevant reward information. In the present study, we examine this possible link by characterizing individual differences in value-based attentional bias in a sample of HIV+ individuals with varying histories of risk-taking behavior. Participants learned associations between experimental stimuli and monetary reward outcome. The degree of attentional bias for these reward-associated stimuli, reflected in their ability to capture attention when presented as task-irrelevant distractors, was then assessed both immediately and six months following reward learning. Value-driven attentional capture was related to substance abuse history and non-planning impulsiveness during the time leading up to contraction of HIV as measured via self report. These findings suggest a link between the ability to ignore reward-associated information and prior HIV-related risk-taking behavior. Additionally, particular aspects of HIV-associated neurocognitive disorders were related to attentional bias, including motor deficits commonly associated with HIV-induced damage to the basal ganglia. PMID:26484383

  8. Reward, attention, and HIV-related risk in HIV+ individuals.

    PubMed

    Anderson, Brian A; Kronemer, Sharif I; Rilee, Jessica J; Sacktor, Ned; Marvel, Cherie L

    2016-08-01

    Human immunodeficiency virus (HIV) is often contracted through engaging in risky reward-motivated behaviors such as needle sharing and unprotected sex. Understanding the factors that make an individual more vulnerable to succumbing to the temptation to engage in these risky behaviors is important to limiting the spread of HIV. One potential source of this vulnerability concerns the degree to which an individual is able to resist paying attention to irrelevant reward information. In the present study, we examine this possible link by characterizing individual differences in value-based attentional bias in a sample of HIV+ individuals with varying histories of risk-taking behavior. Participants learned associations between experimental stimuli and monetary reward outcome. The degree of attentional bias for these reward-associated stimuli, reflected in their ability to capture attention when presented as task-irrelevant distractors, was then assessed both immediately and six months following reward learning. Value-driven attentional capture was related to substance abuse history and non-planning impulsiveness during the time leading up to contraction of HIV as measured via self-report. These findings suggest a link between the ability to ignore reward-associated information and prior HIV-related risk-taking behavior. Additionally, particular aspects of HIV-associated neurocognitive disorders were related to attentional bias, including motor deficits commonly associated with HIV-induced damage to the basal ganglia. Copyright © 2015 Elsevier Inc. All rights reserved.

  9. Generalized Orienteering Problem with Resource Dependent Rewards

    DTIC Science & Technology

    2013-02-19

    School, Monterey, California February 19, 2013 Abstract We introduce a generalized Orienteering Problem where, as usual, a vehicle is routed from a ...prescribed start node, through a directed network, to a prescribed destination node, collecting rewards at each node visited, in order to maximize the...total reward along the path. In our generalization, transit on arcs in the network and reward collection at nodes both consume a variable amount of the

  10. The Basal Ganglia-Circa 1982

    NASA Technical Reports Server (NTRS)

    Mehler, William R.

    1981-01-01

    Our review has shown that recent studies with the new anterograde and retrograde axon transport methods have confirmed and extended our knowledge of the projection of the basal ganglia and clarified their sites of origin. They have thrown new light on certain topographic connectional relationships and revealed several new reciprocal connections between constituent nuclei of the basal ganglia. Similarly, attention has been drawn to the fact that there have also been many new histochemical techniques introduced in recent years that are now providing regional biochemical overlays for connectional maps of the central nervous system, especially regions in, or interconnecting with, the basal ganglia. However, although these new morphological biochemical maps are very complex and technically highly advanced, our understanding of the function controlled by the basal ganglia still remains primitive. The reader who is interested in some new ideas of the functional aspects of the basal ganglia is directed to Nauta's proposed conceptual reorganization of the basal ganglia telencephalon and to Marsden's more clinically orientated appraisal of the unsolved mysteries of the basal ganglia participation in the control of movement.

  11. A neural mass model of basal ganglia nuclei simulates pathological beta rhythm in Parkinson's disease

    NASA Astrophysics Data System (ADS)

    Liu, Fei; Wang, Jiang; Liu, Chen; Li, Huiyan; Deng, Bin; Fietkiewicz, Chris; Loparo, Kenneth A.

    2016-12-01

    An increase in beta oscillations within the basal ganglia nuclei has been shown to be associated with movement disorder, such as Parkinson's disease. The motor cortex and an excitatory-inhibitory neuronal network composed of the subthalamic nucleus (STN) and the external globus pallidus (GPe) are thought to play an important role in the generation of these oscillations. In this paper, we propose a neuron mass model of the basal ganglia on the population level that reproduces the Parkinsonian oscillations in a reciprocal excitatory-inhibitory network. Moreover, it is shown that the generation and frequency of these pathological beta oscillations are varied by the coupling strength and the intrinsic characteristics of the basal ganglia. Simulation results reveal that increase of the coupling strength induces the generation of the beta oscillation, as well as enhances the oscillation frequency. However, for the intrinsic properties of each nucleus in the excitatory-inhibitory network, the STN primarily influences the generation of the beta oscillation while the GPe mainly determines its frequency. Interestingly, describing function analysis applied on this model theoretically explains the mechanism of pathological beta oscillations.

  12. Imaging basal ganglia function

    PubMed Central

    BROOKS, DAVID J.

    2000-01-01

    In this review, the value of functional imaging for providing insight into the role of the basal ganglia in motor control is reviewed. Brain activation findings in normal subjects and Parkinson's disease patients are examined and evidence supporting the existence for functionally independent distributed basal ganglia-frontal loops is presented. It is argued that the basal ganglia probably act to focus and filter cortical output, optimising the running of motor programs. PMID:10923986

  13. Obesity is marked by distinct functional connectivity in brain networks involved in food reward and salience.

    PubMed

    Wijngaarden, M A; Veer, I M; Rombouts, S A R B; van Buchem, M A; Willems van Dijk, K; Pijl, H; van der Grond, J

    2015-01-01

    We hypothesized that brain circuits involved in reward and salience respond differently to fasting in obese versus lean individuals. We compared functional connectivity networks related to food reward and saliency after an overnight fast (baseline) and after a prolonged fast of 48 h in lean versus obese subjects. We included 13 obese (2 males, 11 females, BMI 35.4 ± 1.2 kg/m(2), age 31 ± 3 years) and 11 lean subjects (2 males, 9 females, BMI 23.2 ± 0.5 kg/m(2), age 28 ± 3 years). Resting-state functional magnetic resonance imaging scans were made after an overnight fast (baseline) and after a prolonged 48 h fast. Functional connectivity of the amygdala, hypothalamus and posterior cingulate cortex (default-mode) networks was assessed using seed-based correlations. At baseline, we found a stronger connectivity between hypothalamus and left insula in the obese subjects. This effect diminished upon the prolonged fast. After prolonged fasting, connectivity of the hypothalamus with the dorsal anterior cingulate cortex (dACC) increased in lean subjects and decreased in obese subjects. Amygdala connectivity with the ventromedial prefrontal cortex was stronger in lean subjects at baseline, which did not change upon the prolonged fast. No differences in posterior cingulate cortex connectivity were observed. In conclusion, obesity is marked by alterations in functional connectivity networks involved in food reward and salience. Prolonged fasting differentially affected hypothalamic connections with the dACC and the insula between obese and lean subjects. Our data support the idea that food reward and nutrient deprivation are differently perceived and/or processed in obesity. Copyright © 2015 Elsevier B.V. All rights reserved.

  14. The many worlds hypothesis of dopamine prediction error: implications of a parallel circuit architecture in the basal ganglia.

    PubMed

    Lau, Brian; Monteiro, Tiago; Paton, Joseph J

    2017-10-01

    Computational models of reinforcement learning (RL) strive to produce behavior that maximises reward, and thus allow software or robots to behave adaptively [1]. At the core of RL models is a learned mapping between 'states'-situations or contexts that an agent might encounter in the world-and actions. A wealth of physiological and anatomical data suggests that the basal ganglia (BG) is important for learning these mappings [2,3]. However, the computations performed by specific circuits are unclear. In this brief review, we highlight recent work concerning the anatomy and physiology of BG circuits that suggest refinements in our understanding of computations performed by the basal ganglia. We focus on one important component of basal ganglia circuitry, midbrain dopamine neurons, drawing attention to data that has been cast as supporting or departing from the RL framework that has inspired experiments in basal ganglia research over the past two decades. We suggest that the parallel circuit architecture of the BG might be expected to produce variability in the response properties of different dopamine neurons, and that variability in response profile may not reflect variable functions, but rather different arguments that serve as inputs to a common function: the computation of prediction error. Copyright © 2017 Elsevier Ltd. All rights reserved.

  15. Real-time simulation of a spiking neural network model of the basal ganglia circuitry using general purpose computing on graphics processing units.

    PubMed

    Igarashi, Jun; Shouno, Osamu; Fukai, Tomoki; Tsujino, Hiroshi

    2011-11-01

    Real-time simulation of a biologically realistic spiking neural network is necessary for evaluation of its capacity to interact with real environments. However, the real-time simulation of such a neural network is difficult due to its high computational costs that arise from two factors: (1) vast network size and (2) the complicated dynamics of biologically realistic neurons. In order to address these problems, mainly the latter, we chose to use general purpose computing on graphics processing units (GPGPUs) for simulation of such a neural network, taking advantage of the powerful computational capability of a graphics processing unit (GPU). As a target for real-time simulation, we used a model of the basal ganglia that has been developed according to electrophysiological and anatomical knowledge. The model consists of heterogeneous populations of 370 spiking model neurons, including computationally heavy conductance-based models, connected by 11,002 synapses. Simulation of the model has not yet been performed in real-time using a general computing server. By parallelization of the model on the NVIDIA Geforce GTX 280 GPU in data-parallel and task-parallel fashion, faster-than-real-time simulation was robustly realized with only one-third of the GPU's total computational resources. Furthermore, we used the GPU's full computational resources to perform faster-than-real-time simulation of three instances of the basal ganglia model; these instances consisted of 1100 neurons and 33,006 synapses and were synchronized at each calculation step. Finally, we developed software for simultaneous visualization of faster-than-real-time simulation output. These results suggest the potential power of GPGPU techniques in real-time simulation of realistic neural networks. Copyright © 2011 Elsevier Ltd. All rights reserved.

  16. [Anti-basal ganglia antibody].

    PubMed

    Hayashi, Masaharu

    2013-04-01

    Sydenham's chorea (SC) is a major manifestation of rheumatic fever, and the production of anti-basal ganglia antibodies (ABGA) has been proposed in SC. The pathogenesis is hypothesized as autoimmune targeting of the basal ganglia via molecular mimicry, triggered by streptococcal infection. The spectrum of diseases in which ABGA may be involved has been broadened to include other extrapyramidal movement disorders, such as tics, dystonia, and Parkinsonism, as well as other psychiatric disorders. The autoimmune hypothesis in the presence and absence of ABGA has been suggested in Tourette's syndrome (TS), early onset obsessive-compulsive disorders (OCD), and pediatric autoimmune neuropsychiatric disorders associated with streptococcal infections (PANDAS). Recently, the relationship between ABGA and dopamine neurons in the basal ganglia has been examined, and autoantibodies against dopamine receptors were detected in the sera from patients with basal ganglia encephalitis. In Japan, the occurrence of subacute encephalitis, where patients suffer from episodes of altered behavior and involuntary movements, has increased. Immune-modulating treatments are effective, indicating the involvement of an autoimmune mechanism. We aimed to detect the anti-neuronal autoantibodies in such encephalitis, using immunohistochemical assessment of patient sera. The sera from patients showing involuntary movements had immunoreactivity for basal ganglia neurons. Further epitopes for ABGA will be investigated in basal ganglia disorders other than SC, TS, OCD, and PANDAS.

  17. Interaction of oscillations, and their suppression via deep brain stimulation, in a model of the cortico-basal ganglia network.

    PubMed

    Kang, Guiyeom; Lowery, Madeleine M

    2013-03-01

    Growing evidence suggests that synchronized neural oscillations in the cortico-basal ganglia network may play a critical role in the pathophysiology of Parkinson's disease. In this study, a new model of the closed loop network is used to explore the generation and interaction of network oscillations and their suppression through deep brain stimulation (DBS). Under simulated dopamine depletion conditions, increased gain through the hyperdirect pathway resulted in the interaction of neural oscillations at different frequencies in the cortex and subthalamic nucleus (STN), leading to the emergence of synchronized oscillations at a new intermediate frequency. Further increases in synaptic gain resulted in the cortex driving synchronous oscillatory activity throughout the network. When DBS was added to the model a progressive reduction in STN power at the tremor and beta frequencies was observed as the frequency of stimulation was increased, with resonance effects occurring for low frequency DBS (40 Hz) in agreement with experimental observations. The results provide new insights into the mechanisms by which synchronous oscillations can arise within the network and how DBS may suppress unwanted oscillatory activity.

  18. PreSMA stimulation changes task-free functional connectivity in the fronto-basal-ganglia that correlates with response inhibition efficiency

    PubMed Central

    Xu, Benjamin; Sandrini, Marco; Wang, Wen-tung; Smith, Jason F.; Sarlls, Joelle E.; Awosika, Oluwole; Butman, John A.; Horwitz, Barry; Cohen, Leonardo G.

    2016-01-01

    Previous work using transcranial magnetic stimulation (TMS) demonstrated that the right pre-supplementary motor area (preSMA), a node in the fronto-basal-ganglia network, is critical for response inhibition. However, TMS influences interconnected regions, raising the possibility of a link between the preSMA activity and the functional connectivity within the network. To understand this relationship, we applied single-pulse TMS to the right preSMA during functional magnetic resonance imaging when the subjects were at rest to examine changes in neural activity and functional connectivity within the network in relation to the efficiency of response inhibition evaluated with a stop-signal task. The results showed that preSMA-TMS increased activation in the right inferior-frontal cortex (rIFC) and basal ganglia and modulated their task-free functional connectivity. Both the TMS-induced changes in the basal-ganglia activation and the functional connectivity between rIFC and left striatum, and of the overall network correlated with the efficiency of response inhibition and with the white-matter microstructure along the preSMA – rIFC pathway. These results suggest that the task-free functional and structural connectivity between the rIFCop and basal ganglia are critical to the efficiency of response inhibition. PMID:27144466

  19. External pallidal stimulation improves parkinsonian motor signs and modulates neuronal activity throughout the basal ganglia thalamic network.

    PubMed

    Vitek, Jerrold L; Zhang, Jianyu; Hashimoto, Takao; Russo, Gary S; Baker, Kenneth B

    2012-01-01

    Deep brain stimulation (DBS) of the internal segment of the globus pallidus (GPi) and the subthalamic nucleus (STN) are effective for the treatment of advanced Parkinson's disease (PD). We have shown previously that DBS of the external segment of the globus pallidus (GPe) is associated with improvements in parkinsonian motor signs; however, the mechanism of this effect is not known. In this study, we extend our findings on the effect of STN and GPi DBS on neuronal activity in the basal ganglia thalamic network to include GPe DBS using the 1-methyl-4-phenyl-1.2.3.6-tetrahydropyridine (MPTP) monkey model. Stimulation parameters that improved bradykinesia were associated with changes in the pattern and mean discharge rate of neuronal activity in the GPi, STN, and the pallidal [ventralis lateralis pars oralis (VLo) and ventralis anterior (VA)] and cerebellar [ventralis lateralis posterior pars oralis (VPLo)] receiving areas of the motor thalamus. Population post-stimulation time histograms revealed a complex pattern of stimulation-related inhibition and excitation for the GPi and VA/VLo, with a more consistent pattern of inhibition in STN and excitation in VPLo. Mean discharge rate was reduced in the GPi and STN and increased in the VPLo. Effective GPe DBS also reduced bursting in the STN and GPi. These data support the hypothesis that therapeutic DBS activates output from the stimulated structure and changes the temporal pattern of neuronal activity throughout the basal ganglia thalamic network and provide further support for GPe as a potential therapeutic target for DBS in the treatment of PD. Copyright © 2011 Elsevier Inc. All rights reserved.

  20. Herpes Simplex Virus 1 Reactivates from Autonomic Ciliary Ganglia Independently from Sensory Trigeminal Ganglia To Cause Recurrent Ocular Disease

    PubMed Central

    Lee, Sungseok; Ives, Angela M.

    2015-01-01

    ABSTRACT Herpes simplex virus 1 (HSV-1) and HSV-2 establish latency in sensory and autonomic neurons after ocular or genital infection, but their recurrence patterns differ. HSV-1 reactivates from latency to cause recurrent orofacial disease, and while HSV-1 also causes genital lesions, HSV-2 recurs more efficiently in the genital region and rarely causes ocular disease. The mechanisms regulating these anatomical preferences are unclear. To determine whether differences in latent infection and reactivation in autonomic ganglia contribute to differences in HSV-1 and HSV-2 anatomical preferences for recurrent disease, we compared HSV-1 and HSV-2 clinical disease, acute and latent viral loads, and viral gene expression in sensory trigeminal and autonomic superior cervical and ciliary ganglia in a guinea pig ocular infection model. HSV-2 produced more severe acute disease, correlating with higher viral DNA loads in sensory and autonomic ganglia, as well as higher levels of thymidine kinase expression, a marker of productive infection, in autonomic ganglia. HSV-1 reactivated in ciliary ganglia, independently from trigeminal ganglia, to cause more frequent recurrent symptoms, while HSV-2 replicated simultaneously in autonomic and sensory ganglia to cause more persistent disease. While both HSV-1 and HSV-2 expressed the latency-associated transcript (LAT) in the trigeminal and superior cervical ganglia, only HSV-1 expressed LAT in ciliary ganglia, suggesting that HSV-2 is not reactivation competent or does not fully establish latency in ciliary ganglia. Thus, differences in replication and viral gene expression in autonomic ganglia may contribute to differences in HSV-1 and HSV-2 acute and recurrent clinical disease. IMPORTANCE Herpes simplex virus 1 (HSV-1) and HSV-2 establish latent infections, from which the viruses reactivate to cause recurrent disease throughout the life of the host. However, the viruses exhibit different manifestations and frequencies of recurrent

  1. Dopaminergic control of motivation and reinforcement learning: a closed-circuit account for reward-oriented behavior.

    PubMed

    Morita, Kenji; Morishima, Mieko; Sakai, Katsuyuki; Kawaguchi, Yasuo

    2013-05-15

    Humans and animals take actions quickly when they expect that the actions lead to reward, reflecting their motivation. Injection of dopamine receptor antagonists into the striatum has been shown to slow such reward-seeking behavior, suggesting that dopamine is involved in the control of motivational processes. Meanwhile, neurophysiological studies have revealed that phasic response of dopamine neurons appears to represent reward prediction error, indicating that dopamine plays central roles in reinforcement learning. However, previous attempts to elucidate the mechanisms of these dopaminergic controls have not fully explained how the motivational and learning aspects are related and whether they can be understood by the way the activity of dopamine neurons itself is controlled by their upstream circuitries. To address this issue, we constructed a closed-circuit model of the corticobasal ganglia system based on recent findings regarding intracortical and corticostriatal circuit architectures. Simulations show that the model could reproduce the observed distinct motivational effects of D1- and D2-type dopamine receptor antagonists. Simultaneously, our model successfully explains the dopaminergic representation of reward prediction error as observed in behaving animals during learning tasks and could also explain distinct choice biases induced by optogenetic stimulation of the D1 and D2 receptor-expressing striatal neurons. These results indicate that the suggested roles of dopamine in motivational control and reinforcement learning can be understood in a unified manner through a notion that the indirect pathway of the basal ganglia represents the value of states/actions at a previous time point, an empirically driven key assumption of our model.

  2. Role of Basal Ganglia Circuits in Resisting Interference by Distracters: A swLORETA Study

    PubMed Central

    Bocquillon, Perrine; Bourriez, Jean-Louis; Palmero-Soler, Ernesto; Destée, Alain; Defebvre, Luc; Derambure, Philippe; Dujardin, Kathy

    2012-01-01

    Background The selection of task-relevant information requires both the focalization of attention on the task and resistance to interference from irrelevant stimuli. Both mechanisms rely on a dorsal frontoparietal network, while focalization additionally involves a ventral frontoparietal network. The role of subcortical structures in attention is less clear, despite the fact that the striatum interacts significantly with the frontal cortex via frontostriatal loops. One means of investigating the basal ganglia's contributions to attention is to examine the features of P300 components (i.e. amplitude, latency, and generators) in patients with basal ganglia damage (such as in Parkinson's disease (PD), in which attention is often impaired). Three-stimulus oddball paradigms can be used to study distracter-elicited and target-elicited P300 subcomponents. Methodology/Principal Findings In order to compare distracter- and target-elicited P300 components, high-density (128-channel) electroencephalograms were recorded during a three-stimulus visual oddball paradigm in 15 patients with early PD and 15 matched healthy controls. For each subject, the P300 sources were localized using standardized weighted low-resolution electromagnetic tomography (swLORETA). Comparative analyses (one-sample and two-sample t-tests) were performed using SPM5® software. The swLORETA analyses showed that PD patients displayed fewer dorsolateral prefrontal (DLPF) distracter-P300 generators but no significant differences in target-elicited P300 sources; this suggests dysfunction of the DLPF cortex when the executive frontostriatal loop is disrupted by basal ganglia damage. Conclusions/Significance Our results suggest that the cortical attention frontoparietal networks (mainly the dorsal one) are modulated by the basal ganglia. Disruption of this network in PD impairs resistance to distracters, which results in attention disorders. PMID:22470542

  3. Community-based faculty: motivation and rewards.

    PubMed

    Fulkerson, P K; Wang-Cheng, R

    1997-02-01

    The reasons why practicing physicians precept students in their offices, and the rewards they wish to receive for this work, have not been clearly elucidated. This study determined the reasons for precepting and the rewards expected among a network of preceptors in Milwaukee. A questionnaire was mailed to 120 community-based physician preceptors in a required, third-year ambulatory care clerkship. Respondents were asked to identify why they volunteered and what they considered appropriate recognition or reward. The personal satisfaction derived from the student-teacher interaction was, by far, the most important motivator for preceptors (84%). The most preferred rewards for teaching included clinical faculty appointment, CME and bookstore discounts, computer networking, and workshops for improving skills in clinical teaching. Community-based private physicians who participate in medical student education programs are primarily motivated by the personal satisfaction that they derive from the teaching encounter. An effective preceptor recognition/reward program can be developed using input from the preceptors themselves.

  4. Reward-dependent learning in neuronal networks for planning and decision making.

    PubMed

    Dehaene, S; Changeux, J P

    2000-01-01

    Neuronal network models have been proposed for the organization of evaluation and decision processes in prefrontal circuitry and their putative neuronal and molecular bases. The models all include an implementation and simulation of an elementary reward mechanism. Their central hypothesis is that tentative rules of behavior, which are coded by clusters of active neurons in prefrontal cortex, are selected or rejected based on an evaluation by this reward signal, which may be conveyed, for instance, by the mesencephalic dopaminergic neurons with which the prefrontal cortex is densely interconnected. At the molecular level, the reward signal is postulated to be a neurotransmitter such as dopamine, which exerts a global modulatory action on prefrontal synaptic efficacies, either via volume transmission or via targeted synaptic triads. Negative reinforcement has the effect of destabilizing the currently active rule-coding clusters; subsequently, spontaneous activity varies again from one cluster to another, giving the organism the chance to discover and learn a new rule. Thus, reward signals function as effective selection signals that either maintain or suppress currently active prefrontal representations as a function of their current adequacy. Simulations of this variation-selection have successfully accounted for the main features of several major tasks that depend on prefrontal cortex integrity, such as the delayed-response test, the Wisconsin card sorting test, the Tower of London test and the Stroop test. For the more complex tasks, we have found it necessary to supplement the external reward input with a second mechanism that supplies an internal reward; it consists of an auto-evaluation loop which short-circuits the reward input from the exterior. This allows for an internal evaluation of covert motor intentions without actualizing them as behaviors, by simply testing them covertly by comparison with memorized former experiences. This element of architecture

  5. Neural basis of the undermining effect of monetary reward on intrinsic motivation

    PubMed Central

    Murayama, Kou; Matsumoto, Madoka; Izuma, Keise; Matsumoto, Kenji

    2010-01-01

    Contrary to the widespread belief that people are positively motivated by reward incentives, some studies have shown that performance-based extrinsic reward can actually undermine a person's intrinsic motivation to engage in a task. This “undermining effect” has timely practical implications, given the burgeoning of performance-based incentive systems in contemporary society. It also presents a theoretical challenge for economic and reinforcement learning theories, which tend to assume that monetary incentives monotonically increase motivation. Despite the practical and theoretical importance of this provocative phenomenon, however, little is known about its neural basis. Herein we induced the behavioral undermining effect using a newly developed task, and we tracked its neural correlates using functional MRI. Our results show that performance-based monetary reward indeed undermines intrinsic motivation, as assessed by the number of voluntary engagements in the task. We found that activity in the anterior striatum and the prefrontal areas decreased along with this behavioral undermining effect. These findings suggest that the corticobasal ganglia valuation system underlies the undermining effect through the integration of extrinsic reward value and intrinsic task value. PMID:21078974

  6. Neural basis of the undermining effect of monetary reward on intrinsic motivation.

    PubMed

    Murayama, Kou; Matsumoto, Madoka; Izuma, Keise; Matsumoto, Kenji

    2010-12-07

    Contrary to the widespread belief that people are positively motivated by reward incentives, some studies have shown that performance-based extrinsic reward can actually undermine a person's intrinsic motivation to engage in a task. This "undermining effect" has timely practical implications, given the burgeoning of performance-based incentive systems in contemporary society. It also presents a theoretical challenge for economic and reinforcement learning theories, which tend to assume that monetary incentives monotonically increase motivation. Despite the practical and theoretical importance of this provocative phenomenon, however, little is known about its neural basis. Herein we induced the behavioral undermining effect using a newly developed task, and we tracked its neural correlates using functional MRI. Our results show that performance-based monetary reward indeed undermines intrinsic motivation, as assessed by the number of voluntary engagements in the task. We found that activity in the anterior striatum and the prefrontal areas decreased along with this behavioral undermining effect. These findings suggest that the corticobasal ganglia valuation system underlies the undermining effect through the integration of extrinsic reward value and intrinsic task value.

  7. PreSMA stimulation changes task-free functional connectivity in the fronto-basal-ganglia that correlates with response inhibition efficiency.

    PubMed

    Xu, Benjamin; Sandrini, Marco; Wang, Wen-Tung; Smith, Jason F; Sarlls, Joelle E; Awosika, Oluwole; Butman, John A; Horwitz, Barry; Cohen, Leonardo G

    2016-09-01

    Previous work using transcranial magnetic stimulation (TMS) demonstrated that the right presupplementary motor area (preSMA), a node in the fronto-basal-ganglia network, is critical for response inhibition. However, TMS influences interconnected regions, raising the possibility of a link between the preSMA activity and the functional connectivity within the network. To understand this relationship, we applied single-pulse TMS to the right preSMA during functional magnetic resonance imaging when the subjects were at rest to examine changes in neural activity and functional connectivity within the network in relation to the efficiency of response inhibition evaluated with a stop-signal task. The results showed that preSMA-TMS increased activation in the right inferior-frontal cortex (rIFC) and basal ganglia and modulated their task-free functional connectivity. Both the TMS-induced changes in the basal-ganglia activation and the functional connectivity between rIFC and left striatum, and of the overall network correlated with the efficiency of response inhibition and with the white-matter microstructure along the preSMA-rIFC pathway. These results suggest that the task-free functional and structural connectivity between the rIFCop and basal ganglia are critical to the efficiency of response inhibition. Hum Brain Mapp 37:3236-3249, 2016. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

  8. Frontal-striatum dysfunction during reward processing: Relationships to amotivation in schizophrenia.

    PubMed

    Chung, Yu Sun; Barch, Deanna M

    2016-04-01

    Schizophrenia is characterized by deficits of context processing, thought to be related to dorsolateral prefrontal cortex (DLPFC) impairment. Despite emerging evidence suggesting a crucial role of the DLPFC in integrating reward and goal information, we do not know whether individuals with schizophrenia can represent and integrate reward-related context information to modulate cognitive control. To address this question, 36 individuals with schizophrenia (n = 29) or schizoaffective disorder (n = 7) and 27 healthy controls performed a variant of a response conflict task (Padmala & Pessoa, 2011) during fMRI scanning, in both baseline and reward conditions, with monetary incentives on some reward trials. We used a mixed state-item design that allowed us to examine both sustained and transient reward effects on cognitive control. Different from predictions about impaired DLPFC function in schizophrenia, we found an intact pattern of increased sustained DLPFC activity during reward versus baseline blocks in individuals with schizophrenia at a group level but blunted sustained activations in the putamen. Contrary to our predictions, individuals with schizophrenia showed blunted cue-related activations in several regions of the basal ganglia responding to reward-predicting cues. Importantly, as predicted, individual differences in anhedonia/amotivation symptoms severity were significantly associated with reduced sustained DLPFC activation in the same region that showed overall increased activity as a function of reward. These results suggest that individual differences in motivational impairments in schizophrenia may be related to dysfunction of the DLPFC and striatum in motivationally salient situations. (c) 2016 APA, all rights reserved).

  9. Motor functions of the basal ganglia.

    PubMed

    Phillips, J G; Bradshaw, J L; Iansek, R; Chiu, E

    1993-01-01

    A study of movement disorders such as Parkinson's disease and Huntington's disease can provide an indication of the motor functions of the basal ganglia. Basal-ganglia diseases affect voluntary movement and can cause involuntary movement. Deficits are often manifested during the coordination of fine multi-joint movements (e.g., handwriting). The disturbances of motor control (e.g. akinesia, bradykinesia) caused by basal-ganglia disorders are illustrated. Data suggest that the basal ganglia play an important role in the automatic execution of serially ordered complex movements.

  10. The temptation of suicide: striatal gray matter, discounting of delayed rewards, and suicide attempts in late-life depression

    PubMed Central

    Dombrovski, Alexandre Y.; Siegle, Greg J.; Szanto, Katalin; Clark, Luke; Reynolds, Charles F.; Aizenstein, Howard

    2012-01-01

    Background Converging evidence implicates basal ganglia alterations in impulsivity and suicidal behavior. For example, D2/D3 agonists and subthalamic nucleus stimulation in Parkinson’s disease trigger impulse control disorders and possibly suicidal behavior. Further, suicidal behavior has been associated with structural basal ganglia abnormalities. Finally, low-lethality, unplanned suicide attempts are associated with increased discounting of delayed rewards, a behavior dependent upon the striatum. Thus, we tested whether, in late-life depression, changes in the basal ganglia were associated with suicide attempts and with increased delay discounting. Methods Fifty-two persons aged ≥60 underwent extensive clinical and cognitive characterization: 33 with major depression (13 suicide attempters [SA], 20 non-suicidal depressed elderly), and 19 non-depressed controls. Participants had high-resolution T1-weighted MPRAGE MRI scans. Basal ganglia gray matter voxel counts were estimated using atlas-based segmentation, with a highly-deformable automated algorithm. Discounting of delayed rewards was assessed using the Monetary Choice Questionnaire, and delay aversion with the Cambridge Gamble Task. Results SA had lower putamen but not caudate or pallidum gray matter voxel counts, compared to the control groups. This difference persisted after accounting for substance use disorders and possible brain injury from suicide attempts. SA with lower putamen gray matter voxel counts displayed higher delay discounting on the MCQ, but not delay aversion on the CGT. Secondary analyses revealed that SA had lower voxel counts in associative and possibly ventral, but not sensorimotor striatum. Conclusions Our findings, while limited by small sample size and case-control design, suggest that striatal lesions could contribute to suicidal behavior by increasing impulsivity. PMID:21999930

  11. The temptation of suicide: striatal gray matter, discounting of delayed rewards, and suicide attempts in late-life depression.

    PubMed

    Dombrovski, A Y; Siegle, G J; Szanto, K; Clark, L; Reynolds, C F; Aizenstein, H

    2012-06-01

    Converging evidence implicates basal ganglia alterations in impulsivity and suicidal behavior. For example, D2/D3 agonists and subthalamic nucleus stimulation in Parkinson's disease (PD) trigger impulse control disorders and possibly suicidal behavior. Furthermore, suicidal behavior has been associated with structural basal ganglia abnormalities. Finally, low-lethality, unplanned suicide attempts are associated with increased discounting of delayed rewards, a behavior dependent upon the striatum. Thus, we tested whether, in late-life depression, changes in the basal ganglia were associated with suicide attempts and with increased delay discounting. Fifty-two persons aged ≥ 60 years underwent extensive clinical and cognitive characterization: 33 with major depression [13 suicide attempters (SA), 20 non-suicidal depressed elderly] and 19 non-depressed controls. Participants had high-resolution T1-weighted magnetization prepared rapid acquisition gradient-echo (MPRAGE) magnetic resonance imaging (MRI) scans. Basal ganglia gray matter voxel counts were estimated using atlas-based segmentation, with a highly deformable automated algorithm. Discounting of delayed rewards was assessed using the Monetary Choice Questionnaire (MCQ) and delay aversion with the Cambridge Gamble Task (CGT). SA had lower putamen but not caudate or pallidum gray matter voxel counts, compared to the control groups. This difference persisted after accounting for substance use disorders and possible brain injury from suicide attempts. SA with lower putamen gray matter voxel counts displayed higher delay discounting but not delay aversion. Secondary analyses revealed that SA had lower voxel counts in associative and ventral but not sensorimotor striatum. Our findings, although limited by small sample size and the case-control design, suggest that striatal lesions could contribute to suicidal behavior by increasing impulsivity.

  12. Common Dimensional Reward Deficits Across Mood and Psychotic Disorders: A Connectome-Wide Association Study.

    PubMed

    Sharma, Anup; Wolf, Daniel H; Ciric, Rastko; Kable, Joseph W; Moore, Tyler M; Vandekar, Simon N; Katchmar, Natalie; Daldal, Aylin; Ruparel, Kosha; Davatzikos, Christos; Elliott, Mark A; Calkins, Monica E; Shinohara, Russell T; Bassett, Danielle S; Satterthwaite, Theodore D

    2017-07-01

    Anhedonia is central to multiple psychiatric disorders and causes substantial disability. A dimensional conceptualization posits that anhedonia severity is related to a transdiagnostic continuum of reward deficits in specific neural networks. Previous functional connectivity studies related to anhedonia have focused on case-control comparisons in specific disorders, using region-specific seed-based analyses. Here, the authors explore the entire functional connectome in relation to reward responsivity across a population of adults with heterogeneous psychopathology. In a sample of 225 adults from five diagnostic groups (major depressive disorder, N=32; bipolar disorder, N=50; schizophrenia, N=51; psychosis risk, N=39; and healthy control subjects, N=53), the authors conducted a connectome-wide analysis examining the relationship between a dimensional measure of reward responsivity (the reward sensitivity subscale of the Behavioral Activation Scale) and resting-state functional connectivity using multivariate distance-based matrix regression. The authors identified foci of dysconnectivity associated with reward responsivity in the nucleus accumbens, the default mode network, and the cingulo-opercular network. Follow-up analyses revealed dysconnectivity among specific large-scale functional networks and their connectivity with the nucleus accumbens. Reward deficits were associated with decreased connectivity between the nucleus accumbens and the default mode network and increased connectivity between the nucleus accumbens and the cingulo-opercular network. In addition, impaired reward responsivity was associated with default mode network hyperconnectivity and diminished connectivity between the default mode network and the cingulo-opercular network. These results emphasize the centrality of the nucleus accumbens in the pathophysiology of reward deficits and suggest that dissociable patterns of connectivity among large-scale networks are critical to the neurobiology of

  13. Basal ganglia and cerebellar interconnectivity within the human thalamus.

    PubMed

    Pelzer, Esther A; Melzer, Corina; Timmermann, Lars; von Cramon, D Yves; Tittgemeyer, Marc

    2017-01-01

    Basal ganglia and the cerebellum are part of a densely interconnected network. While both subcortical structures process information in basically segregated loops that primarily interact in the neocortex, direct subcortical interaction has been recently confirmed by neuroanatomical studies using viral transneuronal tracers in non-human primate brains. The thalamus is thought to be the main relay station of both projection systems. Yet, our understanding of subcortical basal ganglia and cerebellar interconnectivity within the human thalamus is rather sparse, primarily due to limitation in the acquisition of in vivo tracing. Consequently, we strive to characterize projections of both systems and their potential overlap within the human thalamus by diffusion MRI and tractography. Our analysis revealed a decreasing anterior-to-posterior gradient for pallido-thalamic connections in: (1) the ventral-anterior thalamus, (2) the intralaminar nuclei, and (3) midline regions. Conversely, we found a decreasing posterior-to-anterior gradient for dentato-thalamic projections predominantly in: (1) the ventral-lateral and posterior nucleus; (2) dorsal parts of the intralaminar nuclei and the subparafascicular nucleus, and (3) the medioventral and lateral mediodorsal nucleus. A considerable overlap of connectivity pattern was apparent in intralaminar nuclei and midline regions. Notably, pallidal and cerebellar projections were both hemispherically lateralized to the left thalamus. While strikingly consistent with findings from transneuronal studies in non-human primates as well as with pre-existing anatomical studies on developmentally expressed markers or pathological human brains, our assessment provides distinctive connectional fingerprints that illustrate the anatomical substrate of integrated functional networks between basal ganglia and the cerebellum. Thereby, our findings furnish useful implications for cerebellar contributions to the clinical symptomatology of movement

  14. Earlier adolescent substance use onset predicts stronger connectivity between reward and cognitive control brain networks.

    PubMed

    Weissman, David G; Schriber, Roberta A; Fassbender, Catherine; Atherton, Olivia; Krafft, Cynthia; Robins, Richard W; Hastings, Paul D; Guyer, Amanda E

    2015-12-01

    Early adolescent onset of substance use is a robust predictor of future substance use disorders. We examined the relation between age of substance use initiation and resting state functional connectivity (RSFC) of the core reward processing (nucleus accumbens; NAcc) to cognitive control (prefrontal cortex; PFC) brain networks. Adolescents in a longitudinal study of Mexican-origin youth reported their substance use annually from ages 10 to 16 years. At age 16, 69 adolescents participated in a resting state functional magnetic resonance imaging scan. Seed-based correlational analyses were conducted using regions of interest in bilateral NAcc. The earlier that adolescents initiated substance use, the stronger the connectivity between bilateral NAcc and right dorsolateral PFC, right dorsomedial PFC, right pre-supplementary motor area, right inferior parietal lobule, and left medial temporal gyrus. The regions that demonstrated significant positive linear relationships between the number of adolescent years using substances and connectivity with NAcc are nodes in the right frontoparietal network, which is central to cognitive control. The coupling of reward and cognitive control networks may be a mechanism through which earlier onset of substance use is related to brain function over time, a trajectory that may be implicated in subsequent substance use disorders. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

  15. Dopamine in motivational control: rewarding, aversive, and alerting

    PubMed Central

    Bromberg-Martin, Ethan S.; Matsumoto, Masayuki; Hikosaka, Okihide

    2010-01-01

    SUMMARY Midbrain dopamine neurons are well known for their strong responses to rewards and their critical role in positive motivation. It has become increasingly clear, however, that dopamine neurons also transmit signals related to salient but non-rewarding experiences such as aversive and alerting events. Here we review recent advances in understanding the reward and non-reward functions of dopamine. Based on this data, we propose that dopamine neurons come in multiple types that are connected with distinct brain networks and have distinct roles in motivational control. Some dopamine neurons encode motivational value, supporting brain networks for seeking, evaluation, and value learning. Others encode motivational salience, supporting brain networks for orienting, cognition, and general motivation. Both types of dopamine neurons are augmented by an alerting signal involved in rapid detection of potentially important sensory cues. We hypothesize that these dopaminergic pathways for value, salience, and alerting cooperate to support adaptive behavior. PMID:21144997

  16. Influence of promised rewards on conflict resolution in healthy participants and patients with Parkinson's disease.

    PubMed

    Houvenaghel, Jean-François; Duprez, Joan; Naudet, Florian; Argaud, Soizic; Dondaine, Thibaut; Drapier, Sophie; Robert, Gabriel Hadrien; Drapier, Dominique; Vérin, Marc; Sauleau, Paul

    2016-08-15

    The influence of promised rewards on conflict resolution processes is not clearly defined in the literature, and the underlying mechanisms are poorly understood. Some studies have shown no effect of reward, while others have demonstrated a beneficial influence. In addition, although the basal ganglia are known to play a critical role in the association between motivation and cognition, the influence of promised rewards on conflict resolution processes in Parkinson's disease (PD) has received little attention. In this context, we assessed the influence of promised rewards on both impulse activation and suppression in 36 healthy participants and 36 patients with PD, using a rewarded Simon task. Analysis of performances revealed that promised rewards worsened the overall congruence effect, but only in healthy participants. Although the incentive context did not modulate the congruence effect in patients, by using the activation-suppression model, we were able to show that promised rewards did influence impulse suppression in patients-but not in healthy participants. Suppressing inappropriate response activation in an incentive context appears to be harder in medically treated Parkinson's disease. This indicates that incentive motivation can modulate at least one cognitive process involved in cognitive action control in patients with medically treated PD. The activation-suppression model provides essential additional information concerning the influence of promised rewards on conflict resolution processes in a pathological population. Copyright © 2016 Elsevier B.V. All rights reserved.

  17. Comparing the neural basis of monetary reward and cognitive feedback during information-integration category learning.

    PubMed

    Daniel, Reka; Pollmann, Stefan

    2010-01-06

    The dopaminergic system is known to play a central role in reward-based learning (Schultz, 2006), yet it was also observed to be involved when only cognitive feedback is given (Aron et al., 2004). Within the domain of information-integration category learning, in which information from several stimulus dimensions has to be integrated predecisionally (Ashby and Maddox, 2005), the importance of contingent feedback is well established (Maddox et al., 2003). We examined the common neural correlates of reward anticipation and prediction error in this task. Sixteen subjects performed two parallel information-integration tasks within a single event-related functional magnetic resonance imaging session but received a monetary reward only for one of them. Similar functional areas including basal ganglia structures were activated in both task versions. In contrast, a single structure, the nucleus accumbens, showed higher activation during monetary reward anticipation compared with the anticipation of cognitive feedback in information-integration learning. Additionally, this activation was predicted by measures of intrinsic motivation in the cognitive feedback task and by measures of extrinsic motivation in the rewarded task. Our results indicate that, although all other structures implicated in category learning are not significantly affected by altering the type of reward, the nucleus accumbens responds to the positive incentive properties of an expected reward depending on the specific type of the reward.

  18. Anatomy of the nerves and ganglia of the aortic plexus in males

    PubMed Central

    Beveridge, Tyler S; Johnson, Marjorie; Power, Adam; Power, Nicholas E; Allman, Brian L

    2015-01-01

    It is well accepted that the aortic plexus is a network of pre- and post-ganglionic nerves overlying the abdominal aorta, which is primarily involved with the sympathetic innervation to the mesenteric, pelvic and urogenital organs. Because a comprehensive anatomical description of the aortic plexus and its connections with adjacent plexuses are lacking, these delicate structures are prone to unintended damage during abdominal surgeries. Through dissection of fresh, frozen human cadavers (n = 7), the present study aimed to provide the first complete mapping of the nerves and ganglia of the aortic plexus in males. Using standard histochemical procedures, ganglia of the aortic plexus were verified through microscopic analysis using haematoxylin & eosin (H&E) and anti-tyrosine hydroxylase stains. All specimens exhibited four distinct sympathetic ganglia within the aortic plexus: the right and left spermatic ganglia, the inferior mesenteric ganglion and one previously unidentified ganglion, which has been named the prehypogastric ganglion by the authors. The spermatic ganglia were consistently supplied by the L1 lumbar splanchnic nerves and the inferior mesenteric ganglion and the newly characterized prehypogastric ganglion were supplied by the left and right L2 lumbar splanchnic nerves, respectively. Additionally, our examination revealed the aortic plexus does have potential for variation, primarily in the possibility of exhibiting accessory splanchnic nerves. Clinically, our results could have significant implications for preserving fertility in men as well as sympathetic function to the hindgut and pelvis during retroperitoneal surgeries. PMID:25382240

  19. Novelty seeking and reward dependence-related large-scale brain networks functional connectivity variation during salience expectancy.

    PubMed

    Li, Shijia; Demenescu, Liliana Ramona; Sweeney-Reed, Catherine M; Krause, Anna Linda; Metzger, Coraline D; Walter, Martin

    2017-08-01

    A salience network (SN) anchored in the anterior insula (AI) and dorsal anterior cingulate cortex (dACC) plays a key role in switching between brain networks during salience detection and attention regulation. Previous fMRI studies have associated expectancy behaviors and SN activation with novelty seeking (NS) and reward dependence (RD) personality traits. To address the question of how functional connectivity (FC) in the SN is modulated by internal (expectancy-related) salience assignment and different personality traits, 68 healthy participants performed a salience expectancy task using functional magnetic resonance imaging, and psychophysiological interaction analysis (PPI) was conducted to determine salience-related connectivity changes during these anticipation periods. Correlation was then evaluated between PPI and personality traits, assessed using the temperament and character inventory of 32 male participants. During high salience expectancy, SN-seed regions showed reduced FC to visual areas and parts of the default mode network, but increased FC to the central executive network. With increasing NS, participants showed significantly increasing disconnection between right AI and middle cingulate cortex when expecting high-salience pictures as compared to low-salience pictures, while increased RD also predicted decreased right dACC and caudate FC for high salience expectancy. Our findings suggest a direct link between personality traits and internal salience processing mediated by differential network integration of the SN. SN activity and coordination may therefore be moderated by novelty seeking and reward dependency personality traits, which are associated with risk of addiction. Hum Brain Mapp 38:4064-4077, 2017. © 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.

  20. Basal Ganglia Beta Oscillations Accompany Cue Utilization

    PubMed Central

    Leventhal, Daniel K.; Gage, Gregory J.; Schmidt, Robert; Pettibone, Jeffrey R.; Case, Alaina C.; Berke, Joshua D.

    2012-01-01

    SUMMARY Beta oscillations in cortical-basal ganglia (BG) circuits have been implicated in normal movement suppression and motor impairment in Parkinson’s disease. To dissect the functional correlates of these rhythms we compared neural activity during four distinct variants of a cued choice task in rats. Brief beta (~20 Hz) oscillations occurred simultaneously throughout the cortical-BG network, both spontaneously and at precise moments of task performance. Beta phase was rapidly reset in response to salient cues, yet increases in beta power were not rigidly linked to cues, movements, or movement suppression. Rather, beta power was enhanced after cues were used to determine motor output. We suggest that beta oscillations reflect a postdecision stabilized state of cortical-BG networks, which normally reduces interference from alternative potential actions. The abnormally strong beta seen in Parkinson’s Disease may reflect overstabilization of these networks, producing pathological persistence of the current motor state. PMID:22325204

  1. Changes in basal ganglia processing of cortical input following magnetic stimulation in Parkinsonism.

    PubMed

    Tischler, Hadass; Moran, Anan; Belelovsky, Katya; Bronfeld, Maya; Korngreen, Alon; Bar-Gad, Izhar

    2012-12-01

    Parkinsonism is associated with major changes in neuronal activity throughout the cortico-basal ganglia loop. Current measures quantify changes in baseline neuronal and network activity but do not capture alterations in information propagation throughout the system. Here, we applied a novel non-invasive magnetic stimulation approach using a custom-made mini-coil that enabled us to study transmission of neuronal activity throughout the cortico-basal ganglia loop in both normal and parkinsonian primates. By magnetically perturbing cortical activity while simultaneously recording neuronal responses along the cortico-basal ganglia loop, we were able to directly investigate modifications in descending cortical activity transmission. We found that in both the normal and parkinsonian states, cortical neurons displayed similar multi-phase firing rate modulations in response to magnetic stimulation. However, in the basal ganglia, large synaptically driven stereotypic neuronal modulation was present in the parkinsonian state that was mostly absent in the normal state. The stimulation-induced neuronal activity pattern highlights the change in information propagation along the cortico-basal ganglia loop. Our findings thus point to the role of abnormal dynamic activity transmission rather than changes in baseline activity as a major component in parkinsonian pathophysiology. Moreover, our results hint that the application of transcranial magnetic stimulation (TMS) in human patients of different disorders may result in different neuronal effects than the one induced in normal subjects. Copyright © 2012 Elsevier Inc. All rights reserved.

  2. Disentangling reward anticipation with simultaneous pupillometry / fMRI.

    PubMed

    Schneider, Max; Leuchs, Laura; Czisch, Michael; Sämann, Philipp G; Spoormaker, Victor I

    2018-05-05

    The reward system may provide an interesting intermediate phenotype for anhedonia in affective disorders. Reward anticipation is characterized by an increase in arousal, and previous studies have linked the anterior cingulate cortex (ACC) to arousal responses such as dilation of the pupil. Here, we examined pupil dynamics during a reward anticipation task in forty-six healthy human subjects and evaluated its neural correlates using functional magnetic resonance imaging (fMRI). Pupil size showed a strong increase during monetary reward anticipation, a moderate increase during verbal reward anticipation and a decrease during control trials. For fMRI analyses, average pupil size and pupil change were computed in 1-s time bins during the anticipation phase. Activity in the ventral striatum was inversely related to the pupil size time course, indicating an early onset of activation and a role in reward prediction processing. Pupil dilations were linked to increased activity in the salience network (dorsal ACC and bilateral insula), which likely triggers an increase in arousal to enhance task performance. Finally, increased pupil size preceding the required motor response was associated with activity in the ventral attention network. In sum, pupillometry provides an effective tool for disentangling different phases of reward anticipation, with relevance for affective symptomatology. Copyright © 2018 Elsevier Inc. All rights reserved.

  3. Neural dynamics of reward probability coding: a Magnetoencephalographic study in humans

    PubMed Central

    Thomas, Julie; Vanni-Mercier, Giovanna; Dreher, Jean-Claude

    2013-01-01

    Prediction of future rewards and discrepancy between actual and expected outcomes (prediction error) are crucial signals for adaptive behavior. In humans, a number of fMRI studies demonstrated that reward probability modulates these two signals in a large brain network. Yet, the spatio-temporal dynamics underlying the neural coding of reward probability remains unknown. Here, using magnetoencephalography, we investigated the neural dynamics of prediction and reward prediction error computations while subjects learned to associate cues of slot machines with monetary rewards with different probabilities. We showed that event-related magnetic fields (ERFs) arising from the visual cortex coded the expected reward value 155 ms after the cue, demonstrating that reward value signals emerge early in the visual stream. Moreover, a prediction error was reflected in ERF peaking 300 ms after the rewarded outcome and showing decreasing amplitude with higher reward probability. This prediction error signal was generated in a network including the anterior and posterior cingulate cortex. These findings pinpoint the spatio-temporal characteristics underlying reward probability coding. Together, our results provide insights into the neural dynamics underlying the ability to learn probabilistic stimuli-reward contingencies. PMID:24302894

  4. Brain activity and infant attachment history in young men during loss and reward processing.

    PubMed

    Quevedo, Karina; Waters, Theodore E A; Scott, Hannah; Roisman, Glenn I; Shaw, Daniel S; Forbes, Erika E

    2017-05-01

    There is now ample evidence that the quality of early attachment experiences shapes expectations for supportive and responsive care and ultimately serves to scaffold adaptation to the salient tasks of development. Nonetheless, few studies have identified neural mechanisms that might give rise to these associations. Using a moderately large sample of low-income male participants recruited during infancy (N = 171), we studied the predictive significance of attachment insecurity and disorganization at age 18 months (as measured in the Strange Situation Procedure) for patterns of neural activation to reward and loss at age 20 years (assessed during a reward-based task as part of a functional magnetic resonance imaging scan). Results indicated that individuals with a history of insecure attachment showed hyperactivity in (a) reward- and emotion-related (e.g., basal ganglia and amygdala) structures and (b) emotion regulation and self-referential processing (cortical midline structures) in response to positive and negative outcomes (and anticipation of those outcomes). Further, the neural activation of individuals with a history of disorganized attachment suggested that they had greater emotional reactivity in anticipation of reward and employed greater cognitive control when negative outcomes were encountered. Overall, results suggest that the quality of early attachments has lasting impacts on brain function and reward processing.

  5. Gender Dimorphism of Brain Reward System Volumes in Alcoholism

    PubMed Central

    Sawyer, Kayle S.; Oscar-Berman, Marlene; Barthelemy, Olivier J.; Papadimitriou, George M.; Harris, Gordon J.; Makris, Nikos

    2017-01-01

    The brain's reward network has been reported to be smaller in alcoholic men compared to nonalcoholic men, but little is known about the volumes of reward regions in alcoholic women. Morphometric analyses were performed on magnetic resonance brain scans of 60 long-term chronic alcoholics (ALC; 30 men) and 60 nonalcoholic controls (NC; 29 men). We derived volumes of total brain, and cortical and subcortical reward-related structures including the dorsolateral prefrontal (DLPFC), orbitofrontal, and cingulate cortices, and the temporal pole, insula, amygdala, hippocampus, nucleus accumbens septi (NAc), and ventral diencephalon (VDC). We examined the relationships of the volumetric findings to drinking history. Analyses revealed a significant gender interaction for the association between alcoholism and total reward network volumes, with ALC men having smaller reward volumes than NC men and ALC women having larger reward volumes than NC women. Analyses of a priori subregions revealed a similar pattern of reward volume differences with significant gender interactions for DLPFC and VDC. Overall, the volume of the cerebral ventricles in ALC participants was negatively associated with duration of abstinence, suggesting decline in atrophy over time. PMID:28285206

  6. Gender dimorphism of brain reward system volumes in alcoholism.

    PubMed

    Sawyer, Kayle S; Oscar-Berman, Marlene; Barthelemy, Olivier J; Papadimitriou, George M; Harris, Gordon J; Makris, Nikos

    2017-05-30

    The brain's reward network has been reported to be smaller in alcoholic men compared to nonalcoholic men, but little is known about the volumes of reward regions in alcoholic women. Morphometric analyses were performed on magnetic resonance brain scans of 60 long-term chronic alcoholics (ALC; 30 men) and 60 nonalcoholic controls (NC; 29 men). We derived volumes of total brain, and cortical and subcortical reward-related structures including the dorsolateral prefrontal (DLPFC), orbitofrontal, and cingulate cortices, and the temporal pole, insula, amygdala, hippocampus, nucleus accumbens septi (NAc), and ventral diencephalon (VDC). We examined the relationships of the volumetric findings to drinking history. Analyses revealed a significant gender interaction for the association between alcoholism and total reward network volumes, with ALC men having smaller reward volumes than NC men and ALC women having larger reward volumes than NC women. Analyses of a priori subregions revealed a similar pattern of reward volume differences with significant gender interactions for DLPFC and VDC. Overall, the volume of the cerebral ventricles in ALC participants was negatively associated with duration of abstinence, suggesting decline in atrophy with greater length of sobriety. Copyright © 2017 Elsevier Ireland Ltd. All rights reserved.

  7. Alterations in neuronal activity in basal ganglia-thalamocortical circuits in the parkinsonian state

    PubMed Central

    Galvan, Adriana; Devergnas, Annaelle; Wichmann, Thomas

    2015-01-01

    In patients with Parkinson’s disease and in animal models of this disorder, neurons in the basal ganglia and related regions in thalamus and cortex show changes that can be recorded by using electrophysiologic single-cell recording techniques, including altered firing rates and patterns, pathologic oscillatory activity and increased inter-neuronal synchronization. In addition, changes in synaptic potentials or in the joint spiking activities of populations of neurons can be monitored as alterations in local field potentials (LFPs), electroencephalograms (EEGs) or electrocorticograms (ECoGs). Most of the mentioned electrophysiologic changes are probably related to the degeneration of diencephalic dopaminergic neurons, leading to dopamine loss in the striatum and other basal ganglia nuclei, although degeneration of non-dopaminergic cell groups may also have a role. The altered electrical activity of the basal ganglia and associated nuclei may contribute to some of the motor signs of the disease. We here review the current knowledge of the electrophysiologic changes at the single cell level, the level of local populations of neural elements, and the level of the entire basal ganglia-thalamocortical network in parkinsonism, and discuss the possible use of this information to optimize treatment approaches to Parkinson’s disease, such as deep brain stimulation (DBS) therapy. PMID:25698937

  8. Basal Ganglia Contributions to Motor Control: A Vigorous Tutor

    PubMed Central

    Turner, Robert S.; Desmurget, Michel

    2010-01-01

    SUMMARY OF RECENT ADVANCES The roles of the basal ganglia (BG) in motor control are much debated. Many influential hypotheses have grown from studies in which output signals of the BG were not blocked, but pathologically-disturbed. A weakness of that approach is that the resulting behavioral impairments reflect degraded function of the BG per se mixed together with secondary dysfunctions of BG-recipient brain areas. To overcome that limitation, several studies have focused on the main skeletomotor output region of the BG, the globus pallidus internus (GPi). Using single-cell recording and inactivation protocols these studies provide consistent support for two hypotheses: the BG modulates movement performance (“vigor”) according to motivational factors (i.e., context-specific cost/reward functions) and the BG contributes to motor learning. Results from these studies also add to the problems that confront theories positing that the BG selects movement, inhibits unwanted motor responses, corrects errors online, or stores and produces well-learned motor skills. PMID:20850966

  9. Using a hybrid neuron in physiologically inspired models of the basal ganglia.

    PubMed

    Thibeault, Corey M; Srinivasa, Narayan

    2013-01-01

    Our current understanding of the basal ganglia (BG) has facilitated the creation of computational models that have contributed novel theories, explored new functional anatomy and demonstrated results complementing physiological experiments. However, the utility of these models extends beyond these applications. Particularly in neuromorphic engineering, where the basal ganglia's role in computation is important for applications such as power efficient autonomous agents and model-based control strategies. The neurons used in existing computational models of the BG, however, are not amenable for many low-power hardware implementations. Motivated by a need for more hardware accessible networks, we replicate four published models of the BG, spanning single neuron and small networks, replacing the more computationally expensive neuron models with an Izhikevich hybrid neuron. This begins with a network modeling action-selection, where the basal activity levels and the ability to appropriately select the most salient input is reproduced. A Parkinson's disease model is then explored under normal conditions, Parkinsonian conditions and during subthalamic nucleus deep brain stimulation (DBS). The resulting network is capable of replicating the loss of thalamic relay capabilities in the Parkinsonian state and its return under DBS. This is also demonstrated using a network capable of action-selection. Finally, a study of correlation transfer under different patterns of Parkinsonian activity is presented. These networks successfully captured the significant results of the originals studies. This not only creates a foundation for neuromorphic hardware implementations but may also support the development of large-scale biophysical models. The former potentially providing a way of improving the efficacy of DBS and the latter allowing for the efficient simulation of larger more comprehensive networks.

  10. Differential coding of reward and movement information in the dorsomedial striatal direct and indirect pathways.

    PubMed

    Shin, Jung Hwan; Kim, Dohoung; Jung, Min Whan

    2018-01-26

    The direct and indirect pathways of the basal ganglia have long been thought to mediate behavioral promotion and inhibition, respectively. However, this classic dichotomous model has been recently challenged. To better understand neural processes underlying reward-based learning and movement control, we recorded from direct (dSPNs) and indirect (iSPNs) pathway spiny projection neurons in the dorsomedial striatum of D1-Cre and D2-Cre mice performing a probabilistic Pavlovian conditioning task. dSPNs tend to increase activity while iSPNs decrease activity as a function of reward value, suggesting the striatum represents value in the relative activity levels of dSPNs versus iSPNs. Lick offset-related activity increase is largely dSPN selective, suggesting dSPN involvement in suppressing ongoing licking behavior. Rapid responses to negative outcome and previous reward-related responses are more frequent among iSPNs than dSPNs, suggesting stronger contributions of iSPNs to outcome-dependent behavioral adjustment. These findings provide new insights into striatal neural circuit operations.

  11. Top-Down Network Effective Connectivity in Abstinent Substance Dependent Individuals

    PubMed Central

    Regner, Michael F.; Saenz, Naomi; Maharajh, Keeran; Yamamoto, Dorothy J.; Mohl, Brianne; Wylie, Korey; Tregellas, Jason; Tanabe, Jody

    2016-01-01

    Objective We hypothesized that compared to healthy controls, long-term abstinent substance dependent individuals (SDI) will differ in their effective connectivity between large-scale brain networks and demonstrate increased directional information from executive control to interoception-, reward-, and habit-related networks. In addition, using graph theory to compare network efficiencies we predicted decreased small-worldness in SDI compared to controls. Methods 50 SDI and 50 controls of similar sex and age completed psychological surveys and resting state fMRI. fMRI results were analyzed using group independent component analysis; 14 networks-of-interest (NOI) were selected using template matching to a canonical set of resting state networks. The number, direction, and strength of connections between NOI were analyzed with Granger Causality. Within-group thresholds were p<0.005 using a bootstrap permutation. Between group thresholds were p<0.05, FDR-corrected for multiple comparisons. NOI were correlated with behavioral measures, and group-level graph theory measures were compared. Results Compared to controls, SDI showed significantly greater Granger causal connectivity from right executive control network (RECN) to dorsal default mode network (dDMN) and from dDMN to basal ganglia network (BGN). RECN was negatively correlated with impulsivity, behavioral approach, and negative affect; dDMN was positively correlated with impulsivity. Among the 14 NOI, SDI showed greater bidirectional connectivity; controls showed more unidirectional connectivity. SDI demonstrated greater global efficiency and lower local efficiency. Conclusions Increased effective connectivity in long-term abstinent drug users may reflect improved cognitive control over habit and reward processes. Higher global and lower local efficiency across all networks in SDI compared to controls may reflect connectivity changes associated with drug dependence or remission and requires future, longitudinal

  12. Role of delay-based reward in the spatial cooperation

    NASA Astrophysics Data System (ADS)

    Wang, Xu-Wen; Nie, Sen; Jiang, Luo-Luo; Wang, Bing-Hong; Chen, Shi-Ming

    2017-01-01

    Strategy selection in games, a typical decision making, usually brings noticeable reward for players which have discounted value if the delay appears. The discounted value is measure: earning sooner with a small reward or later with a delayed larger reward. Here, we investigate effects of delayed rewards on the cooperation in structured population. It is found that delayed reward supports the spreading of cooperation in square lattice, small-world and random networks. In particular, intermediate reward differences between delays impel the highest cooperation level. Interestingly, cooperative individuals with the same delay time steps form clusters to resist the invasion of defects, and cooperative individuals with lowest delay reward survive because they form the largest clusters in the lattice.

  13. Dopamine Depletion Reduces Food-Related Reward Activity Independent of BMI

    PubMed Central

    Frank, Sabine; Veit, Ralf; Sauer, Helene; Enck, Paul; Friederich, Hans-Christoph; Unholzer, Theresa; Bauer, Ute-Maria; Linder, Katarzyna; Heni, Martin; Fritsche, Andreas; Preissl, Hubert

    2016-01-01

    Reward sensitivity and possible alterations in the dopaminergic-reward system are associated with obesity. We therefore aimed to investigate the influence of dopamine depletion on food-reward processing. We investigated 34 female subjects in a randomized placebo-controlled, within-subject design (body mass index (BMI)=27.0 kg/m2 ±4.79 SD; age=28 years ±4.97 SD) using an acute phenylalanine/tyrosine depletion drink representing dopamine depletion and a balanced amino acid drink as the control condition. Brain activity was measured with functional magnetic resonance imaging during a ‘wanting' and ‘liking' rating of food items. Eating behavior-related traits and states were assessed on the basis of questionnaires. Dopamine depletion resulted in reduced activation in the striatum and higher activation in the superior frontal gyrus independent of BMI. Brain activity during the wanting task activated a more distributed network than during the liking task. This network included gustatory, memory, visual, reward, and frontal regions. An interaction effect of dopamine depletion and the wanting/liking task was observed in the hippocampus. The interaction with the covariate BMI was significant in motor and control regions but not in the striatum. Our results support the notion of altered brain activity in the reward and prefrontal network with blunted dopaminergic action during food-reward processing. This effect is, however, independent of BMI, which contradicts the reward-deficiency hypothesis. This hints to the hypothesis suggesting a different or more complex mechanism underlying the dopaminergic reward function in obesity. PMID:26450814

  14. Dopamine homeostasis: brain functional connectivity in reward deficiency syndrome.

    PubMed

    Febo, Marcelo; Blum, Kenneth; Badgaiyan, Rajendra D; Baron, David; Thanos, Panayotis K; Colon-Perez, Luis M; Demortrovics, Zsolt; Gold, Mark S

    2017-01-01

    Reward deficiency syndrome (RDS) was first proposed by Kenneth Blum in 1995 to provide a clinically relevant and predictive term for conditions involving deficits in mesocorticolimbic dopamine function. Genetic, molecular, and neuronal alterations in key components of this circuitry contribute to a reward deficit state that can drive drug-seeking, consumption, and relapse. Among the dysfunctions observed in RDS are dysregulated resting state networks, which recently have been assessed in detail in chronic drug users by, positron emission tomography, functional magnetic resonance imaging, and functional connectivity analysis. A growing number of studies are helping to determine the putative roles of dopamine and glutamatergic neurotransmission in the regulation of activity in resting state networks, particularly in brain reward circuitry affected in drug use disorders. Indeed, we hypothesize in the present review that loss of homeostasis of these systems may lead to 'unbalanced' functional networks that might be both cause and outcome of disrupted synaptic communication between cortical and subcortical systems essential for controlling reward, emotional control, sensation seeking, and chronic drug use.

  15. Neural correlates of RDoC reward constructs in adolescents with diverse psychiatric symptoms: A Reward Flanker Task pilot study.

    PubMed

    Bradley, Kailyn A L; Case, Julia A C; Freed, Rachel D; Stern, Emily R; Gabbay, Vilma

    2017-07-01

    There has been growing interest under the Research Domain Criteria initiative to investigate behavioral constructs and their underlying neural circuitry. Abnormalities in reward processes are salient across psychiatric conditions and may precede future psychopathology in youth. However, the neural circuitry underlying such deficits has not been well defined. Therefore, in this pilot, we studied youth with diverse psychiatric symptoms and examined the neural underpinnings of reward anticipation, attainment, and positive prediction error (PPE, unexpected reward gain). Clinically, we focused on anhedonia, known to reflect deficits in reward function. Twenty-two psychotropic medication-free youth, 16 with psychiatric symptoms, exhibiting a full range of anhedonia, were scanned during the Reward Flanker Task. Anhedonia severity was quantified using the Snaith-Hamilton Pleasure Scale. Functional magnetic resonance imaging analyses were false discovery rate corrected for multiple comparisons. Anticipation activated a broad network, including the medial frontal cortex and ventral striatum, while attainment activated memory and emotion-related regions such as the hippocampus and parahippocampal gyrus, but not the ventral striatum. PPE activated a right-dominant fronto-temporo-parietal network. Anhedonia was only correlated with activation of the right angular gyrus during anticipation and the left precuneus during PPE at an uncorrected threshold. Findings are preliminary due to the small sample size. This pilot characterized the neural circuitry underlying different aspects of reward processing in youth with diverse psychiatric symptoms. These results highlight the complexity of the neural circuitry underlying reward anticipation, attainment, and PPE. Furthermore, this study underscores the importance of RDoC research in youth. Copyright © 2016 Elsevier B.V. All rights reserved.

  16. Evolutionary advantages of adaptive rewarding

    NASA Astrophysics Data System (ADS)

    Szolnoki, Attila; Perc, Matjaž

    2012-09-01

    Our well-being depends on both our personal success and the success of our society. The realization of this fact makes cooperation an essential trait. Experiments have shown that rewards can elevate our readiness to cooperate, but since giving a reward inevitably entails paying a cost for it, the emergence and stability of such behavior remains elusive. Here we show that allowing for the act of rewarding to self-organize in dependence on the success of cooperation creates several evolutionary advantages that instill new ways through which collaborative efforts are promoted. Ranging from indirect territorial battle to the spontaneous emergence and destruction of coexistence, phase diagrams and the underlying spatial patterns reveal fascinatingly rich social dynamics that explain why this costly behavior has evolved and persevered. Comparisons with adaptive punishment, however, uncover an Achilles heel of adaptive rewarding, coming from over-aggression, which in turn hinders optimal utilization of network reciprocity. This may explain why, despite its success, rewarding is not as firmly embedded into our societal organization as punishment.

  17. Rare Neural Correlations Implement Robotic Conditioning with Delayed Rewards and Disturbances

    PubMed Central

    Soltoggio, Andrea; Lemme, Andre; Reinhart, Felix; Steil, Jochen J.

    2013-01-01

    Neural conditioning associates cues and actions with following rewards. The environments in which robots operate, however, are pervaded by a variety of disturbing stimuli and uncertain timing. In particular, variable reward delays make it difficult to reconstruct which previous actions are responsible for following rewards. Such an uncertainty is handled by biological neural networks, but represents a challenge for computational models, suggesting the lack of a satisfactory theory for robotic neural conditioning. The present study demonstrates the use of rare neural correlations in making correct associations between rewards and previous cues or actions. Rare correlations are functional in selecting sparse synapses to be eligible for later weight updates if a reward occurs. The repetition of this process singles out the associating and reward-triggering pathways, and thereby copes with distal rewards. The neural network displays macro-level classical and operant conditioning, which is demonstrated in an interactive real-life human-robot interaction. The proposed mechanism models realistic conditioning in humans and animals and implements similar behaviors in neuro-robotic platforms. PMID:23565092

  18. Effective deep brain stimulation suppresses low-frequency network oscillations in the basal ganglia by regularizing neural firing patterns.

    PubMed

    McConnell, George C; So, Rosa Q; Hilliard, Justin D; Lopomo, Paola; Grill, Warren M

    2012-11-07

    Deep brain stimulation (DBS) of the subthalamic nucleus (STN) is an effective treatment for the motor symptoms of Parkinson's disease (PD). The effects of DBS depend strongly on stimulation frequency: high frequencies (>90 Hz) improve motor symptoms, while low frequencies (<50 Hz) are either ineffective or exacerbate symptoms. The neuronal basis for these frequency-dependent effects of DBS is unclear. The effects of different frequencies of STN-DBS on behavior and single-unit neuronal activity in the basal ganglia were studied in the unilateral 6-hydroxydopamine lesioned rat model of PD. Only high-frequency DBS reversed motor symptoms, and the effectiveness of DBS depended strongly on stimulation frequency in a manner reminiscent of its clinical effects in persons with PD. Quantification of single-unit activity in the globus pallidus externa (GPe) and substantia nigra reticulata (SNr) revealed that high-frequency DBS, but not low-frequency DBS, reduced pathological low-frequency oscillations (∼9 Hz) and entrained neurons to fire at the stimulation frequency. Similarly, the coherence between simultaneously recorded pairs of neurons within and across GPe and SNr shifted from the pathological low-frequency band to the stimulation frequency during high-frequency DBS, but not during low-frequency DBS. The changes in firing patterns in basal ganglia neurons were not correlated with changes in firing rate. These results indicate that high-frequency DBS is more effective than low-frequency DBS, not as a result of changes in firing rate, but rather due to its ability to replace pathological low-frequency network oscillations with a regularized pattern of neuronal firing.

  19. Effective deep brain stimulation suppresses low frequency network oscillations in the basal ganglia by regularizing neural firing patterns

    PubMed Central

    McConnell, George C.; So, Rosa Q.; Hilliard, Justin D; Lopomo, Paola; Grill, Warren M.

    2012-01-01

    Deep brain stimulation (DBS) of the subthalamic nucleus (STN) is an effective treatment for the motor symptoms of Parkinson’s disease (PD). The effects of DBS depend strongly on stimulation frequency: high frequencies (>90Hz) improve motor symptoms, while low frequencies (<50Hz) are either ineffective or exacerbate symptoms. The neuronal basis for these frequency-dependent effects of DBS is unclear. The effects of different frequencies of STN-DBS on behavior and single-unit neuronal activity in the basal ganglia were studied in the unilateral 6-hydroxydopamine lesioned rat model of PD. Only high frequency DBS reversed motor symptoms and the effectiveness of DBS depended strongly on stimulation frequency in a manner reminiscent of its clinical effects in persons with PD. Quantification of single-unit activity in the globus pallidus externa (GPe) and substantia nigra reticulata (SNr) revealed that high frequency DBS, but not low frequency DBS, reduced pathological low frequency oscillations (~9Hz) and entrained neurons to fire at the stimulation frequency. Similarly, the coherence between simultaneously recorded pairs of neurons within and across GPe and SNr shifted from the pathological low frequency band to the stimulation frequency during high frequency DBS, but not during low frequency DBS. The changes in firing patterns in basal ganglia neurons were not correlated with changes in firing rate. These results indicate that high frequency DBS is more effective than low frequency DBS, not as a result of changes in firing rate, but rather due to its ability to replace pathological low frequency network oscillations with a regularized pattern of neuronal firing. PMID:23136407

  20. Integration of homeostatic signaling and food reward processing in the human brain

    PubMed Central

    Simon, Joe J.; Wetzel, Anne; Sinno, Maria Hamze; Skunde, Mandy; Bendszus, Martin; Enck, Paul; Herzog, Wolfgang; Friederich, Hans-Christoph

    2017-01-01

    BACKGROUND. Food intake is guided by homeostatic needs and by the reward value of food, yet the exact relation between the two remains unclear. The aim of this study was to investigate the influence of different metabolic states and hormonal satiety signaling on responses in neural reward networks. METHODS. Twenty-three healthy participants underwent functional magnetic resonance imaging while performing a task distinguishing between the anticipation and the receipt of either food- or monetary-related reward. Every participant was scanned twice in a counterbalanced fashion, both during a fasted state (after 24 hours fasting) and satiety. A functional connectivity analysis was performed to investigate the influence of satiety signaling on activation in neural reward networks. Blood samples were collected to assess hormonal satiety signaling. RESULTS. Fasting was associated with sensitization of the striatal reward system to the anticipation of food reward irrespective of reward magnitude. Furthermore, during satiety, individual ghrelin levels were associated with increased neural processing during the expectation of food-related reward. CONCLUSIONS. Our findings show that physiological hunger stimulates food consumption by specifically increasing neural processing during the expectation (i.e., incentive salience) but not the receipt of food-related reward. In addition, these findings suggest that ghrelin signaling influences hedonic-driven food intake by increasing neural reactivity during the expectation of food-related reward. These results provide insights into the neurobiological underpinnings of motivational processing and hedonic evaluation of food reward. TRIAL REGISTRATION. ClinicalTrials.gov NCT03081585. FUNDING. This work was supported by the German Competence Network on Obesity, which is funded by the German Federal Ministry of Education and Research (FKZ 01GI1122E). PMID:28768906

  1. Integration of homeostatic signaling and food reward processing in the human brain.

    PubMed

    Simon, Joe J; Wetzel, Anne; Sinno, Maria Hamze; Skunde, Mandy; Bendszus, Martin; Preissl, Hubert; Enck, Paul; Herzog, Wolfgang; Friederich, Hans-Christoph

    2017-08-03

    Food intake is guided by homeostatic needs and by the reward value of food, yet the exact relation between the two remains unclear. The aim of this study was to investigate the influence of different metabolic states and hormonal satiety signaling on responses in neural reward networks. Twenty-three healthy participants underwent functional magnetic resonance imaging while performing a task distinguishing between the anticipation and the receipt of either food- or monetary-related reward. Every participant was scanned twice in a counterbalanced fashion, both during a fasted state (after 24 hours fasting) and satiety. A functional connectivity analysis was performed to investigate the influence of satiety signaling on activation in neural reward networks. Blood samples were collected to assess hormonal satiety signaling. Fasting was associated with sensitization of the striatal reward system to the anticipation of food reward irrespective of reward magnitude. Furthermore, during satiety, individual ghrelin levels were associated with increased neural processing during the expectation of food-related reward. Our findings show that physiological hunger stimulates food consumption by specifically increasing neural processing during the expectation (i.e., incentive salience) but not the receipt of food-related reward. In addition, these findings suggest that ghrelin signaling influences hedonic-driven food intake by increasing neural reactivity during the expectation of food-related reward. These results provide insights into the neurobiological underpinnings of motivational processing and hedonic evaluation of food reward. ClinicalTrials.gov NCT03081585. This work was supported by the German Competence Network on Obesity, which is funded by the German Federal Ministry of Education and Research (FKZ 01GI1122E).

  2. Monetary Reward and Punishment to Response Inhibition Modulate Activation and Synchronization Within the Inhibitory Brain Network.

    PubMed

    Chikara, Rupesh K; Chang, Erik C; Lu, Yi-Chen; Lin, Dar-Shong; Lin, Chin-Teng; Ko, Li-Wei

    2018-01-01

    A reward or punishment can modulate motivation and emotions, which in turn affect cognitive processing. The present simultaneous functional magnetic resonance imaging-electroencephalography study examines neural mechanisms of response inhibition under the influence of a monetary reward or punishment by implementing a modified stop-signal task in a virtual battlefield scenario. The participants were instructed to play as snipers who open fire at a terrorist target but withhold shooting in the presence of a hostage. The participants performed the task under three different feedback conditions in counterbalanced order: a reward condition where each successfully withheld response added a bonus (i.e., positive feedback) to the startup credit, a punishment condition where each failure in stopping deduced a penalty (i.e., negative feedback), and a no-feedback condition where response outcome had no consequences and served as a control setting. Behaviorally both reward and punishment conditions led to significantly down-regulated inhibitory function in terms of the critical stop-signal delay. As for the neuroimaging results, increased activities were found for the no-feedback condition in regions previously reported to be associated with response inhibition, including the right inferior frontal gyrus and the pre-supplementary motor area. Moreover, higher activation of the lingual gyrus, posterior cingulate gyrus (PCG) and inferior parietal lobule were found in the reward condition, while stronger activation of the precuneus gyrus was found in the punishment condition. The positive feedback was also associated with stronger changes of delta, theta, and alpha synchronization in the PCG than were the negative or no-feedback conditions. These findings depicted the intertwining relationship between response inhibition and motivation networks.

  3. Learning and memory functions of the Basal Ganglia.

    PubMed

    Packard, Mark G; Knowlton, Barbara J

    2002-01-01

    Although the mammalian basal ganglia have long been implicated in motor behavior, it is generally recognized that the behavioral functions of this subcortical group of structures are not exclusively motoric in nature. Extensive evidence now indicates a role for the basal ganglia, in particular the dorsal striatum, in learning and memory. One prominent hypothesis is that this brain region mediates a form of learning in which stimulus-response (S-R) associations or habits are incrementally acquired. Support for this hypothesis is provided by numerous neurobehavioral studies in different mammalian species, including rats, monkeys, and humans. In rats and monkeys, localized brain lesion and pharmacological approaches have been used to examine the role of the basal ganglia in S-R learning. In humans, study of patients with neurodegenerative diseases that compromise the basal ganglia, as well as research using brain neuroimaging techniques, also provide evidence of a role for the basal ganglia in habit learning. Several of these studies have dissociated the role of the basal ganglia in S-R learning from those of a cognitive or declarative medial temporal lobe memory system that includes the hippocampus as a primary component. Evidence suggests that during learning, basal ganglia and medial temporal lobe memory systems are activated simultaneously and that in some learning situations competitive interference exists between these two systems.

  4. A local circuit model of learned striatal and dopamine cell responses under probabilistic schedules of reward.

    PubMed

    Tan, Can Ozan; Bullock, Daniel

    2008-10-01

    Recently, dopamine (DA) neurons of the substantia nigra pars compacta (SNc) were found to exhibit sustained responses related to reward uncertainty, in addition to the phasic responses related to reward-prediction errors (RPEs). Thus, cue-dependent anticipations of the timing, magnitude, and uncertainty of rewards are learned and reflected in components of DA signals. Here we simulate a local circuit model to show how learned uncertainty responses are generated, along with phasic RPE responses, on single trials. Both types of simulated DA responses exhibit the empirically observed dependencies on conditional probability, expected value of reward, and time since onset of the reward-predicting cue. The model's three major pathways compute expected values of cues, timed predictions of reward magnitudes, and uncertainties associated with these predictions. The first two pathways' computations refine those modeled by Brown et al. (1999). The third, newly modeled, pathway involves medium spiny projection neurons (MSPNs) of the striatal matrix, whose axons corelease GABA and substance P, both at synapses with GABAergic neurons in the substantia nigra pars reticulata (SNr) and with distal dendrites (in SNr) of DA neurons whose somas are located in ventral SNc. Corelease enables efficient computation of uncertainty responses that are a nonmonotonic function of the conditional probability of reward, and variability in striatal cholinergic transmission can explain observed individual differences in the amplitudes of uncertainty responses. The involvement of matricial MSPNs and cholinergic transmission within the striatum implies a relation between uncertainty in cue-reward contingencies and action-selection functions of the basal ganglia.

  5. Neural correlates of reward processing in healthy siblings of patients with schizophrenia

    PubMed Central

    Hanssen, Esther; van der Velde, Jorien; Gromann, Paula M.; Shergill, Sukhi S.; de Haan, Lieuwe; Bruggeman, Richard; Krabbendam, Lydia; Aleman, André; van Atteveldt, Nienke

    2015-01-01

    Deficits in motivational behavior and psychotic symptoms often observed in schizophrenia (SZ) may be driven by dysfunctional reward processing (RP). RP can be divided in two different stages; reward anticipation and reward consumption. Aberrant processing during reward anticipation seems to be related to SZ. Studies in patients with SZ have found less activation in the ventral striatum (VS) during anticipation of reward, but these findings do not provide information on effect of the genetic load on reward processing. Therefore, this study investigated RP in healthy first-degree relatives of SZ patients. The sample consisted of 94 healthy siblings of SZ patients and 57 healthy controls. Participants completed a classic RP task, the Monetary Incentive Delay task, during functional magnetic resonance imaging (fMRI). As expected, there were no behavioral differences between groups. In contrast to our expectations, we found no differences in any of the anticipatory reward related brain areas (region of interest analyses). Whole-brain analyses did reveal group differences during both reward anticipation and reward consumption; during reward anticipation siblings showed less deactivation in the insula, posterior cingulate cortex (PCC) and medial frontal gyrus (MFG) than controls. During reward consumption siblings showed less deactivation in the PCC and the right MFG compared to controls and activation in contrast to deactivation in controls in the precuneus and the left MFG. Exclusively in siblings, MFG activity correlated positively with subclinical negative symptoms. These regions are typically associated with the default mode network (DMN), which normally shows decreases in activation during task-related cognitive processes. Thus, in contrast to prior literature in patients with SZ, the results do not point to altered brain activity in classical RP brain areas, such as the VS. However, the weaker deactivation found outside the reward-related network in siblings could

  6. Neural substrates of reward magnitude, probability, and risk during a wheel of fortune decision-making task.

    PubMed

    Smith, Bruce W; Mitchell, Derek G V; Hardin, Michael G; Jazbec, Sandra; Fridberg, Daniel; Blair, R James R; Ernst, Monique

    2009-01-15

    Economic decision-making involves the weighting of magnitude and probability of potential gains/losses. While previous work has examined the neural systems involved in decision-making, there is a need to understand how the parameters associated with decision-making (e.g., magnitude of expected reward, probability of expected reward and risk) modulate activation within these neural systems. In the current fMRI study, we modified the monetary wheel of fortune (WOF) task [Ernst, M., Nelson, E.E., McClure, E.B., Monk, C.S., Munson, S., Eshel, N., et al. (2004). Choice selection and reward anticipation: an fMRI study. Neuropsychologia 42(12), 1585-1597.] to examine in 25 healthy young adults the neural responses to selections of different reward magnitudes, probabilities, or risks. Selection of high, relative to low, reward magnitude increased activity in insula, amygdala, middle and posterior cingulate cortex, and basal ganglia. Selection of low-probability, as opposed to high-probability reward, increased activity in anterior cingulate cortex, as did selection of risky, relative to safe reward. In summary, decision-making that did not involve conflict, as in the magnitude contrast, recruited structures known to support the coding of reward values, and those that integrate motivational and perceptual information for behavioral responses. In contrast, decision-making under conflict, as in the probability and risk contrasts, engaged the dorsal anterior cingulate cortex whose role in conflict monitoring is well established. However, decision-making under conflict failed to activate the structures that track reward values per se. Thus, the presence of conflict in decision-making seemed to significantly alter the pattern of neural responses to simple rewards. In addition, this paradigm further clarifies the functional specialization of the cingulate cortex in processes of decision-making.

  7. Neural correlates of pathological gamblers preference for immediate rewards during the iowa gambling task: an fMRI study.

    PubMed

    Power, Yuri; Goodyear, Bradley; Crockford, David

    2012-12-01

    The Iowa Gambling Task (IGT) involves exploratory learning via rewards and penalties, where most advantageous task performance requires subjects to forego potential large immediate rewards for small longer-term rewards to avoid larger punishments. Pathological gambling (PG) subjects perform worse on the IGT compared to controls, relating to their persistence at high risk decisions involving the continued choice of potential large immediate rewards despite experiencing larger punishments. We wished to determine if neural processing of risk and reward within striatal and frontal cortex is associated with this behaviour observed in PG. Functional magnetic resonance imaging (fMRI) was used to assess brain activity in response to a computerized version of the IGT. Thirteen male PG subjects with no active comorbidities were compared to 13 demographically matched control subjects. In agreement with previous behavioural studies, PG subjects performed worse on the IGT and made more high-risk choices compared to controls, particularly after experiencing wins and losses. During high-risk gambling decisions, fMRI demonstrated that PG subjects exhibited relatively increased frontal lobe and basal ganglia activation, particularly involving the orbitofrontal cortex (OFC), caudate and amygdala. Increased activation of regions encompassing the extended reward pathway in PG subjects during high risk choices suggests that the persistence of PG may be due to the increased salience of immediate and greater potential monetary rewards relative to lower monetary rewards or potential future losses. Whether this over activation of the reward pathway is associated with the development of PG warrants further investigation.

  8. Bidirectional control of absence seizures by the basal ganglia: a computational evidence.

    PubMed

    Chen, Mingming; Guo, Daqing; Wang, Tiebin; Jing, Wei; Xia, Yang; Xu, Peng; Luo, Cheng; Valdes-Sosa, Pedro A; Yao, Dezhong

    2014-03-01

    Absence epilepsy is believed to be associated with the abnormal interactions between the cerebral cortex and thalamus. Besides the direct coupling, anatomical evidence indicates that the cerebral cortex and thalamus also communicate indirectly through an important intermediate bridge-basal ganglia. It has been thus postulated that the basal ganglia might play key roles in the modulation of absence seizures, but the relevant biophysical mechanisms are still not completely established. Using a biophysically based model, we demonstrate here that the typical absence seizure activities can be controlled and modulated by the direct GABAergic projections from the substantia nigra pars reticulata (SNr) to either the thalamic reticular nucleus (TRN) or the specific relay nuclei (SRN) of thalamus, through different biophysical mechanisms. Under certain conditions, these two types of seizure control are observed to coexist in the same network. More importantly, due to the competition between the inhibitory SNr-TRN and SNr-SRN pathways, we find that both decreasing and increasing the activation of SNr neurons from the normal level may considerably suppress the generation of spike-and-slow wave discharges in the coexistence region. Overall, these results highlight the bidirectional functional roles of basal ganglia in controlling and modulating absence seizures, and might provide novel insights into the therapeutic treatments of this brain disorder.

  9. Bidirectional Control of Absence Seizures by the Basal Ganglia: A Computational Evidence

    PubMed Central

    Wang, Tiebin; Jing, Wei; Xia, Yang; Xu, Peng; Luo, Cheng; Valdes-Sosa, Pedro A.; Yao, Dezhong

    2014-01-01

    Absence epilepsy is believed to be associated with the abnormal interactions between the cerebral cortex and thalamus. Besides the direct coupling, anatomical evidence indicates that the cerebral cortex and thalamus also communicate indirectly through an important intermediate bridge–basal ganglia. It has been thus postulated that the basal ganglia might play key roles in the modulation of absence seizures, but the relevant biophysical mechanisms are still not completely established. Using a biophysically based model, we demonstrate here that the typical absence seizure activities can be controlled and modulated by the direct GABAergic projections from the substantia nigra pars reticulata (SNr) to either the thalamic reticular nucleus (TRN) or the specific relay nuclei (SRN) of thalamus, through different biophysical mechanisms. Under certain conditions, these two types of seizure control are observed to coexist in the same network. More importantly, due to the competition between the inhibitory SNr-TRN and SNr-SRN pathways, we find that both decreasing and increasing the activation of SNr neurons from the normal level may considerably suppress the generation of spike-and-slow wave discharges in the coexistence region. Overall, these results highlight the bidirectional functional roles of basal ganglia in controlling and modulating absence seizures, and might provide novel insights into the therapeutic treatments of this brain disorder. PMID:24626189

  10. Distinct medial temporal networks encode surprise during motivation by reward versus punishment

    PubMed Central

    Murty, Vishnu P.; LaBar, Kevin S.; Adcock, R. Alison

    2016-01-01

    Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment. PMID:26854903

  11. Distinct medial temporal networks encode surprise during motivation by reward versus punishment.

    PubMed

    Murty, Vishnu P; LaBar, Kevin S; Adcock, R Alison

    2016-10-01

    Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment. Copyright © 2016 Elsevier Inc. All rights reserved.

  12. Enriched Encoding: Reward Motivation Organizes Cortical Networks for Hippocampal Detection of Unexpected Events

    PubMed Central

    Murty, Vishnu P.; Adcock, R. Alison

    2014-01-01

    Learning how to obtain rewards requires learning about their contexts and likely causes. How do long-term memory mechanisms balance the need to represent potential determinants of reward outcomes with the computational burden of an over-inclusive memory? One solution would be to enhance memory for salient events that occur during reward anticipation, because all such events are potential determinants of reward. We tested whether reward motivation enhances encoding of salient events like expectancy violations. During functional magnetic resonance imaging, participants performed a reaction-time task in which goal-irrelevant expectancy violations were encountered during states of high- or low-reward motivation. Motivation amplified hippocampal activation to and declarative memory for expectancy violations. Connectivity of the ventral tegmental area (VTA) with medial prefrontal, ventrolateral prefrontal, and visual cortices preceded and predicted this increase in hippocampal sensitivity. These findings elucidate a novel mechanism whereby reward motivation can enhance hippocampus-dependent memory: anticipatory VTA-cortical–hippocampal interactions. Further, the findings integrate literatures on dopaminergic neuromodulation of prefrontal function and hippocampus-dependent memory. We conclude that during reward motivation, VTA modulation induces distributed neural changes that amplify hippocampal signals and records of expectancy violations to improve predictions—a potentially unique contribution of the hippocampus to reward learning. PMID:23529005

  13. The Nucleus Accumbens and Pavlovian Reward Learning

    PubMed Central

    Day, Jeremy J.

    2011-01-01

    The ability to form associations between predictive environmental events and rewarding outcomes is a fundamental aspect of learned behavior. This apparently simple ability likely requires complex neural processing evolved to identify, seek, and utilize natural rewards and redirect these activities based on updated sensory information. Emerging evidence from both animal and human research suggests that this type of processing is mediated in part by the nucleus accumbens and a closely associated network of brain structures. The nucleus accumbens is required for a number of reward-related behaviors, and processes specific information about reward availability, value, and context. Additionally, this structure is critical for the acquisition and expression of most Pavlovian stimulus-reward relationships, and cues that predict rewards produce robust changes in neural activity in the nucleus accumbens. While processing within the nucleus accumbens may enable or promote Pavlovian reward learning in natural situations, it has also been implicated in aspects of human drug addiction, including the ability of drug-paired cues to control behavior. This article will provide a critical review of the existing animal and human literature concerning the role of the NAc in Pavlovian learning with non-drug rewards and consider some clinical implications of these findings. PMID:17404375

  14. Reward magnitude tracking by neural populations in ventral striatum

    PubMed Central

    Fiallos, Ana M.; Bricault, Sarah J.; Cai, Lili X.; Worku, Hermoon A.; Colonnese, Matthew T.; Westmeyer, Gil; Jasanoff, Alan

    2017-01-01

    Evaluation of the magnitudes of intrinsically rewarding stimuli is essential for assigning value and guiding behavior. By combining parametric manipulation of a primary reward, medial forebrain bundle (MFB) microstimulation, with functional magnetic imaging (fMRI) in rodents, we delineated a broad network of structures activated by behaviorally characterized levels of rewarding stimulation. Correlation of psychometric behavioral measurements with fMRI response magnitudes revealed regions whose activity corresponded closely to the subjective magnitude of rewards. The largest and most reliable focus of reward magnitude tracking was observed in the shell region of the nucleus accumbens (NAc). Although the nonlinear nature of neurovascular coupling complicates interpretation of fMRI findings in precise neurophysiological terms, reward magnitude tracking was not observed in vascular compartments and could not be explained by saturation of region-specific hemodynamic responses. In addition, local pharmacological inactivation of NAc changed the profile of animals’ responses to rewards of different magnitudes without altering mean reward response rates, further supporting a hypothesis that neural population activity in this region contributes to assessment of reward magnitudes. PMID:27789262

  15. Basal ganglia circuit loops, dopamine and motivation: A review and enquiry

    PubMed Central

    Ikemoto, Satoshi; Yang, Chen; Tan, Aaron

    2015-01-01

    Dopamine neurons located in the midbrain play a role in motivation that regulates approach behavior (approach motivation). In addition, activation and inactivation of dopamine neurons regulate mood and induce reward and aversion, respectively. Accumulating evidence suggests that such motivational role of dopamine neurons is not limited to those located in the ventral tegmental area, but also in the substantia nigra. The present paper reviews previous rodent work concerning dopamine’s role in approach motivation and the connectivity of dopamine neurons, and proposes two working models: One concerns the relationship between extracellular dopamine concentration and approach motivation. High, moderate and low concentrations of extracellular dopamine induce euphoric, seeking and aversive states, respectively. The other concerns circuit loops involving the cerebral cortex, basal ganglia, thalamus, epithalamus, and midbrain through which dopaminergic activity alters approach motivation. These models should help to generate hypothesis-driven research and provide insights for understanding altered states associated with drugs of abuse and affective disorders. PMID:25907747

  16. Enriched encoding: reward motivation organizes cortical networks for hippocampal detection of unexpected events.

    PubMed

    Murty, Vishnu P; Adcock, R Alison

    2014-08-01

    Learning how to obtain rewards requires learning about their contexts and likely causes. How do long-term memory mechanisms balance the need to represent potential determinants of reward outcomes with the computational burden of an over-inclusive memory? One solution would be to enhance memory for salient events that occur during reward anticipation, because all such events are potential determinants of reward. We tested whether reward motivation enhances encoding of salient events like expectancy violations. During functional magnetic resonance imaging, participants performed a reaction-time task in which goal-irrelevant expectancy violations were encountered during states of high- or low-reward motivation. Motivation amplified hippocampal activation to and declarative memory for expectancy violations. Connectivity of the ventral tegmental area (VTA) with medial prefrontal, ventrolateral prefrontal, and visual cortices preceded and predicted this increase in hippocampal sensitivity. These findings elucidate a novel mechanism whereby reward motivation can enhance hippocampus-dependent memory: anticipatory VTA-cortical-hippocampal interactions. Further, the findings integrate literatures on dopaminergic neuromodulation of prefrontal function and hippocampus-dependent memory. We conclude that during reward motivation, VTA modulation induces distributed neural changes that amplify hippocampal signals and records of expectancy violations to improve predictions-a potentially unique contribution of the hippocampus to reward learning. © The Author 2013. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

  17. Incentive-Rewarding Mechanism for User-position Control in Mobile Services

    NASA Astrophysics Data System (ADS)

    Yoshino, Makoto; Sato, Kenichiro; Shinkuma, Ryoichi; Takahashi, Tatsuro

    When the number of users in a service area increases in mobile multimedia services, no individual user can obtain satisfactory radio resources such as bandwidth and signal power because the resources are limited and shared. A solution for such a problem is user-position control. In the user-position control, the operator informs users of better communication areas (or spots) and navigates them to these positions. However, because of subjective costs caused by subjects moving from their original to a new position, they do not always attempt to move. To motivate users to contribute their resources in network services that require resource contributions for users, incentive-rewarding mechanisms have been proposed. However, there are no mechanisms that distribute rewards appropriately according to various subjective factors involving users. Furthermore, since the conventional mechanisms limit how rewards are paid, they are applicable only for the network service they targeted. In this paper, we propose a novel incentive-rewarding mechanism to solve these problems, using an external evaluator and interactive learning agents. We also investigated ways of appropriately controlling rewards based on user contributions and system service quality. We applied the proposed mechanism and reward control to the user-position control, and demonstrated its validity.

  18. Endogenous neurotrophin-3 promotes neuronal sprouting from dorsal root ganglia.

    PubMed

    Wang, Xu-Yang; Gu, Pei-Yuan; Chen, Shi-Wen; Gao, Wen-Wei; Tian, Heng-Li; Lu, Xiang-He; Zheng, Wei-Ming; Zhuge, Qi-Chuan; Hu, Wei-Xing

    2015-11-01

    In the present study, we investigated the role of endogenous neurotrophin-3 in nerve terminal sprouting 2 months after spinal cord dorsal root rhizotomy. The left L1-5 and L7-S2 dorsal root ganglia in adult cats were exposed and removed, preserving the L6 dorsal root ganglia. Neurotrophin-3 was mainly expressed in large neurons in the dorsal root ganglia and in some neurons in spinal lamina II. Two months after rhizotomy, the number of neurotrophin-3-positive neurons in the spared dorsal root ganglia and the density of neurite sprouts emerging from these ganglia were increased. Intraperitoneal injection of an antibody against neurotrophin-3 decreased the density of neurite sprouts. These findings suggest that endogenous neurotrophin-3 is involved in spinal cord plasticity and regeneration, and that it promotes axonal sprouting from the dorsal root ganglia after spinal cord dorsal root rhizotomy.

  19. A Learning Theory for Reward-Modulated Spike-Timing-Dependent Plasticity with Application to Biofeedback

    PubMed Central

    Maass, Wolfgang

    2008-01-01

    Reward-modulated spike-timing-dependent plasticity (STDP) has recently emerged as a candidate for a learning rule that could explain how behaviorally relevant adaptive changes in complex networks of spiking neurons could be achieved in a self-organizing manner through local synaptic plasticity. However, the capabilities and limitations of this learning rule could so far only be tested through computer simulations. This article provides tools for an analytic treatment of reward-modulated STDP, which allows us to predict under which conditions reward-modulated STDP will achieve a desired learning effect. These analytical results imply that neurons can learn through reward-modulated STDP to classify not only spatial but also temporal firing patterns of presynaptic neurons. They also can learn to respond to specific presynaptic firing patterns with particular spike patterns. Finally, the resulting learning theory predicts that even difficult credit-assignment problems, where it is very hard to tell which synaptic weights should be modified in order to increase the global reward for the system, can be solved in a self-organizing manner through reward-modulated STDP. This yields an explanation for a fundamental experimental result on biofeedback in monkeys by Fetz and Baker. In this experiment monkeys were rewarded for increasing the firing rate of a particular neuron in the cortex and were able to solve this extremely difficult credit assignment problem. Our model for this experiment relies on a combination of reward-modulated STDP with variable spontaneous firing activity. Hence it also provides a possible functional explanation for trial-to-trial variability, which is characteristic for cortical networks of neurons but has no analogue in currently existing artificial computing systems. In addition our model demonstrates that reward-modulated STDP can be applied to all synapses in a large recurrent neural network without endangering the stability of the network

  20. Cannabinoid modulation of drug reward and the implications of marijuana legalization.

    PubMed

    Covey, Dan P; Wenzel, Jennifer M; Cheer, Joseph F

    2015-12-02

    Marijuana is the most popular illegal drug worldwide. Recent trends indicate that this may soon change; not due to decreased marijuana use, but to an amendment in marijuana's illegal status. The cannabinoid type 1 (CB1) receptor mediates marijuana's psychoactive and reinforcing properties. CB1 receptors are also part of the brain endocannabinoid (eCB) system and support numerous forms of learning and memory, including the conditioned reinforcing properties of cues predicting reward or punishment. This is accomplished via eCB-dependent alterations in mesolimbic dopamine function, which plays an obligatory role in reward learning and motivation. Presynaptic CB1 receptors control midbrain dopamine neuron activity and thereby shape phasic dopamine release in target regions, particularly the nucleus accumbens (NAc). By also regulating synaptic input to the NAc, CB1 receptors modulate NAc output onto downstream neurons of the basal ganglia motor circuit, and thereby support goal-directed behaviors. Abused drugs promote short- and long-term adaptations in eCB-regulation of mesolimbic dopamine function, and thereby hijack neural systems related to the pursuit of rewards to promote drug abuse. By pharmacologically targeting the CB1 receptors, marijuana has preferential access to this neuronal system and can potently alter eCB-dependent processing of reward-related stimuli. As marijuana legalization progresses, greater access to this drug should increase the utility of marijuana as a research tool to better understand the eCB system, which has the potential to advance cannabinoid-based treatments for drug addiction. Copyright © 2014 Elsevier B.V. All rights reserved.

  1. Gender-specific modulation of neural mechanisms underlying social reward processing by Autism Quotient

    PubMed Central

    Barman, Adriana; Richter, Sylvia; Soch, Joram; Deibele, Anna; Richter, Anni; Assmann, Anne; Wüstenberg, Torsten; Walter, Henrik; Seidenbecher, Constanze I.

    2015-01-01

    Autism spectrum disorder refers to a neurodevelopmental condition primarily characterized by deficits in social cognition and behavior. Subclinically, autistic features are supposed to be present in healthy humans and can be quantified using the Autism Quotient (AQ). Here, we investigated a potential relationship between AQ and neural correlates of social and monetary reward processing, using functional magnetic resonance imaging in young, healthy participants. In an incentive delay task with either monetary or social reward, reward anticipation elicited increased ventral striatal activation, which was more pronounced during monetary reward anticipation. Anticipation of social reward elicited activation in the default mode network (DMN), a network previously implicated in social processing. Social reward feedback was associated with bilateral amygdala and fusiform face area activation. The relationship between AQ and neural correlates of social reward processing varied in a gender-dependent manner. In women and, to a lesser extent in men, higher AQ was associated with increased posterior DMN activation during social reward anticipation. During feedback, we observed a negative correlation of AQ and right amygdala activation in men only. Our results suggest that social reward processing might constitute an endophenotype for autism-related traits in healthy humans that manifests in a gender-specific way. PMID:25944965

  2. Psychological intervention with working memory training increases basal ganglia volume: A VBM study of inpatient treatment for methamphetamine use.

    PubMed

    Brooks, S J; Burch, K H; Maiorana, S A; Cocolas, E; Schioth, H B; Nilsson, E K; Kamaloodien, K; Stein, D J

    2016-01-01

    Protracted methamphetamine (MA) use is associated with decreased control over drug craving and altered brain volume in the frontostriatal network. However, the nature of volumetric changes following a course of psychological intervention for MA use is not yet known. 66 males (41 MA patients, 25 healthy controls, HC) between the ages of 18-50 were recruited, the MA patients from new admissions to an in-patient drug rehabilitation centre and the HC via public advertisement, both in Cape Town, South Africa. 17 MA patients received 4 weeks of treatment as usual (TAU), and 24 MA patients completed TAU plus daily 30-minute cognitive training (CT) using an N-back working memory task. Magnetic resonance imaging (MRI) at baseline and 4-week follow-up was acquired and voxel-based morphometry (VBM) was used for analysis. TAU was associated with larger bilateral striatum (caudate/putamen) volume, whereas CT was associated with more widespread increases of the bilateral basal ganglia (incorporating the amygdala and hippocampus) and reduced bilateral cerebellum volume coinciding with improvements in impulsivity scores. While psychological intervention is associated with larger volume in mesolimbic reward regions, the utilisation of additional working memory training as an adjunct to treatment may further normalize frontostriatal structure and function.

  3. Basal ganglia lesions in subacute sclerosing panencephalitis

    PubMed Central

    Almeida, Kelson James; Brucki, Sonia Maria Dozzi; Duarte, Maria Irma Seixas; Pasqualucci, Carlos Augusto Gonçalves; Rosemberg, Sérgio; Nitrini, Ricardo

    2012-01-01

    The parieto-occipital region of the brain is the most frequently and severely affected in subacute sclerosing panencephalitis (SSPE). The basal ganglia, cerebellum and corpus callosum are less commonly involved. We describe a patient with SSPE confirmed by neuropathology based on brain magnetic resonance imaging showing extensive basal ganglia involvement and no significant involvement of other cortical structures. Though rarely described in SSPE, clinicians should be aware of this involvement. SSPE should be kept in mind when changes in basal ganglia signal are seen on brain magnetic resonance imaging with or without involvement of other regions of the human brain to avoid erroneous etiological diagnosis of other pathologies causing rapidly progressive dementia. PMID:29213810

  4. Neural basis of reward anticipation and its genetic determinants.

    PubMed

    Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J; Bokde, Arun L W; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J; Dove, Rachel; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Smolka, Michael N; Müller, Christian P; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

    2016-04-05

    Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature.

  5. Neural basis of reward anticipation and its genetic determinants

    PubMed Central

    Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A.; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J.; Bokde, Arun L. W.; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J.; Dove, Rachel; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A.; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Müller, Christian P.; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

    2016-01-01

    Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila. Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature. PMID:27001827

  6. Serum Fetuin-A Levels in Patients with Bilateral Basal Ganglia Calcification.

    PubMed

    Demiryurek, Bekir Enes; Gundogdu, Asli Aksoy

    2018-02-14

    The idiopathic basal ganglia calcification (Fahr syndrome) may occur due to senility. Fetuin-A is a negative acute phase reactant which inhibits calcium-phosphorus precipitation and vascular calcification. In this study, we aimed to evaluate whether serum fetuin-A levels correlate with bilateral basal ganglia calcification. Forty-five patients who had bilateral basal ganglia calcification on brain CT were selected according to the inclusion and exclusion criteria, and 45 age and gender-matched subjects without basal ganglia calcification were included for the control group. Serum fetuin-A levels were measured from venous blood samples. All participants were divided into two groups; with and without basal ganglia calcification. These groups were divided into subgroups regarding age (18-32 and 33-45 years of age) and gender (male, female). We detected lower levels of serum fetuin-A in patients with basal ganglia calcification compared with the subjects without basal ganglia calcification. In all subgroups (female, male, 18-32 years and 33-45 years), mean fetuin-A levels were significantly lower in patients with basal ganglia calcification (p = 0.017, p = 0.014, p = 0.024, p = 0.026, p = 0.01 respectively). And statistically significantly lower levels of fetuin-A was found to be correlated with the increasing densities of calcification in the calcified basal ganglia group (p-value: <0.001). Considering the role of fetuin-A in tissue calcification and inflammation, higher serum fetuin-A levels should be measured in patients with basal ganglia calcification. We believe that the measurement of serum fetuin-A may play a role in the prediction of basal ganglia calcification as a biomarker. Copyright © 2017 Elsevier B.V. All rights reserved.

  7. Increased default mode network activity in socially anxious individuals during reward processing

    PubMed Central

    2014-01-01

    of monetary loss. Conclusions Socially anxious individuals may increase default mode network activity during reward processing, suggesting high self-focused attention even in relation to potentially rewarding stimuli lacking explicit social connotations. Additionally, social anxiety may relate to decreased ventral striatum reactivity when anticipating potential losses. PMID:25075275

  8. Effects of Motivation: Rewarding Hackers for Undetected Attacks Cause Analysts to Perform Poorly.

    PubMed

    Maqbool, Zahid; Makhijani, Nidhi; Pammi, V S Chandrasekhar; Dutt, Varun

    2017-05-01

    The aim of this study was to determine how monetary motivations influence decision making of humans performing as security analysts and hackers in a cybersecurity game. Cyberattacks are increasing at an alarming rate. As cyberattacks often cause damage to existing cyber infrastructures, it is important to understand how monetary rewards may influence decision making of hackers and analysts in the cyber world. Currently, only limited attention has been given to this area. In an experiment, participants were randomly assigned to three between-subjects conditions ( n = 26 for each condition): equal payoff, where the magnitude of monetary rewards for hackers and defenders was the same; rewarding hacker, where the magnitude of monetary reward for hacker's successful attack was 10 times the reward for analyst's successful defense; and rewarding analyst, where the magnitude of monetary reward for analyst's successful defense was 10 times the reward for hacker's successful attack. In all conditions, half of the participants were human hackers playing against Nash analysts and half were human analysts playing against Nash hackers. Results revealed that monetary rewards for human hackers and analysts caused a decrease in attack and defend actions compared with the baseline. Furthermore, rewarding human hackers for undetected attacks made analysts deviate significantly from their optimal behavior. If hackers are rewarded for their undetected attack actions, then this causes analysts to deviate from optimal defend proportions. Thus, analysts need to be trained not become overenthusiastic in defending networks. Applications of our results are to networks where the influence of monetary rewards may cause information theft and system damage.

  9. Specific contributions of basal ganglia and cerebellum to the neural tracking of rhythm.

    PubMed

    Nozaradan, Sylvie; Schwartze, Michael; Obermeier, Christian; Kotz, Sonja A

    2017-10-01

    How specific brain networks track rhythmic sensory input over time remains a challenge in neuroimaging work. Here we show that subcortical areas, namely the basal ganglia and the cerebellum, specifically contribute to the neural tracking of rhythm. We tested patients with focal lesions in either of these areas and healthy controls by means of electroencephalography (EEG) while they listened to rhythmic sequences known to induce selective neural tracking at a frequency corresponding to the most-often perceived pulse-like beat. Both patients and controls displayed neural responses to the rhythmic sequences. However, these response patterns were different across groups, with patients showing reduced tracking at beat frequency, especially for the more challenging rhythms. In the cerebellar patients, this effect was specific to the rhythm played at a fast tempo, which places high demands on the temporally precise encoding of events. In contrast, basal ganglia patients showed more heterogeneous responses at beat frequency specifically for the most complex rhythm, which requires more internal generation of the beat. These findings provide electrophysiological evidence that these subcortical structures selectively shape the neural representation of rhythm. Moreover, they suggest that the processing of rhythmic auditory input relies on an extended cortico-subcortico-cortical functional network providing specific timing and entrainment sensitivities. Copyright © 2017 Elsevier Ltd. All rights reserved.

  10. Aging Affects Acquisition and Reversal of Reward-Based Associative Learning

    ERIC Educational Resources Information Center

    Weiler, Julia A.; Bellebaum, Christian; Daum, Irene

    2008-01-01

    Reward-based associative learning is mediated by a distributed network of brain regions that are dependent on the dopaminergic system. Age-related changes in key regions of this system, the striatum and the prefrontal cortex, may adversely affect the ability to use reward information for the guidance of behavior. The present study investigated the…

  11. Endogenous angiotensinergic system in neurons of rat and human trigeminal ganglia

    PubMed Central

    Imboden, Hans; Patil, Jaspal; Nussberger, Juerg; Nicoud, Françoise; Hess, Benno; Ahmed, Nermin; Schaffner, Thomas; Wellner, Maren; Müller, Dominik; Inagami, Tadashi; Senbonmatsu, Takaaki; Pavel, Jaroslav; Saavedra, Juan M.

    2009-01-01

    To clarify the role of Angiotensin II (Ang II) in the sensory system and especially in the trigeminal ganglia, we studied the expression of angiotensinogen (Ang-N)-, renin-, angiotensin converting enzyme (ACE)- and cathepsin D-mRNA, and the presence of Ang II and substance P in the rat and human trigeminal ganglia. The rat trigeminal ganglia expressed substantial amounts of Ang-N- and ACE mRNA as determined by quantitative real time PCR. Renin mRNA was untraceable in rat samples. Cathepsin D was detected in the rat trigeminal ganglia indicating the possibility of existence of pathways alternative to renin for Ang I formation. In situ hybridization in rat trigeminal ganglia revealed expression of Ang-N mRNA in the cytoplasm of numerous neurons. By using immunocytochemistry, a number of neurons and their processes in both the rat and human trigeminal ganglia were stained for Ang II. Post in situ hybridization immunocytochemistry reveals that in the rat trigeminal ganglia some, but not all Ang-N mRNA-positive neurons marked for Ang II. In some neurons Substance P was found colocalized with Ang II. Angiotensins from rat trigeminal ganglia were quantitated by radioimmunoassay with and without prior separation by high performance liquid chromatography. Immunoreactive angiotensin II (ir-Ang II) was consistently present and the sum of true Ang II (1-8) octapeptide and its specifically measured metabolites were found to account for it. Radioimmunological and immunocytochemical evidence of ir-Ang II in neuronal tissue is compatible with Ang II as a neurotransmitter. In conclusion, these results suggest that Ang II could be produced locally in the neurons of rat trigeminal ganglia. The localization and colocalization of neuronal Ang II with Substance P in the trigeminal ganglia neurons may be the basis for a participation and function of Ang II in the regulation of nociception and migraine pathology. PMID:19323983

  12. Complex Dynamics in the Basal Ganglia: Health and Disease Beyond the Motor System.

    PubMed

    Andres, Daniela S; Darbin, Olivier

    2018-01-01

    The rate and oscillatory hypotheses are the two main current frameworks of basal ganglia pathophysiology. Both hypotheses have emerged from research on movement disorders sharing similar conceptualizations. These pathological conditions are classified either as hypokinetic or hyperkinetic, and the electrophysiological hallmarks of basal ganglia dysfunction are categorized as prokinetic or antikinetic. Although nonmotor symptoms, including neurobehavioral symptoms, are a key manifestation of basal ganglia dysfunction, they are uncommonly accounted for in these models. In patients with Parkinson's disease, the broad spectrum of motor symptoms and neurobehavioral symptoms challenges the concept that basal ganglia disorders can be classified into two categories. The profile of symptoms of basal ganglia dysfunction is best characterized by a breakdown of information processing, accompanied at an electrophysiological level by complex alterations of spiking activity from basal ganglia neurons. The authors argue that the dynamics of the basal ganglia circuit cannot be fully characterized by linear properties such as the firing rate or oscillatory activity. In fact, the neuronal spiking stream of the basal ganglia circuit is irregular but has temporal structure. In this context, entropy was introduced as a measure of probabilistic irregularity in the temporal organization of neuronal activity of the basal ganglia, giving place to the entropy hypothesis of basal ganglia pathology. Obtaining a quantitative characterization of irregularity of spike trains from basal ganglia neurons is key to elaborating a new framework of basal ganglia pathophysiology.

  13. Overlapping neural systems represent cognitive effort and reward anticipation.

    PubMed

    Vassena, Eliana; Silvetti, Massimo; Boehler, Carsten N; Achten, Eric; Fias, Wim; Verguts, Tom

    2014-01-01

    Anticipating a potential benefit and how difficult it will be to obtain it are valuable skills in a constantly changing environment. In the human brain, the anticipation of reward is encoded by the Anterior Cingulate Cortex (ACC) and Striatum. Naturally, potential rewards have an incentive quality, resulting in a motivational effect improving performance. Recently it has been proposed that an upcoming task requiring effort induces a similar anticipation mechanism as reward, relying on the same cortico-limbic network. However, this overlapping anticipatory activity for reward and effort has only been investigated in a perceptual task. Whether this generalizes to high-level cognitive tasks remains to be investigated. To this end, an fMRI experiment was designed to investigate anticipation of reward and effort in cognitive tasks. A mental arithmetic task was implemented, manipulating effort (difficulty), reward, and delay in reward delivery to control for temporal confounds. The goal was to test for the motivational effect induced by the expectation of bigger reward and higher effort. The results showed that the activation elicited by an upcoming difficult task overlapped with higher reward prospect in the ACC and in the striatum, thus highlighting a pivotal role of this circuit in sustaining motivated behavior.

  14. Frontal glutamate and reward processing in adolescence and adulthood.

    PubMed

    Gleich, Tobias; Lorenz, Robert C; Pöhland, Lydia; Raufelder, Diana; Deserno, Lorenz; Beck, Anne; Heinz, Andreas; Kühn, Simone; Gallinat, Jürgen

    2015-11-01

    The fronto-limbic network interaction, driven by glutamatergic and dopaminergic neurotransmission, represents a core mechanism of motivated behavior and personality traits. Reward seeking behavior undergoes tremendous changes in adolescence paralleled by neurobiological changes of this network including the prefrontal cortex, striatum and amygdala. Since fronto-limbic dysfunctions also underlie major psychiatric diseases beginning in adolescence, this investigation focuses on network characteristics separating adolescents from adults. To investigate differences in network interactions, the brain reward system activity (slot machine task) together with frontal glutamate concentration (anterior cingulate cortex, ACC) was measured in 28 adolescents and 26 adults employing functional magnetic resonance imaging and magnetic resonance spectroscopy, respectively. An inverse coupling of glutamate concentrations in the ACC and activation of the ventral striatum was observed in adolescents. Further, amygdala response in adolescents was negatively correlated with the personality trait impulsivity. For adults, no significant associations of network components or correlations with impulsivity were found. The inverse association between frontal glutamate concentration and striatal activation in adolescents is in line with the triadic model of motivated behavior stressing the important role of frontal top-down inhibition on limbic structures. Our data identified glutamate as the mediating neurotransmitter of this inhibitory process and demonstrates the relevance of glutamate on the reward system and related behavioral traits like impulsivity. This fronto-limbic coupling may represent a vulnerability factor for psychiatric disorders starting in adolescence but not in adulthood.

  15. Deep-Brain Stimulation for Basal Ganglia Disorders.

    PubMed

    Wichmann, Thomas; Delong, Mahlon R

    2011-07-01

    The realization that medications used to treat movement disorders and psychiatric conditions of basal ganglia origin have significant shortcomings, as well as advances in the understanding of the functional organization of the brain, has led to a renaissance in functional neurosurgery, and particularly the use of deep brain stimulation (DBS). Movement disorders are now routinely being treated with DBS of 'motor' portions of the basal ganglia output nuclei, specifically the subthalamic nucleus and the internal pallidal segment. These procedures are highly effective and generally safe. Use of DBS is also being explored in the treatment of neuropsychiatric disorders, with targeting of the 'limbic' basal ganglia-thalamocortical circuitry. The results of these procedures are also encouraging, but many unanswered questions remain in this emerging field. This review summarizes the scientific rationale and practical aspects of using DBS for neurologic and neuropsychiatric disorders.

  16. Computational Stimulation of the Basal Ganglia Neurons with Cost Effective Delayed Gaussian Waveforms

    PubMed Central

    Daneshzand, Mohammad; Faezipour, Miad; Barkana, Buket D.

    2017-01-01

    Deep brain stimulation (DBS) has compelling results in the desynchronization of the basal ganglia neuronal activities and thus, is used in treating the motor symptoms of Parkinson's disease (PD). Accurate definition of DBS waveform parameters could avert tissue or electrode damage, increase the neuronal activity and reduce energy cost which will prolong the battery life, hence avoiding device replacement surgeries. This study considers the use of a charge balanced Gaussian waveform pattern as a method to disrupt the firing patterns of neuronal cell activity. A computational model was created to simulate ganglia cells and their interactions with thalamic neurons. From the model, we investigated the effects of modified DBS pulse shapes and proposed a delay period between the cathodic and anodic parts of the charge balanced Gaussian waveform to desynchronize the firing patterns of the GPe and GPi cells. The results of the proposed Gaussian waveform with delay outperformed that of rectangular DBS waveforms used in in-vivo experiments. The Gaussian Delay Gaussian (GDG) waveforms achieved lower number of misses in eliciting action potential while having a lower amplitude and shorter length of delay compared to numerous different pulse shapes. The amount of energy consumed in the basal ganglia network due to GDG waveforms was dropped by 22% in comparison with charge balanced Gaussian waveforms without any delay between the cathodic and anodic parts and was also 60% lower than a rectangular charged balanced pulse with a delay between the cathodic and anodic parts of the waveform. Furthermore, by defining a Synchronization Level metric, we observed that the GDG waveform was able to reduce the synchronization of GPi neurons more effectively than any other waveform. The promising results of GDG waveforms in terms of eliciting action potential, desynchronization of the basal ganglia neurons and reduction of energy consumption can potentially enhance the performance of DBS

  17. Computational Stimulation of the Basal Ganglia Neurons with Cost Effective Delayed Gaussian Waveforms.

    PubMed

    Daneshzand, Mohammad; Faezipour, Miad; Barkana, Buket D

    2017-01-01

    Deep brain stimulation (DBS) has compelling results in the desynchronization of the basal ganglia neuronal activities and thus, is used in treating the motor symptoms of Parkinson's disease (PD). Accurate definition of DBS waveform parameters could avert tissue or electrode damage, increase the neuronal activity and reduce energy cost which will prolong the battery life, hence avoiding device replacement surgeries. This study considers the use of a charge balanced Gaussian waveform pattern as a method to disrupt the firing patterns of neuronal cell activity. A computational model was created to simulate ganglia cells and their interactions with thalamic neurons. From the model, we investigated the effects of modified DBS pulse shapes and proposed a delay period between the cathodic and anodic parts of the charge balanced Gaussian waveform to desynchronize the firing patterns of the GPe and GPi cells. The results of the proposed Gaussian waveform with delay outperformed that of rectangular DBS waveforms used in in-vivo experiments. The Gaussian Delay Gaussian (GDG) waveforms achieved lower number of misses in eliciting action potential while having a lower amplitude and shorter length of delay compared to numerous different pulse shapes. The amount of energy consumed in the basal ganglia network due to GDG waveforms was dropped by 22% in comparison with charge balanced Gaussian waveforms without any delay between the cathodic and anodic parts and was also 60% lower than a rectangular charged balanced pulse with a delay between the cathodic and anodic parts of the waveform. Furthermore, by defining a Synchronization Level metric, we observed that the GDG waveform was able to reduce the synchronization of GPi neurons more effectively than any other waveform. The promising results of GDG waveforms in terms of eliciting action potential, desynchronization of the basal ganglia neurons and reduction of energy consumption can potentially enhance the performance of DBS

  18. Mesolimbic recruitment by nondrug rewards in detoxified alcoholics: effort anticipation, reward anticipation, and reward delivery.

    PubMed

    Bjork, James M; Smith, Ashley R; Chen, Gang; Hommer, Daniel W

    2012-09-01

    Aberrant sensitivity of incentive neurocircuitry to nondrug rewards has been suggested as either a risk factor for or consequence of drug addiction. Using functional magnetic resonance imaging, we tested whether alcohol-dependent patients (ADP: n = 29) showed altered recruitment of ventral striatal (VS) incentive neurocircuitry compared to controls (n = 23) by: (1) cues to respond for monetary rewards, (2) post-response anticipation of rewards, or (3) delivery of rewards. Using an instrumental task with two-stage presentation of reward-predictive information, subjects saw cues signaling opportunities to win $0, $1, or $10 for responding to a target. Following this response, subjects were notified whether their success would be indicated by a lexical notification (“Hit?”) or by delivery of a monetary reward (“Win?”). After a variable interval, subjects then viewed the trial outcome. We found no significant group differences in voxelwise activation by task contrasts, or in signal change extracted from VS. Both ADP and controls showed significant VS and other limbic recruitment by pre-response reward anticipation. In addition, controls also showed VS recruitment by post-response reward-anticipation, and ADP had appreciable subthreshold VS activation. Both groups also showed similar mesolimbic responses to reward deliveries. Across all subjects, a questionnaire measure of “hot” impulsivity correlated with VS recruitment by post-response anticipation of low rewards and with VS recruitment by delivery of low rewards. These findings indicate that incentive-motivational processing of nondrug rewards is substantially maintained in recovering alcoholics, and that reward-elicited VS recruitment correlates more with individual differences in trait impulsivity irrespective of addiction.

  19. Task-Rest Modulation of Basal Ganglia Connectivity in Mild to Moderate Parkinson’s Disease

    PubMed Central

    Müller-Oehring, Eva M.; Sullivan, Edith V.; Pfefferbaum, Adolf; Huang, Neng C.; Poston, Kathleen L.; Bronte-Stewart, Helen M.; Schulte, Tilman

    2014-01-01

    Parkinson’s disease (PD) is associated with abnormal synchronization in basal ganglia-thalamo-cortical loops. We tested whether early PD patients without demonstrable cognitive impairment exhibit abnormal modulation of functional connectivity at rest, while engaged in a task, or both. PD and healthy controls underwent two functional MRI scans: a resting-state scan and a Stroop Match-to-Sample task scan. Rest-task modulation of basal ganglia (BG) connectivity was tested using seed-to-voxel connectivity analysis with task and rest time series as conditions. Despite substantial overlap of BG–cortical connectivity patterns in both groups, connectivity differences between groups had clinical and behavioral correlates. During rest, stronger putamen–medial parietal and pallidum–occipital connectivity in PD than controls was associated with worse task performance and more severe PD symptoms suggesting that abnormalities in resting-state connectivity denote neural network dedifferentiation. During the executive task, PD patients showed weaker BG-cortical connectivity than controls, i.e., between caudate–supramarginal gyrus and pallidum–inferior prefrontal regions, that was related to more severe PD symptoms and worse task performance. Yet, task processing also evoked stronger striatal–cortical connectivity, specifically between caudate–prefrontal, caudate–precuneus, and putamen–motor/premotor regions in PD relative to controls, which was related to less severe PD symptoms and better performance on the Stroop task. Thus, stronger task-evoked striatal connectivity in PD demonstrated compensatory neural network enhancement to meet task demands and improve performance levels. fMRI-based network analysis revealed that despite resting-state BG network compromise in PD, BG connectivity to prefrontal, premotor, and precuneus regions can be adequately invoked during executive control demands enabling near normal task performance. PMID:25280970

  20. Deep-Brain Stimulation for Basal Ganglia Disorders

    PubMed Central

    Wichmann, Thomas; DeLong, Mahlon R.

    2011-01-01

    The realization that medications used to treat movement disorders and psychiatric conditions of basal ganglia origin have significant shortcomings, as well as advances in the understanding of the functional organization of the brain, has led to a renaissance in functional neurosurgery, and particularly the use of deep brain stimulation (DBS). Movement disorders are now routinely being treated with DBS of ‘motor’ portions of the basal ganglia output nuclei, specifically the subthalamic nucleus and the internal pallidal segment. These procedures are highly effective and generally safe. Use of DBS is also being explored in the treatment of neuropsychiatric disorders, with targeting of the ‘limbic’ basal ganglia-thalamocortical circuitry. The results of these procedures are also encouraging, but many unanswered questions remain in this emerging field. This review summarizes the scientific rationale and practical aspects of using DBS for neurologic and neuropsychiatric disorders. PMID:21804953

  1. Mesolimbic recruitment by nondrug rewards in detoxified alcoholics: effort anticipation, reward anticipation and reward delivery

    PubMed Central

    Bjork, James M.; Smith, Ashley R.; Chen, Gang; Hommer, Daniel W.

    2011-01-01

    Aberrant sensitivity of incentive neurocircuitry to nondrug rewards has been suggested as either a risk factor for or consequence of drug addiction. Using functional magnetic resonance imaging, we tested whether alcohol-dependent patients (ADP: n = 29) showed altered recruitment of ventral striatal (VS) incentive neurocircuitry compared to controls (n = 23) by: 1) cues to respond for monetary rewards, 2) post-response anticipation of rewards, or 3) delivery of rewards. Using an instrumental task with two-stage presentation of reward-predictive information, subjects saw cues signaling opportunities to win $0, $1, or $10 for responding to a target. Following this response, subjects were notified whether their success would be indicated by a lexical notification (“Hit?”) or by delivery of a monetary reward (“Win?”). After a variable interval, subjects then viewed the trial outcome. We found no significant group differences in voxelwise activation by task contrasts, or in signal change extracted from VS. Both ADP and controls showed significant VS and other limbic recruitment by pre-response reward anticipation. In addition, controls also showed VS recruitment by post-response reward-anticipation, and ADP had appreciable subthreshold VS activation. Both groups also showed similar mesolimbic responses to reward deliveries. Across all subjects, a questionnaire measure of “hot” impulsivity correlated with VS recruitment by post-response anticipation of low rewards and with VS recruitment by delivery of low rewards. These findings indicate that incentive-motivational processing of nondrug rewards is substantially maintained in recovering alcoholics, and that reward-elicited VS recruitment correlates more with individual differences in trait impulsivity irrespective of addiction. PMID:22281932

  2. Heightened Activity in Social Reward Networks is Associated with Adolescents’ Risky Sexual Behaviors

    PubMed Central

    Eckstrand, Kristen L.; Choukas-Bradley, Sophia; Mohanty, Arpita; Cross, Marissa; Allen, Nicholas B.; Silk, Jennifer S.; Jones, Neil P.; Forbes, Erika E.

    2018-01-01

    Adolescent sexual risk behavior can lead to serious health consequences, yet few investigations have addressed its neurodevelopmental mechanisms. Social neurocircuitry is postulated to underlie the development of risky sexual behavior, and response to social reward may be especially relevant. Typically developing adolescents (N=47; 18M, 29F; 16.3±1.4 years; 42.5% sexual intercourse experience) completed a social reward fMRI task and reported their sexual risk behaviors (e.g., lifetime sexual partners) on the Youth Risk Behavior Survey (YRBS). Neural response and functional connectivity to social reward were compared for adolescents with higher- and lower-risk sexual behavior. Adolescents with higher-risk sexual behaviors demonstrated increased activation in the right precuneus and the right temporoparietal junction during receipt of social reward. Adolescents with higher-risk sexual behaviors also demonstrated greater functional connectivity between the precuneus and the temporoparietal junction bilaterally, dorsal medial prefrontal cortex, and left anterior insula/ventrolateral prefrontal cortex. The greater activation and functional connectivity in self-referential, social reward, and affective processing regions among higher sexual risk adolescents underscores the importance of social influence underlying sexual risk behaviors. Furthermore, results suggest an orientation towards and sensitivity to social rewards among youth engaging in higher-risk sexual behavior, perhaps as a consequence of or vulnerability to such behavior. PMID:28755632

  3. Heightened activity in social reward networks is associated with adolescents' risky sexual behaviors.

    PubMed

    Eckstrand, Kristen L; Choukas-Bradley, Sophia; Mohanty, Arpita; Cross, Marissa; Allen, Nicholas B; Silk, Jennifer S; Jones, Neil P; Forbes, Erika E

    2017-10-01

    Adolescent sexual risk behavior can lead to serious health consequences, yet few investigations have addressed its neurodevelopmental mechanisms. Social neurocircuitry is postulated to underlie the development of risky sexual behavior, and response to social reward may be especially relevant. Typically developing adolescents (N=47; 18M, 29F; 16.3±1.4years; 42.5% sexual intercourse experience) completed a social reward fMRI task and reported their sexual risk behaviors (e.g., lifetime sexual partners) on the Youth Risk Behavior Survey (YRBS). Neural response and functional connectivity to social reward were compared for adolescents with higher- and lower-risk sexual behavior. Adolescents with higher-risk sexual behaviors demonstrated increased activation in the right precuneus and the right temporoparietal junction during receipt of social reward. Adolescents with higher-risk sexual behaviors also demonstrated greater functional connectivity between the precuneus and the temporoparietal junction bilaterally, dorsal medial prefrontal cortex, and left anterior insula/ventrolateral prefrontal cortex. The greater activation and functional connectivity in self-referential, social reward, and affective processing regions among higher sexual risk adolescents underscores the importance of social influence underlying sexual risk behaviors. Furthermore, results suggest an orientation towards and sensitivity to social rewards among youth engaging in higher-risk sexual behavior, perhaps as a consequence of or vulnerability to such behavior. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

  4. Pain and suicidality: Insights from reward and addiction neuroscience

    PubMed Central

    Elman, Igor; Borsook, David; Volkow, Nora D.

    2016-01-01

    Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system’s role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward circuitry); both are relevant etiologic factors in pain, suicide and social attachments. A comprehensive literature search on neurobiology of pain and suicidality was performed. The collected articles were critically reviewed and relevant data were extracted and summarized within four key areas: (1) physical and emotional pain, (2) emotional pain and social attachments, (3) pain-and suicide-related alterations of the reward and anti-reward circuits as compared to addiction, which is the premier probe for dysfunction of these circuits and (4) mechanistically informed treatments of co-occurring pain and suicidality. Pain-, stress- and analgesic drugs-induced opponent and proponent states of the mesolimbic dopaminergic pathways may render reward and anti-reward systems vulnerable to sensitization, cross-sensitization and aberrant learning of contents and contexts associated with suicidal acts and behaviors. These findings suggest that pain patients exhibit alterations in the brain circuits mediating reward (depressed function) and anti-reward (sensitized function) that may affect their proclivity for suicide and support pain and suicidality classification among other “reward deficiency syndromes” and a new proposal for “enhanced anti-reward syndromes”. We suggest that interventions aimed at restoring the balance between the reward and anti-reward networks in patients with chronic pain may help decreasing their suicide risk. PMID:23827972

  5. Pain and suicidality: insights from reward and addiction neuroscience.

    PubMed

    Elman, Igor; Borsook, David; Volkow, Nora D

    2013-10-01

    Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system's role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward circuitry); both are relevant etiologic factors in pain, suicide and social attachments. A comprehensive literature search on neurobiology of pain and suicidality was performed. The collected articles were critically reviewed and relevant data were extracted and summarized within four key areas: (1) physical and emotional pain, (2) emotional pain and social attachments, (3) pain- and suicide-related alterations of the reward and anti-reward circuits as compared to addiction, which is the premier probe for dysfunction of these circuits and (4) mechanistically informed treatments of co-occurring pain and suicidality. Pain-, stress- and analgesic drugs-induced opponent and proponent states of the mesolimbic dopaminergic pathways may render reward and anti-reward systems vulnerable to sensitization, cross-sensitization and aberrant learning of contents and contexts associated with suicidal acts and behaviors. These findings suggest that pain patients exhibit alterations in the brain circuits mediating reward (depressed function) and anti-reward (sensitized function) that may affect their proclivity for suicide and support pain and suicidality classification among other "reward deficiency syndromes" and a new proposal for "enhanced anti-reward syndromes". We suggest that interventions aimed at restoring the balance between the reward and anti-reward networks in patients with chronic pain may help decreasing their suicide risk. Published by Elsevier Ltd.

  6. Frequency and function in the basal ganglia: the origins of beta and gamma band activity.

    PubMed

    Blenkinsop, Alexander; Anderson, Sean; Gurney, Kevin

    2017-07-01

    Neuronal oscillations in the basal ganglia have been observed to correlate with behaviours, although the causal mechanisms and functional significance of these oscillations remain unknown. We present a novel computational model of the healthy basal ganglia, constrained by single unit recordings from non-human primates. When the model is run using inputs that might be expected during performance of a motor task, the network shows emergent phenomena: it functions as a selection mechanism and shows spectral properties that match those seen in vivo. Beta frequency oscillations are shown to require pallido-striatal feedback, and occur with behaviourally relevant cortical input. Gamma oscillations arise in the subthalamic-globus pallidus feedback loop, and occur during movement. The model provides a coherent framework for the study of spectral, temporal and functional analyses of the basal ganglia and lays the foundation for an integrated approach to study basal ganglia pathologies such as Parkinson's disease in silico. Neural oscillations in the basal ganglia (BG) are well studied yet remain poorly understood. Behavioural correlates of spectral activity are well described, yet a quantitative hypothesis linking time domain dynamics and spectral properties to BG function has been lacking. We show, for the first time, that a unified description is possible by interpreting previously ignored structure in data describing globus pallidus interna responses to cortical stimulation. These data were used to expose a pair of distinctive neuronal responses to the stimulation. This observation formed the basis for a new mathematical model of the BG, quantitatively fitted to the data, which describes the dynamics in the data, and is validated against other stimulus protocol experiments. A key new result is that when the model is run using inputs hypothesised to occur during the performance of a motor task, beta and gamma frequency oscillations emerge naturally during static-force and

  7. The vagal ganglia transcriptome identifies candidate therapeutics for airway hyperreactivity.

    PubMed

    Reznikov, Leah R; Meyerholz, David K; Abou Alaiwa, Mahmoud H; Kuan, Shin-Ping; Liao, Yan-Shin J; Bormann, Nicholas L; Bair, Thomas B; Price, Margaret; Stoltz, David A; Welsh, Michael J

    2018-04-05

    Mainstay therapeutics are ineffective in some people with asthma, suggesting a need for additional agents. In the current study, we used vagal ganglia transcriptome profiling and connectivity mapping to identify compounds beneficial for alleviating airway hyperreactivity. As a comparison, we also utilized previously published transcriptome data from sensitized mouse lungs and human asthmatic endobronchial biopsies. All transcriptomes revealed agents beneficial for mitigating airway hyperreactivity; however, only the vagal ganglia transcriptome identified agents used clinically to treat asthma (flunisolide, isoetarine). We also tested one compound identified by vagal ganglia transcriptome profiling that had not previously been linked to asthma and found that it had bronchodilator effects in both mouse and pig airways. These data suggest that transcriptome profiling of the vagal ganglia might be a novel strategy to identify potential asthma therapeutics.

  8. Dopamine modulates striatal response to reward and punishment in patients with Parkinson's disease: a pharmacological challenge fMRI study.

    PubMed

    Argyelan, Miklos; Herzallah, Mohammad; Sako, Wataru; DeLucia, Ivana; Sarpal, Deepak; Vo, An; Fitzpatrick, Toni; Moustafa, Ahmed A; Eidelberg, David; Gluck, Mark

    2018-05-02

    It is well established that Parkinson's disease leads to impaired learning from reward and enhanced learning from punishment. The administration of dopaminergic medications reverses this learning pattern. However, few studies have investigated the neural underpinnings of these cognitive processes. In this study, using fMRI, we tested a group of Parkinson's disease patients on and off dopaminergic medications and matched healthy individuals. All individuals completed an fMRI cognitive task that dissociates feedback learning from reward versus punishment. The administration of dopaminergic medications attenuated blood oxygen level dependent (BOLD) responses to punishment in the bilateral putamen, in bilateral dorsolateral prefrontal cortex and the left premotor cortex. Further, the administration of dopaminergic medications resulted in a higher ratio of BOLD activity between reward and punishment trials in these brain areas. BOLD activity in these brain areas was significantly correlated with learning from punishment, but not from reward trials. Furthermore, the administration of dopaminergic medications altered BOLD activity in the right insula and ventromedial prefrontal cortex when Parkinson's disease patients were anticipating feedback. These findings are in agreement with a large body of literature indicating that Parkinson's disease is associated with enhanced learning from punishment. However, it was surprising that dopaminergic medications modulated punishment learning as opposed to reward learning, although reward learning has been directly linked to dopaminergic function. We argue that these results might be attributed to both a change in the balance between direct and indirect pathway activation in the basal ganglia as well as the differential activity of D1 versus D2 dopamine receptors.

  9. THE SIGNIFICANCE OF LESIONS IN PERIPHERAL GANGLIA IN CHIMPANZEE AND IN HUMAN POLIOMYELITIS

    PubMed Central

    Bodian, David; Howe, Howard A.

    1947-01-01

    1. The peripheral ganglia of eighteen inoculated chimpanzees and thirteen uninoculated controls, and of eighteen fatal human poliomyelitis cases, were studied for histopathological evidence of the route of transmission of virus from the alimentary tract to the CNS. 2. Lesions thought to be characteristic of poliomyelitis in inoculated chimpanzees could not be sharply differentiated from lesions of unknown origin in uninoculated control animals. Moreover, although the inoculated animals as a group, in comparison with the control animals, had a greater number of infiltrative lesions in sympathetic as well as in sensory ganglia, it was not possible to make satisfactory correlations between the distribution of these lesions and the routes of inoculation. 3. In sharp contrast with chimpanzees, the celiac and stellate ganglia of the human poliomyelitis cases were free of any but insignificant infiltrative lesions. Lesions in human trigeminal and spinal sensory ganglia included neuronal damage as well as focal and perivascular inflitrative lesions, as is well known. In most ganglia, as in monkey and chimpanzee sensory ganglia, these were correlated in intensify with the degree of severity of lesions in the region of the CNS receiving their axons. This suggested that lesions in sensory ganglia probably resulted from spread of virus centrifugally from the CNS, in accord with considerable experimental evidence. 4. Two principal difficulties in the interpretation of histopathological findings in peripheral ganglia were revealed by this study. The first is that the specificity of lesions in sympathetic ganglia has not been established beyond doubt as being due to poliomyelitis. The second is that the presence of characteristic lesions in sensory ganglia does not, and cannot, reveal whether the virus reached the ganglia from the periphery or from the central nervous system, except in very early preparalytic stages or in exceptional cases of early arrest of virus spread and of

  10. Irregular behavior in an excitatory-inhibitory neuronal network

    NASA Astrophysics Data System (ADS)

    Park, Choongseok; Terman, David

    2010-06-01

    Excitatory-inhibitory networks arise in many regions throughout the central nervous system and display complex spatiotemporal firing patterns. These neuronal activity patterns (of individual neurons and/or the whole network) are closely related to the functional status of the system and differ between normal and pathological states. For example, neurons within the basal ganglia, a group of subcortical nuclei that are responsible for the generation of movement, display a variety of dynamic behaviors such as correlated oscillatory activity and irregular, uncorrelated spiking. Neither the origins of these firing patterns nor the mechanisms that underlie the patterns are well understood. We consider a biophysical model of an excitatory-inhibitory network in the basal ganglia and explore how specific biophysical properties of the network contribute to the generation of irregular spiking. We use geometric dynamical systems and singular perturbation methods to systematically reduce the model to a simpler set of equations, which is suitable for analysis. The results specify the dependence on the strengths of synaptic connections and the intrinsic firing properties of the cells in the irregular regime when applied to the subthalamopallidal network of the basal ganglia.

  11. Common and distinct networks underlying reward valence and processing stages: A meta-analysis of functional neuroimaging studies

    PubMed Central

    Liu, Xun; Hairston, Jacqueline; Schrier, Madeleine; Fan, Jin

    2011-01-01

    To better understand the reward circuitry in human brain, we conducted activation likelihood estimation (ALE) and parametric voxel-based meta-analyses (PVM) on 142 neuroimaging studies that examined brain activation in reward-related tasks in healthy adults. We observed several core brain areas that participated in reward-related decision making, including the nucleus accumbens (NAcc), caudate, putamen, thalamus, orbitofrontal cortex (OFC), bilateral anterior insula, anterior (ACC) and posterior (PCC) cingulate cortex, as well as cognitive control regions in the inferior parietal lobule and prefrontal cortex (PFC). The NAcc was commonly activated by both positive and negative rewards across various stages of reward processing (e.g., anticipation, outcome, and evaluation). In addition, the medial OFC and PCC preferentially responded to positive rewards, whereas the ACC, bilateral anterior insula, and lateral PFC selectively responded to negative rewards. Reward anticipation activated the ACC, bilateral anterior insula, and brain stem, whereas reward outcome more significantly activated the NAcc, medial OFC, and amygdala. Neurobiological theories of reward-related decision making should therefore distributed and interrelated representations of reward valuation and valence assessment into account. PMID:21185861

  12. Development of extracellular matrix in chick paravertebral sympathetic ganglia.

    PubMed

    Luckenbill-Edds, L

    1986-08-01

    Alcian blue staining coupled with enzyme digestion or critical electrolyte staining revealed differences in the development of extracellular matrix (ECM) within sympathetic ganglia compared with the surrounding capsule. On day 5 of chick development (Hamburger-Hamilton stage 26) only hyaluronic acid (HA) could be detected in the ECM surrounding condensing primary ganglia. By day 7 (st 30) the ganglionic capsule contained HA, as well as sulfated glycosaminoglycans (GAGs), and this pattern continued into the adult stage. During the later stages of embryonic life (st 41-45) satellite cells appear, showing fine structural characteristics that point to their role in the secretion of intraganglionic ECM. Only during these stages could ECM be detected histochemically within ganglia, the same stages (days 15-19) when routine electron microscopic methods reveal collagen fibrils embedded in a granular ground substance. Thus, the intraganglionic environment appears as a separate compartment free of detectable amounts of GAG until late embryonic stages when ECM is secreted around satellite cells. This developmental pattern could represent a role of ECM in the histological stabilization of ganglia during the late stages of differentiation, since the appearance of intraganglionic ECM is correlated with the appearance of small dense-cored vesicles characteristic of adult neurons. The developmental pattern of ECM in differentiating sympathetic ganglia is compared with that of other tissues that undergo condensation and morphogenesis.

  13. A Fly's Eye View of Natural and Drug Reward.

    PubMed

    Lowenstein, Eve G; Velazquez-Ulloa, Norma A

    2018-01-01

    Animals encounter multiple stimuli each day. Some of these stimuli are innately appetitive or aversive, while others are assigned valence based on experience. Drugs like ethanol can elicit aversion in the short term and attraction in the long term. The reward system encodes the predictive value for different stimuli, mediating anticipation for attractive or punishing stimuli and driving animal behavior to approach or avoid conditioned stimuli. The neurochemistry and neurocircuitry of the reward system is partly evolutionarily conserved. In both vertebrates and invertebrates, including Drosophila melanogaster , dopamine is at the center of a network of neurotransmitters and neuromodulators acting in concert to encode rewards. Behavioral assays in D. melanogaster have become increasingly sophisticated, allowing more direct comparison with mammalian research. Moreover, recent evidence has established the functional modularity of the reward neural circuits in Drosophila . This functional modularity resembles the organization of reward circuits in mammals. The powerful genetic and molecular tools for D. melanogaster allow characterization and manipulation at the single-cell level. These tools are being used to construct a detailed map of the neural circuits mediating specific rewarding stimuli and have allowed for the identification of multiple genes and molecular pathways that mediate the effects of reinforcing stimuli, including their rewarding effects. This report provides an overview of the research on natural and drug reward in D. melanogaster , including natural rewards such as sugar and other food nutrients, and drug rewards including ethanol, cocaine, amphetamine, methamphetamine, and nicotine. We focused mainly on the known genetic and neural mechanisms underlying appetitive reward for sugar and reward for ethanol. We also include genes, molecular pathways, and neural circuits that have been identified using assays that test the palatability of the rewarding

  14. BOLD responses in reward regions to hypothetical and imaginary monetary rewards

    PubMed Central

    Miyapuram, Krishna P.; Tobler, Philippe N.; Gregorios-Pippas, Lucy; Schultz, Wolfram

    2015-01-01

    Monetary rewards are uniquely human. Because money is easy to quantify and present visually, it is the reward of choice for most fMRI studies, even though it cannot be handed over to participants inside the scanner. A typical fMRI study requires hundreds of trials and thus small amounts of monetary rewards per trial (e.g. 5p) if all trials are to be treated equally. However, small payoffs can have detrimental effects on performance due to their limited buying power. Hypothetical monetary rewards can overcome the limitations of smaller monetary rewards but it is less well known whether predictors of hypothetical rewards activate reward regions. In two experiments, visual stimuli were associated with hypothetical monetary rewards. In Experiment 1, we used stimuli predicting either visually presented or imagined hypothetical monetary rewards, together with non-rewarding control pictures. Activations to reward predictive stimuli occurred in reward regions, namely the medial orbitofrontal cortex and midbrain. In Experiment 2, we parametrically varied the amount of visually presented hypothetical monetary reward keeping constant the amount of actually received reward. Graded activation in midbrain was observed to stimuli predicting increasing hypothetical rewards. The results demonstrate the efficacy of using hypothetical monetary rewards in fMRI studies. PMID:21985912

  15. BOLD responses in reward regions to hypothetical and imaginary monetary rewards.

    PubMed

    Miyapuram, Krishna P; Tobler, Philippe N; Gregorios-Pippas, Lucy; Schultz, Wolfram

    2012-01-16

    Monetary rewards are uniquely human. Because money is easy to quantify and present visually, it is the reward of choice for most fMRI studies, even though it cannot be handed over to participants inside the scanner. A typical fMRI study requires hundreds of trials and thus small amounts of monetary rewards per trial (e.g. 5p) if all trials are to be treated equally. However, small payoffs can have detrimental effects on performance due to their limited buying power. Hypothetical monetary rewards can overcome the limitations of smaller monetary rewards but it is less well known whether predictors of hypothetical rewards activate reward regions. In two experiments, visual stimuli were associated with hypothetical monetary rewards. In Experiment 1, we used stimuli predicting either visually presented or imagined hypothetical monetary rewards, together with non-rewarding control pictures. Activations to reward predictive stimuli occurred in reward regions, namely the medial orbitofrontal cortex and midbrain. In Experiment 2, we parametrically varied the amount of visually presented hypothetical monetary reward keeping constant the amount of actually received reward. Graded activation in midbrain was observed to stimuli predicting increasing hypothetical rewards. The results demonstrate the efficacy of using hypothetical monetary rewards in fMRI studies. Copyright © 2011 Elsevier Inc. All rights reserved.

  16. Interactions between the nucleus accumbens and auditory cortices predict music reward value.

    PubMed

    Salimpoor, Valorie N; van den Bosch, Iris; Kovacevic, Natasa; McIntosh, Anthony Randal; Dagher, Alain; Zatorre, Robert J

    2013-04-12

    We used functional magnetic resonance imaging to investigate neural processes when music gains reward value the first time it is heard. The degree of activity in the mesolimbic striatal regions, especially the nucleus accumbens, during music listening was the best predictor of the amount listeners were willing to spend on previously unheard music in an auction paradigm. Importantly, the auditory cortices, amygdala, and ventromedial prefrontal regions showed increased activity during listening conditions requiring valuation, but did not predict reward value, which was instead predicted by increasing functional connectivity of these regions with the nucleus accumbens as the reward value increased. Thus, aesthetic rewards arise from the interaction between mesolimbic reward circuitry and cortical networks involved in perceptual analysis and valuation.

  17. CREB1 Genotype Modulates Adaptive Reward-Based Decisions in Humans.

    PubMed

    Wolf, Claudia; Mohr, Holger; Diekhof, Esther K; Vieker, Henning; Goya-Maldonado, Roberto; Trost, Sarah; Krämer, Bernd; Keil, Maria; Binder, Elisabeth B; Gruber, Oliver

    2016-07-01

    Cyclic AMP response element-binding protein (CREB) contributes to adaptation of mesocorticolimbic networks by modulating activity-regulated transcription and plasticity in neurons. Activity or expression changes of CREB in the nucleus accumbens (NAc) and orbital frontal cortex (OFC) interact with behavioral changes during reward-motivated learning. However, these findings from animal models have not been evaluated in humans. We tested whether CREB1 genotypes affect reward-motivated decisions and related brain activation, using BOLD fMRI in 224 young and healthy participants. More specifically, participants needed to adapt their decision to either pursue or resist immediate rewards to optimize the reward outcome. We found significant CREB1 genotype effects on choices to pursue increases of the reward outcome and on BOLD signal in the NAc, OFC, insula cortex, cingulate gyrus, hippocampus, amygdala, and precuneus during these decisions in comparison with those decisions avoiding total reward loss. Our results suggest that CREB1 genotype effects in these regions could contribute to individual differences in reward- and associative memory-based decision-making. © The Author 2015. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

  18. Statistical Mechanics of the Delayed Reward-Based Learning with Node Perturbation

    NASA Astrophysics Data System (ADS)

    Hiroshi Saito,; Kentaro Katahira,; Kazuo Okanoya,; Masato Okada,

    2010-06-01

    In reward-based learning, reward is typically given with some delay after a behavior that causes the reward. In machine learning literature, the framework of the eligibility trace has been used as one of the solutions to handle the delayed reward in reinforcement learning. In recent studies, the eligibility trace is implied to be important for difficult neuroscience problem known as the “distal reward problem”. Node perturbation is one of the stochastic gradient methods from among many kinds of reinforcement learning implementations, and it searches the approximate gradient by introducing perturbation to a network. Since the stochastic gradient method does not require a objective function differential, it is expected to be able to account for the learning mechanism of a complex system, like a brain. We study the node perturbation with the eligibility trace as a specific example of delayed reward-based learning, and analyzed it using a statistical mechanics approach. As a result, we show the optimal time constant of the eligibility trace respect to the reward delay and the existence of unlearnable parameter configurations.

  19. Effects of Electrical and Optogenetic Deep Brain Stimulation on Synchronized Oscillatory Activity in Parkinsonian Basal Ganglia.

    PubMed

    Ratnadurai-Giridharan, Shivakeshavan; Cheung, Chung C; Rubchinsky, Leonid L

    2017-11-01

    Conventional deep brain stimulation of basal ganglia uses high-frequency regular electrical pulses to treat Parkinsonian motor symptoms but has a series of limitations. Relatively new and not yet clinically tested, optogenetic stimulation is an effective experimental stimulation technique to affect pathological network dynamics. We compared the effects of electrical and optogenetic stimulation of the basal gangliaon the pathologicalParkinsonian rhythmic neural activity. We studied the network response to electrical stimulation and excitatory and inhibitory optogenetic stimulations. Different stimulations exhibit different interactions with pathological activity in the network. We studied these interactions for different network and stimulation parameter values. Optogenetic stimulation was found to be more efficient than electrical stimulation in suppressing pathological rhythmicity. Our findings indicate that optogenetic control of neural synchrony may be more efficacious than electrical control because of the different ways of how stimulations interact with network dynamics.

  20. Reward positivity: Reward prediction error or salience prediction error?

    PubMed

    Heydari, Sepideh; Holroyd, Clay B

    2016-08-01

    The reward positivity is a component of the human ERP elicited by feedback stimuli in trial-and-error learning and guessing tasks. A prominent theory holds that the reward positivity reflects a reward prediction error signal that is sensitive to outcome valence, being larger for unexpected positive events relative to unexpected negative events (Holroyd & Coles, 2002). Although the theory has found substantial empirical support, most of these studies have utilized either monetary or performance feedback to test the hypothesis. However, in apparent contradiction to the theory, a recent study found that unexpected physical punishments also elicit the reward positivity (Talmi, Atkinson, & El-Deredy, 2013). The authors of this report argued that the reward positivity reflects a salience prediction error rather than a reward prediction error. To investigate this finding further, in the present study participants navigated a virtual T maze and received feedback on each trial under two conditions. In a reward condition, the feedback indicated that they would either receive a monetary reward or not and in a punishment condition the feedback indicated that they would receive a small shock or not. We found that the feedback stimuli elicited a typical reward positivity in the reward condition and an apparently delayed reward positivity in the punishment condition. Importantly, this signal was more positive to the stimuli that predicted the omission of a possible punishment relative to stimuli that predicted a forthcoming punishment, which is inconsistent with the salience hypothesis. © 2016 Society for Psychophysiological Research.

  1. Rewards.

    PubMed

    Gunderman, Richard B; Kamer, Aaron P

    2011-05-01

    For much of the 20th century, psychologists and economists operated on the assumption that work is devoid of intrinsic rewards, and the only way to get people to work harder is through the use of rewards and punishments. This so-called carrot-and-stick model of workplace motivation, when applied to medical practice, emphasizes the use of financial incentives and disincentives to manipulate behavior. More recently, however, it has become apparent that, particularly when applied to certain kinds of work, such approaches can be ineffective or even frankly counterproductive. Instead of focusing on extrinsic rewards such as compensation, organizations and their leaders need to devote more attention to the intrinsic rewards of work itself. This article reviews this new understanding of rewards and traces out its practical implications for radiology today. Copyright © 2011. Published by Elsevier Inc.

  2. Favorite brands as cultural objects modulate reward circuit.

    PubMed

    Schaefer, Michael; Rotte, Michael

    2007-01-22

    On the basis of the hypothesis that brands may function as reward stimuli, we investigated brain responses to favorite brands. Participants viewed brand logos while we measured cortical activity with functional magnetic resonance imaging. Results revealed activity in the striatum for favorite brands that positively correlated with sports and luxury characteristics, but negatively with attributions to a brand of rational choice. Reduced activation of a single region in the dorsolateral prefrontal cortex was demonstrated when viewing the most beloved brand, possibly suggesting reduced strategic reasoning on the basis of affect. The results propose that brands that have been associated with appetitive stimuli owing to marketing efforts engage brain networks similar to those engaged by artificially associated reward stimuli. Moreover, social stimuli may function as secondary inducers of reward mechanisms.

  3. The expanding universe of disorders of the basal ganglia.

    PubMed

    Obeso, Jose A; Rodriguez-Oroz, Maria C; Stamelou, Maria; Bhatia, Kailash P; Burn, David J

    2014-08-09

    The basal ganglia were originally thought to be associated purely with motor control. However, dysfunction and pathology of different regions and circuits are now known to give rise to many clinical manifestations beyond the association of basal ganglia dysfunction with movement disorders. Moreover, disorders that were thought to be caused by dysfunction of the basal ganglia only, such as Parkinson's disease and Huntington's disease, have diverse abnormalities distributed not only in the brain but also in the peripheral and autonomic nervous systems; this knowledge poses new questions and challenges. We discuss advances and the unanswered questions, and ways in which progress might be made. Copyright © 2014 Elsevier Ltd. All rights reserved.

  4. Cortical stimulation evokes abnormal responses in the dopamine-depleted rat basal ganglia.

    PubMed

    Kita, Hitoshi; Kita, Takako

    2011-07-13

    The motor cortex (MC) sends massive projections to the basal ganglia. Motor disabilities in patients and animal models of Parkinson's disease (PD) may be caused by dopamine (DA)-depleted basal ganglia that abnormally process the information originating from MC. To study how DA depletion alters signal transfer in the basal ganglia, MC stimulation-induced (MC-induced) unitary responses were recorded from the basal ganglia of control and 6-hydroxydopamine-treated hemi-parkinsonian rats anesthetized with isoflurane. This report describes new findings about how DA depletion alters MC-induced responses. MC stimulation evokes an excitation in normally quiescent striatal (Str) neurons projecting to the globus pallidus external segment (GPe). After DA-depletion, the spontaneous firing of Str-GPe neurons increases, and MC stimulation evokes a shorter latency excitation followed by a long-lasting inhibition that was invisible under normal conditions. The increased firing activity and the newly exposed long inhibition generate tonic inhibition and a disfacilitation in GPe. The disfacilitation in GPe is then amplified in basal ganglia circuitry and generates a powerful long inhibition in the basal ganglia output nucleus, the globus pallidus internal segment. Intra-Str injections of a behaviorally effective dose of DA precursor l-3,4-dihydroxyphenylalanine effectively reversed these changes. These newly observed mechanisms also support the generation of pauses and burst activity commonly observed in the basal ganglia of parkinsonian subjects. These results suggest that the generation of abnormal response sequences in the basal ganglia contributes to the development of motor disabilities in PD and that intra-Str DA supplements effectively suppress abnormal signal transfer.

  5. [Distribution of herpes simplex virus type 1 and 2 genomes in the human spinal ganglia].

    PubMed

    Obara, Y

    1994-09-01

    Herpes simplex virus (HSV) is well known for its propensity to cause recurrent oral or genital mucosal infections in humans. HSV-1 is involved primarily in oral lesions, whereas HSV-2 is more frequently involved in genital lesions. Based on this, it is thought that HSV-1 may produce latent infections in trigeminal ganglia, and HSV-2 in the sacral ganglia. However the distribution pattern of latent HSV-1 and HSV-2 infections in spinal ganglia remains unknown. Using the polymerase chain reaction we detected latent herpes HSV-1 and HSV-2 in human spinal ganglia obtained from autopsy material. A pair of primers which were specific for a part of the HSV-1 and HSV-2 DNA polymerase domain were employed. HSV-1 and HSV-2 DNAs were detected in 11 of 40 (28%) and 15 of 40 (38%) cervical ganglia, respectively, 52 of 103 (50%) and 47 of 103 (46%) thoracic ganglia, 16 of 53 (30%) and 17 of 53 (32%) lumbar ganglia, and 3 of 20 (15%) and 3 of 20 (15%) sacral ganglia. These findings suggest that latent HSV-1 and HSV-2 infections have a widespread distribution from the cervical ganglia to sacral ganglia. Importantly this study demonstrated latent HSV-1 infection of both the lumbar and sacral ganglia for the first time.

  6. Neural signal during immediate reward anticipation in schizophrenia: Relationship to real-world motivation and function.

    PubMed

    Subramaniam, Karuna; Hooker, Christine I; Biagianti, Bruno; Fisher, Melissa; Nagarajan, Srikantan; Vinogradov, Sophia

    2015-01-01

    Amotivation in schizophrenia is a central predictor of poor functioning, and is thought to occur due to deficits in anticipating future rewards, suggesting that impairments in anticipating pleasure can contribute to functional disability in schizophrenia. In healthy comparison (HC) participants, reward anticipation is associated with activity in frontal-striatal networks. By contrast, schizophrenia (SZ) participants show hypoactivation within these frontal-striatal networks during this motivated anticipatory brain state. Here, we examined neural activation in SZ and HC participants during the anticipatory phase of stimuli that predicted immediate upcoming reward and punishment, and during the feedback/outcome phase, in relation to trait measures of hedonic pleasure and real-world functional capacity. SZ patients showed hypoactivation in ventral striatum during reward anticipation. Additionally, we found distinct differences between HC and SZ groups in their association between reward-related immediate anticipatory neural activity and their reported experience of pleasure. HC participants recruited reward-related regions in striatum that significantly correlated with subjective consummatory pleasure, while SZ patients revealed activation in attention-related regions, such as the IPL, which correlated with consummatory pleasure and functional capacity. These findings may suggest that SZ patients activate compensatory attention processes during anticipation of immediate upcoming rewards, which likely contribute to their functional capacity in daily life.

  7. Neural signal during immediate reward anticipation in schizophrenia: Relationship to real-world motivation and function

    PubMed Central

    Subramaniam, Karuna; Hooker, Christine I.; Biagianti, Bruno; Fisher, Melissa; Nagarajan, Srikantan; Vinogradov, Sophia

    2015-01-01

    Amotivation in schizophrenia is a central predictor of poor functioning, and is thought to occur due to deficits in anticipating future rewards, suggesting that impairments in anticipating pleasure can contribute to functional disability in schizophrenia. In healthy comparison (HC) participants, reward anticipation is associated with activity in frontal–striatal networks. By contrast, schizophrenia (SZ) participants show hypoactivation within these frontal–striatal networks during this motivated anticipatory brain state. Here, we examined neural activation in SZ and HC participants during the anticipatory phase of stimuli that predicted immediate upcoming reward and punishment, and during the feedback/outcome phase, in relation to trait measures of hedonic pleasure and real-world functional capacity. SZ patients showed hypoactivation in ventral striatum during reward anticipation. Additionally, we found distinct differences between HC and SZ groups in their association between reward-related immediate anticipatory neural activity and their reported experience of pleasure. HC participants recruited reward-related regions in striatum that significantly correlated with subjective consummatory pleasure, while SZ patients revealed activation in attention-related regions, such as the IPL, which correlated with consummatory pleasure and functional capacity. These findings may suggest that SZ patients activate compensatory attention processes during anticipation of immediate upcoming rewards, which likely contribute to their functional capacity in daily life. PMID:26413478

  8. Periosteal ganglia: CT and MR imaging features.

    PubMed

    Abdelwahab, I F; Kenan, S; Hermann, G; Klein, M J; Lewis, M M

    1993-07-01

    The imaging features of four cases of periosteal ganglia were studied. Three lesions were located over the proximal shaft of the tibia, in proximity to the pes anserinus. The fourth lesion involved the distal shaft of the ulna. Three lesions had different degrees of external cortical erosion, scalloping, and thick spicules of periosteal bone on plain radiographs. The bone adjacent to the fourth lesion was not involved. Computed tomography (CT) showed these lesions to be sharply defined soft-tissue masses abutting the periosteum. All of the lesions had the same attenuation as fluid. Magnetic resonance (MR) imaging revealed the ganglia to be sharply defined masses that were isointense compared with neighboring muscles on T1-weighted images. There was markedly increased signal intensity compared with that of fat on T2-weighted images. The signal intensity on both types of images was homogeneous. The MR imaging features were consistent with the fluid nature of the lesions. Under the appropriate clinical circumstances, the MR imaging and CT features of periosteal ganglia are diagnostic.

  9. Listening to music in a risk-reward context: The roles of the temporoparietal junction and the orbitofrontal/insular cortices in reward-anticipation, reward-gain, and reward-loss.

    PubMed

    Li, Chia-Wei; Chen, Jyh-Horng; Tsai, Chen-Gia

    2015-12-10

    Artificial rewards, such as visual arts and music, produce pleasurable feelings. Popular songs in the verse-chorus form provide a useful model for understanding the neural mechanisms underlying the processing of artificial rewards, because the chorus is usually the most rewarding element of a song. In this functional magnetic resonance imaging (fMRI) study, the stimuli were excerpts of 10 popular songs with a tensioned verse-to-chorus transition. We examined the neural correlates of three phases of reward processing: (1) reward-anticipation during the verse-to-chorus transition, (2) reward-gain during the first phrase of the chorus, and (3) reward-loss during the unexpected noise followed by the verse-to-chorus transition. Participants listened to these excerpts in a risk-reward context because the verse was followed by either the chorus or noise with equal probability. The results showed that reward-gain and reward-loss were associated with left- and right-biased temporoparietal junction activation, respectively. The bilateral temporoparietal junctions were active during reward-anticipation. Moreover, we observed left-biased lateral orbitofrontal activation during reward-anticipation, whereas the medial orbitofrontal cortex was activated during reward-gain. The findings are discussed in relation to the cognitive and emotional aspects of reward processing. Copyright © 2015 Elsevier B.V. All rights reserved.

  10. Basal Ganglia Perfusion in Fibromyalgia is Related to Pain Disability and Disease Impact: An Arterial Spin Labeling Study.

    PubMed

    Shokouhi, Mahsa; Davis, Karen D; Moulin, Dwight E; Morley-Forster, Pat; Nielson, Warren R; Bureau, Yves; St Lawrence, Keith

    2016-06-01

    Pain disability is a major impediment to fibromyalgia (FM) patients' quality of life. Neuroimaging studies have demonstrated abnormal pain processing in FM. However, it is not known whether there are brain abnormalities linked to pain disability. Understanding neural correlates of pain disability in FM, independent from pain intensity, could provide a framework to guide future more efficient therapy strategies to improve patients' functional ability. We used arterial spin labeling to image cerebral blood flow (CBF) in 23 FM patients and 16 controls. Functional connectivity was also estimated using blood oxygenation level-dependent imaging to further investigate the possible underpinnings of the observed CBF changes. Among patients, CBF in the basal ganglia correlated negatively with pain disability index and positively with the overall impact of FM (Fibromyalgia Impact Questionnaire) but did not correlate with pain intensity. Whole-brain analysis revealed no CBF differences between the 2 groups; however, post hoc analysis in the basal ganglia showed CBF reductions mainly in the right putamen and right lateral globus pallidus in patients, likely reflecting the negative correlation with the pain disability index. However, the connectivity of the corresponding corticobasal ganglia-thalamus loop, that is, motor network (the connection between supplementary motor area, putamen, and thalamus) remained intact. Basal ganglia perfusion reflects long-term symptoms, including somatic and psychological components of FM rather than pain intensity. These CBF findings may reflect differences in behavioral and psychological responses between patients.

  11. Reward deficiency and anti-reward in pain chronification.

    PubMed

    Borsook, D; Linnman, C; Faria, V; Strassman, A M; Becerra, L; Elman, I

    2016-09-01

    Converging lines of evidence suggest that the pathophysiology of pain is mediated to a substantial degree via allostatic neuroadaptations in reward- and stress-related brain circuits. Thus, reward deficiency (RD) represents a within-system neuroadaptation to pain-induced protracted activation of the reward circuits that leads to depletion-like hypodopaminergia, clinically manifested anhedonia, and diminished motivation for natural reinforcers. Anti-reward (AR) conversely pertains to a between-systems neuroadaptation involving over-recruitment of key limbic structures (e.g., the central and basolateral amygdala nuclei, the bed nucleus of the stria terminalis, the lateral tegmental noradrenergic nuclei of the brain stem, the hippocampus and the habenula) responsible for massive outpouring of stressogenic neurochemicals (e.g., norepinephrine, corticotropin releasing factor, vasopressin, hypocretin, and substance P) giving rise to such negative affective states as anxiety, fear and depression. We propose here the Combined Reward deficiency and Anti-reward Model (CReAM), in which biopsychosocial variables modulating brain reward, motivation and stress functions can interact in a 'downward spiral' fashion to exacerbate the intensity, chronicity and comorbidities of chronic pain syndromes (i.e., pain chronification). Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

  12. The basolateral amygdala in reward learning and addiction.

    PubMed

    Wassum, Kate M; Izquierdo, Alicia

    2015-10-01

    Sophisticated behavioral paradigms partnered with the emergence of increasingly selective techniques to target the basolateral amygdala (BLA) have resulted in an enhanced understanding of the role of this nucleus in learning and using reward information. Due to the wide variety of behavioral approaches many questions remain on the circumscribed role of BLA in appetitive behavior. In this review, we integrate conclusions of BLA function in reward-related behavior using traditional interference techniques (lesion, pharmacological inactivation) with those using newer methodological approaches in experimental animals that allow in vivo manipulation of cell type-specific populations and neural recordings. Secondly, from a review of appetitive behavioral tasks in rodents and monkeys and recent computational models of reward procurement, we derive evidence for BLA as a neural integrator of reward value, history, and cost parameters. Taken together, BLA codes specific and temporally dynamic outcome representations in a distributed network to orchestrate adaptive responses. We provide evidence that experiences with opiates and psychostimulants alter these outcome representations in BLA, resulting in long-term modified action. Copyright © 2015 Elsevier Ltd. All rights reserved.

  13. The basolateral amygdala in reward learning and addiction

    PubMed Central

    Wassum, Kate M.; Izquierdo, Alicia

    2015-01-01

    Sophisticated behavioral paradigms partnered with the emergence of increasingly selective techniques to target the basolateral amygdala (BLA) have resulted in an enhanced understanding of the role of this nucleus in learning and using reward information. Due to the wide variety of behavioral approaches many questions remain on the circumscribed role of BLA in appetitive behavior. In this review, we integrate conclusions of BLA function in reward-related behavior using traditional interference techniques (lesion, pharmacological inactivation) with those using newer methodological approaches in experimental animals that allow in vivo manipulation of cell type-specific populations and neural recordings. Secondly, from a review of appetitive behavioral tasks in rodents and monkeys and recent computational models of reward procurement, we derive evidence for BLA as a neural integrator of reward value, history, and cost parameters. Taken together, BLA codes specific and temporally dynamic outcome representations in a distributed network to orchestrate adaptive responses. We provide evidence that experiences with opiates and psychostimulants alter these outcome representations in BLA, resulting in long-term modified action. PMID:26341938

  14. How motivation and reward learning modulate selective attention.

    PubMed

    Bourgeois, A; Chelazzi, L; Vuilleumier, P

    2016-01-01

    Motivational stimuli such as rewards elicit adaptive responses and influence various cognitive functions. Notably, increasing evidence suggests that stimuli with particular motivational values can strongly shape perception and attention. These effects resemble both selective top-down and stimulus-driven attentional orienting, as they depend on internal states but arise without conscious will, yet they seem to reflect attentional systems that are functionally and anatomically distinct from those classically associated with frontoparietal cortical networks in the brain. Recent research in human and nonhuman primates has begun to reveal how reward can bias attentional selection, and where within the cognitive system the signals providing attentional priority are generated. This review aims at describing the different mechanisms sustaining motivational attention, their impact on different behavioral tasks, and current knowledge concerning the neural networks governing the integration of motivational influences on attentional behavior. © 2016 Elsevier B.V. All rights reserved.

  15. A Fly’s Eye View of Natural and Drug Reward

    PubMed Central

    Lowenstein, Eve G.; Velazquez-Ulloa, Norma A.

    2018-01-01

    Animals encounter multiple stimuli each day. Some of these stimuli are innately appetitive or aversive, while others are assigned valence based on experience. Drugs like ethanol can elicit aversion in the short term and attraction in the long term. The reward system encodes the predictive value for different stimuli, mediating anticipation for attractive or punishing stimuli and driving animal behavior to approach or avoid conditioned stimuli. The neurochemistry and neurocircuitry of the reward system is partly evolutionarily conserved. In both vertebrates and invertebrates, including Drosophila melanogaster, dopamine is at the center of a network of neurotransmitters and neuromodulators acting in concert to encode rewards. Behavioral assays in D. melanogaster have become increasingly sophisticated, allowing more direct comparison with mammalian research. Moreover, recent evidence has established the functional modularity of the reward neural circuits in Drosophila. This functional modularity resembles the organization of reward circuits in mammals. The powerful genetic and molecular tools for D. melanogaster allow characterization and manipulation at the single-cell level. These tools are being used to construct a detailed map of the neural circuits mediating specific rewarding stimuli and have allowed for the identification of multiple genes and molecular pathways that mediate the effects of reinforcing stimuli, including their rewarding effects. This report provides an overview of the research on natural and drug reward in D. melanogaster, including natural rewards such as sugar and other food nutrients, and drug rewards including ethanol, cocaine, amphetamine, methamphetamine, and nicotine. We focused mainly on the known genetic and neural mechanisms underlying appetitive reward for sugar and reward for ethanol. We also include genes, molecular pathways, and neural circuits that have been identified using assays that test the palatability of the rewarding

  16. Anatomy of a Decision: Striato-Orbitofrontal Interactions in Reinforcement Learning, Decision Making, and Reversal

    ERIC Educational Resources Information Center

    Frank, Michael J.; Claus, Eric D.

    2006-01-01

    The authors explore the division of labor between the basal ganglia-dopamine (BG-DA) system and the orbitofrontal cortex (OFC) in decision making. They show that a primitive neural network model of the BG-DA system slowly learns to make decisions on the basis of the relative probability of rewards but is not as sensitive to (a) recency or (b) the…

  17. Electrocorticography reveals beta desynchronization in the basal ganglia-cortical loop during rest tremor in Parkinson’s disease

    PubMed Central

    Qasim, Salman E.; de Hemptinne, Coralie; Swann, Nicole C.; Miocinovic, Svjetlana; Ostrem, Jill L.; Starr, Philip A.

    2015-01-01

    The pathophysiology of rest tremor in Parkinson’s disease (PD) is not well understood, and its severity does not correlate with the severity of other cardinal signs of PD. We hypothesized that tremor-related oscillatory activity in the basal-ganglia-thalamocortical loop might serve as a compensatory mechanism for the excessive beta band synchronization associated with the parkinsonian state. We recorded electrocorticography (ECoG) from the sensorimotor cortex and local field potentials (LFP) from the subthalamic nucleus (STN) in patients undergoing lead implantation for deep brain stimulation (DBS). We analyzed differences in measures of network synchronization during epochs of spontaneous rest tremor, versus epochs without rest tremor, occurring in the same subjects. The presence of tremor was associated with reduced beta power in the cortex and STN. Cortico-cortical coherence and phase-amplitude coupling (PAC) decreased during rest tremor, as did basal ganglia-cortical coherence in the same frequency band. Cortical broadband gamma power was not increased by tremor onset, in contrast to the movement-related gamma increase typically observed at the onset of voluntary movement. These findings suggest that the cortical representation of rest tremor is distinct from that of voluntary movement, and support a model in which tremor acts to decrease beta band synchronization within the basal ganglia-cortical loop. PMID:26639855

  18. Automated segmentation of multifocal basal ganglia T2*-weighted MRI hypointensities

    PubMed Central

    Glatz, Andreas; Bastin, Mark E.; Kiker, Alexander J.; Deary, Ian J.; Wardlaw, Joanna M.; Valdés Hernández, Maria C.

    2015-01-01

    Multifocal basal ganglia T2*-weighted (T2*w) hypointensities, which are believed to arise mainly from vascular mineralization, were recently proposed as a novel MRI biomarker for small vessel disease and ageing. These T2*w hypointensities are typically segmented semi-automatically, which is time consuming, associated with a high intra-rater variability and low inter-rater agreement. To address these limitations, we developed a fully automated, unsupervised segmentation method for basal ganglia T2*w hypointensities. This method requires conventional, co-registered T2*w and T1-weighted (T1w) volumes, as well as region-of-interest (ROI) masks for the basal ganglia and adjacent internal capsule generated automatically from T1w MRI. The basal ganglia T2*w hypointensities were then segmented with thresholds derived with an adaptive outlier detection method from respective bivariate T2*w/T1w intensity distributions in each ROI. Artefacts were reduced by filtering connected components in the initial masks based on their standardised T2*w intensity variance. The segmentation method was validated using a custom-built phantom containing mineral deposit models, i.e. gel beads doped with 3 different contrast agents in 7 different concentrations, as well as with MRI data from 98 community-dwelling older subjects in their seventies with a wide range of basal ganglia T2*w hypointensities. The method produced basal ganglia T2*w hypointensity masks that were in substantial volumetric and spatial agreement with those generated by an experienced rater (Jaccard index = 0.62 ± 0.40). These promising results suggest that this method may have use in automatic segmentation of basal ganglia T2*w hypointensities in studies of small vessel disease and ageing. PMID:25451469

  19. Dorsal root ganglia volume differentiates schwannomatosis and neurofibromatosis 2.

    PubMed

    Godel, Tim; Mautner, Victor-Felix; Farschtschi, Said; Pham, Mirko; Schwarz, Daniel; Kronlage, Moritz; Gugel, Isabel; Heiland, Sabine; Bendszus, Martin; Bäumer, Philipp

    2018-04-01

    Schwannomatosis and neurofibromatosis type 2 are hereditary tumor syndromes, and peripheral neuropathy has been reported in both. We prospectively applied in vivo morphometric measurement of dorsal root ganglia volume in 16 schwannomatosis patients, 14 neurofibromatosis type 2 patients, and 26 healthy controls by magnetic resonance neurography. Compared to healthy controls, dorsal root ganglia hypertrophy was a consistent finding in neurofibromatosis type 2 (L3, + 267%; L4, + 235%; L5, + 241%; S1, + 300%; S2, + 242%; Bonferroni-adjusted p < 0.001) but not in schwannomatosis. Dorsal root ganglia may be a vulnerable site in origination of areflexia and sensory loss and a useful diagnostic marker in neurofibromatosis type 2. Ann Neurol 2018;83:854-857. © 2018 American Neurological Association.

  20. Markov reward processes

    NASA Technical Reports Server (NTRS)

    Smith, R. M.

    1991-01-01

    Numerous applications in the area of computer system analysis can be effectively studied with Markov reward models. These models describe the behavior of the system with a continuous-time Markov chain, where a reward rate is associated with each state. In a reliability/availability model, upstates may have reward rate 1 and down states may have reward rate zero associated with them. In a queueing model, the number of jobs of certain type in a given state may be the reward rate attached to that state. In a combined model of performance and reliability, the reward rate of a state may be the computational capacity, or a related performance measure. Expected steady-state reward rate and expected instantaneous reward rate are clearly useful measures of the Markov reward model. More generally, the distribution of accumulated reward or time-averaged reward over a finite time interval may be determined from the solution of the Markov reward model. This information is of great practical significance in situations where the workload can be well characterized (deterministically, or by continuous functions e.g., distributions). The design process in the development of a computer system is an expensive and long term endeavor. For aerospace applications the reliability of the computer system is essential, as is the ability to complete critical workloads in a well defined real time interval. Consequently, effective modeling of such systems must take into account both performance and reliability. This fact motivates our use of Markov reward models to aid in the development and evaluation of fault tolerant computer systems.

  1. Beyond reward prediction errors: the role of dopamine in movement kinematics

    PubMed Central

    Barter, Joseph W.; Li, Suellen; Lu, Dongye; Bartholomew, Ryan A.; Rossi, Mark A.; Shoemaker, Charles T.; Salas-Meza, Daniel; Gaidis, Erin; Yin, Henry H.

    2015-01-01

    We recorded activity of dopamine (DA) neurons in the substantia nigra pars compacta in unrestrained mice while monitoring their movements with video tracking. Our approach allows an unbiased examination of the continuous relationship between single unit activity and behavior. Although DA neurons show characteristic burst firing following cue or reward presentation, as previously reported, their activity can be explained by the representation of actual movement kinematics. Unlike neighboring pars reticulata GABAergic output neurons, which can represent vector components of position, DA neurons represent vector components of velocity or acceleration. We found neurons related to movements in four directions—up, down, left, right. For horizontal movements, there is significant lateralization of neurons: the left nigra contains more rightward neurons, whereas the right nigra contains more leftward neurons. The relationship between DA activity and movement kinematics was found on both appetitive trials using sucrose and aversive trials using air puff, showing that these neurons belong to a velocity control circuit that can be used for any number of purposes, whether to seek reward or to avoid harm. In support of this conclusion, mimicry of the phasic activation of DA neurons with selective optogenetic stimulation could also generate movements. Contrary to the popular hypothesis that DA neurons encode reward prediction errors, our results suggest that nigrostriatal DA plays an essential role in controlling the kinematics of voluntary movements. We hypothesize that DA signaling implements gain adjustment for adaptive transition control, and describe a new model of the basal ganglia (BG) in which DA functions to adjust the gain of the transition controller. This model has significant implications for our understanding of movement disorders implicating DA and the BG. PMID:26074791

  2. Alteration of Basal Ganglia and Right Frontoparietal Network in Early Drug-Naïve Parkinson's Disease during Heat Pain Stimuli and Resting State.

    PubMed

    Tan, Ying; Tan, Juan; Deng, Jiayan; Cui, Wenjuan; He, Hui; Yang, Fei; Deng, Hongjie; Xiao, Ruhui; Huang, Zhengkuan; Zhang, Xingxing; Tan, Rui; Shen, Xiaotao; Liu, Tao; Wang, Xiaoming; Yao, Dezhong; Luo, Cheng

    2015-01-01

    The symptoms and pathogenesis of Parkinson's disease (PD) are complicated and an accurate diagnosis of PD is difficult, particularly in early-stage. Because functional magnetic resonance imaging (fMRI) is non-invasive and is characterized by the integration of different brain areas in terms of functional connectivity (FC), fMRI has been widely used in PD research. Non-motor symptom (NMS) features are also frequently present in PD before the onset of classical motor symptoms with pain as the primary NMS. Considering that PD could affect the pain process at multiple levels, we hypothesized that pain is one of the earliest symptoms in PD and investigated whether FC of the pain network was disrupted in PD without pain. To better understand the pathogenesis of pain in PD, we combined resting state and pain-stimuli-induced task state fMRI to identify alterations in FC related to pain in PD. Fourteen early drug-naïve PD without pain and 17 age- and sex-matched healthy controls (HC) participated in our testing task. We used independent component analysis to select seven functional networks related to PD and pain. We focused on abnormalities in FC and in functional network connectivity (FNC) in PD compared with HC during the task (51°C heat pain stimuli) and at rest. Compared with HC, PD showed decreased FC in putamen within basal ganglia network (BGN) in task state and decreased FC in putamen of salience network (SN) and mid-cingulate cortex of sensorimotor network in rest state. FNC between the BGN and the SN are reduced during both states in PD compared with HC. In addition, right frontoparietal network (RFPN), which is considered as a bridge between the SN and default-mode network, was significantly disturbed during the task. These findings suggest that BGN plays a role in the pathological mechanisms of pain underlying PD, and RFPN likely contributes greatly to harmonization between intrinsic brain activity and external stimuli.

  3. Lesions of basal ganglia due to disulfiram neurotoxicity.

    PubMed Central

    Laplane, D; Attal, N; Sauron, B; de Billy, A; Dubois, B

    1992-01-01

    Three cases of disulfiram induced Parkinsonism and frontal lobe-like syndrome associated with bilateral lesions of the lentiform nuclei on CT scan are reported. Symptoms developed either after an acute high dose of disulfiram (one case) or after several days to weeks of disulfiram treatment (two cases) and persisted over several years in two patients. These observations suggest that basal ganglia are one of the major targets of disulfiram neurotoxicity. The mechanisms of the lesions of basal ganglia may involve carbon disulfide toxicity. Images PMID:1431956

  4. Rewards and Performance Incentives.

    ERIC Educational Resources Information Center

    Zigon, Jack

    1994-01-01

    Discusses rewards and performance incentives for employees, including types of rewards; how rewards help in managing; dysfunctional awards; selecting the right reward; how to find rewards that fit; and delivering rewards effectively. Examples are included. (three references) (LRW)

  5. Analysis of T Cell Responses during Active Varicella-Zoster Virus Reactivation in Human Ganglia

    PubMed Central

    Steain, Megan; Sutherland, Jeremy P.; Rodriguez, Michael; Cunningham, Anthony L.; Slobedman, Barry

    2014-01-01

    ABSTRACT Varicella-zoster virus (VZV) is responsible for both varicella (chickenpox) and herpes zoster (shingles). During varicella, the virus establishes latency within the sensory ganglia and can reactivate to cause herpes zoster, but the immune responses that occur in ganglia during herpes zoster have not previously been defined. We examined ganglia obtained from individuals who, at the time of death, had active herpes zoster. Ganglia innervating the site of the cutaneous herpes zoster rash showed evidence of necrosis, secondary to vasculitis, or localized hemorrhage. Despite this, there was limited evidence of VZV antigen expression, although a large inflammatory infiltrate was observed. Characterization of the infiltrating T cells showed a large number of infiltrating CD4+ T cells and cytolytic CD8+ T cells. Many of the infiltrating T cells were closely associated with neurons within the reactivated ganglia, yet there was little evidence of T cell-induced neuronal apoptosis. Notably, an upregulation in the expression of major histocompatibility complex class I (MHC-I) and MHC-II molecules was observed on satellite glial cells, implying these cells play an active role in directing the immune response during herpes zoster. This is the first detailed characterization of the interaction between T cells and neuronal cells within ganglia obtained from patients suffering herpes zoster at the time of death and provides evidence that CD4+ and cytolytic CD8+ T cell responses play an important role in controlling VZV replication in ganglia during active herpes zoster. IMPORTANCE VZV is responsible for both varicella (chickenpox) and herpes zoster (shingles). During varicella, the virus establishes a life-long dormant infection within the sensory ganglia and can reawaken to cause herpes zoster, but the immune responses that occur in ganglia during herpes zoster have not previously been defined. We examined ganglia obtained from individuals who, at the time of death, had

  6. Rewarding peer reviewers: maintaining the integrity of science communication.

    PubMed

    Gasparyan, Armen Yuri; Gerasimov, Alexey N; Voronov, Alexander A; Kitas, George D

    2015-04-01

    This article overviews currently available options for rewarding peer reviewers. Rewards and incentives may help maintain the quality and integrity of scholarly publications. Publishers around the world implemented a variety of financial and nonfinancial mechanisms for incentivizing their best reviewers. None of these is proved effective on its own. A strategy of combined rewards and credits for the reviewers1 creative contributions seems a workable solution. Opening access to reviews and assigning publication credits to the best reviews is one of the latest achievements of digitization. Reviews, posted on academic networking platforms, such as Publons, add to the transparency of the whole system of peer review. Reviewer credits, properly counted and displayed on individual digital profiles, help distinguish the best contributors, invite them to review and offer responsible editorial posts.

  7. Rewarding Peer Reviewers: Maintaining the Integrity of Science Communication

    PubMed Central

    2015-01-01

    This article overviews currently available options for rewarding peer reviewers. Rewards and incentives may help maintain the quality and integrity of scholarly publications. Publishers around the world implemented a variety of financial and nonfinancial mechanisms for incentivizing their best reviewers. None of these is proved effective on its own. A strategy of combined rewards and credits for the reviewers1 creative contributions seems a workable solution. Opening access to reviews and assigning publication credits to the best reviews is one of the latest achievements of digitization. Reviews, posted on academic networking platforms, such as Publons, add to the transparency of the whole system of peer review. Reviewer credits, properly counted and displayed on individual digital profiles, help distinguish the best contributors, invite them to review and offer responsible editorial posts. PMID:25829801

  8. Reward loss and the basolateral amygdala: A function in reward comparisons.

    PubMed

    Kawasaki, Katsuyoshi; Annicchiarico, Iván; Glueck, Amanda C; Morón, Ignacio; Papini, Mauricio R

    2017-07-28

    The neural circuitry underlying behavior in reward loss situations is poorly understood. We considered two such situations: reward devaluation (from large to small rewards) and reward omission (from large rewards to no rewards). There is evidence that the central nucleus of the amygdala (CeA) plays a role in the negative emotion accompanying reward loss. However, little is known about the function of the basolateral nucleus (BLA) in reward loss. Two hypotheses of BLA function in reward loss, negative emotion and reward comparisons, were tested in an experiment involving pretraining excitotoxic BLA lesions followed by training in four tasks: consummatory successive negative contrast (cSNC), autoshaping (AS) acquisition and extinction, anticipatory negative contrast (ANC), and open field testing (OF). Cell counts in the BLA (but not in the CeA) were significantly lower in animals with lesions vs. shams. BLA lesions eliminated cSNC and ANC, and accelerated extinction of lever pressing in AS. BLA lesions had no effect on OF testing: higher activity in the periphery than in the central area. This pattern of results provides support for the hypothesis that BLA neurons are important for reward comparison. The three affected tasks (cSNC, ANC, and AS extinction) involve reward comparisons. However, ANC does not seem to involve negative emotions and it was affected, whereas OF activity is known to involve negative emotion, but it was not affected. It is hypothesized that a circuit involving the thalamus, insular cortex, and BLA is critically involved in the mechanism comparing current and expected rewards. Copyright © 2017 Elsevier B.V. All rights reserved.

  9. Electrocorticography reveals beta desynchronization in the basal ganglia-cortical loop during rest tremor in Parkinson's disease.

    PubMed

    Qasim, Salman E; de Hemptinne, Coralie; Swann, Nicole C; Miocinovic, Svjetlana; Ostrem, Jill L; Starr, Philip A

    2016-02-01

    The pathophysiology of rest tremor in Parkinson's disease (PD) is not well understood, and its severity does not correlate with the severity of other cardinal signs of PD. We hypothesized that tremor-related oscillatory activity in the basal-ganglia-thalamocortical loop might serve as a compensatory mechanism for the excessive beta band synchronization associated with the parkinsonian state. We recorded electrocorticography (ECoG) from the sensorimotor cortex and local field potentials (LFP) from the subthalamic nucleus (STN) in patients undergoing lead implantation for deep brain stimulation (DBS). We analyzed differences in measures of network synchronization during epochs of spontaneous rest tremor, versus epochs without rest tremor, occurring in the same subjects. The presence of tremor was associated with reduced beta power in the cortex and STN. Cortico-cortical coherence and phase-amplitude coupling (PAC) decreased during rest tremor, as did basal ganglia-cortical coherence in the same frequency band. Cortical broadband gamma power was not increased by tremor onset, in contrast to the movement-related gamma increase typically observed at the onset of voluntary movement. These findings suggest that the cortical representation of rest tremor is distinct from that of voluntary movement, and support a model in which tremor acts to decrease beta band synchronization within the basal ganglia-cortical loop. Copyright © 2015 Elsevier Inc. All rights reserved.

  10. High monetary reward rates and caloric rewards decrease temporal persistence

    PubMed Central

    Bode, Stefan; Murawski, Carsten

    2017-01-01

    Temporal persistence refers to an individual's capacity to wait for future rewards, while forgoing possible alternatives. This requires a trade-off between the potential value of delayed rewards and opportunity costs, and is relevant to many real-world decisions, such as dieting. Theoretical models have previously suggested that high monetary reward rates, or positive energy balance, may result in decreased temporal persistence. In our study, 50 fasted participants engaged in a temporal persistence task, incentivised with monetary rewards. In alternating blocks of this task, rewards were delivered at delays drawn randomly from distributions with either a lower or higher maximum reward rate. During some blocks participants received either a caloric drink or water. We used survival analysis to estimate participants' probability of quitting conditional on the delay distribution and the consumed liquid. Participants had a higher probability of quitting in blocks with the higher reward rate. Furthermore, participants who consumed the caloric drink had a higher probability of quitting than those who consumed water. Our results support the predictions from the theoretical models, and importantly, suggest that both higher monetary reward rates and physiologically relevant rewards can decrease temporal persistence, which is a crucial determinant for survival in many species. PMID:28228517

  11. High monetary reward rates and caloric rewards decrease temporal persistence.

    PubMed

    Fung, Bowen J; Bode, Stefan; Murawski, Carsten

    2017-02-22

    Temporal persistence refers to an individual's capacity to wait for future rewards, while forgoing possible alternatives. This requires a trade-off between the potential value of delayed rewards and opportunity costs, and is relevant to many real-world decisions, such as dieting. Theoretical models have previously suggested that high monetary reward rates, or positive energy balance, may result in decreased temporal persistence. In our study, 50 fasted participants engaged in a temporal persistence task, incentivised with monetary rewards. In alternating blocks of this task, rewards were delivered at delays drawn randomly from distributions with either a lower or higher maximum reward rate. During some blocks participants received either a caloric drink or water. We used survival analysis to estimate participants' probability of quitting conditional on the delay distribution and the consumed liquid. Participants had a higher probability of quitting in blocks with the higher reward rate. Furthermore, participants who consumed the caloric drink had a higher probability of quitting than those who consumed water. Our results support the predictions from the theoretical models, and importantly, suggest that both higher monetary reward rates and physiologically relevant rewards can decrease temporal persistence, which is a crucial determinant for survival in many species. © 2017 The Authors.

  12. Neural activation to monetary reward is associated with amphetamine reward sensitivity.

    PubMed

    Crane, Natania A; Gorka, Stephanie M; Weafer, Jessica; Langenecker, Scott A; de Wit, Harriet; Phan, K Luan

    2018-03-14

    One known risk factor for drug use and abuse is sensitivity to rewarding effects of drugs. It is not known whether this risk factor extends to sensitivity to non-drug rewards. In this study with healthy young adults, we examined the association between sensitivity to the subjective rewarding effects of amphetamine and a neural indicator of anticipation of monetary reward. We hypothesized that greater euphorigenic response to amphetamine would be associated with greater neural activation to anticipation of monetary reward (Win > Loss). Healthy participants (N = 61) completed four laboratory sessions in which they received d-amphetamine (20 mg) and placebo in alternating order, providing self-report measures of euphoria and stimulation at regular intervals. At a separate visit 1-3 weeks later, participants completed the guessing reward task (GRT) during fMRI in a drug-free state. Participants reporting greater euphoria after amphetamine also exhibited greater neural activation during monetary reward anticipation in mesolimbic reward regions, including the bilateral caudate and putamen. This is the first study to show a relationship between neural correlates of monetary reward and sensitivity to the subjective rewarding effects of amphetamine in humans. These findings support growing evidence that sensitivity to reward in general is a risk factor for drug use and abuse, and suggest that sensitivity of drug-induced euphoria may reflect a general sensitivity to rewards. This may be an index of vulnerability for drug use or abuse.

  13. Real and hypothetical rewards

    PubMed Central

    Locey, Matthew L.; Jones, Bryan A.; Rachlin, Howard

    2012-01-01

    Laboratory studies of choice and decision making among real monetary rewards typically use smaller real rewards than those common in real life. When laboratory rewards are large, they are almost always hypothetical. In applying laboratory results meaningfully to real-life situations, it is important to know the extent to which choices among hypothetical rewards correspond to choices among real rewards and whether variation of the magnitude of hypothetical rewards affects behavior in meaningful ways. The present study compared real and hypothetical monetary rewards in two experiments. In Experiment 1, participants played a temporal discounting game that incorporates the logic of a repeated prisoner’s-dilemma (PD) type game versus tit-for-tat; choice of one alternative (“defection” in PD terminology) resulted in a small-immediate reward; choice of the other alternative (“cooperation” in PD terminology) resulted in a larger reward delayed until the following trial. The larger-delayed reward was greater for half of the groups than for the other half. Rewards also differed in type across groups: multiples of real nickels, hypothetical nickels or hypothetical hundred-dollar bills. All groups significantly increased choice of the larger delayed reward over the 40 trials of the experiment. Over the last 10 trials, cooperation was significantly higher when the difference between larger and smaller hypothetical rewards was greater. Reward type (real or hypothetical) made no significant difference in cooperation. In Experiment 2, real and hypothetical rewards were compared in social discounting – the decrease in value to the giver of a reward as social distance increases to the receiver of the reward. Social discount rates were well described by a hyperbolic function. Discounting rates for real and hypothetical rewards did not significantly differ. These results add to the evidence that results of experiments with hypothetical rewards validly apply in everyday

  14. Beyond Rewards

    ERIC Educational Resources Information Center

    Hall, Philip S.

    2009-01-01

    Using rewards to impact students' behavior has long been common practice. However, using reward systems to enhance student learning conveniently masks the larger and admittedly more difficult task of finding and implementing the structure and techniques that children with special needs require to learn. More important, rewarding the child for good…

  15. Comprehensive RNA-Seq Expression Analysis of Sensory Ganglia with a Focus on Ion Channels and GPCRs in Trigeminal Ganglia

    PubMed Central

    Manteniotis, Stavros; Lehmann, Ramona; Flegel, Caroline; Vogel, Felix; Hofreuter, Adrian; Schreiner, Benjamin S. P.; Altmüller, Janine; Becker, Christian; Schöbel, Nicole; Hatt, Hanns; Gisselmann, Günter

    2013-01-01

    The specific functions of sensory systems depend on the tissue-specific expression of genes that code for molecular sensor proteins that are necessary for stimulus detection and membrane signaling. Using the Next Generation Sequencing technique (RNA-Seq), we analyzed the complete transcriptome of the trigeminal ganglia (TG) and dorsal root ganglia (DRG) of adult mice. Focusing on genes with an expression level higher than 1 FPKM (fragments per kilobase of transcript per million mapped reads), we detected the expression of 12984 genes in the TG and 13195 in the DRG. To analyze the specific gene expression patterns of the peripheral neuronal tissues, we compared their gene expression profiles with that of the liver, brain, olfactory epithelium, and skeletal muscle. The transcriptome data of the TG and DRG were scanned for virtually all known G-protein-coupled receptors (GPCRs) as well as for ion channels. The expression profile was ranked with regard to the level and specificity for the TG. In total, we detected 106 non-olfactory GPCRs and 33 ion channels that had not been previously described as expressed in the TG. To validate the RNA-Seq data, in situ hybridization experiments were performed for several of the newly detected transcripts. To identify differences in expression profiles between the sensory ganglia, the RNA-Seq data of the TG and DRG were compared. Among the differentially expressed genes (> 1 FPKM), 65 and 117 were expressed at least 10-fold higher in the TG and DRG, respectively. Our transcriptome analysis allows a comprehensive overview of all ion channels and G protein-coupled receptors that are expressed in trigeminal ganglia and provides additional approaches for the investigation of trigeminal sensing as well as for the physiological and pathophysiological mechanisms of pain. PMID:24260241

  16. A Biologically Inspired Computational Model of Basal Ganglia in Action Selection.

    PubMed

    Baston, Chiara; Ursino, Mauro

    2015-01-01

    The basal ganglia (BG) are a subcortical structure implicated in action selection. The aim of this work is to present a new cognitive neuroscience model of the BG, which aspires to represent a parsimonious balance between simplicity and completeness. The model includes the 3 main pathways operating in the BG circuitry, that is, the direct (Go), indirect (NoGo), and hyperdirect pathways. The main original aspects, compared with previous models, are the use of a two-term Hebb rule to train synapses in the striatum, based exclusively on neuronal activity changes caused by dopamine peaks or dips, and the role of the cholinergic interneurons (affected by dopamine themselves) during learning. Some examples are displayed, concerning a few paradigmatic cases: action selection in basal conditions, action selection in the presence of a strong conflict (where the role of the hyperdirect pathway emerges), synapse changes induced by phasic dopamine, and learning new actions based on a previous history of rewards and punishments. Finally, some simulations show model working in conditions of altered dopamine levels, to illustrate pathological cases (dopamine depletion in parkinsonian subjects or dopamine hypermedication). Due to its parsimonious approach, the model may represent a straightforward tool to analyze BG functionality in behavioral experiments.

  17. A Biologically Inspired Computational Model of Basal Ganglia in Action Selection

    PubMed Central

    Baston, Chiara

    2015-01-01

    The basal ganglia (BG) are a subcortical structure implicated in action selection. The aim of this work is to present a new cognitive neuroscience model of the BG, which aspires to represent a parsimonious balance between simplicity and completeness. The model includes the 3 main pathways operating in the BG circuitry, that is, the direct (Go), indirect (NoGo), and hyperdirect pathways. The main original aspects, compared with previous models, are the use of a two-term Hebb rule to train synapses in the striatum, based exclusively on neuronal activity changes caused by dopamine peaks or dips, and the role of the cholinergic interneurons (affected by dopamine themselves) during learning. Some examples are displayed, concerning a few paradigmatic cases: action selection in basal conditions, action selection in the presence of a strong conflict (where the role of the hyperdirect pathway emerges), synapse changes induced by phasic dopamine, and learning new actions based on a previous history of rewards and punishments. Finally, some simulations show model working in conditions of altered dopamine levels, to illustrate pathological cases (dopamine depletion in parkinsonian subjects or dopamine hypermedication). Due to its parsimonious approach, the model may represent a straightforward tool to analyze BG functionality in behavioral experiments. PMID:26640481

  18. Using food as a reward: An examination of parental reward practices.

    PubMed

    Roberts, Lindsey; Marx, Jenna M; Musher-Eizenman, Dara R

    2018-01-01

    Eating patterns and taste preferences are often established early in life. Many studies have examined how parental feeding practices may affect children's outcomes, including food intake and preference. The current study focused on a common food parenting practice, using food as a reward, and used Latent Profile Analysis (LPA) to examine whether mothers (n = 376) and fathers (n = 117) of children ages 2.8 to 7.5 (M = 4.7; SD = 1.1) grouped into profiles (i.e., subgroups) based on how they use of food as a reward. The 4-class model was the best-fitting LPA model, with resulting classes based on both the frequency and type of reward used. Classes were: infrequent reward (33%), tangible reward (21%), food reward (27%), and frequent reward (19%). The current study also explored whether children's eating styles (emotional overeating, rood fussiness, food responsiveness, and satiety responsiveness) and parenting style (Authoritative, Authoritarian, and Permissive) varied by reward profile. Analyses of Variance (ANOVA) revealed that the four profiles differed significantly for all outcome variables except satiety responsiveness. It appears that the use of tangible and food-based rewards have important implications in food parenting. More research is needed to better understand how the different rewarding practices affect additional child outcomes. Copyright © 2017 Elsevier Ltd. All rights reserved.

  19. Local GABAergic signaling within sensory ganglia controls peripheral nociceptive transmission

    PubMed Central

    Du, Xiaona; Hao, Han; Yang, Yuehui; Huang, Sha; Wang, Caixue; Gigout, Sylvain; Ramli, Rosmaliza; Li, Xinmeng; Jaworska, Ewa; Edwards, Ian; Yanagawa, Yuchio; Qi, Jinlong; Guan, Bingcai; Jaffe, David B.; Zhang, Hailin

    2017-01-01

    The integration of somatosensory information is generally assumed to be a function of the central nervous system (CNS). Here we describe fully functional GABAergic communication within rodent peripheral sensory ganglia and show that it can modulate transmission of pain-related signals from the peripheral sensory nerves to the CNS. We found that sensory neurons express major proteins necessary for GABA synthesis and release and that sensory neurons released GABA in response to depolarization. In vivo focal infusion of GABA or GABA reuptake inhibitor to sensory ganglia dramatically reduced acute peripherally induced nociception and alleviated neuropathic and inflammatory pain. In addition, focal application of GABA receptor antagonists to sensory ganglia triggered or exacerbated peripherally induced nociception. We also demonstrated that chemogenetic or optogenetic depolarization of GABAergic dorsal root ganglion neurons in vivo reduced acute and chronic peripherally induced nociception. Mechanistically, GABA depolarized the majority of sensory neuron somata, yet produced a net inhibitory effect on the nociceptive transmission due to the filtering effect at nociceptive fiber T-junctions. Our findings indicate that peripheral somatosensory ganglia represent a hitherto underappreciated site of somatosensory signal integration and offer a potential target for therapeutic intervention. PMID:28375159

  20. Neural Mechanisms Underlying Motivation of Mental Versus Physical Effort

    PubMed Central

    Daunizeau, Jean; Pessiglione, Mathias

    2012-01-01

    Mental and physical efforts, such as paying attention and lifting weights, have been shown to involve different brain systems. These cognitive and motor systems, respectively, include cortical networks (prefronto-parietal and precentral regions) as well as subregions of the dorsal basal ganglia (caudate and putamen). Both systems appeared sensitive to incentive motivation: their activity increases when we work for higher rewards. Another brain system, including the ventral prefrontal cortex and the ventral basal ganglia, has been implicated in encoding expected rewards. How this motivational system drives the cognitive and motor systems remains poorly understood. More specifically, it is unclear whether cognitive and motor systems can be driven by a common motivational center or if they are driven by distinct, dedicated motivational modules. To address this issue, we used functional MRI to scan healthy participants while performing a task in which incentive motivation, cognitive, and motor demands were varied independently. We reasoned that a common motivational node should (1) represent the reward expected from effort exertion, (2) correlate with the performance attained, and (3) switch effective connectivity between cognitive and motor regions depending on task demand. The ventral striatum fulfilled all three criteria and therefore qualified as a common motivational node capable of driving both cognitive and motor regions of the dorsal striatum. Thus, we suggest that the interaction between a common motivational system and the different task-specific systems underpinning behavioral performance might occur within the basal ganglia. PMID:22363208

  1. Basal ganglia structure in Tourette's disorder and/or attention-deficit/hyperactivity disorder.

    PubMed

    Forde, Natalie J; Zwiers, Marcel P; Naaijen, Jilly; Akkermans, Sophie E A; Openneer, Thaira J C; Visscher, Frank; Dietrich, Andrea; Buitelaar, Jan K; Hoekstra, Pieter J

    2017-04-01

    Tourette's disorder and attention-deficit/hyperactivity disorder often co-occur and have both been associated with structural variation of the basal ganglia. However, findings are inconsistent and comorbidity is often neglected. T1-weighted magnetic resonance images from children (n = 141, 8 to 12 years) with Tourette's disorder and/or attention-deficit/hyperactivity disorder and controls were processed with the Oxford Centre for Functional MRI [Magnetic resonance imaging] of the Brain (FMRIB) integrated registration and segmentation tool to determine basal ganglia nuclei volume and shape. Across all participants, basal ganglia nuclei volume and shape were estimated in relation to Tourette's disorder (categorical), attention-deficit/hyperactivity disorder severity (continuous across all participants), and their interaction. The analysis revealed no differences in basal ganglia nuclei volumes or shape between children with and without Tourette's disorder, no association with attention-deficit/hyperactivity disorder severity, and no interaction between the two. We found no evidence that Tourette's disorder, attention-deficit/hyperactivity disorder severity, or a combination thereof are associated with structural variation of the basal ganglia in 8- to 12-year-old patients. © 2016 International Parkinson and Movement Disorder Society. © 2016 International Parkinson and Movement Disorder Society.

  2. Effects of alexithymia and empathy on the neural processing of social and monetary rewards.

    PubMed

    Goerlich, Katharina Sophia; Votinov, Mikhail; Lammertz, Sarah E; Winkler, Lina; Spreckelmeyer, Katja N; Habel, Ute; Gründer, Gerhard; Gossen, Anna

    2017-07-01

    Empathy has been found to affect the neural processing of social and monetary rewards. Alexithymia, a subclinical condition showing a close inverse relationship with empathy is linked to dysfunctions of socio-emotional processing in the brain. Whether alexithymia alters the neural processing of rewards, which is currently unknown. Here, we investigated the influence of both alexithymia and empathy on reward processing using a social incentive delay (SID) task and a monetary incentive delay (MID) task in 45 healthy men undergoing functional magnetic resonance imaging. Controlling for temperament-character dimensions and rejection sensitivity, the relationship of alexithymia and empathy with neural activity in several a priori regions of interest (ROIs) was examined by means of partial correlations, while participants anticipated and received social and monetary rewards. Results were considered significant if they survived Holm-Bonferroni correction for multiple comparisons. Alexithymia modulated neural activity in several ROIs of the emotion and reward network, both during the anticipation of social and monetary rewards and in response to the receipt of monetary rewards. In contrast, empathy did not affect reward anticipation and modulated ROI activity only in response to the receipt of social rewards. These results indicate a significant influence of alexithymia on the processing of social and monetary rewards in the healthy brain.

  3. Self-stimulating rats combine subjective reward magnitude and subjective reward rate multiplicatively.

    PubMed

    Leon, M I; Gallistel, C R

    1998-07-01

    For rats that bar pressed for intracranial electrical stimulation in a 2-lever matching paradigm with concurrent variable interval schedules of reward, the authors found that the time allocation ratio is based on a multiplicative combination of the ratio of subjective reward magnitudes and the ratio of the rates of reward. Multiplicative combining was observed in a range covering approximately 2 orders of magnitude in the ratio of the rates of reward from about 1:10 to 10:1) and an order of magnitude change in the size of rewards. After determining the relation between the pulse frequency of stimulation and subjective reward magnitude, the authors were able to predict from knowledge of the subjective magnitudes of the rewards and the obtained relative rates of reward the subject's time allocation ratio over a range in which it varied by more than 3 orders of magnitude.

  4. The electrophysiological effects of nicotinic and electrical stimulation of intrinsic cardiac ganglia in the absence of extrinsic autonomic nerves in the rabbit heart.

    PubMed

    Allen, Emily; Coote, John H; Grubb, Blair D; Batten, Trevor Fc; Pauza, Dainius H; Ng, G André; Brack, Kieran E

    2018-05-22

    The intrinsic cardiac nervous system (ICNS) is a rich network of cardiac nerves that converge to form distinct ganglia and extend across the heart and is capable of influencing cardiac function. To provide a picture of the neurotransmitter/neuromodulator profile of the rabbit ICNS and determine the action of spatially divergent ganglia on cardiac electrophysiology. Nicotinic or electrical stimulation was applied at discrete sites of the intrinsic cardiac nerve plexus in the Langendorff perfused rabbit heart. Functional effects on sinus rate and atrioventricular conduction were measured. Immunohistochemistry for choline acetyltransferase (ChAT), tyrosine hydroxylase (TH) and/or neuronal nitric oxide synthase (nNOS) was performed on whole-mount preparations. Stimulation within all ganglia produced either bradycardia, tachycardia or a biphasic brady-tachycardia. Electrical stimulation of the right atrial (RA) and right neuronal cluster (RNC) regions produced the greatest chronotropic responses. Significant prolongation of atrioventricular conduction (AVC) was predominant at the pulmonary vein-caudal vein region (PVCV). Neurons immunoreactive (IR) only for ChAT, or TH or nNOS were consistently located within the limits of the hilum and at the roots of the right cranial and right pulmonary veins. ChAT-IR neurons were most abundant (1946±668 neurons). Neurons IR solely for nNOS were distributed within ganglia. Stimulation of intrinsic ganglia, shown to be of phenotypic complexity but predominantly of cholinergic nature, indicates that clusters of neurons are capable of independent selective effects on cardiac electrophysiology, therefore providing a potential therapeutic target for the prevention and treatment of cardiac disease. Copyright © 2018. Published by Elsevier Inc.

  5. Fronto-striatal Dysfunction During Reward Processing in Unaffected Siblings of Schizophrenia Patients

    PubMed Central

    de Leeuw, Max; Kahn, René S.; Vink, Matthijs

    2015-01-01

    Schizophrenia is a psychiatric disorder that is associated with impaired functioning of the fronto-striatal network, in particular during reward processing. However, it is unclear whether this dysfunction is related to the illness itself or whether it reflects a genetic vulnerability to develop schizophrenia. Here, we examined reward processing in unaffected siblings of schizophrenia patients using functional magnetic resonance imaging. Brain activity was measured during reward anticipation and reward outcome in 27 unaffected siblings of schizophrenia patients and 29 healthy volunteers using a modified monetary incentive delay task. Task performance was manipulated online so that all subjects won the same amount of money. Despite equal performance, siblings showed reduced activation in the ventral striatum, insula, and supplementary motor area (SMA) during reward anticipation compared to controls. Decreased ventral striatal activation in siblings was correlated with sub-clinical negative symptoms. During the outcome of reward, siblings showed increased activation in the ventral striatum and orbitofrontal cortex compared to controls. Our finding of decreased activity in the ventral striatum during reward anticipation and increased activity in this region during receiving reward may indicate impaired cue processing in siblings. This is consistent with the notion of dopamine dysfunction typically associated with schizophrenia. Since unaffected siblings share on average 50% of their genes with their ill relatives, these deficits may be related to the genetic vulnerability for schizophrenia. PMID:25368371

  6. The Effects of Medium Spiny Neuron Morphologcial Changes on Basal Ganglia Network under External Electric Field: A Computational Modeling Study

    PubMed Central

    Zhang, Xiaohan; Liu, Shenquan; Zhan, Feibiao; Wang, Jing; Jiang, Xiaofang

    2017-01-01

    The damage of dopaminergic neurons that innervate the striatum has been considered to be the proximate cause of Parkinson's disease (PD). In the dopamine-denervated state, the loss of dendritic spines and the decrease of dendritic length may prevent medium spiny neuron (MSN) from receiving too much excitatory stimuli from the cortex, thereby reducing the symptom of Parkinson's disease. However, the reduction in dendritic spine density obtained by different experiments is significantly different. We developed a biological-based network computational model to quantify the effect of dendritic spine loss and dendrites tree degeneration on basal ganglia (BG) signal regulation. Through the introduction of error index (EI), which was used to measure the attenuation of the signal, we explored the amount of dendritic spine loss and dendritic trees degradation required to restore the normal regulatory function of the network, and found that there were two ranges of dendritic spine loss that could reduce EI to normal levels in the case of dopamine at a certain level, this was also true for dendritic trees. However, although these effects were the same, the mechanisms of these two cases were significant difference. Using the method of phase diagram analysis, we gained insight into the mechanism of signal degradation. Furthermore, we explored the role of cortex in MSN morphology changes dopamine depletion-induced and found that proper adjustments to cortical activity do stop the loss in dendritic spines induced by dopamine depleted. These results suggested that modifying cortical drive onto MSN might provide a new idea on clinical therapeutic strategies for Parkinson's disease. PMID:29123477

  7. The Effects of Medium Spiny Neuron Morphologcial Changes on Basal Ganglia Network under External Electric Field: A Computational Modeling Study.

    PubMed

    Zhang, Xiaohan; Liu, Shenquan; Zhan, Feibiao; Wang, Jing; Jiang, Xiaofang

    2017-01-01

    The damage of dopaminergic neurons that innervate the striatum has been considered to be the proximate cause of Parkinson's disease (PD). In the dopamine-denervated state, the loss of dendritic spines and the decrease of dendritic length may prevent medium spiny neuron (MSN) from receiving too much excitatory stimuli from the cortex, thereby reducing the symptom of Parkinson's disease. However, the reduction in dendritic spine density obtained by different experiments is significantly different. We developed a biological-based network computational model to quantify the effect of dendritic spine loss and dendrites tree degeneration on basal ganglia (BG) signal regulation. Through the introduction of error index (EI), which was used to measure the attenuation of the signal, we explored the amount of dendritic spine loss and dendritic trees degradation required to restore the normal regulatory function of the network, and found that there were two ranges of dendritic spine loss that could reduce EI to normal levels in the case of dopamine at a certain level, this was also true for dendritic trees. However, although these effects were the same, the mechanisms of these two cases were significant difference. Using the method of phase diagram analysis, we gained insight into the mechanism of signal degradation. Furthermore, we explored the role of cortex in MSN morphology changes dopamine depletion-induced and found that proper adjustments to cortical activity do stop the loss in dendritic spines induced by dopamine depleted. These results suggested that modifying cortical drive onto MSN might provide a new idea on clinical therapeutic strategies for Parkinson's disease.

  8. The evolutionary origin of the vertebrate basal ganglia and its role in action selection.

    PubMed

    Grillner, Sten; Robertson, Brita; Stephenson-Jones, Marcus

    2013-11-15

    The group of nuclei within the basal ganglia of the forebrain is central to the control of movement. We present data showing that the structure and function of the basal ganglia have been conserved throughout vertebrate evolution over some 560 million years. The interaction between the different nuclei within the basal ganglia is conserved as well as the cellular and synaptic properties and transmitters. We consider the role of the conserved basal ganglia circuitry for basic patterns of motor behaviour controlled via brainstem circuits. The output of the basal ganglia consists of tonically active GABAergic neurones, which target brainstem motor centres responsible for different patterns of behaviour, such as eye and locomotor movements, posture, and feeding. A prerequisite for activating or releasing a motor programme is that this GABAergic inhibition is temporarily reduced. This can be achieved through activation of GABAergic projection neurons from striatum, the input level of the basal ganglia, given an appropriate synaptic drive from cortex, thalamus and the dopamine system. The tonic inhibition of the motor centres at rest most likely serves to prevent the different motor programmes from becoming active when not intended. Striatal projection neurones are subdivided into one group with dopamine 1 receptors that provides increased excitability of the direct pathway that can initiate movements, while inhibitory dopamine 2 receptors are expressed on neurones that instead inhibit movements and are part of the 'indirect loop' in mammals as well as lamprey. We review the evidence showing that all basic features of the basal ganglia have been conserved throughout vertebrate phylogeny, and discuss these findings in relation to the role of the basal ganglia in selection of behaviour.

  9. Attenuated frontal and sensory inputs to the basal ganglia in cannabis users.

    PubMed

    Blanco-Hinojo, Laura; Pujol, Jesus; Harrison, Ben J; Macià, Dídac; Batalla, Albert; Nogué, Santiago; Torrens, Marta; Farré, Magí; Deus, Joan; Martín-Santos, Rocío

    2017-07-01

    Heavy cannabis use is associated with reduced motivation. The basal ganglia, central in the motivation system, have the brain's highest cannabinoid receptor density. The frontal lobe is functionally coupled to the basal ganglia via segregated frontal-subcortical circuits conveying information from internal, self-generated activity. The basal ganglia, however, receive additional influence from the sensory system to further modulate purposeful behaviors according to the context. We postulated that cannabis use would impact functional connectivity between the basal ganglia and both internal (frontal cortex) and external (sensory cortices) sources of influence. Resting-state functional connectivity was measured in 28 chronic cannabis users and 29 controls. Selected behavioral tests included reaction time, verbal fluency and exposition to affective pictures. Assessments were repeated after one month of abstinence. Cannabis exposure was associated with (1) attenuation of the positive correlation between the striatum and areas pertaining to the 'limbic' frontal-basal ganglia circuit, and (2) attenuation of the negative correlation between the striatum and the fusiform gyrus, which is critical in recognizing significant visual features. Connectivity alterations were associated with lower arousal in response to affective pictures. Functional connectivity changes had a tendency to normalize after abstinence. The results overall indicate that frontal and sensory inputs to the basal ganglia are attenuated after chronic exposure to cannabis. This effect is consistent with the common behavioral consequences of chronic cannabis use concerning diminished responsiveness to both internal and external motivation signals. Such an impairment of the fine-tuning in the motivation system notably reverts after abstinence. © 2016 Society for the Study of Addiction.

  10. Reward and Aversion.

    PubMed

    Hu, Hailan

    2016-07-08

    To benefit from opportunities and cope with challenges in the environment, animals must adapt their behavior to acquire rewards and to avoid punishments. Maladaptive changes in the neuromodulatory systems and neural circuits for reward and aversion can lead to manifestation of several prominent psychiatric disorders including addiction and depression. Recent progress is pushing the boundaries of knowledge on two major fronts in research on reward and aversion: First, new layers of complexity have been reported on the functions of dopamine (DA) and serotonin (5-HT) neuromodulatory systems in reward and aversion. Second, specific circuit components in the neural pathways that encode reward and aversion have begun to be identified. This review aims to outline historic perspectives and new insights into the functions of DA and 5-HT systems in coding the distinct components of rewards. It also highlights recent advances in neural circuit studies enabled by new technologies, such as cell-type-specific electrophysiology and tracing, and optogenetics-based behavioral manipulation. This knowledge may provide guidance for developing novel treatment strategies for neuropsychiatric diseases related to the malfunction of the reward system.

  11. Expression of varicella-zoster virus and herpes simplex virus in normal human trigeminal ganglia

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Vafai, A.; Wellish, M.; Devlin, M.

    1988-04-01

    Lysates of radiolabeled explants from four human trigeminal ganglia were immunoprecipitated with antibodies to varicella-zoster virus (VZV) and to herpes simplex virus. Both herpes simplex virus- and VZV-specific proteins were detected in lysates of all four ganglia. Absence of reactivity in ganglion explants with monoclonal antibodies suggested that herpes simplex virus and VZV were not reactivated during the culture period. In situ hybridization studies demonstrated the presence of RNA transcripts from the VZV immediate early gene 63. This approach to the detection of herpes simplex virus and VZV expression in human ganglia should facilitate analysis of viral RNA and proteinsmore » in human sensory ganglia.« less

  12. Basal Ganglia Shape Abnormalities in the Unaffected Siblings of Schizophrenia Patients

    PubMed Central

    Mamah, Daniel; Harms, Michael P.; Wang, Lei; Barch, Deanna; Thompson, Paul; Kim, Jaeyun; Miller, Michael I.; Csernansky, John G.

    2008-01-01

    Objective Abnormalities of basal ganglia structure in schizophrenia have been attributed to the effects of antipsychotic drugs. Our aim was to test the hypothesis that abnormalities of basal ganglia structure are intrinsic features of schizophrenia, by assessing basal ganglia volume and shape in the unaffected siblings of schizophrenia subjects. Method The study involved 25 pairs of schizophrenia subjects and their unaffected siblings and 40 pairs of healthy controls and their siblings. Large deformation, high-dimensional brain mapping was used to obtain surface representations of the caudate, putamen, and globus pallidus. Surfaces were derived from transformations of anatomical templates and shapes were analyzed using reduced-dimensional measures of surface variability (i.e. principal components and canonical analysis). Canonical functions were derived using schizophrenia and control groups, and were then used to compare shapes in the sibling groups. To visualize shape differences, maps of the estimated surface displacement between groups were created. Results In the caudate, putamen and globus pallidus, the degree of shape abnormality observed in the siblings of the schizophrenia subjects was intermediate between the schizophrenia subjects and the controls. In the schizophrenia subjects, significant correlations were observed between measures of caudate, putamen and globus pallidus structure and the selected measures of lifetime psychopathology. Conclusions Attenuated abnormalities of basal ganglia structure are present in the unaffected siblings of schizophrenia subjects. This finding implies that basal ganglia structural abnormalities observed in subjects with schizophrenia are at least in part an intrinsic feature of the illness. PMID:18295189

  13. Abnormal Striatal BOLD Responses to Reward Anticipation and Reward Delivery in ADHD

    PubMed Central

    Furukawa, Emi; Bado, Patricia; Tripp, Gail; Mattos, Paulo; Wickens, Jeff R.; Bramati, Ivanei E.; Alsop, Brent; Ferreira, Fernanda Meireles; Lima, Debora; Tovar-Moll, Fernanda; Sergeant, Joseph A.; Moll, Jorge

    2014-01-01

    Altered reward processing has been proposed to contribute to the symptoms of attention deficit hyperactivity disorder (ADHD). The neurobiological mechanism underlying this alteration remains unclear. We hypothesize that the transfer of dopamine release from reward to reward-predicting cues, as normally observed in animal studies, may be deficient in ADHD. Functional magnetic resonance imaging (fMRI) was used to investigate striatal responses to reward-predicting cues and reward delivery in a classical conditioning paradigm. Data from 14 high-functioning and stimulant-naïve young adults with elevated lifetime symptoms of ADHD (8 males, 6 females) and 15 well-matched controls (8 males, 7 females) were included in the analyses. During reward anticipation, increased blood-oxygen-level-dependent (BOLD) responses in the right ventral and left dorsal striatum were observed in controls, but not in the ADHD group. The opposite pattern was observed in response to reward delivery; the ADHD group demonstrated significantly greater BOLD responses in the ventral striatum bilaterally and the left dorsal striatum relative to controls. In the ADHD group, the number of current hyperactivity/impulsivity symptoms was inversely related to ventral striatal responses during reward anticipation and positively associated with responses to reward. The BOLD response patterns observed in the striatum are consistent with impaired predictive dopamine signaling in ADHD, which may explain altered reward-contingent behaviors and symptoms of ADHD. PMID:24586543

  14. Dopamine reward prediction error coding.

    PubMed

    Schultz, Wolfram

    2016-03-01

    Reward prediction errors consist of the differences between received and predicted rewards. They are crucial for basic forms of learning about rewards and make us strive for more rewards-an evolutionary beneficial trait. Most dopamine neurons in the midbrain of humans, monkeys, and rodents signal a reward prediction error; they are activated by more reward than predicted (positive prediction error), remain at baseline activity for fully predicted rewards, and show depressed activity with less reward than predicted (negative prediction error). The dopamine signal increases nonlinearly with reward value and codes formal economic utility. Drugs of addiction generate, hijack, and amplify the dopamine reward signal and induce exaggerated, uncontrolled dopamine effects on neuronal plasticity. The striatum, amygdala, and frontal cortex also show reward prediction error coding, but only in subpopulations of neurons. Thus, the important concept of reward prediction errors is implemented in neuronal hardware.

  15. From Actions to Habits

    PubMed Central

    Yin, Henry H.

    2008-01-01

    Recent work on the role of overlapping cerebral networks in action selection and habit formation has important implications for alcohol addiction research. As reviewed below, (1) these networks, which all involve a group of deep-brain structures called the basal ganglia, are associated with distinct behavioral control processes, such as reward-guided Pavlovian conditional responses, goal-directed instrumental actions, and stimulus-driven habits; (2) different stages of action learning are associated with different networks, which have the ability to change (i.e., plasticity); and (3) exposure to alcohol and other addictive drugs can have profound effects on these networks by influencing the mechanisms underlying neural plasticity. PMID:23584008

  16. Heterogeneity of reward mechanisms.

    PubMed

    Lajtha, A; Sershen, H

    2010-06-01

    The finding that many drugs that have abuse potential and other natural stimuli such as food or sexual activity cause similar chemical changes in the brain, an increase in extracellular dopamine (DA) in the shell of the nucleus accumbens (NAccS), indicated some time ago that the reward mechanism is at least very similar for all stimuli and that the mechanism is relatively simple. The presently available information shows that the mechanisms involved are more complex and have multiple elements. Multiple brain regions, multiple receptors, multiple distinct neurons, multiple transmitters, multiple transporters, circuits, peptides, proteins, metabolism of transmitters, and phosphorylation, all participate in reward mechanisms. The system is variable, is changed during development, is sex-dependent, and is influenced by genetic differences. Not all of the elements participate in the reward of all stimuli. Different set of mechanisms are involved in the reward of different drugs of abuse, yet different mechanisms in the reward of natural stimuli such as food or sexual activity; thus there are different systems that distinguish different stimuli. Separate functions of the reward system such as anticipation, evaluation, consummation and identification; all contain function-specific elements. The level of the stimulus also influences the participation of the elements of the reward system, there are possible reactions to even below threshold stimuli, and excessive stimuli can change reward to aversion involving parts of the system. Learning and memory of past reward is an important integral element of reward and addictive behavior. Many of the reward elements are altered by repeated or chronic stimuli, and chronic exposure to one drug is likely to alter the response to another stimulus. To evaluate and identify the reward stimulus thus requires heterogeneity of the reward components in the brain.

  17. Dopamine reward prediction error coding

    PubMed Central

    Schultz, Wolfram

    2016-01-01

    Reward prediction errors consist of the differences between received and predicted rewards. They are crucial for basic forms of learning about rewards and make us strive for more rewards—an evolutionary beneficial trait. Most dopamine neurons in the midbrain of humans, monkeys, and rodents signal a reward prediction error; they are activated by more reward than predicted (positive prediction error), remain at baseline activity for fully predicted rewards, and show depressed activity with less reward than predicted (negative prediction error). The dopamine signal increases nonlinearly with reward value and codes formal economic utility. Drugs of addiction generate, hijack, and amplify the dopamine reward signal and induce exaggerated, uncontrolled dopamine effects on neuronal plasticity. The striatum, amygdala, and frontal cortex also show reward prediction error coding, but only in subpopulations of neurons. Thus, the important concept of reward prediction errors is implemented in neuronal hardware. PMID:27069377

  18. The subdiaphragmatic part of the phrenic nerve - morphometry and connections to autonomic ganglia.

    PubMed

    Loukas, Marios; Du Plessis, Maira; Louis, Robert G; Tubbs, R Shane; Wartmann, Christopher T; Apaydin, Nihal

    2016-01-01

    Few anatomical textbooks offer much information concerning the anatomy and distribution of the phrenic nerve inferior to the diaphragm. The aim of this study was to identify the subdiaphragmatic distribution of the phrenic nerve, the presence of phrenic ganglia, and possible connections to the celiac plexus. One hundred and thirty formalin-fixed adult cadavers were studied. The right phrenic nerve was found inferior to the diaphragm in 98% with 49.1% displaying a right phrenic ganglion. In 22.8% there was an additional smaller ganglion (right accessory phrenic ganglion). The remaining 50.9% had no grossly identifiable right phrenic ganglion. Most (65.5% of specimens) exhibited plexiform communications with the celiac ganglion, aorticorenal ganglion, and suprarenal gland. The left phrenic nerve inferior to the diaphragm was observed in 60% of specimens with 19% containing a left phrenic ganglion. No accessory left phrenic ganglia were observed. The left phrenic ganglion exhibited plexiform communications to several ganglia in 71.4% of specimens. Histologically, the right phrenic and left phrenic ganglia contained large soma concentrated in their peripheries. Both phrenic nerves and ganglia were closely related to the diaphragmatic crura. Surgically, sutures to approximate the crura for repair of hiatal hernias must be placed above the ganglia in order to avoid iatrogenic injuries to the autonomic supply to the diaphragm and abdomen. These findings could also provide a better understanding of the anatomy and distribution of the fibers of that autonomic supply. © 2015 Wiley Periodicals, Inc.

  19. Response of neural reward regions to food cues in autism spectrum disorders

    PubMed Central

    2012-01-01

    Background One hypothesis for the social deficits that characterize autism spectrum disorders (ASD) is diminished neural reward response to social interaction and attachment. Prior research using established monetary reward paradigms as a test of non-social reward to compare with social reward may involve confounds in the ability of individuals with ASD to utilize symbolic representation of money and the abstraction required to interpret monetary gains. Thus, a useful addition to our understanding of neural reward circuitry in ASD includes a characterization of the neural response to primary rewards. Method We asked 17 children with ASD and 18 children without ASD to abstain from eating for at least four hours before an MRI scan in which they viewed images of high-calorie foods. We assessed the neural reward network for increases in the blood oxygenation level dependent (BOLD) signal in response to the food images Results We found very similar patterns of increased BOLD signal to these images in the two groups; both groups showed increased BOLD signal in the bilateral amygdala, as well as in the nucleus accumbens, orbitofrontal cortex, and insula. Direct group comparisons revealed that the ASD group showed a stronger response to food cues in bilateral insula along the anterior-posterior gradient and in the anterior cingulate cortex than the control group, whereas there were no neural reward regions that showed higher activation for controls than for ASD. Conclusion These results suggest that neural response to primary rewards is not diminished but in fact shows an aberrant enhancement in children with ASD. PMID:22958533

  20. Taste, olfactory, and food reward value processing in the brain.

    PubMed

    Rolls, Edmund T

    2015-04-01

    Complementary neuronal recordings in primates, and functional neuroimaging in humans, show that the primary taste cortex in the anterior insula provides separate and combined representations of the taste, temperature, and texture (including fat texture) of food in the mouth independently of hunger and thus of reward value and pleasantness. One synapse on, in a second tier of processing, in the orbitofrontal cortex, these sensory inputs are for some neurons combined by associative learning with olfactory and visual inputs, and these neurons encode food reward value on a continuous scale in that they only respond to food when hungry, and in that activations correlate linearly with subjective pleasantness. Cognitive factors, including word-level descriptions, and selective attention to affective value, modulate the representation of the reward value of taste and olfactory stimuli in the orbitofrontal cortex and a region to which it projects, the anterior cingulate cortex, a tertiary taste cortical area. The food reward representations formed in this way play an important role in the control of appetite, and food intake. Individual differences in these reward representations may contribute to obesity, and there are age-related differences in these value representations that shape the foods that people in different age groups find palatable. In a third tier of processing in medial prefrontal cortex area 10, decisions between stimuli of different reward value are taken, by attractor decision-making networks. Copyright © 2015 Elsevier Ltd. All rights reserved.

  1. Reward anticipation in the adolescent and aging brain.

    PubMed

    Lorenz, Robert C; Gleich, Tobias; Beck, Anne; Pöhland, Lydia; Raufelder, Diana; Sommer, Werner; Rapp, Michael A; Kühn, Simone; Gallinat, Jürgen

    2014-10-01

    Processing of reward is the basis of adaptive behavior of the human being. Neural correlates of reward processing seem to be influenced by developmental changes from adolescence to late adulthood. The aim of this study is to uncover these neural correlates during a slot machine gambling task across the lifespan. Therefore, we used functional magnetic resonance imaging to investigate 102 volunteers in three different age groups: 34 adolescents, 34 younger adults, and 34 older adults. We focused on the core reward areas ventral striatum (VS) and ventromedial prefrontal cortex (VMPFC), the valence processing associated areas, anterior cingulate cortex (ACC) and insula, as well as information integration associated areas, dorsolateral prefrontal cortex (DLPFC), and inferior parietal lobule (IPL). Results showed that VS and VMPFC were characterized by a hyperactivation in adolescents compared with younger adults. Furthermore, the ACC and insula were characterized by a U-shape pattern (hypoactivation in younger adults compared with adolescents and older adults), whereas the DLPFC and IPL were characterized by a J-shaped form (hyperactivation in older adults compared with younger groups). Furthermore, a functional connectivity analysis revealed an elevated negative functional coupling between the inhibition-related area rIFG and VS in younger adults compared with adolescents. Results indicate that lifespan-related changes during reward anticipation are characterized by different trajectories in different reward network modules and support the hypothesis of an imbalance in maturation of striatal and prefrontal cortex in adolescents. Furthermore, these results suggest compensatory age-specific effects in fronto-parietal regions. Copyright © 2014 Wiley Periodicals, Inc.

  2. Learning and generalization from reward and punishment in opioid addiction

    PubMed Central

    Myers, Catherine E.; Rego, Janice; Haber, Paul; Morley, Kirsten; Beck, Kevin D.; Hogarth, Lee; Moustafa, Ahmed A.

    2016-01-01

    This study adapts a widely-used acquired equivalence paradigm to investigate how opioid-addicted individuals learn from positive and negative feedback, and how they generalize this learning. The opioid-addicted group consisted of 33 participants with a history of heroin dependency currently in a methadone maintenance program; the control group consisted of 32 healthy participants without a history of drug addiction. All participants performed a novel variant of the acquired equivalence task, where they learned to map some stimuli to correct outcomes in order to obtain reward, and to map other stimuli to correct outcomes in order to avoid punishment; some stimuli were implicitly “equivalent” in the sense of being paired with the same outcome. On the initial training phase, both groups performed similarly on learning to obtain reward, but as memory load grew, the control group outperformed the addicted group on learning to avoid punishment. On a subsequent testing phase, the addicted and control groups performed similarly on retention trials involving previously-trained stimulus-outcome pairs, as well as on generalization trials to assess acquired equivalence. Since prior work with acquired equivalence tasks has associated stimulus-outcome learning with the nigrostriatal dopamine system, and generalization with the hippocampal region, the current results are consistent with basal ganglia dysfunction in the opioid-addicted patients. Further, a selective deficit in learning from punishment could contribute to processes by which addicted individuals continue to pursue drug use even at the cost of negative consequences such as loss of income and the opportunity to engage in other life activities. PMID:27641323

  3. Learning and generalization from reward and punishment in opioid addiction.

    PubMed

    Myers, Catherine E; Rego, Janice; Haber, Paul; Morley, Kirsten; Beck, Kevin D; Hogarth, Lee; Moustafa, Ahmed A

    2017-01-15

    This study adapts a widely-used acquired equivalence paradigm to investigate how opioid-addicted individuals learn from positive and negative feedback, and how they generalize this learning. The opioid-addicted group consisted of 33 participants with a history of heroin dependency currently in a methadone maintenance program; the control group consisted of 32 healthy participants without a history of drug addiction. All participants performed a novel variant of the acquired equivalence task, where they learned to map some stimuli to correct outcomes in order to obtain reward, and to map other stimuli to correct outcomes in order to avoid punishment; some stimuli were implicitly "equivalent" in the sense of being paired with the same outcome. On the initial training phase, both groups performed similarly on learning to obtain reward, but as memory load grew, the control group outperformed the addicted group on learning to avoid punishment. On a subsequent testing phase, the addicted and control groups performed similarly on retention trials involving previously-trained stimulus-outcome pairs, as well as on generalization trials to assess acquired equivalence. Since prior work with acquired equivalence tasks has associated stimulus-outcome learning with the nigrostriatal dopamine system, and generalization with the hippocampal region, the current results are consistent with basal ganglia dysfunction in the opioid-addicted patients. Further, a selective deficit in learning from punishment could contribute to processes by which addicted individuals continue to pursue drug use even at the cost of negative consequences such as loss of income and the opportunity to engage in other life activities. Published by Elsevier B.V.

  4. Adaptive neural reward processing during anticipation and receipt of monetary rewards in mindfulness meditators.

    PubMed

    Kirk, Ulrich; Brown, Kirk Warren; Downar, Jonathan

    2015-05-01

    Reward seeking is ubiquitous and adaptive in humans. But excessive reward seeking behavior, such as chasing monetary rewards, may lead to diminished subjective well-being. This study examined whether individuals trained in mindfulness meditation show neural evidence of lower susceptibility to monetary rewards. Seventy-eight participants (34 meditators, 44 matched controls) completed the monetary incentive delay task while undergoing functional magnetic resonance imaging. The groups performed equally on the task, but meditators showed lower neural activations in the caudate nucleus during reward anticipation, and elevated bilateral posterior insula activation during reward anticipation. Meditators also evidenced reduced activations in the ventromedial prefrontal cortex during reward receipt compared with controls. Connectivity parameters between the right caudate and bilateral anterior insula were attenuated in meditators during incentive anticipation. In summary, brain regions involved in reward processing-both during reward anticipation and receipt of reward-responded differently in mindfulness meditators than in nonmeditators, indicating that the former are less susceptible to monetary incentives. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  5. Neural alterations of fronto-striatal circuitry during reward anticipation in euthymic bipolar disorder.

    PubMed

    Schreiter, S; Spengler, S; Willert, A; Mohnke, S; Herold, D; Erk, S; Romanczuk-Seiferth, N; Quinlivan, E; Hindi-Attar, C; Banzhaf, C; Wackerhagen, C; Romund, L; Garbusow, M; Stamm, T; Heinz, A; Walter, H; Bermpohl, F

    2016-11-01

    Bipolar disorder (BD), with the hallmark symptoms of elevated and depressed mood, is thought to be characterized by underlying alterations in reward-processing networks. However, to date the neural circuitry underlying abnormal responses during reward processing in BD remains largely unexplored. The aim of this study was to investigate whether euthymic BD is characterized by aberrant ventral striatal (VS) activation patterns and altered connectivity with the prefrontal cortex in response to monetary gains and losses. During functional magnetic resonance imaging 20 euthymic BD patients and 20 age-, gender- and intelligence quotient-matched healthy controls completed a monetary incentive delay paradigm, to examine neural processing of reward and loss anticipation. A priori defined regions of interest (ROIs) included the VS and the anterior prefrontal cortex (aPFC). Psychophysiological interactions (PPIs) between these ROIs were estimated and tested for group differences for reward and loss anticipation separately. BD participants, relative to healthy controls, displayed decreased activation selectively in the left and right VS during anticipation of reward, but not during loss anticipation. PPI analyses showed decreased functional connectivity between the left VS and aPFC in BD patients compared with healthy controls during reward anticipation. This is the first study showing decreased VS activity and aberrant connectivity in the reward-processing circuitry in euthymic, medicated BD patients during reward anticipation. Our findings contrast with research supporting a reward hypersensitivity model of BD, and add to the body of literature suggesting that blunted activation of reward processing circuits may be a vulnerability factor for mood disorders.

  6. Adaptive Reward Pursuit: How Effort Requirements Affect Unconscious Reward Responses and Conscious Reward Decisions

    ERIC Educational Resources Information Center

    Bijleveld, Erik; Custers, Ruud; Aarts, Henk

    2012-01-01

    When in pursuit of rewards, humans weigh the value of potential rewards against the amount of effort that is required to attain them. Although previous research has generally conceptualized this process as a deliberate calculation, recent work suggests that rudimentary mechanisms--operating without conscious intervention--play an important role as…

  7. The effects of age on resting state functional connectivity of the basal ganglia from young to middle adulthood.

    PubMed

    Manza, Peter; Zhang, Sheng; Hu, Sien; Chao, Herta H; Leung, Hoi-Chung; Li, Chiang-Shan R

    2015-02-15

    The basal ganglia nuclei are critical for a variety of cognitive and motor functions. Much work has shown age-related structural changes of the basal ganglia. Yet less is known about how the functional interactions of these regions with the cerebral cortex and the cerebellum change throughout the lifespan. Here, we took advantage of a convenient sample and examined resting state functional magnetic resonance imaging data from 250 adults 18 to 49 years of age, focusing specifically on the caudate nucleus, pallidum, putamen, and ventral tegmental area/substantia nigra (VTA/SN). There are a few main findings to report. First, with age, caudate head connectivity increased with a large region of ventromedial prefrontal/medial orbitofrontal cortex. Second, across all subjects, pallidum and putamen showed negative connectivity with default mode network (DMN) regions such as the ventromedial prefrontal cortex and posterior cingulate cortex, in support of anti-correlation of the "task-positive" network (TPN) and DMN. This negative connectivity was reduced with age. Furthermore, pallidum, posterior putamen and VTA/SN connectivity to other TPN regions, such as somatomotor cortex, decreased with age. These results highlight a distinct effect of age on cerebral functional connectivity of the dorsal striatum and VTA/SN from young to middle adulthood and may help research investigating the etiologies or monitoring outcomes of neuropsychiatric conditions that implicate dopaminergic dysfunction. Copyright © 2014 Elsevier Inc. All rights reserved.

  8. Pattern Analysis in Social Networks with Dynamic Connections

    NASA Astrophysics Data System (ADS)

    Wu, Yu; Zhang, Yu

    In this paper, we explore how decentralized local interactions of autonomous agents in a network relate to collective behaviors. Most existing work in this area models social network in which agent relations are fixed; instead, we focus on dynamic social networks where agents can rationally adjust their neighborhoods based on their individual interests. We propose a new connection evaluation rule called the Highest Weighted Reward (HWR) rule, with which agents dynamically choose their neighbors in order to maximize their own utilities based on the rewards from previous interactions. Our experiments show that in the 2-action pure coordination game, our system will stabilize to a clustering state where all relationships in the network are rewarded with the optimal payoff. Our experiments also reveal additional interesting patterns in the network.

  9. Reward Processing, Neuroeconomics, and Psychopathology.

    PubMed

    Zald, David H; Treadway, Michael T

    2017-05-08

    Abnormal reward processing is a prominent transdiagnostic feature of psychopathology. The present review provides a framework for considering the different aspects of reward processing and their assessment, and highlights recent insights from the field of neuroeconomics that may aid in understanding these processes. Although altered reward processing in psychopathology has often been treated as a general hypo- or hyperresponsivity to reward, increasing data indicate that a comprehensive understanding of reward dysfunction requires characterization within more specific reward-processing domains, including subjective valuation, discounting, hedonics, reward anticipation and facilitation, and reinforcement learning. As such, more nuanced models of the nature of these abnormalities are needed. We describe several processing abnormalities capable of producing the types of selective alterations in reward-related behavior observed in different forms of psychopathology, including (mal)adaptive scaling and anchoring, dysfunctional weighting of reward and cost variables, competition between valuation systems, and reward prediction error signaling.

  10. Shaping Attention with Reward: Effects of Reward on Space- and Object-Based Selection

    PubMed Central

    Shomstein, Sarah; Johnson, Jacoba

    2014-01-01

    The contribution of rewarded actions to automatic attentional selection remains obscure. We hypothesized that some forms of automatic orienting, such as object-based selection, can be completely abandoned in lieu of reward maximizing strategy. While presenting identical visual stimuli to the observer, in a set of two experiments, we manipulate what is being rewarded (different object targets or random object locations) and the type of reward received (money or points). It was observed that reward alone guides attentional selection, entirely predicting behavior. These results suggest that guidance of selective attention, while automatic, is flexible and can be adjusted in accordance with external non-sensory reward-based factors. PMID:24121412

  11. Control Networks and Neuromodulators of Early Development

    ERIC Educational Resources Information Center

    Posner, Michael I.; Rothbart, Mary K.; Sheese, Brad E.; Voelker, Pascale

    2012-01-01

    In adults, most cognitive and emotional self-regulation is carried out by a network of brain regions, including the anterior cingulate, insula, and areas of the basal ganglia, related to executive attention. We propose that during infancy, control systems depend primarily upon a brain network involved in orienting to sensory events that includes…

  12. Relationship between Personality Traits and Brain Reward Responses when Playing on a Team

    PubMed Central

    Morawetz, Carmen; Kirilina, Evgeniya; Baudewig, Juergen; Heekeren, Hauke R.

    2014-01-01

    Cooperation is an integral part of human social life and we often build teams to achieve certain goals. However, very little is currently understood about emotions with regard to cooperation. Here, we investigated the impact of social context (playing alone versus playing on a team) on emotions while winning or losing a game. We hypothesized that activity in the reward network is modulated by the social context and that personality characteristics might impact team play. We conducted an event-related functional magnetic resonance imaging experiment that involved a simple game of dice. In the team condition, the participant played with a partner against another two-person team. In the single-player condition, the participant played alone against another player. Our results revealed that reward processing in the right amygdala was modulated by the social context. The main effect of outcome (gains versus losses) was associated with increased responses in the reward network. We also found that differences in the reward-related neural response due to social context were associated with specific personality traits. When playing on a team, increased activity in the amygdala during winning was a unique function of openness, while decreased activity in the ventromedial prefrontal cortex and ventral striatum during losing was associated with extraversion and conscientiousness, respectively. In conclusion, we provide evidence that working on a team influences the affective value of a negative outcome by attenuating the negative response associated with it in the amygdala. Our results also show that brain reward responses in a social context are affected by personality traits related to teamwork. PMID:24475262

  13. Relationship between personality traits and brain reward responses when playing on a team.

    PubMed

    Morawetz, Carmen; Kirilina, Evgeniya; Baudewig, Juergen; Heekeren, Hauke R

    2014-01-01

    Cooperation is an integral part of human social life and we often build teams to achieve certain goals. However, very little is currently understood about emotions with regard to cooperation. Here, we investigated the impact of social context (playing alone versus playing on a team) on emotions while winning or losing a game. We hypothesized that activity in the reward network is modulated by the social context and that personality characteristics might impact team play. We conducted an event-related functional magnetic resonance imaging experiment that involved a simple game of dice. In the team condition, the participant played with a partner against another two-person team. In the single-player condition, the participant played alone against another player. Our results revealed that reward processing in the right amygdala was modulated by the social context. The main effect of outcome (gains versus losses) was associated with increased responses in the reward network. We also found that differences in the reward-related neural response due to social context were associated with specific personality traits. When playing on a team, increased activity in the amygdala during winning was a unique function of openness, while decreased activity in the ventromedial prefrontal cortex and ventral striatum during losing was associated with extraversion and conscientiousness, respectively. In conclusion, we provide evidence that working on a team influences the affective value of a negative outcome by attenuating the negative response associated with it in the amygdala. Our results also show that brain reward responses in a social context are affected by personality traits related to teamwork.

  14. CONTRAST BETWEEN OSMIUM-FIXED AND PERMANGANATE-FIXED TOAD SPINAL GANGLIA

    PubMed Central

    Rosenbluth, Jack

    1963-01-01

    Chains of vesicles are prominent near the plasma membranes of both the neurons and satellite cells of osmium-fixed toad spinal ganglia. In permanganate-fixed specimens, however, such vesicles are absent, and in their place are continuous invaginations of the plasma membranes of these cells. The discrepancy suggests that the serried vesicles seen in osmium-fixed preparations arise through disintegration of plasma membrane invaginations, and do not represent active pinocytosis, as has been suggested previously. A second difference between ganglia fixed by these two methods is that rows of small, disconnected cytoplasmic globules occur in the sheaths of permanganate-fixed ganglia, but not in osmium-fixed samples. It is suggested that these globules arise from the breakdown of thin sheets of satellite cell cytoplasm which occur as continuous lamellae in osmium-fixed specimens. Possible mechanisms of these membrane reorganizations, and the relevance of these findings to other tissues, are discussed. PMID:13990905

  15. Reward Sensitivity for a Palatable Food Reward Peaks During Pubertal Developmental in Rats

    PubMed Central

    Friemel, Chris M.; Spanagel, Rainer; Schneider, Miriam

    2010-01-01

    Puberty is a critical period for the initiation of drug use and abuse. Because early drug use onset often accounts for a more severe progression of addiction, it is of importance to understand the underlying mechanisms and neurodevelopmental changes during puberty that are contributing to enhanced reward processing in teenagers. The present study investigated the progression of reward sensitivity toward a natural food reward over the whole course of adolescence in male rats (postnatal days 30–90) by monitoring consummatory, motivational behavior and neurobiological correlates of reward. Using a limited-free intake paradigm, consumption of sweetened condensed milk (SCM) was measured repeatedly in adolescent and adult rats. Additionally, early- and mid-pubertal animals were tested in Progressive Ratio responding for SCM and c-fos protein expression in reward-associated brain structures was examined after odor conditioning for SCM. We found a transient increase in SCM consumption and motivational incentive for SCM during puberty. This increased reward sensitivity was most pronounced around mid-puberty. The behavioral findings are paralleled by enhanced c-fos staining in reward-related structures revealing an intensified neuronal response after reward-cue presentation, distinctive for pubertal animals. Taken together, these data indicate an increase in reward sensitivity during adolescence accompanied by enhanced responsiveness of reward-associated brain structures to incentive stimuli, and it seems that both is strongly pronounced around mid-puberty. Therefore, higher reward sensitivity during pubertal maturation might contribute to the enhanced vulnerability of teenagers for the initiation of experimental drug use. PMID:20700386

  16. Abnormal activity in reward brain circuits in human narcolepsy with cataplexy.

    PubMed

    Ponz, Aurélie; Khatami, Ramin; Poryazova, Rositsa; Werth, Esther; Boesiger, Peter; Bassetti, Claudio L; Schwartz, Sophie

    2010-02-01

    Hypothalamic hypocretins (or orexins) regulate energy metabolism and arousal maintenance. Recent animal research suggests that hypocretins may also influence reward-related behaviors. In humans, the loss of hypocretin-containing neurons results in a major sleep-wake disorder called narcolepsy-cataplexy, which is associated with emotional disturbances. Here, we aim to test whether narcoleptic patients show an abnormal pattern of brain activity during reward processing. We used functional magnetic resonance imaging in 12 unmedicated patients with narcolepsy-cataplexy to measure the neural responses to expectancy and experience of monetary gains and losses. We statistically compared the patients' data with those obtained in a group of 12 healthy matched controls. Our results reveal that activity in the dopaminergic ventral midbrain (ventral tegmental area) was not modulated in narcolepsy-cataplexy patients during high reward expectancy (unlike controls), and that ventral striatum activity was reduced during winning. By contrast, the patients showed abnormal activity increases in the amygdala and in dorsal striatum for positive outcomes. In addition, we found that activity in the nucleus accumbens and the ventral-medial prefrontal cortex correlated with disease duration, suggesting that an alternate neural circuit could be privileged over the years to control affective responses to emotional challenges and compensate for the lack of influence from ventral midbrain regions. Our study offers a detailed picture of the distributed brain network involved during distinct stages of reward processing and shows for the first time, to our knowledge, how this network is affected in hypocretin-deficient narcoleptic patients.

  17. Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network.

    PubMed

    Pan, Wei-Xing; Schmidt, Robert; Wickens, Jeffery R; Hyland, Brian I

    2005-06-29

    Behavioral conditioning of cue-reward pairing results in a shift of midbrain dopamine (DA) cell activity from responding to the reward to responding to the predictive cue. However, the precise time course and mechanism underlying this shift remain unclear. Here, we report a combined single-unit recording and temporal difference (TD) modeling approach to this question. The data from recordings in conscious rats showed that DA cells retain responses to predicted reward after responses to conditioned cues have developed, at least early in training. This contrasts with previous TD models that predict a gradual stepwise shift in latency with responses to rewards lost before responses develop to the conditioned cue. By exploring the TD parameter space, we demonstrate that the persistent reward responses of DA cells during conditioning are only accurately replicated by a TD model with long-lasting eligibility traces (nonzero values for the parameter lambda) and low learning rate (alpha). These physiological constraints for TD parameters suggest that eligibility traces and low per-trial rates of plastic modification may be essential features of neural circuits for reward learning in the brain. Such properties enable rapid but stable initiation of learning when the number of stimulus-reward pairings is limited, conferring significant adaptive advantages in real-world environments.

  18. Bicycling suppresses abnormal beta synchrony in the Parkinsonian basal ganglia.

    PubMed

    Storzer, Lena; Butz, Markus; Hirschmann, Jan; Abbasi, Omid; Gratkowski, Maciej; Saupe, Dietmar; Vesper, Jan; Dalal, Sarang S; Schnitzler, Alfons

    2017-10-01

    Freezing of gait is a poorly understood symptom of Parkinson disease, and can severely disrupt the locomotion of affected patients. However, bicycling ability remains surprisingly unaffected in most patients suffering from freezing, suggesting functional differences in the motor network. The purpose of this study was to characterize and contrast the oscillatory dynamics underlying bicycling and walking in the basal ganglia. We present the first local field potential recordings directly comparing bicycling and walking in Parkinson disease patients with electrodes implanted in the subthalamic nuclei for deep brain stimulation. Low (13-22Hz) and high (23-35Hz) beta power changes were analyzed in 22 subthalamic nuclei from 13 Parkinson disease patients (57.5 ± 5.9 years old, 4 female). The study group consisted of 5 patients with and 8 patients without freezing of gait. In patients without freezing of gait, both bicycling and walking led to a suppression of subthalamic beta power (13-35Hz), and this suppression was stronger for bicycling. Freezers showed a similar pattern in general. Superimposed on this pattern, however, we observed a movement-induced, narrowband power increase around 18Hz, which was evident even in the absence of freezing. These results indicate that bicycling facilitates overall suppression of beta power. Furthermore, movement leads to exaggerated synchronization in the low beta band specifically within the basal ganglia of patients susceptible to freezing. Abnormal ∼18Hz oscillations are implicated in the pathophysiology of freezing of gait, and suppressing them may form a key strategy in developing potential therapies. Ann Neurol 2017;82:592-601. © 2017 American Neurological Association.

  19. Resting-State Brain and the FTO Obesity Risk Allele: Default Mode, Sensorimotor, and Salience Network Connectivity Underlying Different Somatosensory Integration and Reward Processing between Genotypes.

    PubMed

    Olivo, Gaia; Wiemerslage, Lyle; Nilsson, Emil K; Solstrand Dahlberg, Linda; Larsen, Anna L; Olaya Búcaro, Marcela; Gustafsson, Veronica P; Titova, Olga E; Bandstein, Marcus; Larsson, Elna-Marie; Benedict, Christian; Brooks, Samantha J; Schiöth, Helgi B

    2016-01-01

    Single-nucleotide polymorphisms (SNPs) of the fat mass and obesity associated (FTO) gene are linked to obesity, but how these SNPs influence resting-state neural activation is unknown. Few brain-imaging studies have investigated the influence of obesity-related SNPs on neural activity, and no study has investigated resting-state connectivity patterns. We tested connectivity within three, main resting-state networks: default mode (DMN), sensorimotor (SMN), and salience network (SN) in 30 male participants, grouped based on genotype for the rs9939609 FTO SNP, as well as punishment and reward sensitivity measured by the Behavioral Inhibition (BIS) and Behavioral Activation System (BAS) questionnaires. Because obesity is associated with anomalies in both systems, we calculated a BIS/BAS ratio (BBr) accounting for features of both scores. A prominence of BIS over BAS (higher BBr) resulted in increased connectivity in frontal and paralimbic regions. These alterations were more evident in the obesity-associated AA genotype, where a high BBr was also associated with increased SN connectivity in dopaminergic circuitries, and in a subnetwork involved in somatosensory integration regarding food. Participants with AA genotype and high BBr, compared to corresponding participants in the TT genotype, also showed greater DMN connectivity in regions involved in the processing of food cues, and in the SMN for regions involved in visceral perception and reward-based learning. These findings suggest that neural connectivity patterns influence the sensitivity toward punishment and reward more closely in the AA carriers, predisposing them to developing obesity. Our work explains a complex interaction between genetics, neural patterns, and behavioral measures in determining the risk for obesity and may help develop individually-tailored strategies for obesity prevention.

  20. Resting-State Brain and the FTO Obesity Risk Allele: Default Mode, Sensorimotor, and Salience Network Connectivity Underlying Different Somatosensory Integration and Reward Processing between Genotypes

    PubMed Central

    Olivo, Gaia; Wiemerslage, Lyle; Nilsson, Emil K.; Solstrand Dahlberg, Linda; Larsen, Anna L.; Olaya Búcaro, Marcela; Gustafsson, Veronica P.; Titova, Olga E.; Bandstein, Marcus; Larsson, Elna-Marie; Benedict, Christian; Brooks, Samantha J.; Schiöth, Helgi B.

    2016-01-01

    Single-nucleotide polymorphisms (SNPs) of the fat mass and obesity associated (FTO) gene are linked to obesity, but how these SNPs influence resting-state neural activation is unknown. Few brain-imaging studies have investigated the influence of obesity-related SNPs on neural activity, and no study has investigated resting-state connectivity patterns. We tested connectivity within three, main resting-state networks: default mode (DMN), sensorimotor (SMN), and salience network (SN) in 30 male participants, grouped based on genotype for the rs9939609 FTO SNP, as well as punishment and reward sensitivity measured by the Behavioral Inhibition (BIS) and Behavioral Activation System (BAS) questionnaires. Because obesity is associated with anomalies in both systems, we calculated a BIS/BAS ratio (BBr) accounting for features of both scores. A prominence of BIS over BAS (higher BBr) resulted in increased connectivity in frontal and paralimbic regions. These alterations were more evident in the obesity-associated AA genotype, where a high BBr was also associated with increased SN connectivity in dopaminergic circuitries, and in a subnetwork involved in somatosensory integration regarding food. Participants with AA genotype and high BBr, compared to corresponding participants in the TT genotype, also showed greater DMN connectivity in regions involved in the processing of food cues, and in the SMN for regions involved in visceral perception and reward-based learning. These findings suggest that neural connectivity patterns influence the sensitivity toward punishment and reward more closely in the AA carriers, predisposing them to developing obesity. Our work explains a complex interaction between genetics, neural patterns, and behavioral measures in determining the risk for obesity and may help develop individually-tailored strategies for obesity prevention. PMID:26924971

  1. Uncovering the Forgotten Effect of Superior Cervical Ganglia on Pupil Diameter in Subarachnoid Hemorrhage: An Experimental Study.

    PubMed

    Onen, Mehmet Resid; Yilmaz, Ilhan; Ramazanoglu, Leyla; Aydin, Mehmet Dumlu; Keles, Sadullah; Baykal, Orhan; Aydin, Nazan; Gundogdu, Cemal

    2018-01-01

    To investigate the relationship between neuron density of the superior cervical sympathetic ganglia and pupil diameter in subarachnoid hemorrhage. This study was conducted on 22 rabbits; 5 for the baseline control group, 5 for the SHAM group and 12 for the study group. Pupil diameters were measured via sunlight and ocular tomography on day 1 as the control values. Pupil diameters were re-measured after injecting 0.5 cc saline to the SHAM group, and autologous arterial blood into the cisterna magna of the study group. After 3 weeks, the brain, superior cervical sympathetic ganglia and ciliary ganglia were extracted with peripheral tissues bilaterally and examined histopathologically. Pupil diameters were compared with neuron densities of the sympathetic ganglia and ciliary ganglia which were examined using stereological methods. Baseline values were; normal pupil diameter 7.180±620 ?m and mean neuron density of the superior cervical sympathetic ganglia 6.321±510/mm3, degenerated neuron density of ciliary ganglia was 5±2/mm3 after histopathological examination in the control group. These values were measured as 6.850±578 ?m, 5.950±340/mm3 and 123±39/mm3 in the SHAM group and 9.910±840 ?m, 7.950±764/mm3 and 650±98/mm3 in the study group. A linear relationship was determined between neuron density of the superior cervical sympathetic ganglia and pupil diameters (p < 0.005). Degenerated ciliary ganglia neuron density had an inverse effect on pupil diameters in all groups (p < 0.0001). Highly degenerated neuron density of the ciliary ganglion is not responsible for pupil dilatation owing to parasympathetic pupilloconstrictor palsy, but high neuron density of the pupillodilatatory superior cervical sympathetic ganglia should be considered an important factor for pupil dilatation.

  2. Cannabis cue-elicited craving and the reward neurocircuitry.

    PubMed

    Filbey, Francesca M; DeWitt, Samuel J

    2012-07-02

    Cue-elicited craving or the intense desire to consume a substance following exposure to a conditioned drug cue is one of the primary behavioral symptoms of substance use disorders (SUDs). While the concept of cue-elicited craving is well characterized in alcohol and other substances of abuse, only recently has it been described in cannabis. A review of the extant literature has established that cue-elicited craving is a powerful reinforcer that contributes to drug-seeking for cannabis. Further, emergent research has begun to identify the neurobiological systems and neural mechanisms associated with this behavior. What research shows is that while theories of THC's effects on the dopaminergic-reward system remain divergent, cannabis cues elicit neural activation in the brain's reward network. Copyright © 2011 Elsevier Inc. All rights reserved.

  3. Action selection performance of a reconfigurable basal ganglia inspired model with Hebbian–Bayesian Go-NoGo connectivity

    PubMed Central

    Berthet, Pierre; Hellgren-Kotaleski, Jeanette; Lansner, Anders

    2012-01-01

    Several studies have shown a strong involvement of the basal ganglia (BG) in action selection and dopamine dependent learning. The dopaminergic signal to striatum, the input stage of the BG, has been commonly described as coding a reward prediction error (RPE), i.e., the difference between the predicted and actual reward. The RPE has been hypothesized to be critical in the modulation of the synaptic plasticity in cortico-striatal synapses in the direct and indirect pathway. We developed an abstract computational model of the BG, with a dual pathway structure functionally corresponding to the direct and indirect pathways, and compared its behavior to biological data as well as other reinforcement learning models. The computations in our model are inspired by Bayesian inference, and the synaptic plasticity changes depend on a three factor Hebbian–Bayesian learning rule based on co-activation of pre- and post-synaptic units and on the value of the RPE. The model builds on a modified Actor-Critic architecture and implements the direct (Go) and the indirect (NoGo) pathway, as well as the reward prediction (RP) system, acting in a complementary fashion. We investigated the performance of the model system when different configurations of the Go, NoGo, and RP system were utilized, e.g., using only the Go, NoGo, or RP system, or combinations of those. Learning performance was investigated in several types of learning paradigms, such as learning-relearning, successive learning, stochastic learning, reversal learning and a two-choice task. The RPE and the activity of the model during learning were similar to monkey electrophysiological and behavioral data. Our results, however, show that there is not a unique best way to configure this BG model to handle well all the learning paradigms tested. We thus suggest that an agent might dynamically configure its action selection mode, possibly depending on task characteristics and also on how much time is available. PMID:23060764

  4. Framing Reinforcement Learning from Human Reward: Reward Positivity, Temporal Discounting, Episodicity, and Performance

    DTIC Science & Technology

    2014-09-29

    Framing Reinforcement Learning from Human Reward: Reward Positivity, Temporal Discounting, Episodicity , and Performance W. Bradley Knox...positive a trainer’s reward values are; temporal discounting, the extent to which future reward is discounted in value; episodicity , whether task...learning occurs in discrete learning episodes instead of one continuing session; and task performance, the agent’s performance on the task the trainer

  5. Extending overjustification: the effect of perceived reward-giver intention on response to rewards.

    PubMed

    Forehand, M R

    2000-12-01

    The perceived intention model incorporates a new moderator, beliefs about reward-giver intention, into the overjustification paradigm. In 2 simulated shopping studies featuring products paired with promotional rewards, consumers who believed the marketer was promotion focused (reward used to encourage purchase) reported lower purchase intentions and brand attitudes for promoted products after promotion, whereas consumers who believed the marketer was reward focused (promotion used to distribute the reward) showed no attitude change. Promotion-focus beliefs lowered attitudes by heightening the contingency between the promotion and purchase and thereby increasing the perceived causal role of the reward. This effect was contingent on initial behavior--postpromotion attitude change occurred for consumers who actively engaged in product decisions but not for consumers who passively observed the choice sets.

  6. Reward Processing, Neuroeconomics, and Psychopathology

    PubMed Central

    Zald, David H.; Treadway, Michael

    2018-01-01

    Abnormal reward processing is a prominent transdiagnostic feature of psychopathology. The present review provides a framework for considering the different aspects of reward processing and their assessment and highlight recent insights from the field of neuroeconomics that may aid in understanding these processes. Although altered reward processing in psychopathology has often been treated as a general hypo- or hyper-responsivity to reward, increasing data indicate that a comprehensive understanding of reward dysfunction requires characterization within more specific reward processing domains, including subjective valuation, discounting, hedonics, reward anticipation and facilitation, and reinforcement learning. As such, more nuanced models of the nature of these abnormalities are needed. We describe several processing abnormalities capable of producing the types of selective alterations in reward related behavior observed in different forms of psychopathology, including (mal)adaptive scaling and anchoring, dysfunctional weighting of reward and cost variables, completion between valuation systems, and positive prediction error signaling. PMID:28301764

  7. Reward Sensitivity and Waiting Impulsivity: Shift towards Reward Valuation away from Action Control

    PubMed Central

    Mechelmans, Daisy J; Strelchuk, Daniela; Doñamayor, Nuria; Banca, Paula; Robbins, Trevor W; Baek, Kwangyeol

    2017-01-01

    Abstract Background Impulsivity and reward expectancy are commonly interrelated. Waiting impulsivity, measured using the rodent 5-Choice Serial Reaction Time task, predicts compulsive cocaine seeking and sign (or cue) tracking. Here, we assess human waiting impulsivity using a novel translational task, the 4-Choice Serial Reaction Time task, and the relationship with reward cues. Methods Healthy volunteers (n=29) performed the monetary incentive delay task as a functional MRI study where subjects observe a cue predicting reward (cue) and wait to respond for high (£5), low (£1), or no reward. Waiting impulsivity was tested with the 4-Choice Serial Reaction Time task. Results For high reward prospects (£5, no reward), greater waiting impulsivity on the 4-CSRT correlated with greater medial orbitofrontal cortex and lower supplementary motor area activity to cues. In response to high reward cues, greater waiting impulsivity was associated with greater subthalamic nucleus connectivity with orbitofrontal cortex and greater subgenual cingulate connectivity with anterior insula, but decreased connectivity with regions implicated in action selection and preparation. Conclusion These findings highlight a shift towards regions implicated in reward valuation and a shift towards compulsivity away from higher level motor preparation and action selection and response. We highlight the role of reward sensitivity and impulsivity, mechanisms potentially linking human waiting impulsivity with incentive approach and compulsivity, theories highly relevant to disorders of addiction. PMID:29020291

  8. Identifying enhanced cortico-basal ganglia loops associated with prolonged dance training

    PubMed Central

    Li, Gujing; He, Hui; Huang, Mengting; Zhang, Xingxing; Lu, Jing; Lai, Yongxiu; Luo, Cheng; Yao, Dezhong

    2015-01-01

    Studies have revealed that prolonged, specialized training combined with higher cognitive conditioning induces enhanced brain alternation. In particular, dancers with long-term dance experience exhibit superior motor control and integration with their sensorimotor networks. However, little is known about the functional connectivity patterns of spontaneous intrinsic activities in the sensorimotor network of dancers. Our study examined the functional connectivity density (FCD) of dancers with a mean period of over 10 years of dance training in contrast with a matched non-dancer group without formal dance training using resting-state fMRI scans. FCD was mapped and analyzed, and the functional connectivity (FC) analyses were then performed based on the difference of FCD. Compared to the non-dancers, the dancers exhibited significantly increased FCD in the precentral gyri, postcentral gyri and bilateral putamen. Furthermore, the results of the FC analysis revealed enhanced connections between the middle cingulate cortex and the bilateral putamen and between the precentral and the postcentral gyri. All findings indicated an enhanced functional integration in the cortico-basal ganglia loops that govern motor control and integration in dancers. These findings might reflect improved sensorimotor function for the dancers consequent to long-term dance training. PMID:26035693

  9. Disrupted reward circuits is associated with cognitive deficits and depression severity in major depressive disorder.

    PubMed

    Gong, Liang; Yin, Yingying; He, Cancan; Ye, Qing; Bai, Feng; Yuan, Yonggui; Zhang, Haisan; Lv, Luxian; Zhang, Hongxing; Xie, Chunming; Zhang, Zhijun

    2017-01-01

    Neuroimaging studies have demonstrated that major depressive disorder (MDD) patients show blunted activity responses to reward-related tasks. However, whether abnormal reward circuits affect cognition and depression in MDD patients remains unclear. Seventy-five drug-naive MDD patients and 42 cognitively normal (CN) subjects underwent a resting-state functional magnetic resonance imaging scan. The bilateral nucleus accumbens (NAc) were selected as seeds to construct reward circuits across all subjects. A multivariate linear regression analysis was employed to investigate the neural substrates of cognitive function and depression severity on the reward circuits in MDD patients. The common pathway underlying cognitive deficits and depression was identified with conjunction analysis. Compared with CN subjects, MDD patients showed decreased reward network connectivity that was primarily located in the prefrontal-striatal regions. Importantly, distinct and common neural pathways underlying cognition and depression were identified, implying the independent and synergistic effects of cognitive deficits and depression severity on reward circuits. This study demonstrated that disrupted topological organization within reward circuits was significantly associated with cognitive deficits and depression severity in MDD patients. These findings suggest that in addition to antidepressant treatment, normalized reward circuits should be a focus and a target for improving depression and cognitive deficits in MDD patients. Copyright © 2016 Elsevier Ltd. All rights reserved.

  10. A Dynamic Connectome Supports the Emergence of Stable Computational Function of Neural Circuits through Reward-Based Learning.

    PubMed

    Kappel, David; Legenstein, Robert; Habenschuss, Stefan; Hsieh, Michael; Maass, Wolfgang

    2018-01-01

    Synaptic connections between neurons in the brain are dynamic because of continuously ongoing spine dynamics, axonal sprouting, and other processes. In fact, it was recently shown that the spontaneous synapse-autonomous component of spine dynamics is at least as large as the component that depends on the history of pre- and postsynaptic neural activity. These data are inconsistent with common models for network plasticity and raise the following questions: how can neural circuits maintain a stable computational function in spite of these continuously ongoing processes, and what could be functional uses of these ongoing processes? Here, we present a rigorous theoretical framework for these seemingly stochastic spine dynamics and rewiring processes in the context of reward-based learning tasks. We show that spontaneous synapse-autonomous processes, in combination with reward signals such as dopamine, can explain the capability of networks of neurons in the brain to configure themselves for specific computational tasks, and to compensate automatically for later changes in the network or task. Furthermore, we show theoretically and through computer simulations that stable computational performance is compatible with continuously ongoing synapse-autonomous changes. After reaching good computational performance it causes primarily a slow drift of network architecture and dynamics in task-irrelevant dimensions, as observed for neural activity in motor cortex and other areas. On the more abstract level of reinforcement learning the resulting model gives rise to an understanding of reward-driven network plasticity as continuous sampling of network configurations.

  11. A Dynamic Connectome Supports the Emergence of Stable Computational Function of Neural Circuits through Reward-Based Learning

    PubMed Central

    Habenschuss, Stefan; Hsieh, Michael

    2018-01-01

    Synaptic connections between neurons in the brain are dynamic because of continuously ongoing spine dynamics, axonal sprouting, and other processes. In fact, it was recently shown that the spontaneous synapse-autonomous component of spine dynamics is at least as large as the component that depends on the history of pre- and postsynaptic neural activity. These data are inconsistent with common models for network plasticity and raise the following questions: how can neural circuits maintain a stable computational function in spite of these continuously ongoing processes, and what could be functional uses of these ongoing processes? Here, we present a rigorous theoretical framework for these seemingly stochastic spine dynamics and rewiring processes in the context of reward-based learning tasks. We show that spontaneous synapse-autonomous processes, in combination with reward signals such as dopamine, can explain the capability of networks of neurons in the brain to configure themselves for specific computational tasks, and to compensate automatically for later changes in the network or task. Furthermore, we show theoretically and through computer simulations that stable computational performance is compatible with continuously ongoing synapse-autonomous changes. After reaching good computational performance it causes primarily a slow drift of network architecture and dynamics in task-irrelevant dimensions, as observed for neural activity in motor cortex and other areas. On the more abstract level of reinforcement learning the resulting model gives rise to an understanding of reward-driven network plasticity as continuous sampling of network configurations. PMID:29696150

  12. Neural Basis of Anhedonia and Amotivation in Patients with Schizophrenia: The Role of Reward System.

    PubMed

    Lee, Jung Suk; Jung, Suwon; Park, Il Ho; Kim, Jae-Jin

    2015-01-01

    Anhedonia, the inability to feel pleasure, and amotivation, the lack of motivation, are two prominent negative symptoms of schizophrenia, which contribute to the poor social and occupational behaviors in the patients. Recently growing evidence shows that anhedonia and amotivation are tied together, but have distinct neural correlates. It is important to note that both of these symptoms may derive from deficient functioning of the reward network. A further analysis into the neuroimaging findings of schizophrenia shows that the neural correlates overlap in the reward network including the ventral striatum, anterior cingulate cortex and orbitofrontal cortex. Other neuroimaging studies have demonstrated the involvement of the default mode network in anhedonia. The identification of aspecific deficit in hedonic and motivational capacity may help to elucidate the mechanisms behind social functioning deficits in schizophrenia, and may also lead to more targeted treatment of negative symptoms.

  13. Common and distinct neural features of social and non-social reward processing in autism and social anxiety disorder.

    PubMed

    Richey, John A; Rittenberg, Alison; Hughes, Lauren; Damiano, Cara R; Sabatino, Antoinette; Miller, Stephanie; Hanna, Eleanor; Bodfish, James W; Dichter, Gabriel S

    2014-03-01

    Autism spectrum disorders (ASDs) and social anxiety disorder (SAD) are both characterized by social dysfunction, but no study to date has compared neural responses to social rewards in ASDs and SAD. Neural responses during social and non-social reward anticipation and outcomes were examined in individuals with ASD (n = 16), SAD (n = 15) and a control group (n = 19) via functional magnetic resonance imaging. Analyses modeling all three groups revealed increased nucleus accumbens (NAc) activation in SAD relative to ASD during monetary reward anticipation, whereas both the SAD and ASD group demonstrated decreased bilateral NAc activation relative to the control group during social reward anticipation. During reward outcomes, the SAD group did not differ significantly from the other two groups in ventromedial prefrontal cortex activation to either reward type. Analyses comparing only the ASD and SAD groups revealed greater bilateral amygdala activation to social rewards in SAD relative to ASD during both anticipation and outcome phases, and the magnitude of left amygdala hyperactivation in the SAD group during social reward anticipation was significantly correlated with the severity of trait anxiety symptoms. Results suggest reward network dysfunction to both monetary and social rewards in SAD and ASD during reward anticipation and outcomes, but that NAc hypoactivation during monetary reward anticipation differentiates ASD from SAD.

  14. Directional analysis of coherent oscillatory field potentials in the cerebral cortex and basal ganglia of the rat

    PubMed Central

    Sharott, Andrew; Magill, Peter J; Bolam, J Paul; Brown, Peter

    2005-01-01

    Population activity in cortico-basal ganglia circuits is synchronized at different frequencies according to brain state. However, the structures that are likely to drive the synchronization of activity in these circuits remain unclear. Furthermore, it is not known whether the direction of transmission of activity is fixed or dependent on brain state. We have used the directed transfer function (DTF) to investigate the direction in which coherent activity is effectively driven in cortico-basal ganglia circuits. Local field potentials (LFPs) were simultaneously recorded in the subthalamic nucleus (STN), globus pallidus (GP) and substantia nigra pars reticulata (SNr), together with the ipsilateral frontal electrocorticogram (ECoG) of anaesthetized rats. Directional analysis was performed on recordings made during robust cortical slow-wave activity (SWA) and ‘global activation’. During SWA, there was coherence at ∼1 Hz between ECoG and basal ganglia LFPs, with much of the coherent activity directed from cortex to basal ganglia. There were similar coherent activities at ∼1 Hz within the basal ganglia, with more activity directed from SNr to GP and STN, and from STN to GP rather than vice versa. During global activation, peaks in coherent activity were seen at higher frequencies (15–60 Hz), with most coherence also directed from cortex to basal ganglia. Within the basal ganglia, however, coherence was predominantly directed from GP to STN and SNr. Together, these results highlight a lead role for the cortex in activity relationships with the basal ganglia, and further suggest that the effective direction of coupling between basal ganglia nuclei is dynamically organized according to brain state, with activity relationships involving the GP displaying the greatest capacity to change. PMID:15550466

  15. Additive effects of oxytocin receptor gene polymorphisms on reward circuitry in youth with autism.

    PubMed

    Hernandez, L M; Krasileva, K; Green, S A; Sherman, L E; Ponting, C; McCarron, R; Lowe, J K; Geschwind, D H; Bookheimer, S Y; Dapretto, M

    2017-08-01

    Several common alleles in the oxytocin receptor gene (OXTR) are associated with altered brain function in reward circuitry in neurotypical adults and may increase risk for autism spectrum disorders (ASD). Yet, it is currently unknown how variation in the OXTR relates to brain functioning in individuals with ASD, and, critically, whether neural endophenotypes vary as a function of aggregate genetic risk. Here, for we believe the first time, we use a multi-locus approach to examine how genetic variation across several OXTR single-nucleotide polymorphisms (SNPs) affect functional connectivity of the brain's reward network. Using data from 41 children with ASD and 41 neurotypical children, we examined functional connectivity of the nucleus accumbens (NAcc) - a hub of the reward network - focusing on how connectivity varies with OXTR risk-allele dosage. Youth with ASD showed reduced NAcc connectivity with other areas in the reward circuit as a function of increased OXTR risk-allele dosage, as well as a positive association between risk-allele dosage and symptom severity, whereas neurotypical youth showed increased NAcc connectivity with frontal brain regions involved in mentalizing. In addition, we found that increased NAcc-frontal cortex connectivity in typically developing youth was related to better scores on a standardized measure of social functioning. Our results indicate that cumulative genetic variation on the OXTR impacts reward system connectivity in both youth with ASD and neurotypical controls. By showing differential genetic effects on neuroendophenotypes, these pathways elucidate mechanisms of vulnerability versus resilience in carriers of disease-associated risk alleles.

  16. Transcriptome analysis of trigeminal ganglia following masseter muscle inflammation in rats

    PubMed Central

    Park, Jennifer; Asgar, Jamila; Ro, Jin Y.

    2016-01-01

    Background Chronic pain in masticatory muscles is a major medical problem. Although mechanisms underlying persistent pain in masticatory muscles are not fully understood, sensitization of nociceptive primary afferents following muscle inflammation or injury contributes to muscle hyperalgesia. It is well known that craniofacial muscle injury or inflammation induces regulation of multiple genes in trigeminal ganglia, which is associated with muscle hyperalgesia. However, overall transcriptional profiles within trigeminal ganglia following masseter inflammation have not yet been determined. In the present study, we performed RNA sequencing assay in rat trigeminal ganglia to identify transcriptome profiles of genes relevant to hyperalgesia following inflammation of the rat masseter muscle. Results Masseter inflammation differentially regulated >3500 genes in trigeminal ganglia. Predominant biological pathways were predicted to be related with activation of resident non-neuronal cells within trigeminal ganglia or recruitment of immune cells. To focus our analysis on the genes more relevant to nociceptors, we selected genes implicated in pain mechanisms, genes enriched in small- to medium-sized sensory neurons, and genes enriched in TRPV1-lineage nociceptors. Among the 2320 candidate genes, 622 genes showed differential expression following masseter inflammation. When the analysis was limited to these candidate genes, pathways related with G protein-coupled signaling and synaptic plasticity were predicted to be enriched. Inspection of individual gene expression changes confirmed the transcriptional changes of multiple nociceptor genes associated with masseter hyperalgesia (e.g., Trpv1, Trpa1, P2rx3, Tac1, and Bdnf) and also suggested a number of novel probable contributors (e.g., Piezo2, Tmem100, and Hdac9). Conclusion These findings should further advance our understanding of peripheral mechanisms involved in persistent craniofacial muscle pain conditions and provide a

  17. Localization of Basal Ganglia and Thalamic Damage in Dyskinetic Cerebral Palsy.

    PubMed

    Aravamuthan, Bhooma R; Waugh, Jeff L

    2016-01-01

    Dyskinetic cerebral palsy affects 15%-20% of patients with cerebral palsy. Basal ganglia injury is associated with dyskinetic cerebral palsy, but the patterns of injury within the basal ganglia predisposing to dyskinetic cerebral palsy are unknown, making treatment difficult. For example, deep brain stimulation of the globus pallidus interna improves dystonia in only 40% of patients with dyskinetic cerebral palsy. Basal ganglia injury heterogeneity may explain this variability. To investigate this, we conducted a qualitative systematic review of basal ganglia and thalamic damage in dyskinetic cerebral palsy. Reviews and articles primarily addressing genetic or toxic causes of cerebral palsy were excluded yielding 22 studies (304 subjects). Thirteen studies specified the involved basal ganglia nuclei (subthalamic nucleus, caudate, putamen, globus pallidus, or lentiform nuclei, comprised by the putamen and globus pallidus). Studies investigating the lentiform nuclei (without distinguishing between the putamen and globus pallidus) showed that all subjects (19 of 19) had lentiform nuclei damage. Studies simultaneously but independently investigating the putamen and globus pallidus also showed that all subjects (35 of 35) had lentiform nuclei damage (i.e., putamen or globus pallidus damage); this was followed in frequency by damage to the putamen alone (70 of 101, 69%), the subthalamic nucleus (17 of 25, 68%), the thalamus (88 of 142, 62%), the globus pallidus (7/35, 20%), and the caudate (6 of 47, 13%). Globus pallidus damage was almost always coincident with putaminal damage. Noting consistent involvement of the lentiform nuclei in dyskinetic cerebral palsy, these results could suggest two groups of patients with dyskinetic cerebral palsy: those with putamen-predominant damage and those with panlenticular damage involving both the putamen and the globus pallidus. Differentiating between these groups could help predict response to therapies such as deep brain

  18. Willing to wait: Elevated reward-processing EEG activity associated with a greater preference for larger-but-delayed rewards.

    PubMed

    Pornpattananangkul, Narun; Nusslock, Robin

    2016-10-01

    While almost everyone discounts the value of future rewards over immediate rewards, people differ in their so-called delay-discounting. One of the several factors that may explain individual differences in delay-discounting is reward-processing. To study individual-differences in reward-processing, however, one needs to consider the heterogeneity of neural-activity at each reward-processing stage. Here using EEG, we separated reward-related neural activity into distinct reward-anticipation and reward-outcome stages using time-frequency characteristics. Thirty-seven individuals first completed a behavioral delay-discounting task. Then reward-processing EEG activity was assessed using a separate reward-learning task, called a reward time-estimation task. During this EEG task, participants were instructed to estimate time duration and were provided performance feedback on a trial-by-trial basis. Participants received monetary-reward for accurate-performance on Reward trials, but not on No-Reward trials. Reward trials, relative to No-Reward trials, enhanced EEG activity during both reward-anticipation (including, cued-locked delta power during cue-evaluation and pre-feedback alpha suppression during feedback-anticipation) and reward-outcome (including, feedback-locked delta, theta and beta power) stages. Moreover, all of these EEG indices correlated with behavioral performance in the time-estimation task, suggesting their essential roles in learning and adjusting performance to maximize winnings in a reward-learning situation. Importantly, enhanced EEG power during Reward trials, as reflected by stronger 1) pre-feedback alpha suppression, 2) feedback-locked theta and 3) feedback-locked beta, was associated with a greater preference for larger-but-delayed rewards in a separate, behavioral delay-discounting task. Results highlight the association between a stronger preference toward larger-but-delayed rewards and enhanced reward-processing. Moreover, our reward

  19. Willing to Wait: Elevated Reward-Processing EEG Activity Associated with a Greater Preference for Larger-But-Delayed Rewards

    PubMed Central

    Pornpattananangkul, Narun; Nusslock, Robin

    2016-01-01

    While almost everyone discounts the value of future rewards over immediate rewards, people differ in their so-called delay-discounting. One of the several factors that may explain individual differences in delay-discounting is reward-processing. To study individual-differences in reward-processing, however, one needs to consider the heterogeneity of neural-activity at each reward-processing stage. Here using EEG, we separated reward-related neural activity into distinct reward-anticipation and reward-outcome stages using time-frequency characteristics. Thirty-seven individuals completed a behavioral delay-discounting task. Reward-processing EEG activity was assessed using a separate reward-learning task, called a reward time-estimation task. During this task, participants were instructed to estimate time duration and were provided performance feedback on a trial-by-trial basis. Participants received monetary-reward for accurate-performance on Reward trials, but not on No-Reward trials. Reward trials, relative to No-Reward trials, enhanced EEG activity during both reward-anticipation stage (including, cued-locked delta power during cue-evaluation and pre-feedback alpha suppression during feedback-anticipation) and at the reward-outcome stage (including, feedback-locked delta, theta and beta power). Moreover, all of these EEG indices correlated with behavioral performance in the time-estimation task, suggesting their essential roles in learning and adjusting performance to maximize winnings in a reward-learning situation. Importantly, enhanced EEG power during Reward trials for 1) pre-feedback alpha suppression, 2) feedback-locked theta and 3) feedback-locked beta was associated with a greater preference for larger-but-delayed rewards. Results highlight the association between a stronger preference toward larger-but-delayed rewards and enhanced reward-processing. Moreover, our reward-processing EEG indices detail the specific stages of reward-processing where these

  20. White matter integrity between left basal ganglia and left prefrontal cortex is compromised in gambling disorder.

    PubMed

    van Timmeren, Tim; Jansen, Jochem M; Caan, Matthan W A; Goudriaan, Anna E; van Holst, Ruth J

    2017-11-01

    Pathological gambling (PG) is a behavioral addiction characterized by an inability to stop gambling despite the negative consequences, which may be mediated by cognitive flexibility deficits. Indeed, impaired cognitive flexibility has previously been linked to PG and also to reduced integrity of white matter connections between the basal ganglia and the prefrontal cortex. It remains unclear, however, how white matter integrity problems relate to cognitive inflexibility seen in PG. We used a cognitive switch paradigm during functional magnetic resonance imaging in pathological gamblers (PGs; n = 26) and healthy controls (HCs; n = 26). Cognitive flexibility performance was measured behaviorally by accuracy and reaction time on the switch task, while brain activity was measured in terms of blood oxygen level-dependent responses. We also used diffusion tensor imaging on a subset of data (PGs = 21; HCs = 21) in combination with tract-based spatial statistics and probabilistic fiber tracking to assess white matter integrity between the basal ganglia and the dorsolateral prefrontal cortex. Although there were no significant group differences in either task performance, related neural activity or tract-based spatial statistics, PGs did show decreased white matter integrity between the left basal ganglia and prefrontal cortex. Our results complement and expand similar findings from a previous study in alcohol-dependent patients. Although we found no association between white matter integrity and task performance here, decreased white matter connections may contribute to a diminished ability to recruit prefrontal networks needed for regulating behavior in PG. Hence, our findings could resonate an underlying risk factor for PG, and we speculate that these findings may extend to addiction in general. © 2016 Society for the Study of Addiction.

  1. The Brain's Reward Response Occurs Even Without Actual Reward!

    PubMed

    Fielding, A; Fu, Y; Franz, E A

    2018-06-01

    What if the brain's response to reward occurs even when there is no reward? Wouldn't that be a further concern for people prone to problem gambling and other forms of addiction, like those related to eating? Electroencephalography was employed to investigate this possibility using probabilistic feedback manipulations and measures of known event-related potentials (ERPs) related to reward processing. We tested the hypothesis-that reward-based ERPs would occur even in the absence of a tangible reward and when manipulations on expectation are implicit. The well-known P300 response potential was a key focus, and was assessed in non-gambling volunteer undergraduates on a task involving experimentally-manipulated probabilities of positive or negative feedback comprising three trial types-80, 50, or 20% positive feedback. A feedback stimulus (F1) followed a guess response between two possible outcomes (implicit win/loss), and then a second feedback stimulus (F2) was presented to confirm an alleged 'win' or 'loss' (explicit win/loss). Results revealed that amplitude of the P300 in F1-locked data (implicit manipulation) was larger (more positive) on average for feedback outcomes that were manipulated to be less likely than expected. The effect is pronounced after increased time on task (later trials), even though the majority of participants were not explicitly aware of our probability manipulations. For the explicit effects in F2-locked data, no meaningful or significant effects were observed. These findings point to the existence of proposed success-response mechanisms that operate not only explicitly but also with implicit manipulations that do not involve any direct indication of a win or loss, and are not associated with tangible rewards. Thus, there seems to be a non-explicit form of perception (we call 'implicit') associated with an internal experience of wins/losses (in the absence of actual rewards or losses) that can be measured in associated brain processes. The

  2. Neural basis of singing in crickets: central pattern generation in abdominal ganglia

    NASA Astrophysics Data System (ADS)

    Schöneich, Stefan; Hedwig, Berthold

    2011-12-01

    The neural mechanisms underlying cricket singing behavior have been the focus of several studies, but the central pattern generator (CPG) for singing has not been localized conclusively. To test if the abdominal ganglia contribute to the singing motor pattern and to analyze if parts of the singing CPG are located in these ganglia, we systematically truncated the abdominal nerve cord of fictively singing crickets while recording the singing motor pattern from a front-wing nerve. Severing the connectives anywhere between terminal ganglion and abdominal ganglion A3 did not preclude singing, although the motor pattern became more variable and failure-prone as more ganglia were disconnected. Singing terminated immediately and permanently after transecting the connectives between the metathoracic ganglion complex and the first unfused abdominal ganglion A3. The contribution of abdominal ganglia for singing pattern generation was confirmed by intracellular interneuron recordings and current injections. During fictive singing, an ascending interneuron with its soma and dendrite in A3 depolarized rhythmically. It spiked 10 ms before the wing-opener activity and hyperpolarized in phase with the wing-closer activity. Depolarizing current injection elicited rhythmic membrane potential oscillations and spike bursts that elicited additional syllables and reliably reset the ongoing chirp rhythm. Our results disclose that the abdominal ganglion A3 is directly involved in generating the singing motor pattern, whereas the more posterior ganglia seem to provide only stabilizing feedback to the CPG circuit. Localizing the singing CPG in the anterior abdominal neuromeres now allows analyzing its circuitry at the level of identified interneurons in subsequent studies.

  3. Structural connectivity of neural reward networks in youth at risk for substance use disorders.

    PubMed

    Squeglia, Lindsay M; Sorg, Scott F; Jacobus, Joanna; Brumback, Ty; Taylor, Charles T; Tapert, Susan F

    2015-07-01

    Having a positive family history of alcohol use disorders (FHP), as well as aberrant reward circuitry, has been implicated in the initiation of substance use during adolescence. This study explored the relationship between FHP status and reward circuitry in substance naïve youth to better understand future risky behaviors. Participants were 49 FHP and 45 demographically matched family history negative (FHN) substance-naïve 12-14 year-olds (54 % female). Subjects underwent structural magnetic resonance imaging, including diffusion tensor imaging. Nucleus accumbens and orbitofrontal cortex volumes were derived using FreeSurfer, and FSL probabilistic tractography probed structural connectivity and differences in white matter diffusivity estimates (e.g. fractional anisotropy, and mean, radial, and axial diffusivity) between fiber tracts connecting these regions. FHP and FHN youth did not differ on nucleus accumbens or orbitofrontal cortex volumes, white matter tract volumes, or percentages of streamlines (a proxy for fiber tract count) connecting these regions. However, within white matter tracts connecting the nucleus accumbens to the orbitofrontal cortex, FHP youth had significantly lower mean and radial diffusivity (ps < 0.03) than FHN youth. While white matter macrostructure between salience and reward regions did not differ between FHP and FHN youth, FHP youth showed greater white matter coherence within these tracts than FHN youth. Aberrant connectivity between reward regions in FHP youth could be linked to an increased risk for substance use initiation.

  4. Light-Induced Alterations in Basil Ganglia Kynurenic Acid Levels

    NASA Technical Reports Server (NTRS)

    Sroufe, Angela E.; Whittaker, J. A.; Patrickson, J. W.; Orr, M. C.

    1997-01-01

    The metabolic synthesis, release and breakdown of several known CNS neurotransmitters have been shown to follow a circadian pattern entrained to the environmental light/dark cycle. The levels of excitatory amino acid (EAA) transmitters such as glutamate, have been shown to vary with environmental lighting conditions. Kynurenic Acid (KA), an endogenous tryptophan metabolite and glutamate receptor antagonist, has been reported to have neuroprotective effects against EAA-induced excitotoxic cell damage. Changes in KA's activity within the mammalian basal ganglia has been proposed as being contributory to neurotoxicity in Huntington's Disease. It is not known whether CNS KA levels follow a circadian pattern or exhibit light-induced fluctuations. However, because the symptoms of certain degenerative motor disorders seem to fluctuate with daily 24 hour rhythm, we initiated studies to determine if basal ganglia KA were influenced by the daily light/dark cycle and could influence motor function. Therefore in this study, HPLC-EC was utilized to determine if basal ganglia KA levels in tissue extracts from adult male Long-Evans rats (200-250g) entrained to 24 and 48 hours constant light and dark conditions, respectively. Samples were taken one hour before the onset of the subjective day and one hour prior to the onset of the subjective night in order to detect possible phase differences in KA levels and to allow for accumulation of factors expressed in association with the light or dark phase. Data analysis revealed that KA levels in the basal ganglia vary with environmental lighting conditions; being elevated generally during the dark. Circadian phase differences in KA levels were also evident during the subjective night and subjective day, respectively. Results from these studies are discussed with respect to potential cyclic changes in neuronal susceptibility to excitotoxic damage during the daily 24 hour cycle and its possible relevance to future therapeutic approaches in

  5. Metabolite alterations in basal ganglia associated with methamphetamine-related psychiatric symptoms. A proton MRS study.

    PubMed

    Sekine, Yoshimoto; Minabe, Yoshio; Kawai, Masayoshi; Suzuki, Katsuaki; Iyo, Masaomi; Isoda, Haruo; Sakahara, Harumi; Ashby, Charles R; Takei, Nori; Mori, Norio

    2002-09-01

    Following the chronic use of methamphetamine, some individuals experience psychosis and anxiety. One reason may be the persistence of metabolite abnormalities in the brain of currently abstinent former methamphetamine users. In this study, N-acetylaspartate (NAA), creatine plus phosphocreatine (Cr+PCr), and choline-containing compound (Cho) levels were measured in the left and right basal ganglia using proton magnetic resonance spectroscopy (MRS) in 13 abstinent methamphetamine users and 11 healthy comparison subjects with no history of illicit drug use. The methamphetamine users showed a significantly reduced Cr+PCr/Cho ratio in the bilateral basal ganglia compared with the healthy comparison subjects. Furthermore, the reduction in the Cr+PCr/Cho ratio was significantly correlated with the duration of methamphetamine use and with the severity of residual psychiatric symptoms. NAA/Cho ratios in the bilateral basal ganglia did not significantly differ between methamphetamine users and comparison subjects. These findings suggest that protracted use of methamphetamine may cause metabolite alterations in the basal ganglia. Furthermore, residual psychiatric symptoms may be attributable to the metabolite alterations in the basal ganglia.

  6. Two spatiotemporally distinct value systems shape reward-based learning in the human brain.

    PubMed

    Fouragnan, Elsa; Retzler, Chris; Mullinger, Karen; Philiastides, Marios G

    2015-09-08

    Avoiding repeated mistakes and learning to reinforce rewarding decisions is critical for human survival and adaptive actions. Yet, the neural underpinnings of the value systems that encode different decision-outcomes remain elusive. Here coupling single-trial electroencephalography with simultaneously acquired functional magnetic resonance imaging, we uncover the spatiotemporal dynamics of two separate but interacting value systems encoding decision-outcomes. Consistent with a role in regulating alertness and switching behaviours, an early system is activated only by negative outcomes and engages arousal-related and motor-preparatory brain structures. Consistent with a role in reward-based learning, a later system differentially suppresses or activates regions of the human reward network in response to negative and positive outcomes, respectively. Following negative outcomes, the early system interacts and downregulates the late system, through a thalamic interaction with the ventral striatum. Critically, the strength of this coupling predicts participants' switching behaviour and avoidance learning, directly implicating the thalamostriatal pathway in reward-based learning.

  7. High temporal discounters overvalue immediate rewards rather than undervalue future rewards: an event-related brain potential study.

    PubMed

    Cherniawsky, Avital S; Holroyd, Clay B

    2013-03-01

    Impulsivity is characterized in part by heightened sensitivity to immediate relative to future rewards. Although previous research has suggested that "high discounters" in intertemporal choice tasks tend to prefer immediate over future rewards because they devalue the latter, it remains possible that they instead overvalue immediate rewards. To investigate this question, we recorded the reward positivity, a component of the event-related brain potential (ERP) associated with reward processing, with participants engaged in a task in which they received both immediate and future rewards and nonrewards. The participants also completed a temporal discounting task without ERP recording. We found that immediate but not future rewards elicited the reward positivity. High discounters also produced larger reward positivities to immediate rewards than did low discounters, indicating that high discounters relatively overvalued immediate rewards. These findings suggest that high discounters may be more motivated than low discounters to work for monetary rewards, irrespective of the time of arrival of the incentives.

  8. Addictive drugs and brain stimulation reward.

    PubMed

    Wise, R A

    1996-01-01

    Direct electrical or chemical stimulation of specific brain regions can establish response habits similar to those established by natural rewards such as food or sexual contact. Cocaine, mu and delta opiates, nicotine, phencyclidine, and cannabis each have actions that summate with rewarding electrical stimulation of the medial forebrain bundle (MFB). The reward-potentiating effects of amphetamine and opiates are associated with central sites of action where these drugs also have their direct rewarding effects, suggesting common mechanisms for drug reward per se and for drug potentiation of brain stimulation reward. The central sites at which these and perhaps other drugs of abuse potentiate brain stimulation reward and are rewarding in their own right are consistent with the hypothesis that the laboratory reward of brain stimulation and the pharmacological rewards of addictive drugs are habit forming because they act in the brain circuits that subserve more natural and biologically significant rewards.

  9. Dysfunctions of the basal ganglia-cerebellar-thalamo-cortical system produce motor tics in Tourette syndrome

    PubMed Central

    Arbib, Michael A.; Baldassarre, Gianluca

    2017-01-01

    Motor tics are a cardinal feature of Tourette syndrome and are traditionally associated with an excess of striatal dopamine in the basal ganglia. Recent evidence increasingly supports a more articulated view where cerebellum and cortex, working closely in concert with basal ganglia, are also involved in tic production. Building on such evidence, this article proposes a computational model of the basal ganglia-cerebellar-thalamo-cortical system to study how motor tics are generated in Tourette syndrome. In particular, the model: (i) reproduces the main results of recent experiments about the involvement of the basal ganglia-cerebellar-thalamo-cortical system in tic generation; (ii) suggests an explanation of the system-level mechanisms underlying motor tic production: in this respect, the model predicts that the interplay between dopaminergic signal and cortical activity contributes to triggering the tic event and that the recently discovered basal ganglia-cerebellar anatomical pathway may support the involvement of the cerebellum in tic production; (iii) furnishes predictions on the amount of tics generated when striatal dopamine increases and when the cortex is externally stimulated. These predictions could be important in identifying new brain target areas for future therapies. Finally, the model represents the first computational attempt to study the role of the recently discovered basal ganglia-cerebellar anatomical links. Studying this non-cortex-mediated basal ganglia-cerebellar interaction could radically change our perspective about how these areas interact with each other and with the cortex. Overall, the model also shows the utility of casting Tourette syndrome within a system-level perspective rather than viewing it as related to the dysfunction of a single brain area. PMID:28358814

  10. Dysfunctions of the basal ganglia-cerebellar-thalamo-cortical system produce motor tics in Tourette syndrome.

    PubMed

    Caligiore, Daniele; Mannella, Francesco; Arbib, Michael A; Baldassarre, Gianluca

    2017-03-01

    Motor tics are a cardinal feature of Tourette syndrome and are traditionally associated with an excess of striatal dopamine in the basal ganglia. Recent evidence increasingly supports a more articulated view where cerebellum and cortex, working closely in concert with basal ganglia, are also involved in tic production. Building on such evidence, this article proposes a computational model of the basal ganglia-cerebellar-thalamo-cortical system to study how motor tics are generated in Tourette syndrome. In particular, the model: (i) reproduces the main results of recent experiments about the involvement of the basal ganglia-cerebellar-thalamo-cortical system in tic generation; (ii) suggests an explanation of the system-level mechanisms underlying motor tic production: in this respect, the model predicts that the interplay between dopaminergic signal and cortical activity contributes to triggering the tic event and that the recently discovered basal ganglia-cerebellar anatomical pathway may support the involvement of the cerebellum in tic production; (iii) furnishes predictions on the amount of tics generated when striatal dopamine increases and when the cortex is externally stimulated. These predictions could be important in identifying new brain target areas for future therapies. Finally, the model represents the first computational attempt to study the role of the recently discovered basal ganglia-cerebellar anatomical links. Studying this non-cortex-mediated basal ganglia-cerebellar interaction could radically change our perspective about how these areas interact with each other and with the cortex. Overall, the model also shows the utility of casting Tourette syndrome within a system-level perspective rather than viewing it as related to the dysfunction of a single brain area.

  11. Biological auctions with multiple rewards

    PubMed Central

    Reiter, Johannes G.; Kanodia, Ayush; Gupta, Raghav; Nowak, Martin A.; Chatterjee, Krishnendu

    2015-01-01

    The competition for resources among cells, individuals or species is a fundamental characteristic of evolution. Biological all-pay auctions have been used to model situations where multiple individuals compete for a single resource. However, in many situations multiple resources with various values exist and single reward auctions are not applicable. We generalize the model to multiple rewards and study the evolution of strategies. In biological all-pay auctions the bid of an individual corresponds to its strategy and is equivalent to its payment in the auction. The decreasingly ordered rewards are distributed according to the decreasingly ordered bids of the participating individuals. The reproductive success of an individual is proportional to its fitness given by the sum of the rewards won minus its payments. Hence, successful bidding strategies spread in the population. We find that the results for the multiple reward case are very different from the single reward case. While the mixed strategy equilibrium in the single reward case with more than two players consists of mostly low-bidding individuals, we show that the equilibrium can convert to many high-bidding individuals and a few low-bidding individuals in the multiple reward case. Some reward values lead to a specialization among the individuals where one subpopulation competes for the rewards and the other subpopulation largely avoids costly competitions. Whether the mixed strategy equilibrium is an evolutionarily stable strategy (ESS) depends on the specific values of the rewards. PMID:26180069

  12. BLOOD VESSELS IN GANGLIA IN HUMAN ESOPHAGUS MIGHT EXPLAIN THE HIGHER FREQUENCY OF MEGAESOPHAGUS COMPARED WITH MEGACOLON

    PubMed Central

    Adad, Sheila Jorge; Etchebehere, Renata Margarida; Jammal, Alessandro Adad

    2014-01-01

    This study aimed to determine the existence of blood vessels within ganglia of the myenteric plexus of the human esophagus and colon. At necropsy, 15 stillborns, newborns and children up to two years of age, with no gastrointestinal disorders, were examined. Rings of the esophagus and colon were analyzed and then fixed in formalin and processed for paraffin. Histological sections were stained by hematoxylin-eosin, Giemsa and immunohistochemistry for the characterization of endothelial cells, using antibodies for anti-factor VIII and CD31. Blood vessels were identified within the ganglia of the myenteric plexus of the esophagus, and no blood vessels were found in any ganglia of the colon. It was concluded that the ganglia of the myenteric plexus of the esophagus are vascularized, while the ganglia of the colon are avascular. Vascularization within the esophageal ganglia could facilitate the entrance of infectious agents, as well as the development of inflammatory responses (ganglionitis) and denervation, as found in Chagas disease and idiopathic achalasia. This could explain the higher frequency of megaesophagus compared with megacolon. PMID:25351549

  13. Monetary rewards modulate inhibitory control

    PubMed Central

    Herrera, Paula M.; Speranza, Mario; Hampshire, Adam; Bekinschtein, Tristán A.

    2014-01-01

    The ability to override a dominant response, often referred to as behavioral inhibition, is considered a key element of executive cognition. Poor behavioral inhibition is a defining characteristic of several neurological and psychiatric populations. Recently, there has been increasing interest in the motivational dimension of behavioral inhibition, with some experiments incorporating emotional contingencies in classical inhibitory paradigms such as the Go/NoGo and Stop Signal Tasks (SSTs). Several studies have reported a positive modulatory effect of reward on performance in pathological conditions such as substance abuse, pathological gambling, and Attention Deficit Hyperactive Disorder (ADHD). However, experiments that directly investigate the modulatory effects of reward magnitudes on the performance of inhibitory tasks are scarce and little is known about the finer grained relationship between motivation and inhibitory control. Here we probed the effect of reward magnitude and context on behavioral inhibition with three modified versions of the widely used SST. The pilot study compared inhibition performance during six blocks alternating neutral feedback, low, medium, and high monetary rewards. Study One compared increasing vs. decreasing rewards, with low, high rewards, and neutral feedback; whilst Study Two compared low and high reward magnitudes alone also in an increasing and decreasing reward design. The reward magnitude effect was not demonstrated in the pilot study, probably due to a learning effect induced by practice in this lengthy task. The reward effect per se was weak but the context (order of reward) was clearly suggested in Study One, and was particularly strongly confirmed in study two. In addition, these findings revealed a “kick start effect” over global performance measures. Specifically, there was a long lasting improvement in performance throughout the task when participants received the highest reward magnitudes at the beginning of the

  14. Latent Herpes Simplex Virus 1 Infection Does Not Induce Apoptosis in Human Trigeminal Ganglia

    PubMed Central

    Lindemann, Anja; Sinicina, Inga; Strupp, Michael; Brandt, Thomas; Hüfner, Katharina

    2015-01-01

    Herpes simplex virus 1 (HSV-1) can establish lifelong latency in human trigeminal ganglia. Latently infected ganglia contain CD8+ T cells, which secrete granzyme B and are thus capable of inducing neuronal apoptosis. Using immunohistochemistry and single-cell reverse transcription-quantitative PCR (RT-qPCR), higher frequency and transcript levels of caspase-3 were found in HSV-1-negative compared to HSV-1-positive ganglia and neurons, respectively. No terminal deoxynucleotidyltransferase-mediated dUTP-biotin nick end labeling (TUNEL) assay-positive neurons were detected. The infiltrating T cells do not induce apoptosis in latently infected neurons. PMID:25762734

  15. Selective attentional enhancement and inhibition of fronto-posterior connectivity by the basal ganglia during attention switching.

    PubMed

    van Schouwenburg, Martine R; den Ouden, Hanneke E M; Cools, Roshan

    2015-06-01

    The prefrontal cortex and the basal ganglia interact to selectively gate a desired action. Recent studies have shown that this selective gating mechanism of the basal ganglia extends to the domain of attention. Here, we investigate the nature of this action-like gating mechanism for attention using a spatial attention-switching paradigm in combination with functional neuroimaging and dynamic causal modeling. We show that the basal ganglia guide attention by focally releasing inhibition of task-relevant representations, while simultaneously inhibiting task-irrelevant representations by selectively modulating prefrontal top-down connections. These results strengthen and specify the role of the basal ganglia in attention. Moreover, our findings have implications for psychological theorizing by suggesting that inhibition of unattended sensory regions is not only a consequence of mutual suppression, but is an active process, subserved by the basal ganglia. © The Author 2013. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

  16. Symmetrical and bilateral basal ganglia calcification. Case series and literature review.

    PubMed

    Jiménez-Ruiz, Amado; Cárdenas-Sáenz, Omar; Ruiz-Sandoval, José Luis

    2018-01-01

    Symmetric, bilateral basal ganglia calcification is rare finding that sometimes occurs asymptomatically. Its prevalence increases with age, and the most affected site is the globus pallidus. A series of seven cases with clinical and imaging diagnosis of basal ganglia calcification, recorded during the 2012 to 2016 period at the Department of Internal Medicine of the Hospital Civil de Guadalajara "Fray Antonio Alcalde, is presented. Most common clinical presentation was with altered alertness, headache and seizures. There was one case with movement disorders; there were no cases identified with dementia or tetany. Ganglia calcification can be associated with age-related neurodegenerative changes, but it can be an initial manifestation of a variety of systemic pathologies, including disorders of the calcium metabolism, intoxication by different agents, and autoimmune and genetic diseases. Correlation of typical imaging findings with clinical manifestations and laboratory results should be established to reach a definitive judgment. Copyright: © 2018 SecretarÍa de Salud.

  17. Running is rewarding and antidepressive.

    PubMed

    Brené, Stefan; Bjørnebekk, Astrid; Aberg, Elin; Mathé, Aleksander A; Olson, Lars; Werme, Martin

    2007-09-10

    Natural behaviors such as eating, drinking, reproduction and exercise activate brain reward pathways and consequently the individual engages in these behaviors to receive the reward. However, drugs of abuse are even more potent in activating the reward pathways. Rewarding behaviors and addictive drugs also affect other parts of the brain not directly involved in the mediation of reward. For instance, running increases neurogenesis in hippocampus and is beneficial as an antidepressant in a genetic animal model of depression and in depressed humans. Here we discuss and compare neurochemical and functional changes in the brain after addictive drugs and exercise with a focus on brain reward pathways and hippocampus.

  18. Running is rewarding and antidepressive

    PubMed Central

    Brené, Stefan; Bjørnebekk, Astrid; Åberg, Elin; Mathé, Aleksander A; Olson, Lars; Werme, Martin

    2007-01-01

    Natural behaviors such as eating, drinking, reproduction and exercise activate brain reward pathways and consequently the individual engages in these behaviors to receive the reward. However, drugs of abuse are even more potent to activate the reward pathways. Rewarding behaviors and addictive drugs also affect other parts of the brain not directly involved in the mediation of reward. For instance, running increases neurogenesis in hippocampus and is beneficial as an antidepressant in a genetic animal model of depression and in depressed humans. Here we discuss and compare neurochemical and functional changes in the brain after addictive drugs and exercise with a focus on brain reward pathways and hippocampus. PMID:17561174

  19. A direct GABAergic output from the basal ganglia to frontal cortex

    PubMed Central

    Saunders, Arpiar; Oldenburg, Ian A.; Berezovskii, Vladimir K.; Johnson, Caroline A.; Kingery, Nathan D.; Elliott, Hunter L.; Xie, Tiao; Gerfen, Charles R.; Sabatini, Bernardo L.

    2014-01-01

    The basal ganglia (BG) are phylogenetically conserved subcortical nuclei necessary for coordinated motor action and reward learning1. Current models postulate that the BG modulate cerebral cortex indirectly via an inhibitory output to thalamus, bidirectionally controlled by the BG via direct (dSPNs) and indirect (iSPNs) pathway striatal projection neurons2–4. The BG thalamic output sculpts cortical activity by interacting with signals from sensory and motor systems5. Here we describe a direct projection from the globus pallidus externus (GP), a central nucleus of the BG, to frontal regions of the cerebral cortex (FC). Two cell types make up the GP-FC projection, distinguished by their electrophysiological properties, cortical projections and expression of choline acetyltransferase (ChAT), a synthetic enzyme for the neurotransmitter acetylcholine (ACh). Despite these differences, ChAT+ cells, which have been historically identified as an extension of the nucleus basalis (NB), as well as ChAT− cells, release the inhibitory neurotransmitter GABA (γ-aminobutyric acid) and are inhibited by iSPNs and dSPNs of dorsal striatum. Thus GP-FC cells comprise a direct GABAergic/cholinergic projection under the control of striatum that activates frontal cortex in vivo. Furthermore, iSPN inhibition of GP-FC cells is sensitive to dopamine 2 receptor signaling, revealing a pathway by which drugs that target dopamine receptors for the treatment of neuropsychiatric disorders can act in the BG to modulate frontal cortices. PMID:25739505

  20. Neural Basis of Anhedonia and Amotivation in Patients with Schizophrenia: The role of Reward System

    PubMed Central

    Lee, Jung Suk; Jung, Suwon; Park, Il Ho; Kim, Jae-Jin

    2015-01-01

    Anhedonia, the inability to feel pleasure, and amotivation, the lack of motivation, are two prominent negative symptoms of schizophrenia, which contribute to the poor social and occupational behaviors in the patients. Recently growing evidence shows that anhedonia and amotivation are tied together, but have distinct neural correlates. It is important to note that both of these symptoms may derive from deficient functioning of the reward network. A further analysis into the neuroimaging findings of schizophrenia shows that the neural correlates overlap in the reward network including the ventral striatum, anterior cingulate cortex and orbitofrontal cortex. Other neuroimaging studies have demonstrated the involvement of the default mode network in anhedonia. The identification of a specific deficit in hedonic and motivational capacity may help to elucidate the mechanisms behind social functioning deficits in schizophrenia, and may also lead to more targeted treatment of negative symptoms. PMID:26630955

  1. Introduction: Addiction and Brain Reward and Anti-Reward Pathways

    PubMed Central

    Gardner, Eliot L.

    2013-01-01

    Addictive drugs have in common that they are voluntarily self-administered by laboratory animals (usually avidly) and that they enhance the functioning of the reward circuitry of the brain (producing the “high” that the drug-user seeks). The core reward circuitry consists of an “in series” circuit linking the ventral tegmental area, nucleus accumbens, and ventral pallidum - via the medial forebrain bundle. Although originally believed to encode simply the set-point of hedonic tone, these circuits are now believed to be functionally far more complex - also encoding attention, expectancy of reward, disconfirmation of reward expectancy, and incentive motivation. “Hedonic dysregulation” within these circuits may lead to addiction. The “second-stage” dopaminergic component in this reward circuitry is the crucial addictive-drug-sensitive component. All addictive drugs have in common that they enhance (directly or indirectly or even transsynaptically) dopaminergic reward synaptic function in the nucleus accumbens. Drug self-administration is regulated by nucleus accumbens dopamine levels, and is done to keep nucleus accumbens dopamine within a specific elevated range (to maintain a desired hedonic level). For some classes of addictive drugs (e.g., opiates), tolerance to the euphoric effects develops with chronic use. Post-use dysphoria then comes to dominate reward circuit hedonic tone, and addicts no longer use drugs to get “high,” but simply to get back to normal (“get straight”). The brain circuits mediating the pleasurable effects of addictive drugs are anatomically, neurophysiologically, and neurochemically different from those mediating physical dependence, and from those mediating craving and relapse. There are important genetic variations in vulnerability to drug addiction, yet environmental factors such as stress and social defeat also alter brain-reward mechanisms in such a manner as to impart vulnerability to addiction. In short, the

  2. Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans.

    PubMed

    Elliott, R; Agnew, Z; Deakin, J F W

    2008-05-01

    Functional imaging studies in recent years have confirmed the involvement of orbitofrontal cortex (OFC) in human reward processing and have suggested that OFC responses are context-dependent. A seminal electrophysiological experiment in primates taught animals to associate abstract visual stimuli with differently valuable food rewards. Subsequently, pairs of these learned abstract stimuli were presented and firing of OFC neurons to the medium-value stimulus was measured. OFC firing was shown to depend on the relative value context. In this study, we developed a human analogue of this paradigm and scanned subjects using functional magnetic resonance imaging. The analysis compared neuronal responses to two superficially identical events, which differed only in terms of the preceding context. Medial OFC response to the same perceptual stimulus was greater when the stimulus predicted the more valuable of two rewards than when it predicted the less valuable. Additional responses were observed in other components of reward circuitry, the amygdala and ventral striatum. The central finding is consistent with the primate results and suggests that OFC neurons code relative rather than absolute reward value. Amygdala and striatal involvement in coding reward value is also consistent with recent functional imaging data. By using a simpler and less confounded paradigm than many functional imaging studies, we are able to demonstrate that relative financial reward value per se is coded in distinct subregions of an extended reward and decision-making network.

  3. Discrete coding of stimulus value, reward expectation, and reward prediction error in the dorsal striatum.

    PubMed

    Oyama, Kei; Tateyama, Yukina; Hernádi, István; Tobler, Philippe N; Iijima, Toshio; Tsutsui, Ken-Ichiro

    2015-11-01

    To investigate how the striatum integrates sensory information with reward information for behavioral guidance, we recorded single-unit activity in the dorsal striatum of head-fixed rats participating in a probabilistic Pavlovian conditioning task with auditory conditioned stimuli (CSs) in which reward probability was fixed for each CS but parametrically varied across CSs. We found that the activity of many neurons was linearly correlated with the reward probability indicated by the CSs. The recorded neurons could be classified according to their firing patterns into functional subtypes coding reward probability in different forms such as stimulus value, reward expectation, and reward prediction error. These results suggest that several functional subgroups of dorsal striatal neurons represent different kinds of information formed through extensive prior exposure to CS-reward contingencies. Copyright © 2015 the American Physiological Society.

  4. Discrete coding of stimulus value, reward expectation, and reward prediction error in the dorsal striatum

    PubMed Central

    Oyama, Kei; Tateyama, Yukina; Hernádi, István; Tobler, Philippe N.; Iijima, Toshio

    2015-01-01

    To investigate how the striatum integrates sensory information with reward information for behavioral guidance, we recorded single-unit activity in the dorsal striatum of head-fixed rats participating in a probabilistic Pavlovian conditioning task with auditory conditioned stimuli (CSs) in which reward probability was fixed for each CS but parametrically varied across CSs. We found that the activity of many neurons was linearly correlated with the reward probability indicated by the CSs. The recorded neurons could be classified according to their firing patterns into functional subtypes coding reward probability in different forms such as stimulus value, reward expectation, and reward prediction error. These results suggest that several functional subgroups of dorsal striatal neurons represent different kinds of information formed through extensive prior exposure to CS-reward contingencies. PMID:26378201

  5. Self-stimulation in the rat: quantitative characteristics of the reward pathway.

    PubMed

    Gallistel, C R

    1978-12-01

    Quantitative characteristics of the neural pathway that carries the reinforcing signal in electrical self-stimulation of the brain were established by finding which combinations of stimulation parameters give the same performance in a runway. The reward for each run was a train of evenly spaced monophasic cathodal pulses from a monopolar electrode. With train duration and pulse frequency held constant, the required current was a hyperbolic function of pulse duration, with chronaxie c approximately 1.5 msec. With pulse duration held constant, the required strength of the train (the charge delivered per second) was a hyperbolic function of train duration, with chronaxie C approximately 500 msec. To a first approximation, the values of c and C were independent of the choice either of train duration and pulse frequency or of pulse duration, respectively. Hence, the current intensity required by any choice of train duration, pulse frequency, and pulse duration dependent on only two basic parameters, c and C, and one quantity, Qi, the required impulse charge. These may reflect, respectively, current integration by directly excited neurons; temporal integration of neural activity by synaptic processes in a neural network; and the peak of the impulse response of the network, assuming that the network has linear dynamics and that the reward depends on the peak of the output of the network.

  6. Genetics Home Reference: biotin-thiamine-responsive basal ganglia disease

    MedlinePlus

    ... link) Biotin-Thiamine-Responsive Basal Ganglia Disease Scientific Articles on PubMed (1 link) PubMed OMIM (1 link) THIAMINE METABOLISM DYSFUNCTION SYNDROME 2 (BIOTIN- OR THIAMINE-RESPONSIVE TYPE) ...

  7. Monetary rewards influence retrieval orientations.

    PubMed

    Halsband, Teresa M; Ferdinand, Nicola K; Bridger, Emma K; Mecklinger, Axel

    2012-09-01

    Reward anticipation during learning is known to support memory formation, but its role in retrieval processes is so far unclear. Retrieval orientations, as a reflection of controlled retrieval processing, are one aspect of retrieval that might be modulated by reward. These processes can be measured using the event-related potentials (ERPs) elicited by retrieval cues from tasks with different retrieval requirements, such as via changes in the class of targeted memory information. To determine whether retrieval orientations of this kind are modulated by reward during learning, we investigated the effects of high and low reward expectancy on the ERP correlates of retrieval orientation in two separate experiments. The reward manipulation at study in Experiment 1 was associated with later memory performance, whereas in Experiment 2, reward was directly linked to accuracy in the study task. In both studies, the participants encoded mixed lists of pictures and words preceded by high- or low-reward cues. After 24 h, they performed a recognition memory exclusion task, with words as the test items. In addition to a previously reported material-specific effect of retrieval orientation, a frontally distributed, reward-associated retrieval orientation effect was found in both experiments. These findings suggest that reward motivation during learning leads to the adoption of a reward-associated retrieval orientation to support the retrieval of highly motivational information. Thus, ERP retrieval orientation effects not only reflect retrieval processes related to the sought-for materials, but also relate to the reward conditions with which items were combined during encoding.

  8. Reward and punishment.

    PubMed

    Sigmund, K; Hauert, C; Nowak, M A

    2001-09-11

    Minigames capturing the essence of Public Goods experiments show that even in the absence of rationality assumptions, both punishment and reward will fail to bring about prosocial behavior. This result holds in particular for the well-known Ultimatum Game, which emerges as a special case. But reputation can induce fairness and cooperation in populations adapting through learning or imitation. Indeed, the inclusion of reputation effects in the corresponding dynamical models leads to the evolution of economically productive behavior, with agents contributing to the public good and either punishing those who do not or rewarding those who do. Reward and punishment correspond to two types of bifurcation with intriguing complementarity. The analysis suggests that reputation is essential for fostering social behavior among selfish agents, and that it is considerably more effective with punishment than with reward.

  9. Electrophysiological evidence for the involvement of proactive and reactive control in a rewarded stop-signal task.

    PubMed

    Schevernels, Hanne; Bombeke, Klaas; Van der Borght, Liesbet; Hopf, Jens-Max; Krebs, Ruth M; Boehler, C Nicolas

    2015-11-01

    Reward availability is known to facilitate various cognitive operations, which is usually studied in cue-based paradigms that allow for enhanced preparation in reward-related trials. However, recent research using tasks that signal reward availability via task-relevant stimuli suggests that reward can also rapidly promote performance independent of global strategic preparation. Notably, this effect was also observed in a reward-related stop-signal task, in which behavioral measures of inhibition speed were found to be shorter in trials signaling reward. Corresponding fMRI results implied that this effect relies on boosted reactive control as indicated by increased activity in the 'inhibition-related network' in the reward-related condition. Here, we used EEG to better characterize transient modulations of attentional processes likely preceding this ultimate implementation of response inhibition. Importantly, such modulations would probably reflect enhanced proactive control in the form of more top-down attention to reward-related features. Counter to the notion that behavioral benefits would rely purely on reactive control, we found increased stop-evoked attentional processing (larger N1 component) on reward-related trials. This effect was accompanied by enhanced frontal P3 amplitudes reflecting successful stopping, and earlier and larger ERP differences between successful and failed stop trials in the reward-related condition. Finally, more global proactive control processes in the form of a reward context modulation of reward-unrelated trials did not have an effect on stopping performance but did influence attentional processing of go stimuli. Together, these results suggest that proactive and reactive processes can interact to bring about stimulus-specific reward benefits when the task precludes differential global preparation. Copyright © 2015 Elsevier Inc. All rights reserved.

  10. Infantile Basal Ganglia Stroke after Mild Head Trauma Associated with Mineralizing Angiopathy of Lenticulostriate Arteries: An Under Recognized Entity.

    PubMed

    Toelle, Sandra P; Avetisyan, Tamara; Kuyumjyan, Nune; Sukhudyan, Biayna; Boltshauser, Eugen; Hackenberg, Annette

    2018-05-23

    Basal ganglia infarction in young children, mostly after mild head trauma, has been repeatedly reported. The pathogenesis and the risk factors are not fully understood. Lenticulostriate vasculopathy, usually referred to as basal ganglia calcification, is discussed as one of them. We describe five young (7-13 months old on presentation) male children who suffered from hemiparesis due to ischemic stroke of the basal ganglia, four of them after minor head trauma. All of them had calcification in the basal ganglia visible on computed tomography or cranial ultrasound but not on magnetic resonance imaging. Follow-up care was remarkable for recurrent infarction in three patients. One patient had a second symptomatic stroke on the contralateral side, and two patients showed new asymptomatic infarctions in the contralateral basal ganglia on imaging. In view of the scant literature, this clinic-radiologic entity seems under recognized. We review the published cases and hypothesize that male sex and iron deficiency anemia are risk factors for basal ganglia stroke after minor trauma in the context of basal ganglia calcification in infants. We suggest to perform appropriate targeted neuroimaging in case of infantile basal ganglia stroke, and to consider prophylactic medical treatment, although its value in this context is not proven. Georg Thieme Verlag KG Stuttgart · New York.

  11. Modulation of neural activity by reward in medial intraparietal cortex is sensitive to temporal sequence of reward

    PubMed Central

    Rajalingham, Rishi; Stacey, Richard Greg; Tsoulfas, Georgios

    2014-01-01

    To restore movements to paralyzed patients, neural prosthetic systems must accurately decode patients' intentions from neural signals. Despite significant advancements, current systems are unable to restore complex movements. Decoding reward-related signals from the medial intraparietal area (MIP) could enhance prosthetic performance. However, the dynamics of reward sensitivity in MIP is not known. Furthermore, reward-related modulation in premotor areas has been attributed to behavioral confounds. Here we investigated the stability of reward encoding in MIP by assessing the effect of reward history on reward sensitivity. We recorded from neurons in MIP while monkeys performed a delayed-reach task under two reward schedules. In the variable schedule, an equal number of small- and large-rewards trials were randomly interleaved. In the constant schedule, one reward size was delivered for a block of trials. The memory period firing rate of most neurons in response to identical rewards varied according to schedule. Using systems identification tools, we attributed the schedule sensitivity to the dependence of neural activity on the history of reward. We did not find schedule-dependent behavioral changes, suggesting that reward modulates neural activity in MIP. Neural discrimination between rewards was less in the variable than in the constant schedule, degrading our ability to decode reach target and reward simultaneously. The effect of schedule was mitigated by adding Haar wavelet coefficients to the decoding model. This raises the possibility of multiple encoding schemes at different timescales and reinforces the potential utility of reward information for prosthetic performance. PMID:25008408

  12. Modulation of neural activity by reward in medial intraparietal cortex is sensitive to temporal sequence of reward.

    PubMed

    Rajalingham, Rishi; Stacey, Richard Greg; Tsoulfas, Georgios; Musallam, Sam

    2014-10-01

    To restore movements to paralyzed patients, neural prosthetic systems must accurately decode patients' intentions from neural signals. Despite significant advancements, current systems are unable to restore complex movements. Decoding reward-related signals from the medial intraparietal area (MIP) could enhance prosthetic performance. However, the dynamics of reward sensitivity in MIP is not known. Furthermore, reward-related modulation in premotor areas has been attributed to behavioral confounds. Here we investigated the stability of reward encoding in MIP by assessing the effect of reward history on reward sensitivity. We recorded from neurons in MIP while monkeys performed a delayed-reach task under two reward schedules. In the variable schedule, an equal number of small- and large-rewards trials were randomly interleaved. In the constant schedule, one reward size was delivered for a block of trials. The memory period firing rate of most neurons in response to identical rewards varied according to schedule. Using systems identification tools, we attributed the schedule sensitivity to the dependence of neural activity on the history of reward. We did not find schedule-dependent behavioral changes, suggesting that reward modulates neural activity in MIP. Neural discrimination between rewards was less in the variable than in the constant schedule, degrading our ability to decode reach target and reward simultaneously. The effect of schedule was mitigated by adding Haar wavelet coefficients to the decoding model. This raises the possibility of multiple encoding schemes at different timescales and reinforces the potential utility of reward information for prosthetic performance. Copyright © 2014 the American Physiological Society.

  13. Hormonal gain control of a medial preoptic area social reward circuit

    PubMed Central

    McHenry, Jenna A.; Otis, James M.; Rossi, Mark A.; Robinson, J. Elliott; Kosyk, Oksana; Miller, Noah W.; McElligott, Zoe A.; Budygin, Evgeny A.; Rubinow, David R.; Stuber, Garret D.

    2017-01-01

    Neural networks that control reproduction must integrate social and hormonal signals, tune motivation, and invigorate social interactions. However, the neurocircuit mechanisms for these processes remain unresolved. The medial preoptic area (mPOA), an essential node for social behaviors and is comprised of molecularly-diverse neurons with widespread projections. Here, we identify a steroid-responsive subset of neurotensin (Nts) expressing mPOA neurons that interface with the ventral tegmental area (VTA) to form a socially-engaged reward circuit. Using in vivo 2-photon imaging in female mice, we show that mPOANts neurons preferentially encode attractive male cues compared to non-social appetitive stimuli. Ovarian hormone signals regulate both the physiological and cue encoding properties of these cells. Furthermore, optogenetic stimulation of mPOANts-VTA circuitry promotes rewarding phenotypes, social approach, and striatal dopamine release. Collectively, these data demonstrate that steroid-sensitive mPOA neurons encode ethologically-relevant stimuli and co-opt midbrain reward circuits to promote prosocial behavior critical for species survival. PMID:28135243

  14. Components of reward-driven attentional capture.

    PubMed

    Sha, Li Z; Jiang, Yuhong V

    2016-02-01

    Recent research reported that task-irrelevant colors captured attention if these colors previously served as search targets and received high monetary reward. We showed that both monetary reward and value-independent mechanisms influenced selective attention. Participants searched for two potential target colors among distractor colors in the training phase. Subsequently, they searched for a shape singleton in a testing phase. Experiment 1 found that participants were slower in the testing phase if a distractor of a previous target color was present rather than absent. Such slowing was observed even when no monetary reward was used during training. Experiment 2 associated monetary rewards with the target colors during the training phase. Participants were faster finding the target associated with higher monetary reward. However, reward training did not yield value-dependent attentional capture in the testing phase. Attentional capture by the previous target colors was not significantly greater for the previously high-reward color than the previously low or no-reward color. These findings revealed both the power and limitations of monetary reward on attention. Although monetary reward can increase attentional priority for the high-reward target during training, subsequent attentional capture effects may not be reward-based, but reflect, in part, attentional capture by previous targets.

  15. Consensus Paper: Towards a Systems-Level View of Cerebellar Function: the Interplay Between Cerebellum, Basal Ganglia, and Cortex.

    PubMed

    Caligiore, Daniele; Pezzulo, Giovanni; Baldassarre, Gianluca; Bostan, Andreea C; Strick, Peter L; Doya, Kenji; Helmich, Rick C; Dirkx, Michiel; Houk, James; Jörntell, Henrik; Lago-Rodriguez, Angel; Galea, Joseph M; Miall, R Chris; Popa, Traian; Kishore, Asha; Verschure, Paul F M J; Zucca, Riccardo; Herreros, Ivan

    2017-02-01

    Despite increasing evidence suggesting the cerebellum works in concert with the cortex and basal ganglia, the nature of the reciprocal interactions between these three brain regions remains unclear. This consensus paper gathers diverse recent views on a variety of important roles played by the cerebellum within the cerebello-basal ganglia-thalamo-cortical system across a range of motor and cognitive functions. The paper includes theoretical and empirical contributions, which cover the following topics: recent evidence supporting the dynamical interplay between cerebellum, basal ganglia, and cortical areas in humans and other animals; theoretical neuroscience perspectives and empirical evidence on the reciprocal influences between cerebellum, basal ganglia, and cortex in learning and control processes; and data suggesting possible roles of the cerebellum in basal ganglia movement disorders. Although starting from different backgrounds and dealing with different topics, all the contributors agree that viewing the cerebellum, basal ganglia, and cortex as an integrated system enables us to understand the function of these areas in radically different ways. In addition, there is unanimous consensus between the authors that future experimental and computational work is needed to understand the function of cerebellar-basal ganglia circuitry in both motor and non-motor functions. The paper reports the most advanced perspectives on the role of the cerebellum within the cerebello-basal ganglia-thalamo-cortical system and illustrates other elements of consensus as well as disagreements and open questions in the field.

  16. Acute D3 Antagonist GSK598809 Selectively Enhances Neural Response During Monetary Reward Anticipation in Drug and Alcohol Dependence

    PubMed Central

    Murphy, Anna; Nestor, Liam J; McGonigle, John; Paterson, Louise; Boyapati, Venkataramana; Ersche, Karen D; Flechais, Remy; Kuchibatla, Shankar; Metastasio, Antonio; Orban, Csaba; Passetti, Filippo; Reed, Laurence; Smith, Dana; Suckling, John; Taylor, Eleanor; Robbins, Trevor W; Lingford-Hughes, Anne; Nutt, David J; Deakin, John FW; Elliott, Rebecca

    2017-01-01

    Evidence suggests that disturbances in neurobiological mechanisms of reward and inhibitory control maintain addiction and provoke relapse during abstinence. Abnormalities within the dopamine system may contribute to these disturbances and pharmacologically targeting the D3 dopamine receptor (DRD3) is therefore of significant clinical interest. We used functional magnetic resonance imaging to investigate the acute effects of the DRD3 antagonist GSK598809 on anticipatory reward processing, using the monetary incentive delay task (MIDT), and response inhibition using the Go/No-Go task (GNGT). A double-blind, placebo-controlled, crossover design approach was used in abstinent alcohol dependent, abstinent poly-drug dependent and healthy control volunteers. For the MIDT, there was evidence of blunted ventral striatal response to reward in the poly-drug-dependent group under placebo. GSK598809 normalized ventral striatal reward response and enhanced response in the DRD3-rich regions of the ventral pallidum and substantia nigra. Exploratory investigations suggested that the effects of GSK598809 were mainly driven by those with primary dependence on alcohol but not on opiates. Taken together, these findings suggest that GSK598809 may remediate reward deficits in substance dependence. For the GNGT, enhanced response in the inferior frontal cortex of the poly-drug group was found. However, there were no effects of GSK598809 on the neural network underlying response inhibition nor were there any behavioral drug effects on response inhibition. GSK598809 modulated the neural network underlying reward anticipation but not response inhibition, suggesting that DRD3 antagonists may restore reward deficits in addiction. PMID:28042871

  17. Proactive Selective Response Suppression Is Implemented via the Basal Ganglia

    PubMed Central

    Majid, D. S. Adnan; Cai, Weidong; Corey-Bloom, Jody

    2013-01-01

    In the welter of everyday life, people can stop particular response tendencies without affecting others. A key requirement for such selective suppression is that subjects know in advance which responses need stopping. We hypothesized that proactively setting up and implementing selective suppression relies on the basal ganglia and, specifically, regions consistent with the inhibitory indirect pathway for which there is scant functional evidence in humans. Consistent with this hypothesis, we show, first, that the degree of proactive motor suppression when preparing to stop selectively (indexed by transcranial magnetic stimulation) corresponds to striatal, pallidal, and frontal activation (indexed by functional MRI). Second, we demonstrate that greater striatal activation at the time of selective stopping correlates with greater behavioral selectivity. Third, we show that people with striatal and pallidal volume reductions (those with premanifest Huntington's disease) have both absent proactive motor suppression and impaired behavioral selectivity when stopping. Thus, stopping goals are used to proactively set up specific basal ganglia channels that may then be triggered to implement selective suppression. By linking this suppression to the striatum and pallidum, these results provide compelling functional evidence in humans of the basal ganglia's inhibitory indirect pathway. PMID:23946385

  18. A nap to recap or how reward regulates hippocampal-prefrontal memory networks during daytime sleep in humans

    PubMed Central

    Igloi, Kinga; Gaggioni, Giulia; Sterpenich, Virginie; Schwartz, Sophie

    2015-01-01

    Sleep plays a crucial role in the consolidation of newly acquired memories. Yet, how our brain selects the noteworthy information that will be consolidated during sleep remains largely unknown. Here we show that post-learning sleep favors the selectivity of long-term consolidation: when tested three months after initial encoding, the most important (i.e., rewarded, strongly encoded) memories are better retained, and also remembered with higher subjective confidence. Our brain imaging data reveals that the functional interplay between dopaminergic reward regions, the prefrontal cortex and the hippocampus contributes to the integration of rewarded associative memories. We further show that sleep spindles strengthen memory representations based on reward values, suggesting a privileged replay of information yielding positive outcomes. These findings demonstrate that post-learning sleep determines the neural fate of motivationally-relevant memories and promotes a value-based stratification of long-term memory stores. DOI: http://dx.doi.org/10.7554/eLife.07903.001 PMID:26473618

  19. Parkinson's disease and dopaminergic therapy—differential effects on movement, reward and cognition

    PubMed Central

    Hughes, L.; Ghosh, B. C. P.; Eckstein, D.; Williams-Gray, C. H.; Fallon, S.; Barker, R. A.; Owen, A. M.

    2008-01-01

    Cognitive deficits are very common in Parkinson's disease particularly for ‘executive functions’ associated with frontal cortico-striatal networks. Previous work has identified deficits in tasks that require attentional control like task-switching, and reward-based tasks like gambling or reversal learning. However, there is a complex relationship between the specific cognitive problems faced by an individual patient, their stage of disease and dopaminergic treatment. We used a bimodality continuous performance task during fMRI to examine how patients with Parkinson's disease represent the prospect of reward and switch between competing task rules accordingly. The task-switch was not separately cued but was based on the implicit reward relevance of spatial and verbal dimensions of successive compound stimuli. Nineteen patients were studied in relative ‘on’ and ‘off’ states, induced by dopaminergic medication withdrawal (Hoehn and Yahr stages 1–4). Patients were able to successfully complete the task and establish a bias to one or other dimension in order to gain reward. However the lateral prefrontal cortex and caudate nucleus showed a non-linear U-shape relationship between motor disease severity and regional brain activation. Dopaminergic treatment led to a shift in this U-shape function, supporting the hypothesis of differential neurodegeneration in separate motor and cognitive cortico–striato–thalamo–cortical circuits. In addition, anterior cingulate activation associated with reward expectation declined with more severe disease, whereas activation following actual rewards increased with more severe disease. This may facilitate a change in goal-directed behaviours from deferred predicted rewards to immediate actual rewards, particularly when on dopaminergic treatment. We discuss the implications for investigation and optimal treatment of this common condition at different stages of disease. PMID:18577547

  20. Latent herpes simplex virus 1 infection does not induce apoptosis in human trigeminal Ganglia.

    PubMed

    Himmelein, Susanne; Lindemann, Anja; Sinicina, Inga; Strupp, Michael; Brandt, Thomas; Hüfner, Katharina

    2015-05-01

    Herpes simplex virus 1 (HSV-1) can establish lifelong latency in human trigeminal ganglia. Latently infected ganglia contain CD8(+) T cells, which secrete granzyme B and are thus capable of inducing neuronal apoptosis. Using immunohistochemistry and single-cell reverse transcription-quantitative PCR (RT-qPCR), higher frequency and transcript levels of caspase-3 were found in HSV-1-negative compared to HSV-1-positive ganglia and neurons, respectively. No terminal deoxynucleotidyltransferase-mediated dUTP-biotin nick end labeling (TUNEL) assay-positive neurons were detected. The infiltrating T cells do not induce apoptosis in latently infected neurons. Copyright © 2015, American Society for Microbiology. All Rights Reserved.

  1. Reward from bugs to bipeds: a comparative approach to understanding how reward circuits function

    PubMed Central

    Scaplen, Kristin M.; Kaun, Karla R.

    2016-01-01

    Abstract In a complex environment, animals learn from their responses to stimuli and events. Appropriate response to reward and punishment can promote survival, reproduction and increase evolutionary fitness. Interestingly, the neural processes underlying these responses are remarkably similar across phyla. In all species, dopamine is central to encoding reward and directing motivated behaviors, however, a comprehensive understanding of how circuits encode reward and direct motivated behaviors is still lacking. In part, this is a result of the sheer diversity of neurons, the heterogeneity of their responses and the complexity of neural circuits within which they are found. We argue that general features of reward circuitry are common across model organisms, and thus principles learned from invertebrate model organisms can inform research across species. In particular, we discuss circuit motifs that appear to be functionally equivalent from flies to primates. We argue that a comparative approach to studying and understanding reward circuit function provides a more comprehensive understanding of reward circuitry, and informs disorders that affect the brain’s reward circuitry. PMID:27328845

  2. Dorsomedial striatum lesions affect adjustment to reward uncertainty, but not to reward devaluation or omission.

    PubMed

    Torres, Carmen; Glueck, Amanda C; Conrad, Shannon E; Morón, Ignacio; Papini, Mauricio R

    2016-09-22

    The dorsomedial striatum (DMS) has been implicated in the acquisition of reward representations, a proposal leading to the hypothesis that it should play a role in situations involving reward loss. We report the results of an experiment in which the effects of DMS excitotoxic lesions were tested in consummatory successive negative contrast (reward devaluation), autoshaping training with partial vs. continuous reinforcement (reward uncertainty), and appetitive extinction (reward omission). Animals with DMS lesions exhibited reduced lever pressing responding, but enhanced goal entries, during partial reinforcement training in autoshaping. However, they showed normal negative contrast, acquisition under continuous reinforcement (CR), appetitive extinction, and response facilitation in early extinction trials. Open-field testing also indicated normal motor behavior. Thus, DMS lesions selectively affected the behavioral adjustment to a situation involving reward uncertainty, producing a behavioral reorganization according to which goal tracking (goal entries) became predominant at the expense of sign tracking (lever pressing). This pattern of results shows that the function of the DMS in situations involving reward loss is not general, but restricted to reward uncertainty. We suggest that a nonassociative, drive-related process induced by reward uncertainty requires normal output from DMS neurons. Copyright © 2016 IBRO. Published by Elsevier Ltd. All rights reserved.

  3. Reward and punishment

    PubMed Central

    Sigmund, Karl; Hauert, Christoph; Nowak, Martin A.

    2001-01-01

    Minigames capturing the essence of Public Goods experiments show that even in the absence of rationality assumptions, both punishment and reward will fail to bring about prosocial behavior. This result holds in particular for the well-known Ultimatum Game, which emerges as a special case. But reputation can induce fairness and cooperation in populations adapting through learning or imitation. Indeed, the inclusion of reputation effects in the corresponding dynamical models leads to the evolution of economically productive behavior, with agents contributing to the public good and either punishing those who do not or rewarding those who do. Reward and punishment correspond to two types of bifurcation with intriguing complementarity. The analysis suggests that reputation is essential for fostering social behavior among selfish agents, and that it is considerably more effective with punishment than with reward. PMID:11553811

  4. Extinction Can Reduce the Impact of Reward Cues on Reward-Seeking Behavior.

    PubMed

    Lovibond, Peter F; Satkunarajah, Michelle; Colagiuri, Ben

    2015-07-01

    Reward-associated cues are thought to promote relapse after treatment of appetitive disorders such as drug-taking, binge eating, and gambling. This process has been modelled in the laboratory using a Pavlovian-instrumental transfer (PIT) design in which Pavlovian cues facilitate instrumental reward-directed action. Attempts to reduce facilitation by cue exposure (extinction) have produced mixed results. We tested the effect of extinction in a recently developed PIT procedure using a natural reward, chocolate, in human participants. Facilitation of instrumental responding was only observed in participants who were aware of the Pavlovian contingencies. Pavlovian extinction successfully reduced, but did not completely eliminate, expectancy of reward and facilitation of instrumental responding. The results indicate that exposure can reduce the ability of cues to promote reward-directed behavior in the laboratory. However, the residual potency of extinguished cues means that additional active strategies may be needed in clinical practice to train patients to resist the impact of these cues in their environment. Copyright © 2015. Published by Elsevier Ltd.

  5. Participation of satellite glial cells of the dorsal root ganglia in acute nociception.

    PubMed

    Lemes, Júlia Borges Paes; de Campos Lima, Tais; Santos, Débora Oliveira; Neves, Amanda Ferreira; de Oliveira, Fernando Silva; Parada, Carlos Almicar; da Cruz Lotufo, Celina Monteiro

    2018-05-29

    At dorsal root ganglia, neurons and satellite glial cells (SGC) can communicate through ATP release and P2X7 receptor activation. SGCs are also interconnected by gap junctions and have been previously implicated in modulating inflammatory and chronic pain.We now present evidence that SGCs are also involved in processing acute nociception in rat dorsal root ganglia. Using primary dorsal root ganglia cultures we observed that calcium transients induced in neurons by capsaicin administration were followed by satellite glial cells activation. Only satellite glial cells response was reduced by administration of the P2X7 receptor antagonist A740003. In vivo, acute nociception induced by intraplantar injection of capsaicin in rats was inhibited by A740003 or by the gap junction blocker carbenoxolone administered at the dorsal root ganglia (L5 level). Both drugs also reduced the second phase of the formalin test. These results suggest that communication between neurons and satellite glial cells is not only involved in inflammatory or pathological pain, but also in the transmission of the nociceptive signal, possibly in situations involving C-fiber activation. Copyright © 2018 Elsevier B.V. All rights reserved.

  6. Parkinson's Disease and Dopaminergic Therapy--Differential Effects on Movement, Reward and Cognition

    ERIC Educational Resources Information Center

    Rowe, J. B.; Hughes, L.; Ghosh, B. C. P.; Eckstein, D.; Williams-Gray, C. H.; Fallon, S.; Barker, R. A.; Owen, A. M.

    2008-01-01

    Cognitive deficits are very common in Parkinson's disease particularly for "executive functions" associated with frontal cortico-striatal networks. Previous work has identified deficits in tasks that require attentional control like task-switching, and reward-based tasks like gambling or reversal learning. However, there is a complex…

  7. Alterations of Brain Functional Architecture Associated with Psychopathic Traits in Male Adolescents with Conduct Disorder.

    PubMed

    Pu, Weidan; Luo, Qiang; Jiang, Yali; Gao, Yidian; Ming, Qingsen; Yao, Shuqiao

    2017-09-12

    Psychopathic traits of conduct disorder (CD) have a core callous-unemotional (CU) component and an impulsive-antisocial component. Previous task-driven fMRI studies have suggested that psychopathic traits are associated with dysfunction of several brain areas involved in different cognitive functions (e.g., empathy, reward, and response inhibition etc.), but the relationship between psychopathic traits and intrinsic brain functional architecture has not yet been explored in CD. Using a holistic brain-wide functional connectivity analysis, this study delineated the alterations in brain functional networks in patients with conduct disorder. Compared with matched healthy controls, we found decreased anti-synchronization between the fronto-parietal network (FPN) and default mode network (DMN), and increased intra-network synchronization within the frontothalamic-basal ganglia, right frontoparietal, and temporal/limbic/visual networks in CD patients. Correlation analysis showed that the weakened FPN-DMN interaction was associated with CU traits, while the heightened intra-network functional connectivity was related to impulsivity traits in CD patients. Our findings suggest that decoupling of cognitive control (FPN) with social understanding of others (DMN) is associated with the CU traits, and hyper-functions of the reward and motor inhibition systems elevate impulsiveness in CD.

  8. Transmitter-induced glycogenolysis and gluconeogenesis in leech segmental ganglia.

    PubMed

    Pennington, A J; Pentreath, V W

    1987-01-01

    1. The utilization and control of glycogen stores were studied in the isolated segmental ganglia of the horse leech, Haemopis sanguisuga. The glycogen in the ganglia was extracted and assayed fluorimetrically and its cellular localization and turnover studied by autoradiography in conjunction with [3H] glucose. 2. The glycogen levels were measured after incubation with different neurotransmitters for 60 min at 28 degrees C. The results for each experimental ganglion were compared to a paired control ganglion, and the results analysed by paired t-tests. 3. Several transmitter substances (5-HT, octopamine, dopamine, noradrenaline, histamine) produced reductions in glycogen (glycogenolysis); other transmitters (glutamate, GABA) produced increases in glycogen (gluconeogenesis); others (adenosine, glycine) produced reductions or increases, depending on concentration. Acetylcholine had no effect on the glycogen levels. 4. Most of the glycogen in the ganglia is localized in the packet glial cells, which surround the neuron perikarya. Autoradiographic analysis demonstrated that the effects of histamine and dopamine were principally on the glycogen in the glial cells. 5. Adenylate cyclase was demonstrated by electron microscope histochemistry to be localized on the plasma membranes of the glial cells, and to a lesser extent on the neuronal membranes. 6. It is concluded that the changes in glycogen in the glial cells may be party controlled by transmitters via adenylate cyclase. This may provide a sensitive mechanism for coupling neuronal activity with energy metabolism.

  9. The Pedunculopontine Tegmental Nucleus as a Motor and Cognitive Interface between the Cerebellum and Basal Ganglia.

    PubMed

    Mori, Fumika; Okada, Ken-Ichi; Nomura, Taishin; Kobayashi, Yasushi

    2016-01-01

    As an important component of ascending activating systems, brainstem cholinergic neurons in the pedunculopontine tegmental nucleus (PPTg) are involved in the regulation of motor control (locomotion, posture and gaze) and cognitive processes (attention, learning and memory). The PPTg is highly interconnected with several regions of the basal ganglia, and one of its key functions is to regulate and relay activity from the basal ganglia. Together, they have been implicated in the motor control system (such as voluntary movement initiation or inhibition), and modulate aspects of executive function (such as motivation). In addition to its intimate connection with the basal ganglia, projections from the PPTg to the cerebellum have been recently reported to synaptically activate the deep cerebellar nuclei. Classically, the cerebellum and basal ganglia were regarded as forming separated anatomical loops that play a distinct functional role in motor and cognitive behavioral control. Here, we suggest that the PPTg may also act as an interface device between the basal ganglia and cerebellum. As such, part of the therapeutic effect of PPTg deep brain stimulation (DBS) to relieve gait freezing and postural instability in advanced Parkinson's disease (PD) patients might also involve modulation of the cerebellum. We review the anatomical position and role of the PPTg in the pathway of basal ganglia and cerebellum in relation to motor control, cognitive function and PD.

  10. Mu-Opioid Receptors in Ganglia, But Not in Muscle, Mediate Peripheral Analgesia in Rat Muscle Pain.

    PubMed

    Bagues, Ana; Martín, María Isabel; Higuera-Matas, Alejandro; Esteban-Hernández, Jesús; Ambrosio, Emilio; Sánchez-Robles, Eva María

    2018-04-01

    Previous studies have demonstrated the participation of peripheral μ-opioid receptors (MOR) in the antinociceptive effect of systemically administered morphine and loperamide in an orofacial muscle pain model, induced by hypertonic saline, but not in a spinally innervated one, in rats. In this study, we determine whether this peripheral antinociceptive effect is due to the activation of MOR localized in the muscle, ganglia, or both. To determine the local antinociceptive effect of morphine and loperamide, 2 models of acute muscle pain (trigeminal and spinal) were used. Also, to study the MOR expression, protein quantification was performed in the trigeminal and spinal ganglia, and in the muscles. The behavioral results show that the intramuscular injection of morphine and loperamide did not exert an antinociceptive effect in either muscle (morphine: P = .63, loperamide: P = .9). On the other hand, MOR expression was found in the ganglia but not in the muscles. This expression was on average 44% higher (95% confidence interval, 33.3-53.9) in the trigeminal ganglia than in the spinal one. The peripheral antinociceptive effect of systemically administered opioids may be due to the activation of MOR in ganglia. The greater expression of MOR in trigeminal ganglia could explain the higher antinociceptive effect of opioids in orofacial muscle pain than in spinal muscle pain. Therefore, peripheral opioids could represent a promising approach for the treatment of orofacial pain.

  11. Altered basal ganglia-cortical functional connections in frontal lobe epilepsy: A resting-state fMRI study.

    PubMed

    Dong, Li; Wang, Pu; Peng, Rui; Jiang, Sisi; Klugah-Brown, Benjamin; Luo, Cheng; Yao, Dezhong

    2016-12-01

    The purpose of this study was to investigate alterations of basal ganglia-cortical functional connections in patients with frontal lobe epilepsy (FLE). Resting-state functional magnetic resonance imaging (fMRI) data were gathered from 19 FLE patients and 19 age- and gender-matched healthy controls. Functional connectivity (FC) analysis was used to assess the functional connections between basal ganglia and cerebral cortex. Regions of interest, including the left/right caudate, putamen, pallidum and thalamus, were selected as the seeds. Two sample t-test was used to determine the difference between patients and controls, while controlling the age, gender and head motions. Compared with controls, FLE patients demonstrated increased FCs between basal ganglia and regions including the right fusiform gyrus, the bilateral cingulate gyrus, the precuneus and anterior cingulate gyrus. Reduced FCs were mainly located in a range of brain regions including the bilateral middle occipital gyrus, the ventral frontal lobe, the right putamen, the left fusiform gyrus and right rolandic operculum. In addition, the relationships between basal ganglia-cingulate connections and durations of epilepsy were also found. The alterations of functional integrity within the basal ganglia, as well as its connections to limbic and ventral frontal areas, indicate the important roles of the basal ganglia-cortical functional connections in FLE, and provide new insights in the pathophysiological mechanism of FLE. Copyright © 2016 Elsevier B.V. All rights reserved.

  12. The role of high-frequency oscillatory activity in reward processing and learning.

    PubMed

    Marco-Pallarés, Josep; Münte, Thomas F; Rodríguez-Fornells, Antoni

    2015-02-01

    Oscillatory activity has been proposed as a key mechanism in the integration of brain activity of distant structures. Particularly, high frequency brain oscillatory activity in the beta and gamma range has received increasing interest in the domains of attention and memory. In addition, a number of recent studies have revealed an increase of beta-gamma activity (20-35 Hz) after unexpected or relevant positive reward outcomes. In the present manuscript we review the literature on this phenomenon and we propose that this activity is a brain signature elicited by unexpected positive outcomes in order to transmit a fast motivational value signal to the reward network. In addition, we hypothesize that beta-gamma oscillatory activity indexes the interaction between attentional and emotional systems, and that it directly reflects the appearance of unexpected positive rewards in learning-related contexts. Copyright © 2014 Elsevier Ltd. All rights reserved.

  13. Role of Basal Ganglia in Sleep–Wake Regulation: Neural Circuitry and Clinical Significance

    PubMed Central

    Vetrivelan, Ramalingam; Qiu, Mei-Hong; Chang, Celene; Lu, Jun

    2010-01-01

    Researchers over the last decade have made substantial progress toward understanding the roles of dopamine and the basal ganglia (BG) in the control of sleep–wake behavior. In this review, we outline recent advancements regarding dopaminergic modulation of sleep through the BG and extra-BG sites. Our main hypothesis is that dopamine promotes sleep by its action on the D2 receptors in the BG and promotes wakefulness by its action on D1 and D2 receptors in the extra-BG sites. This hypothesis implicates dopamine depletion in the BG (such as in Parkinson's disease) in causing frequent nighttime arousal and overall insomnia. Furthermore, the arousal effects of psychostimulants (methamphetamine, cocaine, and modafinil) may be linked to the ventral periaquductal gray (vPAG) dopaminergic circuitry targeting the extra-BG sleep–wake network. PMID:21151379

  14. Reward, salience, and attentional networks are activated by religious experience in devout Mormons

    PubMed Central

    Ferguson, Michael A.; Nielsen, Jared A.; King, Jace B.; Dai, Li; Giangrasso, Danielle M.; Holman, Rachel; Korenberg, Julie R.; Anderson, Jeffrey S.

    2017-01-01

    High-level cognitive and emotional experience arises from brain activity, but the specific brain substrates for religious and spiritual euphoria remain unclear. We demonstrate using functional magnetic resonance imaging scans in 19 devout Mormons that a recognizable feeling central to their devotional practice was reproducibly associated with activation in nucleus accumbens, ventromedial prefrontal cortex, and frontal attentional regions. Nucleus accumbens activation preceded peak spiritual feelings by 1–3 s and was replicated in four separate tasks. Attentional activation in the anterior cingulate and frontal eye fields was greater in the right hemisphere. The association of abstract ideas and brain reward circuitry may interact with frontal attentional and emotive salience processing, suggesting a mechanism whereby doctrinal concepts may come to be intrinsically rewarding and motivate behavior in religious individuals. PMID:27834117

  15. Dissociating hippocampal and basal ganglia contributions to category learning using stimulus novelty and subjective judgments

    PubMed Central

    Seger, Carol A.; Dennison, Christina S.; Lopez-Paniagua, Dan; Peterson, Erik J.; Roark, Aubrey A.

    2011-01-01

    We identified factors leading to hippocampal and basal ganglia recruitment during categorization learning. Subjects alternated between blocks of a standard trial and error category learning task and a subjective judgment task. In the subjective judgments task subjects categorized the stimulus and then instead of receiving feedback they indicated the basis of their response using 4 options: Remember: Conscious episodic memory of previous trials. Know-Automatic: Automatic, rapid response accompanied by conscious awareness of category membership. Know-Intuition: A “gut feeling” without fully conscious knowledge of category membership. Guess: Guessing. In addition, new stimuli were introduced throughout the experiment to examine effects of novelty. Categorization overall recruited both the basal ganglia and posterior hippocampus. However, basal ganglia activity was found during Know judgments (both Automatic and Intuition), whereas posterior hippocampus activity was found during Remember judgments. Granger causality mapping indicated interactions between the basal ganglia and hippocampus, with the putamen exerting directed influence on the posterior hippocampus, which in turn exerted directed influence on the posterior caudate nucleus. We also found a region of anterior hippocampus that showed decreased activity relative to baseline during categorization overall, and showed a strong novelty effect. Our results indicate that subjective measures may be effective in dissociating basal ganglia from hippocampal dependent learning, and that the basal ganglia are involved in both conscious and unconscious learning. They also indicate a dissociation within the hippocampus, in which the anterior regions are sensitive to novelty, and the posterior regions are involved in memory based categorization learning. PMID:21255655

  16. Monetary reward speeds up voluntary saccades.

    PubMed

    Chen, Lewis L; Chen, Y Mark; Zhou, Wu; Mustain, William D

    2014-01-01

    Past studies have shown that reward contingency is critical for sensorimotor learning, and reward expectation speeds up saccades in animals. Whether monetary reward speeds up saccades in human remains unknown. Here we addressed this issue by employing a conditional saccade task, in which human subjects performed a series of non-reflexive, visually-guided horizontal saccades. The subjects were (or were not) financially compensated for making a saccade in response to a centrally-displayed visual congruent (or incongruent) stimulus. Reward modulation of saccadic velocities was quantified independently of the amplitude-velocity coupling. We found that reward expectation significantly sped up voluntary saccades up to 30°/s, and the reward modulation was consistent across tests. These findings suggest that monetary reward speeds up saccades in human in a fashion analogous to how juice reward sped up saccades in monkeys. We further noticed that the idiosyncratic nasal-temporal velocity asymmetry was highly consistent regardless of test order, and its magnitude was not correlated with the magnitude of reward modulation. This suggests that reward modulation and the intrinsic velocity asymmetry may be governed by separate mechanisms that regulate saccade generation.

  17. Mental Imagery Training Increases Wanting of Rewards and Reward Sensitivity and Reduces Depressive Symptoms.

    PubMed

    Linke, Julia; Wessa, Michèle

    2017-09-01

    High reward sensitivity and wanting of rewarding stimuli help to identify and motivate repetition of pleasant activities. This behavioral activation is thought to increase positive emotions. Therefore, both mechanisms are highly relevant for resilience against depressive symptoms. Yet, these mechanisms have not been targeted by psychotherapeutic interventions. In the present study, we tested a mental imagery training comprising eight 10-minute sessions every second day and delivered via the Internet to healthy volunteers (N = 30, 21 female, mean age of 23.8 years, Caucasian) who were preselected for low reward sensitivity. Participants were paired according to age, sex, reward sensitivity, and mental imagery ability. Then, members of each pair were randomly assigned to either the intervention or wait condition. Ratings of wanting and response bias toward probabilistic reward cues (Probabilistic Reward Task) served as primary outcomes. We further tested whether training effects extended to approach behavior (Approach Avoidance Task) and depressive symptoms (Beck Depression Inventory). The intervention led to an increase in wanting (p < .001, η 2 p = .45) and reward sensitivity (p = .004, η 2 p = .27). Further, the training group displayed faster approach toward positive edibles and activities (p = .025, η 2 p = .18) and reductions in depressive symptoms (p = .028, η 2 p = .16). Results extend existing literature by showing that mental imagery training can increase wanting of rewarding stimuli and reward sensitivity. Further, the training appears to reduce depressive symptoms and thus may foster the successful implementation of exsiting treatments for depression such as behavioral activation and could also increase resilience against depressive symptoms. Copyright © 2017. Published by Elsevier Ltd.

  18. Acute Simian Varicella Virus Infection Causes Robust and Sustained Changes in Gene Expression in the Sensory Ganglia

    PubMed Central

    Arnold, Nicole; Girke, Thomas; Sureshchandra, Suhas

    2016-01-01

    ABSTRACT Primary infection with varicella-zoster virus (VZV), a neurotropic alphaherpesvirus, results in varicella. VZV establishes latency in the sensory ganglia and can reactivate later in life to cause herpes zoster. The relationship between VZV and its host during acute infection in the sensory ganglia is not well understood due to limited access to clinical specimens. Intrabronchial inoculation of rhesus macaques with simian varicella virus (SVV) recapitulates the hallmarks of VZV infection in humans. We leveraged this animal model to characterize the host-pathogen interactions in the ganglia during both acute and latent infection by measuring both viral and host transcriptomes on days postinfection (dpi) 3, 7, 10, 14, and 100. SVV DNA and transcripts were detected in sensory ganglia 3 dpi, before the appearance of rash. CD4 and CD8 T cells were also detected in the sensory ganglia 3 dpi. Moreover, lung-resident T cells isolated from the same animals 3 dpi also harbored SVV DNA and transcripts, suggesting that T cells may be responsible for trafficking SVV to the ganglia. Transcriptome sequencing (RNA-Seq) analysis showed that cessation of viral transcription 7 dpi coincides with a robust antiviral innate immune response in the ganglia. Interestingly, a significant number of genes that play a critical role in nervous system development and function remained downregulated into latency. These studies provide novel insights into host-pathogen interactions in the sensory ganglia during acute varicella and demonstrate that SVV infection results in profound and sustained changes in neuronal gene expression. IMPORTANCE Many aspects of VZV infection of sensory ganglia remain poorly understood, due to limited access to human specimens and the fact that VZV is strictly a human virus. Infection of rhesus macaques with simian varicella virus (SVV), a homolog of VZV, provides a robust model of the human disease. Using this model, we show that SVV reaches the ganglia early

  19. "Liking" and "wanting" linked to Reward Deficiency Syndrome (RDS): hypothesizing differential responsivity in brain reward circuitry.

    PubMed

    Blum, Kenneth; Gardner, Eliot; Oscar-Berman, Marlene; Gold, Mark

    2012-01-01

    In an attempt to resolve controversy regarding the causal contributions of mesolimbic dopamine (DA) systems to reward, we evaluate the three main competing explanatory categories: "liking,"learning," and "wanting" [1]. That is, DA may mediate (a) the hedonic impact of reward (liking), (b) learned predictions about rewarding effects (learning), or (c) the pursuit of rewards by attributing incentive salience to reward-related stimuli (wanting). We evaluate these hypotheses, especially as they relate to the Reward Deficiency Syndrome (RDS), and we find that the incentive salience or "wanting" hypothesis of DA function is supported by a majority of the evidence. Neuroimaging studies have shown that drugs of abuse, palatable foods, and anticipated behaviors such as sex and gaming affect brain regions involving reward circuitry, and may not be unidirectional. Drugs of abuse enhance DA signaling and sensitize mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Addictive drugs have in common that they are voluntarily selfadministered, they enhance (directly or indirectly) dopaminergic synaptic function in the nucleus accumbens (NAC), and they stimulate the functioning of brain reward circuitry (producing the "high" that drug users seek). Although originally believed simply to encode the set point of hedonic tone, these circuits now are believed to be functionally more complex, also encoding attention, reward expectancy, disconfirmation of reward expectancy, and incentive motivation. Elevated stress levels, together with polymorphisms of dopaminergic genes and other neurotransmitter genetic variants, may have a cumulative effect on vulnerability to addiction. The RDS model of etiology holds very well for a variety of chemical and behavioral addictions.

  20. Optimizing congestion and emissions via tradable credit charge and reward scheme without initial credit allocations

    NASA Astrophysics Data System (ADS)

    Zhu, Wenlong; Ma, Shoufeng; Tian, Junfang

    2017-01-01

    This paper investigates the revenue-neutral tradable credit charge and reward scheme without initial credit allocations that can reassign network traffic flow patterns to optimize congestion and emissions. First, we prove the existence of the proposed schemes and further decentralize the minimum emission flow pattern to user equilibrium. Moreover, we design the solving method of the proposed credit scheme for minimum emission problem. Second, we investigate the revenue-neutral tradable credit charge and reward scheme without initial credit allocations for bi-objectives to obtain the Pareto system optimum flow patterns of congestion and emissions; and present the corresponding solutions are located in the polyhedron constituted by some inequalities and equalities system. Last, numerical example based on a simple traffic network is adopted to obtain the proposed credit schemes and verify they are revenue-neutral.

  1. Caloric primary rewards systematically alter time perception.

    PubMed

    Fung, Bowen J; Murawski, Carsten; Bode, Stefan

    2017-11-01

    Human time perception can be influenced by contextual factors, such as the presence of reward. Yet, the exact nature of the relationship between time perception and reward has not been conclusively characterized. We implemented a novel experimental paradigm to measure estimations of time across a range of suprasecond intervals, during the anticipation and after the consumption of fruit juice, a physiologically relevant primary reward. We show that average time estimations were systematically affected by the consumption of reward, but not by the anticipation of reward. Compared with baseline estimations of time, reward consumption was associated with subsequent overproductions of time, and this effect increased for larger magnitudes of reward. Additional experiments demonstrated that the effect of consumption did not extend to a secondary reward (money), a tasteless, noncaloric primary reward (water), or a sweet, noncaloric reward (aspartame). However, a tasteless caloric reward (maltodexrin) did induce overproductions of time, although this effect did not scale with reward magnitude. These results suggest that the consumption of caloric primary rewards can alter time perception, which may be a psychophysiological mechanism by which organisms regulate homeostatic balance. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

  2. Metabolic networks in epilepsy by MR spectroscopic imaging.

    PubMed

    Pan, J W; Spencer, D D; Kuzniecky, R; Duckrow, R B; Hetherington, H; Spencer, S S

    2012-12-01

    The concept of an epileptic network has long been suggested from both animal and human studies of epilepsy. Based on the common observation that the MR spectroscopic imaging measure of NAA/Cr is sensitive to neuronal function and injury, we use this parameter to assess for the presence of a metabolic network in mesial temporal lobe epilepsy (MTLE) patients. A multivariate factor analysis is performed with controls and MTLE patients, using NAA/Cr measures from 12 loci: the bilateral hippocampi, thalami, basal ganglia, and insula. The factor analysis determines which and to what extent these loci are metabolically covarying. We extract two independent factors that explain the data's variability in control and MTLE patients. In controls, these factors characterize a 'thalamic' and 'dominant subcortical' function. The MTLE patients also exhibit a 'thalamic' factor, in addition to a second factor involving the ipsilateral insula and bilateral basal ganglia. These data suggest that MTLE patients demonstrate a metabolic network that involves the thalami, also seen in controls. The MTLE patients also display a second set of metabolically covarying regions that may be a manifestation of the epileptic network that characterizes limbic seizure propagation. © 2012 John Wiley & Sons A/S.

  3. Incremental effects of reward on creativity.

    PubMed

    Eisenberger, R; Rhoades, L

    2001-10-01

    The authors examined 2 ways reward might increase creativity. First, reward contingent on creativity might increase extrinsic motivation. Studies 1 and 2 found that repeatedly giving preadolescent students reward for creative performance in 1 task increased their creativity in subsequent tasks. Study 3 reported that reward promised for creativity increased college students' creative task performance. Second, expected reward for high performance might increase creativity by enhancing perceived self-determination and, therefore, intrinsic task interest. Study 4 found that employees' intrinsic job interest mediated a positive relationship between expected reward for high performance and creative suggestions offered at work. Study 5 found that employees' perceived self-determination mediated a positive relationship between expected reward for high performance and the creativity of anonymous suggestions for helping the organization.

  4. Electrophysiology of Basal Ganglia and Cortex in Models of Parkinson Disease

    PubMed Central

    Ellens, Damien J.; Leventhal, Daniel K.

    2014-01-01

    Incomplete understanding of the systems-level pathophysiology of Parkinson Disease (PD) remains a significant barrier to improving its treatment. Substantial progress has been made, however, due to the availability of neurotoxins that selectively target monoaminergic (in particular, dopaminergic) neurons. This review discusses the in vivo electrophysiology of basal ganglia (BG), thalamic, and cortical regions after dopamine-depleting lesions. These include firing rate changes, neuronal burst-firing, neuronal oscillations, and neuronal synchrony that result from a combination of local microanatomic changes and network-level interactions. While much is known of the clinical and electrophysiological phenomenology of dopamine loss, a critical gap in our conception of PD pathophysiology is the link between them. We discuss potential mechanisms by which these systems-level electrophysiological changes may emerge, as well as how they may relate to clinical parkinsonism. Proposals for an updated understanding of BG function are reviewed, with an emphasis on how emerging frameworks will guide future research into the pathophysiology and treatment of PD. PMID:23948994

  5. Reward contingencies and the recalibration of task monitoring and reward systems: a high-density electrical mapping study.

    PubMed

    Morie, K P; De Sanctis, P; Foxe, J J

    2014-07-25

    Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task-monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward-seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density electroencephalography (EEG) recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task-preparatory and task-monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task-preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task-monitoring processes are clearly dissociable, but

  6. Reward Contingencies and the Recalibration of Task Monitoring and Reward Systems: A high-density electrical mapping study

    PubMed Central

    Morie, Kristen P.; De Sanctis, Pierfilippo; Foxe, John J.

    2014-01-01

    Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density EEG recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task preparatory and task monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task monitoring processes are clearly dissociable, but interact across very fast

  7. Individual differences in sensitivity to reward and punishment and neural activity during reward and avoidance learning

    PubMed Central

    Yoon, HeungSik; Kim, Hackjin; Hamann, Stephan

    2015-01-01

    In this functional neuroimaging study, we investigated neural activations during the process of learning to gain monetary rewards and to avoid monetary loss, and how these activations are modulated by individual differences in reward and punishment sensitivity. Healthy young volunteers performed a reinforcement learning task where they chose one of two fractal stimuli associated with monetary gain (reward trials) or avoidance of monetary loss (avoidance trials). Trait sensitivity to reward and punishment was assessed using the behavioral inhibition/activation scales (BIS/BAS). Functional neuroimaging results showed activation of the striatum during the anticipation and reception periods of reward trials. During avoidance trials, activation of the dorsal striatum and prefrontal regions was found. As expected, individual differences in reward sensitivity were positively associated with activation in the left and right ventral striatum during reward reception. Individual differences in sensitivity to punishment were negatively associated with activation in the left dorsal striatum during avoidance anticipation and also with activation in the right lateral orbitofrontal cortex during receiving monetary loss. These results suggest that learning to attain reward and learning to avoid loss are dependent on separable sets of neural regions whose activity is modulated by trait sensitivity to reward or punishment. PMID:25680989

  8. KATP channels in the nodose ganglia mediate the orexigenic actions of ghrelin

    PubMed Central

    Grabauskas, Gintautas; Wu, Xiaoyin; Lu, Yuanxu; Heldsinger, Andrea; Song, Il; Zhou, Shi-Yi; Owyang, Chung

    2015-01-01

    Abstract Ghrelin is the only known hunger signal derived from the peripheral tissues. Ghrelin overcomes the satiety signals evoked by anorexigenic molecules, such as cholecystokinin (CCK) and leptin, to stimulate feeding. The mechanisms by which ghrelin reduces the sensory signals evoked by anorexigenic hormones, which act via the vagus nerve to stimulate feeding, are unknown. Patch clamp recordings of isolated rat vagal neurons show that ghrelin hyperpolarizes neurons by activating K+ conductance. Administering a KATP channel antagonist or silencing Kir6.2, a major subunit of the KATP channel, abolished ghrelin inhibition in vitro and in vivo. Patch clamp studies show that ghrelin inhibits currents evoked by leptin and CCK-8, which operate through independent ionic channels. The inhibitory actions of ghrelin were abolished by treating the vagal ganglia neurons with pertussis toxin, as well as phosphatidylinositol 3-kinase (PI3K) or extracellular signal-regulated kinase 1 and 2 (Erk1/2) small interfering RNA. In vivo gene silencing of PI3K and Erk1/2 in the nodose ganglia prevented ghrelin inhibition of leptin- or CCK-8-evoked vagal firing. Feeding experiments showed that silencing Kir6.2 in the vagal ganglia abolished the orexigenic actions of ghrelin. These data indicate that ghrelin modulates vagal ganglia neuron excitability by activating KATP conductance via the growth hormone secretagogue receptor subtype 1a–Gαi–PI3K–Erk1/2–KATP pathway. The resulting hyperpolarization renders the neurons less responsive to signals evoked by anorexigenic hormones. This provides a mechanism to explain the actions of ghrelin with respect to overcoming anorexigenic signals that act via the vagal afferent pathways. Key points Ghrelin, a hunger signalling peptide derived from the peripheral tissues, overcomes the satiety signals evoked by anorexigenic molecules, such as cholecystokinin (CCK) and leptin, to stimulate feeding. Using in vivo and in vitro electrophysiological

  9. Social reward shapes attentional biases.

    PubMed

    Anderson, Brian A

    2016-01-01

    Paying attention to stimuli that predict a reward outcome is important for an organism to survive and thrive. When visual stimuli are associated with tangible, extrinsic rewards such as money or food, these stimuli acquire high attentional priority and come to automatically capture attention. In humans and other primates, however, many behaviors are not motivated directly by such extrinsic rewards, but rather by the social feedback that results from performing those behaviors. In the present study, I examine whether positive social feedback can similarly influence attentional bias. The results show that stimuli previously associated with a high probability of positive social feedback elicit value-driven attentional capture, much like stimuli associated with extrinsic rewards. Unlike with extrinsic rewards, however, such stimuli also influence task-specific motivation. My findings offer a potential mechanism by which social reward shapes the information that we prioritize when perceiving the world around us.

  10. Acetylcholine-modulated plasticity in reward-driven navigation: a computational study.

    PubMed

    Zannone, Sara; Brzosko, Zuzanna; Paulsen, Ole; Clopath, Claudia

    2018-06-21

    Neuromodulation plays a fundamental role in the acquisition of new behaviours. In previous experimental work, we showed that acetylcholine biases hippocampal synaptic plasticity towards depression, and the subsequent application of dopamine can retroactively convert depression into potentiation. We also demonstrated that incorporating this sequentially neuromodulated Spike-Timing-Dependent Plasticity (STDP) rule in a network model of navigation yields effective learning of changing reward locations. Here, we employ computational modelling to further characterize the effects of cholinergic depression on behaviour. We find that acetylcholine, by allowing learning from negative outcomes, enhances exploration over the action space. We show that this results in a variety of effects, depending on the structure of the model, the environment and the task. Interestingly, sequentially neuromodulated STDP also yields flexible learning, surpassing the performance of other reward-modulated plasticity rules.

  11. Do dopaminergic gene polymorphisms affect mesolimbic reward activation of music listening response? Therapeutic impact on Reward Deficiency Syndrome (RDS).

    PubMed

    Blum, Kenneth; Chen, Thomas J H; Chen, Amanda L H; Madigan, Margaret; Downs, B William; Waite, Roger L; Braverman, Eric R; Kerner, Mallory; Bowirrat, Abdalla; Giordano, John; Henshaw, Harry; Gold, Mark S

    2010-03-01

    Using fMRI, Menon and Levitin [9] clearly found for the first time that listening to music strongly modulates activity in a network of mesolimbic structures involved in reward processing including the nucleus accumbens (NAc) and the ventral tegmental area (VTA), as well as the hypothalamus, and insula, which are thought to be involved in regulating autonomic and physiological responses to rewarding and emotional stimuli. Importantly, responses in the NAc and VTA were strongly correlated pointing to an association between dopamine release and NAc response to music. Listing to pleasant music induced a strong response and significant activation of the VTA-mediated interaction of the NAc with the hypothalamus, insula, and orbitofrontal cortex. Blum et al. [10] provided the first evidence that the dopamine D2 receptor gene (DRD2) Taq 1 A1 allele significantly associated with severe alcoholism whereby the author's suggested that they found the first "reward gene" located in the mesolimbic system. The enhanced functional and effective connectivity between brain regions mediating reward, autonomic, and cognitive processing provides insight into understanding why listening to music is one of the most rewarding and pleasurable human experiences. However, little is known about why some people have a more or less powerful mesolimbic experience when they are listening to music. It is well-known that music may induce an endorphinergic response that is blocked by naloxone, a known opioid antagonist (Goldstein [19]). Opioid transmission in the NAc is associated with dopamine release in the VTA. Moreover, dopamine release in the VTA is linked to polymorphisms of the DRD2 gene and even attention-deficit hyperactivity disorder (ADHD), whereby carriers of the DRD2 A1 allele show a reduced NAc release of dopamine (DA). Thus it is conjectured that similar mechanisms in terms of adequate dopamine release and subsequent activation of reward circuitry by listening to music might also be

  12. Peripheral ganglia supplying the genital smooth musculature in the female pig: an experimental study

    PubMed Central

    PANU, RINO; BO MINELLI, LUISA; BOTTI, MADDALENA; GAZZA, FERDINANDO; ACONE, FRANCA; PALMIERI, GIOVANNI

    2001-01-01

    The aim of the present study was to locate the sensory and autonomic ganglia innervating the female genital musculature in pigs. The retrograde neuronal tracers horseradish peroxidase (HRP) or fast blue (FB) were injected into the left retractor clitoridis muscle (RCM), which was treated as a typical model of the genital smooth musculature. Labelled cells were found in ipsilateral dorsal root ganglia Sl–S4, in bilateral sympathetic paravertebral ganglia from L5–L6 or L6–L7 to S3 and in the left and right caudal mesenteric ganglion. In two of the five animals treated, presumably preganglionic parasympathetic cells were labelled in the ipsilateral intermediate grey substance of the segments Sl–S2. PMID:11554508

  13. Consolidation power of extrinsic rewards: reward cues enhance long-term memory for irrelevant past events.

    PubMed

    Murayama, Kou; Kitagami, Shinji

    2014-02-01

    Recent research suggests that extrinsic rewards promote memory consolidation through dopaminergic modulation processes. However, no conclusive behavioral evidence exists given that the influence of extrinsic reward on attention and motivation during encoding and consolidation processes are inherently confounded. The present study provides behavioral evidence that extrinsic rewards (i.e., monetary incentives) enhance human memory consolidation independently of attention and motivation. Participants saw neutral pictures, followed by a reward or control cue in an unrelated context. Our results (and a direct replication study) demonstrated that the reward cue predicted a retrograde enhancement of memory for the preceding neutral pictures. This retrograde effect was observed only after a delay, not immediately upon testing. An additional experiment showed that emotional arousal or unconscious resource mobilization cannot explain the retrograde enhancement effect. These results provide support for the notion that the dopaminergic memory consolidation effect can result from extrinsic reward.

  14. How may the basal ganglia contribute to auditory categorization and speech perception?

    PubMed Central

    Lim, Sung-Joo; Fiez, Julie A.; Holt, Lori L.

    2014-01-01

    Listeners must accomplish two complementary perceptual feats in extracting a message from speech. They must discriminate linguistically-relevant acoustic variability and generalize across irrelevant variability. Said another way, they must categorize speech. Since the mapping of acoustic variability is language-specific, these categories must be learned from experience. Thus, understanding how, in general, the auditory system acquires and represents categories can inform us about the toolbox of mechanisms available to speech perception. This perspective invites consideration of findings from cognitive neuroscience literatures outside of the speech domain as a means of constraining models of speech perception. Although neurobiological models of speech perception have mainly focused on cerebral cortex, research outside the speech domain is consistent with the possibility of significant subcortical contributions in category learning. Here, we review the functional role of one such structure, the basal ganglia. We examine research from animal electrophysiology, human neuroimaging, and behavior to consider characteristics of basal ganglia processing that may be advantageous for speech category learning. We also present emerging evidence for a direct role for basal ganglia in learning auditory categories in a complex, naturalistic task intended to model the incidental manner in which speech categories are acquired. To conclude, we highlight new research questions that arise in incorporating the broader neuroscience research literature in modeling speech perception, and suggest how understanding contributions of the basal ganglia can inform attempts to optimize training protocols for learning non-native speech categories in adulthood. PMID:25136291

  15. Nutritional controls of food reward.

    PubMed

    Fernandes, Maria F; Sharma, Sandeep; Hryhorczuk, Cecile; Auguste, Stephanie; Fulton, Stephanie

    2013-08-01

    The propensity to select and consume palatable nutrients is strongly influenced by the rewarding effects of food. Neural processes integrating reward, emotional states and decision-making can supersede satiety signals to promote excessive caloric intake and weight gain. While nutritional habits are influenced by reward-based neural mechanisms, nutrition and its impact on energy metabolism, in turn, plays an important role in the control of food reward. Feeding modulates the release of metabolic hormones that have an important influence on central controls of appetite. Nutrients themselves are also an essential source of energy fuel, while serving as key metabolites and acting as signalling molecules in the neural pathways that control feeding and food reward. Along these lines, this review discusses the impact of nutritionally regulated hormones and select macronutrients on the behavioural and neural processes underlying the rewarding effects of food. Copyright © 2013 Canadian Diabetes Association. Published by Elsevier Inc. All rights reserved.

  16. Effect of direct reciprocity and network structure on continuing prosperity of social networking services.

    PubMed

    Osaka, Kengo; Toriumi, Fujio; Sugawara, Toshihauru

    2017-01-01

    Social networking services (SNSs) are widely used as communicative tools for a variety of purposes. SNSs rely on the users' individual activities associated with some cost and effort, and thus it is not known why users voluntarily continue to participate in SNSs. Because the structures of SNSs are similar to that of the public goods (PG) game, some studies have focused on why voluntary activities emerge as an optimal strategy by modifying the PG game. However, their models do not include direct reciprocity between users, even though reciprocity is a key mechanism that evolves and sustains cooperation in human society. We developed an abstract SNS model called the reciprocity rewards and meta-rewards games that include direct reciprocity by extending the existing models. Then, we investigated how direct reciprocity in an SNS facilitates cooperation that corresponds to participation in SNS by posting articles and comments and how the structure of the networks of users exerts an influence on the strategies of users using the reciprocity rewards game. We run reciprocity rewards games on various complex networks and an instance network of Facebook and found that two types of stable cooperation emerged. First, reciprocity slightly improves the rate of cooperation in complete graphs but the improvement is insignificant because of the instability of cooperation. However, this instability can be avoided by making two assumptions: high degree of fun, i.e. articles are read with high probability, and different attitudes to reciprocal and non-reciprocal agents. We then propose the concept of half free riders to explain what strategy sustains cooperation-dominant situations. Second, we indicate that a certain WS network structure affects users' optimal strategy and facilitates stable cooperation without any extra assumptions. We give a detailed analysis of the different characteristics of the two types of cooperation-dominant situations and the effect of the memory of

  17. Dopamine prediction errors in reward learning and addiction: from theory to neural circuitry

    PubMed Central

    Keiflin, Ronald; Janak, Patricia H.

    2015-01-01

    Summary Midbrain dopamine (DA) neurons are proposed to signal reward prediction error (RPE), a fundamental parameter in associative learning models. This RPE hypothesis provides a compelling theoretical framework for understanding DA function in reward learning and addiction. New studies support a causal role for DA-mediated RPE activity in promoting learning about natural reward; however, this question has not been explicitly tested in the context of drug addiction. In this review, we integrate theoretical models with experimental findings on the activity of DA systems, and on the causal role of specific neuronal projections and cell types, to provide a circuit-based framework for probing DA-RPE function in addiction. By examining error-encoding DA neurons in the neural network in which they are embedded, hypotheses regarding circuit-level adaptations that possibly contribute to pathological error-signaling and addiction can be formulated and tested. PMID:26494275

  18. Individual differences in sensitivity to reward and punishment and neural activity during reward and avoidance learning.

    PubMed

    Kim, Sang Hee; Yoon, HeungSik; Kim, Hackjin; Hamann, Stephan

    2015-09-01

    In this functional neuroimaging study, we investigated neural activations during the process of learning to gain monetary rewards and to avoid monetary loss, and how these activations are modulated by individual differences in reward and punishment sensitivity. Healthy young volunteers performed a reinforcement learning task where they chose one of two fractal stimuli associated with monetary gain (reward trials) or avoidance of monetary loss (avoidance trials). Trait sensitivity to reward and punishment was assessed using the behavioral inhibition/activation scales (BIS/BAS). Functional neuroimaging results showed activation of the striatum during the anticipation and reception periods of reward trials. During avoidance trials, activation of the dorsal striatum and prefrontal regions was found. As expected, individual differences in reward sensitivity were positively associated with activation in the left and right ventral striatum during reward reception. Individual differences in sensitivity to punishment were negatively associated with activation in the left dorsal striatum during avoidance anticipation and also with activation in the right lateral orbitofrontal cortex during receiving monetary loss. These results suggest that learning to attain reward and learning to avoid loss are dependent on separable sets of neural regions whose activity is modulated by trait sensitivity to reward or punishment. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

  19. Dissociation between musical and monetary reward responses in specific musical anhedonia.

    PubMed

    Mas-Herrero, Ernest; Zatorre, Robert J; Rodriguez-Fornells, Antoni; Marco-Pallarés, Josep

    2014-03-17

    Music has been present in all human cultures since prehistory [1, 2], although it is not associated with any apparent biological advantages (such as food, sex, etc.) or utility value (such as money). Nevertheless, music is ranked among the highest sources of pleasure [3], and its important role in our society and culture has led to the assumption that the ability of music to induce pleasure is universal. However, this assumption has never been empirically tested. In the present report, we identified a group of healthy individuals without depression or generalized anhedonia who showed reduced behavioral pleasure ratings and no autonomic responses to pleasurable music, despite having normal musical perception capacities. These persons showed preserved behavioral and physiological responses to monetary reward, indicating that the low sensitivity to music was not due to a global hypofunction of the reward network. These results point to the existence of specific musical anhedonia and suggest that there may be individual differences in access to the reward system. Copyright © 2014 Elsevier Ltd. All rights reserved.

  20. Desynchronization of slow oscillations in the basal ganglia during natural sleep.

    PubMed

    Mizrahi-Kliger, Aviv D; Kaplan, Alexander; Israel, Zvi; Bergman, Hagai

    2018-05-01

    Slow oscillations of neuronal activity alternating between firing and silence are a hallmark of slow-wave sleep (SWS). These oscillations reflect the default activity present in all mammalian species, and are ubiquitous to anesthesia, brain slice preparations, and neuronal cultures. In all these cases, neuronal firing is highly synchronous within local circuits, suggesting that oscillation-synchronization coupling may be a governing principle of sleep physiology regardless of anatomical connectivity. To investigate whether this principle applies to overall brain organization, we recorded the activity of individual neurons from basal ganglia (BG) structures and the thalamocortical (TC) network over 70 full nights of natural sleep in two vervet monkeys. During SWS, BG neurons manifested slow oscillations (∼0.5 Hz) in firing rate that were as prominent as in the TC network. However, in sharp contrast to any neural substrate explored thus far, the slow oscillations in all BG structures were completely desynchronized between individual neurons. Furthermore, whereas in the TC network single-cell spiking was locked to slow oscillations in the local field potential (LFP), the BG LFP exhibited only weak slow oscillatory activity and failed to entrain nearby cells. We thus show that synchrony is not inherent to slow oscillations, and propose that the BG desynchronization of slow oscillations could stem from its unique anatomy and functional connectivity. Finally, we posit that BG slow-oscillation desynchronization may further the reemergence of slow-oscillation traveling waves from multiple independent origins in the frontal cortex, thus significantly contributing to normal SWS.

  1. The influence of playing a non-reward game on motor ability and executive function in Parkinson's disease.

    PubMed

    Araújo Lima, Alisson Menezes; Cordeiro Hirata, Fabiana de Campos; Sales de Bruin, Gabriela; Salani Mota, Rosa Maria; Bruin, Veralice Meireles Sales de

    2012-01-01

    The aim of this study is to evaluate the acute effect of playing games on executive function and motor ability in Parkinson's disease (PD). Consecutive cases with PD were studied with the Unified Parkinson Disease Rating Scale (UPDRS), Mini-Mental State examination (MMSE), Beck Depression Inventory (BDI), Stroop test, finger tapping and 14-meter walk test. After randomization, patients performed a game of dominoes and were tested before and after experiment being further categorized as control, winners or non-winners. Forty patients, 27 male (67.5%), aged 48 to 84 years (63.2 ± 8.5), Hoehn & Yahr I to III were included. Twenty-eight (70%) presented depressive symptoms (BDI > 10). Groups (Control N = 13; Winners = 14 and Non-winners = 13) were not different regarding age, disease duration, age at onset, BMI, MMSE scores, depressive symptoms, levodopa dose, and previous practice of games. Winners presented significantly better results on executive function (Stroop test, p = 0.002) and on motor activity (Finger tapping, p = 0.01). Non-winners showed a trend of better performance in the 14-meter-walk test. This study shows that the practice of a non-reward game acutely improved memory and motor skills in PD. Our results suggest a role for the reward system in the modulation of the dopaminergic function of the basal ganglia in these patients.

  2. Elevated cognitive control over reward processing in recovered female patients with anorexia nervosa.

    PubMed

    Ehrlich, Stefan; Geisler, Daniel; Ritschel, Franziska; King, Joseph A; Seidel, Maria; Boehm, Ilka; Breier, Marion; Clas, Sabine; Weiss, Jessika; Marxen, Michael; Smolka, Michael N; Roessner, Veit; Kroemer, Nils B

    2015-09-01

    Individuals with anorexia nervosa are thought to exert excessive self-control to inhibit primary drives. This study used functional MRI (fMRI) to interrogate interactions between the neural correlates of cognitive control and motivational processes in the brain reward system during the anticipation of monetary reward and reward-related feedback. In order to avoid confounding effects of undernutrition, we studied female participants recovered from anorexia nervosa and closely matched healthy female controls. The fMRI analysis (including node-to-node functional connectivity) followed a region of interest approach based on models of the brain reward system and cognitive control regions implicated in anorexia nervosa: the ventral striatum, medial orbitofrontal cortex (mOFC) and dorsolateral prefrontal cortex (DLPFC). We included 30 recovered patients and 30 controls in our study. There were no behavioural differences and no differences in hemodynamic responses of the ventral striatum and the mOFC in the 2 phases of the task. However, relative to controls, recovered patients showed elevated DLPFC activity during the anticipation phase, failed to deactivate this region during the feedback phase and displayed greater functional coupling between the DLPFC and mOFC. Recovered patients also had stronger associations than controls between anticipation-related DLPFC responses and instrumental responding. The results we obtained using monetary stimuli might not generalize to other forms of reward. Unaltered neural responses in ventral limbic reward networks but increased recruitment of and connectivity with lateral-frontal brain circuitry in recovered patients suggests an elevated degree of selfregulatory processes in response to rewarding stimuli. An imbalance between brain systems subserving bottom-up and top-down processes may be a trait marker of the disorder.

  3. The Development of the Basal Ganglia in Capuchin Monkeys (Cebus apella)

    PubMed Central

    Phillips, Kimberley A.; Sobieski, Courtney A.; Gilbert, Valerie R.; Chiappini-Williamson, Christine; Sherwood, Chet C.; Strick, Peter L.

    2010-01-01

    The basal ganglia are subcortical structures involved in the planning, initiation and regulation of movement as well as a variety of non-motor, cognitive and affective functions. Capuchin monkeys share several important characteristics of development with humans, including a prolonged infancy and juvenile period, a long lifespan, and complex manipulative abilities. This makes capuchins important comparative models for understanding age-related neuroanatomical changes in these structures. Here we report developmental volumetric data on the three subdivisions of the basal ganglia, the caudate, putamen and globus pallidus in brown capuchin monkeys (Cebus apella). Based on a cross-sectional sample, we describe brain development in 28 brown capuchin monkeys (male n = 17, female n = 11; age range = 2 months – 20 years) using high-resolution structural MRI. We found that the raw volumes of the putamen and caudate varied significantly with age, decreasing in volume from birth through early adulthood. Notably, developmental changes did not differ between sexes. Because these observed developmental patterns are similar to humans, our results suggest that capuchin monkeys may be useful animal models for investigating neurodevelopmental disorders of the basal ganglia. PMID:20227397

  4. Methylphenidate and brain activity in a reward/conflict paradigm: role of the insula in task performance.

    PubMed

    Ivanov, Iliyan; Liu, Xun; Clerkin, Suzanne; Schulz, Kurt; Fan, Jin; Friston, Karl; London, Edythe D; Schwartz, Jeffrey; Newcorn, Jeffrey H

    2014-06-01

    Psychostimulants, such as methylphenidate, are thought to improve information processing in motivation-reward and attention-activation networks by enhancing the effects of more relevant signals and suppressing those of less relevant ones; however the nature of such reciprocal influences remains poorly understood. To explore this question, we tested the effect of methylphenidate on performance and associated brain activity in the Anticipation, Conflict, Reward (ACR) task. Sixteen healthy adult volunteers, ages 21-45, were scanned twice using functional magnetic resonance imaging (fMRI) as they performed the ACR task under placebo and methylphenidate conditions. A three-way repeated measures analysis of variance, with cue (reward vs. non-reward), target (congruent vs. incongruent) and medication condition (methylphenidate vs. placebo) as the factors, was used to analyze behaviors on the task. Blood oxygen level dependent (BOLD) signals, reflecting task-related neural activity, were evaluated using linear contrasts. Participants exhibited significantly greater accuracy in the methylphenidate condition than the placebo condition. Compared with placebo, the methylphenidate condition also was associated with lesser task-related activity in components of attention-activation systems irrespective of the reward cue, and less task-related activity in components of the reward-motivation system, particularly the insula, during reward trials irrespective of target difficulty. These results suggest that methylphenidate enhances task performance by improving efficiency of information processing in both reward-motivation and in attention-activation systems. Published by Elsevier B.V.

  5. Impairments in learning by monetary rewards and alcohol-associated rewards in detoxified alcoholic patients.

    PubMed

    Jokisch, Daniel; Roser, Patrik; Juckel, Georg; Daum, Irene; Bellebaum, Christian

    2014-07-01

    Excessive alcohol consumption has been linked to structural and functional brain changes associated with cognitive, emotional, and behavioral impairments. It has been suggested that neural processing in the reward system is also affected by alcoholism. The present study aimed at further investigating reward-based associative learning and reversal learning in detoxified alcohol-dependent patients. Twenty-one detoxified alcohol-dependent patients and 26 healthy control subjects participated in a probabilistic learning task using monetary and alcohol-associated rewards as feedback stimuli indicating correct responses. Performance during acquisition and reversal learning in the different feedback conditions was analyzed. Alcohol-dependent patients and healthy control subjects showed an increase in learning performance over learning blocks during acquisition, with learning performance being significantly lower in alcohol-dependent patients. After changing the contingencies, alcohol-dependent patients exhibited impaired reversal learning and showed, in contrast to healthy controls, different learning curves for different types of rewards with no increase in performance for high monetary and alcohol-associated feedback. The present findings provide evidence that dysfunctional processing in the reward system in alcohol-dependent patients leads to alterations in reward-based learning resulting in a generally reduced performance. In addition, the results suggest that alcohol-dependent patients are, in particular, more impaired in changing an established behavior originally reinforced by high rewards. Copyright © 2014 by the Research Society on Alcoholism.

  6. Group Rewards Make Groupwork Work.

    ERIC Educational Resources Information Center

    Slavin, Robert E.

    1991-01-01

    Critiques Kohn's article (in the same "Educational Leadership" issue) arguing against the use of cooperative rewards. Without group rewards based on the learning of all group members, cooperative learning can degenerate into answer-sharing. The idea that such rewards (usually paper certificates) can be dispensed with is wishful thinking. Includes…

  7. Altered cingulo-striatal function underlies reward drive deficits in schizophrenia.

    PubMed

    Park, Il Ho; Chun, Ji Won; Park, Hae-Jeong; Koo, Min-Seong; Park, Sunyoung; Kim, Seok-Hyeong; Kim, Jae-Jin

    2015-02-01

    Amotivation in schizophrenia is assumed to involve dysfunctional dopaminergic signaling of reward prediction or anticipation. It is unclear, however, whether the translation of neural representation of reward value to behavioral drive is affected in schizophrenia. In order to examine how abnormal neural processing of response valuation and initiation affects incentive motivation in schizophrenia, we conducted functional MRI using a deterministic reinforcement learning task with variable intervals of contingency reversals in 20 clinically stable patients with schizophrenia and 20 healthy controls. Behaviorally, the advantage of positive over negative reinforcer in reinforcement-related responsiveness was not observed in patients. Patients showed altered response valuation and initiation-related striatal activity and deficient rostro-ventral anterior cingulate cortex activation during reward approach initiation. Among these neural abnormalities, rostro-ventral anterior cingulate cortex activation was correlated with positive reinforcement-related responsiveness in controls and social anhedonia and social amotivation subdomain scores in patients. Our findings indicate that the central role of the anterior cingulate cortex is in translating action value into driving force of action, and underscore the role of the cingulo-striatal network in amotivation in schizophrenia. Copyright © 2014 Elsevier B.V. All rights reserved.

  8. Led into temptation? Rewarding brand logos bias the neural encoding of incidental economic decisions.

    PubMed

    Murawski, Carsten; Harris, Philip G; Bode, Stefan; Domínguez D, Juan F; Egan, Gary F

    2012-01-01

    Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI) study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness.

  9. Risk of punishment influences discrete and coordinated encoding of reward-guided actions by prefrontal cortex and VTA neurons

    PubMed Central

    Park, Junchol

    2017-01-01

    Actions motivated by rewards are often associated with risk of punishment. Little is known about the neural representation of punishment risk during reward-seeking behavior. We modeled this circumstance in rats by designing a task where actions were consistently rewarded but probabilistically punished. Spike activity and local field potentials were recorded during task performance simultaneously from VTA and mPFC, two reciprocally connected regions implicated in reward-seeking and aversive behaviors. At the single unit level, we found that ensembles of putative dopamine and non-dopamine VTA neurons and mPFC neurons encode the relationship between action and punishment. At the network level, we found that coherent theta oscillations synchronize VTA and mPFC in a bottom-up direction, effectively phase-modulating the neuronal spike activity in the two regions during punishment-free actions. This synchrony declined as a function of punishment probability, suggesting that during reward-seeking actions, risk of punishment diminishes VTA-driven neural synchrony between the two regions. PMID:29058673

  10. Long term voluntary wheel running is rewarding and produces plasticity in the mesolimbic reward pathway

    PubMed Central

    Greenwood, Benjamin N.; Foley, Teresa E.; Le, Tony V.; Strong, Paul V.; Loughridge, Alice B.; Day, Heidi E.W.; Fleshner, Monika

    2011-01-01

    The mesolimbic reward pathway is implicated in stress-related psychiatric disorders and is a potential target of plasticity underlying the stress resistance produced by repeated voluntary exercise. It is unknown, however, whether rats find long-term access to running wheels rewarding, or if repeated voluntary exercise reward produces plastic changes in mesolimbic reward neurocircuitry. In the current studies, young adult, male Fischer 344 rats allowed voluntary access to running wheels for 6 weeks, but not 2 weeks, found wheel running rewarding, as measured by conditioned place preference (CPP). Consistent with prior reports and the behavioral data, 6 weeks of wheel running increased ΔFosB/FosB immunoreactivity in the nucleus accumbens (Acb). In addition, semi quantitative in situ hybridization revealed that 6 weeks of wheel running, compared to sedentary housing, increased tyrosine hydroxylase (TH) mRNA levels in the ventral tegmental area (VTA), increased delta opioid receptor (DOR) mRNA levels in the Acb shell, and reduced levels of dopamine receptor (DR)-D2 mRNA in the Acb core. Results indicate that repeated voluntary exercise is rewarding and alters gene transcription in mesolimbic reward neurocircuitry. The duration-dependent effects of wheel running on CPP suggest that as the weeks of wheel running progress, the rewarding effects of a night of voluntary wheel running might linger longer into the inactive cycle thus providing stronger support for CPP. The observed plasticity could contribute to the mechanisms by which exercise reduces the incidence and severity of substance abuse disorders, changes the rewarding properties of drugs of abuse, and facilitates successful coping with stress. PMID:21070820

  11. Long-term voluntary wheel running is rewarding and produces plasticity in the mesolimbic reward pathway.

    PubMed

    Greenwood, Benjamin N; Foley, Teresa E; Le, Tony V; Strong, Paul V; Loughridge, Alice B; Day, Heidi E W; Fleshner, Monika

    2011-03-01

    The mesolimbic reward pathway is implicated in stress-related psychiatric disorders and is a potential target of plasticity underlying the stress resistance produced by repeated voluntary exercise. It is unknown, however, whether rats find long-term access to running wheels rewarding, or if repeated voluntary exercise reward produces plastic changes in mesolimbic reward neurocircuitry. In the current studies, young adult, male Fischer 344 rats allowed voluntary access to running wheels for 6 weeks, but not 2 weeks, found wheel running rewarding, as measured by conditioned place preference (CPP). Consistent with prior reports and the behavioral data, 6 weeks of wheel running increased ΔFosB/FosB immunoreactivity in the nucleus accumbens (Acb). In addition, semi quantitative in situ hybridization revealed that 6 weeks of wheel running, compared to sedentary housing, increased tyrosine hydroxylase (TH) mRNA levels in the ventral tegmental area (VTA), increased delta opioid receptor (DOR) mRNA levels in the Acb shell, and reduced levels of dopamine receptor (DR)-D2 mRNA in the Acb core. Results indicate that repeated voluntary exercise is rewarding and alters gene transcription in mesolimbic reward neurocircuitry. The duration-dependent effects of wheel running on CPP suggest that as the weeks of wheel running progress, the rewarding effects of a night of voluntary wheel running might linger longer into the inactive cycle thus providing stronger support for CPP. The observed plasticity could contribute to the mechanisms by which exercise reduces the incidence and severity of substance abuse disorders, changes the rewarding properties of drugs of abuse, and facilitates successful coping with stress. Copyright © 2010 Elsevier B.V. All rights reserved.

  12. Neural Processing of Calories in Brain Reward Areas Can be Modulated by Reward Sensitivity

    PubMed Central

    van Rijn, Inge; Griffioen-Roose, Sanne; de Graaf, Cees; Smeets, Paul A. M.

    2016-01-01

    A food's reward value is dependent on its caloric content. Furthermore, a food's acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity), however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015), in which participants (n = 30) tasted simple solutions of a non-caloric sweetener with or without a non-sweet carbohydrate (maltodextrin) during hunger and satiety. Secondly, we expanded these analyses to regular drinks by assessing the same relationship in data from a study in which soft drinks sweetened with either sucrose or a non-caloric sweetener were administered during hunger (n = 18) (Griffioen-Roose et al., 2013). First, taste activation by the non-caloric solution/soft drink was subtracted from that by the caloric solution/soft drink to eliminate sweetness effects and retain activation induced by calories. Subsequently, this difference in taste activation was correlated with reward sensitivity as measured with the BAS drive subscale of the Behavioral Activation System (BAS) questionnaire. When participants were hungry and tasted calories from the simple solution, brain activation in the right ventral striatum (caudate), right amygdala and anterior cingulate cortex (bilaterally) correlated negatively with BAS drive scores. In contrast, when participants were satiated, taste responses correlated positively with BAS drive scores in the left caudate. These results were not replicated for soft drinks. Thus, neural responses to oral calories from maltodextrin were modulated by reward sensitivity in reward-related brain areas. This was not the case for sucrose. This may be due to the direct detection of maltodextrin, but not sucrose in the oral cavity. Also, in a familiar beverage, detection of calories per se may be

  13. Goal-directed and habitual control in the basal ganglia: implications for Parkinson’s disease

    PubMed Central

    Redgrave, Peter; Rodriguez, Manuel; Smith, Yoland; Rodriguez-Oroz, Maria C.; Lehericy, Stephane; Bergman, Hagai; Agid, Yves; DeLong, Mahlon R.; Obeso, Jose A.

    2011-01-01

    Progressive loss of the ascending dopaminergic projection in the basal ganglia is a fundamental pathological feature of Parkinson’s disease. Studies in animals and humans have identified spatially segregated functional territories in the basal ganglia for the control of goal-directed and habitual actions. In patients with Parkinson’s disease the loss of dopamine is predominantly in the posterior putamen, a region of the basal ganglia associated with the control of habitual behaviour. These patients may therefore be forced into a progressive reliance on the goal-directed mode of action control that is mediated by comparatively preserved processing in the rostromedial striatum. Thus, many of their behavioural difficulties may reflect a loss of normal automatic control owing to distorting output signals from habitual control circuits, which impede the expression of goal-directed action. PMID:20944662

  14. The inhibitory microcircuit of the substantia nigra provides feedback gain control of the basal ganglia output

    PubMed Central

    Brown, Jennifer; Pan, Wei-Xing; Dudman, Joshua Tate

    2014-01-01

    Dysfunction of the basal ganglia produces severe deficits in the timing, initiation, and vigor of movement. These diverse impairments suggest a control system gone awry. In engineered systems, feedback is critical for control. By contrast, models of the basal ganglia highlight feedforward circuitry and ignore intrinsic feedback circuits. In this study, we show that feedback via axon collaterals of substantia nigra projection neurons control the gain of the basal ganglia output. Through a combination of physiology, optogenetics, anatomy, and circuit mapping, we elaborate a general circuit mechanism for gain control in a microcircuit lacking interneurons. Our data suggest that diverse tonic firing rates, weak unitary connections and a spatially diffuse collateral circuit with distinct topography and kinetics from feedforward input is sufficient to implement divisive feedback inhibition. The importance of feedback for engineered systems implies that the intranigral microcircuit, despite its absence from canonical models, could be essential to basal ganglia function. DOI: http://dx.doi.org/10.7554/eLife.02397.001 PMID:24849626

  15. Reward alters the perception of time.

    PubMed

    Failing, Michel; Theeuwes, Jan

    2016-03-01

    Recent findings indicate that monetary rewards have a powerful effect on cognitive performance. In order to maximize overall gain, the prospect of earning reward biases visual attention to specific locations or stimulus features improving perceptual sensitivity and processing. The question we addressed in this study is whether the prospect of reward also affects the subjective perception of time. Here, participants performed a prospective timing task using temporal oddballs. The results show that temporal oddballs, displayed for varying durations, presented in a sequence of standard stimuli were perceived to last longer when they signaled a relatively high reward compared to when they signaled no or low reward. When instead of the oddball the standards signaled reward, the perception of the temporal oddball remained unaffected. We argue that by signaling reward, a stimulus becomes subjectively more salient thereby modulating its attentional deployment and distorting how it is perceived in time. Copyright © 2015 Elsevier B.V. All rights reserved.

  16. Oscillatory rhythm of reward: anticipation and processing of rewards in children with and without autism.

    PubMed

    Stavropoulos, Katherine Kuhl-Meltzoff; Carver, Leslie J

    2018-01-01

    Autism spectrum disorder (ASD) is a complex neurodevelopmental condition, and multiple theories have emerged concerning core social deficits. While the social motivation hypothesis proposes that deficits in the social reward system cause individuals with ASD to engage less in social interaction, the overly intense world hypothesis (sensory over-responsivity) proposes that individuals with ASD find stimuli to be too intense and may have hypersensitivity to social interaction, leading them to avoid these interactions. EEG was recorded during reward anticipation and reward processing. Reward anticipation was measured using alpha asymmetry, and post-feedback theta was utilized to measure reward processing. Additionally, we calculated post-feedback alpha suppression to measure attention and salience. Participants were 6- to 8-year-olds with ( N  = 20) and without ( N  = 23) ASD. Children with ASD showed more left-dominant alpha suppression when anticipating rewards accompanied by nonsocial stimuli compared to social stimuli. During reward processing, children with ASD had less theta activity than typically developing (TD) children. Alpha activity after feedback showed the opposite pattern: children with ASD had greater alpha suppression than TD children. Significant correlations were observed between behavioral measures of autism severity and EEG activity in both the reward anticipation and reward processing time periods. The findings provide evidence that children with ASD have greater approach motivation prior to nonsocial (compared to social) stimuli. Results after feedback suggest that children with ASD evidence less robust activity thought to reflect evaluation and processing of rewards (e.g., theta) compared to TD children. However, children with ASD evidence greater alpha suppression after feedback compared to TD children. We hypothesize that post-feedback alpha suppression reflects general cognitive engagement-which suggests that children with ASD may

  17. Probing Intrinsic Resting-State Networks in the Infant Rat Brain

    PubMed Central

    Bajic, Dusica; Craig, Michael M.; Borsook, David; Becerra, Lino

    2016-01-01

    Resting-state functional magnetic resonance imaging (rs-fMRI) measures spontaneous fluctuations in blood oxygenation level-dependent (BOLD) signal in the absence of external stimuli. It has become a powerful tool for mapping large-scale brain networks in humans and animal models. Several rs-fMRI studies have been conducted in anesthetized and awake adult rats, reporting consistent patterns of brain activity at the systems level. However, the evolution to adult patterns of resting-state activity has not yet been evaluated and quantified in the developing rat brain. In this study, we hypothesized that large-scale intrinsic networks would be easily detectable but not fully established as specific patterns of activity in lightly anesthetized 2-week-old rats (N = 11). Independent component analysis (ICA) identified 8 networks in 2-week-old-rats. These included Default mode, Sensory (Exteroceptive), Salience (Interoceptive), Basal Ganglia-Thalamic-Hippocampal, Basal Ganglia, Autonomic, Cerebellar, as well as Thalamic-Brainstem networks. Many of these networks consisted of more than one component, possibly indicative of immature, underdeveloped networks at this early time point. Except for the Autonomic network, infant rat networks showed reduced connectivity with subcortical structures in comparison to previously published adult networks. Reported slow fluctuations in the BOLD signal that correspond to functionally relevant resting-state networks in 2-week-old rats can serve as an important tool for future studies of brain development in the settings of different pharmacological applications or disease. PMID:27803653

  18. Distinct Reward Properties are Encoded via Corticostriatal Interactions

    PubMed Central

    Smith, David V.; Rigney, Anastasia E.; Delgado, Mauricio R.

    2016-01-01

    The striatum serves as a critical brain region for reward processing. Yet, understanding the link between striatum and reward presents a challenge because rewards are composed of multiple properties. Notably, affective properties modulate emotion while informative properties help obtain future rewards. We approached this problem by emphasizing affective and informative reward properties within two independent guessing games. We found that both reward properties evoked activation within the nucleus accumbens, a subregion of the striatum. Striatal responses to informative, but not affective, reward properties predicted subsequent utilization of information for obtaining monetary reward. We hypothesized that activation of the striatum may be necessary but not sufficient to encode distinct reward properties. To investigate this possibility, we examined whether affective and informative reward properties were differentially encoded in corticostriatal interactions. Strikingly, we found that the striatum exhibited dissociable connectivity patterns with the ventrolateral prefrontal cortex, with increasing connectivity for affective reward properties and decreasing connectivity for informative reward properties. Our results demonstrate that affective and informative reward properties are encoded via corticostriatal interactions. These findings highlight how corticostriatal systems contribute to reward processing, potentially advancing models linking striatal activation to behavior. PMID:26831208

  19. Distinct Reward Properties are Encoded via Corticostriatal Interactions.

    PubMed

    Smith, David V; Rigney, Anastasia E; Delgado, Mauricio R

    2016-02-02

    The striatum serves as a critical brain region for reward processing. Yet, understanding the link between striatum and reward presents a challenge because rewards are composed of multiple properties. Notably, affective properties modulate emotion while informative properties help obtain future rewards. We approached this problem by emphasizing affective and informative reward properties within two independent guessing games. We found that both reward properties evoked activation within the nucleus accumbens, a subregion of the striatum. Striatal responses to informative, but not affective, reward properties predicted subsequent utilization of information for obtaining monetary reward. We hypothesized that activation of the striatum may be necessary but not sufficient to encode distinct reward properties. To investigate this possibility, we examined whether affective and informative reward properties were differentially encoded in corticostriatal interactions. Strikingly, we found that the striatum exhibited dissociable connectivity patterns with the ventrolateral prefrontal cortex, with increasing connectivity for affective reward properties and decreasing connectivity for informative reward properties. Our results demonstrate that affective and informative reward properties are encoded via corticostriatal interactions. These findings highlight how corticostriatal systems contribute to reward processing, potentially advancing models linking striatal activation to behavior.

  20. Social context differentially modulates activity of two interneuron populations in an avian basal ganglia nucleus

    PubMed Central

    2016-01-01

    Basal ganglia circuits are critical for the modulation of motor performance across behavioral states. In zebra finches, a cortical-basal ganglia circuit dedicated to singing is necessary for males to adjust their song performance and transition between spontaneous singing, when they are alone (“undirected” song), and a performance state, when they sing to a female (“female-directed” song). However, we know little about the role of different basal ganglia cell types in this behavioral transition or the degree to which behavioral context modulates the activity of different neuron classes. To investigate whether interneurons in the songbird basal ganglia encode information about behavioral state, I recorded from two interneuron types, fast-spiking interneurons (FSI) and external pallidal (GPe) neurons, in the songbird basal ganglia nucleus area X during both female-directed and undirected singing. Both cell types exhibited higher firing rates, more frequent bursting, and greater trial-by-trial variability in firing when male zebra finches produced undirected songs compared with when they produced female-directed songs. However, the magnitude and direction of changes to the firing rate, bursting, and variability of spiking between when birds sat silently and when they sang undirected and female-directed song varied between FSI and GPe neurons. These data indicate that social modulation of activity important for eliciting changes in behavioral state is present in multiple cell types within area X and suggests that social interactions may adjust circuit dynamics during singing at multiple points within the circuit. PMID:27628208

  1. Subthalamic, not striatal, activity correlates with basal ganglia downstream activity in normal and parkinsonian monkeys

    PubMed Central

    Deffains, Marc; Iskhakova, Liliya; Katabi, Shiran; Haber, Suzanne N; Israel, Zvi; Bergman, Hagai

    2016-01-01

    The striatum and the subthalamic nucleus (STN) constitute the input stage of the basal ganglia (BG) network and together innervate BG downstream structures using GABA and glutamate, respectively. Comparison of the neuronal activity in BG input and downstream structures reveals that subthalamic, not striatal, activity fluctuations correlate with modulations in the increase/decrease discharge balance of BG downstream neurons during temporal discounting classical condition task. After induction of parkinsonism with 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP), abnormal low beta (8-15 Hz) spiking and local field potential (LFP) oscillations resonate across the BG network. Nevertheless, LFP beta oscillations entrain spiking activity of STN, striatal cholinergic interneurons and BG downstream structures, but do not entrain spiking activity of striatal projection neurons. Our results highlight the pivotal role of STN divergent projections in BG physiology and pathophysiology and may explain why STN is such an effective site for invasive treatment of advanced Parkinson's disease and other BG-related disorders. DOI: http://dx.doi.org/10.7554/eLife.16443.001 PMID:27552049

  2. Measuring and modeling the interaction among reward size, delay to reward, and satiation level on motivation in monkeys.

    PubMed

    Minamimoto, Takafumi; La Camera, Giancarlo; Richmond, Barry J

    2009-01-01

    Motivation is usually inferred from the likelihood or the intensity with which behavior is carried out. It is sensitive to external factors (e.g., the identity, amount, and timing of a rewarding outcome) and internal factors (e.g., hunger or thirst). We trained macaque monkeys to perform a nonchoice instrumental task (a sequential red-green color discrimination) while manipulating two external factors: reward size and delay-to-reward. We also inferred the state of one internal factor, level of satiation, by monitoring the accumulated reward. A visual cue indicated the forthcoming reward size and delay-to-reward in each trial. The fraction of trials completed correctly by the monkeys increased linearly with reward size and was hyperbolically discounted by delay-to-reward duration, relations that are similar to those found in free operant and choice tasks. The fraction of correct trials also decreased progressively as a function of the satiation level. Similar (albeit noiser) relations were obtained for reaction times. The combined effect of reward size, delay-to-reward, and satiation level on the proportion of correct trials is well described as a multiplication of the effects of the single factors when each factor is examined alone. These results provide a quantitative account of the interaction of external and internal factors on instrumental behavior, and allow us to extend the concept of subjective value of a rewarding outcome, usually confined to external factors, to account also for slow changes in the internal drive of the subject.

  3. Flexible microelectrode array for interfacing with the surface of neural ganglia

    NASA Astrophysics Data System (ADS)

    Sperry, Zachariah J.; Na, Kyounghwan; Parizi, Saman S.; Chiel, Hillel J.; Seymour, John; Yoon, Euisik; Bruns, Tim M.

    2018-06-01

    Objective. The dorsal root ganglia (DRG) are promising nerve structures for sensory neural interfaces because they provide centralized access to primary afferent cell bodies and spinal reflex circuitry. In order to harness this potential, new electrode technologies are needed which take advantage of the unique properties of DRG, specifically the high density of neural cell bodies at the dorsal surface. Here we report initial in vivo results from the development of a flexible non-penetrating polyimide electrode array interfacing with the surface of ganglia. Approach. Multiple layouts of a 64-channel iridium electrode (420 µm2) array were tested, with pitch as small as 25 µm. The buccal ganglia of invertebrate sea slug Aplysia californica were used to develop handling and recording techniques with ganglionic surface electrode arrays (GSEAs). We also demonstrated the GSEA’s capability to record single- and multi-unit activity from feline lumbosacral DRG related to a variety of sensory inputs, including cutaneous brushing, joint flexion, and bladder pressure. Main results. We recorded action potentials from a variety of Aplysia neurons activated by nerve stimulation, and units were observed firing simultaneously on closely spaced electrode sites. We also recorded single- and multi-unit activity associated with sensory inputs from feline DRG. We utilized spatial oversampling of action potentials on closely-spaced electrode sites to estimate the location of neural sources at between 25 µm and 107 µm below the DRG surface. We also used the high spatial sampling to demonstrate a possible spatial sensory map of one feline’s DRG. We obtained activation of sensory fibers with low-amplitude stimulation through individual or groups of GSEA electrode sites. Significance. Overall, the GSEA has been shown to provide a variety of information types from ganglia neurons and to have significant potential as a tool for neural mapping and interfacing.

  4. Pulmonary vein region ablation in experimental vagal atrial fibrillation: role of pulmonary veins versus autonomic ganglia.

    PubMed

    Lemola, Kristina; Chartier, Denis; Yeh, Yung-Hsin; Dubuc, Marc; Cartier, Raymond; Armour, Andrew; Ting, Michael; Sakabe, Masao; Shiroshita-Takeshita, Akiko; Comtois, Philippe; Nattel, Stanley

    2008-01-29

    Pulmonary vein (PV) -encircling radiofrequency ablation frequently is effective in vagal atrial fibrillation (AF), and there is evidence that PVs may be particularly prone to cholinergically induced arrhythmia mechanisms. However, PV ablation procedures also can affect intracardiac autonomic ganglia. The present study examined the relative role of PVs versus peri-PV autonomic ganglia in an experimental vagal AF model. Cholinergic AF was studied under carbachol infusion in coronary perfused canine left atrial PV preparations in vitro and with cervical vagal stimulation in vivo. Carbachol caused dose-dependent AF promotion in vitro, which was not affected by excision of all PVs. Sustained AF could be induced easily in all dogs during vagal nerve stimulation in vivo both before and after isolation of all PVs with encircling lesions created by a bipolar radiofrequency ablation clamp device. PV elimination had no effect on atrial effective refractory period or its responses to cholinergic stimulation. Autonomic ganglia were identified by bradycardic and/or tachycardic responses to high-frequency subthreshold local stimulation. Ablation of the autonomic ganglia overlying all PV ostia suppressed the effective refractory period-abbreviating and AF-promoting effects of cervical vagal stimulation, whereas ablation of only left- or right-sided PV ostial ganglia failed to suppress AF. Dominant-frequency analysis suggested that the success of ablation in suppressing vagal AF depended on the elimination of high-frequency driver regions. Intact PVs are not needed for maintenance of experimental cholinergic AF. Ablation of the autonomic ganglia at the base of the PVs suppresses vagal responses and may contribute to the effectiveness of PV-directed ablation procedures in vagal AF.

  5. Inverted Social Reward: Associations between Psychopathic Traits and Self-Report and Experimental Measures of Social Reward

    PubMed Central

    Foulkes, Lucy; McCrory, Eamon J.; Neumann, Craig S.; Viding, Essi

    2014-01-01

    Individuals with high levels of psychopathic traits tend to undervalue long-term, affiliative relationships, but it remains unclear what motivates them to engage in social interactions at all. Their experience of social reward may provide an important clue. In Study 1 of this paper, a large sample of participants (N = 505) completed a measure of psychopathic traits (Self-Report Psychopathy Scale Short-Form) and a measure of social reward value (Social Reward Questionnaire) to explore what aspects of social reward are associated with psychopathic traits. In Study 2 (N = 110), the same measures were administered to a new group of participants along with two experimental tasks investigating monetary and social reward value. Psychopathic traits were found to be positively correlated with the enjoyment of callous treatment of others and negatively associated with the enjoyment of positive social interactions. This indicates a pattern of ‘inverted’ social reward in which being cruel is enjoyable and being kind is not. Interpersonal psychopathic traits were also positively associated with the difference between mean reaction times (RTs) in the monetary and social experimental reward tasks; individuals with high levels of these traits responded comparatively faster to social than monetary reward. We speculate that this may be because social approval/admiration has particular value for these individuals, who have a tendency to use and manipulate others. Together, these studies provide evidence that the self-serving and cruel social behaviour seen in psychopathy may in part be explained by what these individuals find rewarding. PMID:25162519

  6. Incentive Mechanism for P2P Content Sharing over Heterogenous Access Networks

    NASA Astrophysics Data System (ADS)

    Sato, Kenichiro; Hashimoto, Ryo; Yoshino, Makoto; Shinkuma, Ryoichi; Takahashi, Tatsuro

    In peer-to-peer (P2P) content sharing, users can share their content by contributing their own resources to one another. However, since there is no incentive for contributing contents or resources to others, users may attempt to obtain content without any contribution. To motivate users to contribute their resources to the service, incentive-rewarding mechanisms have been proposed. On the other hand, emerging wireless technologies, such as IEEE 802.11 wireless local area networks, beyond third generation (B3G) cellular networks and mobile WiMAX, provide high-speed Internet access for wireless users. Using these high-speed wireless access, wireless users can use P2P services and share their content with other wireless users and with fixed users. However, this diversification of access networks makes it difficult to appropriately assign rewards to each user according to their contributions. This is because the cost necessary for contribution is different in different access networks. In this paper, we propose a novel incentive-rewarding mechanism called EMOTIVER that can assign rewards to users appropriately. The proposed mechanism uses an external evaluator and interactive learning agents. We also investigate a way of appropriately controlling rewards based on the system service's quality and managing policy.

  7. Distribution of herpes simplex virus types 1 and 2 genomes in human spinal ganglia studied by PCR and in situ hybridization.

    PubMed

    Obara, Y; Furuta, Y; Takasu, T; Suzuki, S; Suzuki, H; Matsukawa, S; Fujioka, Y; Takahashi, H; Kurata, T; Nagashima, K

    1997-06-01

    Clinical data indicate that the recurring herpes simplex virus (HSV) from oro-labial lesions is HSV subtype 1 and that the virus from genital lesions is HSV-2. This suggests that HSV-1 and HSV-2 reside in latent forms in the trigeminal ganglia and sacral ganglia, respectively. However, the distribution of latent HSV-1 and HSV-2 infections in human spinal ganglia has not been fully examined. This report concerns the application of polymerase chain reaction (PCR) and in situ hybridization (ISH) to such a study. By using PCR and employing the respective primers, HSV-1 and HSV-2 DNAs were detected in 207 of 524 samples from 262 spinal ganglia (from the cervical to the sacral ganglia) examined on both sides. The percentages of HSV-1 and HSV-2 detected in a given set of ganglia were similar, indicating an absence of site preference. By ISH, few but positive hybridization signals were detected evenly in sacral ganglia sections. The data suggest that regional specificity of recurrent HSV infections is not due to regional distribution of latent virus, but that local host factors may be important for recurrences.

  8. Mössbauer spectroscopy of Basal Ganglia

    NASA Astrophysics Data System (ADS)

    Miglierini, Marcel; Lančok, Adriana; Kopáni, Martin; Boča, Roman

    2014-10-01

    Chemical states, structural arrangement, and magnetic features of iron deposits in biological tissue of Basal Ganglia are characterized. The methods of SQUID magnetometry and electron microscopy are employed. 57Fe Mössbauer spectroscopy is used as a principal method of investigation. Though electron microscopy has unveiled robust crystals (1-3 μm in size) of iron oxides, they are not manifested in the corresponding 57Fe Mössbauer spectra. The latter were acquired at 300 K and 4.2 K and resemble ferritin-like behavior.

  9. Mössbauer spectroscopy of Basal Ganglia

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Miglierini, Marcel, E-mail: marcel.miglierini@stuba.sk; Lančok, Adriana; Kopáni, Martin

    2014-10-27

    Chemical states, structural arrangement, and magnetic features of iron deposits in biological tissue of Basal Ganglia are characterized. The methods of SQUID magnetometry and electron microscopy are employed. {sup 57}Fe Mössbauer spectroscopy is used as a principal method of investigation. Though electron microscopy has unveiled robust crystals (1-3 μm in size) of iron oxides, they are not manifested in the corresponding {sup 57}Fe Mössbauer spectra. The latter were acquired at 300 K and 4.2 K and resemble ferritin-like behavior.

  10. Characterization of herpes simplex virus type 2 latency-associated transcription in human sacral ganglia and in cell culture.

    PubMed

    Croen, K D; Ostrove, J M; Dragovic, L; Straus, S E

    1991-01-01

    The ability of herpes simplex virus type 2 (HSV-2) to establish latency in and reactivate from sacral dorsal root sensory ganglia is the basis for recurrent genital herpes. The expression of HSV-2 genes in latently infected human sacral ganglia was investigated by in situ hybridization. Hybridizations with a probe from the long repeat region of HSV-2 revealed strong nuclear signals overlying neurons in sacral ganglia from five of nine individuals. The RNA detected overlaps with the transcript for infected cell protein O but in the opposite, or "anti-sense," orientation. These observations mimic those made previously with HSV-1 in human trigeminal ganglia and confirm the recent findings during latency in HSV-2-infected mice and guinea pigs. Northern hybridization of RNA from infected Vero cells showed that an HSV-2 latency-associated transcript was similar in size to the larger (1.85 kb) latency transcript of HSV-1. Thus, HSV-1 and HSV-2 latency in human sensory ganglia are similar, if not identical, in terms of their cellular localization and pattern of transcription.

  11. Social comparison modulates reward-driven attentional capture.

    PubMed

    Jiao, Jun; Du, Feng; He, Xiaosong; Zhang, Kan

    2015-10-01

    It is well established that attention can be captured by task irrelevant and non-salient objects associated with value through reward learning. However, it is unknown whether social comparison influences reward-driven attentional capture. The present study created four social contexts to examine whether different social comparisons modulate the reward-driven capture of attention. The results showed that reward-driven attentional capture varied with different social comparison conditions. Most prominently, reward-driven attentional capture is dramatically reduced in the disadvantageous social comparison context, in which an individual is informed that the other participant is earning more monetary reward for performing the same task. These findings suggest that social comparison can affect the reward-driven capture of attention.

  12. Metabolic and reward feeding synchronises the rhythmic brain.

    PubMed

    Challet, Etienne; Mendoza, Jorge

    2010-07-01

    Daily brain rhythmicity, which controls the sleep-wake cycle and neuroendocrine functions, is generated by an endogenous circadian timing system. Within the multi-oscillatory circadian network, a master clock is located in the suprachiasmatic nuclei of the hypothalamus, whose main synchroniser (Zeitgeber) is light. In contrast, imposed meal times and temporally restricted feeding are potent synchronisers for secondary clocks in peripheral organs such as the liver and in brain regions, although not for the suprachiasmatic nuclei. Even when animals are exposed to a light-dark cycle, timed calorie restriction (i.e. when only a hypocaloric diet is given every day) is a synchroniser powerful enough to modify the suprachiasmatic clockwork and increase the synchronising effects of light. A daily chocolate snack in animals fed ad libitum with chow diet entrains the suprachiasmatic clockwork only under the conditions of constant darkness and decreases the synchronising effects of light. Secondary clocks in the brain outside the suprachiasmatic nuclei are differentially influenced by meal timing. Circadian oscillations can either be highly sensitive to food-related metabolic or reward cues (i.e. their phase is shifted according to the timed meal schedule) in some structures or hardly affected by meal timing (palatable or not) in others. Furthermore, animals will manifest food-anticipatory activity prior to their expected meal time. Anticipation of a palatable or regular meal may rely on a network of brain clocks, involving metabolic and reward systems and the cerebellum.

  13. Registered nurses' perceptions of rewarding and its significance.

    PubMed

    Seitovirta, Jaana; Lehtimäki, Aku-Ville; Vehviläinen-Julkunen, Katri; Mitronen, Lasse; Kvist, Tarja

    2017-11-07

    To examine reward type preferences and their relationships with the significance of rewarding perceived by registered nurses in Finland. Previous studies have found relationships between nurses' rewarding and their motivation at work, job satisfaction and organisational commitment. Data were collected in a cross-sectional, descriptive, questionnaire survey from 402 registered nurses using the Registered Nurses' Perceptions of Rewarding Scale in 2015, and analysed with descriptive and multivariate statistical methods. Registered nurses assigned slightly higher values to several non-financial than to financial rewards. The non-financial reward types appreciation and feedback from work community, worktime arrangements, work content, and opportunity to develop, influence and participate were highly related to the significance of rewarding. We identified various rewards that registered nurses value, and indications that providing an appropriate array of rewards, particularly non-financial rewards, is a highly beneficial element of nursing management. It is important to understand the value of rewards for nursing management. Nurse managers should offer diverse rewards to their registered nurses to promote excellent performance and to help efforts to secure and maintain high-quality, safe patient care. The use of appropriate rewards is especially crucial to improving registered nurses' reward satisfaction and job satisfaction globally in the nursing profession. © 2017 John Wiley & Sons Ltd.

  14. Led into Temptation? Rewarding Brand Logos Bias the Neural Encoding of Incidental Economic Decisions

    PubMed Central

    Murawski, Carsten; Harris, Philip G.; Bode, Stefan; Domínguez D., Juan F.; Egan, Gary F.

    2012-01-01

    Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI) study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness. PMID:22479547

  15. Measuring and Modeling the Interaction Among Reward Size, Delay to Reward, and Satiation Level on Motivation in Monkeys

    PubMed Central

    Minamimoto, Takafumi; La Camera, Giancarlo; Richmond, Barry J.

    2009-01-01

    Motivation is usually inferred from the likelihood or the intensity with which behavior is carried out. It is sensitive to external factors (e.g., the identity, amount, and timing of a rewarding outcome) and internal factors (e.g., hunger or thirst). We trained macaque monkeys to perform a nonchoice instrumental task (a sequential red-green color discrimination) while manipulating two external factors: reward size and delay-to-reward. We also inferred the state of one internal factor, level of satiation, by monitoring the accumulated reward. A visual cue indicated the forthcoming reward size and delay-to-reward in each trial. The fraction of trials completed correctly by the monkeys increased linearly with reward size and was hyperbolically discounted by delay-to-reward duration, relations that are similar to those found in free operant and choice tasks. The fraction of correct trials also decreased progressively as a function of the satiation level. Similar (albeit noiser) relations were obtained for reaction times. The combined effect of reward size, delay-to-reward, and satiation level on the proportion of correct trials is well described as a multiplication of the effects of the single factors when each factor is examined alone. These results provide a quantitative account of the interaction of external and internal factors on instrumental behavior, and allow us to extend the concept of subjective value of a rewarding outcome, usually confined to external factors, to account also for slow changes in the internal drive of the subject. PMID:18987119

  16. Pavlovian reward learning underlies value driven attentional capture.

    PubMed

    Bucker, Berno; Theeuwes, Jan

    2017-02-01

    Recent evidence shows that distractors that signal high compared to low reward availability elicit stronger attentional capture, even when this is detrimental for task-performance. This suggests that simply correlating stimuli with reward administration, rather than their instrumental relationship with obtaining reward, produces value-driven attentional capture. However, in previous studies, reward delivery was never response independent, as only correct responses were rewarded, nor was it completely task-irrelevant, as the distractor signaled the magnitude of reward that could be earned on that trial. In two experiments, we ensured that associative reward learning was completely response independent by letting participants perform a task at fixation, while high and low rewards were automatically administered following the presentation of task-irrelevant colored stimuli in the periphery (Experiment 1) or at fixation (Experiment 2). In a following non-reward test phase, using the additional singleton paradigm, the previously reward signaling stimuli were presented as distractors to assess truly task-irrelevant value driven attentional capture. The results showed that high compared to low reward-value associated distractors impaired performance, and thus captured attention more strongly. This suggests that genuine Pavlovian conditioning of stimulus-reward contingencies is sufficient to obtain value-driven attentional capture. Furthermore, value-driven attentional capture can occur following associative reward learning of temporally and spatially task-irrelevant distractors that signal the magnitude of available reward (Experiment 1), and is independent of training spatial shifts of attention towards the reward signaling stimuli (Experiment 2). This confirms and strengthens the idea that Pavlovian reward learning underlies value driven attentional capture.

  17. The endocannabinoid system in brain reward processes.

    PubMed

    Solinas, M; Goldberg, S R; Piomelli, D

    2008-05-01

    Food, drugs and brain stimulation can serve as strong rewarding stimuli and are all believed to activate common brain circuits that evolved in mammals to favour fitness and survival. For decades, endogenous dopaminergic and opioid systems have been considered the most important systems in mediating brain reward processes. Recent evidence suggests that the endogenous cannabinoid (endocannabinoid) system also has an important role in signalling of rewarding events. First, CB(1) receptors are found in brain areas involved in reward processes, such as the dopaminergic mesolimbic system. Second, activation of CB(1) receptors by plant-derived, synthetic or endogenous CB(1) receptor agonists stimulates dopaminergic neurotransmission, produces rewarding effects and increases rewarding effects of abused drugs and food. Third, pharmacological or genetic blockade of CB(1) receptors prevents activation of dopaminergic neurotransmission by several addictive drugs and reduces rewarding effects of food and these drugs. Fourth, brain levels of the endocannabinoids anandamide and 2-arachidonoylglycerol are altered by activation of reward processes. However, the intrinsic activity of the endocannabinoid system does not appear to play a facilitatory role in brain stimulation reward and some evidence suggests it may even oppose it. The influence of the endocannabinoid system on brain reward processes may depend on the degree of activation of the different brain areas involved and might represent a mechanism for fine-tuning dopaminergic activity. Although involvement of the various components of the endocannabinoid system may differ depending on the type of rewarding event investigated, this system appears to play a major role in modulating reward processes.

  18. Canceling actions involves a race between basal ganglia pathways

    PubMed Central

    Schmidt, Robert; Leventhal, Daniel K.; Mallet, Nicolas; Chen, Fujun; Berke, Joshua D.

    2013-01-01

    Salient cues can prompt the rapid interruption of planned actions. It has been proposed that fast, reactive behavioral inhibition involves specific basal ganglia pathways, and we tested this by comparing activity in multiple rat basal ganglia structures during performance of a stop-signal task. Subthalamic nucleus (STN) neurons showed low-latency responses to Stop cues, irrespective of whether actions were successfully canceled or not. By contrast, neurons downstream in the substantia nigra pars reticulata (SNr) responded to Stop cues only in trials with successful cancellation. Recordings and simulations together indicate that this sensorimotor gating arises from the relative timing of two distinct inputs to neurons in the SNr dorsolateral “core” subregion: cue-related excitation from STN and movement-related inhibition from striatum. Our results support race models of action cancellation, with successful stopping requiring Stop cue information to be transmitted from STN to SNr before increased striatal input creates a point of no return. PMID:23852117

  19. Basal Ganglia Calcification with Tetanic Seizure Suggest Mitochondrial Disorder.

    PubMed

    Finsterer, Josef; Enzelsberger, Barbara; Bastowansky, Adam

    2017-04-09

    BACKGROUND Basal ganglia calcification (BGC) is a rare sporadic or hereditary central nervous system (CNS) abnormality, characterized by symmetric or asymmetric calcification of the basal ganglia. CASE REPORT We report the case of a 65-year-old Gypsy female who was admitted for a tetanic seizure, and who had a history of polyneuropathy, restless-leg syndrome, retinopathy, diabetes, hyperlipidemia, osteoporosis with consecutive hyperkyphosis, cervicalgia, lumbalgia, struma nodosa requiring thyroidectomy and consecutive hypothyroidism, adipositas, resection of a vocal chord polyp, arterial hypertension, coronary heart disease, atheromatosis of the aorta, peripheral artery disease, chronic obstructive pulmonary disease, steatosis hepatis, mild renal insufficiency, long-term hypocalcemia, hyperphosphatemia, impingement syndrome, spondylarthrosis of the lumbar spine, and hysterectomy. History and clinical presentation suggested a mitochondrial defect which also manifested as hypoparathyroidism or Fanconi syndrome resulting in BGC. After substitution of calcium, no further tetanic seizures occurred. CONCLUSIONS Patients with BGC should be investigated for a mitochondrial disorder. A mitochondrial disorder may also manifest as tetanic seizure.

  20. Sonographic detection of basal ganglia abnormalities in spasmodic dysphonia.

    PubMed

    Walter, U; Blitzer, A; Benecke, R; Grossmann, A; Dressler, D

    2014-02-01

    Abnormalities of the lenticular nucleus (LN) on transcranial sonography (TCS) are a characteristic finding in idiopathic segmental and generalized dystonia. Our intention was to study whether TCS detects basal ganglia abnormalities also in spasmodic dysphonia, an extremely focal form of dystonia. Transcranial sonography of basal ganglia, substantia nigra and ventricles was performed in 14 patients with spasmodic dysphonia (10 women, four men; disease duration 16.5 ± 6.1 years) and 14 age- and sex-matched healthy controls in an investigator-blinded setting. Lenticular nucleus hyperechogenicity was found in 12 spasmodic dysphonia patients but only in one healthy individual (Fisher's exact test, P < 0.001) whilst other TCS findings did not differ. The area of LN hyperechogenic lesions quantified on digitized image analysis correlated with spasmodic dysphonia severity (Spearman test, r = 0.82, P < 0.001). Our findings link the underlying pathology of spasmodic dysphonia to that of more widespread forms of dystonia. © 2013 The Author(s) European Journal of Neurology © 2013 EFNS.

  1. Reward system dysfunction in autism spectrum disorders

    PubMed Central

    Schulte-Rüther, Martin; Nehrkorn, Barbara; Müller, Kristin; Fink, Gereon R.; Kamp-Becker, Inge; Herpertz-Dahlmann, Beate; Schultz, Robert T.; Konrad, Kerstin

    2013-01-01

    Although it has been suggested that social deficits of autism spectrum disorders (ASDs) are related to reward circuitry dysfunction, very little is known about the neural reward mechanisms in ASD. In the current functional magnetic resonance imaging study, we investigated brain activations in response to both social and monetary reward in a group of children with ASD, relative to matched controls. Participants with ASD showed the expected hypoactivation in the mesocorticolimbic circuitry in response to both reward types. In particular, diminished activation in the nucleus accumbens was observed when money, but not when social reward, was at stake, whereas the amygdala and anterior cingulate cortex were hypoactivated within the ASD group in response to both rewards. These data indicate that the reward circuitry is compromised in ASD in social as well as in non-social, i.e. monetary conditions, which likely contributes to atypical motivated behaviour. Taken together, with incentives used in this study sample, there is evidence for a general reward dysfunction in ASD. However, more ecologically valid social reward paradigms are needed to fully understand, whether there is any domain specificity to the reward deficit that appears evident in ASD, which would be most consistent with the ASD social phenotype. PMID:22419119

  2. Sex differences in the influence of body mass index on anatomical architecture of brain networks.

    PubMed

    Gupta, A; Mayer, E A; Hamadani, K; Bhatt, R; Fling, C; Alaverdyan, M; Torgerson, C; Ashe-McNalley, C; Van Horn, J D; Naliboff, B; Tillisch, K; Sanmiguel, C P; Labus, J S

    2017-08-01

    The brain has a central role in regulating ingestive behavior in obesity. Analogous to addiction behaviors, an imbalance in the processing of rewarding and salient stimuli results in maladaptive eating behaviors that override homeostatic needs. We performed network analysis based on graph theory to examine the association between body mass index (BMI) and network measures of integrity, information flow and global communication (centrality) in reward, salience and sensorimotor regions and to identify sex-related differences in these parameters. Structural and diffusion tensor imaging were obtained in a sample of 124 individuals (61 males and 63 females). Graph theory was applied to calculate anatomical network properties (centrality) for regions of the reward, salience and sensorimotor networks. General linear models with linear contrasts were performed to test for BMI and sex-related differences in measures of centrality, while controlling for age. In both males and females, individuals with high BMI (obese and overweight) had greater anatomical centrality (greater connectivity) of reward (putamen) and salience (anterior insula) network regions. Sex differences were observed both in individuals with normal and elevated BMI. In individuals with high BMI, females compared to males showed greater centrality in reward (amygdala, hippocampus and nucleus accumbens) and salience (anterior mid-cingulate cortex) regions, while males compared to females had greater centrality in reward (putamen) and sensorimotor (posterior insula) regions. In individuals with increased BMI, reward, salience and sensorimotor network regions are susceptible to topological restructuring in a sex-related manner. These findings highlight the influence of these regions on integrative processing of food-related stimuli and increased ingestive behavior in obesity, or in the influence of hedonic ingestion on brain topological restructuring. The observed sex differences emphasize the importance of

  3. Sex Differences in the Influence of Body Mass Index on Anatomical Architecture of Brain Networks

    PubMed Central

    Gupta, Arpana; Mayer, Emeran A.; Hamadani, Kareem; Bhatt, Ravi; Fling, Connor; Alaverdyan, Mher; Torgenson, Carinna; Ashe-McNalley, Cody; Van Horn, John D; Naliboff, Bruce; Tillisch, Kirsten; Sanmiguel, Claudia P.; Labus, Jennifer S.

    2017-01-01

    Background/Objective The brain plays a central role in regulating ingestive behavior in obesity. Analogous to addiction behaviors, an imbalance in the processing of rewarding and salient stimuli results in maladaptive eating behaviors that override homeostatic needs. We performed network analysis based on graph theory to examine the association between body mass index (BMI) and network measures of integrity, information flow, and global communication (centrality) in reward, salience and sensorimotor regions, and to identify sex-related differences in these parameters. Subjects/Methods Structural and diffusion tensor imaging were obtained in a sample of 124 individuals (61 males and 63 females). Graph theory was applied to calculate anatomical network properties (centrality) for regions of the reward, salience, and sensorimotor networks. General linear models with linear contrasts were performed to test for BMI and sex-related differences in measures of centrality, while controlling for age. Results In both males and females, individuals with high BMI (obese and overweight) had greater anatomical centrality (greater connectivity) of reward (putamen) and salience (anterior insula) network regions. Sex differences were observed both in individuals with normal and elevated BMI. In individuals with high BMI, females compared to males showed greater centrality in reward (amygdala, hippocampus, nucleus accumbens) and salience (anterior mid cingulate cortex) regions, while males compared to females had greater centrality in reward (putamen) and sensorimotor (posterior insula) regions. Conclusions In individuals with increased BMI, reward, salience, and sensorimotor network regions are susceptible to topological restructuring in a sex related manner. These findings highlight the influence of these regions on integrative processing of food-related stimuli and increased ingestive behavior in obesity, or in the influence of hedonic ingestion on brain topological restructuring

  4. Abnormal reward functioning across substance use disorders and major depressive disorder: Considering reward as a transdiagnostic mechanism.

    PubMed

    Baskin-Sommers, Arielle R; Foti, Dan

    2015-11-01

    A common criticism of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 2013) is that its criteria are based more on behavioral descriptions than on underlying biological mechanisms. Increasingly, calls have intensified for a more biologically-based approach to conceptualizing, studying, and treating psychological disorders, as exemplified by the Research Domain Criteria Project (RDoC). Among the most well-studied neurobiological mechanisms is reward processing. Moreover, individual differences in reward sensitivity are related to risk for substance abuse and depression. The current review synthesizes the available preclinical, electrophysiological, and neuroimaging literature on reward processing from a transdiagnostic, multidimensional perspective. Findings are organized with respect to key reward constructs within the Positive Valence Systems domain of the RDoC matrix, including initial responsiveness to reward (physiological 'liking'), approach motivation (physiological 'wanting'), and reward learning/habit formation. In the current review, we (a) describe the neural basis of reward, (b) elucidate differences in reward activity in substance abuse and depression, and (c) suggest a framework for integrating these disparate literatures and discuss the utility of shifting focus from diagnosis to process for understanding liability and co-morbidity. Ultimately, we believe that an integrative focus on abnormal reward functioning across the full continuum of clinically heterogeneous samples, rather than within circumscribed diagnostic categories, might actually help to refine the phenotypes and improve the prediction of onset and recovery of these disorders. Copyright © 2015 Elsevier B.V. All rights reserved.

  5. Reward Merit with Praise.

    ERIC Educational Resources Information Center

    Andrews, Hans A.

    1987-01-01

    Describes the efforts of two educational institutions to reward teaching excellence using positive feedback rather than merit pay incentives. An Arizona district, drawing on Herzberg's motivation theories, offers highly individualized rewards ranging from computers to conference money, while an Illinois community college bestows engraved plaques…

  6. Brain Stimulation Reward Supports More Consistent and Accurate Rodent Decision-Making than Food Reward.

    PubMed

    McMurray, Matthew S; Conway, Sineadh M; Roitman, Jamie D

    2017-01-01

    Animal models of decision-making rely on an animal's motivation to decide and its ability to detect differences among various alternatives. Food reinforcement, although commonly used, is associated with problematic confounds, especially satiety. Here, we examined the use of brain stimulation reward (BSR) as an alternative reinforcer in rodent models of decision-making and compared it with the effectiveness of sugar pellets. The discriminability of various BSR frequencies was compared to differing numbers of sugar pellets in separate free-choice tasks. We found that BSR was more discriminable and motivated greater task engagement and more consistent preference for the larger reward. We then investigated whether rats prefer BSR of varying frequencies over sugar pellets. We found that animals showed either a clear preference for sugar reward or no preference between reward modalities, depending on the frequency of the BSR alternative and the size of the sugar reward. Overall, these results suggest that BSR is an effective reinforcer in rodent decision-making tasks, removing food-related confounds and resulting in more accurate, consistent, and reliable metrics of choice.

  7. “Liking” and “Wanting” Linked to Reward Deficiency Syndrome (RDS): Hypothesizing Differential Responsivity in Brain Reward Circuitry

    PubMed Central

    Blum, Kenneth; Gardner, Eliot; Oscar-Berman, Marlene; Gold, Mark

    2013-01-01

    In an attempt to resolve controversy regarding the causal contributions of mesolimbic dopamine (DA) systems to reward, we evaluate the three main competing explanatory categories: “liking,” “learning,” and “wanting” [1]. That is, DA may mediate (a) the hedonic impact of reward (liking), (b) learned predictions about rewarding effects (learning), or (c) the pursuit of rewards by attributing incentive salience to reward-related stimuli (wanting). We evaluate these hypotheses, especially as they relate to the Reward Deficiency Syndrome (RDS), and we find that the incentive salience or “wanting” hypothesis of DA function is supported by a majority of the evidence. Neuroimaging studies have shown that drugs of abuse, palatable foods, and anticipated behaviors such as sex and gaming affect brain regions involving reward circuitry, and may not be unidirectional. Drugs of abuse enhance DA signaling and sensitize mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Addictive drugs have in common that they are voluntarily self-administered, they enhance (directly or indirectly) dopaminergic synaptic function in the nucleus accumbens, and they stimulate the functioning of brain reward circuitry (producing the “high” that drug users seek). Although originally believed simply to encode the set point of hedonic tone, these circuits now are believed to be functionally more complex, also encoding attention, reward expectancy, disconfirmation of reward expectancy, and incentive motivation. Elevated stress levels, together with polymorphisms of dopaminergic genes and other neurotransmitter genetic variants, may have a cumulative effect on vulnerability to addiction. The RDS model of etiology holds very well for a variety of chemical and behavioral addictions. PMID:22236117

  8. Reward Industry for Innovative Outcomes

    DTIC Science & Technology

    2015-08-01

    Defense AT&L: July–August 2015 34 Reward Industry for Innovative Outcomes RADM Allie Coetzee, USN Coetzee is Acting Director of Defense Procurement...away from the “best efforts” default and toward rational use of other techniques. Rather than reward compa- nies with contracts and funds to pursue...concepts advanced on paper in proposals, the DoD desires to reward companies that deliver demonstrable results through early prototypes that can be

  9. The inhibitory microcircuit of the substantia nigra provides feedback gain control of the basal ganglia output.

    PubMed

    Brown, Jennifer; Pan, Wei-Xing; Dudman, Joshua Tate

    2014-05-21

    Dysfunction of the basal ganglia produces severe deficits in the timing, initiation, and vigor of movement. These diverse impairments suggest a control system gone awry. In engineered systems, feedback is critical for control. By contrast, models of the basal ganglia highlight feedforward circuitry and ignore intrinsic feedback circuits. In this study, we show that feedback via axon collaterals of substantia nigra projection neurons control the gain of the basal ganglia output. Through a combination of physiology, optogenetics, anatomy, and circuit mapping, we elaborate a general circuit mechanism for gain control in a microcircuit lacking interneurons. Our data suggest that diverse tonic firing rates, weak unitary connections and a spatially diffuse collateral circuit with distinct topography and kinetics from feedforward input is sufficient to implement divisive feedback inhibition. The importance of feedback for engineered systems implies that the intranigral microcircuit, despite its absence from canonical models, could be essential to basal ganglia function. DOI: http://dx.doi.org/10.7554/eLife.02397.001. Copyright © 2014, Brown et al.

  10. TNFα Levels and Macrophages Expression Reflect an Inflammatory Potential of Trigeminal Ganglia in a Mouse Model of Familial Hemiplegic Migraine

    PubMed Central

    Franceschini, Alessia; Vilotti, Sandra; Ferrari, Michel D.; van den Maagdenberg, Arn M. J. M.; Nistri, Andrea; Fabbretti, Elsa

    2013-01-01

    Latent changes in trigeminal ganglion structure and function resembling inflammatory conditions may predispose to acute attacks of migraine pain. Here, we investigated whether, in trigeminal sensory ganglia, cytokines such as TNFα might contribute to a local inflammatory phenotype of a transgenic knock-in (KI) mouse model of familial hemiplegic migraine type-1 (FHM-1). To this end, macrophage occurrence and cytokine expression in trigeminal ganglia were compared between wild type (WT) and R192Q mutant CaV2.1 Ca2+ channel (R192Q KI) mice, a genetic model of FHM-1. Cellular and molecular characterization was performed using a combination of confocal immunohistochemistry and cytokine assays. With respect to WT, R192Q KI trigeminal ganglia were enriched in activated macrophages as suggested by their morphology and immunoreactivity to the markers Iba1, CD11b, and ED1. R192Q KI trigeminal ganglia constitutively expressed higher mRNA levels of IL1β, IL6, IL10 and TNFα cytokines and the MCP-1 chemokine. Consistent with the report that TNFα is a major factor to sensitize trigeminal ganglia, we observed that, following an inflammatory reaction evoked by LPS injection, TNFα expression and macrophage occurrence were significantly higher in R192Q KI ganglia with respect to WT ganglia. Our data suggest that, in KI trigeminal ganglia, the complex cellular and molecular environment could support a new tissue phenotype compatible with a neuroinflammatory profile. We propose that, in FHM patients, this condition might contribute to trigeminal pain pathophysiology through release of soluble mediators, including TNFα, that may modulate the crosstalk between sensory neurons and resident glia, underlying the process of neuronal sensitisation. PMID:23326332

  11. Noradrenergic modulation of risk/reward decision making.

    PubMed

    Montes, David R; Stopper, Colin M; Floresco, Stan B

    2015-08-01

    Catecholamine transmission modulates numerous cognitive and reward-related processes that can subserve more complex functions such as cost/benefit decision making. Dopamine has been shown to play an integral role in decisions involving reward uncertainty, yet there is a paucity of research investigating the contributions of noradrenaline (NA) transmission to these functions. The present study was designed to elucidate the contribution of NA to risk/reward decision making in rats, assessed with a probabilistic discounting task. We examined the effects of reducing noradrenergic transmission with the α2 agonist clonidine (10-100 μg/kg), and increasing activity at α2A receptor sites with the agonist guanfacine (0.1-1 mg/kg), the α2 antagonist yohimbine (1-3 mg/kg), and the noradrenaline transporter (NET) inhibitor atomoxetine (0.3-3 mg/kg) on probabilistic discounting. Rats chose between a small/certain reward and a larger/risky reward, wherein the probability of obtaining the larger reward either decreased (100-12.5 %) or increased (12.5-100 %) over a session. In well-trained rats, clonidine reduced risky choice by decreasing reward sensitivity, whereas guanfacine did not affect choice behavior. Yohimbine impaired adjustments in decision biases as reward probability changed within a session by altering negative feedback sensitivity. In a subset of rats that displayed prominent discounting of probabilistic rewards, the lowest dose of atomoxetine increased preference for the large/risky reward when this option had greater long-term utility. These data highlight an important and previously uncharacterized role for noradrenergic transmission in mediating different aspects of risk/reward decision making and mediating reward and negative feedback sensitivity.

  12. MR-DTI and PET multimodal imaging of dopamine release within subdivisions of basal ganglia

    NASA Astrophysics Data System (ADS)

    Tziortzi, A.; Searle, G.; Tsoumpas, C.; Long, C.; Shotbolt, P.; Rabiner, E.; Jenkinson, M.; Gunn, R. N.

    2011-09-01

    The basal ganglia is a group of anatomical nuclei, functionally organised into limbic, associative and sensorimotor regions, which plays a central role in dopamine related neurological and psychiatric disorders. In this study, we combine two imaging modalities to enable the measurement of dopamine release in functionally related subdivisions of the basal ganglia. [11C]-(+)-PHNO Positron Emission Tomography (PET) measurements in the living human brain pre- and post-administration of amphetamine allow for the estimation of regional dopamine release. Combined Magnetic Resonance Diffusion Tensor Imaging (MR-DTI) data allows for the definition of functional territories of the basal ganglia from connectivity information. The results suggest that there is a difference in dopamine release among the connectivity derived functional subdivisions. Dopamine release is highest in the limbic area followed by the sensorimotor and then the associative area with this pattern reflected in both striatum and pallidum.

  13. Effect of mCOUP-TF1 deficiency on the glossopharyngeal and vagal sensory ganglia.

    PubMed

    Ichikawa, H; Lin, S-C; Tsai, S Y; Tsai, M-J; Sugimoto, T

    2004-07-16

    Immunohistochemistry for calcitonin gene-related peptide (CGRP), tyrosine hydroxylase and calbindin D-28k was performed on the glossopharyngeal and vagal ganglia in mCOUP-TFI knockout mice to know the effect of its deficiency on different types of primary sensory neurons. In wild type and heterozygous mice, the glossopharyngeal and vagal ganglia contained abundant CGRP-, tyrosine hydroxylase- and calbindin D-28k-immunoreactive (IR) neurons. In the ganglia of mCOUP-TFI knockout mice, a 38% decrease of CGRP-IR neurons was detected. However, the number of tyrosine hydroxylase- or calbindin D-28k-neurons was not altered by the mCOUP-TFI deficiency. In the tongue of knockout mice, the number of CGRP-IR nerve fibers decreased compared to wild-type and heterozygous mice. The development of CGRP-IR petrosal neurons, which supply innervation of the tongue, may depend on mCOUP-TFI.

  14. Neuroanatomical correlates of intelligence in healthy young adults: the role of basal ganglia volume.

    PubMed

    Rhein, Cosima; Mühle, Christiane; Richter-Schmidinger, Tanja; Alexopoulos, Panagiotis; Doerfler, Arnd; Kornhuber, Johannes

    2014-01-01

    In neuropsychiatric diseases with basal ganglia involvement, higher cognitive functions are often impaired. In this exploratory study, we examined healthy young adults to gain detailed insight into the relationship between basal ganglia volume and cognitive abilities under non-pathological conditions. We investigated 137 healthy adults that were between the ages of 21 and 35 years with similar educational backgrounds. Magnetic resonance imaging (MRI) was performed, and volumes of basal ganglia nuclei in both hemispheres were calculated using FreeSurfer software. The cognitive assessment consisted of verbal, numeric and figural aspects of intelligence for either the fluid or the crystallised intelligence factor using the intelligence test Intelligenz-Struktur-Test (I-S-T 2000 R). Our data revealed significant correlations of the caudate nucleus and pallidum volumes with figural and numeric aspects of intelligence, but not with verbal intelligence. Interestingly, figural intelligence associations were dependent on sex and intelligence factor; in females, the pallidum volumes were correlated with crystallised figural intelligence (r = 0.372, p = 0.01), whereas in males, the caudate volumes were correlated with fluid figural intelligence (r = 0.507, p = 0.01). Numeric intelligence was correlated with right-lateralised caudate nucleus volumes for both females and males, but only for crystallised intelligence (r = 0.306, p = 0.04 and r = 0.459, p = 0.04, respectively). The associations were not mediated by prefrontal cortical subfield volumes when controlling with partial correlation analyses. The findings of our exploratory analysis indicate that figural and numeric intelligence aspects, but not verbal aspects, are strongly associated with basal ganglia volumes. Unlike numeric intelligence, the type of figural intelligence appears to be related to distinct basal ganglia nuclei in a sex-specific manner. Subcortical brain structures thus may contribute substantially to

  15. Neuroanatomical Correlates of Intelligence in Healthy Young Adults: The Role of Basal Ganglia Volume

    PubMed Central

    Rhein, Cosima; Mühle, Christiane; Richter-Schmidinger, Tanja; Alexopoulos, Panagiotis; Doerfler, Arnd; Kornhuber, Johannes

    2014-01-01

    Background In neuropsychiatric diseases with basal ganglia involvement, higher cognitive functions are often impaired. In this exploratory study, we examined healthy young adults to gain detailed insight into the relationship between basal ganglia volume and cognitive abilities under non-pathological conditions. Methodology/Principal Findings We investigated 137 healthy adults that were between the ages of 21 and 35 years with similar educational backgrounds. Magnetic resonance imaging (MRI) was performed, and volumes of basal ganglia nuclei in both hemispheres were calculated using FreeSurfer software. The cognitive assessment consisted of verbal, numeric and figural aspects of intelligence for either the fluid or the crystallised intelligence factor using the intelligence test Intelligenz-Struktur-Test (I-S-T 2000 R). Our data revealed significant correlations of the caudate nucleus and pallidum volumes with figural and numeric aspects of intelligence, but not with verbal intelligence. Interestingly, figural intelligence associations were dependent on sex and intelligence factor; in females, the pallidum volumes were correlated with crystallised figural intelligence (r = 0.372, p = 0.01), whereas in males, the caudate volumes were correlated with fluid figural intelligence (r = 0.507, p = 0.01). Numeric intelligence was correlated with right-lateralised caudate nucleus volumes for both females and males, but only for crystallised intelligence (r = 0.306, p = 0.04 and r = 0.459, p = 0.04, respectively). The associations were not mediated by prefrontal cortical subfield volumes when controlling with partial correlation analyses. Conclusions/Significance The findings of our exploratory analysis indicate that figural and numeric intelligence aspects, but not verbal aspects, are strongly associated with basal ganglia volumes. Unlike numeric intelligence, the type of figural intelligence appears to be related to distinct basal ganglia

  16. Adolescent Depression: Stress and Reward Dysfunction

    PubMed Central

    Auerbach, Randy P.; Admon, Roee; Pizzagalli, Diego A.

    2014-01-01

    Adolescence is a peak period for the onset of depression, and it is also a time marked by substantial stress as well as neural development within the brain reward circuitry. In the current review, we provide a selective overview of current animal and human research investigating the relationship among reward processes, stress, and depression. Three separate, but related, etiological models examine the differential roles that stress may play with regard to reward dysfunction and adolescent depression. First, the reward mediation model suggests that acute and chronic stress contribute to reward deficits, which in turn, potentiate depressive symptoms and/or increase the risk for depression. Second, in line with the stress generation perspective, it is plausible that premorbid reward-related dysfunction generates stress, in particular interpersonal stress, which then leads to the manifestation of depressive symptoms. Last, consistent with a diathesis-stress model, the interaction between stress and premorbid reward dysfunction may contribute to the onset of depression. Given the equifinal nature of depression, these models could shed important light on different etiological pathways during adolescence, particularly as they may relate to understanding the heterogeneity of depression. To highlight the translational potential of these insights, a hypothetical case study is provided as means of demonstrating the importance of targeting reward dysfunction in both assessment and treatment of adolescent depression. PMID:24704785

  17. Abnormal Reward System Activation in Mania

    PubMed Central

    Abler, Birgit; Greenhouse, Ian; Ongur, Dost; Walter, Henrik; Heckers, Stephan

    2008-01-01

    Transmission of reward signals is a function of dopamine, a neurotransmitter known to be involved in the mechanism of psychosis. Using functional magnetic resonance imaging (fMRI), we investigated how expectation and receipt of monetary rewards modulate brain activation in patients with bipolar mania and schizophrenia. We studied 12 acutely manic patients with a history of bipolar disorder, 12 patients with a current episode of schizoaffective disorder or schizophrenia and 12 healthy subjects. All patients were treated with dopamine antagonists at the time of the study. Subjects performed a delayed incentive paradigm with monetary reward in the scanner that allowed for investigating effects of expectation, receipt, and omission of rewards. Patients with schizophrenia and healthy control subjects showed the expected activation of dopaminergic brain areas, that is, ventral tegmentum activation upon expectation of monetary rewards and nucleus accumbens activation during receipt vs omission of rewards. In manic patients, however, we did not find a similar pattern of brain activation and the differential signal in the nucleus accumbens upon receipt vs omission of rewards was significantly lower compared to the healthy control subjects. Our findings provide evidence for abnormal function of the dopamine system during receipt or omission of expected rewards in bipolar disorder. These deficits in prediction error processing in acute mania may help to explain symptoms of disinhibition and abnormal goal pursuit regulation. PMID:17987058

  18. Differences in neurokinin receptor pharmacology between rat and guinea-pig superior cervical ganglia.

    PubMed

    Seabrook, G R; Main, M; Bowery, B; Wood, N; Hill, R G

    1992-04-01

    1. The depolarizations elicited by seven neurokinin receptor agonists were examined in both rat and guinea-pig superior cervical ganglia by use of grease-gap methodology in the presence of tetrodotoxin (0.1 microM). Responses were normalised with respect to 1 microM eledoisin. 2. The rank order of agonist potency in the rat ganglia was senktide greater than substance P greater than substance P methyl ester = eleidosin = Sar-Met-substance P greater than neurokinin B greater than neurokinin A, whereas in guinea-pig superior cervical ganglion (SCG) the rank order was senktide greater than Sar-Met-substance P greater than neurokinin B = eledoisin = substance P methyl ester. The concentration-effect curves for substance P and neurokinin A in guinea-pig ganglia were biphasic which precluded the determination of meaningful potency values. 3. The maximal depolarization achieved by subtype selective ligands was different between these two species. On rat and guinea-pig SCG, the NK3-selective ligand, senktide, produced a maximal depolarization of 27% and 274% respectively, whereas the NK1-selective ligand, substance P methyl ester, produced depolarizations of 77% and 64% respectively. 4. The depolarizations induced by substance P methyl ester and senktide in either species were unaffected by atropine (1 microM), suggesting a lack of involvement of presynaptic neurokinin receptors in the generation of the response. 5. The potency of substance P methyl ester, senktide, and neurokinin A were unaffected by pretreating ganglia with the peptidase inhibitors bacitracin (40 micrograms ml-1), leupeptin (4 micrograms ml-1), and chymostatin (2 micrograms ml-1). Similarly, these peptidase inhibitors had no effect on the maximal depolarizations achieved by any of these agonists.6. It is evident that rat and guinea-pig superior cervical ganglia possess both NK, and NK3 receptors, but that their net contribution to depolarizations are different between the two species. The depolarizations

  19. Rewarding the Resident Teacher

    ERIC Educational Resources Information Center

    McBride, Jennifer M.; Drake, Richard L.

    2011-01-01

    Residents routinely make significant contributions to the education of medical students. However, little attention has been paid to rewarding these individuals for their involvement in these academic activities. This report describes a program that rewards resident teachers with an academic appointment as a Clinical Instructor. The residents…

  20. Feedback associated with expectation for larger-reward improves visuospatial working memory performances in children with ADHD.

    PubMed

    Hammer, Rubi; Tennekoon, Michael; Cooke, Gillian E; Gayda, Jessica; Stein, Mark A; Booth, James R

    2015-08-01

    We tested the interactive effect of feedback and reward on visuospatial working memory in children with ADHD. Seventeen boys with ADHD and 17 Normal Control (NC) boys underwent functional magnetic resonance imaging (fMRI) while performing four visuospatial 2-back tasks that required monitoring the spatial location of letters presented on a display. Tasks varied in reward size (large; small) and feedback availability (no-feedback; feedback). While the performance of NC boys was high in all conditions, boys with ADHD exhibited higher performance (similar to those of NC boys) only when they received feedback associated with large-reward. Performance pattern in both groups was mirrored by neural activity in an executive function neural network comprised of few distinct frontal brain regions. Specifically, neural activity in the left and right middle frontal gyri of boys with ADHD became normal-like only when feedback was available, mainly when feedback was associated with large-reward. When feedback was associated with small-reward, or when large-reward was expected but feedback was not available, boys with ADHD exhibited altered neural activity in the medial orbitofrontal cortex and anterior insula. This suggests that contextual support normalizes activity in executive brain regions in children with ADHD, which results in improved working memory. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

  1. Acute stress selectively reduces reward sensitivity

    PubMed Central

    Berghorst, Lisa H.; Bogdan, Ryan; Frank, Michael J.; Pizzagalli, Diego A.

    2013-01-01

    Stress may promote the onset of psychopathology by disrupting reward processing. However, the extent to which stress impairs reward processing, rather than incentive processing more generally, is unclear. To evaluate the specificity of stress-induced reward processing disruption, 100 psychiatrically healthy females were administered a probabilistic stimulus selection task (PSST) that enabled comparison of sensitivity to reward-driven (Go) and punishment-driven (NoGo) learning under either “no stress” or “stress” (threat-of-shock) conditions. Cortisol samples and self-report measures were collected. Contrary to hypotheses, the groups did not differ significantly in task performance or cortisol reactivity. However, further analyses focusing only on individuals under “stress” who were high responders with regard to both cortisol reactivity and self-reported negative affect revealed reduced reward sensitivity relative to individuals tested in the “no stress” condition; importantly, these deficits were reward-specific. Overall, findings provide preliminary evidence that stress-reactive individuals show diminished sensitivity to reward, but not punishment, under stress. While such results highlight the possibility that stress-induced anhedonia might be an important mechanism linking stress to affective disorders, future studies are necessary to confirm this conjecture. PMID:23596406

  2. A test of the reward-value hypothesis.

    PubMed

    Smith, Alexandra E; Dalecki, Stefan J; Crystal, Jonathon D

    2017-03-01

    Rats retain source memory (memory for the origin of information) over a retention interval of at least 1 week, whereas their spatial working memory (radial maze locations) decays within approximately 1 day. We have argued that different forgetting functions dissociate memory systems. However, the two tasks, in our previous work, used different reward values. The source memory task used multiple pellets of a preferred food flavor (chocolate), whereas the spatial working memory task provided access to a single pellet of standard chow-flavored food at each location. Thus, according to the reward-value hypothesis, enhanced performance in the source memory task stems from enhanced encoding/memory of a preferred reward. We tested the reward-value hypothesis by using a standard 8-arm radial maze task to compare spatial working memory accuracy of rats rewarded with either multiple chocolate or chow pellets at each location using a between-subjects design. The reward-value hypothesis predicts superior accuracy for high-valued rewards. We documented equivalent spatial memory accuracy for high- and low-value rewards. Importantly, a 24-h retention interval produced equivalent spatial working memory accuracy for both flavors. These data are inconsistent with the reward-value hypothesis and suggest that reward value does not explain our earlier findings that source memory survives unusually long retention intervals.

  3. Reward inference by primate prefrontal and striatal neurons.

    PubMed

    Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru; Sakagami, Masamichi

    2014-01-22

    The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus-reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning.

  4. Reward Inference by Primate Prefrontal and Striatal Neurons

    PubMed Central

    Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru

    2014-01-01

    The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus–reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning. PMID:24453328

  5. Smile! Social reward drives attention.

    PubMed

    Hayward, Dana A; Pereira, Effie J; Otto, A Ross; Ristic, Jelena

    2018-02-01

    Human social behavior is fine-tuned by interactions between individuals and their environments. Here we show that social motivation plays an important role in this process. Using a novel manipulation of social reward that included elements of real-life social exchanges, we demonstrate the emergence of attentional orienting for coincidental spatial associations that received positive social reward. After an interaction with the experimenter, participants completed a computerized task in which they received positive, negative, or no social reward for their performance to spatially congruent, spatially incongruent, and neutral cue-target pairings, respectively. Even though cue-target spatial correspondences remained at chance, attentional benefits emerged and persisted a day later for targets that received positive social reward. Our data further revealed that participants' level of social competence, as measured by the Autism-Spectrum Quotient scale, was predictably related to the magnitude of their reward-driven attentional benefits. No attentional effects emerged when the social interaction and social reward manipulations were removed. These results show that motivational incentives available during social exchanges affect later individual cognitive functioning, providing one of the first insights into why seemingly ambiguous social signals produce reliable and persistent attentional effects. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

  6. Reward Anticipation in Ventral Striatum and Individual Sensitivity to Reward: A Pilot Study of a Child-Friendly fMRI Task.

    PubMed

    van Hulst, Branko M; de Zeeuw, Patrick; Lupas, Kellina; Bos, Dienke J; Neggers, Sebastiaan F W; Durston, Sarah

    2015-01-01

    Reward processing has been implicated in developmental disorders. However, the classic task to probe reward anticipation, the monetary incentive delay task, has an abstract coding of reward and no storyline and may therefore be less appropriate for use with developmental populations. We modified the task to create a version appropriate for use with children. We investigated whether this child-friendly version could elicit ventral striatal activation during reward anticipation in typically developing children and young adolescents (aged 9.5-14.5). In addition, we tested whether our performance-based measure of reward sensitivity was associated with anticipatory activity in ventral striatum. Reward anticipation was related to activity in bilateral ventral striatum. Moreover, we found an association between individual reward sensitivity and activity in ventral striatum. We conclude that this task assesses ventral striatal activity in a child-friendly paradigm. The combination with a performance-based measure of reward sensitivity potentially makes the task a powerful tool for developmental imaging studies of reward processing.

  7. The Function of Verbal Rewards in the Science Classroom.

    ERIC Educational Resources Information Center

    Lawlor, Francis Xavier

    Contained is a review of the research done on the use of verbal rewards in the classroom. Some verbal rewards are tasks rewards, other rewards are more personal; and still other verbal rewards are impersonal. Verbal rewards, therefore, have both intellectual and emotional implications. Research literature indicates that "verbal reward"…

  8. Remodeling of Dendritic Spines in the Avian Vocal Motor Cortex Following Deafening Depends on the Basal Ganglia Circuit.

    PubMed

    Zhou, Xin; Fu, Xin; Lin, Chun; Zhou, Xiaojuan; Liu, Jin; Wang, Li; Zhang, Xinwen; Zuo, Mingxue; Fan, Xiaolong; Li, Dapeng; Sun, Yingyu

    2017-05-01

    Deafening elicits a deterioration of learned vocalization, in both humans and songbirds. In songbirds, learned vocal plasticity has been shown to depend on the basal ganglia-cortical circuit, but the underlying cellular basis remains to be clarified. Using confocal imaging and electron microscopy, we examined the effect of deafening on dendritic spines in avian vocal motor cortex, the robust nucleus of the arcopallium (RA), and investigated the role of the basal ganglia circuit in motor cortex plasticity. We found rapid structural changes to RA dendritic spines in response to hearing loss, accompanied by learned song degradation. In particular, the morphological characters of RA spine synaptic contacts between 2 major pathways were altered differently. However, experimental disruption of the basal ganglia circuit, through lesions in song-specialized basal ganglia nucleus Area X, largely prevented both the observed changes to RA dendritic spines and the song deterioration after hearing loss. Our results provide cellular evidence to highlight a key role of the basal ganglia circuit in the motor cortical plasticity that underlies learned vocal plasticity. © The Author 2016. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

  9. Extinction and renewal of cue-elicited reward-seeking.

    PubMed

    Bezzina, Louise; Lee, Jessica C; Lovibond, Peter F; Colagiuri, Ben

    2016-12-01

    Reward cues can contribute to overconsumption of food and drugs and can relapse. The failure of exposure therapies to reduce overconsumption and relapse is generally attributed to the context-specificity of extinction. However, no previous study has examined whether cue-elicited reward-seeking (as opposed to cue-reactivity) is sensitive to context renewal. We tested this possibility in 160 healthy volunteers using a Pavlovian-instrumental transfer (PIT) design involving voluntary responding for a high value natural reward (chocolate). One reward cue underwent Pavlovian extinction in the same (Group AAA) or different context (Group ABA) to all other phases. This cue was compared with a second non-extinguished reward cue and an unpaired control cue. There was a significant overall PIT effect with both reward cues eliciting reward-seeking on test relative to the unpaired cue. Pavlovian extinction substantially reduced this effect, with the extinguished reward cue eliciting less reward-seeking than the non-extinguished reward cue. Most interestingly, extinction of cue-elicited reward-seeking was sensitive to renewal, with extinction less effective for reducing PIT when conducted in a different context. These findings have important implications for extinction-based interventions for reducing maladaptive reward-seeking in practice. Copyright © 2016 Elsevier Ltd. All rights reserved.

  10. Preventive Role of Hilar Parasympathetic Ganglia on Pulmonary Artery Vasospasm in Subarachnoid Hemorrhage: An Experimental Study.

    PubMed

    Araz, Omer; Aydin, Mehmet Dumlu; Gundogdu, Betul; Altas, Ender; Cakir, Murteza; Calikoglu, Cagatay; Atalay, Canan; Gundogdu, Cemal

    2015-01-01

    Pulmonary arteries are mainly innervated by sympathetic vasoconstrictor and parasympathetic vasodilatory fibers. We examined whether there is a relationship between the neuron densities of hilar parasympathetic ganglia and pulmonary vasospasm in subarachnoid hemorrhage (SAH). Twenty-four rabbits were divided into two groups: control (n=8) and SAH (n=16). The animals were observed for 20 days following experimental SAH. The number of hilar parasympathetic ganglia and their neuron densities were determined. Proportion of pulmonary artery ring surface to lumen surface values was accepted as vasospasm index (VSI). Neuron densities of the hilar ganglia and VSI values were compared statistically. Animals in the SAH group experienced either mild (n=6) or severe (n=10) pulmonary artery vasospasm. In the control group, the mean VSI of pulmonary arteries was 0.777±0.048 and the hilar ganglion neuron density was estimated as 12.100±2.010/mm < sup > 3 < /sup > . In SAH animals with mild vasospasm, VSI=1.148±0.090 and neuron density was estimated as 10.110±1.430/mm < sup > 3 < /sup > ; in animals with severe vasospasm, VSI=1.500±0.120 and neuron density was estimated as 7.340±990/mm < sup > 3 < /sup > . There was an inverse correlation between quantity and neuron density of hilar ganglia and vasospasm index value. The low numbers and low density of hilar parasympathetic ganglia may be responsible for the more severe artery vasospasm in SAH.

  11. Reward modulates oculomotor competition between differently valued stimuli.

    PubMed

    Bucker, Berno; Silvis, Jeroen D; Donk, Mieke; Theeuwes, Jan

    2015-03-01

    The present work explored the effects of reward in the well-known global effect paradigm in which two objects appear simultaneously in close spatial proximity. The experiment consisted of three phases (i) a pre-training phase that served as a baseline, (ii) a reward-training phase to associate differently colored stimuli with high, low and no reward value, and (iii) a post-training phase in which rewards were no longer delivered, to examine whether objects previously associated with higher reward value attracted the eyes more strongly than those associated with low or no reward value. Unlike previous reward studies, the differently valued objects directly competed with each other on the same trial. The results showed that initially eye movements were not biased towards any particular stimulus, while in the reward-training phase, eye movements started to land progressively closer towards stimuli that were associated with a high reward value. Even though rewards were no longer delivered, this bias remained robustly present in the post-training phase. A time course analysis showed that the effect of reward was present for the fastest saccades (around 170 ms) and increased with increasing latency. Although strategic effects for slower saccades cannot be ruled out, we suggest that fast oculomotor responses became habituated and were no longer under strategic attentional control. Together the results imply that reward affects oculomotor competition in favor of stimuli previously associated high reward, when multiple reward associated objects compete for selection. Copyright © 2015 Elsevier Ltd. All rights reserved.

  12. Reward, Distraction, and the Overjustification Effect

    ERIC Educational Resources Information Center

    Smith, Timothy W.; Pittman, Thane S.

    1978-01-01

    This study tests two differing hypotheses: the competing response hypothesis, which states that both reward and non-reward distractions produce decreases in interest which weaken over repeated trials, and the attribution/overjustification hypothesis, which maintains that rewards produce a decrease in interest that does not weaken over trials.…

  13. Working Memory Load Strengthens Reward Prediction Errors.

    PubMed

    Collins, Anne G E; Ciullo, Brittany; Frank, Michael J; Badre, David

    2017-04-19

    Reinforcement learning (RL) in simple instrumental tasks is usually modeled as a monolithic process in which reward prediction errors (RPEs) are used to update expected values of choice options. This modeling ignores the different contributions of different memory and decision-making systems thought to contribute even to simple learning. In an fMRI experiment, we investigated how working memory (WM) and incremental RL processes interact to guide human learning. WM load was manipulated by varying the number of stimuli to be learned across blocks. Behavioral results and computational modeling confirmed that learning was best explained as a mixture of two mechanisms: a fast, capacity-limited, and delay-sensitive WM process together with slower RL. Model-based analysis of fMRI data showed that striatum and lateral prefrontal cortex were sensitive to RPE, as shown previously, but, critically, these signals were reduced when the learning problem was within capacity of WM. The degree of this neural interaction related to individual differences in the use of WM to guide behavioral learning. These results indicate that the two systems do not process information independently, but rather interact during learning. SIGNIFICANCE STATEMENT Reinforcement learning (RL) theory has been remarkably productive at improving our understanding of instrumental learning as well as dopaminergic and striatal network function across many mammalian species. However, this neural network is only one contributor to human learning and other mechanisms such as prefrontal cortex working memory also play a key role. Our results also show that these other players interact with the dopaminergic RL system, interfering with its key computation of reward prediction errors. Copyright © 2017 the authors 0270-6474/17/374332-11$15.00/0.

  14. Neural processing of reward in adolescent rodents.

    PubMed

    Simon, Nicholas W; Moghaddam, Bita

    2015-02-01

    Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

  15. Sticking Up for Rewards.

    ERIC Educational Resources Information Center

    Chance, Paul

    1993-01-01

    Argues, in response to Kohn's article in the same "Kappan" issue, that honest feedback on student performance (informational rewards) are usually necessary for initial learning to occur successfully. Some rewards do work and have long-term benefits. The current philosophy of assigning teachers a facilitative role renders them impotent and blames…

  16. Ventral Pallidum Roles in Reward and Motivation

    PubMed Central

    Smith, Kyle S.; Tindell, Amy J.; Aldridge, J. Wayne; Berridge, Kent C.

    2008-01-01

    In recent years the ventral pallidum has become a focus of great research interest as a mechanism of reward and incentive motivation. As a major output for limbic signals, the ventral pallidum was once associated primarily with motor functions rather than regarded as a reward structure in its own right. However, ample evidence now suggests that ventral pallidum function is a major mechanism of reward in the brain. We review data indicating that 1) an intact ventral pallidum is necessary for normal reward and motivation, 2) stimulated activation of ventral pallidum is sufficient to cause reward and motivation enhancements, and 3) activation patterns in ventral pallidum neurons specifically encode reward and motivation signals via phasic bursts of excitation to incentive and hedonic stimuli. We conclude that the ventral pallidum may serve as an important ‘limbic final common pathway’ for mesocorticolimbic processing of many rewards. PMID:18955088

  17. Ventral pallidum roles in reward and motivation.

    PubMed

    Smith, Kyle S; Tindell, Amy J; Aldridge, J Wayne; Berridge, Kent C

    2009-01-23

    In recent years the ventral pallidum has become a focus of great research interest as a mechanism of reward and incentive motivation. As a major output for limbic signals, the ventral pallidum was once associated primarily with motor functions rather than regarded as a reward structure in its own right. However, ample evidence now suggests that ventral pallidum function is a major mechanism of reward in the brain. We review data indicating that (1) an intact ventral pallidum is necessary for normal reward and motivation, (2) stimulated activation of ventral pallidum is sufficient to cause reward and motivation enhancements, and (3) activation patterns in ventral pallidum neurons specifically encode reward and motivation signals via phasic bursts of excitation to incentive and hedonic stimuli. We conclude that the ventral pallidum may serve as an important 'limbic final common pathway' for mesocorticolimbic processing of many rewards.

  18. Reward modulates perception in binocular rivalry.

    PubMed

    Marx, Svenja; Einhäuser, Wolfgang

    2015-01-14

    Our perception does not provide us with an exact imprint of the outside world, but is continuously adapted to our internal expectations, task sets, and behavioral goals. Although effects of reward-or value in general-on perception therefore seem likely, how valuation modulates perception and how such modulation relates to attention is largely unknown. We probed effects of reward on perception by using a binocular-rivalry paradigm. Distinct gratings drifting in opposite directions were presented to each observer's eyes. To objectify their subjective perceptual experience, the optokinetic nystagmus was used as measure of current perceptual dominance. In a first experiment, one of the percepts was either rewarded or attended. We found that reward and attention similarly biased perception. In a second experiment, observers performed an attentionally demanding task either on the rewarded stimulus, the other stimulus, or both. We found that-on top of an attentional effect on perception-at each level of attentional load, reward still modulated perception by increasing the dominance of the rewarded percept. Similarly, penalizing one percept increased dominance of the other at each level of attentional load. In turn, rewarding-and similarly nonpunishing-a percept yielded performance benefits that are typically associated with selective attention. In conclusion, our data show that value modulates perception in a similar way as the volitional deployment of attention, even though the relative effect of value is largely unaffected by an attention task. © 2015 ARVO.

  19. Intrinsic connectivity networks from childhood to late adolescence: Effects of age and sex.

    PubMed

    Solé-Padullés, Cristina; Castro-Fornieles, Josefina; de la Serna, Elena; Calvo, Rosa; Baeza, Inmaculada; Moya, Jaime; Lázaro, Luisa; Rosa, Mireia; Bargalló, Nuria; Sugranyes, Gisela

    2016-02-01

    There is limited evidence on the effects of age and sex on intrinsic connectivity of networks underlying cognition during childhood and adolescence. Independent component analysis was conducted in 113 subjects aged 7-18; the default mode, executive control, anterior salience, basal ganglia, language and visuospatial networks were identified. The effect of age was examined with multiple regression, while sex and 'age × sex' interactions were assessed by dividing the sample according to age (7-12 and 13-18 years). As age increased, connectivity in the dorsal and ventral default mode network became more anterior and posterior, respectively, while in the executive control network, connectivity increased within frontoparietal regions. The basal ganglia network showed increased engagement of striatum, thalami and precuneus. The anterior salience network showed greater connectivity in frontal areas and anterior cingulate, and less connectivity of orbitofrontal, middle cingulate and temporoparietal regions. The language network presented increased connectivity of inferior frontal and decreased connectivity within the right middle frontal and left inferior parietal cortices. The visuospatial network showed greater engagement of inferior parietal and frontal cortices. No effect of sex, nor age by sex interactions was observed. These findings provide evidence of strengthening of cortico-cortical and cortico-subcortical networks across childhood and adolescence. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

  20. It's about time: Earlier rewards increase intrinsic motivation.

    PubMed

    Woolley, Kaitlin; Fishbach, Ayelet

    2018-06-01

    Can immediate (vs. delayed) rewards increase intrinsic motivation? Prior research compared the presence versus absence of rewards. By contrast, this research compared immediate versus delayed rewards, predicting that more immediate rewards increase intrinsic motivation by creating a perceptual fusion between the activity and its goal (i.e., the reward). In support of the hypothesis, framing a reward from watching a news program as more immediate (vs. delayed) increased intrinsic motivation to watch the program (Study 1), and receiving more immediate bonus (vs. delayed, Study 2; and vs. delayed and no bonus, Study 3) increased intrinsic motivation in an experimental task. The effect of reward timing was mediated by the strength of the association between an activity and a reward, and was specific to intrinsic (vs. extrinsic) motivation-immediacy influenced the positive experience of an activity, but not perceived outcome importance (Study 4). In addition, the effect of the timing of rewards was independent of the effect of the magnitude of the rewards (Study 5). (PsycINFO Database Record (c) 2018 APA, all rights reserved).

  1. iPhone-Assisted Augmented Reality Localization of Basal Ganglia Hypertensive Hematoma.

    PubMed

    Hou, YuanZheng; Ma, LiChao; Zhu, RuYuan; Chen, XiaoLei

    2016-10-01

    A low-cost, time-efficient technique that could localize hypertensive hematomas in the basal ganglia would be beneficial for minimally invasive hematoma evacuation surgery. We used an iPhone to achieve this goal and evaluated its accuracy and feasibility. We located basal ganglia hematomas in 26 patients and depicted the boundaries of the hematomas on the skin. To verify the accuracy of the drawn boundaries, computed tomography (CT) markers surrounding the depicted boundaries were attached to 10 patients. The deviation between the CT markers and the actual hematoma boundaries was then measured. In the other 16 patients, minimally invasive endoscopic hematoma evacuation surgery was performed according to the depicted hematoma boundary. The deflection angle of the actual trajectory and deviation in the hematoma center were measured according to the preoperative and postoperative CT data. There were 40 CT markers placed on 10 patients. The mean deviation of these markers was 3.1 mm ± 2.4. In the 16 patients who received surgery, the deflection angle of the actual trajectory was 4.3° ± 2.1. The deviation in the hematoma center was 5.2 mm ± 2.6. This new method can locate basal ganglia hematomas with a sufficient level of accuracy and is helpful for minimally invasive endoscopic hematoma evacuation surgery. Copyright © 2016 Elsevier Inc. All rights reserved.

  2. RNA-Seq Analysis of Human Trigeminal and Dorsal Root Ganglia with a Focus on Chemoreceptors

    PubMed Central

    Flegel, Caroline; Schöbel, Nicole; Altmüller, Janine; Becker, Christian; Tannapfel, Andrea; Hatt, Hanns; Gisselmann, Günter

    2015-01-01

    The chemosensory capacity of the somatosensory system relies on the appropriate expression of chemoreceptors, which detect chemical stimuli and transduce sensory information into cellular signals. Knowledge of the complete repertoire of the chemoreceptors expressed in human sensory ganglia is lacking. This study employed the next-generation sequencing technique (RNA-Seq) to conduct the first expression analysis of human trigeminal ganglia (TG) and dorsal root ganglia (DRG). We analyzed the data with a focus on G-protein coupled receptors (GPCRs) and ion channels, which are (potentially) involved in chemosensation by somatosensory neurons in the human TG and DRG. For years, transient receptor potential (TRP) channels have been considered the main group of receptors for chemosensation in the trigeminal system. Interestingly, we could show that sensory ganglia also express a panel of different olfactory receptors (ORs) with putative chemosensory function. To characterize OR expression in more detail, we performed microarray, semi-quantitative RT-PCR experiments, and immunohistochemical staining. Additionally, we analyzed the expression data to identify further known or putative classes of chemoreceptors in the human TG and DRG. Our results give an overview of the major classes of chemoreceptors expressed in the human TG and DRG and provide the basis for a broader understanding of the reception of chemical cues. PMID:26070209

  3. Neural Signatures of Value Comparison in Human Cingulate Cortex during Decisions Requiring an Effort-Reward Trade-off

    PubMed Central

    Kennerley, Steven W.; Friston, Karl; Bestmann, Sven

    2016-01-01

    Integrating costs and benefits is crucial for optimal decision-making. Although much is known about decisions that involve outcome-related costs (e.g., delay, risk), many of our choices are attached to actions and require an evaluation of the associated motor costs. Yet how the brain incorporates motor costs into choices remains largely unclear. We used human fMRI during choices involving monetary reward and physical effort to identify brain regions that serve as a choice comparator for effort-reward trade-offs. By independently varying both options' effort and reward levels, we were able to identify the neural signature of a comparator mechanism. A network involving supplementary motor area and the caudal portion of dorsal anterior cingulate cortex encoded the difference in reward (positively) and effort levels (negatively) between chosen and unchosen choice options. We next modeled effort-discounted subjective values using a novel behavioral model. This revealed that the same network of regions involving dorsal anterior cingulate cortex and supplementary motor area encoded the difference between the chosen and unchosen options' subjective values, and that activity was best described using a concave model of effort-discounting. In addition, this signal reflected how precisely value determined participants' choices. By contrast, separate signals in supplementary motor area and ventromedial prefrontal cortex correlated with participants' tendency to avoid effort and seek reward, respectively. This suggests that the critical neural signature of decision-making for choices involving motor costs is found in human cingulate cortex and not ventromedial prefrontal cortex as typically reported for outcome-based choice. Furthermore, distinct frontal circuits seem to drive behavior toward reward maximization and effort minimization. SIGNIFICANCE STATEMENT The neural processes that govern the trade-off between expected benefits and motor costs remain largely unknown. This is

  4. Neural Signatures of Value Comparison in Human Cingulate Cortex during Decisions Requiring an Effort-Reward Trade-off.

    PubMed

    Klein-Flügge, Miriam C; Kennerley, Steven W; Friston, Karl; Bestmann, Sven

    2016-09-28

    Integrating costs and benefits is crucial for optimal decision-making. Although much is known about decisions that involve outcome-related costs (e.g., delay, risk), many of our choices are attached to actions and require an evaluation of the associated motor costs. Yet how the brain incorporates motor costs into choices remains largely unclear. We used human fMRI during choices involving monetary reward and physical effort to identify brain regions that serve as a choice comparator for effort-reward trade-offs. By independently varying both options' effort and reward levels, we were able to identify the neural signature of a comparator mechanism. A network involving supplementary motor area and the caudal portion of dorsal anterior cingulate cortex encoded the difference in reward (positively) and effort levels (negatively) between chosen and unchosen choice options. We next modeled effort-discounted subjective values using a novel behavioral model. This revealed that the same network of regions involving dorsal anterior cingulate cortex and supplementary motor area encoded the difference between the chosen and unchosen options' subjective values, and that activity was best described using a concave model of effort-discounting. In addition, this signal reflected how precisely value determined participants' choices. By contrast, separate signals in supplementary motor area and ventromedial prefrontal cortex correlated with participants' tendency to avoid effort and seek reward, respectively. This suggests that the critical neural signature of decision-making for choices involving motor costs is found in human cingulate cortex and not ventromedial prefrontal cortex as typically reported for outcome-based choice. Furthermore, distinct frontal circuits seem to drive behavior toward reward maximization and effort minimization. The neural processes that govern the trade-off between expected benefits and motor costs remain largely unknown. This is striking because

  5. Remembrance of rewards past.

    PubMed

    Knutson, Brian; Adcock, R Alison

    2005-02-03

    Using event-related fMRI, Wittmann and colleagues report in this issue of Neuron that reward value enhances cue memory and that this process is associated with midbrain modulation of hippocampal consolidation. We propose that their findings introduce a novel mechanism by which positive arousal induced by reward anticipation may promote memory.

  6. Multisensory integration in the basal ganglia.

    PubMed

    Nagy, Attila; Eördegh, Gabriella; Paróczy, Zsuzsanna; Márkus, Zita; Benedek, György

    2006-08-01

    Sensorimotor co-ordination in mammals is achieved predominantly via the activity of the basal ganglia. To investigate the underlying multisensory information processing, we recorded the neuronal responses in the caudate nucleus (CN) and substantia nigra (SN) of anaesthetized cats to visual, auditory or somatosensory stimulation alone and also to their combinations, i.e. multisensory stimuli. The main goal of the study was to ascertain whether multisensory information provides more information to the neurons than do the individual sensory components. A majority of the investigated SN and CN multisensory units exhibited significant cross-modal interactions. The multisensory response enhancements were either additive or superadditive; multisensory response depressions were also detected. CN and SN cells with facilitatory and inhibitory interactions were found in each multisensory combination. The strengths of the multisensory interactions did not differ in the two structures. A significant inverse correlation was found between the strengths of the best unimodal responses and the magnitudes of the multisensory response enhancements, i.e. the neurons with the weakest net unimodal responses exhibited the strongest enhancement effects. The onset latencies of the responses of the integrative CN and SN neurons to the multisensory stimuli were significantly shorter than those to the unimodal stimuli. These results provide evidence that the multisensory CN and SN neurons, similarly to those in the superior colliculus and related structures, have the ability to integrate multisensory information. Multisensory integration may help in the effective processing of sensory events and the changes in the environment during motor actions controlled by the basal ganglia.

  7. Ketamine-Induced Oscillations in the Motor Circuit of the Rat Basal Ganglia

    PubMed Central

    Alegre, Manuel; Pérez-Alcázar, Marta; Iriarte, Jorge; Artieda, Julio

    2011-01-01

    Oscillatory activity can be widely recorded in the cortex and basal ganglia. This activity may play a role not only in the physiology of movement, perception and cognition, but also in the pathophysiology of psychiatric and neurological diseases like schizophrenia or Parkinson's disease. Ketamine administration has been shown to cause an increase in gamma activity in cortical and subcortical structures, and an increase in 150 Hz oscillations in the nucleus accumbens in healthy rats, together with hyperlocomotion. We recorded local field potentials from motor cortex, caudate-putamen (CPU), substantia nigra pars reticulata (SNr) and subthalamic nucleus (STN) in 20 awake rats before and after the administration of ketamine at three different subanesthetic doses (10, 25 and 50 mg/Kg), and saline as control condition. Motor behavior was semiautomatically quantified by custom-made software specifically developed for this setting. Ketamine induced coherent oscillations in low gamma (50 Hz), high gamma (80 Hz) and high frequency (HFO, 150 Hz) bands, with different behavior in the four structures studied. While oscillatory activity at these three peaks was widespread across all structures, interactions showed a different pattern for each frequency band. Imaginary coherence at 150 Hz was maximum between motor cortex and the different basal ganglia nuclei, while low gamma coherence connected motor cortex with CPU and high gamma coherence was more constrained to the basal ganglia nuclei. Power at three bands correlated with the motor activity of the animal, but only coherence values in the HFO and high gamma range correlated with movement. Interactions in the low gamma band did not show a direct relationship to movement. These results suggest that the motor effects of ketamine administration may be primarily mediated by the induction of coherent widespread high-frequency activity in the motor circuit of the basal ganglia, together with a frequency-specific pattern of

  8. Severity of dysfluency correlates with basal ganglia activity in persistent developmental stuttering.

    PubMed

    Giraud, Anne-Lise; Neumann, Katrin; Bachoud-Levi, Anne-Catherine; von Gudenberg, Alexander W; Euler, Harald A; Lanfermann, Heinrich; Preibisch, Christine

    2008-02-01

    Previous studies suggest that anatomical anomalies [Foundas, A. L., Bollich, A. M., Corey, D. M., Hurley, M., & Heilman, K. M. (2001). Anomalous anatomy of speech-language areas in adults with persistent developmental stuttering. Neurology, 57, 207-215; Foundas, A. L., Corey, D. M., Angeles, V., Bollich, A. M., Crabtree-Hartman, E., & Heilman, K. M. (2003). Atypical cerebral laterality in adults with persistent developmental stuttering. Neurology, 61, 1378-1385; Foundas, A. L., Bollich, A. M., Feldman, J., Corey, D. M., Hurley, M., & Lemen, L. C. et al., (2004). Aberrant auditory processing and atypical planum temporale in developmental stuttering. Neurology, 63, 1640-1646; Jancke, L., Hanggi, J., & Steinmetz, H. (2004). Morphological brain differences between adult stutterers and non-stutterers. BMC Neurology, 4, 23], in particular a reduction of the white matter anisotropy underlying the left sensorimotor cortex [Sommer, M., Koch, M. A., Paulus, W., Weiller, C., & Buchel, C. (2002). Disconnection of speech-relevant brain areas in persistent developmental stuttering. Lancet, 360, 380-383] could be at the origin of persistent developmental stuttering (PDS). Because neural connections between the motor cortex and basal ganglia are implicated in speech motor functions, PDS could also be associated with a dysfunction in basal ganglia activity [Alm, P. (2004). Stuttering and the basal ganglia circuits: a critical review of possible relations. Journal of Communication Disorders, 37, 325-369]. This fMRI study reports a correlation between severity of stuttering and activity in the basal ganglia and shows that this activity is modified by fluency shaping therapy through long-term therapy effects that reflect speech production improvement. A model of dysfunction in stuttering and possible repair modes is proposed that accommodates the data presented here and observations previously made by us and by others.

  9. Overt and covert attention to location-based reward.

    PubMed

    McCoy, Brónagh; Theeuwes, Jan

    2018-01-01

    Recent research on the impact of location-based reward on attentional orienting has indicated that reward factors play an influential role in spatial priority maps. The current study investigated whether and how reward associations based on spatial location translate from overt eye movements to covert attention. If reward associations can be tied to locations in space, and if overt and covert attention rely on similar overlapping neuronal populations, then both overt and covert attentional measures should display similar spatial-based reward learning. Our results suggest that location- and reward-based changes in one attentional domain do not lead to similar changes in the other. Specifically, although we found similar improvements at differentially rewarded locations during overt attentional learning, this translated to the least improvement at a highly rewarded location during covert attention. We interpret this as the result of an increased motivational link between the high reward location and the trained eye movement response acquired during learning, leading to a relative slowing during covert attention when the eyes remained fixated and the saccade response was suppressed. In a second experiment participants were not required to keep fixated during the covert attention task and we no longer observed relative slowing at the high reward location. Furthermore, the second experiment revealed no covert spatial priority of rewarded locations. We conclude that the transfer of location-based reward associations is intimately linked with the reward-modulated motor response employed during learning, and alternative attentional and task contexts may interfere with learned spatial priorities. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

  10. Conditional Routing of Information to the Cortex: A Model of the Basal Ganglia's Role in Cognitive Coordination

    ERIC Educational Resources Information Center

    Stocco, Andrea; Lebiere, Christian; Anderson, John R.

    2010-01-01

    The basal ganglia play a central role in cognition and are involved in such general functions as action selection and reinforcement learning. Here, we present a model exploring the hypothesis that the basal ganglia implement a conditional information-routing system. The system directs the transmission of cortical signals between pairs of regions…

  11. Correlation transfer from basal ganglia to thalamus in Parkinson's disease

    PubMed Central

    Pamela, Reitsma; Brent, Doiron; Jonathan, Rubin

    2011-01-01

    Spike trains from neurons in the basal ganglia of parkinsonian primates show increased pairwise correlations, oscillatory activity, and burst rate compared to those from neurons recorded during normal brain activity. However, it is not known how these changes affect the behavior of downstream thalamic neurons. To understand how patterns of basal ganglia population activity may affect thalamic spike statistics, we study pairs of model thalamocortical (TC) relay neurons receiving correlated inhibitory input from the internal segment of the globus pallidus (GPi), a primary output nucleus of the basal ganglia. We observe that the strength of correlations of TC neuron spike trains increases with the GPi correlation level, and bursty firing patterns such as those seen in the parkinsonian GPi allow for stronger transfer of correlations than do firing patterns found under normal conditions. We also show that the T-current in the TC neurons does not significantly affect correlation transfer, despite its pronounced effects on spiking. Oscillatory firing patterns in GPi are shown to affect the timescale at which correlations are best transferred through the system. To explain this last result, we analytically compute the spike count correlation coefficient for oscillatory cases in a reduced point process model. Our analysis indicates that the dependence of the timescale of correlation transfer is robust to different levels of input spike and rate correlations and arises due to differences in instantaneous spike correlations, even when the long timescale rhythmic modulations of neurons are identical. Overall, these results show that parkinsonian firing patterns in GPi do affect the transfer of correlations to the thalamus. PMID:22355287

  12. Positive mood enhances reward-related neural activity

    PubMed Central

    Nusslock, Robin

    2016-01-01

    Although behavioral research has shown that positive mood leads to desired outcomes in nearly every major life domain, no studies have directly examined the effects of positive mood on the neural processes underlying reward-related affect and goal-directed behavior. To address this gap, participants in the present fMRI study experienced either a positive (n = 20) or neutral (n = 20) mood induction and subsequently completed a monetary incentive delay task that assessed reward and loss processing. Consistent with prediction, positive mood elevated activity specifically during reward anticipation in corticostriatal neural regions that have been implicated in reward processing and goal-directed behavior, including the nucleus accumbens, caudate, lateral orbitofrontal cortex and putamen, as well as related paralimbic regions, including the anterior insula and ventromedial prefrontal cortex. These effects were not observed during reward outcome, loss anticipation or loss outcome. Critically, this is the first study to report that positive mood enhances reward-related neural activity. Our findings have implications for uncovering the neural mechanisms by which positive mood enhances goal-directed behavior, understanding the malleability of reward-related neural activity, and developing targeted treatments for psychiatric disorders characterized by deficits in reward processing. PMID:26833919

  13. A network analysis of ¹⁵O-H₂O PET reveals deep brain stimulation effects on brain network of Parkinson's disease.

    PubMed

    Park, Hae-Jeong; Park, Bumhee; Kim, Hae Yu; Oh, Maeng-Keun; Kim, Joong Il; Yoon, Misun; Lee, Jong Doo; Chang, Jin Woo

    2015-05-01

    As Parkinson's disease (PD) can be considered a network abnormality, the effects of deep brain stimulation (DBS) need to be investigated in the aspect of networks. This study aimed to examine how DBS of the bilateral subthalamic nucleus (STN) affects the motor networks of patients with idiopathic PD during motor performance and to show the feasibility of the network analysis using cross-sectional positron emission tomography (PET) images in DBS studies. We obtained [¹⁵O]H₂O PET images from ten patients with PD during a sequential finger-to-thumb opposition task and during the resting state, with DBS-On and DBS-Off at STN. To identify the alteration of motor networks in PD and their changes due to STN-DBS, we applied independent component analysis (ICA) to all the cross-sectional PET images. We analysed the strength of each component according to DBS effects, task effects and interaction effects. ICA blindly decomposed components of functionally associated distributed clusters, which were comparable to the results of univariate statistical parametric mapping. ICA further revealed that STN-DBS modifies usage-strengths of components corresponding to the basal ganglia-thalamo-cortical circuits in PD patients by increasing the hypoactive basal ganglia and by suppressing the hyperactive cortical motor areas, ventrolateral thalamus and cerebellum. Our results suggest that STN-DBS may affect not only the abnormal local activity, but also alter brain networks in patients with PD. This study also demonstrated the usefulness of ICA for cross-sectional PET data to reveal network modifications due to DBS, which was not observable using the subtraction method.

  14. Computational models of basal-ganglia pathway functions: focus on functional neuroanatomy

    PubMed Central

    Schroll, Henning; Hamker, Fred H.

    2013-01-01

    Over the past 15 years, computational models have had a considerable impact on basal-ganglia research. Most of these models implement multiple distinct basal-ganglia pathways and assume them to fulfill different functions. As there is now a multitude of different models, it has become complex to keep track of their various, sometimes just marginally different assumptions on pathway functions. Moreover, it has become a challenge to oversee to what extent individual assumptions are corroborated or challenged by empirical data. Focusing on computational, but also considering non-computational models, we review influential concepts of pathway functions and show to what extent they are compatible with or contradict each other. Moreover, we outline how empirical evidence favors or challenges specific model assumptions and propose experiments that allow testing assumptions against each other. PMID:24416002

  15. Social and monetary reward processing in autism spectrum disorders.

    PubMed

    Delmonte, Sonja; Balsters, Joshua H; McGrath, Jane; Fitzgerald, Jacqueline; Brennan, Sean; Fagan, Andrew J; Gallagher, Louise

    2012-09-26

    Social motivation theory suggests that deficits in social reward processing underlie social impairments in autism spectrum disorders (ASD). However, the extent to which abnormalities in reward processing generalize to other classes of stimuli remains unresolved. The aim of the current study was to examine if reward processing abnormalities in ASD are specific to social stimuli or can be generalized to other classes of reward. Additionally, we sought to examine the results in the light of behavioral impairments in ASD. Participants performed adapted versions of the social and monetary incentive delay tasks. Data from 21 unmedicated right-handed male participants with ASD and 21 age- and IQ-matched controls were analyzed using a factorial design to examine the blood-oxygen-level-dependent (BOLD) response during the anticipation and receipt of both reward types. Behaviorally, the ASD group showed less of a reduction in reaction time (RT) for rewarded compared to unrewarded trials than the control group. In terms of the fMRI results, there were no significant group differences in reward circuitry during reward anticipation. During the receipt of rewards, there was a significant interaction between group and reward type in the left dorsal striatum (DS). The ASD group showed reduced activity in the DS compared to controls for social rewards but not monetary rewards and decreased activation for social rewards compared to monetary rewards. Controls showed no significant difference between the two reward types. Increased activation in the DS during social reward processing was associated with faster response times for rewarded trials, compared to unrewarded trials, in both groups. This is in line with behavioral results indicating that the ASD group showed less of a reduction in RT for rewarded compared to unrewarded trials. Additionally, de-activation to social rewards was associated with increased repetitive behavior in ASD. In line with social motivation theory, the ASD

  16. Social and monetary reward processing in autism spectrum disorders

    PubMed Central

    2012-01-01

    Background Social motivation theory suggests that deficits in social reward processing underlie social impairments in autism spectrum disorders (ASD). However, the extent to which abnormalities in reward processing generalize to other classes of stimuli remains unresolved. The aim of the current study was to examine if reward processing abnormalities in ASD are specific to social stimuli or can be generalized to other classes of reward. Additionally, we sought to examine the results in the light of behavioral impairments in ASD. Methods Participants performed adapted versions of the social and monetary incentive delay tasks. Data from 21 unmedicated right-handed male participants with ASD and 21 age- and IQ-matched controls were analyzed using a factorial design to examine the blood-oxygen-level-dependent (BOLD) response during the anticipation and receipt of both reward types. Results Behaviorally, the ASD group showed less of a reduction in reaction time (RT) for rewarded compared to unrewarded trials than the control group. In terms of the fMRI results, there were no significant group differences in reward circuitry during reward anticipation. During the receipt of rewards, there was a significant interaction between group and reward type in the left dorsal striatum (DS). The ASD group showed reduced activity in the DS compared to controls for social rewards but not monetary rewards and decreased activation for social rewards compared to monetary rewards. Controls showed no significant difference between the two reward types. Increased activation in the DS during social reward processing was associated with faster response times for rewarded trials, compared to unrewarded trials, in both groups. This is in line with behavioral results indicating that the ASD group showed less of a reduction in RT for rewarded compared to unrewarded trials. Additionally, de-activation to social rewards was associated with increased repetitive behavior in ASD. Conclusions In line

  17. Identifying nurses' rewards: a qualitative categorization study in Belgium

    PubMed Central

    De Gieter, Sara; De Cooman, Rein; Pepermans, Roland; Caers, Ralf; Du Bois, Cindy; Jegers, Marc

    2006-01-01

    Background Rewards are important in attracting, motivating and retaining the most qualified employees, and nurses are no exception to this rule. This makes the establishment of an efficient reward system for nurses a true challenge for every hospital manager. A reward does not necessarily have a financial connotation: non-financial rewards may matter too, or may even be more important. Therefore, the present study examines nurses' reward perceptions, in order to identify potential reward options. Methods To answer the research question "What do nurses consider a reward and how can these rewards be categorized?", 20 in-depth semi-structured interviews with nurses were conducted and analysed using discourse and content analyses. In addition, the respondents received a list of 34 rewards (derived from the literature) and were asked to indicate the extent to which they perceived each of them to be rewarding. Results Discourse analysis revealed three major reward categories: financial, non-financial and psychological, each containing different subcategories. In general, nurses more often mentioned financial rewards spontaneously in the interview, compared to non-financial and psychological rewards. The questionnaire results did not, however, indicate a significant difference in the rewarding potential of these three categories. Both the qualitative and quantitative data revealed that a number of psychological and non-financial rewards were important for nurses in addition to their monthly pay and other remunerations. In particular, appreciation for their work by others, compliments from others, presents from others and contact with patients were highly valued. Moreover, some demographical variables influenced the reward perceptions. Younger and less experienced nurses considered promotion possibilities as more rewarding than the older and more senior ones. The latter valued job security and working for a hospital with a good reputation higher than their younger and more

  18. Cerebellar granule cells encode the expectation of reward

    PubMed Central

    Wagner, Mark J; Kim, Tony Hyun; Savall, Joan; Schnitzer, Mark J; Luo, Liqun

    2017-01-01

    The human brain contains ~60 billion cerebellar granule cells1, which outnumber all other neurons combined. Classical theories posit that a large, diverse population of granule cells allows for highly detailed representations of sensorimotor context, enabling downstream Purkinje cells to sense fine contextual changes2–6. Although evidence suggests a role for cerebellum in cognition7–10, granule cells are known to encode only sensory11–13 and motor14 context. Using two-photon calcium imaging in behaving mice, here we show that granule cells convey information about the expectation of reward. Mice initiated voluntary forelimb movements for delayed water reward. Some granule cells responded preferentially to reward or reward omission, whereas others selectively encoded reward anticipation. Reward responses were not restricted to forelimb movement, as a Pavlovian task evoked similar responses. Compared to predictable rewards, unexpected rewards elicited markedly different granule cell activity despite identical stimuli and licking responses. In both tasks, reward signals were widespread throughout multiple cerebellar lobules. Tracking the same granule cells over several days of learning revealed that cells with reward-anticipating responses emerged from those that responded at the start of learning to reward delivery, whereas reward omission responses grew stronger as learning progressed. The discovery of predictive, non-sensorimotor encoding in granule cells is a major departure from current understanding of these neurons and dramatically enriches contextual information available to postsynaptic Purkinje cells, with important implications for cognitive processing in the cerebellum. PMID:28321129

  19. Evolution of the dynamic properties of the cortex-basal ganglia network after dopaminergic depletion in rats.

    PubMed

    Dejean, Cyril; Nadjar, Agnes; Le Moine, Catherine; Bioulac, Bernard; Gross, Christian E; Boraud, Thomas

    2012-05-01

    It is well established that parkinsonian syndrome is associated with alterations of neuronal activity temporal pattern basal ganglia (BG). An increase in synchronized oscillations has been observed in different BG nuclei in Parkinson's disease patients as well as animal models such as 6-hydroxydopamine treated rats. We recently demonstrated that this increase in oscillatory synchronization is present during high-voltage spindles (HVS) probably underpinned by the disorganization of cortex-BG interactions. Here we investigated the time course of both oscillatory and motor alterations. For that purpose we performed daily simultaneous recordings of neuronal activity in motor cortex, striatum and substantia nigra pars reticulata (SNr), before and after 6-hydroxydopamine lesion in awake rats. After a brief non-dopamine-specific desynchronization, oscillatory activity first increased during HVS followed by progressive motor impairment and the shortening of SNr activation delay. While the oscillatory firing increase reflects dopaminergic depletion, response alteration in SNr neurons is closely related to motor symptom. Copyright © 2012 Elsevier Inc. All rights reserved.

  20. Rewards: Knowledge and Liberation.

    ERIC Educational Resources Information Center

    Logan, Carolyn

    Part of the reward for expository college English papers is, of course, letter grades, but careful writing offers two greater rewards: knowledge and liberation. Teachers can best motivate students to write by seeing to it that the writing they assign teaches and challenges, and by assigning topics that are important to students but ones that they…

  1. Mapping of Courtship Behavior-Induced Neural Activity in the Thoracic Ganglia of Silkmoth Bombyx mori by an Immediate Early Gene, Hr38.

    PubMed

    Morishita, Koudai; Iwami, Masafumi; Kiya, Taketoshi

    2018-06-01

    In the central nervous system of insects, motor patterns are generated in the thoracic ganglia under the control of brain, where sensory information is integrated and behavioral decisions are made. Previously, we established neural activity-mapping methods using an immediate early gene, BmHr38, as a neural activity marker in the brain of male silkmoth Bombyx mori. In the present study, to gain insights into neural mechanisms of motor-pattern generation in the thoracic ganglia, we investigated expression of BmHr38 in response to sex pheromone-induced courtship behavior. Levels of BmHr38 expression were strongly correlated between the brain and thoracic ganglia, suggesting that neural activity in the thoracic ganglia is tightly controlled by the brain. In situ hybridization of BmHr38 revealed that 20-30% of thoracic neurons are activated by courtship behavior. Using serial sections, we constructed a comprehensive map of courtship behaviorinduced activity in the thoracic ganglia. These results provide important clues into how complex courtship behavior is generated in the neural circuits of thoracic ganglia.

  2. Motor phenotype and magnetic resonance measures of basal ganglia iron levels in Parkinson's disease☆

    PubMed Central

    Bunzeck, Nico; Singh-Curry, Victoria; Eckart, Cindy; Weiskopf, Nikolaus; Perry, Richard J.; Bain, Peter G.; Düzel, Emrah; Husain, Masud

    2013-01-01

    Background In Parkinson's disease the degree of motor impairment can be classified with respect to tremor dominant and akinetic rigid features. While tremor dominance and akinetic rigidity might represent two ends of a continuum rather than discrete entities, it would be important to have non-invasive markers of any biological differences between them in vivo, to assess disease trajectories and response to treatment, as well as providing insights into the underlying mechanisms contributing to heterogeneity within the Parkinson's disease population. Methods Here, we used magnetic resonance imaging to examine whether Parkinson's disease patients exhibit structural changes within the basal ganglia that might relate to motor phenotype. Specifically, we examined volumes of basal ganglia regions, as well as transverse relaxation rate (a putative marker of iron load) and magnetization transfer saturation (considered to index structural integrity) within these regions in 40 individuals. Results We found decreased volume and reduced magnetization transfer within the substantia nigra in Parkinson's disease patients compared to healthy controls. Importantly, there was a positive correlation between tremulous motor phenotype and transverse relaxation rate (reflecting iron load) within the putamen, caudate and thalamus. Conclusions Our findings suggest that akinetic rigid and tremor dominant symptoms of Parkinson's disease might be differentiated on the basis of the transverse relaxation rate within specific basal ganglia structures. Moreover, they suggest that iron load within the basal ganglia makes an important contribution to motor phenotype, a key prognostic indicator of disease progression in Parkinson's disease. PMID:24025315

  3. Toward sophisticated basal ganglia neuromodulation: Review on basal ganglia deep brain stimulation.

    PubMed

    Da Cunha, Claudio; Boschen, Suelen L; Gómez-A, Alexander; Ross, Erika K; Gibson, William S J; Min, Hoon-Ki; Lee, Kendall H; Blaha, Charles D

    2015-11-01

    This review presents state-of-the-art knowledge about the roles of the basal ganglia (BG) in action-selection, cognition, and motivation, and how this knowledge has been used to improve deep brain stimulation (DBS) treatment of neurological and psychiatric disorders. Such pathological conditions include Parkinson's disease, Huntington's disease, Tourette syndrome, depression, and obsessive-compulsive disorder. The first section presents evidence supporting current hypotheses of how the cortico-BG circuitry works to select motor and emotional actions, and how defects in this circuitry can cause symptoms of the BG diseases. Emphasis is given to the role of striatal dopamine on motor performance, motivated behaviors and learning of procedural memories. Next, the use of cutting-edge electrochemical techniques in animal and human studies of BG functioning under normal and disease conditions is discussed. Finally, functional neuroimaging studies are reviewed; these works have shown the relationship between cortico-BG structures activated during DBS and improvement of disease symptoms. Copyright © 2015 Elsevier Ltd. All rights reserved.

  4. Potential long-term effects of MDMA on the basal ganglia-thalamocortical circuit: a proton MR spectroscopy and diffusion-tensor imaging study.

    PubMed

    Liu, Hua-Shan; Chou, Ming-Chung; Chung, Hsiao-Wen; Cho, Nai-Yu; Chiang, Shih-Wei; Wang, Chao-Ying; Kao, Hung-Wen; Huang, Guo-Shu; Chen, Cheng-Yu

    2011-08-01

    To investigate the effects of 3,4-methylenedioxymethamphetamine (MDMA, commonly known as "ecstasy") on the alterations of brain metabolites and anatomic tissue integrity related to the function of the basal ganglia-thalamocortical circuit by using proton magnetic resonance (MR) spectroscopy and diffusion-tensor MR imaging. This study was approved by a local institutional review board, and written informed consent was obtained from all subjects. Thirty-one long-term (>1 year) MDMA users and 33 healthy subjects were enrolled. Proton MR spectroscopy from the middle frontal cortex and bilateral basal ganglia and whole-brain diffusion-tensor MR imaging were performed with a 3.0-T system. Absolute concentrations of metabolites were computed, and diffusion-tensor data were registered to the International Consortium for Brain Mapping template to facilitate voxel-based group comparison. The mean myo-inositol level in the basal ganglia of MDMA users (left: 4.55 mmol/L ± 2.01 [standard deviation], right: 4.48 mmol/L ± 1.33) was significantly higher than that in control subjects (left: 3.25 mmol/L ± 1.30, right: 3.31 mmol/L ± 1.19) (P < .001). Cumulative lifetime MDMA dose showed a positive correlation with the levels of choline-containing compounds (Cho) in the right basal ganglia (r = 0.47, P = .02). MDMA users also showed a significant increase in fractional anisotropy (FA) in the bilateral thalami and significant changes in water diffusion in several regions related to the basal ganglia-thalamocortical circuit as compared with control subjects (P < .05; cluster size, >50 voxels). Increased myo-inositol and Cho concentrations in the basal ganglia of MDMA users are suggestive of glial response to degenerating serotonergic functions. The abnormal metabolic changes in the basal ganglia may consequently affect the inhibitory effect of the basal ganglia to the thalamus, as suggested by the increased FA in the thalamus and abnormal changes in water diffusion in the

  5. Endoscopic Evacuation of Basal Ganglia Hemorrhage via Keyhole Approach Using an Adjustable Cannula in Comparison with Craniotomy

    PubMed Central

    Zhang, Heng-Zhu; Li, Yu-Ping; Yan, Zheng-cun; Wang, Xing-dong; She, Lei; Wang, Xiao-dong; Dong, Lun

    2014-01-01

    Neuroendoscopic (NE) surgery as a minimal invasive treatment for basal ganglia hemorrhage is a promising approach. The present study aims to evaluate the efficacy and safety of NE approach using an adjustable cannula to treat basal ganglia hemorrhage. In this study, we analysed the clinical and radiographic outcomes between NE group (21 cases) and craniotomy group (30 cases). The results indicated that NE surgery might be an effective and safe approach for basal ganglia haemorrhage, and it is also suggested that NE approach may improve good functional recovery. However, NE approach only suits the selected patient, and the usefulness of NE approach needs further randomized controlled trials (RCTs) to evaluate. PMID:24949476

  6. Reward Circuitry in Addiction.

    PubMed

    Cooper, Sarah; Robison, A J; Mazei-Robison, Michelle S

    2017-07-01

    Understanding the brain circuitry that underlies reward is critical to improve treatment for many common health issues, including obesity, depression, and addiction. Here we focus on insights into the organization and function of reward circuitry and its synaptic and structural adaptations in response to cocaine exposure. While the importance of certain circuits, such as the mesocorticolimbic dopamine pathway, are well established in drug reward, recent studies using genetics-based tools have revealed functional changes throughout the reward circuitry that contribute to different facets of addiction, such as relapse and craving. The ability to observe and manipulate neuronal activity within specific cell types and circuits has led to new insight into not only the basic connections between brain regions, but also the molecular changes within these specific microcircuits, such as neurotrophic factor and GTPase signaling or α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) receptor function, that underlie synaptic and structural plasticity evoked by drugs of abuse. Excitingly, these insights from preclinical rodent work are now being translated into the clinic, where transcranial magnetic simulation and deep brain stimulation therapies are being piloted in human cocaine dependence. Thus, this review seeks to summarize current understanding of the major brain regions implicated in drug-related behaviors and the molecular mechanisms that contribute to altered connectivity between these regions, with the postulation that increased knowledge of the plasticity within the drug reward circuit will lead to new and improved treatments for addiction.

  7. Music-related reward responses predict episodic memory performance.

    PubMed

    Ferreri, Laura; Rodriguez-Fornells, Antoni

    2017-12-01

    Music represents a special type of reward involving the recruitment of the mesolimbic dopaminergic system. According to recent theories on episodic memory formation, as dopamine strengthens the synaptic potentiation produced by learning, stimuli triggering dopamine release could result in long-term memory improvements. Here, we behaviourally test whether music-related reward responses could modulate episodic memory performance. Thirty participants rated (in terms of arousal, familiarity, emotional valence, and reward) and encoded unfamiliar classical music excerpts. Twenty-four hours later, their episodic memory was tested (old/new recognition and remember/know paradigm). Results revealed an influence of music-related reward responses on memory: excerpts rated as more rewarding were significantly better recognized and remembered. Furthermore, inter-individual differences in the ability to experience musical reward, measured through the Barcelona Music Reward Questionnaire, positively predicted memory performance. Taken together, these findings shed new light on the relationship between music, reward and memory, showing for the first time that music-driven reward responses are directly implicated in higher cognitive functions and can account for individual differences in memory performance.

  8. Rewarded visual items capture attention only in heterogeneous contexts.

    PubMed

    Feldmann-Wüstefeld, Tobias; Brandhofer, Ruben; Schubö, Anna

    2016-07-01

    Reward is known to affect visual search performance. Rewarding targets can increase search performance, whereas rewarding distractors can decrease search performance. We used subcomponents of the N2pc in the event-related EEG, the NT (target negativity) and ND /PD (distractor negativity/positivity), in a visual search task to disentangle target and distractor processing related to reward. The visual search task comprised homogeneous and heterogeneous contexts in which a target and a colored distractor were embedded. After each correct trial, participants were given a monetary reward that depended on the color of the distractor. We found longer response times for displays with high-reward distractors compared to displays with low-reward distractors, indicating reward-induced interference, however, only for heterogeneous contexts. The NT component, indicative of attention deployment to the target, showed that target selection was impaired by high-reward distractors, regardless of the context homogeneity. Processing of distractors was not affected by reward in homogeneous contexts. In heterogeneous contexts, however, high-reward distractors were more likely to capture attention (ND ) and required more effort to be suppressed (PD ) than low-reward distractors. In sum the results showed that, despite the fact that target selection is impaired by high-reward distractors in both homogeneous and heterogeneous background contexts, high-reward distractors capture attention only in scenarios that foster attentional capture. © 2016 Society for Psychophysiological Research.

  9. T2-weighted high-intensity signals in the basal ganglia as an interesting image finding in Unverricht-Lundborg disease.

    PubMed

    Korja, Miikka; Ferlazzo, Edoardo; Soilu-Hänninen, Merja; Magaudda, Adriana; Marttila, Reijo; Genton, Pierre; Parkkola, Riitta

    2010-01-01

    We conducted a search for white matter changes (WMCs) in 13 Unverricht-Lundborg disease patients and compared the prevalence of WMCs in these patients to age-matched long-term epileptics and healthy controls. ULD patients had significantly more T2-weighted high-intensity signals on MRI than control subjects, due to the increased prevalence of these signals in the basal ganglia. Interestingly, ULD patients with the basal ganglia changes were overweight. Basal ganglia T2-weighted high-intensity signals are novel findings in ULD. 2009 Elsevier B.V. All rights reserved.

  10. Video game training and the reward system.

    PubMed

    Lorenz, Robert C; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

    2015-01-01

    Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training.

  11. Reward Systems in the Brain and Nutrition.

    PubMed

    Rolls, Edmund T

    2016-07-17

    The taste cortex in the anterior insula provides separate and combined representations of the taste, temperature, and texture of food in the mouth independently of hunger and thus of reward value and pleasantness. One synapse on, in the orbitofrontal cortex, these sensory inputs are combined by associative learning with olfactory and visual inputs for some neurons, and these neurons encode food reward value in that they respond to food only when hunger is present and in that activations correlate linearly with subjective pleasantness. Cognitive factors, including word-level descriptions and selective attention to affective value, modulate the representation of the reward value of taste, olfactory, and flavor stimuli in the orbitofrontal cortex and a region to which it projects, the anterior cingulate cortex. These food reward representations are important in the control of appetite and food intake. Individual differences in reward representations may contribute to obesity, and there are age-related differences in these reward representations. Implications of how reward systems in the brain operate for understanding, preventing, and treating obesity are described.

  12. Basal ganglia function, stuttering, sequencing, and repair in adult songbirds.

    PubMed

    Kubikova, Lubica; Bosikova, Eva; Cvikova, Martina; Lukacova, Kristina; Scharff, Constance; Jarvis, Erich D

    2014-10-13

    A pallial-basal-ganglia-thalamic-pallial loop in songbirds is involved in vocal motor learning. Damage to its basal ganglia part, Area X, in adult zebra finches has been noted to have no strong effects on song and its function is unclear. Here we report that neurotoxic damage to adult Area X induced changes in singing tempo and global syllable sequencing in all animals, and considerably increased syllable repetition in birds whose song motifs ended with minor repetitions before lesioning. This stuttering-like behavior started at one month, and improved over six months. Unexpectedly, the lesioned region showed considerable recovery, including immigration of newly generated or repaired neurons that became active during singing. The timing of the recovery and stuttering suggest that immature recovering activity of the circuit might be associated with stuttering. These findings indicate that even after juvenile learning is complete, the adult striatum plays a role in higher level organization of learned vocalizations.

  13. Surprise disrupts cognition via a fronto-basal ganglia suppressive mechanism

    PubMed Central

    Wessel, Jan R.; Jenkinson, Ned; Brittain, John-Stuart; Voets, Sarah H. E. M.; Aziz, Tipu Z.; Aron, Adam R.

    2016-01-01

    Surprising events markedly affect behaviour and cognition, yet the underlying mechanism is unclear. Surprise recruits a brain mechanism that globally suppresses motor activity, ostensibly via the subthalamic nucleus (STN) of the basal ganglia. Here, we tested whether this suppressive mechanism extends beyond skeletomotor suppression and also affects cognition (here, verbal working memory, WM). We recorded scalp-EEG (electrophysiology) in healthy participants and STN local field potentials in Parkinson's patients during a task in which surprise disrupted WM. For scalp-EEG, surprising events engage the same independent neural signal component that indexes action stopping in a stop-signal task. Importantly, the degree of this recruitment mediates surprise-related WM decrements. Intracranially, STN activity is also increased post surprise, especially when WM is interrupted. These results suggest that surprise interrupts cognition via the same fronto-basal ganglia mechanism that interrupts action. This motivates a new neural theory of how cognition is interrupted, and how distraction arises after surprising events. PMID:27088156

  14. Basal ganglia function, stuttering, sequencing, and repair in adult songbirds

    PubMed Central

    Kubikova, Lubica; Bosikova, Eva; Cvikova, Martina; Lukacova, Kristina; Scharff, Constance; Jarvis, Erich D.

    2014-01-01

    A pallial-basal-ganglia-thalamic-pallial loop in songbirds is involved in vocal motor learning. Damage to its basal ganglia part, Area X, in adult zebra finches has been noted to have no strong effects on song and its function is unclear. Here we report that neurotoxic damage to adult Area X induced changes in singing tempo and global syllable sequencing in all animals, and considerably increased syllable repetition in birds whose song motifs ended with minor repetitions before lesioning. This stuttering-like behavior started at one month, and improved over six months. Unexpectedly, the lesioned region showed considerable recovery, including immigration of newly generated or repaired neurons that became active during singing. The timing of the recovery and stuttering suggest that immature recovering activity of the circuit might be associated with stuttering. These findings indicate that even after juvenile learning is complete, the adult striatum plays a role in higher level organization of learned vocalizations. PMID:25307086

  15. Basolateral amygdala rapid glutamate release encodes an outcome-specific representation vital for reward-predictive cues to selectively invigorate reward-seeking actions

    PubMed Central

    Malvaez, Melissa; Greenfield, Venuz Y.; Wang, Alice S.; Yorita, Allison M.; Feng, Lili; Linker, Kay E.; Monbouquette, Harold G.; Wassum, Kate M.

    2015-01-01

    Environmental stimuli have the ability to generate specific representations of the rewards they predict and in so doing alter the selection and performance of reward-seeking actions. The basolateral amygdala participates in this process, but precisely how is unknown. To rectify this, we monitored, in near-real time, basolateral amygdala glutamate concentration changes during a test of the ability of reward-predictive cues to influence reward-seeking actions (Pavlovian-instrumental transfer). Glutamate concentration was found to be transiently elevated around instrumental reward seeking. During the Pavlovian-instrumental transfer test these glutamate transients were time-locked to and correlated with only those actions invigorated by outcome-specific motivational information provided by the reward-predictive stimulus (i.e., actions earning the same specific outcome as predicted by the presented CS). In addition, basolateral amygdala AMPA, but not NMDA glutamate receptor inactivation abolished the selective excitatory influence of reward-predictive cues over reward seeking. These data the hypothesis that transient glutamate release in the BLA can encode the outcome-specific motivational information provided by reward-predictive stimuli. PMID:26212790

  16. Neural correlates of reward processing in adults with 22q11 deletion syndrome.

    PubMed

    van Duin, Esther D A; Goossens, Liesbet; Hernaus, Dennis; da Silva Alves, Fabiana; Schmitz, Nicole; Schruers, Koen; van Amelsvoort, Therese

    2016-01-01

    engage a fronto-temporal neural network. Compared to healthy controls, people with 22q11DS primarily displayed reduced activity in medial frontal regions during reward anticipation. COMT hemizygosity affects responsivity of the reward system in this condition. Alterations in reward processing partly underlain by the dopamine system may play a role in susceptibility for psychosis in 22q11DS.

  17. Trait Anticipatory Pleasure Predicts Effort Expenditure for Reward

    PubMed Central

    Geaney, Joachim T.; Treadway, Michael T.; Smillie, Luke D.

    2015-01-01

    Research in motivation and emotion has been increasingly influenced by the perspective that processes underpinning the motivated approach of rewarding goals are distinct from those underpinning enjoyment during reward consummation. This distinction recently inspired the construction of the Temporal Experience of Pleasure Scale (TEPS), a self-report measure that distinguishes trait anticipatory pleasure (pre-reward feelings of desire) from consummatory pleasure (feelings of enjoyment and gratification upon reward attainment). In a university community sample (N = 97), we examined the TEPS subscales as predictors of (1) the willingness to expend effort for monetary rewards, and (2) affective responses to a pleasant mood induction procedure. Results showed that both anticipatory pleasure and a well-known trait measure of reward motivation predicted effort-expenditure for rewards when the probability of being rewarded was relatively low. Against expectations, consummatory pleasure was unrelated to induced pleasant affect. Taken together, our findings provide support for the validity of the TEPS anticipatory pleasure scale, but not the consummatory pleasure scale. PMID:26115223

  18. Category Learning in the Brain

    PubMed Central

    Seger, Carol A.; Miller, Earl K.

    2013-01-01

    The ability to group items and events into functional categories is a fundamental characteristic of sophisticated thought. It is subserved by plasticity in many neural systems, including neocortical regions (sensory, prefrontal, parietal, and motor cortex), the medial temporal lobe, the basal ganglia, and midbrain dopaminergic systems. These systems interact during category learning. Corticostriatal loops may mediate recursive, bootstrapping interactions between fast reward-gated plasticity in the basal ganglia and slow reward-shaded plasticity in the cortex. This can provide a balance between acquisition of details of experiences and generalization across them. Interactions between the corticostriatal loops can integrate perceptual, response, and feedback-related aspects of the task and mediate the shift from novice to skilled performance. The basal ganglia and medial temporal lobe interact competitively or cooperatively, depending on the demands of the learning task. PMID:20572771

  19. Network architecture of the cerebral nuclei (basal ganglia) association and commissural connectome.

    PubMed

    Swanson, Larry W; Sporns, Olaf; Hahn, Joel D

    2016-10-04

    The cerebral nuclei form the ventral division of the cerebral hemisphere and are thought to play an important role in neural systems controlling somatic movement and motivation. Network analysis was used to define global architectural features of intrinsic cerebral nuclei circuitry in one hemisphere (association connections) and between hemispheres (commissural connections). The analysis was based on more than 4,000 reports of histologically defined axonal connections involving all 45 gray matter regions of the rat cerebral nuclei and revealed the existence of four asymmetrically interconnected modules. The modules form four topographically distinct longitudinal columns that only partly correspond to previous interpretations of cerebral nuclei structure-function organization. The network of connections within and between modules in one hemisphere or the other is quite dense (about 40% of all possible connections), whereas the network of connections between hemispheres is weak and sparse (only about 5% of all possible connections). Particularly highly interconnected regions (rich club and hubs within it) form a topologically continuous band extending through two of the modules. Connection path lengths among numerous pairs of regions, and among some of the network's modules, are relatively long, thus accounting for low global efficiency in network communication. These results provide a starting point for reexamining the connectional organization of the cerebral hemispheres as a whole (right and left cerebral cortex and cerebral nuclei together) and their relation to the rest of the nervous system.

  20. Facilitation of voluntary goal-directed action by reward cues.

    PubMed

    Lovibond, Peter F; Colagiuri, Ben

    2013-10-01

    Reward-associated cues are known to influence motivation to approach both natural and man-made rewards, such as food and drugs. However, the mechanisms underlying these effects are not well understood. To model these processes in the laboratory with humans, we developed an appetitive Pavlovian-instrumental transfer procedure with a chocolate reward. We used a single unconstrained response that led to an actual rather than symbolic reward to assess the strength of reward motivation. Presentation of a chocolate-paired cue, but not an unpaired cue, markedly enhanced instrumental responding over a 30-s period. The same pattern was observed with 10-s and 30-s cues, showing that close cue-reward contiguity is not necessary for facilitation of reward-directed action. The results confirm that reward-related cues can instigate voluntary action to obtain that reward. The effectiveness of long-duration cues suggests that in clinical settings, attention should be directed to both proximal and distal cues for reward.