Associations between Electrophysiological Evidence of Reward and Punishment-Based Learning and Psychotic Experiences and Social Anhedonia in At-Risk Groups

PubMed Central

Karcher, Nicole R; Bartholow, Bruce D; Martin, Elizabeth A; Kerns, John G

2017-01-01

Both positive psychotic symptoms and anhedonia are associated with striatal functioning, but few studies have linked risk for psychotic disorders to a neural measure evoked during a striatal dopamine-related reward and punishment-based learning task, such as a reversal learning task (RLT; Cools et al, 2009). The feedback-related negativity (FRN) is a neural response that in part reflects striatal dopamine functioning. We recorded EEG during the RLT in three groups: (a) people with psychotic experiences (PE; n=20) at increased risk for psychotic disorders; (b) people with extremely elevated social anhedonia (SocAnh; n=22); and (c) controls (n=20). Behaviorally, consistent with increased striatal dopamine, the PE group exhibited better behavioral learning (ie, faster responses) after unexpected reward than after unexpected punishment. Moreover, although the control and SocAnh groups showed a larger FRN to punishment than reward, the PE group showed similar FRNs to punishment and reward, with a numerically larger FRN to reward than punishment (with similar results on these trials also found for a P3a component). These results are among the first to link a neural response evoked by a reward and punishment-based learning task specifically with elevated psychosis risk. PMID:27629367

Associations between Electrophysiological Evidence of Reward and Punishment-Based Learning and Psychotic Experiences and Social Anhedonia in At-Risk Groups.

PubMed

Karcher, Nicole R; Bartholow, Bruce D; Martin, Elizabeth A; Kerns, John G

2017-03-01

Both positive psychotic symptoms and anhedonia are associated with striatal functioning, but few studies have linked risk for psychotic disorders to a neural measure evoked during a striatal dopamine-related reward and punishment-based learning task, such as a reversal learning task (RLT; Cools et al, 2009). The feedback-related negativity (FRN) is a neural response that in part reflects striatal dopamine functioning. We recorded EEG during the RLT in three groups: (a) people with psychotic experiences (PE; n=20) at increased risk for psychotic disorders; (b) people with extremely elevated social anhedonia (SocAnh; n=22); and (c) controls (n=20). Behaviorally, consistent with increased striatal dopamine, the PE group exhibited better behavioral learning (ie, faster responses) after unexpected reward than after unexpected punishment. Moreover, although the control and SocAnh groups showed a larger FRN to punishment than reward, the PE group showed similar FRNs to punishment and reward, with a numerically larger FRN to reward than punishment (with similar results on these trials also found for a P3a component). These results are among the first to link a neural response evoked by a reward and punishment-based learning task specifically with elevated psychosis risk.

Deficits in Positive Reinforcement Learning and Uncertainty-Driven Exploration are Associated with Distinct Aspects of Negative Symptoms in Schizophrenia

PubMed Central

Strauss, Gregory P.; Frank, Michael J.; Waltz, James A.; Kasanova, Zuzana; Herbener, Ellen S.; Gold, James M.

2011-01-01

Background Negative symptoms are core features of schizophrenia; however, the cognitive and neural basis for individual negative symptom domains remains unclear. Converging evidence suggests a role for striatal and prefrontal dopamine in reward learning and the exploration of actions that might produce outcomes that are better than the status quo. The current study examines whether deficits in reinforcement learning and uncertainty-driven exploration predict specific negative symptoms domains. Methods We administered a temporal decision making task, which required trial-by-trial adjustment of reaction time (RT) to maximize reward receipt, to 51 patients with schizophrenia and 39 age-matched healthy controls. Task conditions were designed such that expected value (probability * magnitude) increased (IEV), decreased (DEV), or remained constant (CEV) with increasing response times. Computational analyses were applied to estimate the degree to which trial-by-trial responses are influenced by reinforcement history. Results Individuals with schizophrenia showed impaired Go learning, but intact NoGo learning relative to controls. These effects were pronounced as a function of global measures of negative symptom. Uncertainty-based exploration was substantially reduced in individuals with schizophrenia, and selectively correlated with clinical ratings of anhedonia. Conclusions Schizophrenia patients, particularly those with high negative symptoms, failed to speed RT's to increase positive outcomes and showed reduced tendency to explore when alternative actions could lead to better outcomes than the status quo. Results are interpreted in the context of current computational, genetic, and pharmacological data supporting the roles of striatal and prefrontal dopamine in these processes. PMID:21168124

Hemispheric Asymmetries in Striatal Reward Responses Relate to Approach-Avoidance Learning and Encoding of Positive-Negative Prediction Errors in Dopaminergic Midbrain Regions.

PubMed

Aberg, Kristoffer Carl; Doell, Kimberly C; Schwartz, Sophie

2015-10-28

Some individuals are better at learning about rewarding situations, whereas others are inclined to avoid punishments (i.e., enhanced approach or avoidance learning, respectively). In reinforcement learning, action values are increased when outcomes are better than predicted (positive prediction errors [PEs]) and decreased for worse than predicted outcomes (negative PEs). Because actions with high and low values are approached and avoided, respectively, individual differences in the neural encoding of PEs may influence the balance between approach-avoidance learning. Recent correlational approaches also indicate that biases in approach-avoidance learning involve hemispheric asymmetries in dopamine function. However, the computational and neural mechanisms underpinning such learning biases remain unknown. Here we assessed hemispheric reward asymmetry in striatal activity in 34 human participants who performed a task involving rewards and punishments. We show that the relative difference in reward response between hemispheres relates to individual biases in approach-avoidance learning. Moreover, using a computational modeling approach, we demonstrate that better encoding of positive (vs negative) PEs in dopaminergic midbrain regions is associated with better approach (vs avoidance) learning, specifically in participants with larger reward responses in the left (vs right) ventral striatum. Thus, individual dispositions or traits may be determined by neural processes acting to constrain learning about specific aspects of the world. Copyright © 2015 the authors 0270-6474/15/3514491-10$15.00/0.

Acetylcholine Activity in Selective Striatal Regions Supports Behavioral Flexibility

PubMed Central

Ragozzino, Michael E.; Mohler, Eric G.; Prior, Margaret; Palencia, Carlos A.; Rozman, Suzanne

2009-01-01

Daily living often requires individuals to flexibly respond to new circumstances. There is considerable evidence that the striatum is part of a larger neural network that supports flexible adaptations. Cholinergic interneurons are situated to strongly influence striatal output patterns which may enable flexible adaptations. The present experiments investigated whether acetylcholine actions in different striatal regions support behavioral flexibility by measuring acetylcholine efflux during place reversal learning. Acetylcholine efflux selectively increased in the dorsomedial striatum, but not dorsolateral or ventromedial striatum during place reversal learning. In order to modulate the M2-class of autoreceptors, administration of oxotremorine sesquifumurate (100 nM) into the dorsomedial striatum, concomitantly impaired reversal learning and an increase in acetylcholine output. These effects were reversed by the m2 muscarinic receptor antagonist, AF-DX-116 (20 nM). The effects of oxotremorine sesquifumurate and AF-DX-116 on acetylcholine efflux were selective to behaviorally-induced changes as neither treatment affected acetylcholine output in a resting condition. In contrast to reversal learning, acetylcholine efflux in the dorsomedial striatum did not change during place acquisition. The results reveal an essential role for cholinergic activity and define its locus of control to the dorsomedial striatum in cognitive flexibility. PMID:18845266

Acetylcholine activity in selective striatal regions supports behavioral flexibility.

PubMed

Ragozzino, Michael E; Mohler, Eric G; Prior, Margaret; Palencia, Carlos A; Rozman, Suzanne

2009-01-01

Daily living often requires individuals to flexibly respond to new circumstances. There is considerable evidence that the striatum is part of a larger neural network that supports flexible adaptations. Cholinergic interneurons are situated to strongly influence striatal output patterns which may enable flexible adaptations. The present experiments investigated whether acetylcholine actions in different striatal regions support behavioral flexibility by measuring acetylcholine efflux during place reversal learning. Acetylcholine efflux selectively increased in the dorsomedial striatum, but not dorsolateral or ventromedial striatum during place reversal learning. In order to modulate the M2-class of autoreceptors, administration of oxotremorine sesquifumurate (100 nM) into the dorsomedial striatum, concomitantly impaired reversal learning and an increase in acetylcholine output. These effects were reversed by the m(2) muscarinic receptor antagonist, AF-DX-116 (20 nM). The effects of oxotremorine sesquifumurate and AF-DX-116 on acetylcholine efflux were selective to behaviorally-induced changes as neither treatment affected acetylcholine output in a resting condition. In contrast to reversal learning, acetylcholine efflux in the dorsomedial striatum did not change during place acquisition. The results reveal an essential role for cholinergic activity and define its locus of control to the dorsomedial striatum in cognitive flexibility.

Humanized Foxp2 accelerates learning by enhancing transitions from declarative to procedural performance.

PubMed

Schreiweis, Christiane; Bornschein, Ulrich; Burguière, Eric; Kerimoglu, Cemil; Schreiter, Sven; Dannemann, Michael; Goyal, Shubhi; Rea, Ellis; French, Catherine A; Puliyadi, Rathi; Groszer, Matthias; Fisher, Simon E; Mundry, Roger; Winter, Christine; Hevers, Wulf; Pääbo, Svante; Enard, Wolfgang; Graybiel, Ann M

2014-09-30

The acquisition of language and speech is uniquely human, but how genetic changes might have adapted the nervous system to this capacity is not well understood. Two human-specific amino acid substitutions in the transcription factor forkhead box P2 (FOXP2) are outstanding mechanistic candidates, as they could have been positively selected during human evolution and as FOXP2 is the sole gene to date firmly linked to speech and language development. When these two substitutions are introduced into the endogenous Foxp2 gene of mice (Foxp2(hum)), cortico-basal ganglia circuits are specifically affected. Here we demonstrate marked effects of this humanization of Foxp2 on learning and striatal neuroplasticity. Foxp2(hum/hum) mice learn stimulus-response associations faster than their WT littermates in situations in which declarative (i.e., place-based) and procedural (i.e., response-based) forms of learning could compete during transitions toward proceduralization of action sequences. Striatal districts known to be differently related to these two modes of learning are affected differently in the Foxp2(hum/hum) mice, as judged by measures of dopamine levels, gene expression patterns, and synaptic plasticity, including an NMDA receptor-dependent form of long-term depression. These findings raise the possibility that the humanized Foxp2 phenotype reflects a different tuning of corticostriatal systems involved in declarative and procedural learning, a capacity potentially contributing to adapting the human brain for speech and language acquisition.

Parallel, but Dissociable, Processing in Discrete Corticostriatal Inputs Encodes Skill Learning.

PubMed

Kupferschmidt, David A; Juczewski, Konrad; Cui, Guohong; Johnson, Kari A; Lovinger, David M

2017-10-11

Changes in cortical and striatal function underlie the transition from novel actions to refined motor skills. How discrete, anatomically defined corticostriatal projections function in vivo to encode skill learning remains unclear. Using novel fiber photometry approaches to assess real-time activity of associative inputs from medial prefrontal cortex to dorsomedial striatum and sensorimotor inputs from motor cortex to dorsolateral striatum, we show that associative and sensorimotor inputs co-engage early in action learning and disengage in a dissociable manner as actions are refined. Disengagement of associative, but not sensorimotor, inputs predicts individual differences in subsequent skill learning. Divergent somatic and presynaptic engagement in both projections during early action learning suggests potential learning-related in vivo modulation of presynaptic corticostriatal function. These findings reveal parallel processing within associative and sensorimotor circuits that challenges and refines existing views of corticostriatal function and expose neuronal projection- and compartment-specific activity dynamics that encode and predict action learning. Published by Elsevier Inc.

Erasing the engram: the unlearning of procedural skills.

PubMed

Crossley, Matthew J; Ashby, F Gregory; Maddox, W Todd

2013-08-01

Huge amounts of money are spent every year on unlearning programs--in drug-treatment facilities, prisons, psychotherapy clinics, and schools. Yet almost all of these programs fail, since recidivism rates are high in each of these fields. Progress on this problem requires a better understanding of the mechanisms that make unlearning so difficult. Much cognitive neuroscience evidence suggests that an important component of these mechanisms also dictates success on categorization tasks that recruit procedural learning and depend on synaptic plasticity within the striatum. A biologically detailed computational model of this striatal-dependent learning is described (based on Ashby & Crossley, 2011). The model assumes that a key component of striatal-dependent learning is provided by interneurons in the striatum called the tonically active neurons (TANs), which act as a gate for the learning and expression of striatal-dependent behaviors. In their tonically active state, the TANs prevent the expression of any striatal-dependent behavior. However, they learn to pause in rewarding environments and thereby permit the learning and expression of striatal-dependent behaviors. The model predicts that when rewards are no longer contingent on behavior, the TANs cease to pause, which protects striatal learning from decay and prevents unlearning. In addition, the model predicts that when rewards are partially contingent on behavior, the TANs remain partially paused, leaving the striatum available for unlearning. The results from 3 human behavioral studies support the model predictions and suggest a novel unlearning protocol that shows promising initial signs of success. PsycINFO Database Record (c) 2013 APA, all rights reserved.

Normative development of ventral striatal resting state connectivity in humans.

PubMed

Fareri, Dominic S; Gabard-Durnam, Laurel; Goff, Bonnie; Flannery, Jessica; Gee, Dylan G; Lumian, Daniel S; Caldera, Christina; Tottenham, Nim

2015-09-01

Incentives play a crucial role in guiding behavior throughout our lives, but perhaps no more so than during the early years of life. The ventral striatum is a critical piece of an incentive-based learning circuit, sharing robust anatomical connections with subcortical (e.g., amygdala, hippocampus) and cortical structures (e.g., medial prefrontal cortex (mPFC), insula) that collectively support incentive valuation and learning. Resting-state functional connectivity (rsFC) is a powerful method that provides insight into the development of the functional architecture of these connections involved in incentive-based learning. We employed a seed-based correlation approach to investigate ventral striatal rsFC in a cross-sectional sample of typically developing individuals between the ages of 4.5 and 23-years old (n=66). Ventral striatal rsFC with the mPFC showed regionally specific linear age-related changes in connectivity that were associated with age-related increases in circulating testosterone levels. Further, ventral striatal connectivity with the posterior hippocampus and posterior insula demonstrated quadratic age-related changes characterized by negative connectivity in adolescence. Finally, across this age range, the ventral striatum demonstrated positive coupling with the amygdala beginning during childhood and remaining consistently positive across age. In sum, our findings suggest that normative ventral striatal rsFC development is dynamic and characterized by early establishment of connectivity with medial prefrontal and limbic structures supporting incentive-based learning, as well as substantial functional reorganization with later developing regions during transitions into and out of adolescence. Copyright © 2015. Published by Elsevier Inc.

Dissociable contribution of prefrontal and striatal dopaminergic genes to learning in economic games

PubMed Central

Set, Eric; Saez, Ignacio; Zhu, Lusha; Houser, Daniel E.; Myung, Noah; Zhong, Songfa; Ebstein, Richard P.; Chew, Soo Hong; Hsu, Ming

2014-01-01

Game theory describes strategic interactions where success of players’ actions depends on those of coplayers. In humans, substantial progress has been made at the neural level in characterizing the dopaminergic and frontostriatal mechanisms mediating such behavior. Here we combined computational modeling of strategic learning with a pathway approach to characterize association of strategic behavior with variations in the dopamine pathway. Specifically, using gene-set analysis, we systematically examined contribution of different dopamine genes to variation in a multistrategy competitive game captured by (i) the degree players anticipate and respond to actions of others (belief learning) and (ii) the speed with which such adaptations take place (learning rate). We found that variation in genes that primarily regulate prefrontal dopamine clearance—catechol-O-methyl transferase (COMT) and two isoforms of monoamine oxidase—modulated degree of belief learning across individuals. In contrast, we did not find significant association for other genes in the dopamine pathway. Furthermore, variation in genes that primarily regulate striatal dopamine function—dopamine transporter and D2 receptors—was significantly associated with the learning rate. We found that this was also the case with COMT, but not for other dopaminergic genes. Together, these findings highlight dissociable roles of frontostriatal systems in strategic learning and support the notion that genetic variation, organized along specific pathways, forms an important source of variation in complex phenotypes such as strategic behavior. PMID:24979760

Dissociable contribution of prefrontal and striatal dopaminergic genes to learning in economic games.

PubMed

Set, Eric; Saez, Ignacio; Zhu, Lusha; Houser, Daniel E; Myung, Noah; Zhong, Songfa; Ebstein, Richard P; Chew, Soo Hong; Hsu, Ming

2014-07-01

Game theory describes strategic interactions where success of players' actions depends on those of coplayers. In humans, substantial progress has been made at the neural level in characterizing the dopaminergic and frontostriatal mechanisms mediating such behavior. Here we combined computational modeling of strategic learning with a pathway approach to characterize association of strategic behavior with variations in the dopamine pathway. Specifically, using gene-set analysis, we systematically examined contribution of different dopamine genes to variation in a multistrategy competitive game captured by (i) the degree players anticipate and respond to actions of others (belief learning) and (ii) the speed with which such adaptations take place (learning rate). We found that variation in genes that primarily regulate prefrontal dopamine clearance--catechol-O-methyl transferase (COMT) and two isoforms of monoamine oxidase--modulated degree of belief learning across individuals. In contrast, we did not find significant association for other genes in the dopamine pathway. Furthermore, variation in genes that primarily regulate striatal dopamine function--dopamine transporter and D2 receptors--was significantly associated with the learning rate. We found that this was also the case with COMT, but not for other dopaminergic genes. Together, these findings highlight dissociable roles of frontostriatal systems in strategic learning and support the notion that genetic variation, organized along specific pathways, forms an important source of variation in complex phenotypes such as strategic behavior.

A Neurocomputational model of tonic and phasic dopamine in action selection: A comparison with cognitive deficits in Parkinson’s disease

PubMed Central

Guthrie, M.; Myers, C.E.; Gluck, M.A.

2015-01-01

The striatal dopamine signal has multiple facets; tonic level, phasic rise and fall, and variation of the phasic rise/fall depending on the expectation of reward/punishment. We have developed a network model of the striatal direct pathway using an ionic current level model of the medium spiny neuron that incorporates currents sensitive to changes in the tonic level of dopamine. The model neurons in the network learn action selection based on a novel set of mathematical rules that incorporate the phasic change in the dopamine signal. This network model is capable of learning to perform a sequence learning task that in humans is thought to be dependent on the basal ganglia. When both tonic and phasic levels of dopamine are decreased, as would be expected in unmedicated Parkinson’s disease (PD), the model reproduces the deficits seen in a human PD group off medication. When the tonic level is increased to normal, but with reduced phasic increases and decreases in response to reward and punishment respectively, as would be expected in PD medicated with L-Dopa, the model again reproduces the human data. These findings support the view that the cognitive dysfunctions seen in Parkinson’s disease are not solely due to either the decreased tonic level of dopamine or to the decreased responsiveness of the phasic dopamine signal to reward and punishment, but to a combination of the two factors that varies dependent on disease stage and medication status. PMID:19162084

Ventral striatum response during reward and punishment reversal learning in unmedicated major depressive disorder.

PubMed

Robinson, Oliver J; Cools, Roshan; Carlisi, Christina O; Sahakian, Barbara J; Drevets, Wayne C

2012-02-01

Affective biases may underlie many of the key symptoms of major depressive disorder, from anhedonia to altered cognitive performance. Understanding the cause of these biases is therefore critical in the quest for improved treatments. Depression is associated, for example, with a negative affective bias in reversal learning. However, despite the fact that reversal learning is associated with striatal response in healthy individuals and depressed individuals exhibit attenuated striatal function on multiple tasks, studies to date have not demonstrated striatal involvement in the negative bias in reversal learning in depression. In this study, the authors sought to determine whether this may be because reversal learning tasks conventionally used to study behavior examine reversals only on the basis of unexpected punishment and therefore do not adequately separate reward- and punishment-based behavior. The authors used functional MRI to compare the hemodynamic response to a reversal learning task with mixed reward- and punishment-based reversal stages between individuals with unmedicated major depressive disorder (N=13) and healthy comparison subjects (N=14). Impaired reward (but not punishment) reversal accuracy was found alongside attenuated anteroventral striatal response to unexpected reward in depression. Attenuated neurophysiological response of the anteroventral striatum may reflect dysfunction in circuits involving afferent projections from the orbitofrontal, limbic, and/or mesostriatal dopaminergic pathways, which conceivably may, together with the ventral striatum, underlie anhedonia in depression. Learning to appreciate and enjoy positive life experiences is critical for recovery from depression. This study pinpoints a neural target for such recovery.

Adult Age Differences in Learning from Positive and Negative Probabilistic Feedback

PubMed Central

Simon, Jessica R.; Howard, James H.; Howard, Darlene V.

2010-01-01

Objective Past research has investigated age differences in frontal-based decision making, but few studies have focused on the behavioral effects of striatal-based changes in healthy aging. Feedback learning has been found to vary with dopamine levels; increases in dopamine facilitate learning from positive feedback, whereas decreases facilitate learning from negative feedback. Given previous evidence of striatal dopamine depletion in healthy aging, we investigated behavioral differences between college-aged and healthy old adults using a feedback learning task that is sensitive to both frontal and striatal processes. Method Seventeen college-aged (M = 18.9 years) and 24 healthy, older adults (M = 70.3 years) completed the Probabilistic selection task, in which participants are trained on probabilistic stimulus-outcome information and then tested to determine whether they learned more from positive or negative feedback. Results As a group, the old adults learned equally well from positive and negative feedback, whereas the college-aged group learned more from positive than negative feedback, F(1, 39) = 4.10, p < .05, reffect = .3. However, these group differences were not due to the older individuals being more balanced learners. Most individuals of both ages were balanced learners, but while all of the remaining young learners had a positive bias, the remaining older learners were split between those with positive and negative learning biases (χ2(2) = 6.12, p<.047). Conclusions These behavioral results are consistent with the dopamine theory of striatal aging, and suggest there might be adult age differences in the kinds of information people use when faced with a current choice. PMID:20604627

A corticostriatal deficit promotes temporal distortion of automatic action in ageing

PubMed Central

Matamales, Miriam; Skrbis, Zala; Bailey, Matthew R; Balsam, Peter D; Balleine, Bernard W; Götz, Jürgen

2017-01-01

The acquisition of motor skills involves implementing action sequences that increase task efficiency while reducing cognitive loads. This learning capacity depends on specific cortico-basal ganglia circuits that are affected by normal ageing. Here, combining a series of novel behavioural tasks with extensive neuronal mapping and targeted cell manipulations in mice, we explored how ageing of cortico-basal ganglia networks alters the microstructure of action throughout sequence learning. We found that, after extended training, aged mice produced shorter actions and displayed squeezed automatic behaviours characterised by ultrafast oligomeric action chunks that correlated with deficient reorganisation of corticostriatal activity. Chemogenetic disruption of a striatal subcircuit in young mice reproduced age-related within-sequence features, and the introduction of an action-related feedback cue temporarily restored normal sequence structure in aged mice. Our results reveal static properties of aged cortico-basal ganglia networks that introduce temporal limits to action automaticity, something that can compromise procedural learning in ageing. PMID:29058672

Ventral Striatum Response During Reward and Punishment Reversal Learning in Unmedicated Major Depressive Disorder

PubMed Central

Robinson, Oliver J.; Cools, Roshan; Carlisi, Christina O.; Sahakian, Barbara J.; Drevets, Wayne C.

2017-01-01

Objective Affective biases may underlie many of the key symptoms of major depressive disorder, from anhedonia to altered cognitive performance. Understanding the cause of these biases is therefore critical in the quest for improved treatments. Depression is associated, for example, with a negative affective bias in reversal learning. However, despite the fact that reversal learning is associated with striatal response in healthy individuals and depressed individuals exhibit attenuated striatal function on multiple tasks, studies to date have not demonstrated striatal involvement in the negative bias in reversal learning in depression. In this study, the authors sought to determine whether this may be because reversal learning tasks conventionally used to study behavior examine reversals only on the basis of unexpected punishment and therefore do not adequately separate reward- and punishment-based behavior. Method The authors used functional MRI to com pare the hemodynamic response to a reversal learning task with mixed reward- and punishment-based reversal stages between individuals with unmedicated major depressive disorder (N=13) and healthy comparison subjects (N=14). Results Impaired reward (but not punishment) reversal accuracy was found alongside attenuated anteroventral striatal response to unexpected reward in depression. Conclusions Attenuated neurophysiological response of the anteroventral striatum may reflect dysfunction in circuits involving afferent projections from the orbitofrontal, limbic, and/or mesostriatal dopaminergic pathways, which conceivably may, together with the ventral striatum, underlie anhedonia in depression. Learning to appreciate and enjoy positive life experiences is critical for recovery from depression. This study pinpoints a neural target for such recovery. PMID:22420038

Changes in Striatal Dopamine Release Associated with Human Motor-Skill Acquisition

PubMed Central

Kawashima, Shoji; Ueki, Yoshino; Kato, Takashi; Matsukawa, Noriyuki; Mima, Tatsuya; Hallett, Mark; Ito, Kengo; Ojika, Kosei

2012-01-01

The acquisition of new motor skills is essential throughout daily life and involves the processes of learning new motor sequence and encoding elementary aspects of new movement. Although previous animal studies have suggested a functional importance for striatal dopamine release in the learning of new motor sequence, its role in encoding elementary aspects of new movement has not yet been investigated. To elucidate this, we investigated changes in striatal dopamine levels during initial skill-training (Day 1) compared with acquired conditions (Day 2) using 11C-raclopride positron-emission tomography. Ten volunteers learned to perform brisk contractions using their non-dominant left thumbs with the aid of visual feedback. On Day 1, the mean acceleration of each session was improved through repeated training sessions until performance neared asymptotic levels, while improved motor performance was retained from the beginning on Day 2. The 11C-raclopride binding potential (BP) in the right putamen was reduced during initial skill-training compared with under acquired conditions. Moreover, voxel-wise analysis revealed that 11C-raclopride BP was particularly reduced in the right antero-dorsal to the lateral part of the putamen. Based on findings from previous fMRI studies that show a gradual shift of activation within the striatum during the initial processing of motor learning, striatal dopamine may play a role in the dynamic cortico-striatal activation during encoding of new motor memory in skill acquisition. PMID:22355391

Substance P and dopamine interact to modulate the distribution of delta-opioid receptors on cholinergic interneurons in the striatum.

PubMed

Heath, Emily; Chieng, Billy; Christie, Macdonald J; Balleine, Bernard W

2018-05-01

It has been recently demonstrated that predictive learning induces a persistent accumulation of delta-opioid receptors (DOPrs) at the somatic membrane of cholinergic interneurons (CINs) in the nucleus accumbens shell (Nac-S). This accumulation is required for predictive learning to influence subsequent choice between goal-directed actions. The current experiments investigated the local neurochemical events responsible for this translocation. We found that (1) local administration of substance P into multiple striatal sub-territories induced DOPr translocation and (2) that this effect was mediated by the NK1 receptor, likely through its expression on CINs. Interestingly, whereas intrastriatal infusion of the D1 agonist chloro-APB reduced the DOPr translocation on CINs and infusion of the D2 agonist quinpirole had no effect, co-administration of both agonists again generated DOPr translocation, suggesting the effect of the D1 agonist alone was due to receptor internalisation. In support of this, local administration of cocaine was found to increase DOPr translocation as was chloro-APB when co-administered with the DOPr antagonist naltrindole. These studies provide the first evidence of delta-opioid receptor translocation in striatal cholinergic interneurons outside of the accumbens shell and suggest that, despite differences in local striatal neurochemical microenvironments, a similar molecular mechanism - involving an interaction between dopamine and SP signalling via NK1R - regulates DOPr translocation in multiple striatal regions. To our knowledge, this represents a novel mechanism by which DOPr distribution is regulated that may be particularly relevant to learning-induced DOPr trafficking. © 2017 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

Altered cingulo-striatal function underlies reward drive deficits in schizophrenia.

PubMed

Park, Il Ho; Chun, Ji Won; Park, Hae-Jeong; Koo, Min-Seong; Park, Sunyoung; Kim, Seok-Hyeong; Kim, Jae-Jin

2015-02-01

Amotivation in schizophrenia is assumed to involve dysfunctional dopaminergic signaling of reward prediction or anticipation. It is unclear, however, whether the translation of neural representation of reward value to behavioral drive is affected in schizophrenia. In order to examine how abnormal neural processing of response valuation and initiation affects incentive motivation in schizophrenia, we conducted functional MRI using a deterministic reinforcement learning task with variable intervals of contingency reversals in 20 clinically stable patients with schizophrenia and 20 healthy controls. Behaviorally, the advantage of positive over negative reinforcer in reinforcement-related responsiveness was not observed in patients. Patients showed altered response valuation and initiation-related striatal activity and deficient rostro-ventral anterior cingulate cortex activation during reward approach initiation. Among these neural abnormalities, rostro-ventral anterior cingulate cortex activation was correlated with positive reinforcement-related responsiveness in controls and social anhedonia and social amotivation subdomain scores in patients. Our findings indicate that the central role of the anterior cingulate cortex is in translating action value into driving force of action, and underscore the role of the cingulo-striatal network in amotivation in schizophrenia. Copyright © 2014 Elsevier B.V. All rights reserved.

Distinct prediction errors in mesostriatal circuits of the human brain mediate learning about the values of both states and actions: evidence from high-resolution fMRI.

PubMed

Colas, Jaron T; Pauli, Wolfgang M; Larsen, Tobias; Tyszka, J Michael; O'Doherty, John P

2017-10-01

Prediction-error signals consistent with formal models of "reinforcement learning" (RL) have repeatedly been found within dopaminergic nuclei of the midbrain and dopaminoceptive areas of the striatum. However, the precise form of the RL algorithms implemented in the human brain is not yet well determined. Here, we created a novel paradigm optimized to dissociate the subtypes of reward-prediction errors that function as the key computational signatures of two distinct classes of RL models-namely, "actor/critic" models and action-value-learning models (e.g., the Q-learning model). The state-value-prediction error (SVPE), which is independent of actions, is a hallmark of the actor/critic architecture, whereas the action-value-prediction error (AVPE) is the distinguishing feature of action-value-learning algorithms. To test for the presence of these prediction-error signals in the brain, we scanned human participants with a high-resolution functional magnetic-resonance imaging (fMRI) protocol optimized to enable measurement of neural activity in the dopaminergic midbrain as well as the striatal areas to which it projects. In keeping with the actor/critic model, the SVPE signal was detected in the substantia nigra. The SVPE was also clearly present in both the ventral striatum and the dorsal striatum. However, alongside these purely state-value-based computations we also found evidence for AVPE signals throughout the striatum. These high-resolution fMRI findings suggest that model-free aspects of reward learning in humans can be explained algorithmically with RL in terms of an actor/critic mechanism operating in parallel with a system for more direct action-value learning.

Reward-based spatial learning in unmedicated adults with obsessive-compulsive disorder.

PubMed

Marsh, Rachel; Tau, Gregory Z; Wang, Zhishun; Huo, Yuankai; Liu, Ge; Hao, Xuejun; Packard, Mark G; Peterson, Bradley S; Simpson, H Blair

2015-04-01

The authors assessed the functioning of mesolimbic and striatal areas involved in reward-based spatial learning in unmedicated adults with obsessive-compulsive disorder (OCD). Functional MRI blood-oxygen-level-dependent response was compared in 33 unmedicated adults with OCD and 33 healthy, age-matched comparison subjects during a reward-based learning task that required learning to use extramaze cues to navigate a virtual eight-arm radial maze to find hidden rewards. The groups were compared in their patterns of brain activation associated with reward-based spatial learning versus a control condition in which rewards were unexpected because they were allotted pseudorandomly to experimentally prevent learning. Both groups learned to navigate the maze to find hidden rewards, but group differences in neural activity during navigation and reward processing were detected in mesolimbic and striatal areas. During navigation, the OCD group, unlike the healthy comparison group, exhibited activation in the left posterior hippocampus. Unlike healthy subjects, participants in the OCD group did not show activation in the left ventral putamen and amygdala when anticipating rewards or in the left hippocampus, amygdala, and ventral putamen when receiving unexpected rewards (control condition). Signal in these regions decreased relative to baseline during unexpected reward receipt among those in the OCD group, and the degree of activation was inversely associated with doubt/checking symptoms. Participants in the OCD group displayed abnormal recruitment of mesolimbic and ventral striatal circuitry during reward-based spatial learning. Whereas healthy comparison subjects exhibited activation in this circuitry in response to the violation of reward expectations, unmedicated OCD participants did not and instead over-relied on the posterior hippocampus during learning. Thus, dopaminergic innervation of reward circuitry may be altered, and future study of anterior/posterior hippocampal dysfunction in OCD is warranted.

Reward-Based Spatial Learning in Teens With Bulimia Nervosa

PubMed Central

Cyr, Marilyn; Wang, Zhishun; Tau, Gregory Z.; Zhao, Guihu; Friedl, Eve; Stefan, Mihaela; Terranova, Kate; Marsh, Rachel

2016-01-01

Objective To assess the functioning of mesolimbic and fronto-striatal areas involved in reward-based spatial learning in teenaged girls with bulimia nervosa (BN) that might be involved in the development and maintenance of maladaptive behaviors characteristic of the disorder. Method We compared functional magnetic resonance imaging blood oxygen level dependent response in 27 adolescent girls with BN to that of 27 healthy, age-matched control participants during a reward-based learning task that required learning to use extra-maze cues to navigate a virtual 8-arm radial maze to find hidden rewards. We compared groups in their patterns of brain activation associated with reward-based spatial learning versus a control condition in which rewards were unexpected because they were allotted pseudo-randomly to experimentally prevent learning. Results Both groups learned to navigate the maze to find hidden rewards, but group differences in brain activity associated with maze navigation and reward processing were detected in fronto-striatal regions and right anterior hippocampus. Unlike healthy adolescents, those with BN did not engage right inferior frontal gyrus during maze navigation, activated right anterior hippocampus during the receipt of unexpected rewards (control condition), and deactivated left superior frontal gyrus and right anterior hippocampus during expected reward receipt (learning condition). These patterns of hippocampal activation in the control condition were significantly associated with the frequency of binge-eating episodes. Conclusion Adolescents with BN displayed abnormal functioning of anterior hippocampus and fronto-striatal regions during reward-based spatial learning. These findings suggest that an imbalance in control and reward circuits may arise early in the course of BN. Clinical trial registration information An fMRI Study of Self-regulation in Adolescents With Bulimia Nervosa; https://clinicaltrials.gov/ct2/show/NCT00345943; NCT00345943. PMID:27806864

Distinct prediction errors in mesostriatal circuits of the human brain mediate learning about the values of both states and actions: evidence from high-resolution fMRI

PubMed Central

Pauli, Wolfgang M.; Larsen, Tobias; Tyszka, J. Michael; O’Doherty, John P.

2017-01-01

Prediction-error signals consistent with formal models of “reinforcement learning” (RL) have repeatedly been found within dopaminergic nuclei of the midbrain and dopaminoceptive areas of the striatum. However, the precise form of the RL algorithms implemented in the human brain is not yet well determined. Here, we created a novel paradigm optimized to dissociate the subtypes of reward-prediction errors that function as the key computational signatures of two distinct classes of RL models—namely, “actor/critic” models and action-value-learning models (e.g., the Q-learning model). The state-value-prediction error (SVPE), which is independent of actions, is a hallmark of the actor/critic architecture, whereas the action-value-prediction error (AVPE) is the distinguishing feature of action-value-learning algorithms. To test for the presence of these prediction-error signals in the brain, we scanned human participants with a high-resolution functional magnetic-resonance imaging (fMRI) protocol optimized to enable measurement of neural activity in the dopaminergic midbrain as well as the striatal areas to which it projects. In keeping with the actor/critic model, the SVPE signal was detected in the substantia nigra. The SVPE was also clearly present in both the ventral striatum and the dorsal striatum. However, alongside these purely state-value-based computations we also found evidence for AVPE signals throughout the striatum. These high-resolution fMRI findings suggest that model-free aspects of reward learning in humans can be explained algorithmically with RL in terms of an actor/critic mechanism operating in parallel with a system for more direct action-value learning. PMID:29049406

Generalization of value in reinforcement learning by humans.

PubMed

Wimmer, G Elliott; Daw, Nathaniel D; Shohamy, Daphna

2012-04-01

Research in decision-making has focused on the role of dopamine and its striatal targets in guiding choices via learned stimulus-reward or stimulus-response associations, behavior that is well described by reinforcement learning theories. However, basic reinforcement learning is relatively limited in scope and does not explain how learning about stimulus regularities or relations may guide decision-making. A candidate mechanism for this type of learning comes from the domain of memory, which has highlighted a role for the hippocampus in learning of stimulus-stimulus relations, typically dissociated from the role of the striatum in stimulus-response learning. Here, we used functional magnetic resonance imaging and computational model-based analyses to examine the joint contributions of these mechanisms to reinforcement learning. Humans performed a reinforcement learning task with added relational structure, modeled after tasks used to isolate hippocampal contributions to memory. On each trial participants chose one of four options, but the reward probabilities for pairs of options were correlated across trials. This (uninstructed) relationship between pairs of options potentially enabled an observer to learn about option values based on experience with the other options and to generalize across them. We observed blood oxygen level-dependent (BOLD) activity related to learning in the striatum and also in the hippocampus. By comparing a basic reinforcement learning model to one augmented to allow feedback to generalize between correlated options, we tested whether choice behavior and BOLD activity were influenced by the opportunity to generalize across correlated options. Although such generalization goes beyond standard computational accounts of reinforcement learning and striatal BOLD, both choices and striatal BOLD activity were better explained by the augmented model. Consistent with the hypothesized role for the hippocampus in this generalization, functional connectivity between the ventral striatum and hippocampus was modulated, across participants, by the ability of the augmented model to capture participants' choice. Our results thus point toward an interactive model in which striatal reinforcement learning systems may employ relational representations typically associated with the hippocampus. © 2012 The Authors. European Journal of Neuroscience © 2012 Federation of European Neuroscience Societies and Blackwell Publishing Ltd.

Generalization of value in reinforcement learning by humans

PubMed Central

Wimmer, G. Elliott; Daw, Nathaniel D.; Shohamy, Daphna

2012-01-01

Research in decision making has focused on the role of dopamine and its striatal targets in guiding choices via learned stimulus-reward or stimulus-response associations, behavior that is well-described by reinforcement learning (RL) theories. However, basic RL is relatively limited in scope and does not explain how learning about stimulus regularities or relations may guide decision making. A candidate mechanism for this type of learning comes from the domain of memory, which has highlighted a role for the hippocampus in learning of stimulus-stimulus relations, typically dissociated from the role of the striatum in stimulus-response learning. Here, we used fMRI and computational model-based analyses to examine the joint contributions of these mechanisms to RL. Humans performed an RL task with added relational structure, modeled after tasks used to isolate hippocampal contributions to memory. On each trial participants chose one of four options, but the reward probabilities for pairs of options were correlated across trials. This (uninstructed) relationship between pairs of options potentially enabled an observer to learn about options’ values based on experience with the other options and to generalize across them. We observed BOLD activity related to learning in the striatum and also in the hippocampus. By comparing a basic RL model to one augmented to allow feedback to generalize between correlated options, we tested whether choice behavior and BOLD activity were influenced by the opportunity to generalize across correlated options. Although such generalization goes beyond standard computational accounts of RL and striatal BOLD, both choices and striatal BOLD were better explained by the augmented model. Consistent with the hypothesized role for the hippocampus in this generalization, functional connectivity between the ventral striatum and hippocampus was modulated, across participants, by the ability of the augmented model to capture participants’ choice. Our results thus point toward an interactive model in which striatal RL systems may employ relational representations typically associated with the hippocampus. PMID:22487039

Dopamine Dependence in Aggregate Feedback Learning: A Computational Cognitive Neuroscience Approach

PubMed Central

Valentin, Vivian V.; Maddox, W. Todd; Ashby, F. Gregory

2016-01-01

Procedural learning of skills depends on dopamine-mediated striatal plasticity. Most prior work investigated single stimulus-response procedural learning followed by feedback. However, many skills include several actions that must be performed before feedback is available. A new procedural-learning task is developed in which three independent and successive unsupervised categorization responses receive aggregate feedback indicating either that all three responses were correct, or at least one response was incorrect. Experiment 1 showed superior learning of stimuli in position 3, and that learning in the first two positions was initially compromised, and then recovered. An extensive theoretical analysis that used parameter space partitioning found that a large class of procedural-learning models, which predict propagation of dopamine release from feedback to stimuli, and/or an eligibility trace, fail to fully account for these data. The analysis also suggested that any dopamine released to the second or third stimulus impaired categorization learning in the first and second positions. A second experiment tested and confirmed a novel prediction of this large class of procedural-learning models that if the to-be-learned actions are introduced one-by-one in succession then learning is much better if training begins with the first action (and works forwards) than if it begins with the last action (and works backwards). PMID:27596541

Levodopa administration modulates striatal processing of punishment-associated items in healthy participants.

PubMed

Wittmann, Bianca C; D'Esposito, Mark

2015-01-01

Appetitive and aversive processes share a number of features such as their relevance for action and learning. On a neural level, reward and its predictors are associated with increased firing of dopaminergic neurons, whereas punishment processing has been linked to the serotonergic system and to decreases in dopamine transmission. Recent data indicate, however, that the dopaminergic system also responds to aversive stimuli and associated actions. In this pharmacological functional magnetic resonance imaging study, we investigated the contribution of the dopaminergic system to reward and punishment processing in humans. Two groups of participants received either placebo or the dopamine precursor levodopa and were scanned during alternating reward and punishment anticipation blocks. Levodopa administration increased striatal activations for cues presented in punishment blocks. In an interaction with individual personality scores, levodopa also enhanced striatal activation for punishment-predictive compared with neutral cues in participants scoring higher on the novelty-seeking dimension. These data support recent indications that dopamine contributes to punishment processing and suggest that the novelty-seeking trait is a measure of susceptibility to drug effects on motivation. These findings are also consistent with the possibility of an inverted U-shaped response function of dopamine in the striatum, suggesting an optimal level of dopamine release for motivational processing.

Levodopa administration modulates striatal processing of punishment-associated items in healthy participants

PubMed Central

Wittmann, Bianca C.; D’Esposito, Mark

2014-01-01

Rationale Appetitive and aversive processes share a number of features such as their relevance for action and learning. On a neural level, reward and its predictors are associated with increased firing of dopaminergic neurons, whereas punishment processing has been linked to the serotonergic system and to decreases in dopamine transmission. Recent data indicate, however, that the dopaminergic system also responds to aversive stimuli and associated actions. Objectives In this pharmacological functional magnetic resonance imaging (fMRI) study, we investigated the contribution of the dopaminergic system to reward and punishment processing in humans. Methods Two groups of participants received either placebo or the dopamine precursor levodopa and were scanned during alternating reward and punishment anticipation blocks. Results Levodopa administration increased striatal activations for cues presented in punishment blocks. In an interaction with individual personality scores, levodopa also enhanced striatal activation for punishment-predictive compared to neutral cues in participants scoring higher on the novelty-seeking dimension. Conclusions These data support recent indications that dopamine contributes to punishment processing and suggest that the novelty-seeking trait is a measure of susceptibility to drug effects on motivation. These findings are also consistent with the possibility of an inverted U-shaped response function of dopamine in the striatum, suggesting an optimal level of dopamine release for motivational processing. PMID:24923987

Human reinforcement learning subdivides structured action spaces by learning effector-specific values

PubMed Central

Gershman, Samuel J.; Pesaran, Bijan; Daw, Nathaniel D.

2009-01-01

Humans and animals are endowed with a large number of effectors. Although this enables great behavioral flexibility, it presents an equally formidable reinforcement learning problem of discovering which actions are most valuable, due to the high dimensionality of the action space. An unresolved question is how neural systems for reinforcement learning – such as prediction error signals for action valuation associated with dopamine and the striatum – can cope with this “curse of dimensionality.” We propose a reinforcement learning framework that allows for learned action valuations to be decomposed into effector-specific components when appropriate to a task, and test it by studying to what extent human behavior and BOLD activity can exploit such a decomposition in a multieffector choice task. Subjects made simultaneous decisions with their left and right hands and received separate reward feedback for each hand movement. We found that choice behavior was better described by a learning model that decomposed the values of bimanual movements into separate values for each effector, rather than a traditional model that treated the bimanual actions as unitary with a single value. A decomposition of value into effector-specific components was also observed in value-related BOLD signaling, in the form of lateralized biases in striatal correlates of prediction error and anticipatory value correlates in the intraparietal sulcus. These results suggest that the human brain can use decomposed value representations to “divide and conquer” reinforcement learning over high-dimensional action spaces. PMID:19864565

Human reinforcement learning subdivides structured action spaces by learning effector-specific values.

PubMed

Gershman, Samuel J; Pesaran, Bijan; Daw, Nathaniel D

2009-10-28

Humans and animals are endowed with a large number of effectors. Although this enables great behavioral flexibility, it presents an equally formidable reinforcement learning problem of discovering which actions are most valuable because of the high dimensionality of the action space. An unresolved question is how neural systems for reinforcement learning-such as prediction error signals for action valuation associated with dopamine and the striatum-can cope with this "curse of dimensionality." We propose a reinforcement learning framework that allows for learned action valuations to be decomposed into effector-specific components when appropriate to a task, and test it by studying to what extent human behavior and blood oxygen level-dependent (BOLD) activity can exploit such a decomposition in a multieffector choice task. Subjects made simultaneous decisions with their left and right hands and received separate reward feedback for each hand movement. We found that choice behavior was better described by a learning model that decomposed the values of bimanual movements into separate values for each effector, rather than a traditional model that treated the bimanual actions as unitary with a single value. A decomposition of value into effector-specific components was also observed in value-related BOLD signaling, in the form of lateralized biases in striatal correlates of prediction error and anticipatory value correlates in the intraparietal sulcus. These results suggest that the human brain can use decomposed value representations to "divide and conquer" reinforcement learning over high-dimensional action spaces.

Episodic Memory Encoding Interferes with Reward Learning and Decreases Striatal Prediction Errors

PubMed Central

Braun, Erin Kendall; Daw, Nathaniel D.

2014-01-01

Learning is essential for adaptive decision making. The striatum and its dopaminergic inputs are known to support incremental reward-based learning, while the hippocampus is known to support encoding of single events (episodic memory). Although traditionally studied separately, in even simple experiences, these two types of learning are likely to co-occur and may interact. Here we sought to understand the nature of this interaction by examining how incremental reward learning is related to concurrent episodic memory encoding. During the experiment, human participants made choices between two options (colored squares), each associated with a drifting probability of reward, with the goal of earning as much money as possible. Incidental, trial-unique object pictures, unrelated to the choice, were overlaid on each option. The next day, participants were given a surprise memory test for these pictures. We found that better episodic memory was related to a decreased influence of recent reward experience on choice, both within and across participants. fMRI analyses further revealed that during learning the canonical striatal reward prediction error signal was significantly weaker when episodic memory was stronger. This decrease in reward prediction error signals in the striatum was associated with enhanced functional connectivity between the hippocampus and striatum at the time of choice. Our results suggest a mechanism by which memory encoding may compete for striatal processing and provide insight into how interactions between different forms of learning guide reward-based decision making. PMID:25378157

Reward-Based Spatial Learning in Teens With Bulimia Nervosa.

PubMed

Cyr, Marilyn; Wang, Zhishun; Tau, Gregory Z; Zhao, Guihu; Friedl, Eve; Stefan, Mihaela; Terranova, Kate; Marsh, Rachel

2016-11-01

To assess the functioning of mesolimbic and fronto-striatal areas involved in reward-based spatial learning in teenaged girls with bulimia nervosa (BN) that might be involved in the development and maintenance of maladaptive behaviors characteristic of the disorder. We compared functional magnetic resonance imaging blood oxygen level-dependent response in 27 adolescent girls with BN to that of 27 healthy, age-matched control participants during a reward-based learning task that required learning to use extra-maze cues to navigate a virtual 8-arm radial maze to find hidden rewards. We compared groups in their patterns of brain activation associated with reward-based spatial learning versus a control condition in which rewards were unexpected because they were allotted pseudo-randomly to experimentally prevent learning. Both groups learned to navigate the maze to find hidden rewards, but group differences in brain activity associated with maze navigation and reward processing were detected in the fronto-striatal regions and right anterior hippocampus. Unlike healthy adolescents, those with BN did not engage the right inferior frontal gyrus during maze navigation, activated the right anterior hippocampus during the receipt of unexpected rewards (control condition), and deactivated the left superior frontal gyrus and right anterior hippocampus during expected reward receipt (learning condition). These patterns of hippocampal activation in the control condition were significantly associated with the frequency of binge-eating episodes. Adolescents with BN displayed abnormal functioning of the anterior hippocampus and fronto-striatal regions during reward-based spatial learning. These findings suggest that an imbalance in control and reward circuits may arise early in the course of BN. Clinical trial registration information-An fMRI Study of Self-Regulation in Adolescents With Bulimia Nervosa; https://clinicaltrials.gov/; NCT00345943. Copyright © 2016 American Academy of Child and Adolescent Psychiatry. Published by Elsevier Inc. All rights reserved.

Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making.

PubMed

Schönberg, Tom; Daw, Nathaniel D; Joel, Daphna; O'Doherty, John P

2007-11-21

The computational framework of reinforcement learning has been used to forward our understanding of the neural mechanisms underlying reward learning and decision-making behavior. It is known that humans vary widely in their performance in decision-making tasks. Here, we used a simple four-armed bandit task in which subjects are almost evenly split into two groups on the basis of their performance: those who do learn to favor choice of the optimal action and those who do not. Using models of reinforcement learning we sought to determine the neural basis of these intrinsic differences in performance by scanning both groups with functional magnetic resonance imaging. We scanned 29 subjects while they performed the reward-based decision-making task. Our results suggest that these two groups differ markedly in the degree to which reinforcement learning signals in the striatum are engaged during task performance. While the learners showed robust prediction error signals in both the ventral and dorsal striatum during learning, the nonlearner group showed a marked absence of such signals. Moreover, the magnitude of prediction error signals in a region of dorsal striatum correlated significantly with a measure of behavioral performance across all subjects. These findings support a crucial role of prediction error signals, likely originating from dopaminergic midbrain neurons, in enabling learning of action selection preferences on the basis of obtained rewards. Thus, spontaneously observed individual differences in decision making performance demonstrate the suggested dependence of this type of learning on the functional integrity of the dopaminergic striatal system in humans.

A cholinergic feedback circuit to regulate striatal population uncertainty and optimize reinforcement learning.

PubMed

Franklin, Nicholas T; Frank, Michael J

2015-12-25

Convergent evidence suggests that the basal ganglia support reinforcement learning by adjusting action values according to reward prediction errors. However, adaptive behavior in stochastic environments requires the consideration of uncertainty to dynamically adjust the learning rate. We consider how cholinergic tonically active interneurons (TANs) may endow the striatum with such a mechanism in computational models spanning three Marr's levels of analysis. In the neural model, TANs modulate the excitability of spiny neurons, their population response to reinforcement, and hence the effective learning rate. Long TAN pauses facilitated robustness to spurious outcomes by increasing divergence in synaptic weights between neurons coding for alternative action values, whereas short TAN pauses facilitated stochastic behavior but increased responsiveness to change-points in outcome contingencies. A feedback control system allowed TAN pauses to be dynamically modulated by uncertainty across the spiny neuron population, allowing the system to self-tune and optimize performance across stochastic environments.

Dopamine dependence in aggregate feedback learning: A computational cognitive neuroscience approach.

PubMed

Valentin, Vivian V; Maddox, W Todd; Ashby, F Gregory

2016-11-01

Procedural learning of skills depends on dopamine-mediated striatal plasticity. Most prior work investigated single stimulus-response procedural learning followed by feedback. However, many skills include several actions that must be performed before feedback is available. A new procedural-learning task is developed in which three independent and successive unsupervised categorization responses receive aggregate feedback indicating either that all three responses were correct, or at least one response was incorrect. Experiment 1 showed superior learning of stimuli in position 3, and that learning in the first two positions was initially compromised, and then recovered. An extensive theoretical analysis that used parameter space partitioning found that a large class of procedural-learning models, which predict propagation of dopamine release from feedback to stimuli, and/or an eligibility trace, fail to fully account for these data. The analysis also suggested that any dopamine released to the second or third stimulus impaired categorization learning in the first and second positions. A second experiment tested and confirmed a novel prediction of this large class of procedural-learning models that if the to-be-learned actions are introduced one-by-one in succession then learning is much better if training begins with the first action (and works forwards) than if it begins with the last action (and works backwards). Copyright © 2016 Elsevier Inc. All rights reserved.

Multiple memory stores and operant conditioning: a rationale for memory's complexity.

PubMed

Meeter, Martijn; Veldkamp, Rob; Jin, Yaochu

2009-02-01

Why does the brain contain more than one memory system? Genetic algorithms can play a role in elucidating this question. Here, model animals were constructed containing a dorsal striatal layer that controlled actions, and a ventral striatal layer that controlled a dopaminergic learning signal. Both layers could gain access to three modeled memory stores, but such access was penalized as energy expenditure. Model animals were then selected on their fitness in simulated operant conditioning tasks. Results suggest that having access to multiple memory stores and their representations is important in learning to regulate dopamine release, as well as in contextual discrimination. For simple operant conditioning, as well as stimulus discrimination, hippocampal compound representations turned out to suffice, a counterintuitive result given findings that hippocampal lesions tend not to affect performance in such tasks. We argue that there is in fact evidence to support a role for compound representations and the hippocampus in even the simplest conditioning tasks.

Role of contingency in striatal response to incentive in adolescents with anxiety.

PubMed

Benson, Brenda E; Guyer, Amanda E; Nelson, Eric E; Pine, Daniel S; Ernst, Monique

2015-03-01

This study examines the effect of contingency on reward function in anxiety. We define contingency as the aspect of a situation in which the outcome is determined by one's action-that is, when there is a direct link between one's action and the outcome of the action. Past findings in adolescents with anxiety or at risk for anxiety have revealed hypersensitive behavioral and neural responses to higher value rewards with correct performance. This hypersensitivity to highly valued (salient) actions suggests that the value of actions is determined not only by outcome magnitude, but also by the degree to which the outcome is contingent on correct performance. Thus, contingency and incentive value might each modulate reward responses in unique ways in anxiety. Using fMRI with a monetary reward task, striatal response to cue anticipation is compared in 18 clinically anxious and 20 healthy adolescents. This task manipulates orthogonally reward contingency and incentive value. Findings suggest that contingency modulates the neural response to incentive magnitude differently in the two groups. Specifically, during the contingent condition, right-striatal response tracks incentive value in anxious, but not healthy, adolescents. During the noncontingent condition, striatal response is bilaterally stronger to low than to high incentive in anxious adolescents, while healthy adolescents exhibit the expected opposite pattern. Both contingency and reward magnitude differentiate striatal activation in anxious versus healthy adolescents. These findings may reflect exaggerated concern about performance and/or alterations of striatal coding of reward value in anxious adolescents. Abnormalities in reward function in anxiety may have treatment implications.

Striatal volume predicts level of video game skill acquisition.

PubMed

Erickson, Kirk I; Boot, Walter R; Basak, Chandramallika; Neider, Mark B; Prakash, Ruchika S; Voss, Michelle W; Graybiel, Ann M; Simons, Daniel J; Fabiani, Monica; Gratton, Gabriele; Kramer, Arthur F

2010-11-01

Video game skills transfer to other tasks, but individual differences in performance and in learning and transfer rates make it difficult to identify the source of transfer benefits. We asked whether variability in initial acquisition and of improvement in performance on a demanding video game, the Space Fortress game, could be predicted by variations in the pretraining volume of either of 2 key brain regions implicated in learning and memory: the striatum, implicated in procedural learning and cognitive flexibility, and the hippocampus, implicated in declarative memory. We found that hippocampal volumes did not predict learning improvement but that striatal volumes did. Moreover, for the striatum, the volumes of the dorsal striatum predicted improvement in performance but the volumes of the ventral striatum did not. Both ventral and dorsal striatal volumes predicted early acquisition rates. Furthermore, this early-stage correlation between striatal volumes and learning held regardless of the cognitive flexibility demands of the game versions, whereas the predictive power of the dorsal striatal volumes held selectively for performance improvements in a game version emphasizing cognitive flexibility. These findings suggest a neuroanatomical basis for the superiority of training strategies that promote cognitive flexibility and transfer to untrained tasks.

Altered brain response to reward and punishment in adolescents with Anorexia Nervosa

PubMed Central

Bischoff-Grethe, Amanda; McCurdy, Danyale; Grenesko-Stevens, Emily; (Zoe) Irvine, Laura E.; Wagner, Angela; Yau, Wai-Ying Wendy; Fennema-Notestine, Christine; Wierenga, Christina E.; Fudge, Julie L.; Delgado, Mauricio R.; Kaye, Walter H.

2013-01-01

Adults recovered from anorexia nervosa (AN) have altered reward modulation within striatal limbic regions associated with the emotional significance of stimuli, and executive regions concerned with planning and consequences. We hypothesized that adolescents with AN would show similar disturbed reward modulation within the striatum and the anterior cingulate cortex, a region connected to the striatum and involved in reward-guided action selection. Using functional magnetic resonance imaging, twenty-two adolescent females (10 restricting-type AN, 12 healthy volunteers) performed a monetary guessing task. Time series data associated with monetary wins and losses within striatal and cingulate regions of interest were subjected to a linear mixed effects analysis. All participants responded more strongly to wins versus losses in limbic and anterior executive striatal territories. However, AN participants exhibited an exaggerated response to losses compared to wins in posterior executive and sensorimotor striatal regions, suggesting altered function in circuitry responsible for coding the affective context of stimuli and action selection based upon these valuations. As AN individuals are particularly sensitive to criticism, failure, and making mistakes, these findings may reflect the neural processes responsible for a bias in those with AN to exaggerate negative consequences. PMID:24148909

Altered brain response to reward and punishment in adolescents with Anorexia nervosa.

PubMed

Bischoff-Grethe, Amanda; McCurdy, Danyale; Grenesko-Stevens, Emily; Irvine, Laura E Zoe; Wagner, Angela; Yau, Wai-Ying Wendy; Fennema-Notestine, Christine; Wierenga, Christina E; Fudge, Julie L; Delgado, Mauricio R; Kaye, Walter H

2013-12-30

Adults recovered from Anorexia nervosa (AN) have altered reward modulation within striatal limbic regions associated with the emotional significance of stimuli, and executive regions concerned with planning and consequences. We hypothesized that adolescents with AN would show similar disturbed reward modulation within the striatum and the anterior cingulate cortex, a region connected to the striatum and involved in reward-guided action selection. Using functional magnetic resonance imaging, twenty-two adolescent females (10 restricting-type AN, 12 healthy volunteers) performed a monetary guessing task. Time series data associated with monetary wins and losses within striatal and cingulate regions of interest were subjected to a linear mixed effects analysis. All participants responded more strongly to wins versus losses in limbic and anterior executive striatal territories. However, AN participants exhibited an exaggerated response to losses compared to wins in posterior executive and sensorimotor striatal regions, suggesting altered function in circuitry responsible for coding the affective context of stimuli and action selection based upon these valuations. As AN individuals are particularly sensitive to criticism, failure, and making mistakes, these findings may reflect the neural processes responsible for a bias in those with AN to exaggerate negative consequences. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Neural Correlates of Motor Learning, Transfer of Learning, and Learning to Learn

PubMed Central

Seidler, Rachael D.

2009-01-01

Recent studies on the neural bases of sensorimotor adaptation demonstrate that the cerebellar and striatal thalamocortical pathways contribute to early learning. Transfer of learning involves a reduction in the contribution of early learning networks, and increased reliance on the cerebellum. The neural correlates of learning to learn remain to be determined, but likely involve enhanced functioning of general aspects of early learning. PMID:20016293

Ventral striatal activity links adversity and reward processing in children.

PubMed

Kamkar, Niki H; Lewis, Daniel J; van den Bos, Wouter; Morton, J Bruce

2017-08-01

Adversity impacts many aspects of psychological and physical development including reward-based learning and decision-making. Mechanisms relating adversity and reward processing in children, however, remain unclear. Here, we show that adversity is associated with potentiated learning from positive outcomes and impulsive decision-making, but unrelated to learning from negative outcomes. We then show via functional magnetic resonance imaging that the link between adversity and reward processing is partially mediated by differences in ventral striatal response to rewards. The findings suggest that early-life adversity is associated with alterations in the brain's sensitivity to rewards accounting, in part, for the link between adversity and altered reward processing in children. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Mechanisms of Hierarchical Reinforcement Learning in Corticostriatal Circuits 1: Computational Analysis

PubMed Central

Badre, David

2012-01-01

Growing evidence suggests that the prefrontal cortex (PFC) is organized hierarchically, with more anterior regions having increasingly abstract representations. How does this organization support hierarchical cognitive control and the rapid discovery of abstract action rules? We present computational models at different levels of description. A neural circuit model simulates interacting corticostriatal circuits organized hierarchically. In each circuit, the basal ganglia gate frontal actions, with some striatal units gating the inputs to PFC and others gating the outputs to influence response selection. Learning at all of these levels is accomplished via dopaminergic reward prediction error signals in each corticostriatal circuit. This functionality allows the system to exhibit conditional if–then hypothesis testing and to learn rapidly in environments with hierarchical structure. We also develop a hybrid Bayesian-reinforcement learning mixture of experts (MoE) model, which can estimate the most likely hypothesis state of individual participants based on their observed sequence of choices and rewards. This model yields accurate probabilistic estimates about which hypotheses are attended by manipulating attentional states in the generative neural model and recovering them with the MoE model. This 2-pronged modeling approach leads to multiple quantitative predictions that are tested with functional magnetic resonance imaging in the companion paper. PMID:21693490

Model-based influences on humans’ choices and striatal prediction errors

PubMed Central

Daw, Nathaniel D.; Gershman, Samuel J.; Seymour, Ben; Dayan, Peter; Dolan, Raymond J.

2011-01-01

Summary The mesostriatal dopamine system is prominently implicated in model-free reinforcement learning, with fMRI BOLD signals in ventral striatum notably covarying with model-free prediction errors. However, latent learning and devaluation studies show that behavior also shows hallmarks of model-based planning, and the interaction between model-based and model-free values, prediction errors and preferences is underexplored. We designed a multistep decision task in which model-based and model-free influences on human choice behavior could be distinguished. By showing that choices reflected both influences we could then test the purity of the ventral striatal BOLD signal as a model-free report. Contrary to expectations, the signal reflected both model-free and model-based predictions in proportions matching those that best explained choice behavior. These results challenge the notion of a separate model-free learner and suggest a more integrated computational architecture for high-level human decision-making. PMID:21435563

A local circuit model of learned striatal and dopamine cell responses under probabilistic schedules of reward.

PubMed

Tan, Can Ozan; Bullock, Daniel

2008-10-01

Recently, dopamine (DA) neurons of the substantia nigra pars compacta (SNc) were found to exhibit sustained responses related to reward uncertainty, in addition to the phasic responses related to reward-prediction errors (RPEs). Thus, cue-dependent anticipations of the timing, magnitude, and uncertainty of rewards are learned and reflected in components of DA signals. Here we simulate a local circuit model to show how learned uncertainty responses are generated, along with phasic RPE responses, on single trials. Both types of simulated DA responses exhibit the empirically observed dependencies on conditional probability, expected value of reward, and time since onset of the reward-predicting cue. The model's three major pathways compute expected values of cues, timed predictions of reward magnitudes, and uncertainties associated with these predictions. The first two pathways' computations refine those modeled by Brown et al. (1999). The third, newly modeled, pathway involves medium spiny projection neurons (MSPNs) of the striatal matrix, whose axons corelease GABA and substance P, both at synapses with GABAergic neurons in the substantia nigra pars reticulata (SNr) and with distal dendrites (in SNr) of DA neurons whose somas are located in ventral SNc. Corelease enables efficient computation of uncertainty responses that are a nonmonotonic function of the conditional probability of reward, and variability in striatal cholinergic transmission can explain observed individual differences in the amplitudes of uncertainty responses. The involvement of matricial MSPNs and cholinergic transmission within the striatum implies a relation between uncertainty in cue-reward contingencies and action-selection functions of the basal ganglia.

Integrating cortico-limbic-basal ganglia architectures for learning model-based and model-free navigation strategies

PubMed Central

Khamassi, Mehdi; Humphries, Mark D.

2012-01-01

Behavior in spatial navigation is often organized into map-based (place-driven) vs. map-free (cue-driven) strategies; behavior in operant conditioning research is often organized into goal-directed vs. habitual strategies. Here we attempt to unify the two. We review one powerful theory for distinct forms of learning during instrumental conditioning, namely model-based (maintaining a representation of the world) and model-free (reacting to immediate stimuli) learning algorithms. We extend these lines of argument to propose an alternative taxonomy for spatial navigation, showing how various previously identified strategies can be distinguished as “model-based” or “model-free” depending on the usage of information and not on the type of information (e.g., cue vs. place). We argue that identifying “model-free” learning with dorsolateral striatum and “model-based” learning with dorsomedial striatum could reconcile numerous conflicting results in the spatial navigation literature. From this perspective, we further propose that the ventral striatum plays key roles in the model-building process. We propose that the core of the ventral striatum is positioned to learn the probability of action selection for every transition between states of the world. We further review suggestions that the ventral striatal core and shell are positioned to act as “critics” contributing to the computation of a reward prediction error for model-free and model-based systems, respectively. PMID:23205006

Origin and Properties of Striatal Local Field Potential Responses to Cortical Stimulation: Temporal Regulation by Fast Inhibitory Connections

PubMed Central

Galiñanes, Gregorio L.; Braz, Barbara Y.; Murer, Mario Gustavo

2011-01-01

Evoked striatal field potentials are seldom used to study corticostriatal communication in vivo because little is known about their origin and significance. Here we show that striatal field responses evoked by stimulating the prelimbic cortex in mice are reduced by more than 90% after infusing the AMPA receptor antagonist CNQX close to the recording electrode. Moreover, the amplitude of local field responses and dPSPs recorded in striatal medium spiny neurons increase in parallel with increasing stimulating current intensity. Finally, the evoked striatal fields show several of the basic known properties of corticostriatal transmission, including paired pulse facilitation and topographical organization. As a case study, we characterized the effect of local GABAA receptor blockade on striatal field and multiunitary action potential responses to prelimbic cortex stimulation. Striatal activity was recorded through a 24 channel silicon probe at about 600 µm from a microdialysis probe. Intrastriatal administration of the GABAA receptor antagonist bicuculline increased by 65±7% the duration of the evoked field responses. Moreover, the associated action potential responses were markedly enhanced during bicuculline infusion. Bicuculline enhancement took place at all the striatal sites that showed a response to cortical stimulation before drug infusion, but sites showing no field response before bicuculline remained unresponsive during GABAA receptor blockade. Thus, the data demonstrate that fast inhibitory connections exert a marked temporal regulation of input-output transformations within spatially delimited striatal networks responding to a cortical input. Overall, we propose that evoked striatal fields may be a useful tool to study corticostriatal synaptic connectivity in relation to behavior. PMID:22163020

Abnormal fronto-striatal activation as a marker of threshold and subthreshold Bulimia Nervosa.

PubMed

Cyr, Marilyn; Yang, Xiao; Horga, Guillermo; Marsh, Rachel

2018-04-01

This study aimed to determine whether functional disturbances in fronto-striatal control circuits characterize adolescents with Bulimia Nervosa (BN) spectrum eating disorders regardless of clinical severity. FMRI was used to assess conflict-related brain activations during performance of a Simon task in two samples of adolescents with BN symptoms compared with healthy adolescents. The BN samples differed in the severity of their clinical presentation, illness duration and age. Multi-voxel pattern analyses (MVPAs) based on machine learning were used to determine whether patterns of fronto-striatal activation characterized adolescents with BN spectrum disorders regardless of clinical severity, and whether accurate classification of less symptomatic adolescents (subthreshold BN; SBN) could be achieved based on patterns of activation in adolescents who met DSM5 criteria for BN. MVPA classification analyses revealed that both BN and SBN adolescents could be accurately discriminated from healthy adolescents based on fronto-striatal activation. Notably, the patterns detected in more severely ill BN compared with healthy adolescents accurately discriminated less symptomatic SBN from healthy adolescents. Deficient activation of fronto-striatal circuits can characterize BN early in its course, when clinical presentations are less severe, perhaps pointing to circuit-based disturbances as useful biomarker or risk factor for the disorder, and a tool for understanding its developmental trajectory, as well as the development of early interventions. © 2018 Wiley Periodicals, Inc.

Motivational Processes Underlying Substance Abuse Disorder.

PubMed

Meyer, Paul J; King, Christopher P; Ferrario, Carrie R

2016-01-01

Drug addiction is a syndrome of dysregulated motivation, evidenced by intense drug craving and compulsive drug-seeking behavior. In the search for 'common neurobiological substrates of addiction to different classes of drugs, behavioral neuroscientists have attempted to determine the neural basis for a number of motivational concepts and describe how they are changed by repeated drug use. Here, we describe these concepts and summarize previous work describing three major neural systems that play distinct roles in different conceptual aspects of motivation: (1) a nigrostriatal system that is involved in two forms of instrumental learning, (2) a ventral striatal system that is involved in Pavlovian incentive motivation and negative reinforcement, and (3) frontal cortical areas that regulate decision making and motivational processes. Within striatal systems, drug addiction can involve a transition from goal-oriented, incentive processes to automatic, habit-based responding. In the cortex, weak inhibitory control is a predisposing factor to, as well as a consequence of, repeated drug intake. However, these transitions are not absolute, and addiction can occur without a transition to habit-based responding, occurring as a result of the overvaluation of drug outcomes and hypersensitivity to incentive properties of drug-associated cues. Finally, we point out that addiction is not monolithic and can depend not only on individual differences between addicts, but also on the neurochernical action of specific drug classes.

A cholinergic feedback circuit to regulate striatal population uncertainty and optimize reinforcement learning

PubMed Central

Franklin, Nicholas T; Frank, Michael J

2015-01-01

Convergent evidence suggests that the basal ganglia support reinforcement learning by adjusting action values according to reward prediction errors. However, adaptive behavior in stochastic environments requires the consideration of uncertainty to dynamically adjust the learning rate. We consider how cholinergic tonically active interneurons (TANs) may endow the striatum with such a mechanism in computational models spanning three Marr's levels of analysis. In the neural model, TANs modulate the excitability of spiny neurons, their population response to reinforcement, and hence the effective learning rate. Long TAN pauses facilitated robustness to spurious outcomes by increasing divergence in synaptic weights between neurons coding for alternative action values, whereas short TAN pauses facilitated stochastic behavior but increased responsiveness to change-points in outcome contingencies. A feedback control system allowed TAN pauses to be dynamically modulated by uncertainty across the spiny neuron population, allowing the system to self-tune and optimize performance across stochastic environments. DOI: http://dx.doi.org/10.7554/eLife.12029.001 PMID:26705698

Modeling effects of intrinsic and extrinsic rewards on the competition between striatal learning systems.

PubMed

Boedecker, Joschka; Lampe, Thomas; Riedmiller, Martin

2013-01-01

A common assumption in psychology, economics, and other fields holds that higher performance will result if extrinsic rewards (such as money) are offered as an incentive. While this principle seems to work well for tasks that require the execution of the same sequence of steps over and over, with little uncertainty about the process, in other cases, especially where creative problem solving is required due to the difficulty in finding the optimal sequence of actions, external rewards can actually be detrimental to task performance. Furthermore, they have the potential to undermine intrinsic motivation to do an otherwise interesting activity. In this work, we extend a computational model of the dorsomedial and dorsolateral striatal reinforcement learning systems to account for the effects of extrinsic and intrinsic rewards. The model assumes that the brain employs both a goal-directed and a habitual learning system, and competition between both is based on the trade-off between the cost of the reasoning process and value of information. The goal-directed system elicits internal rewards when its models of the environment improve, while the habitual system, being model-free, does not. Our results account for the phenomena that initial extrinsic reward leads to reduced activity after extinction compared to the case without any initial extrinsic rewards, and that performance in complex task settings drops when higher external rewards are promised. We also test the hypothesis that external rewards bias the competition in favor of the computationally efficient, but cruder and less flexible habitual system, which can negatively influence intrinsic motivation and task performance in the class of tasks we consider.

Dopaminergic control of motivation and reinforcement learning: a closed-circuit account for reward-oriented behavior.

PubMed

Morita, Kenji; Morishima, Mieko; Sakai, Katsuyuki; Kawaguchi, Yasuo

2013-05-15

Humans and animals take actions quickly when they expect that the actions lead to reward, reflecting their motivation. Injection of dopamine receptor antagonists into the striatum has been shown to slow such reward-seeking behavior, suggesting that dopamine is involved in the control of motivational processes. Meanwhile, neurophysiological studies have revealed that phasic response of dopamine neurons appears to represent reward prediction error, indicating that dopamine plays central roles in reinforcement learning. However, previous attempts to elucidate the mechanisms of these dopaminergic controls have not fully explained how the motivational and learning aspects are related and whether they can be understood by the way the activity of dopamine neurons itself is controlled by their upstream circuitries. To address this issue, we constructed a closed-circuit model of the corticobasal ganglia system based on recent findings regarding intracortical and corticostriatal circuit architectures. Simulations show that the model could reproduce the observed distinct motivational effects of D1- and D2-type dopamine receptor antagonists. Simultaneously, our model successfully explains the dopaminergic representation of reward prediction error as observed in behaving animals during learning tasks and could also explain distinct choice biases induced by optogenetic stimulation of the D1 and D2 receptor-expressing striatal neurons. These results indicate that the suggested roles of dopamine in motivational control and reinforcement learning can be understood in a unified manner through a notion that the indirect pathway of the basal ganglia represents the value of states/actions at a previous time point, an empirically driven key assumption of our model.

Dynamic nigrostriatal dopamine biases action selection

PubMed Central

Howard, Christopher D.; Li, Hao; Geddes, Claire E.; Jin, Xin

2017-01-01

Summary Dopamine is thought to play a critical role in reinforcement learning and goal-directed behavior, but its function in action selection remains largely unknown. Here, we demonstrate that nigrostriatal dopamine biases ongoing action selection. When mice were trained to dynamically switch the action selected at different time points, changes in firing rate of nigrostriatal dopamine neurons, as well as dopamine signaling in the dorsal striatum, were found to be associated with action selection. This dopamine profile is specific to behavioral choice, scalable with interval duration, and doesn’t reflect reward prediction error, timing, or value as single factors alone. Genetic deletion of NMDA receptors on dopamine or striatal neurons, or optogenetic manipulation of dopamine concentration, alters dopamine signaling and biases action selection. These results unveil a crucial role of nigrostriatal dopamine in integrating diverse information for regulating upcoming actions and have important implications for neurological disorders including Parkinson’s disease and substance dependence. PMID:28285820

Dynamic Nigrostriatal Dopamine Biases Action Selection.

PubMed

Howard, Christopher D; Li, Hao; Geddes, Claire E; Jin, Xin

2017-03-22

Dopamine is thought to play a critical role in reinforcement learning and goal-directed behavior, but its function in action selection remains largely unknown. Here we demonstrate that nigrostriatal dopamine biases ongoing action selection. When mice were trained to dynamically switch the action selected at different time points, changes in firing rate of nigrostriatal dopamine neurons, as well as dopamine signaling in the dorsal striatum, were found to be associated with action selection. This dopamine profile is specific to behavioral choice, scalable with interval duration, and doesn't reflect reward prediction error, timing, or value as single factors alone. Genetic deletion of NMDA receptors on dopamine or striatal neurons or optogenetic manipulation of dopamine concentration alters dopamine signaling and biases action selection. These results unveil a crucial role of nigrostriatal dopamine in integrating diverse information for regulating upcoming actions, and they have important implications for neurological disorders, including Parkinson's disease and substance dependence. Copyright © 2017 Elsevier Inc. All rights reserved.

D2 dopamine receptor activation inhibits basal and forskolin-evoked acetylcholine release from dissociated striatal cholinergic interneurons.

PubMed

Login, I S

1997-02-21

We tested whether D2 ligands inhibit basal and forskolin-stimulated [3H]ACh release from dissociated striata, as opposed to striatal slices. Quinpirole inhibited both basal (40% maximal inhibition; IC50 approximately 50 nM) and 10 microM forskolin-stimulated release (80% inhibition; IC50 approximately 25 nM quinpirole) and both actions were blocked by a D2 antagonist. Vesamicol prevented the quinpirole and forskolin actions. The ability of D2 agonists to inhibit basal and cyclase-stimulated acetylcholine release emanating from vesamicol-sensitive vesicles appears to be tonically suppressed by inhibitory elements within striatal circuitry.

Action selection performance of a reconfigurable basal ganglia inspired model with Hebbian–Bayesian Go-NoGo connectivity

PubMed Central

Berthet, Pierre; Hellgren-Kotaleski, Jeanette; Lansner, Anders

2012-01-01

Several studies have shown a strong involvement of the basal ganglia (BG) in action selection and dopamine dependent learning. The dopaminergic signal to striatum, the input stage of the BG, has been commonly described as coding a reward prediction error (RPE), i.e., the difference between the predicted and actual reward. The RPE has been hypothesized to be critical in the modulation of the synaptic plasticity in cortico-striatal synapses in the direct and indirect pathway. We developed an abstract computational model of the BG, with a dual pathway structure functionally corresponding to the direct and indirect pathways, and compared its behavior to biological data as well as other reinforcement learning models. The computations in our model are inspired by Bayesian inference, and the synaptic plasticity changes depend on a three factor Hebbian–Bayesian learning rule based on co-activation of pre- and post-synaptic units and on the value of the RPE. The model builds on a modified Actor-Critic architecture and implements the direct (Go) and the indirect (NoGo) pathway, as well as the reward prediction (RP) system, acting in a complementary fashion. We investigated the performance of the model system when different configurations of the Go, NoGo, and RP system were utilized, e.g., using only the Go, NoGo, or RP system, or combinations of those. Learning performance was investigated in several types of learning paradigms, such as learning-relearning, successive learning, stochastic learning, reversal learning and a two-choice task. The RPE and the activity of the model during learning were similar to monkey electrophysiological and behavioral data. Our results, however, show that there is not a unique best way to configure this BG model to handle well all the learning paradigms tested. We thus suggest that an agent might dynamically configure its action selection mode, possibly depending on task characteristics and also on how much time is available. PMID:23060764

Pharmacological evidence that both cognitive memory and habit formation contribute to within-session learning of concurrent visual discriminations

PubMed Central

Turchi, Janita; Devan, Bryan; Yin, Pingbo; Sigrist, Emmalynn; Mishkin, Mortimer

2010-01-01

The monkey's ability to learn a set of visual discriminations presented concurrently just once a day on successive days (24-hr ITI task) is based on habit formation, which is known to rely on a visuo-striatal circuit and to be independent of visuo-rhinal circuits that support one-trial memory. Consistent with this dissociation, we recently reported that performance on the 24-hr ITI task is impaired by a striatal-function blocking agent, the dopaminergic antagonist haloperidol, and not by a rhinal-function blocking agent, the muscarinic cholinergic antagonist scopolamine. In the present study, monkeys were trained on a short-ITI form of concurrent visual discrimination learning, one in which a set of stimulus pairs is repeated not only across daily sessions but also several times within each session (in this case, at about 4-min ITIs). Asymptotic discrimination learning rates in the non-drug condition were reduced by half, from ~11 trials/pair on the 24-hr ITI task to ~5 trials/pair on the 4-min ITI task, and this faster learning was impaired by systemic injections of either haloperidol or scopolamine. The results suggest that in the version of concurrent discrimination learning used here, the short ITIs within a session recruit both visuo-rhinal and visuo-striatal circuits, and that the final performance level is driven by both cognitive memory and habit formation working in concert. PMID:20144631

Pharmacological evidence that both cognitive memory and habit formation contribute to within-session learning of concurrent visual discriminations.

PubMed

Turchi, Janita; Devan, Bryan; Yin, Pingbo; Sigrist, Emmalynn; Mishkin, Mortimer

2010-07-01

The monkey's ability to learn a set of visual discriminations presented concurrently just once a day on successive days (24-h ITI task) is based on habit formation, which is known to rely on a visuo-striatal circuit and to be independent of visuo-rhinal circuits that support one-trial memory. Consistent with this dissociation, we recently reported that performance on the 24-h ITI task is impaired by a striatal-function blocking agent, the dopaminergic antagonist haloperidol, and not by a rhinal-function blocking agent, the muscarinic cholinergic antagonist scopolamine. In the present study, monkeys were trained on a short-ITI form of concurrent visual discrimination learning, one in which a set of stimulus pairs is repeated not only across daily sessions but also several times within each session (in this case, at about 4-min ITIs). Asymptotic discrimination learning rates in the non-drug condition were reduced by half, from approximately 11 trials/pair on the 24-h ITI task to approximately 5 trials/pair on the 4-min ITI task, and this faster learning was impaired by systemic injections of either haloperidol or scopolamine. The results suggest that in the version of concurrent discrimination learning used here, the short ITIs within a session recruit both visuo-rhinal and visuo-striatal circuits, and that the final performance level is driven by both cognitive memory and habit formation working in concert.

Model-based influences on humans' choices and striatal prediction errors.

PubMed

Daw, Nathaniel D; Gershman, Samuel J; Seymour, Ben; Dayan, Peter; Dolan, Raymond J

2011-03-24

The mesostriatal dopamine system is prominently implicated in model-free reinforcement learning, with fMRI BOLD signals in ventral striatum notably covarying with model-free prediction errors. However, latent learning and devaluation studies show that behavior also shows hallmarks of model-based planning, and the interaction between model-based and model-free values, prediction errors, and preferences is underexplored. We designed a multistep decision task in which model-based and model-free influences on human choice behavior could be distinguished. By showing that choices reflected both influences we could then test the purity of the ventral striatal BOLD signal as a model-free report. Contrary to expectations, the signal reflected both model-free and model-based predictions in proportions matching those that best explained choice behavior. These results challenge the notion of a separate model-free learner and suggest a more integrated computational architecture for high-level human decision-making. Copyright © 2011 Elsevier Inc. All rights reserved.

Dorsolateral Striatal Lesions Impair Navigation Based on Landmark-Goal Vectors but Facilitate Spatial Learning Based on a "Cognitive Map"

ERIC Educational Resources Information Center

Kosaki, Yutaka; Poulter, Steven L.; Austen, Joe M.; McGregor, Anthony

2015-01-01

In three experiments, the nature of the interaction between multiple memory systems in rats solving a variation of a spatial task in the water maze was investigated. Throughout training rats were able to find a submerged platform at a fixed distance and direction from an intramaze landmark by learning a landmark-goal vector. Extramaze cues were…

Failing to learn from negative prediction errors: Obesity is associated with alterations in a fundamental neural learning mechanism.

PubMed

Mathar, David; Neumann, Jane; Villringer, Arno; Horstmann, Annette

2017-10-01

Prediction errors (PEs) encode the difference between expected and actual action outcomes in the brain via dopaminergic modulation. Integration of these learning signals ensures efficient behavioral adaptation. Obesity has recently been linked to altered dopaminergic fronto-striatal circuits, thus implying impairments in cognitive domains that rely on its integrity. 28 obese and 30 lean human participants performed an implicit stimulus-response learning paradigm inside an fMRI scanner. Computational modeling and psycho-physiological interaction (PPI) analysis was utilized for assessing PE-related learning and associated functional connectivity. We show that human obesity is associated with insufficient incorporation of negative PEs into behavioral adaptation even in a non-food context, suggesting differences in a fundamental neural learning mechanism. Obese subjects were less efficient in using negative PEs to improve implicit learning performance, despite proper coding of PEs in striatum. We further observed lower functional coupling between ventral striatum and supplementary motor area in obese subjects subsequent to negative PEs. Importantly, strength of functional coupling predicted task performance and negative PE utilization. These findings show that obesity is linked to insufficient behavioral adaptation specifically in response to negative PEs, and to associated alterations in function and connectivity within the fronto-striatal system. Recognition of neural differences as a central characteristic of obesity hopefully paves the way to rethink established intervention strategies: Differential behavioral sensitivity to negative and positive PEs should be considered when designing intervention programs. Measures relying on penalization of unwanted behavior may prove less effective in obese subjects than alternative approaches. Copyright © 2017 Elsevier Ltd. All rights reserved.

Ventral striatal network connectivity reflects reward learning and behavior in patients with Parkinson's disease.

PubMed

Petersen, Kalen; Van Wouwe, Nelleke; Stark, Adam; Lin, Ya-Chen; Kang, Hakmook; Trujillo-Diaz, Paula; Kessler, Robert; Zald, David; Donahue, Manus J; Claassen, Daniel O

2018-01-01

A subgroup of Parkinson's disease (PD) patients treated with dopaminergic therapy develop compulsive reward-driven behaviors, which can result in life-altering morbidity. The mesocorticolimbic dopamine network guides reward-motivated behavior; however, its role in this treatment-related behavioral phenotype is incompletely understood. Here, mesocorticolimbic network function in PD patients who develop impulsive and compulsive behaviors (ICB) in response to dopamine agonists was assessed using BOLD fMRI. The tested hypothesis was that network connectivity between the ventral striatum and the limbic cortex is elevated in patients with ICB and that reward-learning proficiency reflects the extent of mesocorticolimbic network connectivity. To evaluate this hypothesis, 3.0T BOLD-fMRI was applied to measure baseline functional connectivity on and off dopamine agonist therapy in age and sex-matched PD patients with (n = 19) or without (n = 18) ICB. An incentive-based task was administered to a subset of patients (n = 20) to quantify positively or negatively reinforced learning. Whole-brain voxelwise analyses and region-of-interest-based mixed linear effects modeling were performed. Elevated ventral striatal connectivity to the anterior cingulate gyrus (P = 0.013), orbitofrontal cortex (P = 0.034), insula (P = 0.044), putamen (P = 0.014), globus pallidus (P < 0.01), and thalamus (P < 0.01) was observed in patients with ICB. A strong trend for elevated amygdala-to-midbrain connectivity was found in ICB patients on dopamine agonist. Ventral striatum-to-subgenual cingulate connectivity correlated with reward learning (P < 0.01), but not with punishment-avoidance learning. These data indicate that PD-ICB patients have elevated network connectivity in the mesocorticolimbic network. Behaviorally, proficient reward-based learning is related to this enhanced limbic and ventral striatal connectivity. Hum Brain Mapp 39:509-521, 2018. © 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.

β1-adrenergic receptors activate two distinct signaling pathways in striatal neurons

PubMed Central

Meitzen, John; Luoma, Jessie I.; Stern, Christopher M.; Mermelstein, Paul G.

2010-01-01

Monoamine action in the dorsal striatum and nucleus accumbens plays essential roles in striatal physiology. Although research often focuses on dopamine and its receptors, norepinephrine and adrenergic receptors are also crucial in regulating striatal function. While noradrenergic neurotransmission has been identified in the striatum, little is known regarding the signaling pathways activated by β-adrenergic receptors in this brain region. Using cultured striatal neurons, we characterized a novel signaling pathway by which activation of β1-adrenergic receptors leads to the rapid phosphorylation of cAMP Response Element Binding Protein (CREB), a transcription-factor implicated as a molecular switch underlying long-term changes in brain function. Norepinephrine-mediated CREB phosphorylation requires β1-adrenergic receptor stimulation of a receptor tyrosine kinase, ultimately leading to the activation of a Ras/Raf/MEK/MAPK/MSK signaling pathway. Activation of β1-adrenergic receptors also induces CRE-dependent transcription and increased c-fos expression. In addition, stimulation of β1-adrenergic receptors produces cAMP production, but surprisingly, β1-adrenergic receptor activation of adenylyl cyclase was not functionally linked to rapid CREB phosphorylation. These findings demonstrate that activation of β1-adrenergic receptors on striatal neurons can stimulate two distinct signaling pathways. These adrenergic actions can produce long-term changes in gene expression, as well as rapidly modulate cellular physiology. By elucidating the mechanisms by which norepinephrine and β1-adrenergic receptor activation affects striatal physiology, we provide the means to more fully understand the role of monoamines in modulating striatal function, specifically how norepinephrine and β1-adrenergic receptors may affect striatal physiology. PMID:21143600

Memantine alters striatal plasticity inducing a shift of synaptic responses toward long-term depression.

PubMed

Mancini, Maria; Ghiglieri, Veronica; Bagetta, Vincenza; Pendolino, Valentina; Vannelli, Anna; Cacace, Fabrizio; Mineo, Desireé; Calabresi, Paolo; Picconi, Barbara

2016-02-01

Memantine is an open channel blocker that antagonizes NMDA receptors reducing the inappropriate calcium (Ca(2+)) influx occurring in presence of moderately increased glutamate levels. At the same time, memantine has the ability to preserve the transient physiological activation of NMDA receptor, essential for learning and memory formation at synaptic level. In the present study we investigated the effects exerted by memantine on striatal synaptic plasticity in rat striatal spiny projection neurons (SPNs). In vitro application of memantine in striatal slices elicited a disruption of long-term potentiation (LTP) induction and maintenance, and revealed, in the majority of the recorded neurons, a long-term depression (LTD), whose amplitude was concentration-dependent (0.3-10 μM). Interestingly, preincubation with the dopamine (DA) D2 receptor antagonist sulpiride (10 μM) prevented memantine-induced LTD and restored LTP. Moreover, the DA D2 agonist quinpirole (10 μM), similarly to memantine, induced LTD in a subgroup of SPNs. In addition, memantine-induced LTD was also prevented by the CB1 endocannabinoid receptor antagonist AM 251 (1 μM). These results suggest that the actions exerted by memantine on striatal synaptic plasticity, and in particular the induction of LTD observed in SPNs, could be attributed to its ability to activate DA D2 receptors. By contrast, blockade of NMDA receptor is not involved in memantine-induced LTD since APV (30 μM) and MK801 (10 μM), two NMDA receptor antagonists, failed to induce this form of synaptic plasticity. Our data indicate that memantine could be used as treatment of neurological disorders in which DA D2 receptor represents a possible therapeutic target. Copyright © 2015 Elsevier Ltd. All rights reserved.

Modeling effects of intrinsic and extrinsic rewards on the competition between striatal learning systems

PubMed Central

Boedecker, Joschka; Lampe, Thomas; Riedmiller, Martin

2013-01-01

A common assumption in psychology, economics, and other fields holds that higher performance will result if extrinsic rewards (such as money) are offered as an incentive. While this principle seems to work well for tasks that require the execution of the same sequence of steps over and over, with little uncertainty about the process, in other cases, especially where creative problem solving is required due to the difficulty in finding the optimal sequence of actions, external rewards can actually be detrimental to task performance. Furthermore, they have the potential to undermine intrinsic motivation to do an otherwise interesting activity. In this work, we extend a computational model of the dorsomedial and dorsolateral striatal reinforcement learning systems to account for the effects of extrinsic and intrinsic rewards. The model assumes that the brain employs both a goal-directed and a habitual learning system, and competition between both is based on the trade-off between the cost of the reasoning process and value of information. The goal-directed system elicits internal rewards when its models of the environment improve, while the habitual system, being model-free, does not. Our results account for the phenomena that initial extrinsic reward leads to reduced activity after extinction compared to the case without any initial extrinsic rewards, and that performance in complex task settings drops when higher external rewards are promised. We also test the hypothesis that external rewards bias the competition in favor of the computationally efficient, but cruder and less flexible habitual system, which can negatively influence intrinsic motivation and task performance in the class of tasks we consider. PMID:24137146

Dopamine D2 Receptor Signaling in the Nucleus Accumbens Comprises a Metabolic-Cognitive Brain Interface Regulating Metabolic Components of Glucose Reinforcement.

PubMed

Michaelides, Michael; Miller, Michael L; DiNieri, Jennifer A; Gomez, Juan L; Schwartz, Elizabeth; Egervari, Gabor; Wang, Gene Jack; Mobbs, Charles V; Volkow, Nora D; Hurd, Yasmin L

2017-11-01

Appetitive drive is influenced by coordinated interactions between brain circuits that regulate reinforcement and homeostatic signals that control metabolism. Glucose modulates striatal dopamine (DA) and regulates appetitive drive and reinforcement learning. Striatal DA D2 receptors (D2Rs) also regulate reinforcement learning and are implicated in glucose-related metabolic disorders. Nevertheless, interactions between striatal D2R and peripheral glucose have not been previously described. Here we show that manipulations involving striatal D2R signaling coincide with perseverative and impulsive-like responding for sucrose, a disaccharide consisting of fructose and glucose. Fructose conveys orosensory (ie, taste) reinforcement but does not convey metabolic (ie, nutrient-derived) reinforcement. Glucose however conveys orosensory reinforcement but unlike fructose, it is a major metabolic energy source, underlies sustained reinforcement, and activates striatal circuitry. We found that mice with deletion of dopamine- and cAMP-regulated neuronal phosphoprotein (DARPP-32) exclusively in D2R-expressing cells exhibited preferential D2R changes in the nucleus accumbens (NAc), a striatal region that critically regulates sucrose reinforcement. These changes coincided with perseverative and impulsive-like responding for sucrose pellets and sustained reinforcement learning of glucose-paired flavors. These mice were also characterized by significant glucose intolerance (ie, impaired glucose utilization). Systemic glucose administration significantly attenuated sucrose operant responding and D2R activation or blockade in the NAc bidirectionally modulated blood glucose levels and glucose tolerance. Collectively, these results implicate NAc D2R in regulating both peripheral glucose levels and glucose-dependent reinforcement learning behaviors and highlight the notion that glucose metabolic impairments arising from disrupted NAc D2R signaling are involved in compulsive and perseverative feeding behaviors.

Motivational Processes Underlying Substance Abuse Disorder

PubMed Central

King, Christopher P.; Ferrario, Carrie R.

2016-01-01

Drug addiction is a syndrome of dysregulated motivation, evidenced by intense drug craving and compulsive drug-seeking behavior. In the search for common neurobiological substrates of addiction to different classes of drugs, behavioral neuroscientists have attempted to determine the neural basis for a number of motivational concepts and describe how they are changed by repeated drug use. Here, we describe these concepts and summarize previous work describing three major neural systems that play distinct roles in different conceptual aspects of motivation: (1) a nigrostriatal system that is involved in two forms of instrumental learning, (2) a ventral striatal system that is involved in Pavlovian incentive motivation and negative reinforcement, and (3) frontal cortical areas that regulate decision making and motivational processes. Within striatal systems, drug addiction can involve a transition from goal-oriented, incentive processes to automatic, habit-based responding. In the cortex, weak inhibitory control is a predisposing factor to, as well as a consequence of, repeated drug intake. However, these transitions are not absolute, and addiction can occur without a transition to habit-based responding, occurring as a result of the overvaluation of drug outcomes and hypersensitivity to incentive properties of drug-associated cues. Finally, we point out that addiction is not monolithic and can depend not only on individual differences between addicts, but also on the neurochemical action of specific drug classes. PMID:26475159

Striatal and Hippocampal Entropy and Recognition Signals in Category Learning: Simultaneous Processes Revealed by Model-Based fMRI

ERIC Educational Resources Information Center

Davis, Tyler; Love, Bradley C.; Preston, Alison R.

2012-01-01

Category learning is a complex phenomenon that engages multiple cognitive processes, many of which occur simultaneously and unfold dynamically over time. For example, as people encounter objects in the world, they simultaneously engage processes to determine their fit with current knowledge structures, gather new information about the objects, and…

The effects of endomorphins on striatal [3H]GABA release induced by electrical stimulation: an in vitro superfusion study in rats.

PubMed

Bagosi, Zsolt; Jászberényi, Miklós; Telegdy, Gyula

2009-05-01

The endomorphins (EM1 and EM2) are selective endogenous ligands for mu-opioid receptors (MOR1 and MOR2) with neurotransmitter and neuromodulator roles in mammals. In the present study we investigated the potential actions of EMs on striatal GABA release and the implication of different MORs in these processes. Rat striatal slices were preincubated with tritium-labelled GABA ([(3)H]GABA), pretreated with selective MOR1 and MOR2 antagonist beta-funaltrexamine and selective MOR1 antagonist naloxonazine and then superfused with the selective MOR agonists, EM1 and EM2. EM1 significantly decreased the striatal [(3)H]GABA release induced by electrical stimulation. Beta-funaltrexamine antagonized the inhibitory action of EM1, but naloxonazine did not affect it considerably. EM2 was ineffective, even in case of specific enzyme inhibitor diprotin A pretreatment. The results demonstrate that EM1 decreases GABA release in the basal ganglia through MOR2, while EM2 does not influence it.

Significance of Input Correlations in Striatal Function

PubMed Central

Yim, Man Yi; Aertsen, Ad; Kumar, Arvind

2011-01-01

The striatum is the main input station of the basal ganglia and is strongly associated with motor and cognitive functions. Anatomical evidence suggests that individual striatal neurons are unlikely to share their inputs from the cortex. Using a biologically realistic large-scale network model of striatum and cortico-striatal projections, we provide a functional interpretation of the special anatomical structure of these projections. Specifically, we show that weak pairwise correlation within the pool of inputs to individual striatal neurons enhances the saliency of signal representation in the striatum. By contrast, correlations among the input pools of different striatal neurons render the signal representation less distinct from background activity. We suggest that for the network architecture of the striatum, there is a preferred cortico-striatal input configuration for optimal signal representation. It is further enhanced by the low-rate asynchronous background activity in striatum, supported by the balance between feedforward and feedback inhibitions in the striatal network. Thus, an appropriate combination of rates and correlations in the striatal input sets the stage for action selection presumably implemented in the basal ganglia. PMID:22125480

An fMRI investigation of the fronto-striatal learning system in women who exhibit eating disorder behaviors

PubMed Central

Celone, Kim A.; Thompson-Brenner, Heather; Ross, Robert S.; Pratt, Elizabeth M.; Stern, Chantal E.

2013-01-01

In the present study, we sought to examine whether the fronto-striatal learning system, which has been implicated in bulimia nervosa, would demonstrate altered BOLD activity during probabilistic category learning in women who met subthreshold criteria for bulimia nervosa (Sub-BN). Sub-BN, which falls within the clinical category of Eating Disorder Not Otherwise Specified (EDNOS), is comprised of individuals who demonstrate recurrent binge eating, efforts to minimize their caloric intake and caloric retention, and elevated levels of concern about shape, weight, and/or eating, but just fail to meet the diagnostic threshold for bulimia nervosa (BN). fMRI data were collected from eighteen women with subthreshold-BN (Sub-BN) and nineteen healthy control women group-matched for age, education and body mass index (MC) during the weather prediction task. Sub-BN participants demonstrated increased caudate nucleus and dorsolateral prefrontal cortex (DLPFC) activation during the learning of probabilistic categories. Though the two subject groups did not differ in behavioral performance, over the course of learning, Sub-BN participants showed a dynamic pattern of brain activity differences when compared to matched control participants. Regions implicated in episodic memory, including the medial temporal lobe (MTL), retrosplenial cortex, middle frontal gyrus, and anterior and posterior cingulate cortex showed decreased activity in the Sub-BN participants compared to MCs during early learning which was followed by increased involvement of the DLPFC during later learning. These findings demonstrate that women with Sub-BN demonstrate differences in fronto-striatal learning system activity, as well as a distinct functional pattern between fronto-striatal and MTL learning systems during the course of implicit probabilistic category learning. PMID:21419229

Reinforcement Learning Models and Their Neural Correlates: An Activation Likelihood Estimation Meta-Analysis

PubMed Central

Kumar, Poornima; Eickhoff, Simon B.; Dombrovski, Alexandre Y.

2015-01-01

Reinforcement learning describes motivated behavior in terms of two abstract signals. The representation of discrepancies between expected and actual rewards/punishments – prediction error – is thought to update the expected value of actions and predictive stimuli. Electrophysiological and lesion studies suggest that mesostriatal prediction error signals control behavior through synaptic modification of cortico-striato-thalamic networks. Signals in the ventromedial prefrontal and orbitofrontal cortex are implicated in representing expected value. To obtain unbiased maps of these representations in the human brain, we performed a meta-analysis of functional magnetic resonance imaging studies that employed algorithmic reinforcement learning models, across a variety of experimental paradigms. We found that the ventral striatum (medial and lateral) and midbrain/thalamus represented reward prediction errors, consistent with animal studies. Prediction error signals were also seen in the frontal operculum/insula, particularly for social rewards. In Pavlovian studies, striatal prediction error signals extended into the amygdala, while instrumental tasks engaged the caudate. Prediction error maps were sensitive to the model-fitting procedure (fixed or individually-estimated) and to the extent of spatial smoothing. A correlate of expected value was found in a posterior region of the ventromedial prefrontal cortex, caudal and medial to the orbitofrontal regions identified in animal studies. These findings highlight a reproducible motif of reinforcement learning in the cortico-striatal loops and identify methodological dimensions that may influence the reproducibility of activation patterns across studies. PMID:25665667

Contributions of dorsal striatal subregions to spatial alternation behavior.

PubMed

Moussa, Roula; Poucet, Bruno; Amalric, Marianne; Sargolini, Francesca

2011-07-01

Considerable evidence has shown a clear dissociation between the dorsomedial (DMS) and the dorsolateral (DLS) striatum in instrumental conditioning. In particular, DMS activity is necessary to form action-outcome associations, whereas the DLS is required for developing habitual behavior. However, few studies have investigated whether a similar dissociation exists in more complex goal-directed learning processes. The present study examined the role of the two structures in such complex learning by analyzing the effects of excitotoxic DMS and DLS lesions during the acquisition and extinction of spatial alternation behavior, in a continuous alternation T-maze task. We demonstrate that DMS and DLS lesions have opposite effects, the former impairing and the latter improving animal performance during learning and extinction. DMS lesions may impair the acquisition of spatial alternation behavior by disrupting the signal necessary to link a goal with a specific spatial sequence. In contrast, DLS lesions may accelerate goal-driven strategies by minimizing the influence of external stimuli on the response, thus increasing the impact of action-reward contingencies. Taken together, these results suggest that DMS- and DLS-mediated learning strategies develop in parallel and compete for the control of the behavioral response early in learning.

DAT1 Polymorphism Determines L-DOPA Effects on Learning about Others’ Prosociality

PubMed Central

Rieskamp, Jörg; Zehnder, Christian; Ebstein, Richard; Fehr, Ernst; Knoch, Daria

2013-01-01

Despite that a wealth of evidence links striatal dopamine to individualś reward learning performance in non-social environments, the neurochemical underpinnings of such learning during social interaction are unknown. Here, we show that the administration of 300 mg of the dopamine precursor L-DOPA to 200 healthy male subjects influences learning about a partners’ prosocial preferences in a novel social interaction task, which is akin to a repeated trust game. We found learning to be modulated by a well-established genetic marker of striatal dopamine levels, the 40-bp variable number tandem repeats polymorphism of the dopamine transporter (DAT1 polymorphism). In particular, we found that L-DOPA improves learning in 10/10R genoype subjects, who are assumed to have lower endogenous striatal dopamine levels and impairs learning in 9/10R genotype subjects, who are assumed to have higher endogenous dopamine levels. These findings provide first evidence for a critical role of dopamine in learning whether an interaction partner has a prosocial or a selfish personality. The applied pharmacogenetic approach may open doors to new ways of studying psychiatric disorders such as psychosis, which is characterized by distorted perceptions of others’ prosocial attitudes. PMID:23861813

Pathway-Specific Striatal Substrates for Habitual Behavior.

PubMed

O'Hare, Justin K; Ade, Kristen K; Sukharnikova, Tatyana; Van Hooser, Stephen D; Palmeri, Mark L; Yin, Henry H; Calakos, Nicole

2016-02-03

The dorsolateral striatum (DLS) is implicated in habit formation. However, the DLS circuit mechanisms underlying habit remain unclear. A key role for DLS is to transform sensorimotor cortical input into firing of output neurons that project to the mutually antagonistic direct and indirect basal ganglia pathways. Here we examine whether habit alters this input-output function. By imaging cortically evoked firing in large populations of pathway-defined striatal projection neurons (SPNs), we identify features that strongly correlate with habitual behavior on a subject-by-subject basis. Habitual behavior correlated with strengthened DLS output to both pathways as well as a tendency for action-promoting direct pathway SPNs to fire before indirect pathway SPNs. In contrast, habit suppression correlated solely with a weakened direct pathway output. Surprisingly, all effects were broadly distributed in space. Together, these findings indicate that the striatum imposes broad, pathway-specific modulations of incoming activity to render learned motor behaviors habitual. Copyright © 2016 Elsevier Inc. All rights reserved.

Action control is mediated by prefrontal BDNF and glucocorticoid receptor binding.

PubMed

Gourley, Shannon L; Swanson, Andrew M; Jacobs, Andrea M; Howell, Jessica L; Mo, Michelle; Dileone, Ralph J; Koleske, Anthony J; Taylor, Jane R

2012-12-11

Stressor exposure biases decision-making strategies from those based on the relationship between actions and their consequences to others restricted by stimulus-response associations. Chronic stressor exposure also desensitizes glucocorticoid receptors (GR) and diminishes motivation to acquire food reinforcement, although causal relationships are largely not established. We show that a history of chronic exposure to the GR ligand corticosterone or acute posttraining GR blockade with RU38486 makes rodents less able to perform actions based on their consequences. Thus, optimal GR binding is necessary for the consolidation of new response-outcome learning. In contrast, medial prefrontal (but not striatal) BDNF can account for stress-related amotivation, in that selective medial prefrontal cortical Bdnf knockdown decreases break-point ratios in a progressive-ratio task. Knockdown also increases vulnerability to RU38486. Despite the role of BDNF in dendritic spine reorganization, deep-layer spine remodeling does not obviously parallel progressive-ratio response patterns, but treatment with the Na(+)-channel inhibitor riluzole reverses corticosteroid-induced motivational deficits and restores prefrontal BDNF expression after corticosterone. We argue that when prefrontal neurotrophin systems are compromised, and GR-mediated hypothalamic-pituitary-adrenal axis feedback is desensitized (as in the case of chronic stress hormone exposure), amotivation and inflexible maladaptive response strategies that contribute to stress-related mood disorders result.

Liquid computing on and off the edge of chaos with a striatal microcircuit

PubMed Central

Toledo-Suárez, Carlos; Duarte, Renato; Morrison, Abigail

2014-01-01

In reinforcement learning theories of the basal ganglia, there is a need for the expected rewards corresponding to relevant environmental states to be maintained and modified during the learning process. However, the representation of these states that allows them to be associated with reward expectations remains unclear. Previous studies have tended to rely on pre-defined partitioning of states encoded by disjunct neuronal groups or sparse topological drives. A more likely scenario is that striatal neurons are involved in the encoding of multiple different states through their spike patterns, and that an appropriate partitioning of an environment is learned on the basis of task constraints, thus minimizing the number of states involved in solving a particular task. Here we show that striatal activity is sufficient to implement a liquid state, an important prerequisite for such a computation, whereby transient patterns of striatal activity are mapped onto the relevant states. We develop a simple small scale model of the striatum which can reproduce key features of the experimentally observed activity of the major cell types of the striatum. We then use the activity of this network as input for the supervised training of four simple linear readouts to learn three different functions on a plane, where the network is stimulated with the spike coded position of the agent. We discover that the network configuration that best reproduces striatal activity statistics lies on the edge of chaos and has good performance on all three tasks, but that in general, the edge of chaos is a poor predictor of network performance. PMID:25484864

Muscimol increases acetylcholine release by directly stimulating adult striatal cholinergic interneurons.

PubMed

Login, I S; Pal, S N; Adams, D T; Gold, P E

1998-01-01

Because GabaA ligands increase acetylcholine (ACh) release from adult striatal slices, we hypothesized that activation of GabaA receptors on striatal cholinergic interneurons directly stimulates ACh secretion. Fractional [3H]ACh release was recorded during perifusion of acutely dissociated, [3H]choline-labeled, adult male rat striata. The GabaA agonist, muscimol, immediately stimulated release maximally approximately 300% with EC50 = approximately 1 microM. This action was enhanced by the allosteric GabaA receptor modulators, diazepam and secobarbital, and inhibited by the GabaA antagonist, bicuculline, by ligands for D2 or muscarinic cholinergic receptors or by low calcium buffer, tetrodotoxin or vesamicol. Membrane depolarization inversely regulated muscimol-stimulated secretion. Release of endogenous and newly synthesized ACh was stimulated in parallel by muscimol without changing choline release. Muscimol pretreatment inhibited release evoked by K+ depolarization or by receptor-mediated stimulation with glutamate. Thus, GabaA receptors on adult striatal cholinergic interneurons directly stimulate voltage- and calcium-dependent exocytosis of ACh stored in vesamicol-sensitive synaptic vesicles. The action depends on the state of membrane polarization and apparently depolarizes the membrane in turn. This functional assay demonstrates that excitatory GabaA actions are not limited to neonatal tissues. GabaA-stimulated ACh release may be prevented in situ by normal tonic dopaminergic and muscarinic input to cholinergic neurons.

Dissociating hippocampal and striatal contributions to sequential prediction learning

PubMed Central

Bornstein, Aaron M.; Daw, Nathaniel D.

2011-01-01

Behavior may be generated on the basis of many different kinds of learned contingencies. For instance, responses could be guided by the direct association between a stimulus and response, or by sequential stimulus-stimulus relationships (as in model-based reinforcement learning or goal-directed actions). However, the neural architecture underlying sequential predictive learning is not well-understood, in part because it is difficult to isolate its effect on choice behavior. To track such learning more directly, we examined reaction times (RTs) in a probabilistic sequential picture identification task. We used computational learning models to isolate trial-by-trial effects of two distinct learning processes in behavior, and used these as signatures to analyze the separate neural substrates of each process. RTs were best explained via the combination of two delta rule learning processes with different learning rates. To examine neural manifestations of these learning processes, we used functional magnetic resonance imaging to seek correlates of timeseries related to expectancy or surprise. We observed such correlates in two regions, hippocampus and striatum. By estimating the learning rates best explaining each signal, we verified that they were uniquely associated with one of the two distinct processes identified behaviorally. These differential correlates suggest that complementary anticipatory functions drive each region's effect on behavior. Our results provide novel insights as to the quantitative computational distinctions between medial temporal and basal ganglia learning networks and enable experiments that exploit trial-by-trial measurement of the unique contributions of both hippocampus and striatum to response behavior. PMID:22487032

Striatal degeneration impairs language learning: evidence from Huntington's disease.

PubMed

De Diego-Balaguer, R; Couette, M; Dolbeau, G; Dürr, A; Youssov, K; Bachoud-Lévi, A-C

2008-11-01

Although the role of the striatum in language processing is still largely unclear, a number of recent proposals have outlined its specific contribution. Different studies report evidence converging to a picture where the striatum may be involved in those aspects of rule-application requiring non-automatized behaviour. This is the main characteristic of the earliest phases of language acquisition that require the online detection of distant dependencies and the creation of syntactic categories by means of rule learning. Learning of sequences and categorization processes in non-language domains has been known to require striatal recruitment. Thus, we hypothesized that the striatum should play a prominent role in the extraction of rules in learning a language. We studied 13 pre-symptomatic gene-carriers and 22 early stage patients of Huntington's disease (pre-HD), both characterized by a progressive degeneration of the striatum and 21 late stage patients Huntington's disease (18 stage II, two stage III and one stage IV) where cortical degeneration accompanies striatal degeneration. When presented with a simplified artificial language where words and rules could be extracted, early stage Huntington's disease patients (stage I) were impaired in the learning test, demonstrating a greater impairment in rule than word learning compared to the 20 age- and education-matched controls. Huntington's disease patients at later stages were impaired both on word and rule learning. While spared in their overall performance, gene-carriers having learned a set of abstract artificial language rules were then impaired in the transfer of those rules to similar artificial language structures. The correlation analyses among several neuropsychological tests assessing executive function showed that rule learning correlated with tests requiring working memory and attentional control, while word learning correlated with a test involving episodic memory. These learning impairments significantly correlated with the bicaudate ratio. The overall results support striatal involvement in rule extraction from speech and suggest that language acquisition requires several aspects of memory and executive functions for word and rule learning.

Altered mGluR5-Homer scaffolds and corticostriatal connectivity in a Shank3 complete knockout model of autism.

PubMed

Wang, Xiaoming; Bey, Alexandra L; Katz, Brittany M; Badea, Alexandra; Kim, Namsoo; David, Lisa K; Duffney, Lara J; Kumar, Sunil; Mague, Stephen D; Hulbert, Samuel W; Dutta, Nisha; Hayrapetyan, Volodya; Yu, Chunxiu; Gaidis, Erin; Zhao, Shengli; Ding, Jin-Dong; Xu, Qiong; Chung, Leeyup; Rodriguiz, Ramona M; Wang, Fan; Weinberg, Richard J; Wetsel, William C; Dzirasa, Kafui; Yin, Henry; Jiang, Yong-Hui

2016-05-10

Human neuroimaging studies suggest that aberrant neural connectivity underlies behavioural deficits in autism spectrum disorders (ASDs), but the molecular and neural circuit mechanisms underlying ASDs remain elusive. Here, we describe a complete knockout mouse model of the autism-associated Shank3 gene, with a deletion of exons 4-22 (Δe4-22). Both mGluR5-Homer scaffolds and mGluR5-mediated signalling are selectively altered in striatal neurons. These changes are associated with perturbed function at striatal synapses, abnormal brain morphology, aberrant structural connectivity and ASD-like behaviour. In vivo recording reveals that the cortico-striatal-thalamic circuit is tonically hyperactive in mutants, but becomes hypoactive during social behaviour. Manipulation of mGluR5 activity attenuates excessive grooming and instrumental learning differentially, and rescues impaired striatal synaptic plasticity in Δe4-22(-/-) mice. These findings show that deficiency of Shank3 can impair mGluR5-Homer scaffolding, resulting in cortico-striatal circuit abnormalities that underlie deficits in learning and ASD-like behaviours. These data suggest causal links between genetic, molecular, and circuit mechanisms underlying the pathophysiology of ASDs.

Altered mGluR5-Homer scaffolds and corticostriatal connectivity in a Shank3 complete knockout model of autism

PubMed Central

Wang, Xiaoming; Bey, Alexandra L.; Katz, Brittany M.; Badea, Alexandra; Kim, Namsoo; David, Lisa K.; Duffney, Lara J.; Kumar, Sunil; Mague, Stephen D.; Hulbert, Samuel W.; Dutta, Nisha; Hayrapetyan, Volodya; Yu, Chunxiu; Gaidis, Erin; Zhao, Shengli; Ding, Jin-Dong; Xu, Qiong; Chung, Leeyup; Rodriguiz, Ramona M.; Wang, Fan; Weinberg, Richard J.; Wetsel, William C.; Dzirasa, Kafui; Yin, Henry; Jiang, Yong-hui

2016-01-01

Human neuroimaging studies suggest that aberrant neural connectivity underlies behavioural deficits in autism spectrum disorders (ASDs), but the molecular and neural circuit mechanisms underlying ASDs remain elusive. Here, we describe a complete knockout mouse model of the autism-associated Shank3 gene, with a deletion of exons 4–22 (Δe4–22). Both mGluR5-Homer scaffolds and mGluR5-mediated signalling are selectively altered in striatal neurons. These changes are associated with perturbed function at striatal synapses, abnormal brain morphology, aberrant structural connectivity and ASD-like behaviour. In vivo recording reveals that the cortico-striatal-thalamic circuit is tonically hyperactive in mutants, but becomes hypoactive during social behaviour. Manipulation of mGluR5 activity attenuates excessive grooming and instrumental learning differentially, and rescues impaired striatal synaptic plasticity in Δe4–22−/− mice. These findings show that deficiency of Shank3 can impair mGluR5-Homer scaffolding, resulting in cortico-striatal circuit abnormalities that underlie deficits in learning and ASD-like behaviours. These data suggest causal links between genetic, molecular, and circuit mechanisms underlying the pathophysiology of ASDs. PMID:27161151

[Met5]Enkephalin content in brain regions of rats treated with lithium.

PubMed Central

Gillin, J C; Hong, J S; Yang, H Y; Costa, E

1978-01-01

In rats, chronic treatment with lithium elicits a dose-dependent increase in the [Met5]enkephalin content of nucleus caudatus and globus pallidus. A single injection of lithium fails to change the striatal [Met5]enkephalin content. The increase in [Met5]enkephalin caused by chronic lithium is proportional to the serum lithium level. The extent of the increase in striatal [Met5]enkephalin content levels off at a value of about 250% that of untreated rats. This increase has a time latency of 2--3 days and reaches a plateau at 5 days. The increase that was present at 5 days was no longer evident if the treatment was continued for 2 weeks. Lithium also increases striatal [Leu5]enkephalin content by an extent equal to the increase of [Met 5]enkephalin. Based on the characteristics of the lithium-induced increase in [Met6]enkephalin content, it is proposed that lithium may reduce the rate of release of [Met5]enkephalin from the small enkephalinergic neurons that are intrinsic to the striatum; this action may be related to a change in the regulation of striatal neurons. PMID:275866

Arc mRNA induction in striatal efferent neurons associated with response learning.

PubMed

Daberkow, D P; Riedy, M D; Kesner, R P; Keefe, K A

2007-07-01

The dorsal striatum is involved in motor-response learning, but the extent to which distinct populations of striatal efferent neurons are differentially involved in such learning is unknown. Activity-regulated, cytoskeleton-associated (Arc) protein is an effector immediate-early gene implicated in synaptic plasticity. We examined arc mRNA expression in striatopallidal vs. striatonigral efferent neurons in dorsomedial and dorsolateral striatum of rats engaged in reversal learning on a T-maze motor-response task. Male Sprague-Dawley rats learned to turn right or left for 3 days. Half of the rats then underwent reversal training. The remaining rats were yoked to rats undergoing reversal training, such that they ran the same number of trials but ran them as continued-acquisition trials. Brains were removed and processed using double-label fluorescent in situ hybridization for arc and preproenkephalin (PPE) mRNA. In the reversal, but not the continued-acquisition, group there was a significant relation between the overall arc mRNA signal in dorsomedial striatum and the number of trials run, with rats reaching criterion in fewer trials having higher levels of arc mRNA expression. A similar relation was seen between the numbers of PPE(+) and PPE(-) neurons in dorsomedial striatum with cytoplasmic arc mRNA expression. Interestingly, in behaviourally activated animals significantly more PPE(-) neurons had cytoplasmic arc mRNA expression. These data suggest that Arc in both striatonigral and striatopallidal efferent neurons is involved in striatal synaptic plasticity mediating motor-response learning in the T-maze and that there is differential processing of arc mRNA in distinct subpopulations of striatal efferent neurons.

Feedback-based probabilistic category learning is selectively impaired in attention/hyperactivity deficit disorder.

PubMed

Gabay, Yafit; Goldfarb, Liat

2017-07-01

Although Attention-Deficit Hyperactivity Disorder (ADHD) is closely linked to executive function deficits, it has recently been attributed to procedural learning impairments that are quite distinct from the former. These observations challenge the ability of the executive function framework solely to account for the diverse range of symptoms observed in ADHD. A recent neurocomputational model emphasizes the role of striatal dopamine (DA) in explaining ADHD's broad range of deficits, but the link between this model and procedural learning impairments remains unclear. Significantly, feedback-based procedural learning is hypothesized to be disrupted in ADHD because of the involvement of striatal DA in this type of learning. In order to test this assumption, we employed two variants of a probabilistic category learning task known from the neuropsychological literature. Feedback-based (FB) and paired associate-based (PA) probabilistic category learning were employed in a non-medicated sample of ADHD participants and neurotypical participants. In the FB task, participants learned associations between cues and outcomes initially by guessing and subsequently through feedback indicating the correctness of the response. In the PA learning task, participants viewed the cue and its associated outcome simultaneously without receiving an overt response or corrective feedback. In both tasks, participants were trained across 150 trials. Learning was assessed in a subsequent test without a presentation of the outcome or corrective feedback. Results revealed an interesting disassociation in which ADHD participants performed as well as control participants in the PA task, but were impaired compared with the controls in the FB task. The learning curve during FB training differed between the two groups. Taken together, these results suggest that the ability to incrementally learn by feedback is selectively disrupted in ADHD participants. These results are discussed in relation to both the ADHD dopaminergic dysfunction model and recent findings implicating procedural learning impairments in those with ADHD. Copyright © 2017 Elsevier Inc. All rights reserved.

Carbachol inhibits basal and forskolin-evoked adult rat striatal acetylcholine release.

PubMed

Login, I S

1997-05-27

Acutely dissociated adult rat striatal cholinergic neurons labeled with [3H]choline were used in a perifusion system to study muscarinic regulation of basal and forskolin-stimulated fractional [3H]acetylcholine ([3H]-ACh) efflux in the absence of synaptic modulation. Carbachol inhibited basal (40% maximal inhibition; IC50 approximately 0.7 microM) and forskolin-evoked release (75% inhibition; IC50 approximately 0.05 microM) in a concentration-dependent manner, and both carbachol actions were abolished with atropine. Thus, activation of striatal muscarinic cholinergic autoreceptors potently inhibits basal and adenylate cyclase-stimulated ACh release. Tonic inhibitory control of cholinergic activity by functional striatal circuitry apparently prevents detection of these important physiological interactions in slices or in situ.

Parkinson's Disease and Dopaminergic Therapy--Differential Effects on Movement, Reward and Cognition

ERIC Educational Resources Information Center

Rowe, J. B.; Hughes, L.; Ghosh, B. C. P.; Eckstein, D.; Williams-Gray, C. H.; Fallon, S.; Barker, R. A.; Owen, A. M.

2008-01-01

Cognitive deficits are very common in Parkinson's disease particularly for "executive functions" associated with frontal cortico-striatal networks. Previous work has identified deficits in tasks that require attentional control like task-switching, and reward-based tasks like gambling or reversal learning. However, there is a complex…

The neuropsychological basis of addictive behaviour.

PubMed

Everitt, B J; Dickinson, A; Robbins, T W

2001-10-01

The argument advanced in this review is that drug addiction can be understood in terms of normal learning and memory systems of the brain which, through the actions of chronically self-administered drugs, are pathologically subverted, thereby leading to the establishment of compulsive drug-seeking habits, strengthened by the motivational impact of drug-associated stimuli and occurring at the expense of other sources of reinforcement. We review data from our studies that have utilized procedures which reveal the various influences of pavlovian stimuli on goal-directed behaviour, namely discriminated approach, pavlovian-to-instrumental transfer and conditioned reinforcement, in order to demonstrate their overlapping and also unique neural bases. These fundamental studies are also reviewed in the context of the neural and psychological mechanisms underlying drug-seeking behaviour that is under the control of drug-associated environmental stimuli. The ways in which such drug-seeking behaviour becomes compulsive and habitual, as well as the propensity for relapse to drug-seeking even after long periods of relapse, are discussed in terms of the aberrant learning set in train by the effects of self-administered drugs on plastic processes in limbic cortical-ventral striatal systems.

Altered fronto-striatal functions in the Gdi1-null mouse model of X-linked Intellectual Disability.

PubMed

Morè, Lorenzo; Künnecke, Basil; Yekhlef, Latefa; Bruns, Andreas; Marte, Antonella; Fedele, Ernesto; Bianchi, Veronica; Taverna, Stefano; Gatti, Silvia; D'Adamo, Patrizia

2017-03-06

RAB-GDP dissociation inhibitor 1 (GDI1) loss-of-function mutations are responsible for a form of non-specific X-linked Intellectual Disability (XLID) where the only clinical feature is cognitive impairment. GDI1 patients are impaired in specific aspects of executive functions and conditioned response, which are controlled by fronto-striatal circuitries. Previous molecular and behavioral characterization of the Gdi1-null mouse revealed alterations in the total number/distribution of hippocampal and cortical synaptic vesicles as well as hippocampal short-term synaptic plasticity, and memory deficits. In this study, we employed cognitive protocols with high translational validity to human condition that target the functionality of cortico-striatal circuitry such as attention and stimulus selection ability with progressive degree of complexity. We previously showed that Gdi1-null mice are impaired in some hippocampus-dependent forms of associative learning assessed by aversive procedures. Here, using appetitive-conditioning procedures we further investigated associative learning deficits sustained by the fronto-striatal system. We report that Gdi1-null mice are impaired in attention and associative learning processes, which are a key part of the cognitive impairment observed in XLID patients. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Multi-Site Diagnostic Classification of Schizophrenia Using Discriminant Deep Learning with Functional Connectivity MRI.

PubMed

Zeng, Ling-Li; Wang, Huaning; Hu, Panpan; Yang, Bo; Pu, Weidan; Shen, Hui; Chen, Xingui; Liu, Zhening; Yin, Hong; Tan, Qingrong; Wang, Kai; Hu, Dewen

2018-04-01

A lack of a sufficiently large sample at single sites causes poor generalizability in automatic diagnosis classification of heterogeneous psychiatric disorders such as schizophrenia based on brain imaging scans. Advanced deep learning methods may be capable of learning subtle hidden patterns from high dimensional imaging data, overcome potential site-related variation, and achieve reproducible cross-site classification. However, deep learning-based cross-site transfer classification, despite less imaging site-specificity and more generalizability of diagnostic models, has not been investigated in schizophrenia. A large multi-site functional MRI sample (n = 734, including 357 schizophrenic patients from seven imaging resources) was collected, and a deep discriminant autoencoder network, aimed at learning imaging site-shared functional connectivity features, was developed to discriminate schizophrenic individuals from healthy controls. Accuracies of approximately 85·0% and 81·0% were obtained in multi-site pooling classification and leave-site-out transfer classification, respectively. The learned functional connectivity features revealed dysregulation of the cortical-striatal-cerebellar circuit in schizophrenia, and the most discriminating functional connections were primarily located within and across the default, salience, and control networks. The findings imply that dysfunctional integration of the cortical-striatal-cerebellar circuit across the default, salience, and control networks may play an important role in the "disconnectivity" model underlying the pathophysiology of schizophrenia. The proposed discriminant deep learning method may be capable of learning reliable connectome patterns and help in understanding the pathophysiology and achieving accurate prediction of schizophrenia across multiple independent imaging sites. Copyright © 2018 German Center for Neurodegenerative Diseases (DZNE). Published by Elsevier B.V. All rights reserved.

Dopaminergic Balance between Reward Maximization and Policy Complexity

PubMed Central

Parush, Naama; Tishby, Naftali; Bergman, Hagai

2011-01-01

Previous reinforcement-learning models of the basal ganglia network have highlighted the role of dopamine in encoding the mismatch between prediction and reality. Far less attention has been paid to the computational goals and algorithms of the main-axis (actor). Here, we construct a top-down model of the basal ganglia with emphasis on the role of dopamine as both a reinforcement learning signal and as a pseudo-temperature signal controlling the general level of basal ganglia excitability and motor vigilance of the acting agent. We argue that the basal ganglia endow the thalamic-cortical networks with the optimal dynamic tradeoff between two constraints: minimizing the policy complexity (cost) and maximizing the expected future reward (gain). We show that this multi-dimensional optimization processes results in an experience-modulated version of the softmax behavioral policy. Thus, as in classical softmax behavioral policies, probability of actions are selected according to their estimated values and the pseudo-temperature, but in addition also vary according to the frequency of previous choices of these actions. We conclude that the computational goal of the basal ganglia is not to maximize cumulative (positive and negative) reward. Rather, the basal ganglia aim at optimization of independent gain and cost functions. Unlike previously suggested single-variable maximization processes, this multi-dimensional optimization process leads naturally to a softmax-like behavioral policy. We suggest that beyond its role in the modulation of the efficacy of the cortico-striatal synapses, dopamine directly affects striatal excitability and thus provides a pseudo-temperature signal that modulates the tradeoff between gain and cost. The resulting experience and dopamine modulated softmax policy can then serve as a theoretical framework to account for the broad range of behaviors and clinical states governed by the basal ganglia and dopamine systems. PMID:21603228

Possible roles for fronto-striatal circuits in reading disorder

PubMed Central

Hancock, Roeland; Richlan, Fabio; Hoeft, Fumiko

2016-01-01

Several studies have reported hyperactivation in frontal and striatal regions in individuals with reading disorder (RD) during reading-related tasks. Hyperactivation in these regions is typically interpreted as a form of neural compensation and related to articulatory processing. Fronto-striatal hyperactivation in RD can however, also arise from fundamental impairment in reading related processes, such as phonological processing and implicit sequence learning relevant to early language acquisition. We review current evidence for the compensation hypothesis in RD and apply large-scale reverse inference to investigate anatomical overlap between hyperactivation regions and neural systems for articulation, phonological processing, implicit sequence learning. We found anatomical convergence between hyperactivation regions and regions supporting articulation, consistent with the proposed compensatory role of these regions, and low convergence with phonological and implicit sequence learning regions. Although the application of large-scale reverse inference to decode function in a clinical population should be interpreted cautiously, our findings suggest future lines of research that may clarify the functional significance of hyperactivation in RD. PMID:27826071

Striatal FoxP2 Is Actively Regulated during Songbird Sensorimotor Learning

PubMed Central

Teramitsu, Ikuko; Poopatanapong, Amy; Torrisi, Salvatore; White, Stephanie A.

2010-01-01

Background Mutations in the FOXP2 transcription factor lead to language disorders with developmental onset. Accompanying structural abnormalities in cortico-striatal circuitry indicate that at least a portion of the behavioral phenotype is due to organizational deficits. We previously found parallel FoxP2 expression patterns in human and songbird cortico/pallio-striatal circuits important for learned vocalizations, suggesting that FoxP2's function in birdsong may generalize to speech. Methodology/Principal Findings We used zebra finches to address the question of whether FoxP2 is additionally important in the post-organizational function of these circuits. In both humans and songbirds, vocal learning depends on auditory guidance to achieve and maintain optimal vocal output. We tested whether deafening prior to or during the sensorimotor phase of song learning disrupted FoxP2 expression in song circuitry. As expected, the songs of deafened juveniles were abnormal, however basal FoxP2 levels were unaffected. In contrast, when hearing or deaf juveniles sang for two hours in the morning, FoxP2 was acutely down-regulated in the striatal song nucleus, area X. The extent of down-regulation was similar between hearing and deaf birds. Interestingly, levels of FoxP2 and singing were correlated only in hearing birds. Conclusions/Significance Hearing appears to link FoxP2 levels to the amount of vocal practice. As juvenile birds spent more time practicing than did adults, their FoxP2 levels are likely to be low more often. Behaviorally-driven reductions in the mRNA encoding this transcription factor could ultimately affect downstream molecules that function in vocal exploration, especially during sensorimotor learning. PMID:20062527

Selective inactivation of adenosine A2A receptors in striatal neurons enhances working memory and reversal learning

PubMed Central

Wei, Catherine J.; Singer, Philipp; Coelho, Joana; Boison, Detlev; Feldon, Joram; Yee, Benjamin K.; Chen, Jiang-Fan

2011-01-01

The adenosine A2A receptor (A2AR) is highly enriched in the striatum where it is uniquely positioned to integrate dopaminergic, glutamatergic, and other signals to modulate cognition. Although previous studies support the hypothesis that A2AR inactivation can be pro-cognitive, analyses of A2AR's effects on cognitive functions have been restricted to a small subset of cognitive domains. Furthermore, the relative contribution of A2ARs in distinct brain regions remains largely unknown. Here, we studied the regulation of multiple memory processes by brain region-specific populations of A2ARs. Specifically, we evaluated the cognitive impacts of conditional A2AR deletion restricted to either the entire forebrain (i.e., cerebral cortex, hippocampus, and striatum, fb-A2AR KO) or to striatum alone (st-A2AR KO) in recognition memory, working memory, reference memory, and reversal learning. This comprehensive, comparative analysis showed for the first time that depletion of A2AR-dependent signaling in either the entire forebrain or striatum alone is associated with two specific phenotypes indicative of cognitive flexibility—enhanced working memory and enhanced reversal learning. These selective pro-cognitive phenotypes seemed largely attributed to inactivation of striatal A2ARs as they were captured by A2AR deletion restricted to striatal neurons. Neither spatial reference memory acquisition nor spatial recognition memory were grossly affected, and no evidence for compensatory changes in striatal or cortical D1, D2, or A1 receptor expression was found. This study provides the first direct demonstration that targeting striatal A2ARs may be an effective, novel strategy to facilitate cognitive flexibility under normal and pathologic conditions. PMID:21693634

Selective inactivation of adenosine A(2A) receptors in striatal neurons enhances working memory and reversal learning.

PubMed

Wei, Catherine J; Singer, Philipp; Coelho, Joana; Boison, Detlev; Feldon, Joram; Yee, Benjamin K; Chen, Jiang-Fan

2011-01-01

The adenosine A(2A) receptor (A(2A)R) is highly enriched in the striatum where it is uniquely positioned to integrate dopaminergic, glutamatergic, and other signals to modulate cognition. Although previous studies support the hypothesis that A(2A)R inactivation can be pro-cognitive, analyses of A(2A)R's effects on cognitive functions have been restricted to a small subset of cognitive domains. Furthermore, the relative contribution of A(2A)Rs in distinct brain regions remains largely unknown. Here, we studied the regulation of multiple memory processes by brain region-specific populations of A(2A)Rs. Specifically, we evaluated the cognitive impacts of conditional A(2A)R deletion restricted to either the entire forebrain (i.e., cerebral cortex, hippocampus, and striatum, fb-A(2A)R KO) or to striatum alone (st-A(2A)R KO) in recognition memory, working memory, reference memory, and reversal learning. This comprehensive, comparative analysis showed for the first time that depletion of A(2A)R-dependent signaling in either the entire forebrain or striatum alone is associated with two specific phenotypes indicative of cognitive flexibility-enhanced working memory and enhanced reversal learning. These selective pro-cognitive phenotypes seemed largely attributed to inactivation of striatal A(2A)Rs as they were captured by A(2A)R deletion restricted to striatal neurons. Neither spatial reference memory acquisition nor spatial recognition memory were grossly affected, and no evidence for compensatory changes in striatal or cortical D(1), D(2), or A(1) receptor expression was found. This study provides the first direct demonstration that targeting striatal A(2A)Rs may be an effective, novel strategy to facilitate cognitive flexibility under normal and pathologic conditions.

Social defeat disrupts reward learning and potentiates striatal nociceptin/orphanin FQ mRNA in rats.

PubMed

Der-Avakian, Andre; D'Souza, Manoranjan S; Potter, David N; Chartoff, Elena H; Carlezon, William A; Pizzagalli, Diego A; Markou, Athina

2017-05-01

Mood disorders can be triggered by stress and are characterized by deficits in reward processing, including disrupted reward learning (the ability to modulate behavior according to past rewards). Reward learning is regulated by the anterior cingulate cortex (ACC) and striatal circuits, both of which are implicated in the pathophysiology of mood disorders. Here, we assessed in rats the effects of a potent stressor (social defeat) on reward learning and gene expression in the ACC, ventral tegmental area (VTA), and striatum. Adult male Wistar rats were trained on an operant probabilistic reward task (PRT) and then exposed to 3 days of social defeat before assessment of reward learning. After testing, the ACC, VTA, and striatum were dissected, and expression of genes previously implicated in stress was assessed. Social defeat blunted reward learning (manifested as reduced response bias toward a more frequently rewarded stimulus) and was associated with increased nociceptin/orphanin FQ (N/OFQ) peptide mRNA levels in the striatum and decreased Fos mRNA levels in the VTA. Moreover, N/OFQ peptide and nociceptin receptor mRNA levels in the ACC, VTA and striatum were inversely related to reward learning. The behavioral findings parallel previous data in humans, suggesting that stress similarly disrupts reward learning in both species. Increased striatal N/OFQ mRNA in stressed rats characterized by impaired reward learning is consistent with accumulating evidence that antagonism of nociceptin receptors, which bind N/OFQ, has antidepressant-like effects. These results raise the possibility that nociceptin systems represent a molecular substrate through which stress produces reward learning deficits in mood disorders.

Reversal-specific learning impairments after a binge regimen of methamphetamine in rats: possible involvement of striatal dopamine.

PubMed

Izquierdo, Alicia; Belcher, Annabelle M; Scott, Lori; Cazares, Victor A; Chen, Jack; O'Dell, Steven J; Malvaez, Melissa; Wu, Tiffany; Marshall, John F

2010-01-01

A growing body of evidence indicates that protracted use of methamphetamine (mAMPH) causes long-term impairments in cognitive function in humans. Aside from the widely reported problems with attention, mAMPH users exhibit learning and memory deficits, particularly on tasks requiring response control. Although binge mAMPH administration to animals results in cognitive deficits, few studies have attempted to test behavioral flexibility in animals after mAMPH exposure. The aim of this study was to evaluate whether mAMPH would produce impairments in two tasks assessing flexible responding in rats: a touchscreen-based discrimination-reversal learning task and an attentional set shift task (ASST) based on a hallmark test of executive function in humans, the Wisconsin Card Sort. We treated male Long-Evans rats with a regimen of four injections of 2 mg/kg mAMPH (or vehicle) within a single day, a dosing regimen shown earlier to produce object recognition impairments. We then tested them on (1) reversal learning after pretreatment discrimination learning or (2) the ASST. Early reversal learning accuracy was impaired in mAMPH-treated rats. MAMPH pretreatment also selectively impaired reversal performance during ASST testing, leaving set-shifting performance intact. Postmortem analysis of [(125)I]RTI-55 binding revealed small (10-20%) but significant reductions in striatal dopamine transporters produced by this mAMPH regimen. Together, these results lend new information to the growing field documenting impaired cognition after mAMPH exposure, and constitute a rat model of the widely reported decision-making deficits resulting from mAMPH abuse seen in humans.

Fronto-striatal circuits in response-inhibition: Relevance to addiction

PubMed Central

Morein-Zamir, Sharon; Robbins, Trevor W.

2015-01-01

Disruptions to inhibitory control are believed to contribute to multiple aspects of drug abuse, from preexisting vulnerability in at-risk individuals, through escalation to dependence, to promotion of relapse in chronic users. Paradigms investigating the suppression of actions have been investigated in animal and human research on drug addiction. Rodent research has focused largely on impulsive behaviors, often gauged by premature responding, as a viable model highlighting the relevant role of dopamine and other neurotransmitters primarily in the striatum. Human research on action inhibition in stimulant dependence has highlighted impaired performance and largely prefrontal cortical abnormalities as part of a broader pattern of cognitive abnormalities. Animal and human research implicate inhibitory difficulties mediated by fronto-striatal circuitry both preceding and as a result of excessive stimulus use. In this regard, response-inhibition has proven a useful cognitive function to gauge the integrity of fronto-striatal systems and their role in contributing to impulsive and compulsive features of drug dependence. This article is part of a Special Issue entitled SI:Addiction circuits. PMID:25218611

A Closer Look at the Effects of Repeated Cocaine Exposure on Adaptive Decision-Making under Conditions That Promote Goal-Directed Control

PubMed Central

Halbout, Briac; Liu, Angela T.; Ostlund, Sean B.

2016-01-01

It has been proposed that compulsive drug seeking reflects an underlying dysregulation in adaptive behavior that favors habitual (automatic and inflexible) over goal-directed (deliberative and highly flexible) action selection. Rodent studies have established that repeated exposure to cocaine or amphetamine facilitates the development of habits, producing behavior that becomes unusually insensitive to a reduction in the value of its outcome. The current study more directly investigated the effects of cocaine pre-exposure on goal-directed learning and action selection using an approach that discourages habitual performance. After undergoing a 15-day series of cocaine (15 or 30 mg/kg, i.p.) or saline injections and a drug withdrawal period, rats were trained to perform two different lever-press actions for distinct reward options. During a subsequent outcome devaluation test, both cocaine- and saline-treated rats showed a robust bias in their choice between the two actions, preferring whichever action had been trained with the reward that retained its value. Thus, it appears that the tendency for repeated cocaine exposure to promote habit formation does not extend to a more complex behavioral scenario that encourages goal-directed control. To further explore this issue, we assessed how prior cocaine treatment would affect the rats’ ability to learn about a selective reduction in the predictive relationship between one of the two actions and its outcome, which is another fundamental feature of goal-directed behavior. Interestingly, we found that cocaine-treated rats showed enhanced, rather than diminished, sensitivity to this action–outcome contingency degradation manipulation. Given their mutual dependence on striatal dopamine signaling, we suggest that cocaine’s effects on habit formation and contingency learning may stem from a common adaptation in this neurochemical system. PMID:27047400

Ventral striatal prediction error signaling is associated with dopamine synthesis capacity and fluid intelligence

PubMed Central

Schlagenhauf, Florian; Rapp, Michael A.; Huys, Quentin J. M.; Beck, Anne; Wüstenberg, Torsten; Deserno, Lorenz; Buchholz, Hans-Georg; Kalbitzer, Jan; Buchert, Ralph; Kienast, Thorsten; Cumming, Paul; Plotkin, Michail; Kumakura, Yoshitaka; Grace, Anthony A.; Dolan, Raymond J.; Heinz, Andreas

2013-01-01

Fluid intelligence represents the capacity for flexible problem solving and rapid behavioral adaptation. Rewards drive flexible behavioral adaptation, in part via a teaching signal expressed as reward prediction errors in the ventral striatum, which has been associated with phasic dopamine release in animal studies. We examined a sample of 28 healthy male adults using multimodal imaging and biological parametric mapping with 1) functional magnetic resonance imaging during a reversal learning task and 2) in a subsample of 17 subjects also with positron emission tomography using 6-[18F]fluoro-L-DOPA to assess dopamine synthesis capacity. Fluid intelligence was measured using a battery of nine standard neuropsychological tests. Ventral striatal BOLD correlates of reward prediction errors were positively correlated with fluid intelligence and, in the right ventral striatum, also inversely correlated with dopamine synthesis capacity (FDOPA Kinapp). When exploring aspects of fluid intelligence, we observed that prediction error signaling correlates with complex attention and reasoning. These findings indicate that individual differences in the capacity for flexible problem solving may be driven by ventral striatal activation during reward-related learning, which in turn proved to be inversely associated with ventral striatal dopamine synthesis capacity. PMID:22344813

Action potentials and amphetamine release antipsychotic drug from dopamine neuron synaptic VMAT vesicles.

PubMed

Tucker, Kristal R; Block, Ethan R; Levitan, Edwin S

2015-08-11

Based on lysotracker red imaging in cultured hippocampal neurons, antipsychotic drugs (APDs) were proposed to accumulate in synaptic vesicles by acidic trapping and to be released in response to action potentials. Because many APDs are dopamine (DA) D2 receptor (D2R) antagonists, such a mechanism would be particularly interesting if it operated in midbrain DA neurons. Here, the APD cyamemazine (CYAM) is visualized directly by two-photon microscopy in substantia nigra and striatum brain slices. CYAM accumulated slowly into puncta based on vacuolar H(+)-ATPase activity and dispersed rapidly upon dissipating organelle pH gradients. Thus, CYAM is subject to acidic trapping and released upon deprotonation. In the striatum, Ca(2+)-dependent reduction of the CYAM punctate signal was induced by depolarization or action potentials. Striatal CYAM overlapped with the dopamine transporter (DAT). Furthermore, parachloroamphetamine (pCA), acting via vesicular monoamine transporter (VMAT), and a charged VMAT, substrate 1-methyl-4-phenylpyridinium (MPP(+)), reduced striatal CYAM. In vivo CYAM administration and in vitro experiments confirmed that clinically relevant CYAM concentrations result in vesicular accumulation and pCA-dependent release. These results show that some CYAM is in DA neuron VMAT vesicles and suggests a new drug interaction in which amphetamine induces CYAM deprotonation and release as a consequence of the H(+) countertransport by VMAT that accompanies vesicular uptake, but not by inducing exchange or acting as a weak base. Therefore, in the striatum, APDs are released with DA in response to action potentials and an amphetamine. This synaptic corelease is expected to enhance APD antagonism of D2Rs where and when dopaminergic transmission occurs.

Striatal dopamine release and impaired reinforcement learning in adults with 22q11.2 deletion syndrome.

PubMed

van Duin, Esther D A; Kasanova, Zuzana; Hernaus, Dennis; Ceccarini, Jenny; Heinzel, Alexander; Mottaghy, Felix; Mohammadkhani-Shali, Siamak; Winz, Oliver; Frank, Michael; Beck, Merrit C H; Booij, Jan; Myin-Germeys, Inez; van Amelsvoort, Thérèse

2018-06-01

22q11.2 deletion syndrome (22q11DS) is a genetic disorder caused by a microdeletion on chromosome 22q11.2 and associated with an increased risk for developing psychosis. The catechol-O-methyltransferase (COMT) gene is located in the deleted region and involved in dopamine (DA) breakdown. Impaired reinforcement learning (RL) is a recurrent feature in psychosis and thought to be related to abnormal striatal DA function. This study aims to examine RL and the potential association with striatal DA-ergic neuromodulation in 22q11DS. Twelve non-psychotic adults with 22q11DS and 16 healthy controls (HC) were included. A dopamine D 2/3 receptor [ 18 F]fallypride positron emission tomography (PET) scan was acquired while participants performed a modified version of the probabilistic stimulus selection task. RL-task performance was significantly worse in 22q11DS compared to HC. There were no group difference in striatal nondisplaceable binding potential (BP ND ) and task-induced DA release. In HC, striatal task-induced DA release was positively associated with task performance, but no such relation was found in 22q11DS subjects. Moreover, higher caudate nucleus task-induced DA release was found in COMT Met hemizygotes relative to Val hemizygotes. This study is the first to show impairments in RL in 22q11DS. It suggests that potentially motivational impairments are not only present in psychosis, but also in this genetic high risk group. These deficits may be underlain by abnormal striatal task-induced DA release, perhaps as a consequence of COMT haplo-insufficiency. Copyright © 2018 Elsevier B.V. and ECNP. All rights reserved.

Changes in the stimulus-preceding negativity and lateralized readiness potential during reinforcement learning.

PubMed

Ren, Xi; Valle-Inclán, Fernando; Tukaiev, Sergii; Hackley, Steven A

2017-07-01

According to reinforcement learning theory, dopamine-dependent anticipatory processes play a critical role in learning from action outcomes such as feedback or reward. To better understand outcome anticipation, we examined variation in slow cortical potentials and assessed their changes over the course of motor-skill acquisition. Healthy young adults learned a series of precisely timed, key press sequences. Feedback was delivered at a delay of either 2.5 or 8 s, to encourage use of either the striatally mediated, habit learning system or the hippocampus-dependent, episodic memory system, respectively. During the 2.5-s delay, the stimulus-preceding negativity (SPN) was shown to decline in amplitude across trials, confirming previous results from a perceptual categorization task (Morís, Luque, & Rodríguez-Fornells, 2013). This falsifies the hypothesis that SPN reflects specific outcome predictions, on the assumption that the ability to make such predictions should improve as a task is mastered. An SPN was also evident during the 8-s delay, but it increased in amplitude across trials. At the conclusion of the 8-s but not the 2.5-s prefeedback interval, a reversed-polarity lateralized readiness potential (LRP) was noted. It was suggested that this might indicate maintenance of an action representation for comparison with the feedback display. If so, this would constitute the first direct psychophysiological evidence for a popular hypothetical construct in quantitative models of reinforcement learning, the so-called eligibility trace. © 2017 Society for Psychophysiological Research.

Goal-Directed Behavior and Instrumental Devaluation: A Neural System-Level Computational Model

PubMed Central

Mannella, Francesco; Mirolli, Marco; Baldassarre, Gianluca

2016-01-01

Devaluation is the key experimental paradigm used to demonstrate the presence of instrumental behaviors guided by goals in mammals. We propose a neural system-level computational model to address the question of which brain mechanisms allow the current value of rewards to control instrumental actions. The model pivots on and shows the computational soundness of the hypothesis for which the internal representation of instrumental manipulanda (e.g., levers) activate the representation of rewards (or “action-outcomes”, e.g., foods) while attributing to them a value which depends on the current internal state of the animal (e.g., satiation for some but not all foods). The model also proposes an initial hypothesis of the integrated system of key brain components supporting this process and allowing the recalled outcomes to bias action selection: (a) the sub-system formed by the basolateral amygdala and insular cortex acquiring the manipulanda-outcomes associations and attributing the current value to the outcomes; (b) three basal ganglia-cortical loops selecting respectively goals, associative sensory representations, and actions; (c) the cortico-cortical and striato-nigro-striatal neural pathways supporting the selection, and selection learning, of actions based on habits and goals. The model reproduces and explains the results of several devaluation experiments carried out with control rats and rats with pre- and post-training lesions of the basolateral amygdala, the nucleus accumbens core, the prelimbic cortex, and the dorso-medial striatum. The results support the soundness of the hypotheses of the model and show its capacity to integrate, at the system-level, the operations of the key brain structures underlying devaluation. Based on its hypotheses and predictions, the model also represents an operational framework to support the design and analysis of new experiments on the motivational aspects of goal-directed behavior. PMID:27803652

Habit learning and the genetics of the dopamine D3 receptor: evidence from patients with schizophrenia and healthy controls.

PubMed

Kéri, Szabolcs; Juhász, Anna; Rimanóczy, Agnes; Szekeres, György; Kelemen, Oguz; Cimmer, Csongor; Szendi, István; Benedek, György; Janka, Zoltán

2005-06-01

In this study, the authors investigated the relationship between the Ser9Gly (SG) polymorphism of the dopamine D3 receptor (DRD3) and striatal habit learning in healthy controls and patients with schizophrenia. Participants were given the weather prediction task, during which probabilistic cue-response associations were learned for tarot cards and weather outcomes (rain or sunshine). In both healthy controls and patients with schizophrenia, participants with Ser9Ser (SS) genotype did not learn during the early phase of the task (1-50 trials), whereas participants with SG genotype did so. During the late phase of the task (51-100 trials), both participants with SS and SG genotype exhibited significant learning. Learning rate was normal in patients with schizophrenia. These results suggest that the DRD3 variant containing glycine is associated with more efficient striatal habit learning in healthy controls and patients with schizophrenia. (c) 2005 APA, all rights reserved.

Habitual action video game playing is associated with caudate nucleus-dependent navigational strategies.

PubMed

West, Greg L; Drisdelle, Brandi Lee; Konishi, Kyoko; Jackson, Jonathan; Jolicoeur, Pierre; Bohbot, Veronique D

2015-06-07

The habitual playing of video games is associated with increased grey matter and activity in the striatum. Studies in humans and rodents have shown an inverse relationship between grey matter in the striatum and hippocampus. We investigated whether action video game playing is also associated with increased use of response learning strategies during navigation, known to be dependent on the caudate nucleus of the striatum, when presented in a dual solution task. We tested 26 action video game players (actionVGPs) and 33 non-action video game players (nonVGPs) on the 4-on-8 virtual maze and a visual attention event-related potential (ERP) task, which elicits a robust N-2-posterior-controlateral (N2pc) component. We found that actionVGPs had a significantly higher likelihood of using a response learning strategy (80.76%) compared to nonVGPs (42.42%). Consistent with previous evidence, actionVGPs and nonVGPs differed in the way they deployed visual attention to central and peripheral targets as observed in the elicited N2pc component during an ERP visual attention task. Increased use of the response strategy in actionVGPs is consistent with previously observed increases in striatal volume in video game players (VGPs). Using response strategies is associated with decreased grey matter in the hippocampus. Previous studies have shown that decreased volume in the hippocampus precedes the onset of many neurological and psychiatric disorders. If actionVGPs have lower grey matter in the hippocampus, as response learners normally do, then these individuals could be at increased risk of developing neurological and psychiatric disorders during their lifetime. © 2015 The Author(s) Published by the Royal Society. All rights reserved.

Habitual action video game playing is associated with caudate nucleus-dependent navigational strategies

PubMed Central

West, Greg L.; Drisdelle, Brandi Lee; Konishi, Kyoko; Jackson, Jonathan; Jolicoeur, Pierre; Bohbot, Veronique D.

2015-01-01

The habitual playing of video games is associated with increased grey matter and activity in the striatum. Studies in humans and rodents have shown an inverse relationship between grey matter in the striatum and hippocampus. We investigated whether action video game playing is also associated with increased use of response learning strategies during navigation, known to be dependent on the caudate nucleus of the striatum, when presented in a dual solution task. We tested 26 action video game players (actionVGPs) and 33 non-action video game players (nonVGPs) on the 4-on-8 virtual maze and a visual attention event-related potential (ERP) task, which elicits a robust N-2-posterior-controlateral (N2pc) component. We found that actionVGPs had a significantly higher likelihood of using a response learning strategy (80.76%) compared to nonVGPs (42.42%). Consistent with previous evidence, actionVGPs and nonVGPs differed in the way they deployed visual attention to central and peripheral targets as observed in the elicited N2pc component during an ERP visual attention task. Increased use of the response strategy in actionVGPs is consistent with previously observed increases in striatal volume in video game players (VGPs). Using response strategies is associated with decreased grey matter in the hippocampus. Previous studies have shown that decreased volume in the hippocampus precedes the onset of many neurological and psychiatric disorders. If actionVGPs have lower grey matter in the hippocampus, as response learners normally do, then these individuals could be at increased risk of developing neurological and psychiatric disorders during their lifetime. PMID:25994669

The pan-Kv7 (KCNQ) Channel Opener Retigabine Inhibits Striatal Excitability by Direct Action on Striatal Neurons In Vivo.

PubMed

Hansen, Henrik H; Weikop, Pia; Mikkelsen, Maria D; Rode, Frederik; Mikkelsen, Jens D

2017-01-01

Central Kv7 (KCNQ) channels are voltage-dependent potassium channels composed of different combinations of four Kv7 subunits, being differently expressed in the brain. Notably, striatal dopaminergic neurotransmission is strongly suppressed by systemic administration of the pan-Kv7 channel opener retigabine. The effect of retigabine likely involves the inhibition of the activity in mesencephalic dopaminergic neurons projecting to the striatum, but whether Kv7 channels expressed in the striatum may also play a role is not resolved. We therefore assessed the effect of intrastriatal retigabine administration on striatal neuronal excitability in the rat determined by c-Fos immunoreactivity, a marker of neuronal activation. When retigabine was applied locally in the striatum, this resulted in a marked reduction in the number of c-Fos-positive neurons after a strong excitatory striatal stimulus induced by acute systemic haloperidol administration in the rat. The relative mRNA levels of Kv7 subunits in the rat striatum were found to be Kv7.2 = Kv7.3 = Kv7.5 > >Kv7.4. These data suggest that intrastriatal Kv7 channels play a direct role in regulating striatal excitability in vivo. © 2016 Nordic Association for the Publication of BCPT (former Nordic Pharmacological Society).

Sex differences, learning flexibility, and striatal dopamine D1 and D2 following adolescent drug exposure in rats

PubMed Central

Izquierdo, Alicia; Pozos, Hilda; De La Torre, Adrianna; DeShields, Simone; Cevallos, James; Rodriguez, Jonathan; Stolyarova, Alexandra

2016-01-01

Corticostriatal circuitry supports flexible reward learning and emotional behavior from the critical neurodevelopmental stage of adolescence through adulthood. It is still poorly understood how prescription drug exposure in adolescence may impact these outcomes in the long-term. We studied adolescent methylphenidate (MPH) and fluoxetine (FLX) exposure in rats and their impact on learning and emotion in adulthood. In Experiment 1, male and female rats were administered MPH, FLX, or saline (SAL), and compared with methamphetamine (mAMPH) treatment beginning in postnatal day (PND) 37. The rats were then tested on discrimination and reversal learning in adulthood. In Experiment 2, animals were administered MPH or SAL also beginning in PND 37 and later tested in adulthood for anxiety levels. In Experiment 3, we analyzed striatal dopamine D1 and D2 receptor expression in adulthood following either extensive learning (after Experiment 1) or more brief emotional measures (after Experiment 2). We found sex differences in discrimination learning and attenuated reversal learning after MPH and only sex differences in adulthood anxiety. In learners, there was enhanced striatal D1, but not D2, after either adolescent MPH or mAMPH. Lastly, also in learners, there was a sex x treatment group interaction for D2, but not D1, driven by the MPH-pretreated females, who expressed significantly higher D2 levels compared to SAL. These results show enduring effects of adolescent MPH on reversal learning in rats. Developmental psychostimulant exposure may interact with learning to enhance D1 expression in adulthood, and affect D2 expression in a sex-dependent manner. PMID:27091300

Sex differences, learning flexibility, and striatal dopamine D1 and D2 following adolescent drug exposure in rats.

PubMed

Izquierdo, Alicia; Pozos, Hilda; Torre, Adrianna De La; DeShields, Simone; Cevallos, James; Rodriguez, Jonathan; Stolyarova, Alexandra

2016-07-15

Corticostriatal circuitry supports flexible reward learning and emotional behavior from the critical neurodevelopmental stage of adolescence through adulthood. It is still poorly understood how prescription drug exposure in adolescence may impact these outcomes in the long-term. We studied adolescent methylphenidate (MPH) and fluoxetine (FLX) exposure in rats and their impact on learning and emotion in adulthood. In Experiment 1, male and female rats were administered MPH, FLX, or saline (SAL), and compared with methamphetamine (mAMPH) treatment beginning in postnatal day (PND) 37. The rats were then tested on discrimination and reversal learning in adulthood. In Experiment 2, animals were administered MPH or SAL also beginning in PND 37 and later tested in adulthood for anxiety levels. In Experiment 3, we analyzed striatal dopamine D1 and D2 receptor expression in adulthood following either extensive learning (after Experiment 1) or more brief emotional measures (after Experiment 2). We found sex differences in discrimination learning and attenuated reversal learning after MPH and only sex differences in adulthood anxiety. In learners, there was enhanced striatal D1, but not D2, after either adolescent MPH or mAMPH. Lastly, also in learners, there was a sex x treatment group interaction for D2, but not D1, driven by the MPH-pretreated females, who expressed significantly higher D2 levels compared to SAL. These results show enduring effects of adolescent MPH on reversal learning in rats. Developmental psychostimulant exposure may interact with learning to enhance D1 expression in adulthood, and affect D2 expression in a sex-dependent manner. Copyright © 2016 Elsevier B.V. All rights reserved.

Cholinergic Interneurons Use Orbitofrontal Input to Track Beliefs about Current State.

PubMed

Stalnaker, Thomas A; Berg, Ben; Aujla, Navkiran; Schoenbaum, Geoffrey

2016-06-08

When conditions change, organisms need to learn about the changed conditions without interfering with what they already know. To do so, they can assign the new learning to a new "state" and the old learning to a previous state. This state assignment is fundamental to behavioral flexibility. Cholinergic interneurons (CINs) in the dorsomedial striatum (DMS) are necessary for associative information to be compartmentalized in this way, but the mechanism by which they do so is unknown. Here we addressed this question by recording putative CINs from the DMS in rats performing a task consisting of a series of trial blocks, or states, that required the recall and application of contradictory associative information. We found that individual CINs in the DMS represented the current state throughout each trial. These state correlates were not observed in dorsolateral striatal CINs recorded in the same rats. Notably, DMS CIN ensembles tracked rats' beliefs about the current state such that, when states were miscoded, rats tended to make suboptimal choices reflecting the miscoding. State information held by the DMS CINs also depended completely on the orbitofrontal cortex, an area that has been proposed to signal environmental states. These results suggest that CINs set the stage for recalling associative information relevant to the current environment by maintaining a real-time representation of the current state. Such a role has novel implications for understanding the neural basis of a variety of psychiatric diseases, such as addiction or anxiety disorders, in which patients generalize inappropriately (or fail to generalize) between different environments. Striatal cholinergic interneurons (CINs) are thought to be identical to tonically active neurons. These neurons have long been thought to have an important influence on striatal processing during reward-related learning. Recently, a more specific function for striatal CINs has been suggested, which is that they are necessary for striatal learning to be compartmentalized into different states as the state of the environment changes. Here we report that putative CINs appear to track rats' beliefs about which environmental state is current. We further show that this property of CINs depends on orbitofrontal cortex input and is correlated with choices made by rats. These findings could provide new insight into neuropsychiatric diseases that involve improper generalization between different contexts. Copyright © 2016 the authors 0270-6474/16/366242-16$15.00/0.

Striatal dopaminergic modulation of reinforcement learning predicts reward-oriented behavior in daily life.

PubMed

Kasanova, Zuzana; Ceccarini, Jenny; Frank, Michael J; Amelsvoort, Thérèse van; Booij, Jan; Heinzel, Alexander; Mottaghy, Felix; Myin-Germeys, Inez

2017-07-01

Much human behavior is driven by rewards. Preclinical neurophysiological and clinical positron emission tomography (PET) studies have implicated striatal phasic dopamine (DA) release as a primary modulator of reward processing. However, the relationship between experimental reward-induced striatal DA release and responsiveness to naturalistic rewards, and therefore functional relevance of these findings, has been elusive. We therefore combined, for the first time, a DA D 2/3 receptor [ 18 F]fallypride PET during a probabilistic reinforcement learning (RL) task with a six day ecological momentary assessments (EMA) of reward-related behavior in the everyday life of 16 healthy volunteers. We detected significant reward-induced DA release in the bilateral putamen, caudate nucleus and ventral striatum, the extent of which was associated with better behavioral performance on the RL task across all regions. Furthermore, individual variability in the extent of reward-induced DA release in the right caudate nucleus and ventral striatum modulated the tendency to be actively engaged in a behavior if the active engagement was previously deemed enjoyable. This study suggests a link between striatal reward-related DA release and ecologically relevant reward-oriented behavior, suggesting an avenue for the inquiry into the DAergic basis of optimal and impaired motivational drive. Copyright © 2017 Elsevier B.V. All rights reserved.

Quinolinic acid induces disrupts cytoskeletal homeostasis in striatal neurons. Protective role of astrocyte-neuron interaction.

PubMed

Pierozan, Paula; Ferreira, Fernanda; de Lima, Bárbara Ortiz; Pessoa-Pureur, Regina

2015-02-01

Quinolinic acid (QUIN) is an endogenous metabolite of the kynurenine pathway involved in several neurological disorders. Among the several mechanisms involved in QUIN-mediated toxicity, disruption of the cytoskeleton has been demonstrated in striatally injected rats and in striatal slices. The present work searched for the actions of QUIN in primary striatal neurons. Neurons exposed to 10 µM QUIN presented hyperphosphorylated neurofilament (NF) subunits (NFL, NFM, and NFH). Hyperphosphorylation was abrogated in the presence of protein kinase A and protein kinase C inhibitors H89 (20 μM) and staurosporine (10 nM), respectively, as well as by specific antagonists to N-methyl-D-aspartate (50 µM DL-AP5) and metabotropic glutamate receptor 1 (100 µM MPEP). Also, intra- and extracellular Ca(2+) chelators (10 µM BAPTA-AM and 1 mM EGTA, respectively) and Ca(2+) influx through L-type voltage-dependent Ca(2+) channel (10 µM verapamil) are implicated in QUIN-mediated effects. Cells immunostained for the neuronal markers βIII-tubulin and microtubule-associated protein 2 showed altered neurite/neuron ratios and neurite outgrowth. NF hyperphosphorylation and morphological alterations were totally prevented by conditioned medium from QUIN-treated astrocytes. Cocultured astrocytes and neurons interacted with one another reciprocally, protecting them against QUIN injury. Cocultured cells preserved their cytoskeletal organization and cell morphology together with unaltered activity of the phosphorylating system associated with the cytoskeleton. This article describes cytoskeletal disruption as one of the most relevant actions of QUIN toxicity in striatal neurons in culture with soluble factors secreted by astrocytes, with neuron-astrocyte interaction playing a role in neuroprotection. © 2014 Wiley Periodicals, Inc.

Striatal output markers do not alter in response to circling behaviour in 6-OHDA lesioned rats produced by acute or chronic administration of the monoamine uptake inhibitor BTS 74 398.

PubMed

Lane, E L; Cheetham, S; Jenner, P

2008-01-01

The monoamine uptake inhibitor BTS 74 398 induces ipsilateral circling in 6-hydroxydopamine (6-OHDA) lesioned rats without induction of abnormal motor behaviours associated with L-dopa administration. We examined whether this was reflected in the expression of peptide mRNA in the direct and indirect striatal output pathways.6-OHDA lesioning of the nigrostriatal pathway increased striatal expression of PPE-A mRNA and decreased levels of PPT mRNA with PPE-B mRNA expression remaining unchanged. Acute L-dopa administration normalised PPE-A mRNA and elevated PPT mRNA while PPE-B mRNA expression remained unchanged. Acute administration of BTS 74 398 did not alter striatal peptide mRNA levels. Following chronic treatment with L-dopa, PPE-A mRNA expression in the lesioned striatum continued to be normalised and PPT mRNA was increased compared to the intact side. PPE-B mRNA expression was also markedly increased relative to the non-lesioned striatum. Chronic BTS 74 398 administration did not alter mRNA expression in the 6-OHDA lesioned striatum although small increases in PPT mRNA expression in the intact and sham lesioned striatum were observed. The failure of BTS 74 398 to induce changes in striatal neuropeptide mRNA correlated with its failure to induce abnormal motor behaviours or behavioural sensitisation but does not explain how it produces a reversal of motor deficits. An action in another area of the brain appears likely and may explain the subsequent failure of BTS 74 398 and related compounds to exert anti-parkinsonian actions in man.

Linguistic Grammar Learning and DRD2-TAQ-IA Polymorphism

PubMed Central

Wong, Patrick C. M.; Ettlinger, Marc; Zheng, Jing

2013-01-01

As research into the neurobiology of language has focused primarily on the systems level, fewer studies have examined the link between molecular genetics and normal variations in language functions. Because the ability to learn a language varies in adults and our genetic codes also vary, research linking the two provides a unique window into the molecular neurobiology of language. We consider a candidate association between the dopamine receptor D2 gene (DRD2) and linguistic grammar learning. DRD2-TAQ-IA polymorphism (rs1800497) is associated with dopamine receptor D2 distribution and dopamine impact in the human striatum, such that A1 allele carriers show reduction in D2 receptor binding relative to carriers who are homozygous for the A2 allele. The individual differences in grammatical rule learning that are particularly prevalent in adulthood are also associated with striatal function and its role in domain-general procedural memory. Therefore, we reasoned that procedurally-based grammar learning could be associated with DRD2-TAQ-IA polymorphism. Here, English-speaking adults learned artificial concatenative and analogical grammars, which have been respectively associated with procedural and declarative memory. Language learning capabilities were tested while learners’ neural hemodynamic responses were simultaneously measured by fMRI. Behavioral learning and brain activation data were subsequently compared with the learners’ DRD2 (rs1800497) genotype. Learners who were homozygous for the A2 allele were better at concatenative (but not analogical) grammar learning and had higher striatal responses relative to those who have at least one A1 allele. These results provide preliminary evidence for the neurogenetic basis of normal variations in linguistic grammar learning and its link to domain-general functions. PMID:23741438

Reduced Implicit and Explicit Sequence Learning in First-Episode Schizophrenia

ERIC Educational Resources Information Center

Pedersen, Anya; Siegmund, Ansgar; Ohrmann, Patricia; Rist, Fred; Rothermundt, Matthias; Suslow, Thomas; Arolt, Volker

2008-01-01

A high prevalence of deficits in explicit learning has been reported for schizophrenic patients, but it is less clear whether these patients are impaired in implicit learning. Deficits in implicit learning indicative of a fronto-striatal dysfunction have been reported using a serial reaction-time task (SRT), but the impact of typical neuroleptic…

Feeling safe in the plane: neural mechanisms underlying superior action control in airplane pilot trainees--a combined EEG/MRS study.

PubMed

Yildiz, Ali; Quetscher, Clara; Dharmadhikari, Shalmali; Chmielewski, Witold; Glaubitz, Benjamin; Schmidt-Wilcke, Tobias; Edden, Richard; Dydak, Ulrike; Beste, Christian

2014-10-01

In day-to-day life, we need to apply strategies to cascade different actions for efficient unfolding of behavior. While deficits in action cascading are examined extensively, almost nothing is known about the neuronal mechanisms mediating superior performance above the normal level. To examine this question, we investigate action control in airplane pilot trainees. We use a stop-change paradigm that is able to estimate the efficiency of action cascading on the basis of mathematical constraints. Behavioral and EEG data is analyzed along these constraints and integrated with neurochemical data obtained using Magnetic Resonance Spectroscopy (MRS) from the striatal gamma-aminobutyric acid (GABA) -ergic system. We show that high performance in action cascading, as exemplified in airplane pilot trainees, can be driven by intensified attentional processes, circumventing response selection processes. The results indicate that the efficiency of action cascading and hence the speed of responding as well as attentional gating functions are modulated by striatal GABA and Glutamate + Glutamine concentrations. In superior performance in action cascading similar increases in the concentrations of GABA and Glutamate + Glutamine lead to stronger neurophysiological and behavioral effects as compared to subjects with normal performance in action cascading. Copyright © 2014 Wiley Periodicals, Inc.

Altered striatal intrinsic functional connectivity in pediatric anxiety

PubMed Central

Dorfman, Julia; Benson, Brenda; Farber, Madeline; Pine, Daniel; Ernst, Monique

2016-01-01

Anxiety disorders are among the most common psychiatric disorders of adolescence. Behavioral and task-based imaging studies implicate altered reward system function, including striatal dysfunction, in adolescent anxiety. However, no study has yet examined alterations of the striatal intrinsic functional connectivity in adolescent anxiety disorders. The current study examines striatal intrinsic functional connectivity (iFC), using six bilateral striatal seeds, among 35 adolescents with anxiety disorders and 36 healthy comparisons. Anxiety is associated with abnormally low iFC within the striatum (e.g., between nucleus accumbens and caudate nucleus), and between the striatum and prefrontal regions, including subgenual anterior cingulate cortex, posterior insula and supplementary motor area. The current findings extend prior behavioral and task-based imaging research, and provide novel data implicating decreased striatal iFC in adolescent anxiety. Alterations of striatal neurocircuitry identified in this study may contribute to the perturbations in the processing of motivational, emotional, interoceptive, and motor information seen in pediatric anxiety disorders. This pattern of the striatal iFC perturbations can guide future research on specific mechanisms underlying anxiety. PMID:27004799

Regional specialization within the human striatum for diverse psychological functions.

PubMed

Pauli, Wolfgang M; O'Reilly, Randall C; Yarkoni, Tal; Wager, Tor D

2016-02-16

Decades of animal and human neuroimaging research have identified distinct, but overlapping, striatal zones, which are interconnected with separable corticostriatal circuits, and are crucial for the organization of functional systems. Despite continuous efforts to subdivide the human striatum based on anatomical and resting-state functional connectivity, characterizing the different psychological processes related to each zone remains a work in progress. Using an unbiased, data-driven approach, we analyzed large-scale coactivation data from 5,809 human imaging studies. We (i) identified five distinct striatal zones that exhibited discrete patterns of coactivation with cortical brain regions across distinct psychological processes and (ii) identified the different psychological processes associated with each zone. We found that the reported pattern of cortical activation reliably predicted which striatal zone was most strongly activated. Critically, activation in each functional zone could be associated with distinct psychological processes directly, rather than inferred indirectly from psychological functions attributed to associated cortices. Consistent with well-established findings, we found an association of the ventral striatum (VS) with reward processing. Confirming less well-established findings, the VS and adjacent anterior caudate were associated with evaluating the value of rewards and actions, respectively. Furthermore, our results confirmed a sometimes overlooked specialization of the posterior caudate nucleus for executive functions, often considered the exclusive domain of frontoparietal cortical circuits. Our findings provide a precise functional map of regional specialization within the human striatum, both in terms of the differential cortical regions and psychological functions associated with each striatal zone.

Regional specialization within the human striatum for diverse psychological functions

PubMed Central

Pauli, Wolfgang M.; O’Reilly, Randall C.; Wager, Tor D.

2016-01-01

Decades of animal and human neuroimaging research have identified distinct, but overlapping, striatal zones, which are interconnected with separable corticostriatal circuits, and are crucial for the organization of functional systems. Despite continuous efforts to subdivide the human striatum based on anatomical and resting-state functional connectivity, characterizing the different psychological processes related to each zone remains a work in progress. Using an unbiased, data-driven approach, we analyzed large-scale coactivation data from 5,809 human imaging studies. We (i) identified five distinct striatal zones that exhibited discrete patterns of coactivation with cortical brain regions across distinct psychological processes and (ii) identified the different psychological processes associated with each zone. We found that the reported pattern of cortical activation reliably predicted which striatal zone was most strongly activated. Critically, activation in each functional zone could be associated with distinct psychological processes directly, rather than inferred indirectly from psychological functions attributed to associated cortices. Consistent with well-established findings, we found an association of the ventral striatum (VS) with reward processing. Confirming less well-established findings, the VS and adjacent anterior caudate were associated with evaluating the value of rewards and actions, respectively. Furthermore, our results confirmed a sometimes overlooked specialization of the posterior caudate nucleus for executive functions, often considered the exclusive domain of frontoparietal cortical circuits. Our findings provide a precise functional map of regional specialization within the human striatum, both in terms of the differential cortical regions and psychological functions associated with each striatal zone. PMID:26831091

Partial dopaminergic denervation-induced impairment in stimulus discrimination acquisition in parkinsonian rats: a model for early Parkinson's disease.

PubMed

Eagle, Andrew L; Olumolade, Oluyemi O; Otani, Hajime

2015-03-01

Parkinson's disease (PD) produces progressive nigrostriatal dopamine (DA) denervation resulting in cognitive and motor impairment. However, it is unknown whether cognitive impairments, such as instrumental learning deficits, are associated with the early stage PD-induced mild DA denervation. The current study sought to model early PD-induced instrumental learning impairments by assessing the effects of low dose (5.5μg), bilateral 6OHDA-induced striatal DA denervation on acquisition of instrumental stimulus discrimination in rats. 6OHDA (n=20) or sham (n=10) lesioned rats were tested for stimulus discrimination acquisition either 1 or 2 weeks post surgical lesion. Stimulus discrimination acquisition across 10 daily sessions was used to assess discriminative accuracy, or a probability measure of the shift toward reinforced responding under one stimulus condition (Sd) away from extinction, when reinforcement was withheld, under another (S(d) phase). Striatal DA denervation was assayed by tyrosine hydroxylase (TH) staining intensity. Results indicated that 6OHDA lesions produced significant loss of dorsal striatal TH staining intensity and marked impairment in discrimination acquisition, without inducing akinetic motor deficits. Rather 6OHDA-induced impairment was associated with perseveration during extinction (S(Δ) phase). These findings suggest that partial, bilateral striatal DA denervation produces instrumental learning deficits, prior to the onset of gross motor impairment, and suggest that the current model is useful for investigating mild nigrostriatal DA denervation associated with early stage clinical PD. Copyright © 2014 Elsevier Ireland Ltd and the Japan Neuroscience Society. All rights reserved.

The roles of dopamine and serotonin in decision making: evidence from pharmacological experiments in humans.

PubMed

Rogers, Robert D

2011-01-01

Neurophysiological experiments in primates, alongside neuropsychological and functional magnetic resonance investigations in humans, have significantly enhanced our understanding of the neural architecture of decision making. In this review, I consider the more limited database of experiments that have investigated how dopamine and serotonin activity influences the choices of human adults. These include those experiments that have involved the administration of drugs to healthy controls, experiments that have tested genotypic influences upon dopamine and serotonin function, and, finally, some of those experiments that have examined the effects of drugs on the decision making of clinical samples. Pharmacological experiments in humans are few in number and face considerable methodological challenges in terms of drug specificity, uncertainties about pre- vs post-synaptic modes of action, and interactions with baseline cognitive performance. However, the available data are broadly consistent with current computational models of dopamine function in decision making and highlight the dissociable roles of dopamine receptor systems in the learning about outcomes that underpins value-based decision making. Moreover, genotypic influences on (interacting) prefrontal and striatal dopamine activity are associated with changes in choice behavior that might be relevant to understanding exploratory behaviors and vulnerability to addictive disorders. Manipulations of serotonin in laboratory tests of decision making in human participants have provided less consistent results, but the information gathered to date indicates a role for serotonin in learning about bad decision outcomes, non-normative aspects of risk-seeking behavior, and social choices involving affiliation and notions of fairness. Finally, I suggest that the role played by serotonin in the regulation of cognitive biases, and representation of context in learning, point toward a role in the cortically mediated cognitive appraisal of reinforcers when selecting between actions, potentially accounting for its influence upon the processing salient aversive outcomes and social choice.

Real-time parallel processing of grammatical structure in the fronto-striatal system: a recurrent network simulation study using reservoir computing.

PubMed

Hinaut, Xavier; Dominey, Peter Ford

2013-01-01

Sentence processing takes place in real-time. Previous words in the sentence can influence the processing of the current word in the timescale of hundreds of milliseconds. Recent neurophysiological studies in humans suggest that the fronto-striatal system (frontal cortex, and striatum--the major input locus of the basal ganglia) plays a crucial role in this process. The current research provides a possible explanation of how certain aspects of this real-time processing can occur, based on the dynamics of recurrent cortical networks, and plasticity in the cortico-striatal system. We simulate prefrontal area BA47 as a recurrent network that receives on-line input about word categories during sentence processing, with plastic connections between cortex and striatum. We exploit the homology between the cortico-striatal system and reservoir computing, where recurrent frontal cortical networks are the reservoir, and plastic cortico-striatal synapses are the readout. The system is trained on sentence-meaning pairs, where meaning is coded as activation in the striatum corresponding to the roles that different nouns and verbs play in the sentences. The model learns an extended set of grammatical constructions, and demonstrates the ability to generalize to novel constructions. It demonstrates how early in the sentence, a parallel set of predictions are made concerning the meaning, which are then confirmed or updated as the processing of the input sentence proceeds. It demonstrates how on-line responses to words are influenced by previous words in the sentence, and by previous sentences in the discourse, providing new insight into the neurophysiology of the P600 ERP scalp response to grammatical complexity. This demonstrates that a recurrent neural network can decode grammatical structure from sentences in real-time in order to generate a predictive representation of the meaning of the sentences. This can provide insight into the underlying mechanisms of human cortico-striatal function in sentence processing.

Real-Time Parallel Processing of Grammatical Structure in the Fronto-Striatal System: A Recurrent Network Simulation Study Using Reservoir Computing

PubMed Central

Hinaut, Xavier; Dominey, Peter Ford

2013-01-01

Sentence processing takes place in real-time. Previous words in the sentence can influence the processing of the current word in the timescale of hundreds of milliseconds. Recent neurophysiological studies in humans suggest that the fronto-striatal system (frontal cortex, and striatum – the major input locus of the basal ganglia) plays a crucial role in this process. The current research provides a possible explanation of how certain aspects of this real-time processing can occur, based on the dynamics of recurrent cortical networks, and plasticity in the cortico-striatal system. We simulate prefrontal area BA47 as a recurrent network that receives on-line input about word categories during sentence processing, with plastic connections between cortex and striatum. We exploit the homology between the cortico-striatal system and reservoir computing, where recurrent frontal cortical networks are the reservoir, and plastic cortico-striatal synapses are the readout. The system is trained on sentence-meaning pairs, where meaning is coded as activation in the striatum corresponding to the roles that different nouns and verbs play in the sentences. The model learns an extended set of grammatical constructions, and demonstrates the ability to generalize to novel constructions. It demonstrates how early in the sentence, a parallel set of predictions are made concerning the meaning, which are then confirmed or updated as the processing of the input sentence proceeds. It demonstrates how on-line responses to words are influenced by previous words in the sentence, and by previous sentences in the discourse, providing new insight into the neurophysiology of the P600 ERP scalp response to grammatical complexity. This demonstrates that a recurrent neural network can decode grammatical structure from sentences in real-time in order to generate a predictive representation of the meaning of the sentences. This can provide insight into the underlying mechanisms of human cortico-striatal function in sentence processing. PMID:23383296

Cortico-striatal synaptic defects and OCD-like behaviors in SAPAP3 mutant mice

PubMed Central

Welch, Jeffrey M.; Lu, Jing; Rodriguiz, Ramona M.; Trotta, Nicholas C.; Peca, Joao; Ding, Jin-Dong; Feliciano, Catia; Chen, Meng; Adams, J. Paige; Luo, Jianhong; Dudek, Serena M.; Weinberg, Richard J.; Calakos, Nicole; Wetsel, William C.; Feng, Guoping

2008-01-01

Obsessive-compulsive disorder (OCD) is an anxiety-spectrum disorder characterized by persistent intrusive thoughts (obsessions) and repetitive actions (compulsions). Dysfunction of cortico-striato-thalamo-cortical circuitry is implicated in OCD, though the underlying pathogenic mechanisms are unknown. SAP90/PSD95-associated protein 3 (SAPAP3) is a postsynaptic scaffolding protein at excitatory synapses that is highly expressed in the striatum. Here we show that mice with genetic deletion of SAPAP3 exhibit increased anxiety and compulsive grooming behavior leading to facial hair loss and skin lesions; both behaviors are alleviated by a selective serotonin reuptake inhibitor. Electrophysiological, structural, and biochemical studies of SAPAP3 mutant mice reveal defects in cortico-striatal synapses. Furthermore, lentiviral-mediated selective expression of SAPAP3 in the striatum rescues the synaptic and behavioral defects of SAPAP3 mutant mice. These findings demonstrate a critical role for SAPAP3 at cortico-striatal synapses and emphasize the importance of cortico-striatal circuitry in OCD-like behaviors. PMID:17713528

Implicit learning in a serial choice visual discrimination task in the operant 9-hole box by intact and striatal lesioned mice.

PubMed

Trueman, Rebecca C; Brooks, Simon P; Dunnett, Stephen B

2005-04-30

Within a broader programme developing murine models of Huntington's disease (HD), we have sought to develop a test of implicit learning for the mouse. Mice were trained in a novel serial visual discrimination task in the '9-hole box' operant test apparatus, followed by retesting after either bilateral quinolinic acid striatal lesions or sham lesions. In the task, each trial involves two sequential responses: an initial light stimulus is presented randomly in one of five holes, to which a nose-poke response results in the first light being extinguished and a second light is illuminated in a different hole. Response to the second light results in food reward, followed by a brief interval before the next trial. When the first light was in one of three of the five holes, the location of the second light was unpredictable in any of the remaining four holes; by contrast, if the first light occurred in one of the other two of the five holes, then the location of the second light was entirely predictable, being the hole two steps to the left or to the right, respectively. Reaction times and accuracy of responding were recorded to both stimuli. The mice learned the task with a degree of accuracy, and they demonstrated clear implicit learning, as measured by increased accuracy and reduced latency to respond to the presentation of the predictable stimulus. Striatal lesions disrupted performance, reducing accuracy for both the first and second stimuli and increasing response latencies for the second stimuli. The decrease in accuracy by the lesioned animals was accompanied by increases in perseverative nose-poking and inappropriate magazine entries throughout the trials, but the lesioned mice still showed a similar benefit (albeit, against a lower baseline of performance) from the implicit knowledge provided on predictable trials. The data validates the task as a sensitive probe for determining implicit learning deficits in the mouse, and suggests that the consequences of striatal lesions, while disrupting performance of skilled stimulus-response habits, are not selective to the process underlying implicit learning.

Selective neural pathway targeting reveals key roles of thalamostriatal projection in the control of visual discrimination.

PubMed

Kato, Shigeki; Kuramochi, Masahito; Kobayashi, Kenta; Fukabori, Ryoji; Okada, Kana; Uchigashima, Motokazu; Watanabe, Masahiko; Tsutsui, Yuji; Kobayashi, Kazuto

2011-11-23

The dorsal striatum receives converging excitatory inputs from diverse brain regions, including the cerebral cortex and the intralaminar/midline thalamic nuclei, and mediates learning processes contributing to instrumental motor actions. However, the roles of each striatal input pathway in these learning processes remain uncertain. We developed a novel strategy to target specific neural pathways and applied this strategy for studying behavioral roles of the pathway originating from the parafascicular nucleus (PF) and projecting to the dorsolateral striatum. A highly efficient retrograde gene transfer vector encoding the recombinant immunotoxin (IT) receptor was injected into the dorsolateral striatum in mice to express the receptor in neurons innervating the striatum. IT treatment into the PF of the vector-injected animals caused a selective elimination of neurons of the PF-derived thalamostriatal pathway. The elimination of this pathway impaired the response selection accuracy and delayed the motor response in the acquisition of a visual cue-dependent discrimination task. When the pathway elimination was induced after learning acquisition, it disturbed the response accuracy in the task performance with no apparent change in the response time. The elimination did not influence spontaneous locomotion, methamphetamine-induced hyperactivity, and motor skill learning that demand the function of the dorsal striatum. These results demonstrate that thalamostriatal projection derived from the PF plays essential roles in the acquisition and execution of discrimination learning in response to sensory stimulus. The temporal difference in the pathway requirement for visual discrimination suggests a stage-specific role of thalamostriatal pathway in the modulation of response time of learned motor actions.

Aberrant function of learning and cognitive control networks underlie inefficient cognitive flexibility in anorexia nervosa: a cross-sectional fMRI study.

PubMed

Lao-Kaim, Nick P; Fonville, Leon; Giampietro, Vincent P; Williams, Steven C R; Simmons, Andrew; Tchanturia, Kate

2015-01-01

People with Anorexia Nervosa exhibit difficulties flexibly adjusting behaviour in response to environmental changes. This has previously been attributed to problematic behavioural shifting, characterised by a decrease in fronto-striatal activity. Additionally, alterations of instrumental learning, which relies on fronto-striatal networks, may contribute to the observation of inflexible behaviour. The authors sought to investigate the neural correlates of cognitive flexibility and learning in Anorexia Nervosa. Thirty-two adult females with Anorexia Nervosa and thirty-two age-matched female control participants completed the Wisconsin Card Sorting Task whilst undergoing functional magnetic resonance imaging. Event-related analysis permitted the comparison of cognitive shift trials against those requiring maintenance of rule-sets and allowed assessment of trials representing learning. Although both groups performed similarly, we found significant interactions in the left middle frontal gyrus, precuneus and superior parietal lobule whereby blood-oxygenated-level dependent response was higher in Anorexia Nervosa patients during shifting but lower when maintaining rule-sets, as compared to healthy controls. During learning, posterior cingulate cortex activity in healthy controls decreased whilst increasing in the Anorexia Nervosa group, whereas the right precuneus exhibited the opposite pattern. Furthermore, learning was associated with lower blood-oxygenated-level dependent response in the caudate body, as compared to healthy controls. People with Anorexia Nervosa display widespread changes in executive function. Whilst cognitive flexibility appears to be associated with aberrant functioning of the fronto-parietal control network that mediates between internally and externally directed cognition, fronto-striatal alterations, particularly within the caudate body, were associated with instrumental learning. Together, this shows how perseverative tendencies could be a substrate of multiple high-order processes that may contribute to the maintenance of Anorexia Nervosa.

A Computational Model of How Cholinergic Interneurons Protect Striatal-Dependent Learning

ERIC Educational Resources Information Center

Ashby, F. Gregory; Crossley, Matthew J.

2011-01-01

An essential component of skill acquisition is learning the environmental conditions in which that skill is relevant. This article proposes and tests a neurobiologically detailed theory of how such learning is mediated. The theory assumes that a key component of this learning is provided by the cholinergic interneurons in the striatum known as…

A Neurocomputational Model of Dopamine and Prefrontal-Striatal Interactions during Multicue Category Learning by Parkinson Patients

ERIC Educational Resources Information Center

Moustafa, Ahmed A.; Gluck, Mark A.

2011-01-01

Most existing models of dopamine and learning in Parkinson disease (PD) focus on simulating the role of basal ganglia dopamine in reinforcement learning. Much data argue, however, for a critical role for prefrontal cortex (PFC) dopamine in stimulus selection in attentional learning. Here, we present a new computational model that simulates…

Dopamine transporter-dependent and -independent actions of trace amine beta-phenylethylamine.

PubMed

Sotnikova, Tatyana D; Budygin, Evgeny A; Jones, Sara R; Dykstra, Linda A; Caron, Marc G; Gainetdinov, Raul R

2004-10-01

Beta-phenylethylamine (beta-PEA) is an endogenous amine that is found in trace amounts in the brain. It is believed that the locomotor-stimulating action of beta-PEA, much like amphetamine, depends on its ability to increase extracellular dopamine (DA) concentrations owing to reversal of the direction of dopamine transporter (DAT)-mediated DA transport. beta-PEA can also bind directly to the recently identified G protein-coupled receptors, but the physiological significance of this interaction is unclear. To assess the mechanism by which beta-PEA mediates its effects, we compared the neurochemical and behavioral effects of this amine in wild type (WT), heterozygous and 'null' DAT mutant mice. In microdialysis studies, beta-PEA, administered either systemically or locally via intrastriatal infusion, produced a pronounced outflow of striatal DA in WT mice whereas no increase was detected in mice lacking the DAT (DAT-KO mice). Similarly, in fast-scan voltammetry studies beta-PEA did not alter DA release and clearance rate in striatal slices from DAT-KO mice. In behavioral studies beta-PEA produced a robust but transient increase in locomotor activity in WT and heterozygous mice. In DAT-KO mice, whose locomotor activity and stereotypy are increased in a novel environment, beta-PEA (10-100 mg/kg) exerted a potent inhibitory action. At high doses, beta-PEA induced stereotypies in WT and heterozygous mice; some manifestations of stereotypy were also observed in the DAT-KO mice. These data demonstrate that the DAT is required for the striatal DA-releasing and hyperlocomotor actions of beta-PEA. The inhibitory action on hyperactivity and certain stereotypies induced by beta-PEA in DAT-KO mice indicate that targets other than the DAT are responsible for these effects.

Caudate Microstimulation Increases Value of Specific Choices.

PubMed

Santacruz, Samantha R; Rich, Erin L; Wallis, Joni D; Carmena, Jose M

2017-11-06

Value-based decision-making involves an assessment of the value of items available and the actions required to obtain them. The basal ganglia are highly implicated in action selection and goal-directed behavior [1-4], and the striatum in particular plays a critical role in arbitrating between competing choices [5-9]. Previous work has demonstrated that neural activity in the caudate nucleus is modulated by task-relevant action values [6, 8]. Nonetheless, how value is represented and maintained in the striatum remains unclear since decision-making in these tasks relied on spatially lateralized responses, confounding the ability to generalize to a more abstract choice task [6, 8, 9]. Here, we investigate striatal value representations by applying caudate electrical stimulation in macaque monkeys (n = 3) to bias decision-making in a task that divorces the value of a stimulus from motor action. Electrical microstimulation is known to induce neural plasticity [10, 11], and caudate microstimulation in primates has been shown to accelerate associative learning [12, 13]. Our results indicate that stimulation paired with a particular stimulus increases selection of that stimulus, and this effect was stimulus dependent and action independent. The modulation of choice behavior using microstimulation was best modeled as resulting from changes in stimulus value. Caudate neural recordings (n = 1) show that changes in value-coding neuron activity are stimulus value dependent. We argue that caudate microstimulation can differentially increase stimulus values independent of action, and unilateral manipulations of value are sufficient to mediate choice behavior. These results support potential future applications of microstimulation to correct maladaptive plasticity underlying dysfunctional decision-making related to neuropsychiatric conditions. Copyright © 2017 Elsevier Ltd. All rights reserved.

Reduction of Pavlovian Bias in Schizophrenia: Enhanced Effects in Clozapine-Administered Patients

PubMed Central

Albrecht, Matthew A.; Waltz, James A.; Cavanagh, James F.; Frank, Michael J.; Gold, James M.

2016-01-01

The negative symptoms of schizophrenia (SZ) are associated with a pattern of reinforcement learning (RL) deficits likely related to degraded representations of reward values. However, the RL tasks used to date have required active responses to both reward and punishing stimuli. Pavlovian biases have been shown to affect performance on these tasks through invigoration of action to reward and inhibition of action to punishment, and may be partially responsible for the effects found in patients. Forty-five patients with schizophrenia and 30 demographically-matched controls completed a four-stimulus reinforcement learning task that crossed action (“Go” or “NoGo”) and the valence of the optimal outcome (reward or punishment-avoidance), such that all combinations of action and outcome valence were tested. Behaviour was modelled using a six-parameter RL model and EEG was simultaneously recorded. Patients demonstrated a reduction in Pavlovian performance bias that was evident in a reduced Go bias across the full group. In a subset of patients administered clozapine, the reduction in Pavlovian bias was enhanced. The reduction in Pavlovian bias in SZ patients was accompanied by feedback processing differences at the time of the P3a component. The reduced Pavlovian bias in patients is suggested to be due to reduced fidelity in the communication between striatal regions and frontal cortex. It may also partially account for previous findings of poorer “Go-learning” in schizophrenia where “Go” responses or Pavlovian consistent responses are required for optimal performance. An attenuated P3a component dynamic in patients is consistent with a view that deficits in operant learning are due to impairments in adaptively using feedback to update representations of stimulus value. PMID:27044008

Mechanisms Underlying Motivational Deficits in Psychopathology: Similarities and Differences in Depression and Schizophrenia.

PubMed

Barch, Deanna M; Pagliaccio, David; Luking, Katherine

2016-01-01

Motivational and hedonic impairments are core aspects of a variety of types of psychopathology. These impairments cut across diagnostic categories and may be critical to understanding major aspects of the functional impairments accompanying psychopathology. Given the centrality of motivational and hedonic systems to psychopathology, the Research Domain Criteria (RDoC) initiative includes a "positive valence" systems domain that outlines a number of constructs that may be key to understanding the nature and mechanisms of motivational and hedonic impairments in psychopathology. These component constructs include initial responsiveness to reward, reward anticipation or expectancy, incentive or reinforcement learning, effort valuation, and action selection. Here, we review behavioral and neuroimaging studies providing evidence for impairments in these constructs in individuals with psychosis versus in individuals with depressive pathology. There are important differences in the nature of reward-related and hedonic deficits associated with psychosis versus depression that have major implications for our understanding of etiology and treatment development. In particular, the literature strongly suggests the presence of impairments in in-the-moment hedonics or "liking" in individuals with depressive pathology, particularly among those who experience anhedonia. Such deficits may propagate forward and contribute to impairments in other constructs that are dependent on hedonic responses, such as anticipation, learning, effort, and action selection. Such hedonic impairments could reflect alterations in dopamine and/or opioid signaling in the striatum related to depression or specifically to anhedonia in depressed populations. In contrast, the literature points to relatively intact in-the-moment hedonic processing in psychosis, but provides much evidence for impairments in other components involved in translating reward to action selection. Particularly, individuals with schizophrenia exhibit altered reward prediction and associated striatal and prefrontal activation, impaired reward learning, and impaired reward-modulated action selection.

Beyond the Classic VTA: Extended Amygdala Projections to DA-Striatal Paths in the Primate

PubMed Central

Fudge, Julie L; Kelly, Emily A; Pal, Ria; Bedont, Joseph L; Park, Lydia; Ho, Brian

2017-01-01

The central extended amygdala (CEA) has been conceptualized as a ‘macrosystem’ that regulates various stress-induced behaviors. Consistent with this, the CEA highly expresses corticotropin-releasing factor (CRF), an important modulator of stress responses. Stress alters goal-directed responses associated with striatal paths, including maladaptive responses such as drug seeking, social withdrawal, and compulsive behavior. CEA inputs to the midbrain dopamine (DA) system are positioned to influence striatal functions through mesolimbic DA-striatal pathways. However, the structure of this amygdala-CEA-DA neuron path to the striatum has been poorly characterized in primates. In primates, we combined neuronal tracer injections into various arms of the circuit through specific DA subpopulations to assess: (1) whether the circuit connecting amygdala, CEA, and DA cells follows CEA intrinsic organization, or a more direct topography involving bed nucleus vs central nucleus divisions; (2) CRF content of the CEA-DA path; and (3) striatal subregions specifically involved in CEA-DA-striatal loops. We found that the amygdala-CEA-DA path follows macrostructural subdivisions, with the majority of input/outputs converging in the medial central nucleus, the sublenticular extended amygdala, and the posterior lateral bed nucleus of the stria terminalis. The proportion of CRF+ outputs is >50%, and mainly targets the A10 parabrachial pigmented nucleus (PBP) and A8 (retrorubal field, RRF) neuronal subpopulations, with additional inputs to the dorsal A9 neurons. CRF-enriched CEA-DA projections are positioned to influence outputs to the ‘limbic-associative’ striatum, which is distinct from striatal regions targeted by DA cells lacking CEA input. We conclude that the concept of the CEA is supported on connectional grounds, and that CEA termination over the PBP and RRF neuronal populations can influence striatal circuits involved in associative learning. PMID:28220796

Beyond the Classic VTA: Extended Amygdala Projections to DA-Striatal Paths in the Primate.

PubMed

Fudge, Julie L; Kelly, Emily A; Pal, Ria; Bedont, Joseph L; Park, Lydia; Ho, Brian

2017-07-01

The central extended amygdala (CEA) has been conceptualized as a 'macrosystem' that regulates various stress-induced behaviors. Consistent with this, the CEA highly expresses corticotropin-releasing factor (CRF), an important modulator of stress responses. Stress alters goal-directed responses associated with striatal paths, including maladaptive responses such as drug seeking, social withdrawal, and compulsive behavior. CEA inputs to the midbrain dopamine (DA) system are positioned to influence striatal functions through mesolimbic DA-striatal pathways. However, the structure of this amygdala-CEA-DA neuron path to the striatum has been poorly characterized in primates. In primates, we combined neuronal tracer injections into various arms of the circuit through specific DA subpopulations to assess: (1) whether the circuit connecting amygdala, CEA, and DA cells follows CEA intrinsic organization, or a more direct topography involving bed nucleus vs central nucleus divisions; (2) CRF content of the CEA-DA path; and (3) striatal subregions specifically involved in CEA-DA-striatal loops. We found that the amygdala-CEA-DA path follows macrostructural subdivisions, with the majority of input/outputs converging in the medial central nucleus, the sublenticular extended amygdala, and the posterior lateral bed nucleus of the stria terminalis. The proportion of CRF+ outputs is >50%, and mainly targets the A10 parabrachial pigmented nucleus (PBP) and A8 (retrorubal field, RRF) neuronal subpopulations, with additional inputs to the dorsal A9 neurons. CRF-enriched CEA-DA projections are positioned to influence outputs to the 'limbic-associative' striatum, which is distinct from striatal regions targeted by DA cells lacking CEA input. We conclude that the concept of the CEA is supported on connectional grounds, and that CEA termination over the PBP and RRF neuronal populations can influence striatal circuits involved in associative learning.

Effects of the modern food environment on striatal function, cognition and regulation of ingestive behavior

PubMed Central

Burke, Mary V; Small, Dana M

2017-01-01

Emerging evidence from human and animal studies suggest that consumption of palatable foods rich in fat and/or carbohydrates may produce deleterious influences on brain function independently of body weight or metabolic disease. Here we consider two mechanisms by which diet can impact striatal circuits to amplify food cue reactivity and impair inhibitory control. First, we review findings demonstrating that the energetic properties of foods regulate nucleus accumbens food cue reactivity, a demonstrated predictor of weight gain susceptibility, which is then sensitized by chronic consumption of an energy dense diet. Second, we consider evidence for diet-induced adaptations in dorsal striatal dopamine signaling that is associated with impaired inhibitory control and negative outcome learning. PMID:29619405

Valence and agency influence striatal response to feedback in patients with major depressive disorder

PubMed Central

Späti, Jakub; Chumbley, Justin; Doerig, Nadja; Brakowski, Janis; Holtforth, Martin Grosse; Seifritz, Erich; Spinelli, Simona

2015-01-01

Background Reduced sensitivity to positive feedback is common in patients with major depressive disorder (MDD). However, findings regarding negative feedback are ambiguous, with both exaggerated and blunted responses being reported. The ventral striatum (VS) plays a major role in processing valenced feedback, and previous imaging studies have shown that the locus of controls (self agency v. external agency) over the outcome influences VS response to feedback. We investigated whether attributing the outcome to one’s own action or to an external agent influences feedback processing in patients with MDD. We hypothesized that depressed participants would be less sensitive to the feedback attribution reflected by an altered VS response to self-attributed gains and losses. Methods Using functional MRI and a motion prediction task, we investigated the neural responses to self-attributed (SA) and externally attributed (EA) monetary gains and losses in unmedicated patients with MDD and healthy controls. Results We included 21 patients and 25 controls in our study. Consistent with our prediction, healthy controls showed a VS response influenced by feedback valence and attribution, whereas in depressed patients striatal activity was modulated by valence but was insensitive to attribution. This attribution insensitivity led to an altered ventral putamen response for SA – EA losses in patients with MDD compared with healthy controls. Limitations Depressed patients with comorbid anxiety disorder were included. Conclusion These results suggest an altered assignment of motivational salience to SA losses in patients with MDD. Altered striatal response to SA negative events may reinforce the belief of not being in control of negative outcomes contributing to a cycle of learned helplessness. PMID:26107160

Spatially Compact Neural Clusters in the Dorsal Striatum Encode Locomotion Relevant Information.

PubMed

Barbera, Giovanni; Liang, Bo; Zhang, Lifeng; Gerfen, Charles R; Culurciello, Eugenio; Chen, Rong; Li, Yun; Lin, Da-Ting

2016-10-05

An influential striatal model postulates that neural activities in the striatal direct and indirect pathways promote and inhibit movement, respectively. Normal behavior requires coordinated activity in the direct pathway to facilitate intended locomotion and indirect pathway to inhibit unwanted locomotion. In this striatal model, neuronal population activity is assumed to encode locomotion relevant information. Here, we propose a novel encoding mechanism for the dorsal striatum. We identified spatially compact neural clusters in both the direct and indirect pathways. Detailed characterization revealed similar cluster organization between the direct and indirect pathways, and cluster activities from both pathways were correlated with mouse locomotion velocities. Using machine-learning algorithms, cluster activities could be used to decode locomotion relevant behavioral states and locomotion velocity. We propose that neural clusters in the dorsal striatum encode locomotion relevant information and that coordinated activities of direct and indirect pathway neural clusters are required for normal striatal controlled behavior. VIDEO ABSTRACT. Published by Elsevier Inc.

Altered Learning and Arc-Regulated Consolidation of Learning in Striatum by Methamphetamine-Induced Neurotoxicity

PubMed Central

Pastuzyn, Elissa D; Chapman, David E; Wilcox, Karen S; Keefe, Kristen A

2012-01-01

Methamphetamine (METH) causes partial depletion of central monoamine systems and cognitive dysfunction in rats and humans. We have previously shown and now further show that the positive correlation between expression of the immediate-early gene Arc (activity-regulated, cytoskeleton-associated) in the dorsomedial (DM) striatum and learning on a response reversal task is lost in rats with METH-induced striatal dopamine loss, despite normal behavioral performance and unaltered N-methyl--aspartate (NMDA) receptor-mediated excitatory post-synaptic currents, suggesting intact excitatory transmission. This discrepancy suggests that METH-pretreated rats may no longer be using the dorsal striatum to solve the reversal task. To test this hypothesis, male Sprague–Dawley rats were pretreated with a neurotoxic regimen of METH or saline. Guide cannulae were surgically implanted bilaterally into the DM striatum. Three weeks after METH treatment, rats were trained on a motor response version of a T-maze task, and then underwent reversal training. Before reversal training, the NMDA receptor antagonist -2-amino-5-phosphonopentanoic acid (AP5) or an Arc antisense oligonucleotide was infused into the DM striatum. Acute disruption of DM striatal function by infusion of AP5 impaired reversal learning in saline-, but not METH-, pretreated rats. Likewise, acute disruption of Arc, which is implicated in consolidation of long-term memory, disrupted retention of reversal learning 24 h later in saline-, but not METH-, pretreated rats. These results highlight the critical importance of Arc in the striatum in consolidation of basal ganglia-mediated learning and suggest that long-term toxicity induced by METH alters the cognitive strategies/neural circuits used to solve tasks normally mediated by dorsal striatal function. PMID:22071872

Altered learning and Arc-regulated consolidation of learning in striatum by methamphetamine-induced neurotoxicity.

PubMed

Pastuzyn, Elissa D; Chapman, David E; Wilcox, Karen S; Keefe, Kristen A

2012-03-01

Methamphetamine (METH) causes partial depletion of central monoamine systems and cognitive dysfunction in rats and humans. We have previously shown and now further show that the positive correlation between expression of the immediate-early gene Arc (activity-regulated, cytoskeleton-associated) in the dorsomedial (DM) striatum and learning on a response reversal task is lost in rats with METH-induced striatal dopamine loss, despite normal behavioral performance and unaltered N-methyl-D-aspartate (NMDA) receptor-mediated excitatory post-synaptic currents, suggesting intact excitatory transmission. This discrepancy suggests that METH-pretreated rats may no longer be using the dorsal striatum to solve the reversal task. To test this hypothesis, male Sprague-Dawley rats were pretreated with a neurotoxic regimen of METH or saline. Guide cannulae were surgically implanted bilaterally into the DM striatum. Three weeks after METH treatment, rats were trained on a motor response version of a T-maze task, and then underwent reversal training. Before reversal training, the NMDA receptor antagonist DL-2-amino-5-phosphonopentanoic acid (AP5) or an Arc antisense oligonucleotide was infused into the DM striatum. Acute disruption of DM striatal function by infusion of AP5 impaired reversal learning in saline-, but not METH-, pretreated rats. Likewise, acute disruption of Arc, which is implicated in consolidation of long-term memory, disrupted retention of reversal learning 24 h later in saline-, but not METH-, pretreated rats. These results highlight the critical importance of Arc in the striatum in consolidation of basal ganglia-mediated learning and suggest that long-term toxicity induced by METH alters the cognitive strategies/neural circuits used to solve tasks normally mediated by dorsal striatal function.

Neural correlates of skill acquisition: decreased cortical activity during a serial interception sequence learning task.

PubMed

Gobel, Eric W; Parrish, Todd B; Reber, Paul J

2011-10-15

Learning of complex motor skills requires learning of component movements as well as the sequential structure of their order and timing. Using a Serial Interception Sequence Learning (SISL) task, participants learned a sequence of precisely timed interception responses through training with a repeating sequence. Following initial implicit learning of the repeating sequence, functional MRI data were collected during performance of that known sequence and compared with activity evoked during novel sequences of actions, novel timing patterns, or both. Reduced activity was observed during the practiced sequence in a distributed bilateral network including extrastriate occipital, parietal, and premotor cortical regions. These reductions in evoked activity likely reflect improved efficiency in visuospatial processing, spatio-motor integration, motor planning, and motor execution for the trained sequence, which is likely supported by nondeclarative skill learning. In addition, the practiced sequence evoked increased activity in the left ventral striatum and medial prefrontal cortex, while the posterior cingulate was more active during periods of better performance. Many prior studies of perceptual-motor skill learning have found increased activity in motor areas of the frontal cortex (e.g., motor and premotor cortex, SMA) and striatal areas (e.g., the putamen). The change in activity observed here (i.e., decreased activity across a cortical network) may reflect skill learning that is predominantly expressed through more accurate performance rather than decreased reaction time. Copyright © 2011 Elsevier Inc. All rights reserved.

Neural Correlates of Skill Acquisition: Decreased Cortical Activity During a Serial Interception Sequence Learning Task

PubMed Central

Gobel, Eric W.; Parrish, Todd B.; Reber, Paul J.

2011-01-01

Learning of complex motor skills requires learning of component movements as well as the sequential structure of their order and timing. Using a Serial Interception Sequence Learning (SISL) task, participants learned a sequence of precisely timed interception responses through training with a repeating sequence. Following initial implicit learning of the repeating sequence, functional MRI data were collected during performance of that known sequence and compared with activity evoked during novel sequences of actions, novel timing patterns, or both. Reduced activity was observed during the practiced sequence in a distributed bilateral network including extrastriate occipital, parietal, and premotor cortical regions. These reductions in evoked activity likely reflect improved efficiency in visuospatial processing, spatio-motor integration, motor planning, and motor execution for the trained sequence, which is likely supported by nondeclarative skill learning. In addition, the practiced sequence evoked increased activity in the left ventral striatum and medial prefrontal cortex, while the posterior cingulate was more active during periods of better performance. Many prior studies of perceptual-motor skill learning have found increased activity in motor areas of frontal cortex (e.g., motor and premotor cortex, SMA) and striatal areas (e.g., the putamen). The change in activity observed here (i.e., decreased activity across a cortical network) may reflect skill learning that is predominantly expressed through more accurate performance rather than decreased reaction time. PMID:21771663

Information processing in decision-making systems.

PubMed

van der Meer, Matthijs; Kurth-Nelson, Zeb; Redish, A David

2012-08-01

Decisions result from an interaction between multiple functional systems acting in parallel to process information in very different ways, each with strengths and weaknesses. In this review, the authors address three action-selection components of decision-making: The Pavlovian system releases an action from a limited repertoire of potential actions, such as approaching learned stimuli. Like the Pavlovian system, the habit system is computationally fast but, unlike the Pavlovian system permits arbitrary stimulus-action pairings. These associations are a "forward'' mechanism; when a situation is recognized, the action is released. In contrast, the deliberative system is flexible but takes time to process. The deliberative system uses knowledge of the causal structure of the world to search into the future, planning actions to maximize expected rewards. Deliberation depends on the ability to imagine future possibilities, including novel situations, and it allows decisions to be taken without having previously experienced the options. Various anatomical structures have been identified that carry out the information processing of each of these systems: hippocampus constitutes a map of the world that can be used for searching/imagining the future; dorsal striatal neurons represent situation-action associations; and ventral striatum maintains value representations for all three systems. Each system presents vulnerabilities to pathologies that can manifest as psychiatric disorders. Understanding these systems and their relation to neuroanatomy opens up a deeper way to treat the structural problems underlying various disorders.

Information Processing in Decision-Making Systems

PubMed Central

van der Meer, Matthijs; Kurth-Nelson, Zeb; Redish, A. David

2015-01-01

Decisions result from an interaction between multiple functional systems acting in parallel to process information in very different ways, each with strengths and weaknesses. In this review, the authors address three action-selection components of decision-making: The Pavlovian system releases an action from a limited repertoire of potential actions, such as approaching learned stimuli. Like the Pavlovian system, the habit system is computationally fast but, unlike the Pavlovian system permits arbitrary stimulus-action pairings. These associations are a “forward” mechanism; when a situation is recognized, the action is released. In contrast, the deliberative system is flexible but takes time to process. The deliberative system uses knowledge of the causal structure of the world to search into the future, planning actions to maximize expected rewards. Deliberation depends on the ability to imagine future possibilities, including novel situations, and it allows decisions to be taken without having previously experienced the options. Various anatomical structures have been identified that carry out the information processing of each of these systems: hippocampus constitutes a map of the world that can be used for searching/imagining the future; dorsal striatal neurons represent situation-action associations; and ventral striatum maintains value representations for all three systems. Each system presents vulnerabilities to pathologies that can manifest as psychiatric disorders. Understanding these systems and their relation to neuroanatomy opens up a deeper way to treat the structural problems underlying various disorders. PMID:22492194

Toward sophisticated basal ganglia neuromodulation: Review on basal ganglia deep brain stimulation.

PubMed

Da Cunha, Claudio; Boschen, Suelen L; Gómez-A, Alexander; Ross, Erika K; Gibson, William S J; Min, Hoon-Ki; Lee, Kendall H; Blaha, Charles D

2015-11-01

This review presents state-of-the-art knowledge about the roles of the basal ganglia (BG) in action-selection, cognition, and motivation, and how this knowledge has been used to improve deep brain stimulation (DBS) treatment of neurological and psychiatric disorders. Such pathological conditions include Parkinson's disease, Huntington's disease, Tourette syndrome, depression, and obsessive-compulsive disorder. The first section presents evidence supporting current hypotheses of how the cortico-BG circuitry works to select motor and emotional actions, and how defects in this circuitry can cause symptoms of the BG diseases. Emphasis is given to the role of striatal dopamine on motor performance, motivated behaviors and learning of procedural memories. Next, the use of cutting-edge electrochemical techniques in animal and human studies of BG functioning under normal and disease conditions is discussed. Finally, functional neuroimaging studies are reviewed; these works have shown the relationship between cortico-BG structures activated during DBS and improvement of disease symptoms. Copyright © 2015 Elsevier Ltd. All rights reserved.

Toward sophisiticated basal ganglia neuromodulation: review on basal gaglia deep brain stimulation

PubMed Central

Da Cunha, Claudio; Boschen, Suelen L.; Gómez-A, Alexander; Ross, Erika K.; Gibson, William S. J.; Min, Hoon-Ki; Lee, Kendall H.; Blaha, Charles D.

2015-01-01

This review presents state-of-the-art knowledge about the roles of the basal ganglia (BG) in action-selection, cognition, and motivation, and how this knowledge has been used to improve deep brain stimulation (DBS) treatment of neurological and psychiatric disorders. Such pathological conditions include Parkinson’s disease, Huntington’s disease, Tourette syndrome, depression, and obsessive-compulsive disorder. The first section presents evidence supporting current hypotheses of how the cortico-BG circuitry works to select motor and emotional actions, and how defects in this circuitry can cause symptoms of the BG diseases. Emphasis is given to the role of striatal dopamine on motor performance, motivated behaviors and learning of procedural memories. Next, the use of cutting-edge electrochemical techniques in animal and human studies of BG functioning under normal and disease conditions is discussed. Finally, functional neuroimaging studies are reviewed; these works have shown the relationship between cortico-BG structures activated during DBS and improvement of disease symptoms. PMID:25684727

Knowledge acquisition is governed by striatal prediction errors.

PubMed

Pine, Alex; Sadeh, Noa; Ben-Yakov, Aya; Dudai, Yadin; Mendelsohn, Avi

2018-04-26

Discrepancies between expectations and outcomes, or prediction errors, are central to trial-and-error learning based on reward and punishment, and their neurobiological basis is well characterized. It is not known, however, whether the same principles apply to declarative memory systems, such as those supporting semantic learning. Here, we demonstrate with fMRI that the brain parametrically encodes the degree to which new factual information violates expectations based on prior knowledge and beliefs-most prominently in the ventral striatum, and cortical regions supporting declarative memory encoding. These semantic prediction errors determine the extent to which information is incorporated into long-term memory, such that learning is superior when incoming information counters strong incorrect recollections, thereby eliciting large prediction errors. Paradoxically, by the same account, strong accurate recollections are more amenable to being supplanted by misinformation, engendering false memories. These findings highlight a commonality in brain mechanisms and computational rules that govern declarative and nondeclarative learning, traditionally deemed dissociable.

Striatal Circuits as a Common Node for Autism Pathophysiology

PubMed Central

Fuccillo, Marc V.

2016-01-01

Autism spectrum disorders (ASD) are characterized by two seemingly unrelated symptom domains—deficits in social interactions and restrictive, repetitive patterns of behavioral output. Whether the diverse nature of ASD symptomatology represents distributed dysfunction of brain networks or abnormalities within specific neural circuits is unclear. Striatal dysfunction is postulated to underlie the repetitive motor behaviors seen in ASD, and neurological and brain-imaging studies have supported this assumption. However, as our appreciation of striatal function expands to include regulation of behavioral flexibility, motivational state, goal-directed learning, and attention, we consider whether alterations in striatal physiology are a central node mediating a range of autism-associated behaviors, including social and cognitive deficits that are hallmarks of the disease. This review investigates multiple genetic mouse models of ASD to explore whether abnormalities in striatal circuits constitute a common pathophysiological mechanism in the development of autism-related behaviors. Despite the heterogeneity of genetic insult investigated, numerous genetic ASD models display alterations in the structure and function of striatal circuits, as well as abnormal behaviors including repetitive grooming, stereotypic motor routines, deficits in social interaction and decision-making. Comparative analysis in rodents provides a unique opportunity to leverage growing genetic association data to reveal canonical neural circuits whose dysfunction directly contributes to discrete aspects of ASD symptomatology. The description of such circuits could provide both organizing principles for understanding the complex genetic etiology of ASD as well as novel treatment routes. Furthermore, this focus on striatal mechanisms of behavioral regulation may also prove useful for exploring the pathogenesis of other neuropsychiatric diseases, which display overlapping behavioral deficits with ASD. PMID:26903795

Influence of cortical synaptic input on striatal neuronal dendritic arborization and sensitivity to excitotoxicity in corticostriatal coculture.

PubMed

Buren, Caodu; Tu, Gaqi; Parsons, Matthew P; Sepers, Marja D; Raymond, Lynn A

2016-08-01

Corticostriatal cocultures are utilized to recapitulate the cortex-striatum connection in vitro as a convenient model to investigate the development, function, and regulation of synapses formed between cortical and striatal neurons. However, optimization of this dissociated neuronal system to more closely reproduce in vivo circuits has not yet been explored. We studied the effect of varying the plating ratio of cortical to striatal neurons on striatal spiny projection neuron (SPN) characteristics in primary neuronal cocultures. Despite the large difference in cortical-striatal neuron ratio (1:1 vs. 1:3) at day of plating, by 18 days in vitro the difference became modest (∼25% lower cortical-striatal neuron ratio in 1:3 cocultures) and the neuronal density was lower in the 1:3 cocultures, indicating enhanced loss of striatal SPNs. Comparing SPNs in cocultures plated at a 1:1 vs. 1:3 ratio, we found that resting membrane potential, input resistance, current injection-induced action potential firing rates, and input-output curves were similar in the two conditions. However, SPNs in the cocultures plated at the lower cortical ratio exhibited reduced membrane capacitance along with significantly shorter total dendritic length, decreased dendritic complexity, and fewer excitatory synapses, consistent with their trend toward reduced miniature excitatory postsynaptic current frequency. Strikingly, the proportion of NMDA receptors found extrasynaptically in recordings from SPNs was significantly higher in the less cortical coculture. Consistently, SPNs in cocultures with reduced cortical input showed decreased basal pro-survival signaling through cAMP response element binding protein and enhanced sensitivity to NMDA-induced apoptosis. Altogether, our study indicates that abundance of cortical input regulates SPN dendritic arborization and survival/death signaling. Copyright © 2016 the American Physiological Society.

Mechanisms mediating parallel action monitoring in fronto-striatal circuits.

PubMed

Beste, Christian; Ness, Vanessa; Lukas, Carsten; Hoffmann, Rainer; Stüwe, Sven; Falkenstein, Michael; Saft, Carsten

2012-08-01

Flexible response adaptation and the control of conflicting information play a pivotal role in daily life. Yet, little is known about the neuronal mechanisms mediating parallel control of these processes. We examined these mechanisms using a multi-methodological approach that integrated data from event-related potentials (ERPs) with structural MRI data and source localisation using sLORETA. Moreover, we calculated evoked wavelet oscillations. We applied this multi-methodological approach in healthy subjects and patients in a prodromal phase of a major basal ganglia disorder (i.e., Huntington's disease), to directly focus on fronto-striatal networks. Behavioural data indicated, especially the parallel execution of conflict monitoring and flexible response adaptation was modulated across the examined cohorts. When both processes do not co-incide a high integrity of fronto-striatal loops seems to be dispensable. The neurophysiological data suggests that conflict monitoring (reflected by the N2 ERP) and working memory processes (reflected by the P3 ERP) differentially contribute to this pattern of results. Flexible response adaptation under the constraint of high conflict processing affected the N2 and P3 ERP, as well as their delta frequency band oscillations. Yet, modulatory effects were strongest for the N2 ERP and evoked wavelet oscillations in this time range. The N2 ERPs were localized in the anterior cingulate cortex (BA32, BA24). Modulations of the P3 ERP were localized in parietal areas (BA7). In addition, MRI-determined caudate head volume predicted modulations in conflict monitoring, but not working memory processes. The results show how parallel conflict monitoring and flexible adaptation of action is mediated via fronto-striatal networks. While both, response monitoring and working memory processes seem to play a role, especially response selection processes and ACC-basal ganglia networks seem to be the driving force in mediating parallel conflict monitoring and flexible adaptation of actions. Copyright © 2012 Elsevier Inc. All rights reserved.

Tph2 gene deletion enhances amphetamine-induced hypermotility: effect of 5-HT restoration and role of striatal noradrenaline release.

PubMed

Carli, Mirjana; Kostoula, Chrysaugi; Sacchetti, Giuseppina; Mainolfi, Pierangela; Anastasia, Alessia; Villani, Claudia; Invernizzi, Roberto William

2015-11-01

Variants of tryptophan hydroxylase-2 (Tph2), the gene encoding enzyme responsible for the synthesis of brain serotonin (5-HT), have been associated with neuropsychiatric disorders, substance abuse and addiction. This study assessed the effect of Tph2 gene deletion on motor behavior and found that motor activity induced by 2.5 and 5 mg/kg amphetamine was enhanced in Tph2(-/-) mice. Using the in vivo microdialysis technique we found that the ability of amphetamine to stimulate noradrenaline (NA) release in the striatum was reduced by about 50% in Tph2(-/-) mice while the release of dopamine (DA) was not affected. Tph2 deletion did not affect the release of NA and DA in the prefrontal cortex. The role of endogenous 5-HT in enhancing the effect of amphetamine was confirmed showing that treatment with the 5-HT precursor 5-hydroxytryptophan (10 mg/kg) restored tissue and extracellular levels of brain 5-HT and the effects of amphetamine on striatal NA release and motor activity in Tph2(-/-) mice. Treatment with the NA precursor dihydroxyphenylserine (400 mg/kg) was sufficient to restore the effect of amphetamine on striatal NA release and motor activity in Tph2(-/-) mice. These findings indicate that amphetamine-induced hyperactivity is attenuated by endogenous 5-HT through the inhibition of striatal NA release. Tph2(-/-) mice may be a useful preclinical model to assess the role of 5-HT-dependent mechanisms in the action of psychostimulants. Acute sensitivity to the motor effects of amphetamine has been associated to increased risk of psychostimulant abuse. Here, we show that deletion of Tph2, the gene responsible for brain 5-HT synthesis, enhances the motor effect of amphetamine in mice through the inhibition of striatal NA release. This suggests that Tph2(-/-) mice is a useful preclinical model to assess the role of 5-HT-dependent mechanisms in psychostimulants action. Tph2, tryptophan hydroxylase-2. © 2015 International Society for Neurochemistry.

Silibinin pretreatment attenuates biochemical and behavioral changes induced by intrastriatal MPP+ injection in rats.

PubMed

Geed, Milind; Garabadu, Debapriya; Ahmad, Ausaf; Krishnamurthy, Sairam

2014-02-01

Silymarin commonly known for its hepatoprotective effect is reported to show protection against 6-hydroxydopamine-induced neurotoxicity. Silibinin forms the major active constituent of silymarin. Therefore, the neuroprotective effect of silibinin (50, 100 and 200 mg/kg) was evaluated in the unilaterally injected 1-methyl-4-phenylpyridinium (MPP(+))-induced dopaminergic neurotoxicity in male rats. A battery of tests such as elevated plus maze (EPM), narrow beam walk, open field, bar catalepsy, grip strength, and foot print analysis was performed to evaluate the behavioral symptoms of striatal dopaminergic toxicity. Furthermore, the mechanism of action of silibinin was investigated by evaluating the mitochondrial complex enzyme activities, mitochondrial integrity and oxidative status. Striatal caspase-3 and NFκB were expressed to evaluate the effect of silibinin on apoptosis and inflammation respectively. Silibinin (100 and 200 mg/kg) protected against MPP(+)-induced dopamine depletion in striatum. Silibinin reversed MPP(+)-induced decrease in transfer latency indicating memory consolidation in the EPM test. Silibinin (100 and 200 mg/kg) attenuated MPP(+)-induced motor deficits, such as fine motor movements and gait. MPP(+)-induced mitochondrial dysfunction, loss of integrity and oxidative stress were attenuated by silibinin. Silibinin decreased striatal caspase-3 and NFκB expression indicating potential anti-apoptotic and anti-inflammatory effects respectively. Hence, silibinin exhibited neuroprotective effect in the MPP(+) induced striatal toxicity augmenting dopamine levels. The mechanism of action may be linked to maintenance of mitochondrial bioenergetics and integrity apart from anti-apoptotic and anti-inflammatory activities. Copyright © 2013 Elsevier Inc. All rights reserved.

Ventral Tegmental Area and Substantia Nigra Neural Correlates of Spatial Learning

ERIC Educational Resources Information Center

Martig, Adria K.; Mizumori, Sheri J. Y.

2011-01-01

The ventral tegmental area (VTA) and substantia nigra pars compacta (SNc) may provide modulatory signals that, respectively, influence hippocampal (HPC)- and striatal-dependent memory. Electrophysiological studies investigating neural correlates of learning and memory of dopamine (DA) neurons during classical conditioning tasks have found DA…

Inhibition of presynaptic calcium transients in cortical inputs to the dorsolateral striatum by metabotropic GABAB and mGlu2/3 receptors

PubMed Central

Kupferschmidt, David A; Lovinger, David M

2015-01-01

Cortical inputs to the dorsolateral striatum (DLS) are dynamically regulated during skill learning and habit formation, and are dysregulated in disorders characterized by impaired action control. Therefore, a mechanistic investigation of the processes regulating corticostriatal transmission is key to understanding DLS-associated circuit function, behaviour and pathology. Presynaptic GABAB and group II metabotropic glutamate (mGlu2/3) receptors exert marked inhibitory control over corticostriatal glutamate release in the DLS, yet the signalling pathways through which they do so are unclear. We developed a novel approach using the genetically encoded calcium (Ca2+) indicator GCaMP6 to assess presynaptic Ca2+ in corticostriatal projections to the DLS. Using simultaneous photometric presynaptic Ca2+ and striatal field potential recordings, we report that relative to P/Q-type Ca2+ channels, N-type channels preferentially contributed to evoked presynaptic Ca2+ influx in motor cortex projections to, and excitatory transmission in, the DLS. Activation of GABAB or mGlu2/3 receptors inhibited both evoked presynaptic Ca2+ transients and striatal field potentials. mGlu2/3 receptor-mediated depression did not require functional N-type Ca2+ channels, but was attenuated by blockade of P/Q-type channels. These findings reveal presynaptic mechanisms of inhibitory modulation of corticostriatal function that probably contribute to the selection and shaping of behavioural repertoires. Key points Plastic changes at cortical inputs to the dorsolateral striatum (DLS) underlie skill learning and habit formation, so characterizing the mechanisms by which these inputs are regulated is important for understanding the neural basis of action control. We developed a novel approach using the genetically encoded calcium (Ca2+) indicator GCaMP6 and brain slice photometry to assess evoked presynaptic Ca2+ transients in cortical inputs to the DLS and study their regulation by GABAB and mGlu2/3 receptors. GABAB and mGlu2/3 receptor activation caused clear reductions in electrical stimulus-evoked presynaptic Ca2+ transients in corticostriatal inputs to the DLS. Functional P/Q-type voltage-gated Ca2+ channels were required for the normal inhibitory action of corticostriatal mGlu2/3 receptors. We provide direct evidence of presynaptic Ca2+ inhibition by G protein-coupled receptors at corticostriatal projections. PMID:25781000

Chronic Nicotine Mitigates Aberrant Inhibitory Motor Learning Induced by Motor Experience under Dopamine Deficiency

PubMed Central

Krok, Anne C.; Xu, Jian; Contractor, Anis; McGehee, Daniel S.; Zhuang, Xiaoxi

2016-01-01

Although dopamine receptor antagonism has long been associated with impairments in motor performance, more recent studies have shown that dopamine D2 receptor (D2R) antagonism, paired with a motor task, not only impairs motor performance concomitant with the pharmacodynamics of the drug, but also impairs future motor performance once antagonism has been relieved. We have termed this phenomenon “aberrant motor learning” and have suggested that it may contribute to motor symptoms in movement disorders such as Parkinson's disease (PD). Here, we show that chronic nicotine (cNIC), but not acute nicotine, treatment mitigates the acquisition of D2R-antagonist-induced aberrant motor learning in mice. Although cNIC mitigates D2R-mediated aberrant motor learning, cNIC has no effect on D1R-mediated motor learning. β2-containing nicotinic receptors in dopamine neurons likely mediate the protective effect of cNIC against aberrant motor learning, because selective deletion of β2 nicotinic subunits in dopamine neurons reduced D2R-mediated aberrant motor learning. Finally, both cNIC treatment and β2 subunit deletion blunted postsynaptic responses to D2R antagonism. These results suggest that a chronic decrease in function or a downregulation of β2-containing nicotinic receptors protects the striatal network against aberrant plasticity and aberrant motor learning induced by motor experience under dopamine deficiency. SIGNIFICANCE STATEMENT Increasingly, aberrant plasticity and aberrant learning are recognized as contributing to the development and progression of movement disorders. Here, we show that chronic nicotine (cNIC) treatment or specific deletion of β2 nicotinic receptor subunits in dopamine neurons mitigates aberrant motor learning induced by dopamine D2 receptor (D2R) blockade in mice. Moreover, both manipulations also reduced striatal dopamine release and blunt postsynaptic responses to D2R antagonists. These results suggest that chronic downregulation of function and/or receptor expression of β2-containing nicotinic receptors alters presynaptic and postsynaptic striatal signaling to protect against aberrant motor learning. Moreover, these results suggest that cNIC treatment may alleviate motor symptoms and/or delay the deterioration of motor function in movement disorders by blocking aberrant motor learning. PMID:27170121

Association Between Interleukin-6 and Striatal Prediction-Error Signals Following Acute Stress in Healthy Female Participants.

PubMed

Treadway, Michael T; Admon, Roee; Arulpragasam, Amanda R; Mehta, Malavika; Douglas, Samuel; Vitaliano, Gordana; Olson, David P; Cooper, Jessica A; Pizzagalli, Diego A

2017-10-15

Stress is widely known to alter behavioral responses to rewards and punishments. It is believed that stress may precipitate these changes through modulation of corticostriatal circuitry involved in reinforcement learning and motivation, although the intervening mechanisms remain unclear. One candidate is inflammation, which can rapidly increase following stress and can disrupt dopamine-dependent reward pathways. Here, in a sample of 88 healthy female participants, we first assessed the effect of an acute laboratory stress paradigm on levels of plasma interleukin-6 (IL-6), a cytokine known to be both responsive to stress and elevated in depression. In a second laboratory session, we examined the effects of a second laboratory stress paradigm on reward prediction error (RPE) signaling in the ventral striatum. We show that individual differences in stress-induced increases in IL-6 (session 1) were associated with decreased ventral striatal RPE signaling during reinforcement learning (session 2), though there was no main effect of stress on RPE. Furthermore, changes in IL-6 following stress predicted intraindividual variability in perceived stress during a 4-month follow-up period. Taken together, these data identify a novel link between IL-6 and striatal RPEs during reinforcement learning in the context of acute psychological stress, as well as future appraisal of stressful life events. Copyright © 2017 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

How did the chicken cross the road? With her striatal cholinergic interneurons, of course

PubMed Central

Schoenbaum, Geoffrey; Stalnaker, Thomas A; Niv, Yael

2013-01-01

Recognizing when the world changes is fundamental for normal learning. Here, Bradfield and colleagues show that cholinergic interneurons in dorsomedial striatum are critical to the process whereby new states of the world are appropriately registered and retrieved during associative learning. PMID:23849192

Spatial Discrimination Reversal Learning in Weanling Rats Is Impaired by Striatal Administration of an NMDA-Receptor Antagonist

ERIC Educational Resources Information Center

Watson, Deborah J.; Stanton, Mark E.

2009-01-01

The striatum plays a major role in both motor control and learning and memory, including executive function and "behavioral flexibility." Lesion, temporary inactivation, and infusion of an N-methyl-d-aspartate (NMDA)-receptor antagonist into the dorsomedial striatum (dmSTR) impair reversal learning in adult rats. Systemic administration of MK-801…

The neural basis of social risky decision making in females with major depressive disorder.

PubMed

Shao, Robin; Zhang, Hui-jun; Lee, Tatia M C

2015-01-01

Recent evidence indicates that Major Depressive Disorder (MDD) may be associated with reduced tendency of committing noncompliant actions during social decision-making even when the risk of being punished is low. The neural underpinnings of this behavioral pattern are unknown, although it likely relates to compromised functioning of the lateral prefrontal-striatal/limbic networks implicated in executive control, emotion regulation and risk/value-based instrumental behaviors. We employed a modified trust game (TG) that provided explicit information on the risk levels of cheating behaviors being detected and punished. Behavioral and neuro-image data were acquired and analyzed from 14 first-episode female MDD patients and 15 age- and gender-matched controls performing the role of trustee in the TG. Relative to controls, MDD patients exhibited less behavioral switching to making cheating choices under low risk, and reduced activity in the dorsal putamen, anterior insula and dorsolateral prefrontal cortex (DLPFC) during making low-risk cheating versus benevolent choices, with limited evidence indicating abnormal bilateral inferior frontal gyrus activities of patients when making high-risk cheating versus benevolent choices. Patients' left dorsal putamen/anterior insular signals correlated positively with their frequency of low-risk cheating. MDD patients' symptom severity correlated positively with their signals in the lateral prefrontal networks during decision-making. A psycho-physiological interaction analysis provided tentative evidence for the recruitment of IFG-striatal/limbic circuitry among the control participants, but greater frontopolar-striatal/limbic connectivity among the MDD patients, during low-risk decision-making. We propose that making risky social decisions based on the balancing of self-gain and other's welfare relies on the functioning of the integrated lateral prefrontal-striatal/limbic networks, which are less efficient and dysregulated among MDD patients compared with controls, impacting negatively on the patients' social capacity and highlighting a key therapeutic target for MDD. Copyright © 2014 Elsevier Ltd. All rights reserved.

Dysregulation of Corticostriatal Ascorbate Release and Glutamate Uptake in Transgenic Models of Huntington's Disease

PubMed Central

2013-01-01

Abstract Significance: Dysregulation of cortical and striatal neuronal processing plays a critical role in Huntington's disease (HD), a dominantly inherited condition that includes a progressive deterioration of cognitive and motor control. Growing evidence indicates that ascorbate (AA), an antioxidant vitamin, is released into striatal extracellular fluid when glutamate is cleared after its release from cortical afferents. Both AA release and glutamate uptake are impaired in the striatum of transgenic mouse models of HD owing to a downregulation of glutamate transporter 1 (GLT1), the protein primarily found on astrocytes and responsible for removing most extracellular glutamate. Improved understanding of an AA–glutamate interaction could lead to new therapeutic strategies for HD. Recent Advances: Increased expression of GLT1 following treatment with ceftriaxone, a beta-lactam antibiotic, increases striatal glutamate uptake and AA release and also improves the HD behavioral phenotype. In fact, treatment with AA alone restores striatal extracellular AA to wild-type levels in HD mice and not only improves behavior but also improves the firing pattern of neurons in HD striatum. Critical Issues: Although evidence is growing for an AA-glutamate interaction, several key issues require clarification: the site of action of AA on striatal neurons; the precise role of GLT1 in striatal AA release; and the mechanism by which HD interferes with this role. Future Directions: Further assessment of how the HD mutation alters corticostriatal signaling is an important next step. A critical focus is the role of astrocytes, which express GLT1 and may be the primary source of extracellular AA. Antioxid. Redox Signal. 19, 2115–2128. PMID:23642110

Fast oscillations in cortical-striatal networks switch frequency following rewarding events and stimulant drugs.

PubMed

Berke, J D

2009-09-01

Oscillations may organize communication between components of large-scale brain networks. Although gamma-band oscillations have been repeatedly observed in cortical-basal ganglia circuits, their functional roles are not yet clear. Here I show that, in behaving rats, distinct frequencies of ventral striatal local field potential oscillations show coherence with different cortical inputs. The approximately 50 Hz gamma oscillations that normally predominate in awake ventral striatum are coherent with piriform cortex, whereas approximately 80-100 Hz high-gamma oscillations are coherent with frontal cortex. Within striatum, entrainment to gamma rhythms is selective to fast-spiking interneurons, with distinct fast-spiking interneuron populations entrained to different gamma frequencies. Administration of the psychomotor stimulant amphetamine or the dopamine agonist apomorphine causes a prolonged decrease in approximately 50 Hz power and increase in approximately 80-100 Hz power. The same frequency switch is observed for shorter epochs spontaneously in awake, undrugged animals and is consistently provoked for < 1 s following reward receipt. Individual striatal neurons can participate in these brief high-gamma bursts with, or without, substantial changes in firing rate. Switching between discrete oscillatory states may allow different modes of information processing during decision-making and reinforcement-based learning, and may also be an important systems-level process by which stimulant drugs affect cognition and behavior.

Protection but maintained dysfunction of nigral dopaminergic nerve cell bodies and striatal dopaminergic terminals in MPTP-lesioned mice after acute treatment with the mGluR5 antagonist MPEP.

PubMed

Aguirre, Jose A; Kehr, Jan; Yoshitake, Takashi; Liu, Fang-Ling; Rivera, Alicia; Fernandez-Espinola, Sergio; Andbjer, Beth; Leo, Giuseppina; Medhurst, Andrew D; Agnati, Luigi F; Fuxe, Kjell

2005-02-08

The mGluR5 antagonist MPEP was used to study the role of mGluR5 in MPTP-induced injury of the nigrostriatal DA neurons. The findings indicate that acute blockade of mGluR5 may result in neuroprotective actions against MPTP neurotoxicity on nigral DA cell bodies and striatal DA terminals using stereological analysis of TH immunoreactivity and microdensitometry. Biochemical analysis showed no restoration of DA levels and metabolism indicating a maintained reduction of DA transmission.

Striatal fast-spiking interneurons selectively modulate circuit output and are required for habitual behavior

PubMed Central

O'Hare, Justin K; Li, Haofang; Kim, Namsoo; Gaidis, Erin; Ade, Kristen; Beck, Jeff; Yin, Henry

2017-01-01

Habit formation is a behavioral adaptation that automates routine actions. Habitual behavior correlates with broad reconfigurations of dorsolateral striatal (DLS) circuit properties that increase gain and shift pathway timing. The mechanism(s) for these circuit adaptations are unknown and could be responsible for habitual behavior. Here we find that a single class of interneuron, fast-spiking interneurons (FSIs), modulates all of these habit-predictive properties. Consistent with a role in habits, FSIs are more excitable in habitual mice compared to goal-directed and acute chemogenetic inhibition of FSIs in DLS prevents the expression of habitual lever pressing. In vivo recordings further reveal a previously unappreciated selective modulation of SPNs based on their firing patterns; FSIs inhibit most SPNs but paradoxically promote the activity of a subset displaying high fractions of gamma-frequency spiking. These results establish a microcircuit mechanism for habits and provide a new example of how interneurons mediate experience-dependent behavior. PMID:28871960

Striatal activation reflects urgency in perceptual decision making.

PubMed

van Maanen, Leendert; Fontanesi, Laura; Hawkins, Guy E; Forstmann, Birte U

2016-10-01

Deciding between multiple courses of action often entails an increasing need to do something as time passes - a sense of urgency. This notion of urgency is not incorporated in standard theories of speeded decision making that assume information is accumulated until a critical fixed threshold is reached. Yet, it is hypothesized in novel theoretical models of decision making. In two experiments, we investigated the behavioral and neural evidence for an "urgency signal" in human perceptual decision making. Experiment 1 found that as the duration of the decision making process increased, participants made a choice based on less evidence for the selected option. Experiment 2 replicated this finding, and additionally found that variability in this effect across participants covaried with activation in the striatum. We conclude that individual differences in susceptibility to urgency are reflected by striatal activation. By dynamically updating a response threshold, the striatum is involved in signaling urgency in humans. Copyright © 2016 Elsevier Inc. All rights reserved.

Towards a Reconceptualization of Striatal Interactions Between Glutamatergic and Dopaminergic Neurotransmission and Their Contribution to the Production of Movements

PubMed Central

David, Hélène N

2009-01-01

According to the current model of the basal ganglia organization, simultaneous activation of the striato-nigral direct pathway by glutamatergic and dopaminergic neurotransmission should lead to a synergistic facilitatory action on locomotor activity, while in contrast activation of the indirect pathway by these two neurotransmittions should lead to antagonistic effects on locomotor activity. Based on published data, as a break with the current thinking, we propose a reconceptualization of functional interactions between dopaminergic and glutamatergic neurotransmission. In this model, dopaminergic neurotransmission is seen as a motor pacemaker responsible for the basal and primary activation of striatal output neurons and glutamate as a driver providing a multiple combination of tonic, phasic, facilitatory and inhibitory influxes resulting from the processing of environmental, emotional and mnesic stimuli. Thus, in the model, glutamate-coded inputs would allow tuning the intrinsic motor-activating properties of dopamine to adjust the production of locomotor activity into goal-oriented movements. PMID:19949572

Role of DARPP-32 and ARPP-21 in the Emergence of Temporal Constraints on Striatal Calcium and Dopamine Integration

PubMed Central

Bhalla, Upinder S.; Hellgren Kotaleski, Jeanette

2016-01-01

In reward learning, the integration of NMDA-dependent calcium and dopamine by striatal projection neurons leads to potentiation of corticostriatal synapses through CaMKII/PP1 signaling. In order to elicit the CaMKII/PP1-dependent response, the calcium and dopamine inputs should arrive in temporal proximity and must follow a specific (dopamine after calcium) order. However, little is known about the cellular mechanism which enforces these temporal constraints on the signal integration. In this computational study, we propose that these temporal requirements emerge as a result of the coordinated signaling via two striatal phosphoproteins, DARPP-32 and ARPP-21. Specifically, DARPP-32-mediated signaling could implement an input-interval dependent gating function, via transient PP1 inhibition, thus enforcing the requirement for temporal proximity. Furthermore, ARPP-21 signaling could impose the additional input-order requirement of calcium and dopamine, due to its Ca2+/calmodulin sequestering property when dopamine arrives first. This highlights the possible role of phosphoproteins in the temporal aspects of striatal signal transduction. PMID:27584878

Striatal Cholinergic Interneurons Modulate Spike-Timing in Striosomes and Matrix by an Amphetamine-Sensitive Mechanism

PubMed Central

Crittenden, Jill R.; Lacey, Carolyn J.; Weng, Feng-Ju; Garrison, Catherine E.; Gibson, Daniel J.; Lin, Yingxi; Graybiel, Ann M.

2017-01-01

The striatum is key for action-selection and the motivation to move. Dopamine and acetylcholine release sites are enriched in the striatum and are cross-regulated, possibly to achieve optimal behavior. Drugs of abuse, which promote abnormally high dopamine release, disrupt normal action-selection and drive restricted, repetitive behaviors (stereotypies). Stereotypies occur in a variety of disorders including obsessive-compulsive disorder, autism, schizophrenia and Huntington's disease, as well as in addictive states. The severity of drug-induced stereotypy is correlated with induction of c-Fos expression in striosomes, a striatal compartment that is related to the limbic system and that directly projects to dopamine-producing neurons of the substantia nigra. These characteristics of striosomes contrast with the properties of the extra-striosomal matrix, which has strong sensorimotor and associative circuit inputs and outputs. Disruption of acetylcholine signaling in the striatum blocks the striosome-predominant c-Fos expression pattern induced by drugs of abuse and alters drug-induced stereotypy. The activity of striatal cholinergic interneurons is associated with behaviors related to sensory cues, and cortical inputs to striosomes can bias action-selection in the face of conflicting cues. The neurons and neuropil of striosomes and matrix neurons have observably separate distributions, both at the input level in the striatum and at the output level in the substantia nigra. Notably, cholinergic axons readily cross compartment borders, providing a potential route for local cross-compartment communication to maintain a balance between striosomal and matrix activity. We show here, by slice electrophysiology in transgenic mice, that repetitive evoked firing patterns in striosomal and matrix striatal projection neurons (SPNs) are interrupted by optogenetic activation of cholinergic interneurons either by the addition or the deletion of spikes. We demonstrate that this cholinergic modulation of projection neurons is blocked in brain slices taken from mice exposed to amphetamine and engaged in amphetamine-induced stereotypy, and lacking responsiveness to salient cues. Our findings support a model whereby activity in striosomes is normally under strong regulation by cholinergic interneurons, favoring behavioral flexibility, but that in animals with drug-induced stereotypy, this cholinergic signaling breaks down, resulting in differential modulation of striosomal activity and an inability to bias action-selection according to relevant sensory cues. PMID:28377698

Gamification of Learning Deactivates the Default Mode Network

PubMed Central

Howard-Jones, Paul A.; Jay, Tim; Mason, Alice; Jones, Harvey

2016-01-01

We hypothesized that embedding educational learning in a game would improve learning outcomes, with increased engagement and recruitment of cognitive resources evidenced by increased activation of working memory network (WMN) and deactivation of default mode network (DMN) regions. In an fMRI study, we compared activity during periods of learning in three conditions that were increasingly game-like: Study-only (when periods of learning were followed by an exemplar question together with its correct answer), Self-quizzing (when periods of learning were followed by a multiple choice question in return for a fixed number of points) and Game-based (when, following each period of learning, participants competed with a peer to answer the question for escalating, uncertain rewards). DMN hubs deactivated as conditions became more game-like, alongside greater self-reported engagement and, in the Game-based condition, higher learning scores. These changes did not occur with any detectable increase in WMN activity. Additionally, ventral striatal activation was associated with responding to questions and receiving positive question feedback. Results support the significance of DMN deactivation for educational learning, and are aligned with recent evidence suggesting DMN and WMN activity may not always be anti-correlated. PMID:26779054

Gamification of Learning Deactivates the Default Mode Network.

PubMed

Howard-Jones, Paul A; Jay, Tim; Mason, Alice; Jones, Harvey

2015-01-01

We hypothesized that embedding educational learning in a game would improve learning outcomes, with increased engagement and recruitment of cognitive resources evidenced by increased activation of working memory network (WMN) and deactivation of default mode network (DMN) regions. In an fMRI study, we compared activity during periods of learning in three conditions that were increasingly game-like: Study-only (when periods of learning were followed by an exemplar question together with its correct answer), Self-quizzing (when periods of learning were followed by a multiple choice question in return for a fixed number of points) and Game-based (when, following each period of learning, participants competed with a peer to answer the question for escalating, uncertain rewards). DMN hubs deactivated as conditions became more game-like, alongside greater self-reported engagement and, in the Game-based condition, higher learning scores. These changes did not occur with any detectable increase in WMN activity. Additionally, ventral striatal activation was associated with responding to questions and receiving positive question feedback. Results support the significance of DMN deactivation for educational learning, and are aligned with recent evidence suggesting DMN and WMN activity may not always be anti-correlated.

Investigating expectation and reward in human opioid addiction with [(11) C]raclopride PET.

PubMed

Watson, Ben J; Taylor, Lindsay G; Reid, Alastair G; Wilson, Sue J; Stokes, Paul R; Brooks, David J; Myers, James F; Turkheimer, Federico E; Nutt, David J; Lingford-Hughes, Anne R

2014-11-01

The rewarding properties of some abused drugs are thought to reside in their ability to increase striatal dopamine levels. Similar increases have been shown in response to expectation of a positive drug effect. The actions of opioid drugs on striatal dopamine release are less well characterized. We examined whether heroin and the expectation of heroin reward increases striatal dopamine levels in human opioid addiction. Ten opioid-dependent participants maintained on either methadone or buprenorphine underwent [(11) C]raclopride positron emission tomography imaging. Opioid-dependent participants were scanned three times, receiving reward from 50-mg intravenous heroin (diamorphine; pharmaceutical heroin) during the first scan to generate expectation of the same reward at the second scan, during which they only received 0.1-mg intravenous heroin. There was no heroin injection during the third scan. Intravenous 50-mg heroin during the first scan induced pronounced effects leading to high levels of expectation at the second scan. There was no detectable increase in striatal dopamine levels to either heroin reward or expectation of reward. We believe this is the first human study to examine whether expectation of heroin reward increases striatal dopamine levels in opioid addiction. The absence of detectable increased dopamine levels to both the expectation and delivery of a heroin-related reward may have been due to the impact of substitute medication. It does however contrast with the changes seen in abstinent stimulant users, suggesting that striatal dopamine release alone may not play such a pivotal role in opioid-maintained individuals. © 2013 The Authors. Addiction Biology published by John Wiley & Sons Ltd on behalf of Society for the Study of Addiction.

Acute effects of 3,4-methylenedioxymethamphetamine on striatal single-unit activity and behavior in freely moving rats: differential involvement of dopamine D(1) and D(2) receptors.

PubMed

Ball, Kevin T; Budreau, Daniel; Rebec, George V

2003-12-24

3,4-Methylenedioxymethamphetamine (MDMA) is a widely abused amphetamine derivative that increases dopamine (DA) and serotonin release via a reverse transport mechanism. Changes in the activity of striatal neurons in response to increased DA transmission may shape the behavioral patterns associated with amphetamine-like stimulants. To determine how the striatum participates in MDMA-induced locomotor activation, we recorded the activity of >100 single units in the striatum of freely moving rats in response to a dose that increased motor activation (5.0 mg/kg). MDMA had a predominantly excitatory effect on neuronal activity that was positively correlated with the magnitude of locomotor activation. Categorizing neurons according to baseline locomotor responsiveness revealed that MDMA excited significantly more neurons showing movement-related increases in activity compared to units that were non-movement-related or associated with movement-related decreases in activity. Further analysis revealed that the drug-induced striatal activation was not simply secondary to the behavioral change, indicating a primary action of MDMA on striatal motor circuits. Prior administration of SCH-23390 (0.2 mg/kg), a D(1) antagonist, resulted in a late onset of MDMA-induced locomotion, which correlated positively with delayed neuronal excitations. Conversely, prior administration of eticlopride (0.2 mg/kg), a D(2) antagonist, completely abolished MDMA-induced locomotion, which paralleled its blockade of MDMA-induced excitatory neuronal responses. Our results highlight the importance of striatal neuronal activity in shaping the behavioral response to MDMA, and suggest that DA D(1) and D(2) receptors have distinct functional roles in the expression of MDMA-induced striatal and locomotor activation.

Action Learning: Avoiding Conflict or Enabling Action

ERIC Educational Resources Information Center

Corley, Aileen; Thorne, Ann

2006-01-01

Action learning is based on the premise that action and learning are inextricably entwined and it is this potential, to enable action, which has contributed to the growth of action learning within education and management development programmes. However has this growth in action learning lead to an evolution or a dilution of Revan's classical…

Comparison of machine learning and semi-quantification algorithms for (I123)FP-CIT classification: the beginning of the end for semi-quantification?

PubMed

Taylor, Jonathan Christopher; Fenner, John Wesley

2017-11-29

Semi-quantification methods are well established in the clinic for assisted reporting of (I123) Ioflupane images. Arguably, these are limited diagnostic tools. Recent research has demonstrated the potential for improved classification performance offered by machine learning algorithms. A direct comparison between methods is required to establish whether a move towards widespread clinical adoption of machine learning algorithms is justified. This study compared three machine learning algorithms with that of a range of semi-quantification methods, using the Parkinson's Progression Markers Initiative (PPMI) research database and a locally derived clinical database for validation. Machine learning algorithms were based on support vector machine classifiers with three different sets of features: Voxel intensities Principal components of image voxel intensities Striatal binding radios from the putamen and caudate. Semi-quantification methods were based on striatal binding ratios (SBRs) from both putamina, with and without consideration of the caudates. Normal limits for the SBRs were defined through four different methods: Minimum of age-matched controls Mean minus 1/1.5/2 standard deviations from age-matched controls Linear regression of normal patient data against age (minus 1/1.5/2 standard errors) Selection of the optimum operating point on the receiver operator characteristic curve from normal and abnormal training data Each machine learning and semi-quantification technique was evaluated with stratified, nested 10-fold cross-validation, repeated 10 times. The mean accuracy of the semi-quantitative methods for classification of local data into Parkinsonian and non-Parkinsonian groups varied from 0.78 to 0.87, contrasting with 0.89 to 0.95 for classifying PPMI data into healthy controls and Parkinson's disease groups. The machine learning algorithms gave mean accuracies between 0.88 to 0.92 and 0.95 to 0.97 for local and PPMI data respectively. Classification performance was lower for the local database than the research database for both semi-quantitative and machine learning algorithms. However, for both databases, the machine learning methods generated equal or higher mean accuracies (with lower variance) than any of the semi-quantification approaches. The gain in performance from using machine learning algorithms as compared to semi-quantification was relatively small and may be insufficient, when considered in isolation, to offer significant advantages in the clinical context.

Striatal and Hippocampal Involvement in Motor Sequence Chunking Depends on the Learning Strategy

PubMed Central

Lungu, Ovidiu; Monchi, Oury; Albouy, Geneviève; Jubault, Thomas; Ballarin, Emanuelle; Burnod, Yves; Doyon, Julien

2014-01-01

Motor sequences can be learned using an incremental approach by starting with a few elements and then adding more as training evolves (e.g., learning a piano piece); conversely, one can use a global approach and practice the whole sequence in every training session (e.g., shifting gears in an automobile). Yet, the neural correlates associated with such learning strategies in motor sequence learning remain largely unexplored to date. Here we used functional magnetic resonance imaging to measure the cerebral activity of individuals executing the same 8-element sequence after they completed a 4-days training regimen (2 sessions each day) following either a global or incremental strategy. A network comprised of striatal and fronto-parietal regions was engaged significantly regardless of the learning strategy, whereas the global training regimen led to additional cerebellar and temporal lobe recruitment. Analysis of chunking/grouping of sequence elements revealed a common prefrontal network in both conditions during the chunk initiation phase, whereas execution of chunk cores led to higher mediotemporal activity (involving the hippocampus) after global than incremental training. The novelty of our results relate to the recruitment of mediotemporal regions conditional of the learning strategy. Thus, the present findings may have clinical implications suggesting that the ability of patients with lesions to the medial temporal lobe to learn and consolidate new motor sequences may benefit from using an incremental strategy. PMID:25148078

Striatal and hippocampal involvement in motor sequence chunking depends on the learning strategy.

PubMed

Lungu, Ovidiu; Monchi, Oury; Albouy, Geneviève; Jubault, Thomas; Ballarin, Emanuelle; Burnod, Yves; Doyon, Julien

2014-01-01

Motor sequences can be learned using an incremental approach by starting with a few elements and then adding more as training evolves (e.g., learning a piano piece); conversely, one can use a global approach and practice the whole sequence in every training session (e.g., shifting gears in an automobile). Yet, the neural correlates associated with such learning strategies in motor sequence learning remain largely unexplored to date. Here we used functional magnetic resonance imaging to measure the cerebral activity of individuals executing the same 8-element sequence after they completed a 4-days training regimen (2 sessions each day) following either a global or incremental strategy. A network comprised of striatal and fronto-parietal regions was engaged significantly regardless of the learning strategy, whereas the global training regimen led to additional cerebellar and temporal lobe recruitment. Analysis of chunking/grouping of sequence elements revealed a common prefrontal network in both conditions during the chunk initiation phase, whereas execution of chunk cores led to higher mediotemporal activity (involving the hippocampus) after global than incremental training. The novelty of our results relate to the recruitment of mediotemporal regions conditional of the learning strategy. Thus, the present findings may have clinical implications suggesting that the ability of patients with lesions to the medial temporal lobe to learn and consolidate new motor sequences may benefit from using an incremental strategy.

Differential coding of reward and movement information in the dorsomedial striatal direct and indirect pathways.

PubMed

Shin, Jung Hwan; Kim, Dohoung; Jung, Min Whan

2018-01-26

The direct and indirect pathways of the basal ganglia have long been thought to mediate behavioral promotion and inhibition, respectively. However, this classic dichotomous model has been recently challenged. To better understand neural processes underlying reward-based learning and movement control, we recorded from direct (dSPNs) and indirect (iSPNs) pathway spiny projection neurons in the dorsomedial striatum of D1-Cre and D2-Cre mice performing a probabilistic Pavlovian conditioning task. dSPNs tend to increase activity while iSPNs decrease activity as a function of reward value, suggesting the striatum represents value in the relative activity levels of dSPNs versus iSPNs. Lick offset-related activity increase is largely dSPN selective, suggesting dSPN involvement in suppressing ongoing licking behavior. Rapid responses to negative outcome and previous reward-related responses are more frequent among iSPNs than dSPNs, suggesting stronger contributions of iSPNs to outcome-dependent behavioral adjustment. These findings provide new insights into striatal neural circuit operations.

Differential representation of Pavlovian-instrumental transfer by prefrontal cortex subregions and striatum.

PubMed

Homayoun, Houman; Moghaddam, Bita

2009-04-01

Environmental cues that once predicted reward can restore extinguished behavior directed toward that reward. This process may be modeled by the Pavlovian-instrumental transfer (PIT) paradigm where a previously learned Pavlovian conditioned stimulus (CS) elicits a representation of the reward associated with that CS, prompts motivation toward the absent reward, and triggers an instrumental action. We recorded in the medial and orbital prefrontal cortex (mPFC and OFC) and dorsal striatum (DS) of freely moving rats during PIT and found that a Pavlovian CS, as compared with neutral or no stimuli, amplified the phasic neuronal responses to instrumental nosepokes ('transfer' event). In mPFC and OFC, but not the DS, representation of the transfer event correlated with the strength of PIT behavior. Neurons in all three regions showed CS-selective amplification of Pavlovian approaches toward the reward delivery site. Whereas striatal neurons represented transfer and approach behavior through mostly segregated neuronal subsets, overlapping subsets represented these events in the mPFC and OFC. These findings suggest that parallel phasic activation of mPFC and OFC neuronal subsets participates in the transfer from Pavlovian incentives to instrumental actions.

Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation.

PubMed

Faure, Alexis; Haberland, Ulrike; Condé, Françoise; El Massioui, Nicole

2005-03-16

Acquisition and performance of instrumental actions are assumed to require both action-outcome and stimulus-response (S-R) habit processes. Over the course of extended training, control over instrumental performance shifts from goal-directed action-outcome associations to S-R associations that progressively gain domination over behavior. Lesions of the lateral part of the dorsal striatum disrupt this process, and rats with lesions to the lateral striatum showed selective sensitivity to devaluation of the instrumental outcome (Yin et al., 2004), indicating that this area is necessary for habit formation. The present experiment further explored the basis of this dysfunction by examining the ability of rats subjected to bilateral 6-hydroxydopamine lesions of the nigrostriatal dopaminergic pathway to develop behavioral autonomy with overtraining. Rats were given extended training on two cued instrumental tasks associating a stimulus (a tone or a light) with an instrumental action (lever press or chain pull) and a food reward (pellets or sucrose). Both tasks were run daily in separate sessions. Overtraining was followed by a test of goal sensitivity by satiety-specific devaluation of the reward. In control animals, one action (lever press) was insensitive to reward devaluation, indicating that it became a habit, whereas the second action (chain pull) was still sensitive to goal devaluation. This result provides evidence that the development of habit learning may depend on the characteristics of the response. In dopamine-depleted rats, lever press and chain pull remained sensitive to reward devaluation, evidencing a role of striatal dopamine transmission in habit formation.

Orbitofrontal Dopamine Depletion Upregulates Caudate Dopamine and Alters Behavior via Changes in Reinforcement Sensitivity

PubMed Central

Cardinal, R. N.; Rygula, R.; Hong, Y. T.; Fryer, T. D.; Sawiak, S. J.; Ferrari, V.; Cockcroft, G.; Aigbirhio, F. I.; Robbins, T. W.; Roberts, A. C.

2014-01-01

Schizophrenia is associated with upregulation of dopamine (DA) release in the caudate nucleus. The caudate has dense connections with the orbitofrontal cortex (OFC) via the frontostriatal loops, and both areas exhibit pathophysiological change in schizophrenia. Despite evidence that abnormalities in dopaminergic neurotransmission and prefrontal cortex function co-occur in schizophrenia, the influence of OFC DA on caudate DA and reinforcement processing is poorly understood. To test the hypothesis that OFC dopaminergic dysfunction disrupts caudate dopamine function, we selectively depleted dopamine from the OFC of marmoset monkeys and measured striatal extracellular dopamine levels (using microdialysis) and dopamine D2/D3 receptor binding (using positron emission tomography), while modeling reinforcement-related behavior in a discrimination learning paradigm. OFC dopamine depletion caused an increase in tonic dopamine levels in the caudate nucleus and a corresponding reduction in D2/D3 receptor binding. Computational modeling of behavior showed that the lesion increased response exploration, reducing the tendency to persist with a recently chosen response side. This effect is akin to increased response switching previously seen in schizophrenia and was correlated with striatal but not OFC D2/D3 receptor binding. These results demonstrate that OFC dopamine depletion is sufficient to induce striatal hyperdopaminergia and changes in reinforcement learning relevant to schizophrenia. PMID:24872570

Reward inference by primate prefrontal and striatal neurons.

PubMed

Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru; Sakagami, Masamichi

2014-01-22

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus-reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning.

Reward Inference by Primate Prefrontal and Striatal Neurons

PubMed Central

Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru

2014-01-01

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus–reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning. PMID:24453328

Effects of Ventral Striatum Lesions on Stimulus-Based versus Action-Based Reinforcement Learning.

PubMed

Rothenhoefer, Kathryn M; Costa, Vincent D; Bartolo, Ramón; Vicario-Feliciano, Raquel; Murray, Elisabeth A; Averbeck, Bruno B

2017-07-19

Learning the values of actions versus stimuli may depend on separable neural circuits. In the current study, we evaluated the performance of rhesus macaques with ventral striatum (VS) lesions on a two-arm bandit task that had randomly interleaved blocks of stimulus-based and action-based reinforcement learning (RL). Compared with controls, monkeys with VS lesions had deficits in learning to select rewarding images but not rewarding actions. We used a RL model to quantify learning and choice consistency and found that, in stimulus-based RL, the VS lesion monkeys were more influenced by negative feedback and had lower choice consistency than controls. Using a Bayesian model to parse the groups' learning strategies, we also found that VS lesion monkeys defaulted to an action-based choice strategy. Therefore, the VS is involved specifically in learning the value of stimuli, not actions. SIGNIFICANCE STATEMENT Reinforcement learning models of the ventral striatum (VS) often assume that it maintains an estimate of state value. This suggests that it plays a general role in learning whether rewards are assigned based on a chosen action or stimulus. In the present experiment, we examined the effects of VS lesions on monkeys' ability to learn that choosing a particular action or stimulus was more likely to lead to reward. We found that VS lesions caused a specific deficit in the monkeys' ability to discriminate between images with different values, whereas their ability to discriminate between actions with different values remained intact. Our results therefore suggest that the VS plays a specific role in learning to select rewarded stimuli. Copyright © 2017 the authors 0270-6474/17/376902-13$15.00/0.

Obstinate Actions-Oriented Behaviour towards Applying Theoractive Learning: An Ontology of Educational Learning and Leadership Theories in Practice

ERIC Educational Resources Information Center

Rajbhandari, Mani Man Singh

2018-01-01

Obstinate actions-oriented behaviour is the study of learning and practicing behaviour theoractively, which is acquired from the content based, process based learning and spawning critical reflexivity to the learnt theoretical phenomena into practical actions. Obstinate actions-oriented behaviour is a multi-faceted behaviour that is generally…

Dermatoglyphic asymmetries and fronto-striatal dysfunction in young-adults reporting non-clinical psychosis

PubMed Central

Mittal, Vijay A.; Dean, Derek J.; Pelletier, Andrea

2012-01-01

Objective Growing evidence indicates that non-clinical psychotic-like experiences occur in otherwise healthy individuals, suggesting that psychosis may occur on a continuum. However, little is know about how the diathesis for formal psychosis maps on to individuals at the non-clinical side of this continuum. Our current understanding of the pathophysiology of schizophrenia implicates certain key factors such as early developmental abnormalities and fronto-striatal dysfunction. To date, no studies have examined these core factors in the context of non-clinical psychosis. Method A total of 221 young adults were assessed for distressing attenuated positive symptoms (DAPS), dermatoglyphic asymmetries (a marker of early developmental insult), and procedural memory (a proxy for fronto-striatal function). Results Participants reporting DAPS (n=16; 7.2%) and no-DAPS (n=205; 92.7%) were split into two groups. The DAPS group showed significantly elevated depression, elevated dermatoglyphic asymmetries, and a pattern of procedural learning consistent with other studies with formally psychotic patients. Conclusion The results indicate that the non-clinical side of the psychosis continuum also shares key vulnerability factors implicated in schizophrenia, suggesting that both early developmental disruption and abnormalities in fronto-striatal function are core aspects underlying the disorder. PMID:22519833

Optimized in vivo detection of dopamine release using 18F-fallypride PET.

PubMed

Ceccarini, Jenny; Vrieze, Elske; Koole, Michel; Muylle, Tom; Bormans, Guy; Claes, Stephan; Van Laere, Koen

2012-10-01

The high-affinity D(2/3) PET radioligand (18)F-fallypride offers the possibility of measuring both striatal and extrastriatal dopamine release during activation paradigms. When a single (18)F-fallypride scanning protocol is used, task timing is critical to the ability to explore both striatal and extrastriatal dopamine release simultaneously. We evaluated the sensitivity and optimal timing of task administration for a single (18)F-fallypride PET protocol and the linearized simplified reference region kinetic model in detecting both striatal and extrastriatal reward-induced dopamine release, using human and simulation studies. Ten healthy volunteers underwent a single-bolus (18)F-fallypride PET protocol. A reward responsiveness learning task was initiated at 100 min after injection. PET data were analyzed using the linearized simplified reference region model, which accounts for time-dependent changes in (18)F-fallypride displacement. Voxel-based statistical maps, reflecting task-induced D(2/3) ligand displacement, and volume-of-interest-based analysis were performed to localize areas with increased ligand displacement after task initiation, thought to be proportional to changes in endogenous dopamine release (γ parameter). Simulated time-activity curves for baseline and hypothetical dopamine release functions (different peak heights of dopamine and task timings) were generated using the enhanced receptor-binding kinetic model to investigate γ as a function of these parameters. The reward task induced increased ligand displacement in extrastriatal regions of the reward circuit, including the medial orbitofrontal cortex, ventromedial prefrontal cortex, and dorsal anterior cingulate cortex. For task timing of 100 min, ligand displacement was found for the striatum only when peak height of dopamine was greater than 240 nM, whereas for frontal regions, γ was always positive for all task timings and peak heights of dopamine. Simulation results for a peak height of dopamine of 200 nM showed that an effect of striatal ligand displacement could be detected only when task timing was greater than 120 min. The prefrontal and anterior cingulate cortices are involved in reward responsiveness that can be measured using (18)F-fallypride PET in a single scanning session. To measure both striatal and extrastriatal dopamine release, the height of dopamine released and task timing need to be considered in designing activation studies depending on regional D(2/3) density.

Imbalanced decision hierarchy in addicts emerging from drug-hijacked dopamine spiraling circuit.

PubMed

Keramati, Mehdi; Gutkin, Boris

2013-01-01

Despite explicitly wanting to quit, long-term addicts find themselves powerless to resist drugs, despite knowing that drug-taking may be a harmful course of action. Such inconsistency between the explicit knowledge of negative consequences and the compulsive behavioral patterns represents a cognitive/behavioral conflict that is a central characteristic of addiction. Neurobiologically, differential cue-induced activity in distinct striatal subregions, as well as the dopamine connectivity spiraling from ventral striatal regions to the dorsal regions, play critical roles in compulsive drug seeking. However, the functional mechanism that integrates these neuropharmacological observations with the above-mentioned cognitive/behavioral conflict is unknown. Here we provide a formal computational explanation for the drug-induced cognitive inconsistency that is apparent in the addicts' "self-described mistake". We show that addictive drugs gradually produce a motivational bias toward drug-seeking at low-level habitual decision processes, despite the low abstract cognitive valuation of this behavior. This pathology emerges within the hierarchical reinforcement learning framework when chronic exposure to the drug pharmacologically produces pathologicaly persistent phasic dopamine signals. Thereby the drug hijacks the dopaminergic spirals that cascade the reinforcement signals down the ventro-dorsal cortico-striatal hierarchy. Neurobiologically, our theory accounts for rapid development of drug cue-elicited dopamine efflux in the ventral striatum and a delayed response in the dorsal striatum. Our theory also shows how this response pattern depends critically on the dopamine spiraling circuitry. Behaviorally, our framework explains gradual insensitivity of drug-seeking to drug-associated punishments, the blocking phenomenon for drug outcomes, and the persistent preference for drugs over natural rewards by addicts. The model suggests testable predictions and beyond that, sets the stage for a view of addiction as a pathology of hierarchical decision-making processes. This view is complementary to the traditional interpretation of addiction as interaction between habitual and goal-directed decision systems.

Dorsolateral striatal lesions impair navigation based on landmark-goal vectors but facilitate spatial learning based on a “cognitive map”

PubMed Central

Poulter, Steven L.; Austen, Joe M.

2015-01-01

In three experiments, the nature of the interaction between multiple memory systems in rats solving a variation of a spatial task in the water maze was investigated. Throughout training rats were able to find a submerged platform at a fixed distance and direction from an intramaze landmark by learning a landmark-goal vector. Extramaze cues were also available for standard place learning, or “cognitive mapping,” but these cues were valid only within each session, as the position of the platform moved around the pool between sessions together with the intramaze landmark. Animals could therefore learn the position of the platform by taking the consistent vector from the landmark across sessions or by rapidly encoding the new platform position on each session with reference to the extramaze cues. Excitotoxic lesions of the dorsolateral striatum impaired vector-based learning but facilitated cognitive map-based rapid place learning when the extramaze cues were relatively poor (Experiment 1) but not when they were more salient (Experiments 2 and 3). The way the lesion effects interacted with cue availability is consistent with the idea that the memory systems involved in the current navigation task are functionally cooperative yet associatively competitive in nature. PMID:25691518

Brain networks of social action-outcome contingency: The role of the ventral striatum in integrating signals from the sensory cortex and medial prefrontal cortex.

PubMed

Sumiya, Motofumi; Koike, Takahiko; Okazaki, Shuntaro; Kitada, Ryo; Sadato, Norihiro

2017-10-01

Social interactions can be facilitated by action-outcome contingency, in which self-actions result in relevant responses from others. Research has indicated that the striatal reward system plays a role in generating action-outcome contingency signals. However, the neural mechanisms wherein signals regarding self-action and others' responses are integrated to generate the contingency signal remain poorly understood. We conducted a functional MRI study to test the hypothesis that brain activity representing the self modulates connectivity between the striatal reward system and sensory regions involved in the processing of others' responses. We employed a contingency task in which participants made the listener laugh by telling jokes. Participants reported more pleasure when greater laughter followed their own jokes than those of another. Self-relevant listener's responses produced stronger activation in the medial prefrontal cortex (mPFC). Laughter was associated with activity in the auditory cortex. The ventral striatum exhibited stronger activation when participants made listeners laugh than when another did. In physio-physiological interaction analyses, the ventral striatum showed interaction effects for signals extracted from the mPFC and auditory cortex. These results support the hypothesis that the mPFC, which is implicated in self-related processing, gates sensory input associated with others' responses during value processing in the ventral striatum. Copyright © 2017 The Authors. Published by Elsevier B.V. All rights reserved.

Serotonin inhibits low-threshold spike interneurons in the striatum

PubMed Central

Cains, Sarah; Blomeley, Craig P; Bracci, Enrico

2012-01-01

Low-threshold spike interneurons (LTSIs) are important elements of the striatal architecture and the only known source of nitric oxide in this nucleus, but their rarity has so far prevented systematic studies. Here, we used transgenic mice in which green fluorescent protein is expressed under control of the neuropeptide Y (NPY) promoter and striatal NPY-expressing LTSIs can be easily identified, to investigate the effects of serotonin on these neurons. In sharp contrast with its excitatory action on other striatal interneurons, serotonin (30 μm) strongly inhibited LTSIs, reducing or abolishing their spontaneous firing activity and causing membrane hyperpolarisations. These hyperpolarisations persisted in the presence of tetrodotoxin, were mimicked by 5-HT2C receptor agonists and reversed by 5-HT2C antagonists. Voltage-clamp slow-ramp experiments showed that serotonin caused a strong increase in an outward current activated by depolarisations that was blocked by the specific M current blocker XE 991. In current-clamp experiments, XE 991 per se caused membrane depolarisations in LTSIs and subsequent application of serotonin (in the presence of XE 991) failed to affect these neurons. We concluded that serotonin strongly inhibits striatal LTSIs acting through postsynaptic 5-HT2C receptors and increasing an M type current. PMID:22495583

Moderation of the Relationship Between Reward Expectancy and Prediction Error-Related Ventral Striatal Reactivity by Anhedonia in Unmedicated Major Depressive Disorder: Findings From the EMBARC Study

PubMed Central

Greenberg, Tsafrir; Chase, Henry W.; Almeida, Jorge R.; Stiffler, Richelle; Zevallos, Carlos R.; Aslam, Haris A.; Deckersbach, Thilo; Weyandt, Sarah; Cooper, Crystal; Toups, Marisa; Carmody, Thomas; Kurian, Benji; Peltier, Scott; Adams, Phillip; McInnis, Melvin G.; Oquendo, Maria A.; McGrath, Patrick J.; Fava, Maurizio; Weissman, Myrna; Parsey, Ramin; Trivedi, Madhukar H.; Phillips, Mary L.

2016-01-01

Objective Anhedonia, disrupted reward processing, is a core symptom of major depressive disorder. Recent findings demonstrate altered reward-related ventral striatal reactivity in depressed individuals, but the extent to which this is specific to anhedonia remains poorly understood. The authors examined the effect of anhedonia on reward expectancy (expected outcome value) and prediction error-(discrepancy between expected and actual outcome) related ventral striatal reactivity, as well as the relationship between these measures. Method A total of 148 unmedicated individuals with major depressive disorder and 31 healthy comparison individuals recruited for the multisite EMBARC (Establishing Moderators and Biosignatures of Antidepressant Response in Clinical Care) study underwent functional MRI during a well-validated reward task. Region of interest and whole-brain data were examined in the first- (N=78) and second- (N=70) recruited cohorts, as well as the total sample, of depressed individuals, and in healthy individuals. Results Healthy, but not depressed, individuals showed a significant inverse relationship between reward expectancy and prediction error-related right ventral striatal reactivity. Across all participants, and in depressed individuals only, greater anhedonia severity was associated with a reduced reward expectancy-prediction error inverse relationship, even after controlling for other symptoms. Conclusions The normal reward expectancy and prediction error-related ventral striatal reactivity inverse relationship concords with conditioning models, predicting a shift in ventral striatal responding from reward outcomes to reward cues. This study shows, for the first time, an absence of this relationship in two cohorts of unmedicated depressed individuals and a moderation of this relationship by anhedonia, suggesting reduced reward-contingency learning with greater anhedonia. These findings help elucidate neural mechanisms of anhedonia, as a step toward identifying potential biosignatures of treatment response. PMID:26183698

Moderation of the Relationship Between Reward Expectancy and Prediction Error-Related Ventral Striatal Reactivity by Anhedonia in Unmedicated Major Depressive Disorder: Findings From the EMBARC Study.

PubMed

Greenberg, Tsafrir; Chase, Henry W; Almeida, Jorge R; Stiffler, Richelle; Zevallos, Carlos R; Aslam, Haris A; Deckersbach, Thilo; Weyandt, Sarah; Cooper, Crystal; Toups, Marisa; Carmody, Thomas; Kurian, Benji; Peltier, Scott; Adams, Phillip; McInnis, Melvin G; Oquendo, Maria A; McGrath, Patrick J; Fava, Maurizio; Weissman, Myrna; Parsey, Ramin; Trivedi, Madhukar H; Phillips, Mary L

2015-09-01

Anhedonia, disrupted reward processing, is a core symptom of major depressive disorder. Recent findings demonstrate altered reward-related ventral striatal reactivity in depressed individuals, but the extent to which this is specific to anhedonia remains poorly understood. The authors examined the effect of anhedonia on reward expectancy (expected outcome value) and prediction error- (discrepancy between expected and actual outcome) related ventral striatal reactivity, as well as the relationship between these measures. A total of 148 unmedicated individuals with major depressive disorder and 31 healthy comparison individuals recruited for the multisite EMBARC (Establishing Moderators and Biosignatures of Antidepressant Response in Clinical Care) study underwent functional MRI during a well-validated reward task. Region of interest and whole-brain data were examined in the first- (N=78) and second- (N=70) recruited cohorts, as well as the total sample, of depressed individuals, and in healthy individuals. Healthy, but not depressed, individuals showed a significant inverse relationship between reward expectancy and prediction error-related right ventral striatal reactivity. Across all participants, and in depressed individuals only, greater anhedonia severity was associated with a reduced reward expectancy-prediction error inverse relationship, even after controlling for other symptoms. The normal reward expectancy and prediction error-related ventral striatal reactivity inverse relationship concords with conditioning models, predicting a shift in ventral striatal responding from reward outcomes to reward cues. This study shows, for the first time, an absence of this relationship in two cohorts of unmedicated depressed individuals and a moderation of this relationship by anhedonia, suggesting reduced reward-contingency learning with greater anhedonia. These findings help elucidate neural mechanisms of anhedonia, as a step toward identifying potential biosignatures of treatment response.

Elevated depressive symptoms enhance reflexive but not reflective auditory category learning.

PubMed

Maddox, W Todd; Chandrasekaran, Bharath; Smayda, Kirsten; Yi, Han-Gyol; Koslov, Seth; Beevers, Christopher G

2014-09-01

In vision an extensive literature supports the existence of competitive dual-processing systems of category learning that are grounded in neuroscience and are partially-dissociable. The reflective system is prefrontally-mediated and uses working memory and executive attention to develop and test rules for classifying in an explicit fashion. The reflexive system is striatally-mediated and operates by implicitly associating perception with actions that lead to reinforcement. Although categorization is fundamental to auditory processing, little is known about the learning systems that mediate auditory categorization and even less is known about the effects of individual difference in the relative efficiency of the two learning systems. Previous studies have shown that individuals with elevated depressive symptoms show deficits in reflective processing. We exploit this finding to test critical predictions of the dual-learning systems model in audition. Specifically, we examine the extent to which the two systems are dissociable and competitive. We predicted that elevated depressive symptoms would lead to reflective-optimal learning deficits but reflexive-optimal learning advantages. Because natural speech category learning is reflexive in nature, we made the prediction that elevated depressive symptoms would lead to superior speech learning. In support of our predictions, individuals with elevated depressive symptoms showed a deficit in reflective-optimal auditory category learning, but an advantage in reflexive-optimal auditory category learning. In addition, individuals with elevated depressive symptoms showed an advantage in learning a non-native speech category structure. Computational modeling suggested that the elevated depressive symptom advantage was due to faster, more accurate, and more frequent use of reflexive category learning strategies in individuals with elevated depressive symptoms. The implications of this work for dual-process approach to auditory learning and depression are discussed. Copyright © 2014 Elsevier Ltd. All rights reserved.

Elevated Depressive Symptoms Enhance Reflexive but not Reflective Auditory Category Learning

PubMed Central

Maddox, W. Todd; Chandrasekaran, Bharath; Smayda, Kirsten; Yi, Han-Gyol; Koslov, Seth; Beevers, Christopher G.

2014-01-01

In vision an extensive literature supports the existence of competitive dual-processing systems of category learning that are grounded in neuroscience and are partially-dissociable. The reflective system is prefrontally-mediated and uses working memory and executive attention to develop and test rules for classifying in an explicit fashion. The reflexive system is striatally-mediated and operates by implicitly associating perception with actions that lead to reinforcement. Although categorization is fundamental to auditory processing, little is known about the learning systems that mediate auditory categorization and even less is known about the effects of individual difference in the relative efficiency of the two learning systems. Previous studies have shown that individuals with elevated depressive symptoms show deficits in reflective processing. We exploit this finding to test critical predictions of the dual-learning systems model in audition. Specifically, we examine the extent to which the two systems are dissociable and competitive. We predicted that elevated depressive symptoms would lead to reflective-optimal learning deficits but reflexive-optimal learning advantages. Because natural speech category learning is reflexive in nature, we made the prediction that elevated depressive symptoms would lead to superior speech learning. In support of our predictions, individuals with elevated depressive symptoms showed a deficit in reflective-optimal auditory category learning, but an advantage in reflexive-optimal auditory category learning. In addition, individuals with elevated depressive symptoms showed an advantage in learning a non-native speech category structure. Computational modeling suggested that the elevated depressive symptom advantage was due to faster, more accurate, and more frequent use of reflexive category learning strategies in individuals with elevated depressive symptoms. The implications of this work for dual-process approach to auditory learning and depression are discussed. PMID:25041936

Morphological elucidation of basal ganglia circuits contributing reward prediction

PubMed Central

Fujiyama, Fumino; Takahashi, Susumu; Karube, Fuyuki

2015-01-01

Electrophysiological studies in monkeys have shown that dopaminergic neurons respond to the reward prediction error. In addition, striatal neurons alter their responsiveness to cortical or thalamic inputs in response to the dopamine signal, via the mechanism of dopamine-regulated synaptic plasticity. These findings have led to the hypothesis that the striatum exhibits synaptic plasticity under the influence of the reward prediction error and conduct reinforcement learning throughout the basal ganglia circuits. The reinforcement learning model is useful; however, the mechanism by which such a process emerges in the basal ganglia needs to be anatomically explained. The actor–critic model has been previously proposed and extended by the existence of role sharing within the striatum, focusing on the striosome/matrix compartments. However, this hypothesis has been difficult to confirm morphologically, partly because of the complex structure of the striosome/matrix compartments. Here, we review recent morphological studies that elucidate the input/output organization of the striatal compartments. PMID:25698913

Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction.

PubMed

Belin, David; Jonkman, Sietse; Dickinson, Anthony; Robbins, Trevor W; Everitt, Barry J

2009-04-12

In this review we discuss the evidence that drug addiction, defined as a maladaptive compulsive habit, results from the progressive subversion by addictive drugs of striatum-dependent operant and Pavlovian learning mechanisms that are usually involved in the control over behaviour by stimuli associated with natural reinforcement. Although mainly organized through segregated parallel cortico-striato-pallido-thalamo-cortical loops involved in motor or emotional functions, the basal ganglia, and especially the striatum, are key mediators of the modulation of behavioural responses, under the control of both action-outcome and stimulus-response mechanisms, by incentive motivational processes and Pavlovian associations. Here we suggest that protracted exposure to addictive drugs recruits serial and dopamine-dependent, striato-nigro-striatal ascending spirals from the nucleus accumbens to more dorsal regions of the striatum that underlie a shift from action-outcome to stimulus-response mechanisms in the control over drug seeking. When this progressive ventral to dorsal striatum shift is combined with drug-associated Pavlovian influences from limbic structures such as the amygdala and the orbitofrontal cortex, drug seeking behaviour becomes established as an incentive habit. This instantiation of implicit sub-cortical processing of drug-associated stimuli and instrumental responding might be a key mechanism underlying the development of compulsive drug seeking and the high vulnerability to relapse which are hallmarks of drug addiction.

Striatal Pleiotrophin Overexpression Provides Functional and Morphological Neuroprotection in the 6-Hydroxydopamine Model

PubMed Central

Gombash, Sara E; Lipton, Jack W; Collier, Timothy J; Madhavan, Lalitha; Steece-Collier, Kathy; Cole-Strauss, Allyson; Terpstra, Brian T; Spieles-Engemann, Anne L; Daley, Brian F; Wohlgenant, Susan L; Thompson, Valerie B; Manfredsson, Fredric P; Mandel, Ronald J; Sortwell, Caryl E

2012-01-01

Neurotrophic factors are integrally involved in the development of the nigrostriatal system and in combination with gene therapy, possess great therapeutic potential for Parkinson's disease (PD). Pleiotrophin (PTN) is involved in the development, maintenance, and repair of the nigrostriatal dopamine (DA) system. The present study examined the ability of striatal PTN overexpression, delivered via psueudotyped recombinant adeno-associated virus type 2/1 (rAAV2/1), to provide neuroprotection and functional restoration from 6-hydroxydopamine (6-OHDA). Striatal PTN overexpression led to significant neuroprotection of tyrosine hydroxylase immunoreactive (THir) neurons in the substantia nigra pars compacta (SNpc) and THir neurite density in the striatum, with long-term PTN overexpression producing recovery from 6-OHDA-induced deficits in contralateral forelimb use. Transduced striatal PTN levels were increased threefold compared to adult striatal PTN expression and approximated peak endogenous developmental levels (P1). rAAV2/1 vector exclusively transduced neurons within the striatum and SNpc with approximately half the total striatal volume routinely transduced using our injection parameters. Our results indicate that striatal PTN overexpression can provide neuroprotection for the 6-OHDA lesioned nigrostriatal system based upon morphological and functional measures and that striatal PTN levels similar in magnitude to those expressed in the striatum during development are sufficient to provide neuroprotection from Parkinsonian insult. PMID:22008908

Frontostriatal anatomical connections predict age- and difficulty-related differences in reinforcement learning.

PubMed

van de Vijver, Irene; Ridderinkhof, K Richard; Harsay, Helga; Reneman, Liesbeth; Cavanagh, James F; Buitenweg, Jessika I V; Cohen, Michael X

2016-10-01

Reinforcement learning (RL) is supported by a network of striatal and frontal cortical structures that are connected through white-matter fiber bundles. With age, the integrity of these white-matter connections declines. The role of structural frontostriatal connectivity in individual and age-related differences in RL is unclear, although local white-matter density and diffusivity have been linked to individual differences in RL. Here we show that frontostriatal tract counts in young human adults (aged 18-28), as assessed noninvasively with diffusion-weighted magnetic resonance imaging and probabilistic tractography, positively predicted individual differences in RL when learning was difficult (70% valid feedback). In older adults (aged 63-87), in contrast, learning under both easy (90% valid feedback) and difficult conditions was predicted by tract counts in the same frontostriatal network. Furthermore, network-level analyses showed a double dissociation between the task-relevant networks in young and older adults, suggesting that older adults relied on different frontostriatal networks than young adults to obtain the same task performance. These results highlight the importance of successful information integration across striatal and frontal regions during RL, especially with variable outcomes. Copyright © 2016 Elsevier Inc. All rights reserved.

C-fos mediates antipsychotic-induced neurotensin gene expression in the rodent striatum.

PubMed

Robertson, G S; Tetzlaff, W; Bedard, A; St-Jean, M; Wigle, N

1995-07-01

The ubiquitous inducibility of the immediate-early gene c-fos in the central nervous system has led to the search for downstream genes which are regulated by its product, Fos. Recent evidence suggests that c-fos induction by a single injection of the classical antipsychotic haloperidol may contribute to the subsequent increase in neurotensin gene expression in the rodent striatum. Consistent with this proposal, in the present study haloperidol-induced Fos-like immunoreactivity and neurotensin/neuromedin N messenger RNA were found to be expressed by the same population of striatal neurons. Moreover, inhibition of haloperidol-induced c-fos expression by intrastriatal injection of antisense phosphorothioate oligodeoxynucleotides complimentary either to bases 109-126 or 127-144 of c-fos attenuated the subsequent increase in neurotensin/neuromedin N messenger RNA. However, injection of a sense phosphorothioate oligodeoxynucleotide corresponding to bases 127-144 of c-fos did not reduce haloperidol-induced c-fos or neurotensin/neuromedin N expression. Furthermore, constitutive expression of Jun-like immunoreactivity in the striatum was not reduced by either the sense or antisense phosphorothioate oligodeoxynucleotides. Similarly, the sense and antisense phosphorothioate oligodeoxynucleotide failed to reduce proenkephalin messenger RNA, which is located in the same striatal neurons that express haloperidol-induced neurotensin/neuromedin N messenger RNA, which is located in the same striatal neurons that express haloperidol-induced neurotensin/neuromedin N messenger RNA. Lastly, haloperidol-induced increases in nerve growth factor I-A-, JunB- and FosB-like immunoreactivity and fosB messenger RNA were not decreased by intrastriatal injection of either the sense or antisense phosphorothioate oligodeoxynucleotides. These results indicate that the antisense phosphorothioate oligodeoxynucleotides attenuated haloperidol-induced neurotensin/neuromedin N expression by selectively reducing c-fos expression and emphasize the potential importance of immediate-early gene induction in the mechanism of action of this antipsychotic drug.

A variable number of tandem repeats in the 3'-untranslated region of the dopamine transporter modulates striatal function during working memory updating across the adult age span.

PubMed

Sambataro, Fabio; Podell, Jamie E; Murty, Vishnu P; Das, Saumitra; Kolachana, Bhaskar; Goldberg, Terry E; Weinberger, Daniel R; Mattay, Venkata S

2015-08-01

Dopamine modulation of striatal function is critical for executive functions such as working memory (WM) updating. The dopamine transporter (DAT) regulates striatal dopamine signaling via synaptic reuptake. A variable number of tandem repeats in the 3'-untranslated region of SLC6A3 (DAT1-3'-UTR-VNTR) is associated with DAT expression, such that 9-repeat allele carriers tend to express lower levels (associated with higher extracellular dopamine concentrations) than 10-repeat homozygotes. Aging is also associated with decline of the dopamine system. The goal of the present study was to investigate the effects of aging and DAT1-3'-UTR-VNTR on the neural activity and functional connectivity of the striatum during WM updating. Our results showed both an age-related decrease in striatal activity and an effect of DAT1-3'-UTR-VNTR. Ten-repeat homozygotes showed reduced striatal activity and increased striatal-hippocampal connectivity during WM updating relative to the 9-repeat carriers. There was no age by DAT1-3'-UTR-VNTR interaction. These results suggest that, whereas striatal function during WM updating is modulated by both age and genetically determined DAT levels, the rate of the age-related decline in striatal function is similar across both DAT1-3'-UTR-VNTR genotype groups. They further suggest that, because of the baseline difference in striatal function based on DAT1-3'-UTR-VNTR polymorphism, 10-repeat homozygotes, who have lower levels of striatal function throughout the adult life span, may reach a threshold of decreased striatal function and manifest impairments in cognitive processes mediated by the striatum earlier in life than the 9-repeat carriers. Our data suggest that age and DAT1-3'-UTR-VNTR polymorphism independently modulate striatal function. Published 2015. This article is a U.S. Government work and is in the public domain in the USA.

Differences in Spontaneously Avoiding or Approaching Mice Reflect Differences in CB1-Mediated Signaling of Dorsal Striatal Transmission

PubMed Central

Laricchiuta, Daniela; Rossi, Silvia; Musella, Alessandra; De Chiara, Valentina; Cutuli, Debora; Centonze, Diego; Petrosini, Laura

2012-01-01

Approach or avoidance behaviors are accompanied by perceptual vigilance for, affective reactivity to and behavioral predisposition towards rewarding or punitive stimuli, respectively. We detected three subpopulations of C57BL/6J mice that responded with avoiding, balancing or approaching behaviors not induced by any experimental manipulation but spontaneously displayed in an approach/avoidance conflict task. Although the detailed neuronal mechanisms underlying the balancing between approach and avoidance are not fully clarified, there is growing evidence that endocannabinoid system (ECS) plays a critical role in the control of these balancing actions. The sensitivity of dorsal striatal synapses to the activation of cannabinoid CB1 receptors was investigated in the subpopulations of spontaneously avoiding, balancing or approaching mice. Avoiding animals displayed decreased control of CB1 receptors on GABAergic striatal transmission and in parallel increase of behavioral inhibition. Conversely, approaching animals exhibited increased control of CB1 receptors and in parallel increase of explorative behavior. Balancing animals reacted with balanced responses between approach and avoidance patterns. Treating avoiding animals with URB597 (fatty acid amide hydrolase inhibitor) or approaching animals with AM251 (CB1 receptor inverse agonist) reverted their respective behavioral and electrophysiological patterns. Therefore, enhanced or reduced CB1-mediated control on dorsal striatal transmission represents the synaptic hallmark of the approach or avoidance behavior, respectively. Thus, the opposite spontaneous responses to conflicting stimuli are modulated by a different involvement of endocannabinoid signaling of dorsal striatal neurons in the range of temperamental traits related to individual differences. PMID:22413007

Ethical sensitivity in obsessive-compulsive disorder and generalized anxiety disorder: the role of reversal learning.

PubMed

Szabó, Csilla; Németh, Attila; Kéri, Szabolcs

2013-12-01

In obsessive-compulsive disorder (OCD), amplified moral sensitivity may be related to the orbitofrontal-striatal circuit, which is also critical in reversal learning. This study examined three questions: (1) What aspects of ethical sensitivity is altered in OCD?; (2) What is the relationship between ethical sensitivity and reversal learning?; (3) Are potential alterations in ethical sensitivity and reversal learning present in generalized anxiety disorder (GAD)? Participants were 28 outpatients with OCD, 21 individuals with GAD, and 30 matched healthy controls. Participants received the ethical sensitivity scale questionnaire (ESSQ), rating scales for clinical symptoms, a reversal learning task, and the Wisconsin Card Sorting Test (WCST). We found higher ethical sensitivity scores in OCD compared with healthy controls in the case of generating interpretations and options and identifying the consequences of actions. Individuals with OCD displayed prolonged reaction times on probabilistic errors without shift and final reversal errors. Participants with GAD did not differ from healthy controls on the ESSQ, but they were slower on reversal learning relative to nonpatients. In OCD, reaction time on final reversal errors mediated the relationship between ethical sensitivity and compulsions. WCST performance was intact in OCD and GAD. Small sample size, limited neuropsychological assessment, self-rating scale for ethical sensitivity. Prolonged reaction time at switching reinforcement contingencies is related to increased ethical sensitivity in OCD. Slow affective switching may link ethical sensitivity and compulsions. Copyright © 2013 Elsevier Ltd. All rights reserved.

Differential Encoding of Time by Prefrontal and Striatal Network Dynamics.

PubMed

Bakhurin, Konstantin I; Goudar, Vishwa; Shobe, Justin L; Claar, Leslie D; Buonomano, Dean V; Masmanidis, Sotiris C

2017-01-25

Telling time is fundamental to many forms of learning and behavior, including the anticipation of rewarding events. Although the neural mechanisms underlying timing remain unknown, computational models have proposed that the brain represents time in the dynamics of neural networks. Consistent with this hypothesis, changing patterns of neural activity dynamically in a number of brain areas-including the striatum and cortex-has been shown to encode elapsed time. To date, however, no studies have explicitly quantified and contrasted how well different areas encode time by recording large numbers of units simultaneously from more than one area. Here, we performed large-scale extracellular recordings in the striatum and orbitofrontal cortex of mice that learned the temporal relationship between a stimulus and a reward and reported their response with anticipatory licking. We used a machine-learning algorithm to quantify how well populations of neurons encoded elapsed time from stimulus onset. Both the striatal and cortical networks encoded time, but the striatal network outperformed the orbitofrontal cortex, a finding replicated both in simultaneously and nonsimultaneously recorded corticostriatal datasets. The striatal network was also more reliable in predicting when the animals would lick up to ∼1 s before the actual lick occurred. Our results are consistent with the hypothesis that temporal information is encoded in a widely distributed manner throughout multiple brain areas, but that the striatum may have a privileged role in timing because it has a more accurate "clock" as it integrates information across multiple cortical areas. The neural representation of time is thought to be distributed across multiple functionally specialized brain structures, including the striatum and cortex. However, until now, the neural code for time has not been compared quantitatively between these areas. Here, we performed large-scale recordings in the striatum and orbitofrontal cortex of mice trained on a stimulus-reward association task involving a delay period and used a machine-learning algorithm to quantify how well populations of simultaneously recorded neurons encoded elapsed time from stimulus onset. We found that, although both areas encoded time, the striatum consistently outperformed the orbitofrontal cortex. These results suggest that the striatum may refine the code for time by integrating information from multiple inputs. Copyright © 2017 the authors 0270-6474/17/370854-17$15.00/0.

Associative and sensorimotor cortico-basal ganglia circuit roles in effects of abused drugs.

PubMed

Gremel, C M; Lovinger, D M

2017-01-01

The mammalian forebrain is characterized by the presence of several parallel cortico-basal ganglia circuits that shape the learning and control of actions. Among these are the associative, limbic and sensorimotor circuits. The function of all of these circuits has now been implicated in responses to drugs of abuse, as well as drug seeking and drug taking. While the limbic circuit has been most widely examined, key roles for the other two circuits in control of goal-directed and habitual instrumental actions related to drugs of abuse have been shown. In this review we describe the three circuits and effects of acute and chronic drug exposure on circuit physiology. Our main emphasis is on drug actions in dorsal striatal components of the associative and sensorimotor circuits. We then review key findings that have implicated these circuits in drug seeking and taking behaviors, as well as drug use disorders. Finally, we consider different models describing how the three cortico-basal ganglia circuits become involved in drug-related behaviors. This topic has implications for drug use disorders and addiction, as treatments that target the balance between the different circuits may be useful for reducing excessive substance use. Published 2016. This article is a U.S. Government work and is in the public domain in the USA.

Dopaminergic striatal innervation predicts interlimb transfer of a visuomotor skill

PubMed Central

Isaias, IU; Moisello, C; Marotta, G; Schiavella, M; Canesi, M; Perfetti, B; Cavallari, P; Pezzoli, G; Ghilardi, MF

2011-01-01

We investigated whether dopamine influences the rate of adaptation to a visuomotor distortion and the transfer of this learning from the right to the left limb in human subjects. We thus studied patients with Parkinson disease as a putative in vivo model of dopaminergic denervation. Despite normal adaptation rates, patients showed a reduced transfer compared to age-matched healthy controls. The magnitude of the transfer, but not of the adaptation rate, was positively predicted by the values of dopamine-transporter binding of the right caudate and putamen. We conclude that striatal dopaminergic activity plays an important role in the transfer of visuomotor skills. PMID:21994362

Dopaminergic striatal innervation predicts interlimb transfer of a visuomotor skill.

PubMed

Isaias, Ioannis U; Moisello, Clara; Marotta, Giorgio; Schiavella, Mauro; Canesi, Margherita; Perfetti, Bernardo; Cavallari, Paolo; Pezzoli, Gianni; Ghilardi, M Felice

2011-10-12

We investigated whether dopamine influences the rate of adaptation to a visuomotor distortion and the transfer of this learning from the right to the left limb in human subjects. We thus studied patients with Parkinson disease as a putative in vivo model of dopaminergic denervation. Despite normal adaptation rates, patients showed a reduced transfer compared with age-matched healthy controls. The magnitude of the transfer, but not of the adaptation rate, was positively predicted by the values of dopamine-transporter binding of the right caudate and putamen. We conclude that striatal dopaminergic activity plays an important role in the transfer of visuomotor skills.

Advance cueing produces enhanced action-boundary patterns of spike activity in the sensorimotor striatum

PubMed Central

Barnes, Terra D.; Mao, Jian-Bin; Hu, Dan; Kubota, Yasuo; Dreyer, Anna A.; Stamoulis, Catherine; Brown, Emery N.

2011-01-01

One of the most characteristic features of habitual behaviors is that they can be evoked by a single cue. In the experiments reported here, we tested for the effects of such advance cueing on the firing patterns of striatal neurons in the sensorimotor striatum. Rats ran in a T-maze with instruction cues about the location of reward given at the start of the runs. This advance cueing about reward produced a highly augmented task-bracketing pattern of activity at the beginning and end of procedural task performance relative to the patterns found previously with midtask cueing. Remarkably, the largest increase in activity early during the T-maze runs was not associated with the instruction cues themselves, the earliest predictors of reward; instead, the highest peak of early activity was associated with the beginning of the motor period of the task. We suggest that the advance cueing, reducing midrun demands for decision making but adding a working-memory load, facilitated chunking of the maze runs as executable scripts anchored to sensorimotor aspects of the task and unencumbered by midtask decision-making demands. Our findings suggest that the acquisition of stronger task-bracketing patterns of striatal activity in the sensorimotor striatum could reflect this enhancement of behavioral chunking. Deficits in such representations of learned sequential behaviors could contribute to motor and cognitive problems in a range of neurological disorders affecting the basal ganglia, including Parkinson's disease. PMID:21307317

Condition interference in rats performing a choice task with switched variable- and fixed-reward conditions.

PubMed

Funamizu, Akihiro; Ito, Makoto; Doya, Kenji; Kanzaki, Ryohei; Takahashi, Hirokazu

2015-01-01

Because humans and animals encounter various situations, the ability to adaptively decide upon responses to any situation is essential. To date, however, decision processes and the underlying neural substrates have been investigated under specific conditions; thus, little is known about how various conditions influence one another in these processes. In this study, we designed a binary choice task with variable- and fixed-reward conditions and investigated neural activities of the prelimbic cortex and dorsomedial striatum in rats. Variable- and fixed-reward conditions induced flexible and inflexible behaviors, respectively; one of the two conditions was randomly assigned in each trial for testing the possibility of condition interference. Rats were successfully conditioned such that they could find the better reward holes of variable-reward-condition and fixed-reward-condition trials. A learning interference model, which updated expected rewards (i.e., values) used in variable-reward-condition trials on the basis of combined experiences of both conditions, better fit choice behaviors than conventional models which updated values in each condition independently. Thus, although rats distinguished the trial condition, they updated values in a condition-interference manner. Our electrophysiological study suggests that this interfering value-updating is mediated by the prelimbic cortex and dorsomedial striatum. First, some prelimbic cortical and striatal neurons represented the action-reward associations irrespective of trial conditions. Second, the striatal neurons kept tracking the values of variable-reward condition even in fixed-reward-condition trials, such that values were possibly interferingly updated even in the fixed-reward condition.

Work-based learning using action learning sets.

PubMed

Rosser, Elizabeth

2016-10-27

Elizabeth Rosser, Deputy Dean (Education and Professional Practice) and Professor of Nursing at Bournemouth University reflects on the concept of action learning, and the benefits of being part of an action learning set.

Enhancing Postgraduate Learning and Development: A Participatory Action Learning and Action Research Approach through Conferences

ERIC Educational Resources Information Center

Wood, Lesley; Louw, Ina; Zuber-Skerritt, Ortrun

2017-01-01

As supervisors who advocate the transformational potential of research both to generate theory and practical and emancipatory outcomes, we practice participatory action learning and action research (PALAR). This paper offers an illustrative case of how supervision practices based on action learning can foster emancipatory and lifelong learning…

Lacosamide protects striatal and hippocampal neurons from in vitro ischemia without altering physiological synaptic plasticity.

PubMed

Mazzocchetti, Petra; Tantucci, Michela; Bastioli, Guendalina; Calabrese, Valeria; Di Filippo, Massimiliano; Tozzi, Alessandro; Calabresi, Paolo; Costa, Cinzia

2018-06-01

Lacosamide ([(R)-2-acetamido-N-benzyl-3-methoxypropanamide], LCM), is an antiepileptic that exerts anticonvulsant activity by selectively enhancing slow sodium channel inactivation. By inhibiting seizures and neuronal excitability it might therefore be a good candidate to stabilize neurons and protect them from energetic insults. Using electrophysiological analyses, we have investigated in mice the possible neuroprotective effect of LCM against in vitro ischemia obtained by oxygen and glucose deprivation (ODG), in striatal and hippocampal tissues, two brain structures particularly susceptible to ischemic injury and of pivotal importance for different form of learning and memory. We also explored in these regions the influence of LCM on firing discharge and on long-term synaptic plasticity. We found that in both areas LCM reduced the neuronal firing activity in a use-dependent manner without influencing the physiological synaptic transmission, confirming its anticonvulsant effects. Moreover, we found that this AED is able to protect, in a dose dependent manner, striatal and hippocampal neurons from energy metabolism failure produced by OGD. This neuroprotective effect does not imply impairment of long-term potentiation of striatal and hippocampal synapses and suggests that LCM might exert additional beneficial therapeutic effects beyond its use as antiepileptic. Copyright © 2018 Elsevier Ltd. All rights reserved.

Striatal dopamine D2/3 receptor regulation by stress inoculation in squirrel monkeys.

PubMed

Lee, Alex G; Nechvatal, Jordan M; Shen, Bin; Buckmaster, Christine L; Levy, Michael J; Chin, Frederick T; Schatzberg, Alan F; Lyons, David M

2016-06-01

Intermittent mildly stressful situations provide opportunities to learn, practice, and improve coping in a process called stress inoculation. Stress inoculation also enhances cognitive control and response inhibition of impulsive motivated behavior. Cognitive control and motivation have been linked to striatal dopamine D2 and/or D3 receptors (DRD2/3) in rodents, monkeys, and humans. Here, we study squirrel monkeys randomized early in life to stress inoculation with or without maternal companionship and a no-stress control treatment condition. Striatal DRD2/3 availability in adulthood was measured in vivo by [ 11 C]raclopride binding using positron emission tomography (PET). DRD2/3 availability was greater in caudate and putamen compared to ventral striatum as reported in PET studies of humans and other non-human primates. DRD2/3 availability in ventral striatum was also consistently greater in stress inoculated squirrel monkeys compared to no-stress controls. Squirrel monkeys exposed to stress inoculation in the presence of their mother did not differ from squirrel monkeys exposed to stress inoculation without maternal companionship. Similar effects in different social contexts extend the generality of our findings and together suggest that stress inoculation increases striatal DRD2/3 availability as a correlate of cognitive control in squirrel monkeys.

Histidine-decarboxylase knockout mice show deficient nonreinforced episodic object memory, improved negatively reinforced water-maze performance, and increased neo- and ventro-striatal dopamine turnover.

PubMed

Dere, Ekrem; De Souza-Silva, Maria A; Topic, Bianca; Spieler, Richard E; Haas, Helmut L; Huston, Joseph P

2003-01-01

The brain's histaminergic system has been implicated in hippocampal synaptic plasticity, learning, and memory, as well as brain reward and reinforcement. Our past pharmacological and lesion studies indicated that the brain's histamine system exerts inhibitory effects on the brain's reinforcement respective reward system reciprocal to mesolimbic dopamine systems, thereby modulating learning and memory performance. Given the close functional relationship between brain reinforcement and memory processes, the total disruption of brain histamine synthesis via genetic disruption of its synthesizing enzyme, histidine decarboxylase (HDC), in the mouse might have differential effects on learning dependent on the task-inherent reinforcement contingencies. Here, we investigated the effects of an HDC gene disruption in the mouse in a nonreinforced object exploration task and a negatively reinforced water-maze task as well as on neo- and ventro-striatal dopamine systems known to be involved in brain reward and reinforcement. Histidine decarboxylase knockout (HDC-KO) mice had higher dihydrophenylacetic acid concentrations and a higher dihydrophenylacetic acid/dopamine ratio in the neostriatum. In the ventral striatum, dihydrophenylacetic acid/dopamine and 3-methoxytyramine/dopamine ratios were higher in HDC-KO mice. Furthermore, the HDC-KO mice showed improved water-maze performance during both hidden and cued platform tasks, but deficient object discrimination based on temporal relationships. Our data imply that disruption of brain histamine synthesis can have both memory promoting and suppressive effects via distinct and independent mechanisms and further indicate that these opposed effects are related to the task-inherent reinforcement contingencies.

The mouse cortico-striatal projectome

PubMed Central

Hintiryan, Houri; Foster, Nicholas N.; Bowman, Ian; Bay, Maxwell; Song, Monica Y.; Gou, Lin; Yamashita, Seita; Bienkowski, Michael S.; Zingg, Brian; Zhu, Muye; Yang, X. William; Shih, Jean C.; Toga, Arthur W.; Dong, Hong-Wei

2017-01-01

Different cortical areas are organized into distinct intra-cortical subnetworks. How descending pathways from the entire cortex interact subcortically as a network remains unclear. Here, we report an open-access comprehensive mesoscale cortico-striatal projectome—a detailed connectivity projection map from the entire cerebral cortex to the dorsal striatum or caudoputamen (CP) in rodents. Based on these projections, we use novel computational neuroanatomical tools to identify 29 distinct functional striatal domains. Further, we characterize different cortico-striatal networks and how they reconfigure across the rostral-caudal extent of the CP. The workflow was also applied to select cortico-striatal connections in two different mouse models of disconnection syndromes to demonstrate its utility in characterizing circuitry-specific connectopathies. Together, this work provides the structural basis for studying the functional diversity of the dorsal striatum and disruptions of cortico-basal ganglia networks across a broad range of disorders. PMID:27322419

A Bayesian Developmental Approach to Robotic Goal-Based Imitation Learning.

PubMed

Chung, Michael Jae-Yoon; Friesen, Abram L; Fox, Dieter; Meltzoff, Andrew N; Rao, Rajesh P N

2015-01-01

A fundamental challenge in robotics today is building robots that can learn new skills by observing humans and imitating human actions. We propose a new Bayesian approach to robotic learning by imitation inspired by the developmental hypothesis that children use self-experience to bootstrap the process of intention recognition and goal-based imitation. Our approach allows an autonomous agent to: (i) learn probabilistic models of actions through self-discovery and experience, (ii) utilize these learned models for inferring the goals of human actions, and (iii) perform goal-based imitation for robotic learning and human-robot collaboration. Such an approach allows a robot to leverage its increasing repertoire of learned behaviors to interpret increasingly complex human actions and use the inferred goals for imitation, even when the robot has very different actuators from humans. We demonstrate our approach using two different scenarios: (i) a simulated robot that learns human-like gaze following behavior, and (ii) a robot that learns to imitate human actions in a tabletop organization task. In both cases, the agent learns a probabilistic model of its own actions, and uses this model for goal inference and goal-based imitation. We also show that the robotic agent can use its probabilistic model to seek human assistance when it recognizes that its inferred actions are too uncertain, risky, or impossible to perform, thereby opening the door to human-robot collaboration.

A Bayesian Developmental Approach to Robotic Goal-Based Imitation Learning

PubMed Central

Chung, Michael Jae-Yoon; Friesen, Abram L.; Fox, Dieter; Meltzoff, Andrew N.; Rao, Rajesh P. N.

2015-01-01

A fundamental challenge in robotics today is building robots that can learn new skills by observing humans and imitating human actions. We propose a new Bayesian approach to robotic learning by imitation inspired by the developmental hypothesis that children use self-experience to bootstrap the process of intention recognition and goal-based imitation. Our approach allows an autonomous agent to: (i) learn probabilistic models of actions through self-discovery and experience, (ii) utilize these learned models for inferring the goals of human actions, and (iii) perform goal-based imitation for robotic learning and human-robot collaboration. Such an approach allows a robot to leverage its increasing repertoire of learned behaviors to interpret increasingly complex human actions and use the inferred goals for imitation, even when the robot has very different actuators from humans. We demonstrate our approach using two different scenarios: (i) a simulated robot that learns human-like gaze following behavior, and (ii) a robot that learns to imitate human actions in a tabletop organization task. In both cases, the agent learns a probabilistic model of its own actions, and uses this model for goal inference and goal-based imitation. We also show that the robotic agent can use its probabilistic model to seek human assistance when it recognizes that its inferred actions are too uncertain, risky, or impossible to perform, thereby opening the door to human-robot collaboration. PMID:26536366

Learning temporal statistics for sensory predictions in mild cognitive impairment.

PubMed

Di Bernardi Luft, Caroline; Baker, Rosalind; Bentham, Peter; Kourtzi, Zoe

2015-08-01

Training is known to improve performance in a variety of perceptual and cognitive skills. However, there is accumulating evidence that mere exposure (i.e. without supervised training) to regularities (i.e. patterns that co-occur in the environment) facilitates our ability to learn contingencies that allow us to interpret the current scene and make predictions about future events. Recent neuroimaging studies have implicated fronto-striatal and medial temporal lobe brain regions in the learning of spatial and temporal statistics. Here, we ask whether patients with mild cognitive impairment due to Alzheimer's disease (MCI-AD) that are characterized by hippocampal dysfunction are able to learn temporal regularities and predict upcoming events. We tested the ability of MCI-AD patients and age-matched controls to predict the orientation of a test stimulus following exposure to sequences of leftwards or rightwards orientated gratings. Our results demonstrate that exposure to temporal sequences without feedback facilitates the ability to predict an upcoming stimulus in both MCI-AD patients and controls. However, our fMRI results demonstrate that MCI-AD patients recruit an alternate circuit to hippocampus to succeed in learning of predictive structures. In particular, we observed stronger learning-dependent activations for structured sequences in frontal, subcortical and cerebellar regions for patients compared to age-matched controls. Thus, our findings suggest a cortico-striatal-cerebellar network that may mediate the ability for predictive learning despite hippocampal dysfunction in MCI-AD. Copyright © 2015 Elsevier Ltd. All rights reserved.

Frequent ice cream consumption is associated with reduced striatal response to receipt of an ice cream–based milkshake123

PubMed Central

Stice, Eric

2012-01-01

Background: Weight gain leads to reduced reward-region responsivity to energy-dense food receipt, and consumption of an energy-dense diet compared with an isocaloric, low-energy-density diet leads to reduced dopamine receptors. Furthermore, phasic dopamine signaling to palatable food receipt decreases after repeated intake of that food, which collectively suggests that frequent intake of an energy-dense food may reduce striatal response to receipt of that food. Objective: We tested the hypothesis that frequent ice cream consumption would be associated with reduced activation in reward-related brain regions (eg, striatum) in response to receipt of an ice cream–based milkshake and examined the influence of adipose tissue and the specificity of this relation. Design: Healthy-weight adolescents (n = 151) underwent fMRI during receipt of a milkshake and during receipt of a tasteless solution. Percentage body fat, reported food intake, and food craving and liking were assessed. Results: Milkshake receipt robustly activated the striatal regions, yet frequent ice cream consumption was associated with a reduced response to milkshake receipt in these reward-related brain regions. Percentage body fat, total energy intake, percentage of energy from fat and sugar, and intake of other energy-dense foods were not related to the neural response to milkshake receipt. Conclusions: Our results provide novel evidence that frequent consumption of ice cream, independent of body fat, is related to a reduction in reward-region responsivity in humans, paralleling the tolerance observed in drug addiction. Data also imply that intake of a particular energy-dense food results in attenuated reward-region responsivity specifically to that food, which suggests that sensory aspects of eating and reward learning may drive the specificity. PMID:22338036

Frequent ice cream consumption is associated with reduced striatal response to receipt of an ice cream-based milkshake.

PubMed

Burger, Kyle S; Stice, Eric

2012-04-01

Weight gain leads to reduced reward-region responsivity to energy-dense food receipt, and consumption of an energy-dense diet compared with an isocaloric, low-energy-density diet leads to reduced dopamine receptors. Furthermore, phasic dopamine signaling to palatable food receipt decreases after repeated intake of that food, which collectively suggests that frequent intake of an energy-dense food may reduce striatal response to receipt of that food. We tested the hypothesis that frequent ice cream consumption would be associated with reduced activation in reward-related brain regions (eg, striatum) in response to receipt of an ice cream-based milkshake and examined the influence of adipose tissue and the specificity of this relation. Healthy-weight adolescents (n = 151) underwent fMRI during receipt of a milkshake and during receipt of a tasteless solution. Percentage body fat, reported food intake, and food craving and liking were assessed. Milkshake receipt robustly activated the striatal regions, yet frequent ice cream consumption was associated with a reduced response to milkshake receipt in these reward-related brain regions. Percentage body fat, total energy intake, percentage of energy from fat and sugar, and intake of other energy-dense foods were not related to the neural response to milkshake receipt. Our results provide novel evidence that frequent consumption of ice cream, independent of body fat, is related to a reduction in reward-region responsivity in humans, paralleling the tolerance observed in drug addiction. Data also imply that intake of a particular energy-dense food results in attenuated reward-region responsivity specifically to that food, which suggests that sensory aspects of eating and reward learning may drive the specificity.

Modulation of acetylcholine release from rat striatal slices by the GABA/benzodiazepine receptor complex

DOE Office of Scientific and Technical Information (OSTI.GOV)

Supavilai, P.; Karobath, M.

1985-02-04

GABA, THIP and muscimol enhance spontaneous and inhibit electrically induced release of tritium labelled compounds from rat striatal slices which have been pre-labelled with /sup 3/H-choline. Baclofen is inactive in this model. Muscimol can inhibit electrically induced release of tritiated material by approximately 75% with half maximal effects at 2 ..mu..M. The response to muscimol can be blocked by the GABA antagonists bicuculline methobromide, picrotoxin, anisatin, R 5135 and CPTBO (cyclopentylbicyclophosphate). Drugs which act on the benzodiazepine receptor (BR) require the presence of muscimol to be effective and they modulate the effects of muscimol in a bidirectional manner. Thus BRmore » agonists enhance and inverse BR agonists attenuate the inhibitory effects of muscimol on electrically induced release. Ro15-1788, a BR antagonist, does not modulate the inhibitory effects of muscimol but antagonizes the actions of clonazepam, a BR agonist, and of DMCM, an inverse BR agonist. These results demonstrate that a GABA/benzodiazepine receptor complex can modulate acetylcholine release from rat striatal slices in vitro. 24 references, 3 figures, 5 table.« less

Place-Based Learning: Action Learning in MA Program for Educational Practitioners

ERIC Educational Resources Information Center

Glassner, Amnon; Eran-Zoran, Yael

2016-01-01

The study presents a new pedagogical idea and practice for educational practitioners. The practice was developed as a workshop of MA program in order to change and expand the meaning of education for the wellbeing of the community. The "place-based learning" workshop combined action learning (AL) with project-based learning (PBL). The…

Methamphetamine protects against MPTP neurotoxicity in C57BL mice.

PubMed

Sziráki, I; Kardos, V; Patthy, M; Pátfalusi, M; Budai, G

1994-01-14

Methamphetamine (5 mg/kg) administered 30 min prior to each injection with 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP) (3 x 30 mg/kg, at 24 h intervals) prevents the reduction of striatal levels of dopamine and its metabolites in C57BL mice. Methamphetamine and amphetamine inhibit the uptake of 1-methyl-4-phenylpyridinium (MPP+) by striatal synaptosomes of rats. A 30-min post-treatment with methamphetamine or amphetamine also prevents the MPTP-induced dopamine depletion, suggesting that their protective effect is related to the blockade of MPP+ uptake into dopaminergic neurons. Since amphetamine and methamphetamine are themselves neurotoxins at higher doses, this work demonstrated the protection against the actions of one neurotoxin by the administration of another.

The common inhaled anesthetic isoflurane increases aggregation of huntingtin and alters calcium homeostasis in a cell model of Huntington's disease

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wang Qiujun; Department of Anesthesiology, The Third Clinical Hospital, Hebei Medical University, Shijiazhuang, Hebei 050051; Liang Ge

2011-02-01

Isoflurane is known to increase {beta}-amyloid aggregation and neuronal damage. We hypothesized that isoflurane will have similar effects on the polyglutamine huntingtin protein and will cause alterations in intracellular calcium homeostasis. We tested this hypothesis in striatal cells from the expanded glutamine huntingtin knock-in mouse (STHdh{sup Q111/Q111}) and wild type (STHdh{sup Q7/Q7}) striatal neurons. The primary cultured neurons were exposed for 24 h to equipotent concentrations of isoflurane, sevoflurane, and desflurane in the presence or absence of extracellular calcium and with or without xestospongin C, a potent endoplasmic reticulum inositol 1,4,5-trisphosphate (InsP{sub 3}) receptor antagonist. Aggregation of huntingtin protein, cellmore » viability, and calcium concentrations were measured. Isoflurane, sevoflurane, and desflurane all increased the aggregation of huntingtin in STHdh{sup Q111/Q111} cells, with isoflurane having the largest effect. Isoflurane induced greater calcium release from the ER and relatively more cell damage in the STHdh{sup Q111/Q111} huntingtin cells than in the wild type STHdh{sup Q7/Q7} striatal cells. However, sevoflurane and desflurane caused less calcium release from the ER and less cell damage. Xestospongin C inhibited the isoflurane-induced calcium release from the ER, aggregation of huntingtin, and cell damage in the STHdh{sup Q111/Q111} cells. In summary, the Q111 form of huntingtin increases the vulnerability of striatal neurons to isoflurane neurotoxicity through combined actions on the ER IP{sub 3} receptors. Calcium release from the ER contributes to the anesthetic induced huntingtin aggregation in STHdh{sup Q111/Q111} striatal cells.« less

The newly synthesized pool of dopamine determines the severity of methamphetamine-induced neurotoxicity.

PubMed

Thomas, David M; Francescutti-Verbeem, Dina M; Kuhn, Donald M

2008-05-01

The neurotransmitter dopamine (DA) has long been implicated as a participant in the neurotoxicity caused by methamphetamine (METH), yet, its mechanism of action in this regard is not fully understood. Treatment of mice with the tyrosine hydroxylase (TH) inhibitor alpha-methyl-p-tyrosine (AMPT) lowers striatal cytoplasmic DA content by 55% and completely protects against METH-induced damage to DA nerve terminals. Reserpine, by disrupting vesicle amine storage, depletes striatal DA by more than 95% and accentuates METH-induced neurotoxicity. l-DOPA reverses the protective effect of AMPT against METH and enhances neurotoxicity in animals with intact TH. Inhibition of MAO-A by clorgyline increases pre-synaptic DA content and enhances METH striatal neurotoxicity. In all conditions of altered pre-synaptic DA homeostasis, increases or decreases in METH neurotoxicity paralleled changes in striatal microglial activation. Mice treated with AMPT, l-DOPA, or clorgyline + METH developed hyperthermia to the same extent as animals treated with METH alone, whereas mice treated with reserpine + METH were hypothermic, suggesting that the effects of alterations in cytoplasmic DA on METH neurotoxicity were not strictly mediated by changes in core body temperature. Taken together, the present data reinforce the notion that METH-induced release of DA from the newly synthesized pool of transmitter into the extracellular space plays an essential role in drug-induced striatal neurotoxicity and microglial activation. Subtle alterations in intracellular DA content can lead to significant enhancement of METH neurotoxicity. Our results also suggest that reactants derived from METH-induced oxidation of released DA may serve as neuronal signals that lead to microglial activation early in the neurotoxic process associated with METH.

Practicing What We Teach: Using Action Research to Learn about Teaching Action Research

ERIC Educational Resources Information Center

Brown, Barb; Dressler, Roswita; Eaton, Sarah Elaine; Jacobsen, Michele

2015-01-01

In this article, action research is explored as a process for instructor reflection, professional learning and collaboration. The context for the professional learning was the teaching of graduate level education courses in which action research, in conjunction with a cohort-based, collaboratory approach to learning, was used to facilitate…

Dose Dependent Dopaminergic Modulation of Reward-Based Learning in Parkinson's Disease

ERIC Educational Resources Information Center

van Wouwe, N. C.; Ridderinkhof, K. R.; Band, G. P. H.; van den Wildenberg, W. P. M.; Wylie, S. A.

2012-01-01

Learning to select optimal behavior in new and uncertain situations is a crucial aspect of living and requires the ability to quickly associate stimuli with actions that lead to rewarding outcomes. Mathematical models of reinforcement-based learning to select rewarding actions distinguish between (1) the formation of stimulus-action-reward…

Developing Results-Based Leadership Attributes and Team Cohesiveness through Action Learning

ERIC Educational Resources Information Center

Troupe, David

2010-01-01

Those who develop leaders in manufacturing settings have little data that describe the usefulness of action learning as a method of developing leaders' abilities to improve results-based leadership attributes or perceptions about their team's cohesiveness. The two purposes of this study were to evaluate an action learning program with regards to…

From Movements to Actions: Two Mechanisms for Learning Action Sequences

ERIC Educational Resources Information Center

Endress, Ansgar D.; Wood, Justin N.

2011-01-01

When other individuals move, we interpret their movements as discrete, hierarchically-organized, goal-directed actions. However, the mechanisms that integrate visible movement features into actions are poorly understood. Here, we consider two sequence learning mechanisms--transitional probability-based (TP) and position-based encoding…

Unravelling the Intrinsic Functional Organization of the Human Striatum: A Parcellation and Connectivity Study Based on Resting-State fMRI

PubMed Central

Jung, Wi Hoon; Jang, Joon Hwan; Park, Jin Woo; Kim, Euitae; Goo, Eun-Hoe; Im, Oh-Soo; Kwon, Jun Soo

2014-01-01

As the main input hub of the basal ganglia, the striatum receives projections from the cerebral cortex. Many studies have provided evidence for multiple parallel corticostriatal loops based on the structural and functional connectivity profiles of the human striatum. A recent resting-state fMRI study revealed the topography of striatum by assigning each voxel in the striatum to its most strongly correlated cortical network among the cognitive, affective, and motor networks. However, it remains unclear what patterns of striatal parcellation would result from performing the clustering without subsequent assignment to cortical networks. Thus, we applied unsupervised clustering algorithms to parcellate the human striatum based on its functional connectivity patterns to other brain regions without any anatomically or functionally defined cortical targets. Functional connectivity maps of striatal subdivisions, identified through clustering analyses, were also computed. Our findings were consistent with recent accounts of the functional distinctions of the striatum as well as with recent studies about its functional and anatomical connectivity. For example, we found functional connections between dorsal and ventral striatal clusters and the areas involved in cognitive and affective processes, respectively, and between rostral and caudal putamen clusters and the areas involved in cognitive and motor processes, respectively. This study confirms prior findings, showing similar striatal parcellation patterns between the present and prior studies. Given such striking similarity, it is suggested that striatal subregions are functionally linked to cortical networks involving specific functions rather than discrete portions of cortical regions. Our findings also demonstrate that the clustering of functional connectivity patterns is a reliable feature in parcellating the striatum into anatomically and functionally meaningful subdivisions. The striatal subdivisions identified here may have important implications for understanding the relationship between corticostriatal dysfunction and various neurodegenerative and psychiatric disorders. PMID:25203441

Computational Psychiatry: towards a mathematically informed understanding of mental illness

PubMed Central

Huys, Quentin J M; Roiser, Jonathan P

2016-01-01

Computational Psychiatry aims to describe the relationship between the brain's neurobiology, its environment and mental symptoms in computational terms. In so doing, it may improve psychiatric classification and the diagnosis and treatment of mental illness. It can unite many levels of description in a mechanistic and rigorous fashion, while avoiding biological reductionism and artificial categorisation. We describe how computational models of cognition can infer the current state of the environment and weigh up future actions, and how these models provide new perspectives on two example disorders, depression and schizophrenia. Reinforcement learning describes how the brain can choose and value courses of actions according to their long-term future value. Some depressive symptoms may result from aberrant valuations, which could arise from prior beliefs about the loss of agency (‘helplessness’), or from an inability to inhibit the mental exploration of aversive events. Predictive coding explains how the brain might perform Bayesian inference about the state of its environment by combining sensory data with prior beliefs, each weighted according to their certainty (or precision). Several cortical abnormalities in schizophrenia might reduce precision at higher levels of the inferential hierarchy, biasing inference towards sensory data and away from prior beliefs. We discuss whether striatal hyperdopaminergia might have an adaptive function in this context, and also how reinforcement learning and incentive salience models may shed light on the disorder. Finally, we review some of Computational Psychiatry's applications to neurological disorders, such as Parkinson's disease, and some pitfalls to avoid when applying its methods. PMID:26157034

Ventral striatal dopamine reflects behavioral and neural signatures of model-based control during sequential decision making.

PubMed

Deserno, Lorenz; Huys, Quentin J M; Boehme, Rebecca; Buchert, Ralph; Heinze, Hans-Jochen; Grace, Anthony A; Dolan, Raymond J; Heinz, Andreas; Schlagenhauf, Florian

2015-02-03

Dual system theories suggest that behavioral control is parsed between a deliberative "model-based" and a more reflexive "model-free" system. A balance of control exerted by these systems is thought to be related to dopamine neurotransmission. However, in the absence of direct measures of human dopamine, it remains unknown whether this reflects a quantitative relation with dopamine either in the striatum or other brain areas. Using a sequential decision task performed during functional magnetic resonance imaging, combined with striatal measures of dopamine using [(18)F]DOPA positron emission tomography, we show that higher presynaptic ventral striatal dopamine levels were associated with a behavioral bias toward more model-based control. Higher presynaptic dopamine in ventral striatum was associated with greater coding of model-based signatures in lateral prefrontal cortex and diminished coding of model-free prediction errors in ventral striatum. Thus, interindividual variability in ventral striatal presynaptic dopamine reflects a balance in the behavioral expression and the neural signatures of model-free and model-based control. Our data provide a novel perspective on how alterations in presynaptic dopamine levels might be accompanied by a disruption of behavioral control as observed in aging or neuropsychiatric diseases such as schizophrenia and addiction.

Own-gender imitation activates the brain's reward circuitry

PubMed Central

Iacoboni, Macro; Martin, Alia; Dapretto, Mirella

2012-01-01

Imitation is an important component of human social learning throughout life. Theoretical models and empirical data from anthropology and psychology suggest that people tend to imitate self-similar individuals, and that such imitation biases increase the adaptive value (e.g., self-relevance) of learned information. It is unclear, however, what neural mechanisms underlie people's tendency to imitate those similar to themselves. We focused on the own-gender imitation bias, a pervasive bias thought to be important for gender identity development. While undergoing fMRI, participants imitated own- and other-gender actors performing novel, meaningless hand signs; as control conditions, they also simply observed such actions and viewed still portraits of the same actors. Only the ventral and dorsal striatum, orbitofrontal cortex and amygdala were more active when imitating own- compared to other-gender individuals. A Bayesian analysis of the BrainMap neuroimaging database demonstrated that the striatal region preferentially activated by own-gender imitation is selectively activated by classical reward tasks in the literature. Taken together, these findings reveal a neurobiological mechanism associated with the own-gender imitation bias and demonstrate a novel role of reward-processing neural structures in social behavior. PMID:22383803

Social stress reactivity alters reward and punishment learning

PubMed Central

Frank, Michael J.; Allen, John J. B.

2011-01-01

To examine how stress affects cognitive functioning, individual differences in trait vulnerability (punishment sensitivity) and state reactivity (negative affect) to social evaluative threat were examined during concurrent reinforcement learning. Lower trait-level punishment sensitivity predicted better reward learning and poorer punishment learning; the opposite pattern was found in more punishment sensitive individuals. Increasing state-level negative affect was directly related to punishment learning accuracy in highly punishment sensitive individuals, but these measures were inversely related in less sensitive individuals. Combined electrophysiological measurement, performance accuracy and computational estimations of learning parameters suggest that trait and state vulnerability to stress alter cortico-striatal functioning during reinforcement learning, possibly mediated via medio-frontal cortical systems. PMID:20453038

Social stress reactivity alters reward and punishment learning.

PubMed

Cavanagh, James F; Frank, Michael J; Allen, John J B

2011-06-01

To examine how stress affects cognitive functioning, individual differences in trait vulnerability (punishment sensitivity) and state reactivity (negative affect) to social evaluative threat were examined during concurrent reinforcement learning. Lower trait-level punishment sensitivity predicted better reward learning and poorer punishment learning; the opposite pattern was found in more punishment sensitive individuals. Increasing state-level negative affect was directly related to punishment learning accuracy in highly punishment sensitive individuals, but these measures were inversely related in less sensitive individuals. Combined electrophysiological measurement, performance accuracy and computational estimations of learning parameters suggest that trait and state vulnerability to stress alter cortico-striatal functioning during reinforcement learning, possibly mediated via medio-frontal cortical systems.

Modafinil evokes striatal [(3)H]dopamine release and alters the subjective properties of stimulants.

PubMed

Dopheide, Marsha M; Morgan, Russell E; Rodvelt, Kelli R; Schachtman, Todd R; Miller, Dennis K

2007-07-30

Modafinil is a mild psychostimulant used for the treatment of sleep and arousal-related disorders, and has been considered a pharmacotherapy for cocaine and amphetamine dependence; however, modafinil's mechanism of action is largely unclear. The present study investigated modafinil using drug discrimination and slice superfusion techniques. Rats were trained to discriminate cocaine (1.6 or 5 mg/kg) or amphetamine (0.3 mg/kg) from saline injection for food reinforcement. Modafinil (64-128 mg/kg) substituted partially for both cocaine doses and amphetamine. Pretreatment with a lower modafinil dose (32 mg/kg) augmented the discriminative stimulus properties of cocaine (1.6 mg/kg dose group) and amphetamine. In neurochemical experiments, modafinil (100-300 microM) evoked [(3)H]overflow from rat striatal slices preloaded with [(3)H]dopamine in a concentration-dependent manner; however, modafinil was less potent and efficacious than amphetamine and nicotine. The dopamine transporter inhibitor nomifensine (10 microM) blocked modafinil-evoked [(3)H]overflow, and concentrations of modafinil (<100 microM) that did not have intrinsic activity attenuated amphetamine (1 and 3 microM)-evoked [(3)H]overflow. Modafinil-evoked [(3)H]overflow was not altered by the nicotinic acetylcholine receptor antagonist mecamylamine, and modafinil did not alter nicotine-evoked [(3)H]overflow, indicating that nicotinic acetylcholine receptors likely are not important for modafinil's mechanism of action. The present results indicate that modafinil evokes dopamine release from striatal neurons and is a psychostimulant that is pharmacologically similar to, but much less potent and efficacious than, amphetamine.

Perceptual alternation in obsessive compulsive disorder--implications for a role of the cortico-striatal circuitry in mediating awareness.

PubMed

Li, C S; Chen, M C; Yang, Y Y; Chang, H L; Liu, C Y; Shen, S; Chen, C Y

2000-06-15

Mounting evidence suggests that obsessive compulsive disorder (OCD) results from functional aberrations of the fronto-striatal circuitry. However, empirical studies of the behavioral manifestations of OCD have been relatively lacking. The present study employs a behavioral task that allows a quantitative measure of how alternative percepts are formed from one moment to another, a process mimicking the brain state in which different thoughts and imageries compete for access to awareness. Eighteen patients with OCD, 12 with generalized anxiety disorder, and 18 normal subjects participated in the experiment, in which they viewed one of the three Schröder staircases and responded by pressing a key to each perceptual reversal. The results demonstrate that the patients with OCD have a higher perceptual alternation rate than the normal controls. Moreover, the frequency of perceptual alternation is significantly correlated with the Yale-Brown obsessive compulsive and the Hamilton anxiety scores. The increase in the frequency of perceptual reversals cannot easily be accounted for by learning or by different patterns of eye fixations on the task. These results provide further evidence that an impairment of the inhibitory function of the cortico-striatal circuitry might underlie the etiology of OCD. The implications of the results for a general role of the cortico-striatal circuitry in mediating awareness are discussed.

Positive and negative feedback learning and associated dopamine and serotonin transporter binding after methamphetamine.

PubMed

Stolyarova, Alexandra; O'Dell, Steve J; Marshall, John F; Izquierdo, Alicia

2014-09-01

Learning from mistakes and prospectively adjusting behavior in response to reward feedback is an important facet of performance monitoring. Dopamine (DA) pathways play an important role in feedback learning and a growing literature has also emerged on the importance of serotonin (5HT) in reward learning, particularly during punishment or reward omission (negative feedback). Cognitive impairments resulting from psychostimulant exposure may arise from altered patterns in feedback learning, which in turn may be modulated by DA and 5HT transmission. We analyzed long-term, off-drug changes in learning from positive and negative feedback and associated striatal DA transporter (DAT) and frontocortical 5HT transporter (SERT) binding in rats pretreated with methamphetamine (mAMPH). Specifically, we assessed the reversal phase of pairwise visual discrimination learning in rats receiving single dose- (mAMPHsingle) vs. escalating-dose exposure (mAMPHescal). Using fine-grained trial-by-trial analyses, we found increased sensitivity to and reliance on positive feedback in mAMPH-pretreated animals, with the mAMPHsingle group showing more pronounced use of this type of feedback. In contrast, overall negative feedback sensitivity was not altered following any mAMPH treatment. In addition to validating the enduring effects of mAMPH on early reversal learning, we found more consecutive error commissions before the first correct response in mAMPH-pretreated rats. This behavioral rigidity was negatively correlated with subregional frontocortical SERT whereas positive feedback sensitivity negatively correlated with striatal DAT binding. These results provide new evidence for the overlapping, yet dissociable roles of DA and 5HT systems in overcoming perseveration and in learning new reward rules. Copyright © 2014 Elsevier B.V. All rights reserved.

How glitter relates to gold: similarity-dependent reward prediction errors in the human striatum.

PubMed

Kahnt, Thorsten; Park, Soyoung Q; Burke, Christopher J; Tobler, Philippe N

2012-11-14

Optimal choices benefit from previous learning. However, it is not clear how previously learned stimuli influence behavior to novel but similar stimuli. One possibility is to generalize based on the similarity between learned and current stimuli. Here, we use neuroscientific methods and a novel computational model to inform the question of how stimulus generalization is implemented in the human brain. Behavioral responses during an intradimensional discrimination task showed similarity-dependent generalization. Moreover, a peak shift occurred, i.e., the peak of the behavioral generalization gradient was displaced from the rewarded conditioned stimulus in the direction away from the unrewarded conditioned stimulus. To account for the behavioral responses, we designed a similarity-based reinforcement learning model wherein prediction errors generalize across similar stimuli and update their value. We show that this model predicts a similarity-dependent neural generalization gradient in the striatum as well as changes in responding during extinction. Moreover, across subjects, the width of generalization was negatively correlated with functional connectivity between the striatum and the hippocampus. This result suggests that hippocampus-striatal connections contribute to stimulus-specific value updating by controlling the width of generalization. In summary, our results shed light onto the neurobiology of a fundamental, similarity-dependent learning principle that allows learning the value of stimuli that have never been encountered.

The effects of endomorphins and diprotin A on striatal dopamine release induced by electrical stimulation-an in vitro superfusion study in rats.

PubMed

Bagosi, Zsolt; Jászberényi, Miklós; Bujdosó, Erika; Szabó, Gyula; Telegdy, Gyula

2006-12-01

The endomorphins (EM1: Tyr-Pro-Trp-Phe-NH2, and EM2: Tyr-Pro-Phe-Phe-NH2) are recently discovered endogenous ligands for mu-opioid receptors (MORs) with role of neurotransmitters or neuromodulators in mammals. Cessation of their physiological action may be effected through rapid enzymatic degradation by the dipeptidyl-peptidase IV (DPPIV) found in the brain synaptic membranes. An in vitro superfusion system was utilized to investigate the actions of EM1, EM2 and specific DPPIV inhibitor diprotin A on the striatal release of dopamine (DA) induced by electrical stimulation in rats. The involvement of the different MORs (MOR1 and MOR2) in this process was studied by pretreatment with MOR antagonists beta-funaltrexamine (a MOR1 and MOR2 antagonist) and naloxonazine (a MOR1 antagonist). EM1 significantly increased the tritium-labelled dopamine DA release induced by electrical stimulation. EM2 was effective only when the slices were pretreated with diprotin A. beta-Funaltrexamine antagonized the stimulatory effects of both EM1 and EM2. The administration of naloxonazine did not appreciably influence the action of EM1, but blocked the action of EM2, at least when the slices were pretreated with diprotin A. These data suggest that both EM1 and EM2 increase DA release from the striatum and, though diprotin A does not affect the action of EM1, it inhibits the enzymatic degradation of EM2. The DA-stimulating action induced by EM1 seems to be mediated by MOR2, while that evoked by EM2 appears to be transmitted by MOR1.

Multi-agent Reinforcement Learning Model for Effective Action Selection

NASA Astrophysics Data System (ADS)

Youk, Sang Jo; Lee, Bong Keun

Reinforcement learning is a sub area of machine learning concerned with how an agent ought to take actions in an environment so as to maximize some notion of long-term reward. In the case of multi-agent, especially, which state space and action space gets very enormous in compared to single agent, so it needs to take most effective measure available select the action strategy for effective reinforcement learning. This paper proposes a multi-agent reinforcement learning model based on fuzzy inference system in order to improve learning collect speed and select an effective action in multi-agent. This paper verifies an effective action select strategy through evaluation tests based on Robocop Keep away which is one of useful test-beds for multi-agent. Our proposed model can apply to evaluate efficiency of the various intelligent multi-agents and also can apply to strategy and tactics of robot soccer system.

Electrical high frequency stimulation in the dorsal striatum: Effects on response learning and on GABA levels in rats.

PubMed

Schumacher, Anett; de Vasconcelos, Anne Pereira; Lecourtier, Lucas; Moser, Andreas; Cassel, Jean-Christophe

2011-09-23

Electrical high frequency stimulation (HFS) has been used to treat various neurological and psychiatric diseases. The striatal area contributes to response learning and procedural memory. Therefore, we investigated the effect of striatal HFS application on procedural/declarative-like memory in rats. All rats were trained in a flooded Double-H maze for three days (4 trials/day) to swim to an escape platform hidden at a constant location. The starting place was the same for all trials. After each training session, HFS of the left dorsal striatum was performed over 4h in alternating 20 min periods (during rest time, 10a.m. to 3p.m.). Nineteen hours after the last HFS and right after a probe trial assessing the rats' strategy (procedural vs. declarative-like memory-based choice), animals were sacrificed and the dorsal striatum was quickly removed. Neurotransmitter levels were measured by HPLC. Stimulated rats did not differ from sham-operated and control rats in acquisition performance, but exhibited altered behavior during the probe trial (procedural memory responses being less frequent than in controls). In stimulated rats, GABA levels were significantly increased in the dorsal striatum on both sides. We suggest that HFS of the dorsal striatum does not alter learning behavior in rats but influences the strategy by which the rats solve the task. Given that the HFS-induced increase of GABA levels was found 19 h after stimulation, it can be assumed that HFS has consequences lasting for several hours and which are functionally significant at a behavioral level, at least under our stimulation (frequency, timing, location, side and strength of stimulation) and testing conditions. Copyright © 2011 Elsevier B.V. All rights reserved.

Corticostriatal-hypothalamic circuitry and food motivation: integration of energy, action and reward.

PubMed

Kelley, Ann E; Baldo, Brian A; Pratt, Wayne E; Will, Matthew J

2005-12-15

Work over the past decade has supported the idea that discrete aspects of appetitive motivation are differentially mediated by separate but interacting neurochemical systems within the nucleus accumbens (Acb). We review herein a series of studies in rats comparing the effects of manipulating Acb amino acid, opioid, acetylcholine, and dopamine systems on tests of free-feeding and food-reinforced operant responding. Results from our laboratory and in the literature support three general conclusions: (1) GABA output neurons localized exclusively within the Acb shell directly influence hypothalamic effector mechanisms for feeding motor patterns, but do not participate in the execution of more complex food-seeking strategies; (2) enkephalinergic neurons distributed throughout the Acb and caudate-putamen mediate the hedonic impact of palatable (high sugar/fat) foods, and these neurons are under modulatory control by striatal cholinergic interneurons; and (3) dopamine transmission in the Acb governs general motoric and arousal processes related to response selection and invigoration, as well as motor learning-related plasticity. These dissociations may reflect the manner in which these neurochemical systems differentially access pallido-thalamo-cortical loops reaching the voluntary motor system (in the case of opioids and dopamine), versus more restricted efferent connections to hypothalamic motor/autonomic control columns (in the case of Acb shell GABA and glutamate systems). Moreover, we hypothesize that while these systems work in tandem to coordinate the anticipatory and consummatory phases of feeding with hypothalamic energy-sensing substrates, the striatal opioid network evolved a specialized capacity to promote overeating of energy-dense foods beyond acute homeostatic needs, to ensure an energy reserve for potential future famine.

Dopamine and μ-opioid receptor dysregulation in the brains of binge-eating female rats - possible relevance in the psychopathology and treatment of binge-eating disorder.

PubMed

Heal, David J; Hallam, Michelle; Prow, Michael; Gosden, Jane; Cheetham, Sharon; Choi, Yong K; Tarazi, Frank; Hutson, Peter

2017-06-01

Adult, female rats given irregular, limited access to chocolate develop binge-eating behaviour with normal bodyweight and compulsive/perseverative and impulsive behaviours similar to those in binge-eating disorder. We investigated whether (a) dysregulated central nervous system dopaminergic and opioidergic systems are part of the psychopathology of binge-eating and (b) these neurotransmitter systems may mediate the actions of drugs ameliorating binge-eating disorder psychopathology. Binge-eating produced a 39% reduction of striatal D 1 receptors with 22% and 23% reductions in medial and lateral caudate putamen and a 22% increase of striatal μ-opioid receptors. There was no change in D 1 receptor density in nucleus accumbens, medial prefrontal cortex or dorsolateral frontal cortex, striatal D 2 receptors and dopamine reuptake transporter sites, or μ-opioid receptors in frontal cortex. There were no changes in ligand affinities. The concentrations of monoamines, metabolites and estimates of dopamine (dopamine/dihydroxyphenylacetic acid ratio) and serotonin/5-hydroxyindolacetic acid ratio turnover rates were unchanged in striatum and frontal cortex. However, turnover of dopamine and serotonin in the hypothalamus was increased ~20% and ~15%, respectively. Striatal transmission via D 1 receptors is decreased in binge-eating rats while μ-opioid receptor signalling may be increased. These changes are consistent with the attenuation of binge-eating by lisdexamfetamine, which increases catecholaminergic neurotransmission, and nalmefene, a μ-opioid antagonist.

Leadership Development through Virtual Action Learning: An Evaluation

ERIC Educational Resources Information Center

Aspinwall, Kath; Pedler, Mike; Radcliff, Phil

2018-01-01

This paper presents a case study based on the evaluation of the two VAL (virtual action learning) sets. We report participants learning both leadership and the VAL process based on the basis of telephone interviews. We conclude that what is learned about leadership is connected with how learning takes place and suggest that the content and process…

Detection of phasic dopamine by D1 and D2 striatal medium spiny neurons.

PubMed

Yapo, Cedric; Nair, Anu G; Clement, Lorna; Castro, Liliana R; Hellgren Kotaleski, Jeanette; Vincent, Pierre

2017-12-15

Brief dopamine events are critical actors of reward-mediated learning in the striatum; the intracellular cAMP-protein kinase A (PKA) response of striatal medium spiny neurons to such events was studied dynamically using a combination of biosensor imaging in mouse brain slices and in silico simulations. Both D1 and D2 medium spiny neurons can sense brief dopamine transients in the sub-micromolar range. While dopamine transients profoundly change cAMP levels in both types of medium spiny neurons, the PKA-dependent phosphorylation level remains unaffected in D2 neurons. At the level of PKA-dependent phosphorylation, D2 unresponsiveness depends on protein phosphatase-1 (PP1) inhibition by DARPP-32. Simulations suggest that D2 medium spiny neurons could detect transient dips in dopamine level. The phasic release of dopamine in the striatum determines various aspects of reward and action selection, but the dynamics of the dopamine effect on intracellular signalling remains poorly understood. We used genetically encoded FRET biosensors in striatal brain slices to quantify the effect of transient dopamine on cAMP or PKA-dependent phosphorylation levels, and computational modelling to further explore the dynamics of this signalling pathway. Medium-sized spiny neurons (MSNs), which express either D 1 or D 2 dopamine receptors, responded to dopamine by an increase or a decrease in cAMP, respectively. Transient dopamine showed similar sub-micromolar efficacies on cAMP in both D1 and D2 MSNs, thus challenging the commonly accepted notion that dopamine efficacy is much higher on D 2 than on D 1 receptors. However, in D2 MSNs, the large decrease in cAMP level triggered by transient dopamine did not translate to a decrease in PKA-dependent phosphorylation level, owing to the efficient inhibition of protein phosphatase 1 by DARPP-32. Simulations further suggested that D2 MSNs can also operate in a 'tone-sensing' mode, allowing them to detect transient dips in basal dopamine. Overall, our results show that D2 MSNs may sense much more complex patterns of dopamine than previously thought. © 2017 The Authors. The Journal of Physiology © 2017 The Physiological Society.

Action Learning and Executive Education: Achieving Credible Personal, Practitioner and Organisational Learning

ERIC Educational Resources Information Center

Stephens, Simon; Margey, Michael

2015-01-01

Action learning involves balancing the often conflicting forces between working knowledge and academic knowledge. This paper explores the experience of executive learners; academics and external contributors involved in action learning at the postgraduate level. The executive learners are members of cohorts on two masters programmes based in…

Improving Pedagogy through Action Learning and Scholarship of Teaching and Learning

ERIC Educational Resources Information Center

Albers, Cheryl

2008-01-01

This ASA Teaching Workshop explored the potential of Action Learning to use teachers' tacit knowledge to collaboratively confront pedagogical issues. The Action Learning model grows out of industrial management and is based on the notion that peers are a valuable resource for learning about how to solve the problems encountered in the workplace.…

Memory profiles in parents of patients with schizophrenia.

PubMed

Sitskoorn, Margriet M; Ebisch, Sjoerd J H; Appels, Melanie; Nuyen, Jasper; Kahn, René S

2004-08-30

Recent research shows that categorizing patients with schizophrenia based on frontal-striatal and frontal-temporal memory profiles may yield neurobiologically meaningful disease subtypes. We hypothesize that parents of patients exhibit similar memory profiles. Both parents of 36 patients with schizophrenia (N = 72) and 26 healthy married control couples (N = 52) participated in this study. All subjects were physically healthy and had no history of neurological illness or alcohol/drug abuse. The presence of a psychiatric and/or personality disorder was assessed with the Comprehensive Assessment of Symptoms and History (CASH) interview, the Schedule for Affective Disorders and Schizophrenia-lifetime (SADS-L) interview and the Structured Interview for DSM-IV Personality Disorders (SIDP-IV), respectively. Cluster analysis of selected measures from the Dutch version of the California Verbal Learning Test (CVLT) delineated parents into two subgroups with distinct memory deficits and a third subgroup without impairments. Specific frontal-striatal and frontal-temporal subgroups, however, were not found. In addition, our results indicated that mothers seem to be more protected against the negative effects of genetic liability to schizophrenia than fathers. Furthermore, relatives with a higher level of intelligence may have more cognitive reserve to compensate for the negative impact of implied brain dysfunction on verbal memory than relatives with a low level of intelligence. Although the parents of patients with schizophrenia could be delineated into subgroups with primary memory deficits, frontal-striatal and frontal-temporal subgroups could not be unambiguously identified. The association that emerged between level of intelligence, gender and severity of memory impairment deserves further exploration.

Emotional arousal and multiple memory systems in the mammalian brain

PubMed Central

Packard, Mark G.; Goodman, Jarid

2012-01-01

Emotional arousal induced by stress and/or anxiety can exert complex effects on learning and memory processes in mammals. Recent studies have begun to link study of the influence of emotional arousal on memory with earlier research indicating that memory is organized in multiple systems in the brain that differ in terms of the “type” of memory they mediate. Specifically, these studies have examined whether emotional arousal may have a differential effect on the “cognitive” and stimulus-response “habit” memory processes sub-served by the hippocampus and dorsal striatum, respectively. Evidence indicates that stress or the peripheral injection of anxiogenic drugs can bias animals and humans toward the use of striatal-dependent habit memory in dual-solution tasks in which both hippocampal and striatal-based strategies can provide an adequate solution. A bias toward the use of habit memory can also be produced by intra-basolateral amygdala (BLA) administration of anxiogenic drugs, consistent with the well documented role of efferent projections of this brain region in mediating the modulatory influence of emotional arousal on memory. In some learning situations, the bias toward the use of habit memory produced by emotional arousal appears to result from an impairing effect on hippocampus-dependent cognitive memory. Further research examining the neural mechanisms linking emotion and the relative use of multiple memory systems should prove useful in view of the potential role for maladaptive habitual behaviors in various human psychopathologies. PMID:22470324

Altered Cingulate Sub-Region Activation Accounts for Task-Related Dissociation in ERN Amplitude as a Function of Obsessive-Compulsive Symptoms

ERIC Educational Resources Information Center

Cavanagh, James F.; Grundler, Theo O. J.; Frank, Michael J.; Allen, John J. B.

2010-01-01

Larger error-related negativities (ERNs) have been consistently found in obsessive-compulsive disorder (OCD) patients, and are thought to reflect the activities of a hyperactive cortico-striatal circuit during action monitoring. We previously observed that obsessive-compulsive (OC) symptomatic students (non-patients) have larger ERNs during errors…

Antidepressants differentially affect striatal amphetamine-stimulated dopamine and serotonin release in rats with high and low novelty-oriented behaviour.

PubMed

O'Leary, Aet; Kõiv, Kadri; Raudkivi, Karita; Harro, Jaanus

2016-11-01

In the studies of depression pathogenesis and antidepressant action, the monoaminergic hypothesis of depression has mainly focused on the serotonergic and noradrenergic mechanisms. However, dopaminergic neurotransmission is also linked to both depressive symptomatology as well as antidepressant effects. We have previously shown that persistent inter-individual differences in the rat behavioural activity in novel environments is associated with differences in the striatal extracellular levels of dopamine and serotonin, depressive-like behaviour and the expression of several depression-related genes. The aim of the current study was to investigate the relative potency of the tricyclic antidepressant imipramine, the selective serotonin re-uptake inhibitor fluoxetine, and the selective noradrenaline re-uptake inhibitor reboxetine (all drugs administered in the dose of 10mg/kg, i.p.) to enhance amphetamine-stimulated dopamine and serotonin release in the striatum using in vivo microdialysis in awake, freely-moving rats, categorized into high explorers (HE) and low explorers (LE) based on their spontaneous novelty-oriented behaviour. The basal extracellular dopamine and serotonin concentration in the striatum did not differ between the LE- and HE-rats. None of the antidepressants alone were able to modify baseline striatal dopamine levels, but the amphetamine-stimulated dopamine release was significantly higher in the HE-rats after acute and chronic imipramine (but not fluoxetine or reboxetine). Acute imipramine and fluoxetine, but not reboxetine, increased both the basal and amphetamine-stimulated levels of serotonin in the striatum. Again, the HE-rats had higher amphetamine-stimulated serotonin release after fluoxetine administration. These findings suggest that rats with depressive-like phenotype are less sensitive to the neurochemical effects of antidepressants in the striatum. These results may have relevance in understanding the neurobiological bases for inter-individual differences in antidepressant treatment response in humans and development of novel medicines. Copyright © 2016 Elsevier Ltd. All rights reserved.

Dopamine-Dependent Compensation Maintains Motor Behavior in Mice with Developmental Ablation of Dopaminergic Neurons

PubMed Central

DeMaro, Joseph A.; Knoten, Amanda; Hoshi, Masato; Pehek, Elizabeth; Johnson, Eugene M.; Gereau, Robert W.

2013-01-01

The loss of dopaminergic neurons in the substantia nigra pars compacta (SNc) and consequent depletion of striatal dopamine are known to underlie the motor deficits observed in Parkinson's disease (PD). Adaptive changes in dopaminergic terminals and in postsynaptic striatal neurons can compensate for significant losses of striatal dopamine, resulting in preservation of motor behavior. In addition, compensatory changes independent of striatal dopamine have been proposed based on PD therapies that modulate nondopaminergic circuits within the basal ganglia. We used a genetic strategy to selectively destroy dopaminergic neurons in mice during development to determine the necessity of these neurons for the maintenance of normal motor behavior in adult and aged mice. We find that loss of 90% of SNc dopaminergic neurons and consequent depletion of >95% of striatal dopamine does not result in changes in motor behavior in young-adult or aged mice as evaluated by an extensive array of motor behavior tests. Treatment of aged mutant mice with the dopamine receptor antagonist haloperidol precipitated motor behavior deficits in aged mutant mice, indicating that <5% of striatal dopamine is sufficient to maintain motor function in these mice. We also found that mutant mice exhibit an exaggerated response to l-DOPA compared with control mice, suggesting that preservation of motor function involves sensitization of striatal dopamine receptors. Our results indicate that congenital loss of dopaminergic neurons induces remarkable adaptions in the nigrostriatal system where limited amounts of dopamine in the dorsal striatum can maintain normal motor function. PMID:24155314

DRD2 genotype-based variation of default mode network activity and of its relationship with striatal DAT binding.

PubMed

Sambataro, Fabio; Fazio, Leonardo; Taurisano, Paolo; Gelao, Barbara; Porcelli, Annamaria; Mancini, Marina; Sinibaldi, Lorenzo; Ursini, Gianluca; Masellis, Rita; Caforio, Grazia; Di Giorgio, Annabella; Niccoli-Asabella, Artor; Popolizio, Teresa; Blasi, Giuseppe; Bertolino, Alessandro

2013-01-01

The default mode network (DMN) comprises a set of brain regions with "increased" activity during rest relative to cognitive processing. Activity in the DMN is associated with functional connections with the striatum and dopamine (DA) levels in this brain region. A functional single-nucleotide polymorphism within the dopamine D2 receptor gene (DRD2, rs1076560 G > T) shifts splicing of the 2 D2 isoforms, D2 short and D2 long, and has been associated with striatal DA signaling as well as with cognitive processing. However, the effects of this polymorphism on DMN have not been explored. The aim of this study was to evaluate the effects of rs1076560 on DMN and striatal connectivity and on their relationship with striatal DA signaling. Twenty-eight subjects genotyped for rs1076560 underwent functional magnetic resonance imaging during a working memory task and 123 55 I-Fluoropropyl-2-beta-carbomethoxy-3-beta(4-iodophenyl) nortropan Single Photon Emission Computed Tomography ([(123)I]-FP-CIT SPECT) imaging (a measure of dopamine transporter [DAT] binding). Spatial group-independent component (IC) analysis was used to identify DMN and striatal ICs. Within the anterior DMN IC, GG subjects had relatively greater connectivity in medial prefrontal cortex (MPFC), which was directly correlated with striatal DAT binding. Within the posterior DMN IC, GG subjects had reduced connectivity in posterior cingulate relative to T carriers. Additionally, rs1076560 genotype predicted connectivity differences within a striatal network, and these changes were correlated with connectivity in MPFC and posterior cingulate within the DMN. These results suggest that genetically determined D2 receptor signaling is associated with DMN connectivity and that these changes are correlated with striatal function and presynaptic DA signaling.

DRD2 Genotype-Based Variation of Default Mode Network Activity and of Its Relationship With Striatal DAT Binding

PubMed Central

Sambataro, Fabio; Fazio, Leonardo; Taurisano, Paolo; Gelao, Barbara; Porcelli, Annamaria; Mancini, Marina; Sinibaldi, Lorenzo; Ursini, Gianluca; Masellis, Rita; Caforio, Grazia; Di Giorgio, Annabella; Niccoli-Asabella, Artor; Popolizio, Teresa; Blasi, Giuseppe; Bertolino, Alessandro

2013-01-01

The default mode network (DMN) comprises a set of brain regions with “increased” activity during rest relative to cognitive processing. Activity in the DMN is associated with functional connections with the striatum and dopamine (DA) levels in this brain region. A functional single-nucleotide polymorphism within the dopamine D2 receptor gene (DRD2, rs1076560 G > T) shifts splicing of the 2 D2 isoforms, D2 short and D2 long, and has been associated with striatal DA signaling as well as with cognitive processing. However, the effects of this polymorphism on DMN have not been explored. The aim of this study was to evaluate the effects of rs1076560 on DMN and striatal connectivity and on their relationship with striatal DA signaling. Twenty-eight subjects genotyped for rs1076560 underwent functional magnetic resonance imaging during a working memory task and 123 55 I-Fluoropropyl-2-beta-carbomethoxy-3-beta(4-iodophenyl) nortropan Single Photon Emission Computed Tomography ([123I]-FP-CIT SPECT) imaging (a measure of dopamine transporter [DAT] binding). Spatial group-independent component (IC) analysis was used to identify DMN and striatal ICs. Within the anterior DMN IC, GG subjects had relatively greater connectivity in medial prefrontal cortex (MPFC), which was directly correlated with striatal DAT binding. Within the posterior DMN IC, GG subjects had reduced connectivity in posterior cingulate relative to T carriers. Additionally, rs1076560 genotype predicted connectivity differences within a striatal network, and these changes were correlated with connectivity in MPFC and posterior cingulate within the DMN. These results suggest that genetically determined D2 receptor signaling is associated with DMN connectivity and that these changes are correlated with striatal function and presynaptic DA signaling. PMID:21976709

Enabling Team Learning in Healthcare

ERIC Educational Resources Information Center

Boak, George

2016-01-01

This paper is based on a study of learning processes within 35 healthcare therapy teams that took action to improve their services. The published research on team learning is introduced, and the paper suggests it is an activity that has similarities with action research and with those forms of action learning where teams address collective…

Cortico-striatal language pathways dynamically adjust for syntactic complexity: A computational study.

PubMed

Szalisznyó, Krisztina; Silverstein, David; Teichmann, Marc; Duffau, Hugues; Smits, Anja

2017-01-01

A growing body of literature supports a key role of fronto-striatal circuits in language perception. It is now known that the striatum plays a role in engaging attentional resources and linguistic rule computation while also serving phonological short-term memory capabilities. The ventral semantic and the dorsal phonological stream dichotomy assumed for spoken language processing also seems to play a role in cortico-striatal perception. Based on recent studies that correlate deep Broca-striatal pathways with complex syntax performance, we used a previously developed computational model of frontal-striatal syntax circuits and hypothesized that different parallel language pathways may contribute to canonical and non-canonical sentence comprehension separately. We modified and further analyzed a thematic role assignment task and corresponding reservoir computing model of language circuits, as previously developed by Dominey and coworkers. We examined the models performance under various parameter regimes, by influencing how fast the presented language input decays and altering the temporal dynamics of activated word representations. This enabled us to quantify canonical and non-canonical sentence comprehension abilities. The modeling results suggest that separate cortico-cortical and cortico-striatal circuits may be recruited differently for processing syntactically more difficult and less complicated sentences. Alternatively, a single circuit would need to dynamically and adaptively adjust to syntactic complexity. Copyright © 2016. Published by Elsevier Inc.

Active Avoidance: Neural Mechanisms and Attenuation of Pavlovian Conditioned Responding.

PubMed

Boeke, Emily A; Moscarello, Justin M; LeDoux, Joseph E; Phelps, Elizabeth A; Hartley, Catherine A

2017-05-03

Patients with anxiety disorders often experience a relapse in symptoms after exposure therapy. Similarly, threat responses acquired during Pavlovian threat conditioning often return after extinction learning. Accordingly, there is a need for alternative methods to persistently reduce threat responding. Studies in rodents have suggested that exercising behavioral control over an aversive stimulus can persistently diminish threat responses, and that these effects are mediated by the amygdala, ventromedial prefrontal cortex, and striatum. In this fMRI study, we attempted to translate these findings to humans. Subjects first underwent threat conditioning. We then contrasted two forms of safety learning: active avoidance, in which participants could prevent the shock through an action, and yoked extinction, with shock presentation matched to the active condition, but without instrumental control. The following day, we assessed subjects' threat responses (measured by skin conductance) to the conditioned stimuli without shock. Subjects next underwent threat conditioning with novel stimuli. Yoked extinction subjects showed an increase in conditioned response to stimuli from the previous day, but the active avoidance group did not. Additionally, active avoidance subjects showed reduced conditioned responding during novel threat conditioning, but the extinction group did not. We observed between-group differences in striatal BOLD responses to shock omission in Avoidance/Extinction. These findings suggest a differential role for the striatum in human active avoidance versus extinction learning, and indicate that active avoidance may be more effective than extinction in persistently diminishing threat responses. SIGNIFICANCE STATEMENT Extinguished threat responses often reemerge with time, highlighting the importance of identifying more enduring means of attenuation. We compared the effects of active avoidance learning and yoked extinction on threat responses in humans and contrasted the neural circuitry engaged by these two processes. Subjects who learned to prevent a shock through an action maintained low threat responses after safety learning and showed attenuated threat conditioning with novel stimuli, in contrast to those who underwent yoked extinction. The results suggest that experiences of active control over threat engage the striatum and promote a shift from expression of innate defensive responses toward more adaptive behavioral responses to threatening stimuli. Copyright © 2017 the authors 0270-6474/17/374808-11$15.00/0.

Active Avoidance: Neural Mechanisms and Attenuation of Pavlovian Conditioned Responding

PubMed Central

Boeke, Emily A.; Moscarello, Justin M.; Phelps, Elizabeth A.

2017-01-01

Patients with anxiety disorders often experience a relapse in symptoms after exposure therapy. Similarly, threat responses acquired during Pavlovian threat conditioning often return after extinction learning. Accordingly, there is a need for alternative methods to persistently reduce threat responding. Studies in rodents have suggested that exercising behavioral control over an aversive stimulus can persistently diminish threat responses, and that these effects are mediated by the amygdala, ventromedial prefrontal cortex, and striatum. In this fMRI study, we attempted to translate these findings to humans. Subjects first underwent threat conditioning. We then contrasted two forms of safety learning: active avoidance, in which participants could prevent the shock through an action, and yoked extinction, with shock presentation matched to the active condition, but without instrumental control. The following day, we assessed subjects' threat responses (measured by skin conductance) to the conditioned stimuli without shock. Subjects next underwent threat conditioning with novel stimuli. Yoked extinction subjects showed an increase in conditioned response to stimuli from the previous day, but the active avoidance group did not. Additionally, active avoidance subjects showed reduced conditioned responding during novel threat conditioning, but the extinction group did not. We observed between-group differences in striatal BOLD responses to shock omission in Avoidance/Extinction. These findings suggest a differential role for the striatum in human active avoidance versus extinction learning, and indicate that active avoidance may be more effective than extinction in persistently diminishing threat responses. SIGNIFICANCE STATEMENT Extinguished threat responses often reemerge with time, highlighting the importance of identifying more enduring means of attenuation. We compared the effects of active avoidance learning and yoked extinction on threat responses in humans and contrasted the neural circuitry engaged by these two processes. Subjects who learned to prevent a shock through an action maintained low threat responses after safety learning and showed attenuated threat conditioning with novel stimuli, in contrast to those who underwent yoked extinction. The results suggest that experiences of active control over threat engage the striatum and promote a shift from expression of innate defensive responses toward more adaptive behavioral responses to threatening stimuli. PMID:28408411

Face-name association learning and brain structural substrates in alcoholism.

PubMed

Pitel, Anne-Lise; Chanraud, Sandra; Rohlfing, Torsten; Pfefferbaum, Adolf; Sullivan, Edith V

2012-07-01

Associative learning is required for face-name association and is impaired in alcoholism, but the cognitive processes and brain structural components underlying this deficit remain unclear. It is also unknown whether prompting alcoholics to implement a deep level of processing during face-name encoding would enhance performance. Abstinent alcoholics and controls performed a levels-of-processing face-name learning task. Participants indicated whether the face was that of an honest person (deep encoding) or that of a man (shallow encoding). Retrieval was examined using an associative (face-name) recognition task and a single-item (face or name only) recognition task. Participants also underwent 3T structural MRI. Compared with controls, alcoholics had poorer associative and single-item learning and performed at similar levels. Level of processing at encoding had little effect on recognition performance but affected reaction time (RT). Correlations with brain volumes were generally modest and based primarily on RT in alcoholics, where the deeper the processing at encoding, the more restricted the correlations with brain volumes. In alcoholics, longer control task RTs correlated modestly with smaller tissue volumes across several anterior to posterior brain regions; shallow encoding correlated with calcarine and striatal volumes; deep encoding correlated with precuneus and parietal volumes; and associative recognition RT correlated with cerebellar volumes. In controls, poorer associative recognition with deep encoding correlated significantly with smaller volumes of frontal and striatal structures. Despite prompting, alcoholics did not take advantage of encoding memoranda at a deep level to enhance face-name recognition accuracy. Nonetheless, conditions of deeper encoding resulted in faster RTs and more specific relations with regional brain volumes than did shallow encoding. The normal relation between associative recognition and corticostriatal volumes was not present in alcoholics. Rather, their speeded RTs occurred at the expense of accuracy and were related most robustly to cerebellar volumes. Copyright © 2012 by the Research Society on Alcoholism.

Contributions of Medial Temporal Lobe and Striatal Memory Systems to Learning and Retrieving Overlapping Spatial Memories

PubMed Central

Brown, Thackery I.; Stern, Chantal E.

2014-01-01

Many life experiences share information with other memories. In order to make decisions based on overlapping memories, we need to distinguish between experiences to determine the appropriate behavior for the current situation. Previous work suggests that the medial temporal lobe (MTL) and medial caudate interact to support the retrieval of overlapping navigational memories in different contexts. The present study used functional magnetic resonance imaging (fMRI) in humans to test the prediction that the MTL and medial caudate play complementary roles in learning novel mazes that cross paths with, and must be distinguished from, previously learned routes. During fMRI scanning, participants navigated virtual routes that were well learned from prior training while also learning new mazes. Critically, some routes learned during scanning shared hallways with those learned during pre-scan training. Overlap between mazes required participants to use contextual cues to select between alternative behaviors. Results demonstrated parahippocampal cortex activity specific for novel spatial cues that distinguish between overlapping routes. The hippocampus and medial caudate were active for learning overlapping spatial memories, and increased their activity for previously learned routes when they became context dependent. Our findings provide novel evidence that the MTL and medial caudate play complementary roles in the learning, updating, and execution of context-dependent navigational behaviors. PMID:23448868

A reward optimization method based on action subrewards in hierarchical reinforcement learning.

PubMed

Fu, Yuchen; Liu, Quan; Ling, Xionghong; Cui, Zhiming

2014-01-01

Reinforcement learning (RL) is one kind of interactive learning methods. Its main characteristics are "trial and error" and "related reward." A hierarchical reinforcement learning method based on action subrewards is proposed to solve the problem of "curse of dimensionality," which means that the states space will grow exponentially in the number of features and low convergence speed. The method can reduce state spaces greatly and choose actions with favorable purpose and efficiency so as to optimize reward function and enhance convergence speed. Apply it to the online learning in Tetris game, and the experiment result shows that the convergence speed of this algorithm can be enhanced evidently based on the new method which combines hierarchical reinforcement learning algorithm and action subrewards. The "curse of dimensionality" problem is also solved to a certain extent with hierarchical method. All the performance with different parameters is compared and analyzed as well.

Enhanced GABAergic Inputs Contribute to Functional Alterations of Cholinergic Interneurons in the R6/2 Mouse Model of Huntington's Disease.

PubMed

Holley, Sandra M; Joshi, Prasad R; Parievsky, Anna; Galvan, Laurie; Chen, Jane Y; Fisher, Yvette E; Huynh, My N; Cepeda, Carlos; Levine, Michael S

2015-01-01

In Huntington's disease (HD), a hereditary neurodegenerative disorder, striatal medium-sized spiny neurons undergo degenerative changes. In contrast, large cholinergic interneurons (LCIs) are relatively spared. However, their ability to release acetylcholine (ACh) is impaired. The present experiments examined morphological and electrophysiological properties of LCIs in the R6/2 mouse model of HD. R6/2 mice show a severe, rapidly progressing phenotype. Immunocytochemical analysis of choline acetyltransferase-positive striatal neurons showed that, although the total number of cells was not changed, somatic areas were significantly smaller in symptomatic R6/2 mice compared to wildtype (WT) littermates, For electrophysiology, brain slices were obtained from presymptomatic (3-4 weeks) and symptomatic (>8 weeks) R6/2 mice and their WT littermates. Striatal LCIs were identified by somatic size and spontaneous action potential firing in the cell-attached mode. Passive and active membrane properties of LCIs were similar in presymptomatic R6/2 and WT mice. In contrast, LCIs from symptomatic R6/2 animals displayed smaller membrane capacitance and higher input resistance, consistent with reduced somatic size. In addition, more LCIs from symptomatic mice displayed irregular firing patterns and bursts of action potentials. They also displayed a higher frequency of spontaneous GABAergic inhibitory postsynaptic currents (IPSCs) and larger amplitude of electrically evoked IPSCs. Selective optogenetic stimulation of somatostatin- but not parvalbumin-containing interneurons also evoked larger amplitude IPSCs in LCIs from R6/2 mice. In contrast, glutamatergic spontaneous or evoked postsynaptic currents were not affected. Morphological and electrophysiological alterations, in conjunction with the presence of mutant huntingtin in LCIs, could explain impaired ACh release in HD mouse models.

7-Fluoro-1,3-diphenylisoquinoline reverses motor and non-motor symptoms induced by MPTP in mice: Role of striatal neuroinflammation.

PubMed

Sampaio, Tuane Bazanella; Marcondes Sari, Marcel Henrique; Pesarico, Ana Paula; Mantovani, Anderson Carboni; Zeni, Gilson; Nogueira, Cristina Wayne

2018-01-15

Parkinson's disease (PD) is a dopaminergic neurodegenerative disorder, which presents motor and non-motor symptoms. 7-Fluoro-1,3-diphenylisoquinoline (FDPI) is an isoquinoline compound with antioxidant and antidepressant properties. This study investigated whether FDPI reverses motor and non-motor symptoms in an acute mouse model of PD induced by 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP). It was also assessed the anti-inflammatory mechanisms in FDPI pharmacological action. C57Bl/6 male adult mice received four MPTP (20mg/kg, intraperitoneal) or saline (vehicle) injections to induce an acute PD model. FDPI (10mg/kg, intragastric) was daily administered to mice from the 2nd to 9th day after the induction and mice performed the behavioral tests on the 8th and 9th days. Striatum samples were collected for biochemical and molecular analyses. The results of the rotarod and challenging beam tests demonstrated that the administration of FDPI attenuated the impairments in balance and coordination of mice induced by MPTP. The FDPI reversed the short-term memory deficit and depressive-like behavior induced by MPTP in mice. FDPI attenuated the reduction in the striatal tyrosine hydroxylase levels, and it reversed the increase in the cyclooxygenase-2 levels and myeloperoxidase activity caused by MPTP in mice. Therefore, FDPI reversed motor and non-motor symptoms induced by an acute PD model and its restorative effects seem to be mediated by an anti-inflammatory action associated with a modulation of the striatal cyclooxygenase-2 levels and myeloperoxidase activity. Copyright © 2017 Elsevier B.V. All rights reserved.

Comorbid rat model of ischemia and β-amyloid toxicity: striatal and cortical degeneration.

PubMed

Amtul, Zareen; Whitehead, Shawn N; Keeley, Robin J; Bechberger, John; Fisher, Alicia L; McDonald, Robert J; Naus, Christian C; Munoz, David G; Cechetto, David F

2015-01-01

Levels of cerebral amyloid, presumably β-amyloid (Abeta), toxicity and the incidence of cortical and subcortical ischemia increases with age. However, little is known about the severe pathological condition and dementia that occur as a result of the comorbid occurrence of this vascular risk factor and Abeta toxicity. Clinical studies have indicated that small ischemic lesions in the striatum are particularly important in generating dementia in combination with minor amyloid lesions. These cognitive deficits are highly likely to be caused by changes in the cortex. In this study, we examined the viability and morphological changes in microglial and neuronal cells, gap junction proteins (connexin43) and neuritic/axonal retraction (Fer Kinase) in the striatum and cerebral cortex using a comorbid rat model of striatal injections of endothelin-1 (ET1) and Abeta toxicity. The results demonstrated ventricular enlargement, striatal atrophy, substantial increases in β-amyloid, ramified microglia and increases in neuritic retraction in the combined models of stroke and Abeta toxicity. Changes in connexin43 occurred equally in both groups of Abeta-treated rats, with and without focal ischemia. Although previous behavioral tests demonstrated impairment in memory and learning, the visual discrimination radial maze task did not show significant difference, suggesting the cognitive impairment in these models is not related to damage to the dorsolateral striatum. These results suggest an insight into the relationship between cortical/striatal atrophy, pathology and functional impairment. © 2014 International Society of Neuropathology.

Haloperidol Selectively Remodels Striatal Indirect Pathway Circuits

PubMed Central

Sebel, Luke E; Graves, Steven M; Chan, C Savio; Surmeier, D James

2017-01-01

Typical antipsychotic drugs are widely thought to alleviate the positive symptoms of schizophrenia by antagonizing dopamine D2 receptors expressed by striatal spiny projection neurons (SPNs). What is less clear is why antipsychotics have a therapeutic latency of weeks. Using a combination of physiological and anatomical approaches in ex vivo brain slices from transgenic mice, it was found that 2 weeks of haloperidol treatment induced both intrinsic and synaptic adaptations specifically within indirect pathway SPNs (iSPNs). Perphenazine treatment had similar effects. Some of these adaptations were homeostatic, including a drop in intrinsic excitability and pruning of excitatory corticostriatal glutamatergic synapses. However, haloperidol treatment also led to strengthening of a subset of excitatory corticostriatal synapses. This slow remodeling of corticostriatal iSPN circuitry is likely to play a role in mediating the delayed therapeutic action of neuroleptics. PMID:27577602

Effects of an acute therapeutic or rewarding dose of amphetamine on acquisition of Pavlovian autoshaping and ventral striatal dopamine signaling.

PubMed

Schuweiler, D R; Athens, J M; Thompson, J M; Vazhayil, S T; Garris, P A

2018-01-15

Rewarding doses of amphetamine increase the amplitude, duration, and frequency of dopamine transients in the ventral striatum. Debate continues at the behavioral level about which component of reward, learning or incentive salience, is signaled by these dopamine transients and thus altered in addiction. The learning hypothesis proposes that rewarding drugs result in pathological overlearning of drug-predictive cues, while the incentive sensitization hypothesis suggests that rewarding drugs result in sensitized attribution of incentive salience to drug-predictive cues. Therapeutic doses of amphetamine, such as those used to treat attention-deficit hyperactivity disorder, are hypothesized to enhance the ventral striatal dopamine transients that are critical for reward-related learning and to enhance Pavlovian learning. However, the effects of therapeutic doses of amphetamine on Pavlovian learning are poorly understood, and the effects on dopamine transients are completely unknown. We determined the effects of an acute pre-training therapeutic or rewarding amphetamine injection on the acquisition of Pavlovian autoshaping in the intact rat. We also determined the effects of these doses on electrically evoked transient-like dopamine signals using fast-scan cyclic voltammetry in the anesthetized rat. The rewarding dose enhanced the amplitude and duration of DA signals, caused acute task disengagement, impaired learning for several days, and triggered incentive sensitization. The therapeutic dose produced smaller enhancements in DA signals but did not have similar behavioral effects. These results underscore the necessity of more studies using therapeutic doses, and suggest a hybrid learning/incentive sensitization model may be required to explain the development of addiction. Copyright © 2017 Elsevier B.V. All rights reserved.

Voluntary Exercise Improves Performance of a Discrimination Task through Effects on the Striatal Dopamine System

ERIC Educational Resources Information Center

Eddy, Meghan C.; Stansfield, Katherine J.; Green, John T.

2014-01-01

We have previously demonstrated that voluntary exercise facilitates discrimination learning in a modified T-maze. There is evidence implicating the dorsolateral striatum (DLS) as the substrate for this task. The present experiments examined whether changes in DLS dopamine receptors might underlie the exercise-associated facilitation. Infusing a…

Striatal Degeneration Impairs Language Learning: Evidence from Huntington's Disease

ERIC Educational Resources Information Center

De Diego-Balaguer, R.; Couette, M.; Dolbeau, G.; Durr, A.; Youssov, K.; Bachoud-Levi, A.-C.

2008-01-01

Although the role of the striatum in language processing is still largely unclear, a number of recent proposals have outlined its specific contribution. Different studies report evidence converging to a picture where the striatum may be involved in those aspects of rule-application requiring non-automatized behaviour. This is the main…

Autism-associated neuroligin-3 mutations commonly impair striatal circuits to boost repetitive behaviors.

PubMed

Rothwell, Patrick E; Fuccillo, Marc V; Maxeiner, Stephan; Hayton, Scott J; Gokce, Ozgun; Lim, Byung Kook; Fowler, Stephen C; Malenka, Robert C; Südhof, Thomas C

2014-07-03

In humans, neuroligin-3 mutations are associated with autism, whereas in mice, the corresponding mutations produce robust synaptic and behavioral changes. However, different neuroligin-3 mutations cause largely distinct phenotypes in mice, and no causal relationship links a specific synaptic dysfunction to a behavioral change. Using rotarod motor learning as a proxy for acquired repetitive behaviors in mice, we found that different neuroligin-3 mutations uniformly enhanced formation of repetitive motor routines. Surprisingly, neuroligin-3 mutations caused this phenotype not via changes in the cerebellum or dorsal striatum but via a selective synaptic impairment in the nucleus accumbens/ventral striatum. Here, neuroligin-3 mutations increased rotarod learning by specifically impeding synaptic inhibition onto D1-dopamine receptor-expressing but not D2-dopamine receptor-expressing medium spiny neurons. Our data thus suggest that different autism-associated neuroligin-3 mutations cause a common increase in acquired repetitive behaviors by impairing a specific striatal synapse and thereby provide a plausible circuit substrate for autism pathophysiology. Copyright © 2014 Elsevier Inc. All rights reserved.

The Dopamine D2 Receptor Gene in Lamprey, Its Expression in the Striatum and Cellular Effects of D2 Receptor Activation

PubMed Central

Robertson, Brita; Huerta-Ocampo, Icnelia; Ericsson, Jesper; Stephenson-Jones, Marcus; Pérez-Fernández, Juan; Bolam, J. Paul; Diaz-Heijtz, Rochellys; Grillner, Sten

2012-01-01

All basal ganglia subnuclei have recently been identified in lampreys, the phylogenetically oldest group of vertebrates. Furthermore, the interconnectivity of these nuclei is similar to mammals and tyrosine hydroxylase-positive (dopaminergic) fibers have been detected within the input layer, the striatum. Striatal processing is critically dependent on the interplay with the dopamine system, and we explore here whether D2 receptors are expressed in the lamprey striatum and their potential role. We have identified a cDNA encoding the dopamine D2 receptor from the lamprey brain and the deduced protein sequence showed close phylogenetic relationship with other vertebrate D2 receptors, and an almost 100% identity within the transmembrane domains containing the amino acids essential for dopamine binding. There was a strong and distinct expression of D2 receptor mRNA in a subpopulation of striatal neurons, and in the same region tyrosine hydroxylase-immunoreactive synaptic terminals were identified at the ultrastructural level. The synaptic incidence of tyrosine hydroxylase-immunoreactive boutons was highest in a region ventrolateral to the compact layer of striatal neurons, a region where most striatal dendrites arborise. Application of a D2 receptor agonist modulates striatal neurons by causing a reduced spike discharge and a diminished post-inhibitory rebound. We conclude that the D2 receptor gene had already evolved in the earliest group of vertebrates, cyclostomes, when they diverged from the main vertebrate line of evolution (560 mya), and that it is expressed in striatum where it exerts similar cellular effects to that in other vertebrates. These results together with our previous published data (Stephenson-Jones et al. 2011, 2012) further emphasize the high degree of conservation of the basal ganglia, also with regard to the indirect loop, and its role as a basic mechanism for action selection in all vertebrates. PMID:22563388

Linking Action Learning and Inter-Organisational Learning: The Learning Journey Approach

ERIC Educational Resources Information Center

Schumacher, Thomas

2015-01-01

The article presents and illustrates the learning journey (LJ)--a new management development approach to inter-organisational learning based on observation, reflection and problem-solving. The LJ involves managers from different organisations and applies key concepts of action learning and systemic organisational development. Made up of…

Brain activation during anticipation of sound sequences.

PubMed

Leaver, Amber M; Van Lare, Jennifer; Zielinski, Brandon; Halpern, Andrea R; Rauschecker, Josef P

2009-02-25

Music consists of sound sequences that require integration over time. As we become familiar with music, associations between notes, melodies, and entire symphonic movements become stronger and more complex. These associations can become so tight that, for example, hearing the end of one album track can elicit a robust image of the upcoming track while anticipating it in total silence. Here, we study this predictive "anticipatory imagery" at various stages throughout learning and investigate activity changes in corresponding neural structures using functional magnetic resonance imaging. Anticipatory imagery (in silence) for highly familiar naturalistic music was accompanied by pronounced activity in rostral prefrontal cortex (PFC) and premotor areas. Examining changes in the neural bases of anticipatory imagery during two stages of learning conditional associations between simple melodies, however, demonstrates the importance of fronto-striatal connections, consistent with a role of the basal ganglia in "training" frontal cortex (Pasupathy and Miller, 2005). Another striking change in neural resources during learning was a shift between caudal PFC earlier to rostral PFC later in learning. Our findings regarding musical anticipation and sound sequence learning are highly compatible with studies of motor sequence learning, suggesting common predictive mechanisms in both domains.

Brain Activation During Anticipation of Sound Sequences

PubMed Central

Leaver, Amber M.; Van Lare, Jennifer; Zielinski, Brandon; Halpern, Andrea R.; Rauschecker, Josef P.

2010-01-01

Music consists of sound sequences that require integration over time. As we become familiar with music, associations between notes, melodies, and entire symphonic movements become stronger and more complex. These associations can become so tight that, for example, hearing the end of one album track can elicit a robust image of the upcoming track while anticipating it in total silence. Here we study this predictive “anticipatory imagery” at various stages throughout learning and investigate activity changes in corresponding neural structures using functional magnetic resonance imaging (fMRI). Anticipatory imagery (in silence) for highly familiar naturalistic music was accompanied by pronounced activity in rostral prefrontal cortex (PFC) and premotor areas. Examining changes in the neural bases of anticipatory imagery during two stages of learning conditional associations between simple melodies, however, demonstrates the importance of fronto-striatal connections, consistent with a role of the basal ganglia in “training” frontal cortex (Pasupathy and Miller, 2005). Another striking change in neural resources during learning was a shift between caudal PFC earlier to rostral PFC later in learning. Our findings regarding musical anticipation and sound sequence learning are highly compatible with studies of motor sequence learning, suggesting common predictive mechanisms in both domains. PMID:19244522

Transcranial infrared laser stimulation improves rule-based, but not information-integration, category learning in humans.

PubMed

Blanco, Nathaniel J; Saucedo, Celeste L; Gonzalez-Lima, F

2017-03-01

This is the first randomized, controlled study comparing the cognitive effects of transcranial laser stimulation on category learning tasks. Transcranial infrared laser stimulation is a new non-invasive form of brain stimulation that shows promise for wide-ranging experimental and neuropsychological applications. It involves using infrared laser to enhance cerebral oxygenation and energy metabolism through upregulation of the respiratory enzyme cytochrome oxidase, the primary infrared photon acceptor in cells. Previous research found that transcranial infrared laser stimulation aimed at the prefrontal cortex can improve sustained attention, short-term memory, and executive function. In this study, we directly investigated the influence of transcranial infrared laser stimulation on two neurobiologically dissociable systems of category learning: a prefrontal cortex mediated reflective system that learns categories using explicit rules, and a striatally mediated reflexive learning system that forms gradual stimulus-response associations. Participants (n=118) received either active infrared laser to the lateral prefrontal cortex or sham (placebo) stimulation, and then learned one of two category structures-a rule-based structure optimally learned by the reflective system, or an information-integration structure optimally learned by the reflexive system. We found that prefrontal rule-based learning was substantially improved following transcranial infrared laser stimulation as compared to placebo (treatment X block interaction: F(1, 298)=5.117, p=0.024), while information-integration learning did not show significant group differences (treatment X block interaction: F(1, 288)=1.633, p=0.202). These results highlight the exciting potential of transcranial infrared laser stimulation for cognitive enhancement and provide insight into the neurobiological underpinnings of category learning. Copyright © 2017 Elsevier Inc. All rights reserved.

The nucleus accumbens and learning and memory.

PubMed

Setlow, B

1997-09-01

Recent research on the nucleus accumbens (NA) indicates that this brain region is involved in learning and memory processes in a way that is separable from its other well-known roles in behavior, such as motivation, reward, and locomotor activity. These findings have suggested that 1) the NA may be involved in declarative, or hippocampal formation-dependent learning and memory, and not in several other non-declarative forms of learning and memory, and 2) the NA may be selectively involved in certain stages of learning and memory. These characteristics suggest that the NA may be part of a larger striatal system which subserves acquisition and consolidation, but is not a site of long-term storage, of different forms of learning and memory.

The PPARgamma agonist pioglitazone is effective in the MPTP mouse model of Parkinson's disease through inhibition of monoamine oxidase B.

PubMed

Quinn, L P; Crook, B; Hows, M E; Vidgeon-Hart, M; Chapman, H; Upton, N; Medhurst, A D; Virley, D J

2008-05-01

The peroxisome proliferator-activated receptor-gamma (PPARgamma) agonist pioglitazone has previously been shown to attenuate dopaminergic cell loss in the 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP) mouse model of Parkinson's disease, an effect attributed to its anti-inflammatory properties. In the present investigation, we provide evidence that pioglitazone is effective in the MPTP mouse model, not via an anti-inflammatory action, but through inhibition of MAO-B, the enzyme required to biotransform MPTP to its active neurotoxic metabolite 1-methyl-4-phenylpyridinium (MPP+). Mice were treated with pioglitazone (20 mg kg(-1) b.i.d. (twice a day), p.o., for 7 days), prior and post or post-MPTP (30 mg kg(-1) s.c.) treatment. Mice were then assessed for motor impairments on a beam-walking apparatus and for reductions in TH immunoreactivity in the substantia nigra and depletions in striatal dopamine. The effects of pioglitazone on striatal MPP+ levels and MAO-B activity were also assessed. Mice treated with MPTP showed deficits in motor performance, marked depletions in striatal dopamine levels and a concomitant reduction in TH immunoreactivity in the substantia nigra. Pretreatment with pioglitazone completely prevented these effects of MPTP. However, pretreatment with pioglitazone also significantly inhibited the MPTP-induced production of striatal MPP+ and the activity of MAO-B in the striatum. The neuroprotection observed with pioglitazone pretreatment in the MPTP mouse model was due to the blockade of the conversion of MPTP to its active toxic metabolite MPP+, via inhibition of MAO-B.

Striatal Activity and Reward Relativity: Neural Signals Encoding Dynamic Outcome Valuation

PubMed Central

Webber, Emily S.; Mankin, David E.

2016-01-01

Abstract The striatum is a key brain region involved in reward processing. Striatal activity has been linked to encoding reward magnitude and integrating diverse reward outcome information. Recent work has supported the involvement of striatum in the valuation of outcomes. The present work extends this idea by examining striatal activity during dynamic shifts in value that include different levels and directions of magnitude disparity. A novel task was used to produce diverse relative reward effects on a chain of instrumental action. Rats (Rattus norvegicus) were trained to respond to cues associated with specific outcomes varying by food pellet magnitude. Animals were exposed to single-outcome sessions followed by mixed-outcome sessions, and neural activity was compared among identical outcome trials from the different behavioral contexts. Results recording striatal activity show that neural responses to different task elements reflect incentive contrast as well as other relative effects that involve generalization between outcomes or possible influences of outcome variety. The activity that was most prevalent was linked to food consumption and post-food consumption periods. Relative encoding was sensitive to magnitude disparity. A within-session analysis showed strong contrast effects that were dependent upon the outcome received in the immediately preceding trial. Significantly higher numbers of responses were found in ventral striatum linked to relative outcome effects. Our results support the idea that relative value can incorporate diverse relationships, including comparisons from specific individual outcomes to general behavioral contexts. The striatum contains these diverse relative processes, possibly enabling both a higher information yield concerning value shifts and a greater behavioral flexibility. PMID:27822506

Striatal Activity and Reward Relativity: Neural Signals Encoding Dynamic Outcome Valuation.

PubMed

Webber, Emily S; Mankin, David E; Cromwell, Howard C

2016-01-01

The striatum is a key brain region involved in reward processing. Striatal activity has been linked to encoding reward magnitude and integrating diverse reward outcome information. Recent work has supported the involvement of striatum in the valuation of outcomes. The present work extends this idea by examining striatal activity during dynamic shifts in value that include different levels and directions of magnitude disparity. A novel task was used to produce diverse relative reward effects on a chain of instrumental action. Rats ( Rattus norvegicus ) were trained to respond to cues associated with specific outcomes varying by food pellet magnitude. Animals were exposed to single-outcome sessions followed by mixed-outcome sessions, and neural activity was compared among identical outcome trials from the different behavioral contexts. Results recording striatal activity show that neural responses to different task elements reflect incentive contrast as well as other relative effects that involve generalization between outcomes or possible influences of outcome variety. The activity that was most prevalent was linked to food consumption and post-food consumption periods. Relative encoding was sensitive to magnitude disparity. A within-session analysis showed strong contrast effects that were dependent upon the outcome received in the immediately preceding trial. Significantly higher numbers of responses were found in ventral striatum linked to relative outcome effects. Our results support the idea that relative value can incorporate diverse relationships, including comparisons from specific individual outcomes to general behavioral contexts. The striatum contains these diverse relative processes, possibly enabling both a higher information yield concerning value shifts and a greater behavioral flexibility.

Dopaminergic control of cognitive flexibility in humans and animals

PubMed Central

Klanker, Marianne; Feenstra, Matthijs; Denys, Damiaan

2013-01-01

Striatal dopamine (DA) is thought to code for learned associations between cues and reinforcers and to mediate approach behavior toward a reward. Less is known about the contribution of DA to cognitive flexibility—the ability to adapt behavior in response to changes in the environment. Altered reward processing and impairments in cognitive flexibility are observed in psychiatric disorders such as obsessive compulsive disorder (OCD). Patients with this disorder show a disruption of functioning in the frontostriatal circuit and alterations in DA signaling. In this review we summarize findings from animal and human studies that have investigated the involvement of striatal DA in cognitive flexibility. These findings may provide a better understanding of the role of dopaminergic dysfunction in cognitive inflexibility in psychiatric disorders, such as OCD. PMID:24204329

Assessing the Value of Action Learning for Social Enterprises and Charities

ERIC Educational Resources Information Center

Smith, Sue; Smith, Laurie

2017-01-01

In this paper we evaluate action learning for leaders of social enterprises and charities. Based on ethnographic research including participant observation, facilitator reflective diary notes and in-depth, qualitative interviews with participants of two action learning sets undertaken over eight months, analysed using Wenger, Trayner, and de Laat…

Anodal Transcranial Direct Current Stimulation Enhances Survival and Integration of Dopaminergic Cell Transplants in a Rat Parkinson Model.

PubMed

Winkler, Christian; Reis, Janine; Hoffmann, Nadin; Gellner, Anne-Kathrin; Münkel, Christian; Curado, Marco Rocha; Furlanetti, Luciano; Garcia, Joanna; Döbrössy, Máté D; Fritsch, Brita

2017-01-01

Restorative therapy concepts, such as cell based therapies aim to restitute impaired neurotransmission in neurodegenerative diseases. New strategies to enhance grafted cell survival and integration are still needed to improve functional recovery. Anodal direct current stimulation (DCS) promotes neuronal activity and secretion of the trophic factor BDNF in the motor cortex. Transcranial DCS applied to the motor cortex transiently improves motor symptoms in Parkinson's disease (PD) patients. In this proof-of-concept study, we combine cell based therapy and noninvasive neuromodulation to assess whether neurotrophic support via transcranial DCS would enhance the restitution of striatal neurotransmission by fetal dopaminergic transplants in a rat Parkinson model. Transcranial DCS was applied daily for 20 min on 14 consecutive days following striatal transplantation of fetal ventral mesencephalic (fVM) cells derived from transgenic rat embryos ubiquitously expressing GFP. Anodal but not cathodal transcranial DCS significantly enhanced graft survival and dopaminergic reinnervation of the surrounding striatal tissue relative to sham stimulation. Behavioral recovery was more pronounced following anodal transcranial DCS, and behavioral effects correlated with the degree of striatal innervation. Our results suggest anodal transcranial DCS may help advance cell-based restorative therapies in neurodegenerative diseases. In particular, such an assistive approach may be beneficial for the already established cell transplantation therapy in PD.

Join Us in a Participatory Approach to Training, Learning & Production. A Practical Guide to the Action Training Model.

ERIC Educational Resources Information Center

Frings, A.; And Others

This handbook is intended to help trainers and development workers plan and conduct training programs based on the Action Training Model (ATM). The ATM combines training with action and learning with production by building upon participants' knowledge and learning needs and involving participants in a process of active learning and cooperative…

Amygdala-Dependent Molecular Mechanisms of the Tac2 Pathway in Fear Learning

PubMed Central

Andero, Raül; Daniel, Sarah; Guo, Ji-Dong; Bruner, Robert C; Seth, Shivani; Marvar, Paul J; Rainnie, Donald; Ressler, Kerry J

2016-01-01

Recently we determined that activation of the tachykinin 2 (Tac2) pathway in the central amygdala (CeA) is necessary and sufficient for the modulation of fear memories. The Tac2 pathway includes the Tac2 gene, which encodes the neuropeptide neurokinin B and its corresponding receptor neurokinin 3 receptor (NK3R). In this study, using Tac2–cre and Tac2–GFP mice, we applied a combination of in vivo (optogenetics) and multiple in vitro techniques to further explore the mechanisms of action within the Tac2 pathway. In transgenic mice that express ChR2 solely in Tac2 neurons, in vivo optogenetic stimulation of CeA Tac2-expressing neurons during fear acquisition enhanced fear memory consolidation and drove action potential firing in vitro. In addition, Tac2–CeA neurons were shown to co-express striatal-enriched protein tyrosine phosphatase, which may have an important role in regulating Nk3R signaling during fear conditioning. These data extend our current understanding for the underlying mechanism(s) for the role of the Tac2 pathway in the regulation of fear memory, which may serve as a new therapeutic target in the treatment of fear-related disorders. PMID:27238620

Striatal and Hippocampal Entropy and Recognition Signals in Category Learning: Simultaneous Processes Revealed by Model-Based fMRI

PubMed Central

Davis, Tyler; Love, Bradley C.; Preston, Alison R.

2012-01-01

Category learning is a complex phenomenon that engages multiple cognitive processes, many of which occur simultaneously and unfold dynamically over time. For example, as people encounter objects in the world, they simultaneously engage processes to determine their fit with current knowledge structures, gather new information about the objects, and adjust their representations to support behavior in future encounters. Many techniques that are available to understand the neural basis of category learning assume that the multiple processes that subserve it can be neatly separated between different trials of an experiment. Model-based functional magnetic resonance imaging offers a promising tool to separate multiple, simultaneously occurring processes and bring the analysis of neuroimaging data more in line with category learning’s dynamic and multifaceted nature. We use model-based imaging to explore the neural basis of recognition and entropy signals in the medial temporal lobe and striatum that are engaged while participants learn to categorize novel stimuli. Consistent with theories suggesting a role for the anterior hippocampus and ventral striatum in motivated learning in response to uncertainty, we find that activation in both regions correlates with a model-based measure of entropy. Simultaneously, separate subregions of the hippocampus and striatum exhibit activation correlated with a model-based recognition strength measure. Our results suggest that model-based analyses are exceptionally useful for extracting information about cognitive processes from neuroimaging data. Models provide a basis for identifying the multiple neural processes that contribute to behavior, and neuroimaging data can provide a powerful test bed for constraining and testing model predictions. PMID:22746951

Altered brain activation in a reversal learning task unmasks adaptive changes in cognitive control in writer's cramp.

PubMed

Zeuner, Kirsten E; Knutzen, Arne; Granert, Oliver; Sablowsky, Simone; Götz, Julia; Wolff, Stephan; Jansen, Olav; Dressler, Dirk; Schneider, Susanne A; Klein, Christine; Deuschl, Günther; van Eimeren, Thilo; Witt, Karsten

2016-01-01

Previous receptor binding studies suggest dopamine function is altered in the basal ganglia circuitry in task-specific dystonia, a condition characterized by contraction of agonist and antagonist muscles while performing specific tasks. Dopamine plays a role in reward-based learning. Using fMRI, this study compared 31 right-handed writer's cramp patients to 35 controls in reward-based learning of a probabilistic reversal-learning task. All subjects chose between two stimuli and indicated their response with their left or right index finger. One stimulus response was rewarded 80%, the other 20%. After contingencies reversal, the second stimulus response was rewarded in 80%. We further linked the DRD2/ANKK1-TaqIa polymorphism, which is associated with 30% reduction of the striatal dopamine receptor density with reward-based learning and assumed impaired reversal learning in A + subjects. Feedback learning in patients was normal. Blood-oxygen level dependent (BOLD) signal in controls increased with negative feedback in the insula, rostral cingulate cortex, middle frontal gyrus and parietal cortex (pFWE < 0.05). In comparison to controls, patients showed greater increase in BOLD activity following negative feedback in the dorsal anterior cingulate cortex (BA32). The genetic status was not correlated with the BOLD activity. The Brodmann area 32 (BA32) is part of the dorsal anterior cingulate cortex (dACC) that plays an important role in coordinating and integrating information to guide behavior and in reward-based learning. The dACC is connected with the basal ganglia-thalamo-loop modulated by dopaminergic signaling. This finding suggests disturbed integration of reinforcement history in decision making and implicate that the reward system might contribute to the pathogenesis in writer's cramp.

Community Action Projects: Applying Biotechnology in the Real World

ERIC Educational Resources Information Center

Nguyen, Phuong D.; Siegel, Marcelle A.

2015-01-01

Project-based learning and action research are powerful pedagogies in improving science education. We implemented a semester-long course using project-based action research to help students apply biotechnology knowledge learned in the classroom to the real world. Students had several choices to make in the project: working individually or as a…

Brain signaling and behavioral responses induced by exposure to (56)Fe-particle radiation

NASA Technical Reports Server (NTRS)

Denisova, N. A.; Shukitt-Hale, B.; Rabin, B. M.; Joseph, J. A.

2002-01-01

Previous experiments have demonstrated that exposure to 56Fe-particle irradiation (1.5 Gy, 1 GeV) produced aging-like accelerations in neuronal and behavioral deficits. Astronauts on long-term space flights will be exposed to similar heavy-particle radiations that might have similar deleterious effects on neuronal signaling and cognitive behavior. Therefore, the present study evaluated whether radiation-induced spatial learning and memory behavioral deficits are associated with region-specific brain signaling deficits by measuring signaling molecules previously found to be essential for behavior [pre-synaptic vesicle proteins, synaptobrevin and synaptophysin, and protein kinases, calcium-dependent PRKCs (also known as PKCs) and PRKA (PRKA RIIbeta)]. The results demonstrated a significant radiation-induced increase in reference memory errors. The increases in reference memory errors were significantly negatively correlated with striatal synaptobrevin and frontal cortical synaptophysin expression. Both synaptophysin and synaptobrevin are synaptic vesicle proteins that are important in cognition. Striatal PRKA, a memory signaling molecule, was also significantly negatively correlated with reference memory errors. Overall, our findings suggest that radiation-induced pre-synaptic facilitation may contribute to some previously reported radiation-induced decrease in striatal dopamine release and for the disruption of the central dopaminergic system integrity and dopamine-mediated behavior.

Brain signaling and behavioral responses induced by exposure to (56)Fe-particle radiation.

PubMed

Denisova, N A; Shukitt-Hale, B; Rabin, B M; Joseph, J A

2002-12-01

Previous experiments have demonstrated that exposure to 56Fe-particle irradiation (1.5 Gy, 1 GeV) produced aging-like accelerations in neuronal and behavioral deficits. Astronauts on long-term space flights will be exposed to similar heavy-particle radiations that might have similar deleterious effects on neuronal signaling and cognitive behavior. Therefore, the present study evaluated whether radiation-induced spatial learning and memory behavioral deficits are associated with region-specific brain signaling deficits by measuring signaling molecules previously found to be essential for behavior [pre-synaptic vesicle proteins, synaptobrevin and synaptophysin, and protein kinases, calcium-dependent PRKCs (also known as PKCs) and PRKA (PRKA RIIbeta)]. The results demonstrated a significant radiation-induced increase in reference memory errors. The increases in reference memory errors were significantly negatively correlated with striatal synaptobrevin and frontal cortical synaptophysin expression. Both synaptophysin and synaptobrevin are synaptic vesicle proteins that are important in cognition. Striatal PRKA, a memory signaling molecule, was also significantly negatively correlated with reference memory errors. Overall, our findings suggest that radiation-induced pre-synaptic facilitation may contribute to some previously reported radiation-induced decrease in striatal dopamine release and for the disruption of the central dopaminergic system integrity and dopamine-mediated behavior.

Action-outcome learning and prediction shape the window of simultaneity of audiovisual outcomes.

PubMed

Desantis, Andrea; Haggard, Patrick

2016-08-01

To form a coherent representation of the objects around us, the brain must group the different sensory features composing these objects. Here, we investigated whether actions contribute in this grouping process. In particular, we assessed whether action-outcome learning and prediction contribute to audiovisual temporal binding. Participants were presented with two audiovisual pairs: one pair was triggered by a left action, and the other by a right action. In a later test phase, the audio and visual components of these pairs were presented at different onset times. Participants judged whether they were simultaneous or not. To assess the role of action-outcome prediction on audiovisual simultaneity, each action triggered either the same audiovisual pair as in the learning phase ('predicted' pair), or the pair that had previously been associated with the other action ('unpredicted' pair). We found the time window within which auditory and visual events appeared simultaneous increased for predicted compared to unpredicted pairs. However, no change in audiovisual simultaneity was observed when audiovisual pairs followed visual cues, rather than voluntary actions. This suggests that only action-outcome learning promotes temporal grouping of audio and visual effects. In a second experiment we observed that changes in audiovisual simultaneity do not only depend on our ability to predict what outcomes our actions generate, but also on learning the delay between the action and the multisensory outcome. When participants learned that the delay between action and audiovisual pair was variable, the window of audiovisual simultaneity for predicted pairs increased, relative to a fixed action-outcome pair delay. This suggests that participants learn action-based predictions of audiovisual outcome, and adapt their temporal perception of outcome events based on such predictions. Copyright © 2016 The Authors. Published by Elsevier B.V. All rights reserved.

Actionable Data Projects: Social Science and Service-Learning in General Education Courses

ERIC Educational Resources Information Center

Maloyed, Christie L.

2016-01-01

The use of service-learning pedagogies in general education courses is often limited to increasing volunteerism or civic literacy with problem-based or research-based projects reserved for upper level courses. This article examines the implementation of an "actionable data" service-learning project in an introductory, general studies…

Challenges of Adopting Constructive Alignment in Action Learning Education

ERIC Educational Resources Information Center

Remneland Wikhamn, Björn

2017-01-01

This paper will critically examine how the two influential pedagogical approaches of action-based learning and constructive alignment relate to each other, and how they may differ in focus and basic assumptions. From the outset, they are based on similar underpinnings, with the student and the learning outcomes in the center. Drawing from…

Development and Testing of a M-Learning System for the Professional Development of Academics through Design-Based Action Research

ERIC Educational Resources Information Center

Keskin, Nilgun Ozdamar; Kuzu, Abdullah

2015-01-01

In the present study, a mobile learning system for the professional development of academics was developed by design based action research, and the perceptions and experiences of the academics using this system were examined. In the first phase of this design-based action research, the research question was defined. In the second phase, a…

Dissociable Frontal–Striatal and Frontal–Parietal Networks Involved in Updating Hierarchical Contexts in Working Memory

PubMed Central

Nee, Derek Evan; Brown, Joshua W.

2013-01-01

Recent theories propose that the prefrontal cortex (PFC) is organized in a hierarchical fashion with more abstract, higher level information represented in anterior regions and more concrete, lower level information represented in posterior regions. This hierarchical organization affords flexible adjustments of action plans based on the context. Computational models suggest that such hierarchical organization in the PFC is achieved through interactions with the basal ganglia (BG) wherein the BG gate relevant contexts into the PFC. Here, we tested this proposal using functional magnetic resonance imaging (fMRI). Participants were scanned while updating working memory (WM) with 2 levels of hierarchical contexts. Consistent with PFC abstraction proposals, higher level context updates involved anterior portions of the PFC (BA 46), whereas lower level context updates involved posterior portions of the PFC (BA 6). Computational models were only partially supported as the BG were sensitive to higher, but not lower level context updates. The posterior parietal cortex (PPC) showed the opposite pattern. Analyses examining changes in functional connectivity confirmed dissociable roles of the anterior PFC–BG during higher level context updates and posterior PFC–PPC during lower level context updates. These results suggest that hierarchical contexts are organized by distinct frontal–striatal and frontal–parietal networks. PMID:22798339

Procuring a Sustainable Future: An Action Learning Approach to the Development and Modelling of Ethical and Sustainable Procurement Practices

ERIC Educational Resources Information Center

Boak, George; Watt, Peter; Gold, Jeff; Devins, David; Garvey, Robert

2016-01-01

This paper contributes to an understanding of the processes by which organisational actors learn how to affect positive and sustainable social change in their local region through action learning, action research and appreciative inquiry. The paper is based on a critically reflective account of key findings from an ongoing action research project,…

Frontal, Striatal, and Medial Temporal Sensitivity to Value Distinguishes Risk-Taking from Risk-Aversive Older Adults during Decision Making.

PubMed

Goh, Joshua O S; Su, Yu-Shiang; Tang, Yong-Jheng; McCarrey, Anna C; Tereshchenko, Alexander; Elkins, Wendy; Resnick, Susan M

2016-12-07

Aging compromises the frontal, striatal, and medial temporal areas of the reward system, impeding accurate value representation and feedback processing critical for decision making. However, substantial variability characterizes age-related effects on the brain so that some older individuals evince clear neurocognitive declines whereas others are spared. Moreover, the functional correlates of normative individual differences in older-adult value-based decision making remain unclear. We performed a functional magnetic resonance imaging study in 173 human older adults during a lottery choice task in which costly to more desirable stakes were depicted using low to high expected values (EVs) of points. Across trials that varied in EVs, participants decided to accept or decline the offered stakes to maximize total accumulated points. We found that greater age was associated with less optimal decisions, accepting stakes when losses were likely and declining stakes when gains were likely, and was associated with increased frontal activity for costlier stakes. Critically, risk preferences varied substantially across older adults and neural sensitivity to EVs in the frontal, striatal, and medial temporal areas dissociated risk-aversive from risk-taking individuals. Specifically, risk-averters increased neural responses to increasing EVs as stakes became more desirable, whereas risk-takers increased neural responses with decreasing EV as stakes became more costly. Risk preference also modulated striatal responses during feedback with risk-takers showing more positive responses to gains compared with risk-averters. Our findings highlight the frontal, striatal, and medial temporal areas as key neural loci in which individual differences differentially affect value-based decision-making ability in older adults. Frontal, striatal, and medial temporal functions implicated in value-based decision processing of rewards and costs undergo substantial age-related changes. However, age effects on brain function and cognition differ across individuals. How this normative variation relates to older-adult value-based decision making is unclear. We found that although the ability make optimal decisions declines with age, there is still much individual variability in how this deterioration occurs. Critically, whereas risk-averters showed increased neural activity to increasingly valuable stakes in frontal, striatal, and medial temporal areas, risk-takers instead increased activity as stakes became more costly. Such distinct functional decision-making processing in these brain regions across normative older adults may reflect individual differences in susceptibility to age-related brain changes associated with incipient cognitive impairment. Copyright © 2016 the authors 0270-6474/16/3612498-12$15.00/0.

MPP+-Lesioned Mice: an Experimental Model of Motor, Emotional, Memory/Learning, and Striatal Neurochemical Dysfunctions.

PubMed

Cunha, Mauricio P; Pazini, Francis L; Lieberknecht, Vicente; Budni, Josiane; Oliveira, Ágatha; Rosa, Júlia M; Mancini, Gianni; Mazzardo, Leidiane; Colla, André R; Leite, Marina C; Santos, Adair R S; Martins, Daniel F; de Bem, Andreza F; Gonçalves, Carlos Alberto S; Farina, Marcelo; Rodrigues, Ana Lúcia S

2017-10-01

The neurotoxin 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP) induces motor and nonmotor dysfunctions resembling Parkinson's disease (PD); however, studies investigating the effects of 1-methyl-4-phenylpyridinium (MPP + ), an active oxidative product of MPTP, are scarce. This study investigated the behavioral and striatal neurochemical changes (related to oxidative damage, glial markers, and neurotrophic factors) 24 h after intracerebroventricular administration of MPP + (1.8-18 μg/mouse) in C57BL6 mice. MPP + administration at high dose (18 μg/mouse) altered motor parameters, since it increased the latency to leave the first quadrant and reduced crossing, rearing, and grooming responses in the open-field test and decreased rotarod latency time. MPP + administration at low dose (1.8 μg/mouse) caused specific nonmotor dysfunctions as it produced a depressive-like effect in the forced swim test and tail suspension test, loss of motivational and self-care behavior in the splash test, anxiety-like effect in the elevated plus maze test, and short-term memory deficit in the step-down inhibitory avoidance task, without altering ambulation. MPP + at doses of 1.8-18 μg/mouse increased tyrosine hydroxylase (TH) immunocontent and at 18 μg/mouse increased α-synuclein and decreased parkin immunocontent. The astrocytic calcium-binding protein S100B and glial fibrillary acidic protein (GFAP)/S100B ratio was decreased following MPP + administration (18 μg/mouse). At this highest dose, MPP + increased the ionized calcium-binding adapter molecule 1 (Iba-1) immunocontent, suggesting microglial activation. Also, MPP + at a dose of 18 μg/mouse increased thiobarbituric acid reactive substances (TBARS) and glutathione (GSH) levels and increased glutathione peroxidase (GPx) and hemeoxygenase-1 (HO-1) immunocontent, suggesting a significant role for oxidative stress in the MPP + -induced striatal damage. MPP + (18 μg/mouse) also increased striatal fibroblast growth factor 2 (FGF-2) and brain-derived neurotrophic factor (BDNF) levels. Moreover, MPP + decreased tropomyosin receptor kinase B (TrkB) immunocontent. Finally, MPP + (1.8-18 μg/mouse) increased serum corticosterone levels and did not alter acetylcholinesterase (AChE) activity in the striatum but increased it in cerebral cortex and hippocampus. Collectively, these results indicate that MPP + administration at low doses may be used as a model of emotional and memory/learning behavioral deficit related to PD and that MPP + administration at high dose could be useful for analysis of striatal dysfunctions associated with motor deficits in PD.

Severe drug-induced repetitive behaviors and striatal overexpression of VAChT in ChAT-ChR2-EYFP BAC transgenic mice

PubMed Central

Lacey, Carolyn J.; Lee, Tyrone; Bowden, Hilary A.; Graybiel, Ann M.

2014-01-01

In drug users, drug-related cues alone can induce dopamine release in the dorsal striatum. Instructive cues activate inputs to the striatum from both dopaminergic and cholinergic neurons, which are thought to work together to support motor learning and motivated behaviors. Imbalances in these neuromodulatory influences can impair normal action selection and might thus contribute to pathologically repetitive and compulsive behaviors such as drug addiction. Dopamine and acetylcholine can have either antagonistic or synergistic effects on behavior, depending on the state of the animal and the receptor signaling systems at play. Semi-synchronized activation of cholinergic interneurons in the dorsal striatum drives dopamine release via presynaptic nicotinic acetylcholine receptors located on dopamine terminals. Nicotinic receptor blockade is known to diminish abnormal repetitive behaviors (stereotypies) induced by psychomotor stimulants. By contrast, blockade of postsynaptic acetylcholine muscarinic receptors in the dorsomedial striatum exacerbates drug-induced stereotypy, exemplifying how different acetylcholine receptors can also have opposing effects. Although acetylcholine release is known to be altered in animal models of drug addiction, predicting whether these changes will augment or diminish drug-induced behaviors thus remains a challenge. Here, we measured amphetamine-induced stereotypy in BAC transgenic mice that have been shown to overexpress the vesicular acetylcholine transporter (VAChT) with consequent increased acetylcholine release. We found that drug-induced stereotypies, consisting of confined sniffing and licking behaviors, were greatly increased in the transgenic mice relative to sibling controls, as was striatal VAChT protein. These findings suggest that VAChT-mediated increases in acetylcholine could be critical in exacerbating drug-induced stereotypic behaviors and promoting exaggerated behavioral fixity. PMID:24904300

Anxiety, cognition, and habit: a multiple memory systems perspective.

PubMed

Packard, Mark G

2009-10-13

Consistent with a multiple systems approach to memory organization in the mammalian brain, numerous studies have differentiated the roles of the hippocampus and dorsal striatum in "cognitive" and "habit" learning and memory, respectively. Additional research indicates that activation of efferent projections of the basolateral amygdala (BLA), a brain region implicated in mammalian emotion, modulates memory processes occurring in other brain structures. The present brief review describes research designed to link these general concepts by examining the manner in which emotional state may influence the relative use of multiple memory systems. In a dual-solution plus-maze task that can be acquired using either hippocampus-dependent or dorsal striatal-dependent learning, acute pre-training or pre-retrieval emotional arousal (restraint stress/inescapable foot shock, exposure to the predator odor TMT, or peripheral injection of anixogenic drugs) biases rats towards the use of habit memory. Moreover, intra-BLA injection of anxiogenic drugs is sufficient to bias rats towards the use of dorsal striatal-dependent habit memory. In single-solution plus-maze tasks that require the use of either cognitive or habit learning, intra-BLA infusions of anxiogenic drugs result in a behavioral profile indicating an impairing effect on hippocampus-dependent memory that effectively produces enhanced habit learning by eliminating competitive interference between cognitive and habit memory systems. It is speculated that the predominant use of habit memory that can be produced by anxious and/or stressful emotional states may have implications for understanding the role of learning and memory processes in various human psychopathologies, including for example post-traumatic stress disorder and drug addiction.

How to use coaching and action learning to support mentors in the workplace.

PubMed

Nash, Sue; Scammell, Janet

Using the example of mentoring preregistration student nurses, this article explores facilitation of learning in the workplace and examines the use of coaching and action learning to support mentors and the wider clinical team. A case study, where a mentor has difficulties with an underperforming student, is considered. Action learning and coaching are then explored, with the aim of maximising personal and team learning. These strategies can be easily transferred to other work based learning situations.

Striatal dopamine D2/D3 receptor binding in pathological gambling is correlated with mood-related impulsivity

PubMed Central

Clark, Luke; Stokes, Paul R.; Wu, Kit; Michalczuk, Rosanna; Benecke, Aaf; Watson, Ben J.; Egerton, Alice; Piccini, Paola; Nutt, David J.; Bowden-Jones, Henrietta; Lingford-Hughes, Anne R.

2012-01-01

Pathological gambling (PG) is a behavioural addiction associated with elevated impulsivity and suspected dopamine dysregulation. Reduced striatal dopamine D2/D3 receptor availability has been reported in drug addiction, and may constitute a premorbid vulnerability marker for addictive disorders. The aim of the present study was to assess striatal dopamine D2/D3 receptor availability in PG, and its association with trait impulsivity. Males with PG (n = 9) and male healthy controls (n = 9) underwent [11C]-raclopride positron emission tomography imaging and completed the UPPS-P impulsivity scale. There was no significant difference between groups in striatal dopamine D2/D3 receptor availability, in contrast to previous reports in drug addiction. However, mood-related impulsivity (‘Urgency’) was negatively correlated with [11C]-raclopride binding potentials in the PG group. The absence of a group difference in striatal dopamine binding implies a distinction between behavioural addictions and drug addictions. Nevertheless, our data indicate heterogeneity in dopamine receptor availability in disordered gambling, such that individuals with high mood-related impulsivity may show differential benefits from dopamine-based medications. PMID:22776462

Conflict between place and response navigation strategies: effects on vicarious trial and error (VTE) behaviors.

PubMed

Schmidt, Brandy; Papale, Andrew; Redish, A David; Markus, Etan J

2013-02-15

Navigation can be accomplished through multiple decision-making strategies, using different information-processing computations. A well-studied dichotomy in these decision-making strategies compares hippocampal-dependent "place" and dorsal-lateral striatal-dependent "response" strategies. A place strategy depends on the ability to flexibly respond to environmental cues, while a response strategy depends on the ability to quickly recognize and react to situations with well-learned action-outcome relationships. When rats reach decision points, they sometimes pause and orient toward the potential routes of travel, a process termed vicarious trial and error (VTE). VTE co-occurs with neurophysiological information processing, including sweeps of representation ahead of the animal in the hippocampus and transient representations of reward in the ventral striatum and orbitofrontal cortex. To examine the relationship between VTE and the place/response strategy dichotomy, we analyzed data in which rats were cued to switch between place and response strategies on a plus maze. The configuration of the maze allowed for place and response strategies to work competitively or cooperatively. Animals showed increased VTE on trials entailing competition between navigational systems, linking VTE with deliberative decision-making. Even in a well-learned task, VTE was preferentially exhibited when a spatial selection was required, further linking VTE behavior with decision-making associated with hippocampal processing.

Differences in navigation performance and postpartal striatal volume associated with pregnancy in humans.

PubMed

Lisofsky, Nina; Wiener, Jan; de Condappa, Olivier; Gallinat, Jürgen; Lindenberger, Ulman; Kühn, Simone

2016-10-01

Pregnancy is accompanied by prolonged exposure to high estrogen levels. Animal studies have shown that estrogen influences navigation strategies and, hence, affects navigation performance. High estrogen levels are related to increased use of hippocampal-based allocentric strategies and decreased use of striatal-based egocentric strategies. In humans, associations between hormonal shifts and navigation strategies are less well studied. This study compared 30 peripartal women (mean age 28years) to an age-matched control group on allocentric versus egocentric navigation performance (measured in the last month of pregnancy) and gray matter volume (measured within two months after delivery). None of the women had a previous pregnancy before study participation. Relative to controls, pregnant women performed less well in the egocentric condition of the navigation task, but not the allocentric condition. A whole-brain group comparison revealed smaller left striatal volume (putamen) in the peripartal women. Across the two groups, left striatal volume was associated with superior egocentric over allocentric performance. Limited by the cross-sectional study design, the findings are a first indication that human pregnancy might be accompanied by structural brain changes in navigation-related neural systems and concomitant changes in navigation strategy. Copyright © 2016 Elsevier Inc. All rights reserved.

D2 receptor genotype and striatal dopamine signaling predict motor cortical activity and behavior in humans.

PubMed

Fazio, Leonardo; Blasi, Giuseppe; Taurisano, Paolo; Papazacharias, Apostolos; Romano, Raffaella; Gelao, Barbara; Ursini, Gianluca; Quarto, Tiziana; Lo Bianco, Luciana; Di Giorgio, Annabella; Mancini, Marina; Popolizio, Teresa; Rubini, Giuseppe; Bertolino, Alessandro

2011-02-14

Pre-synaptic D2 receptors regulate striatal dopamine release and DAT activity, key factors for modulation of motor pathways. A functional SNP of DRD2 (rs1076560 G>T) is associated with alternative splicing such that the relative expression of D2S (mainly pre-synaptic) vs. D2L (mainly post-synaptic) receptor isoforms is decreased in subjects with the T allele with a putative increase of striatal dopamine levels. To evaluate how DRD2 genotype and striatal dopamine signaling predict motor cortical activity and behavior in humans, we have investigated the association of rs1076560 with BOLD fMRI activity during a motor task. To further evaluate the relationship of this circuitry with dopamine signaling, we also explored the correlation between genotype based differences in motor brain activity and pre-synaptic striatal DAT binding measured with [(123)I] FP-CIT SPECT. Fifty healthy subjects, genotyped for DRD2 rs1076560 were studied with BOLD-fMRI at 3T while performing a visually paced motor task with their right hand; eleven of these subjects also underwent [(123)I]FP-CIT SPECT. SPM5 random-effects models were used for statistical analyses. Subjects carrying the T allele had greater BOLD responses in left basal ganglia, thalamus, supplementary motor area, and primary motor cortex, whose activity was also negatively correlated with reaction time at the task. Moreover, left striatal DAT binding and activity of left supplementary motor area were negatively correlated. The present results suggest that DRD2 genetic variation was associated with focusing of responses in the whole motor network, in which activity of predictable nodes was correlated with reaction time and with striatal pre-synaptic dopamine signaling. Our results in humans may help shed light on genetic risk for neurobiological mechanisms involved in the pathophysiology of disorders with dysregulation of striatal dopamine like Parkinson's disease. Copyright © 2010 Elsevier Inc. All rights reserved.

Bidirectional Plasticity in Striatonigral Synapses: A Switch to Balance Direct and Indirect Basal Ganglia Pathways

ERIC Educational Resources Information Center

Aceves, Jose J.; Rueda-Orozco, Pavel E.; Hernandez-Martinez, Ricardo; Galarraga, Elvira; Bargas, Jose

2011-01-01

There is no hypothesis to explain how direct and indirect basal ganglia (BG) pathways interact to reach a balance during the learning of motor procedures. Both pathways converge in the substantia nigra pars reticulata (SNr) carrying the result of striatal processing. Unfortunately, the mechanisms that regulate synaptic plasticity in striatonigral…

Navigating complex decision spaces: Problems and paradigms in sequential choice

PubMed Central

Walsh, Matthew M.; Anderson, John R.

2015-01-01

To behave adaptively, we must learn from the consequences of our actions. Doing so is difficult when the consequences of an action follow a delay. This introduces the problem of temporal credit assignment. When feedback follows a sequence of decisions, how should the individual assign credit to the intermediate actions that comprise the sequence? Research in reinforcement learning provides two general solutions to this problem: model-free reinforcement learning and model-based reinforcement learning. In this review, we examine connections between stimulus-response and cognitive learning theories, habitual and goal-directed control, and model-free and model-based reinforcement learning. We then consider a range of problems related to temporal credit assignment. These include second-order conditioning and secondary reinforcers, latent learning and detour behavior, partially observable Markov decision processes, actions with distributed outcomes, and hierarchical learning. We ask whether humans and animals, when faced with these problems, behave in a manner consistent with reinforcement learning techniques. Throughout, we seek to identify neural substrates of model-free and model-based reinforcement learning. The former class of techniques is understood in terms of the neurotransmitter dopamine and its effects in the basal ganglia. The latter is understood in terms of a distributed network of regions including the prefrontal cortex, medial temporal lobes cerebellum, and basal ganglia. Not only do reinforcement learning techniques have a natural interpretation in terms of human and animal behavior, but they also provide a useful framework for understanding neural reward valuation and action selection. PMID:23834192

The Methods of Teaching Course Based on Constructivist Learning Approach: An Action Research

ERIC Educational Resources Information Center

Altun, Sertel; Yücel-Toy, Banu

2015-01-01

This purpose of this study is to investigate how the course designed based on constructivist principles has been implemented, what actions have been taken to solve problems and what thoughts have arisen in the minds of teacher candidates with regard to the constructivist learning approach. In this study, an action research was employed which…

Assessing the Impact of Learning Environments on Students' Approaches to Learning: Comparing Conventional and Action Learning Designs

ERIC Educational Resources Information Center

Wilson, Keithia; Fowler, Jane

2005-01-01

This study investigated whether students' approaches to learning were influenced by the design of university courses. Pre- and post-evaluations of the approaches to learning of the same group of students concurrently enrolled in a conventional course (lectures and tutorials) and an action learning-based course (project work, learning groups) were…

Regulating prefrontal cortex activation: an emerging role for the 5-HT₂A serotonin receptor in the modulation of emotion-based actions?

PubMed

Aznar, Susana; Klein, Anders B

2013-12-01

The prefrontal cortex (PFC) is involved in mediating important higher-order cognitive processes such as decision making, prompting thereby our actions. At the same time, PFC activation is strongly influenced by emotional reactions through its functional interaction with the amygdala and the striatal circuitry, areas involved in emotion and reward processing. The PFC, however, is able to modulate amygdala reactivity via a feedback loop to this area. A role for serotonin in adjusting for this circuitry of cognitive regulation of emotion has long been suggested based primarily on the positive pharmacological effect of elevating serotonin levels in anxiety regulation. Recent animal and human functional magnetic resonance studies have pointed to a specific involvement of the 5-hydroxytryptamine (5-HT)2A serotonin receptor in the PFC feedback regulatory projection onto the amygdala. This receptor is highly expressed in the prefrontal cortex areas, playing an important role in modulating cortical activity and neural oscillations (brain waves). This makes it an interesting potential pharmacological target for the treatment of neuropsychiatric modes characterized by lack of inhibitory control of emotion-based actions, such as addiction and other impulse-related behaviors. In this review, we give an overview of the 5-HT2A receptor distribution (neuronal, intracellular, and anatomical) along with its functional and physiological effect on PFC activation, and how that relates to more recent findings of a regulatory effect of the PFC on the emotional control of our actions.

Quetiapine and aripiprazole signal differently to ERK, p90RSK and c-Fos in mouse frontal cortex and striatum: role of the EGF receptor

PubMed Central

2014-01-01

Background Signaling pathways outside dopamine D2 receptor antagonism may govern the variable clinical profile of antipsychotic drugs (APD) in schizophrenia. One postulated mechanism causal to APD action may regulate synaptic plasticity and neuronal connectivity via the extracellular signal-regulated kinase (ERK) cascade that links G-protein coupled receptors (GPCR) and ErbB growth factor signaling, systems disturbed in schizophrenia. This was based upon our finding that the low D2 receptor affinity APD clozapine induced initial down-regulation and delayed epidermal growth factor receptor (EGFR or ErbB1) mediated activation of the cortical and striatal ERK response in vivo distinct from olanzapine or haloperidol. Here we map whether the second generation atypical APDs aripiprazole and quetiapine affect the EGFR-ERK pathway and its substrates p90RSK and c-Fos in mouse brain, given their divergent agonist and antagonist properties on dopaminergic transmission, respectively. Results In prefrontal cortex, aripiprazole triggered triphasic ERK phosphorylation that was EGFR-independent but had no significant effect in striatum. Conversely quetiapine did not alter cortical ERK signaling but elevated striatal ERK levels in an EGFR-dependent manner. Induction of ERK by aripiprazole did not affect p90RSK signaling but quetiapine decreased RSK phosphorylation within 1-hour of administration. The transcription factor c-Fos by comparison was a direct target of ERK phosphorylation induced by aripiprazole in cortex and quetiapine in striatum with protein levels in temporal alignment with that of ERK. Conclusions These data indicate that aripiprazole and quetiapine signal to specific nuclear targets of ERK, which for quetiapine occurs via an EGFR-linked mechanism, possibly indicating involvement of this system in its action. PMID:24552586

The extended fronto-striatal model of obsessive compulsive disorder: convergence from event-related potentials, neuropsychology and neuroimaging

PubMed Central

Melloni, Margherita; Urbistondo, Claudia; Sedeño, Lucas; Gelormini, Carlos; Kichic, Rafael; Ibanez, Agustin

2012-01-01

In this work, we explored convergent evidence supporting the fronto-striatal model of obsessive-compulsive disorder (FSMOCD) and the contribution of event-related potential (ERP) studies to this model. First, we considered minor modifications to the FSMOCD model based on neuroimaging and neuropsychological data. We noted the brain areas most affected in this disorder -anterior cingulate cortex (ACC), basal ganglia (BG), and orbito-frontal cortex (OFC) and their related cognitive functions, such as monitoring and inhibition. Then, we assessed the ERPs that are directly related to the FSMOCD, including the error-related negativity (ERN), N200, and P600. Several OCD studies present enhanced ERN and N2 responses during conflict tasks as well as an enhanced P600 during working memory (WM) tasks. Evidence from ERP studies (especially regarding ERN and N200 amplitude enhancement), neuroimaging and neuropsychological findings suggests abnormal activity in the OFC, ACC, and BG in OCD patients. Moreover, additional findings from these analyses suggest dorsolateral prefrontal and parietal cortex involvement, which might be related to executive function (EF) deficits. Thus, these convergent results suggest the existence of a self-monitoring imbalance involving inhibitory deficits and executive dysfunctions. OCD patients present an impaired ability to monitor, control, and inhibit intrusive thoughts, urges, feelings, and behaviors. In the current model, this imbalance is triggered by an excitatory role of the BG (associated with cognitive or motor actions without volitional control) and inhibitory activity of the OFC as well as excessive monitoring of the ACC to block excitatory impulses. This imbalance would interact with the reduced activation of the parietal-DLPC network, leading to executive dysfunction. ERP research may provide further insight regarding the temporal dynamics of action monitoring and executive functioning in OCD. PMID:23015786

Lack of GPR88 enhances medium spiny neuron activity and alters motor- and cue-dependent behaviors.

PubMed

Quintana, Albert; Sanz, Elisenda; Wang, Wengang; Storey, Granville P; Güler, Ali D; Wanat, Matthew J; Roller, Bryan A; La Torre, Anna; Amieux, Paul S; McKnight, G Stanley; Bamford, Nigel S; Palmiter, Richard D

2012-11-01

The striatum regulates motor control, reward and learning. Abnormal function of striatal GABAergic medium spiny neurons (MSNs) is believed to contribute to the deficits in these processes that are observed in many neuropsychiatric diseases. The orphan G protein-coupled receptor GPR88 is robustly expressed in MSNs and is regulated by neuropharmacological drugs, but its contribution to MSN physiology and behavior is unclear. We found that, in the absence of GPR88, MSNs showed increased glutamatergic excitation and reduced GABAergic inhibition, which promoted enhanced firing rates in vivo, resulting in hyperactivity, poor motor coordination and impaired cue-based learning in mice. Targeted viral expression of GPR88 in MSNs rescued the molecular and electrophysiological properties and normalized behavior, suggesting that aberrant MSN activation in the absence of GPR88 underlies behavioral deficits and its dysfunction may contribute to behaviors observed in neuropsychiatric disease.

The alcoholic brain: neural bases of impaired reward-based decision-making in alcohol use disorders.

PubMed

Galandra, Caterina; Basso, Gianpaolo; Cappa, Stefano; Canessa, Nicola

2018-03-01

Neuroeconomics is providing insights into the neural bases of decision-making in normal and pathological conditions. In the neuropsychiatric domain, this discipline investigates how abnormal functioning of neural systems associated with reward processing and cognitive control promotes different disorders, and whether such evidence may inform treatments. This endeavor is crucial when studying different types of addiction, which share a core promoting mechanism in the imbalance between impulsive subcortical neural signals associated with immediate pleasurable outcomes and inhibitory signals mediated by a prefrontal reflective system. The resulting impairment in behavioral control represents a hallmark of alcohol use disorders (AUDs), a chronic relapsing disorder characterized by excessive alcohol consumption despite devastating consequences. This review aims to summarize available magnetic resonance imaging (MRI) evidence on reward-related decision-making alterations in AUDs, and to envision possible future research directions. We review functional MRI (fMRI) studies using tasks involving monetary rewards, as well as MRI studies relating decision-making parameters to neurostructural gray- or white-matter metrics. The available data suggest that excessive alcohol exposure affects neural signaling within brain networks underlying adaptive behavioral learning via the implementation of prediction errors. Namely, weaker ventromedial prefrontal cortex activity and altered connectivity between ventral striatum and dorsolateral prefrontal cortex likely underpin a shift from goal-directed to habitual actions which, in turn, might underpin compulsive alcohol consumption and relapsing episodes despite adverse consequences. Overall, these data highlight abnormal fronto-striatal connectivity as a candidate neurobiological marker of impaired choice in AUDs. Further studies are needed, however, to unveil its implications in the multiple facets of decision-making.

Effects of sarizotan on the corticostriatal glutamate pathways.

PubMed

Antonelli, Tiziana; Fuxe, Kjell; Tomasini, Maria C; Bartoszyk, Gerd D; Seyfried, Christoph A; Tanganelli, Sergio; Ferraro, Luca

2005-12-01

The effects of sarizotan, a 5-HT(1A) agonist with additional affinity for D(3) and D(4) receptors, have been studied on the corticostriatal glutamate pathways using dual-probe microdialysis in the awake rat. Sarizotan given systemically (0.1-10 mg/kg s.c.) or perfused into the motor cortex (10 microM) produced 20-30% reduction of cortical and striatal glutamate levels. The inhibitory effects of the systemic sarizotan on cortical and striatal glutamate levels were counteracted by intracortical perfusion with the 5-HT(1A) antagonist WAY100135 (10 microM). These findings suggest that the anti-dyskinetic properties of sarizotan could be mediated via its 5-HT(1A) agonist actions in the motor cortex, leading to reduced activity in the corticostriatal glutamate pathways with reduced activation of the striatopallidal GABA pathway mediating motor inhibition. Synapse 58:193-199, 2005. (c) 2005 Wiley-Liss, Inc.

[Effect of centrophenoxine, piracetam and aniracetam on the monoamine oxidase activity in different brain structures of rats].

PubMed

Stancheva, S L; Alova, L G

1988-01-01

In vitro studies of effects of some nootropic drugs (centrophenoxine, piracetam and aniracetam) on monoamine oxidase (MAO) activity in the rat striatum and hypothalamus, using tyramine, serotonin and beta-phenylethylamine as substrates, were carried out. At all concentrations used (5.10(-5)-1.10(-3) M) centrophenoxine inhibited total MAO, MAO A and MAO B in both brain structures. Piracetam activated striatal and hypothalamic total MAO, hypothalamic MAO A and MAO B but exerted a pronounced inhibitory effect on MAO A and MAO B activity in the striatum. Aniracetam inhibited total MAO and MAO A in both brain structures but activated striatal and hypothalamic MAO B. The different effects of centrophenoxine, piracetam and aniracetam on MAO activity in the brain structures support the view for the independent mode of action of nootropic drugs in spite of their similar molecular and metabolic activity.

Lesions of the hippocampus or dorsolateral striatum disrupt distinct aspects of spatial navigation strategies based on proximal and distal information in a cued variant of the Morris water task

PubMed Central

Rice, James P.; Wallace, Douglas G.; Hamilton, Derek A.

2015-01-01

The hippocampus and dorsolateral striatum are critically involved in spatial navigation based on extra-maze and intra-maze cues, respectively. Previous reports from our laboratory suggest that behavior in the Morris water task may be guided by both cue types, and rats appear to switch from extra-pool to intra-pool cues to guide navigation in a sequential manner within a given trial. In two experiments, rats with hippocampal or dorsolateral striatal lesions were trained and tested in water task paradigms that involved translation and removal of a cued platform within the pool and translations of the pool itself with respect to the extra-pool cue reference frame. In the first experiment, moment-to-moment analyses of swim behavior indicate that hippocampal lesions disrupt initial trajectories based on extra-pool cues at the beginning of the trial, while dorsolateral striatal lesions disrupt subsequent swim trajectories based on the location of the cued platform at the end of the trial. In the second experiment lesions of the hippocampus, but not the dorsolateral striatum, impaired directional responding in situations where the pool was shifted within the extra-pool cue array. These results are important for understanding the cooperative interactions between the hippocampus and dorsolateral striatum in spatial learning and memory, and establish that these brain areas are continuously involved in goal-directed spatial navigation. These results also highlight the importance of the hippocampus in directional responding in addition to place navigation. PMID:25907746

From feedback- to response-based performance monitoring in active and observational learning.

PubMed

Bellebaum, Christian; Colosio, Marco

2014-09-01

Humans can adapt their behavior by learning from the consequences of their own actions or by observing others. Gradual active learning of action-outcome contingencies is accompanied by a shift from feedback- to response-based performance monitoring. This shift is reflected by complementary learning-related changes of two ACC-driven ERP components, the feedback-related negativity (FRN) and the error-related negativity (ERN), which have both been suggested to signal events "worse than expected," that is, a negative prediction error. Although recent research has identified comparable components for observed behavior and outcomes (observational ERN and FRN), it is as yet unknown, whether these components are similarly modulated by prediction errors and thus also reflect behavioral adaptation. In this study, two groups of 15 participants learned action-outcome contingencies either actively or by observation. In active learners, FRN amplitude for negative feedback decreased and ERN amplitude in response to erroneous actions increased with learning, whereas observational ERN and FRN in observational learners did not exhibit learning-related changes. Learning performance, assessed in test trials without feedback, was comparable between groups, as was the ERN following actively performed errors during test trials. In summary, the results show that action-outcome associations can be learned similarly well actively and by observation. The mechanisms involved appear to differ, with the FRN in active learning reflecting the integration of information about own actions and the accompanying outcomes.

Work-based learning: a leadership development example from an action research study of shared governance implementation.

PubMed

Williamson, Tracey

2005-11-01

An empowering action research study was undertaken to evaluate and strengthen the implementation of shared governance. One aim was to identify factors that acted as aids or barriers to effective decision-making by clinical leaders. As a work-based learning approach, action research was expected to lead to integration of learning into practice by researcher and participants alike. Shared governance replaces traditional hierarchies and requires and develops clinical leaders. Strategies are needed to maximize learning from introduction of such initiatives at the individual, group and organizational level. Participant-observations and interviews were undertaken with shared governance council members from one model in north-west England. Leadership skills and knowledge and shared governance practices were significantly enhanced. Preparation for council roles was considered inadequate. Increased structured time for reflection and action planning was indicated. Implementation of shared governance has succeeded in developing leadership capacity. Evaluation findings have led to improvements in the overall shared governance model. Action research has been found to have great utility at optimizing work-based learning. Nurse Managers need to develop their coaching and facilitating skills and recognize there is no "quick fix" for developing clinical leaders. Implications include the need to support learners in identifying and implementing changes arising from work-based learning activities, the significant resource implications and the need to optimize the organizational climate if work-based learning approaches to leadership and management development are to succeed.

Exploring Constructivist Social Learning Practices in Aiding Russian-Speaking Teachers to Learn Estonian: An Action Research Approach

ERIC Educational Resources Information Center

Kiilo, Tatjana; Kutsar, Dagmar

2012-01-01

Based on appreciative inquiry and threshold concepts from an intercultural learning perspective, the article makes insights into the constructivist social learning practice of Estonian language learning amongst Russian-speaking teachers in Estonia. The application of educational action research methodology, more specifically that of Bridget…

The Effect of Teaching with Stories on Associate Degree Nursing Students' Approach to Learning and Reflective Practice

ERIC Educational Resources Information Center

Bradshaw, Vicki

2012-01-01

This action research study is the culmination of several action cycles investigating cognitive information processing and learning strategies based on students approach to learning theory and assessing students' meta-cognitive learning, motivation, and reflective development suggestive of deep learning. The study introduces a reading…

Defining and comparing learning actions in two simulation modalities: students training on a latex arm and each other's arms.

PubMed

Ravik, Monika; Havnes, Anton; Bjørk, Ida Torunn

2017-12-01

To explore, describe and compare learning actions that nursing students used during peripheral vein cannulation training on a latex arm or each other's arms in a clinical skills centre. Simulation-based training is thought to enhance learning and transfer of learning from simulation to the clinical setting and is commonly recommended in nursing education. What students actually are doing during simulation-based training is, however, less explored. The analysis of learning actions used during simulation-based training could contribute to development and improvement of simulation as a learning strategy in nursing education. A qualitative explorative and descriptive research design, involving content analysis of video recordings, was used. Video-supported observation of nine nursing students practicing vein cannulation was conducted in a clinical skills centre in late 2012. The students engaged in various learning actions. Students training on a latex arm used a considerably higher number of learning actions relative to those training on each other's arms. In both groups, students' learning actions consisted mainly of seeking and giving support. The teacher provided students training on each other's arms with detailed feedback regarding insertion of the cannula into the vein, while those training on a latex arm received sparse feedback from the teacher and fellow students. The teacher played an important role in facilitating nursing students' practical skill learning during simulation. The provision of support from both teachers and students should be emphasised to ensure that nursing students' learning needs are met. This study suggest that student nurses may be differently and inadequately prepared in peripheral vein cannulation in two simulation modalities used in the academic setting; training on a latex arm and on each other's arms. © 2017 John Wiley & Sons Ltd.

Convergent transcriptional specializations in the brains of humans and song-learning birds

PubMed Central

Pfenning, Andreas R.; Hara, Erina; Whitney, Osceola; Rivas, Miriam V.; Wang, Rui; Roulhac, Petra L.; Howard, Jason T.; Wirthlin, Morgan; Lovell, Peter V.; Ganapathy, Ganeshkumar; Mouncastle, Jacquelyn; Moseley, M. Arthur; Thompson, J. Will; Soderblom, Erik J.; Iriki, Atsushi; Kato, Masaki; Gilbert, M. Thomas P.; Zhang, Guojie; Bakken, Trygve; Bongaarts, Angie; Bernard, Amy; Lein, Ed; Mello, Claudio V.; Hartemink, Alexander J.; Jarvis, Erich D.

2015-01-01

Song-learning birds and humans share independently evolved similarities in brain pathways for vocal learning that are essential for song and speech and are not found in most other species. Comparisons of brain transcriptomes of song-learning birds and humans relative to vocal nonlearners identified convergent gene expression specializations in specific song and speech brain regions of avian vocal learners and humans. The strongest shared profiles relate bird motor and striatal song-learning nuclei, respectively, with human laryngeal motor cortex and parts of the striatum that control speech production and learning. Most of the associated genes function in motor control and brain connectivity. Thus, convergent behavior and neural connectivity for a complex trait are associated with convergent specialized expression of multiple genes. PMID:25504733

Impaired Formation of Stimulus–Response, But Not Action–Outcome, Associations in Rats with Methamphetamine-Induced Neurotoxicity

PubMed Central

Son, Jong-Hyun; Latimer, Christine; Keefe, Kristen A

2011-01-01

Methamphetamine (METH) induces neurotoxic changes, including partial striatal dopamine depletions, which are thought to contribute to cognitive dysfunction in rodents and humans. The dorsal striatum is implicated in action–outcome (A–O) and stimulus–response (S–R) associations underlying instrumental learning. Thus, the present study examined the long-term consequences of METH-induced neurotoxicity on A–O and S–R associations underlying appetitive instrumental behavior. Rats were pretreated with saline or a neurotoxic regimen of METH (4 × 7.5–10 mg/kg). Rats trained on random ratio (RR) or random interval (RI) schedules of reinforcement were then subjected to outcome devaluation or contingency degradation, followed by an extinction test. All rats then were killed, and brains removed for determination of striatal dopamine loss. The results show that: (1) METH pretreatment induced a partial 45–50% decrease in striatal dopamine tissue content in dorsomedial and dorsolateral striatum; (2) METH-induced neurotoxicity did not alter acquisition of instrumental behavior on either RR or RI schedules; (3) outcome devaluation and contingency degradation similarly decreased responding in saline- and METH-pretreated rats trained on the RR schedule, suggesting intact A–O associations guiding behavior; (4) outcome devaluation after training on the RI schedule decreased extinction responding only in METH-pretreated rats, suggesting impaired S–R associations. Overall, these data suggest that METH-induced neurotoxicity, possibly due to impairment of the function of dorsolateral striatal circuitry, may decrease cognitive flexibility by impairing the ability to automatize behavioral patterns. PMID:21775980

Mechanisms of the psychostimulant effects of caffeine: Implications for substance use disorders

PubMed Central

Ferré, Sergi

2016-01-01

Background The psychostimulant properties of caffeine are reviewed and compared with those of prototypical psychostimulants, able to cause substance use disorders (SUD). Caffeine produces psychomotor activating, reinforcing and arousing effects, which depend on its ability to disinhibit the brake that endogenous adenosine imposes on the ascending dopamine and arousal systems. Objectives A model that considers the striatal adenosine A2A-dopamine D2 receptor heteromer as a key modulator of dopamine-dependent striatal functions (reward-oriented behavior and learning of stimulus-reward and reward-response associations) is introduced, which should explain most of the psychomotor and reinforcing effects of caffeine. Highlights The model can explain the caffeine-induced rotational behavior in rats with unilateral striatal dopamine denervation and the ability of caffeine to reverse the adipsic-aphagic syndrome in dopamine-deficient rodents. The model can also explain the weaker reinforcing effects and low abuse liability of caffeine, compared with prototypical psychostimulants. Finally the model can explain the actual major societal dangers of caffeine: the ability of caffeine to potentiate the addictive and toxic effects of drugs of abuse, with the particularly alarming associations of caffeine (as adulterant) with cocaine, amphetamine derivatives and synthetic cathinones and energy drinks with alcohol; and the higher sensitivity of children and adolescents to the psychostimulants effects of caffeine and its possible increase in the vulnerability to develop SUD. Conclusions The striatal A2A-D2 receptor heteromer constitutes an unequivocal main pharmacological target of caffeine and provides the main mechanisms by which caffeine potentiates the acute and long-term effects of prototypical psychostimulants. PMID:26786412

Models, Definitions, and Outcome Variables of Action Learning: A Synthesis with Implications for HRD

ERIC Educational Resources Information Center

Chenhall, Everon C.; Chermack, Thomas J.

2010-01-01

Purpose: The purpose of this paper is to propose an integrated model of action learning based on an examination of four reviewed action learning models, definitions, and espoused outcomes. Design/methodology/approach: A clear articulation of the strengths and limitations of each model was essential to developing an integrated model, which could be…

Innovation Development--An Action Learning Programme for Medical Scientists and Engineers

ERIC Educational Resources Information Center

Beniston, Lee; Ellwood, Paul; Gold, Jeff; Roberts, James; Thorpe, Richard

2014-01-01

There is increasing evidence that action learning is valuable in a higher education setting. This paper goes on to report a personal development programme, based on principles of critical action learning, where the aim is to equip early-career scientists and engineers working in a university setting with the knowledge, skills and confidence to…

Engaging Students in a Simulated Collaborative Action Research Project: An Evaluation of a Participatory Approach to Learning

ERIC Educational Resources Information Center

Congdon, Graham John; Congdon, Shirley

2011-01-01

This article reports an action research project designed to develop and implement a new participatory learning and teaching approach to enable postgraduate healthcare students to develop skills and knowledge in preparation for undertaking an action research study within their practice setting. The learning and teaching approach was based upon the…

ARPP-16 Is a Striatal-Enriched Inhibitor of Protein Phosphatase 2A Regulated by Microtubule-Associated Serine/Threonine Kinase 3 (Mast 3 Kinase)

PubMed Central

Andrade, Erika C.; Musante, Veronica; Horiuchi, Atsuko; Greengard, Paul; Taylor, Jane R.

2017-01-01

ARPP-16 (cAMP-regulated phospho-protein of molecular weight 16 kDa) is one of several small acid-soluble proteins highly expressed in medium spiny neurons of striatum that are phosphorylated in response to dopamine acting via D1 receptor/protein kinase A (PKA) signaling. We show here that ARPP-16 is also phosphorylated in vitro and in vivo by microtubule-associated serine/threonine kinase 3 (MAST3 kinase), an enzyme of previously unknown function that is enriched in striatum. We find that ARPP-16 interacts directly with the scaffolding A subunit of the serine/threonine protein phosphatase, PP2A, and that phosphorylation of ARPP-16 at Ser46 by MAST3 kinase converts the protein into a selective inhibitor of B55α- and B56δ-containing heterotrimeric forms of PP2A. Ser46 of ARPP-16 is phosphorylated to a high basal stoichiometry in striatum, suggestive of basal inhibition of PP2A in striatal neurons. In support of this hypothesis, conditional knock-out of ARPP-16 in CaMKIIα::cre/floxed ARPP-16/19 mice results in dephosphorylation of a subset of PP2A substrates including phospho-Thr75-DARPP-32, phospho-T308-Akt, and phospho-T202/Y204-ERK. Conditional knock-out of ARPP-16/19 is associated with increased motivation measured on a progressive ratio schedule of food reinforcement, yet an attenuated locomotor response to acute cocaine. Our previous studies have shown that ARPP-16 is phosphorylated at Ser88 by PKA. Activation of PKA in striatal slices leads to phosphorylation of Ser88, and this is accompanied by marked dephosphorylation of Ser46. Together, these studies suggest that phospho-Ser46-ARPP-16 acts to basally control PP2A in striatal medium spiny neurons but that dopamine acting via PKA inactivates ARPP-16 leading to selective potentiation of PP2A signaling. SIGNIFICANCE STATEMENT We describe a novel mechanism of signal transduction enriched in medium spiny neurons of striatum that likely mediates effects of the neurotransmitter dopamine acting on these cells. We find that the protein ARPP-16, which is highly expressed in striatal medium spiny neurons, acts as a selective inhibitor of certain forms of the serine/threonine protein phosphatase, PP2A, when phosphorylated by the kinase, MAST3. Under basal conditions, ARPP-16 is phosphorylated by MAST3 to a very high stoichiometry. However, the actions of MAST3 are antagonized by dopamine and cAMP-regulated signaling leading to disinhibition of ARPP-16 and increased PP2A action. PMID:28167675

ARPP-16 Is a Striatal-Enriched Inhibitor of Protein Phosphatase 2A Regulated by Microtubule-Associated Serine/Threonine Kinase 3 (Mast 3 Kinase).

PubMed

Andrade, Erika C; Musante, Veronica; Horiuchi, Atsuko; Matsuzaki, Hideo; Brody, A Harrison; Wu, Terence; Greengard, Paul; Taylor, Jane R; Nairn, Angus C

2017-03-08

ARPP-16 (cAMP-regulated phospho-protein of molecular weight 16 kDa) is one of several small acid-soluble proteins highly expressed in medium spiny neurons of striatum that are phosphorylated in response to dopamine acting via D1 receptor/protein kinase A (PKA) signaling. We show here that ARPP-16 is also phosphorylated in vitro and in vivo by microtubule-associated serine/threonine kinase 3 (MAST3 kinase), an enzyme of previously unknown function that is enriched in striatum. We find that ARPP-16 interacts directly with the scaffolding A subunit of the serine/threonine protein phosphatase, PP2A, and that phosphorylation of ARPP-16 at Ser46 by MAST3 kinase converts the protein into a selective inhibitor of B55α- and B56δ-containing heterotrimeric forms of PP2A. Ser46 of ARPP-16 is phosphorylated to a high basal stoichiometry in striatum, suggestive of basal inhibition of PP2A in striatal neurons. In support of this hypothesis, conditional knock-out of ARPP-16 in CaMKIIα::cre/floxed ARPP-16/19 mice results in dephosphorylation of a subset of PP2A substrates including phospho-Thr75-DARPP-32, phospho-T308-Akt, and phospho-T202/Y204-ERK. Conditional knock-out of ARPP-16/19 is associated with increased motivation measured on a progressive ratio schedule of food reinforcement, yet an attenuated locomotor response to acute cocaine. Our previous studies have shown that ARPP-16 is phosphorylated at Ser88 by PKA. Activation of PKA in striatal slices leads to phosphorylation of Ser88, and this is accompanied by marked dephosphorylation of Ser46. Together, these studies suggest that phospho-Ser46-ARPP-16 acts to basally control PP2A in striatal medium spiny neurons but that dopamine acting via PKA inactivates ARPP-16 leading to selective potentiation of PP2A signaling. SIGNIFICANCE STATEMENT We describe a novel mechanism of signal transduction enriched in medium spiny neurons of striatum that likely mediates effects of the neurotransmitter dopamine acting on these cells. We find that the protein ARPP-16, which is highly expressed in striatal medium spiny neurons, acts as a selective inhibitor of certain forms of the serine/threonine protein phosphatase, PP2A, when phosphorylated by the kinase, MAST3. Under basal conditions, ARPP-16 is phosphorylated by MAST3 to a very high stoichiometry. However, the actions of MAST3 are antagonized by dopamine and cAMP-regulated signaling leading to disinhibition of ARPP-16 and increased PP2A action. Copyright © 2017 the authors 0270-6474/17/372709-14$15.00/0.

Striatal MPP+ levels do not necessarily correlate with striatal dopamine levels after MPTP treatment in mice.

PubMed

Vaglini, F; Fascetti, F; Tedeschi, D; Cavalletti, M; Fornai, F; Corsini, G U

1996-06-01

The present study offers confirmation of the fact that an MAO-B inhibitor, (-) deprenyl and a DA uptake blocker, GBR-12909, prevent MPTP-induced striatal DA decrease. This protective effect is accompanied by an almost complete prevention of MPP+ production induced by (-) deprenyl and an accelerated MPP+ clearance induced by GBR-12909 within the striatum. Similarly, the MPTP toxicity enhancers, DDC and acetaldehyde, both increase striatal MPP+ levels, as previously reported. On the contrary, the treatment with MK 801, although uneffective in preventing the long-term MPTP-induced striatal DA decrease, causes an increase in the striatal amount of MPP+. In a similar way, the administration of nicotine in combination with MPTP produces a significant increase in the levels of striatal MPP+, which does not elicit any effect on striatal DA. The effect of clonidine is consistent with these results and in sharp contrast with the current belief that a direct relationship exists between striatal MPP+ concentrations and the degree of MPTP-induced depletion of striatal DA. In this study, using different treatments, we failed to confirm the correlation between MPP+ striatal levels and dopaminergic lesions after MPTP administration in mice. We suggest that this correlation is not a rule and exceptions may depend on a different compartimentalization of the toxic metabolite.

Robots show us how to teach them: feedback from robots shapes tutoring behavior during action learning.

PubMed

Vollmer, Anna-Lisa; Mühlig, Manuel; Steil, Jochen J; Pitsch, Karola; Fritsch, Jannik; Rohlfing, Katharina J; Wrede, Britta

2014-01-01

Robot learning by imitation requires the detection of a tutor's action demonstration and its relevant parts. Current approaches implicitly assume a unidirectional transfer of knowledge from tutor to learner. The presented work challenges this predominant assumption based on an extensive user study with an autonomously interacting robot. We show that by providing feedback, a robot learner influences the human tutor's movement demonstrations in the process of action learning. We argue that the robot's feedback strongly shapes how tutors signal what is relevant to an action and thus advocate a paradigm shift in robot action learning research toward truly interactive systems learning in and benefiting from interaction.

Robots Show Us How to Teach Them: Feedback from Robots Shapes Tutoring Behavior during Action Learning

PubMed Central

Vollmer, Anna-Lisa; Mühlig, Manuel; Steil, Jochen J.; Pitsch, Karola; Fritsch, Jannik; Rohlfing, Katharina J.; Wrede, Britta

2014-01-01

Robot learning by imitation requires the detection of a tutor's action demonstration and its relevant parts. Current approaches implicitly assume a unidirectional transfer of knowledge from tutor to learner. The presented work challenges this predominant assumption based on an extensive user study with an autonomously interacting robot. We show that by providing feedback, a robot learner influences the human tutor's movement demonstrations in the process of action learning. We argue that the robot's feedback strongly shapes how tutors signal what is relevant to an action and thus advocate a paradigm shift in robot action learning research toward truly interactive systems learning in and benefiting from interaction. PMID:24646510

Striatal dopamine dynamics in mice following acute and repeated toluene exposure.

PubMed

Apawu, Aaron K; Mathews, Tiffany A; Bowen, Scott E

2015-01-01

The abused inhalant toluene has potent behavioral effects, but only recently has progress been made in understanding the neurochemical actions that mediate the action of toluene in the brain. Available evidence suggests that toluene inhalation alters dopamine (DA) neurotransmission, but toluene's mechanism of action is unknown. The present study evaluated the effect of acute and repeated toluene inhalation (0, 2,000, or 4,000 ppm) on locomotor activity as well as striatal DA release and uptake using slice fast-scan cyclic voltammetry. Acutely, 2,000 and 4,000 ppm toluene increased locomotor activity, while neurochemically only 4,000 ppm toluene potentiated electrically evoked DA release across the caudate-putamen and the nucleus accumbens. Repeated administration of toluene resulted in sensitization to toluene's locomotor activity effects. Brain slices obtained from mice repeatedly exposed to toluene demonstrated no difference in stimulated DA release in the caudate-putamen as compared to control animals. Repeated exposure to 2,000 and 4,000 ppm toluene caused a concentration-dependent decrease of 25-50 % in evoked DA release in the nucleus accumbens core and shell relative to air-exposed mice. These voltammetric neurochemical findings following repeated toluene exposure suggest that there may be a compensatory downregulation of the DA system. Acute or repeated toluene exposure had no effect on the DA uptake kinetics. Taken together, these results demonstrate that acute toluene inhalation potentiates DA release, while repeated toluene exposure attenuates DA release in the nucleus accumbens only.

Anodal Transcranial Direct Current Stimulation Enhances Survival and Integration of Dopaminergic Cell Transplants in a Rat Parkinson Model

PubMed Central

Winkler, Christian; Reis, Janine; Hoffmann, Nadin; Gellner, Anne-Kathrin; Münkel, Christian; Curado, Marco Rocha

2017-01-01

Abstract Restorative therapy concepts, such as cell based therapies aim to restitute impaired neurotransmission in neurodegenerative diseases. New strategies to enhance grafted cell survival and integration are still needed to improve functional recovery. Anodal direct current stimulation (DCS) promotes neuronal activity and secretion of the trophic factor BDNF in the motor cortex. Transcranial DCS applied to the motor cortex transiently improves motor symptoms in Parkinson’s disease (PD) patients. In this proof-of-concept study, we combine cell based therapy and noninvasive neuromodulation to assess whether neurotrophic support via transcranial DCS would enhance the restitution of striatal neurotransmission by fetal dopaminergic transplants in a rat Parkinson model. Transcranial DCS was applied daily for 20 min on 14 consecutive days following striatal transplantation of fetal ventral mesencephalic (fVM) cells derived from transgenic rat embryos ubiquitously expressing GFP. Anodal but not cathodal transcranial DCS significantly enhanced graft survival and dopaminergic reinnervation of the surrounding striatal tissue relative to sham stimulation. Behavioral recovery was more pronounced following anodal transcranial DCS, and behavioral effects correlated with the degree of striatal innervation. Our results suggest anodal transcranial DCS may help advance cell-based restorative therapies in neurodegenerative diseases. In particular, such an assistive approach may be beneficial for the already established cell transplantation therapy in PD. PMID:28966974

Orbitofrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions

PubMed Central

Gremel, Christina M.; Costa, Rui M.

2014-01-01

Shifting between goal-directed and habitual actions allows for efficient and flexible decision-making. Here we demonstrate a novel, within-subject instrumental lever-pressing paradigm where mice shift between goal-directed and habitual actions. We identify a role for orbitofrontal cortex (OFC) in actions following outcome-revaluation, and confirm that dorsal medial (DMS) and lateral striatum (DLS) mediate different action strategies. In-vivo simultaneous recordings of OFC, DMS, and DLS neuronal ensembles during shifting reveal that the same neurons display different activity depending on whether presses are goal-directed or habitual, with DMS and OFC becoming more—and DLS less-engaged during goal-directed actions. Importantly, the magnitude of neural activity changes in OFC following changes in outcome value positively correlates with the level of goal-directed behavior. Chemogenetic inhibition of OFC disruptsgoal-directed actions, while optogenetic activation of OFC specifically increases goal-directed pressing. They also reveal a role for OFC in action revaluation, which has implications for understanding compulsive behavior. PMID:23921250

Dissociable Learning Processes Underlie Human Pain Conditioning

PubMed Central

Zhang, Suyi; Mano, Hiroaki; Ganesh, Gowrishankar; Robbins, Trevor; Seymour, Ben

2016-01-01

Summary Pavlovian conditioning underlies many aspects of pain behavior, including fear and threat detection [1], escape and avoidance learning [2], and endogenous analgesia [3]. Although a central role for the amygdala is well established [4], both human and animal studies implicate other brain regions in learning, notably ventral striatum and cerebellum [5]. It remains unclear whether these regions make different contributions to a single aversive learning process or represent independent learning mechanisms that interact to generate the expression of pain-related behavior. We designed a human parallel aversive conditioning paradigm in which different Pavlovian visual cues probabilistically predicted thermal pain primarily to either the left or right arm and studied the acquisition of conditioned Pavlovian responses using combined physiological recordings and fMRI. Using computational modeling based on reinforcement learning theory, we found that conditioning involves two distinct types of learning process. First, a non-specific “preparatory” system learns aversive facial expressions and autonomic responses such as skin conductance. The associated learning signals—the learned associability and prediction error—were correlated with fMRI brain responses in amygdala-striatal regions, corresponding to the classic aversive (fear) learning circuit. Second, a specific lateralized system learns “consummatory” limb-withdrawal responses, detectable with electromyography of the arm to which pain is predicted. Its related learned associability was correlated with responses in ipsilateral cerebellar cortex, suggesting a novel computational role for the cerebellum in pain. In conclusion, our results show that the overall phenotype of conditioned pain behavior depends on two dissociable reinforcement learning circuits. PMID:26711494

A Collaborative Action Research Approach to Professional Learning

ERIC Educational Resources Information Center

Bleicher, Robert E.

2014-01-01

The field of professional development is moving towards the notion of professional learning, highlighting the active learning role that teachers play in changing their knowledge bases, beliefs and practice. This article builds on this idea and argues for creating professional learning that is guided by a collaborative action research (CAR)…

Protective effect of Calendula officinalis Linn. flowers against 3-nitropropionic acid induced experimental Huntington's disease in rats.

PubMed

Shivasharan, B D; Nagakannan, Pandian; Thippeswamy, Boreddy Shivanandappa; Veerapur, Veeresh Prabakar; Bansal, Punit; Unnikrishnan, Mazhuvancherry K

2013-10-01

Oxidative stress (OS) and nitric oxide mechanisms have been recently proposed in 3-nitropropionic acid (3-NP)-induced neurotoxicity. The compounds, having antioxidant, anti-inflammatory and estrogenic effects, have been suggested for neuroprotection in different experimental models. Calendula officinalis Linn. flower extract (COE) is known for its potent antioxidant, anti-inflammatory, estrogenic and neuroprotective activities. Hence, the present study was designed to evaluate the neuroprotective effect of COE on 3-NP-induced neurotoxicity in rats by observing behavioral changes, OS and striatal damage in rat brain. Adult female Wistar rats were pretreated with vehicle or COE (100 and 200 mg/kg) for 7 days, followed by cotreatment with 3-NP (15 mg/kg, intraperitoneally) for the next 7 days. At the end of the treatment schedule, rats were evaluated for alterations in sensory motor functions and short-term memory. Animals were sacrificed and brain homogenates were used for the estimation of lipid peroxidation (LPO), glutathione, total thiols, glutathione S-transferase, catalase and nitrite. A set of brain slices was used for the evaluation of neuronal damage in the striatal region of the brain. 3-NP caused significant alterations in animal behavior, oxidative defense system evidenced by raised levels of LPO and nitrite concentration, and depletion of antioxidant levels. It also produced a loss of neuronal cells in the striatal region. Treatment with COE significantly attenuated behavioral alterations, oxidative damage and striatal neuronal loss in 3-NP-treated animals. The present study shows that COE is protective against 3-NP-induced neurotoxicity in rats. The antioxidant, anti-inflammatory and estrogenic properties of COE may be responsible for its neuroprotective action.

Existence and control of Go/No-Go decision transition threshold in the striatum.

PubMed

Bahuguna, Jyotika; Aertsen, Ad; Kumar, Arvind

2015-04-01

A typical Go/No-Go decision is suggested to be implemented in the brain via the activation of the direct or indirect pathway in the basal ganglia. Medium spiny neurons (MSNs) in the striatum, receiving input from cortex and projecting to the direct and indirect pathways express D1 and D2 type dopamine receptors, respectively. Recently, it has become clear that the two types of MSNs markedly differ in their mutual and recurrent connectivities as well as feedforward inhibition from FSIs. Therefore, to understand striatal function in action selection, it is of key importance to identify the role of the distinct connectivities within and between the two types of MSNs on the balance of their activity. Here, we used both a reduced firing rate model and numerical simulations of a spiking network model of the striatum to analyze the dynamic balance of spiking activities in D1 and D2 MSNs. We show that the asymmetric connectivity of the two types of MSNs renders the striatum into a threshold device, indicating the state of cortical input rates and correlations by the relative activity rates of D1 and D2 MSNs. Next, we describe how this striatal threshold can be effectively modulated by the activity of fast spiking interneurons, by the dopamine level, and by the activity of the GPe via pallidostriatal backprojections. We show that multiple mechanisms exist in the basal ganglia for biasing striatal output in favour of either the `Go' or the `No-Go' pathway. This new understanding of striatal network dynamics provides novel insights into the putative role of the striatum in various behavioral deficits in patients with Parkinson's disease, including increased reaction times, L-Dopa-induced dyskinesia, and deep brain stimulation-induced impulsivity.

Existence and Control of Go/No-Go Decision Transition Threshold in the Striatum

PubMed Central

Bahuguna, Jyotika; Aertsen, Ad; Kumar, Arvind

2015-01-01

A typical Go/No-Go decision is suggested to be implemented in the brain via the activation of the direct or indirect pathway in the basal ganglia. Medium spiny neurons (MSNs) in the striatum, receiving input from cortex and projecting to the direct and indirect pathways express D1 and D2 type dopamine receptors, respectively. Recently, it has become clear that the two types of MSNs markedly differ in their mutual and recurrent connectivities as well as feedforward inhibition from FSIs. Therefore, to understand striatal function in action selection, it is of key importance to identify the role of the distinct connectivities within and between the two types of MSNs on the balance of their activity. Here, we used both a reduced firing rate model and numerical simulations of a spiking network model of the striatum to analyze the dynamic balance of spiking activities in D1 and D2 MSNs. We show that the asymmetric connectivity of the two types of MSNs renders the striatum into a threshold device, indicating the state of cortical input rates and correlations by the relative activity rates of D1 and D2 MSNs. Next, we describe how this striatal threshold can be effectively modulated by the activity of fast spiking interneurons, by the dopamine level, and by the activity of the GPe via pallidostriatal backprojections. We show that multiple mechanisms exist in the basal ganglia for biasing striatal output in favour of either the `Go' or the `No-Go' pathway. This new understanding of striatal network dynamics provides novel insights into the putative role of the striatum in various behavioral deficits in patients with Parkinson's disease, including increased reaction times, L-Dopa-induced dyskinesia, and deep brain stimulation-induced impulsivity. PMID:25910230

A neural model of hippocampal-striatal interactions in associative learning and transfer generalization in various neurological and psychiatric patients

PubMed Central

Moustafa, Ahmed A.; Keri, Szabolcs; Herzallah, Mohammad M.; Myers, Catherine E.; Gluck, Mark A.

2010-01-01

Building on our previous neurocomputational models of basal ganglia and hippocampal-region function (and their modulation by dopamine and acetylcholine, respectively), we show here how an integration of these models can inform our understanding of the interaction between the basal ganglia and hippocampal region in associative learning and transfer generalization across various patient populations. As a common test bed for exploring interactions between these brain regions and neuromodulators, we focus on the acquired equivalence task, an associative learning paradigm in which stimuli that have been associated with the same outcome acquire a functional similarity such that subsequent generalization between these stimuli increases. This task has been used to test cognitive dysfunction in various patient populations with damages to the hippocampal region and basal ganglia, including studies of patients with Parkinson’s disease (PD), schizophrenia, basal forebrain amnesia, and hippocampal atrophy. Simulation results show that damage to the hippocampal region—as in patients with hippocampal atrophy (HA), hypoxia, mild Alzheimer’s (AD), or schizophrenia—leads to intact associative learning but impaired transfer generalization performance. Moreover, the model demonstrates how PD and anterior communicating artery (ACoA) aneurysm—two very different brain disorders that affect different neural mechanisms—can have similar effects on acquired equivalence performance. In particular, the model shows that simulating a loss of dopamine function in the basal ganglia module (as in PD) leads to slow acquisition learning but intact transfer generalization. Similarly, the model shows that simulating the loss of acetylcholine in the hippocampal region (as in ACoA aneurysm) also results in slower acquisition learning. We argue from this that changes in associative learning of stimulus-action pathways (in the basal ganglia) or changes in the learning of stimulus representations (in the hippocampal region) can have similar functional effects. PMID:20728258

Facilitating the Learning Process in Design-Based Learning Practices: An Investigation of Teachers' Actions in Supervising Students

ERIC Educational Resources Information Center

Gómez Puente, S. M.; van Eijck, M.; Jochems, W.

2013-01-01

Background: In research on design-based learning (DBL), inadequate attention is paid to the role the teacher plays in supervising students in gathering and applying knowledge to design artifacts, systems, and innovative solutions in higher education. Purpose: In this study, we examine whether teacher actions we previously identified in the DBL…

The Representation of Motor (Inter)action, States of Action, and Learning: Three Perspectives on Motor Learning by Way of Imagery and Execution

PubMed Central

Frank, Cornelia; Schack, Thomas

2017-01-01

Learning in intelligent systems is a result of direct and indirect interaction with the environment. While humans can learn by way of different states of (inter)action such as the execution or the imagery of an action, their unique potential to induce brain- and mind-related changes in the motor action system is still being debated. The systematic repetition of different states of action (e.g., physical and/or mental practice) and their contribution to the learning of complex motor actions has traditionally been approached by way of performance improvements. More recently, approaches highlighting the role of action representation in the learning of complex motor actions have evolved and may provide additional insight into the learning process. In the present perspective paper, we build on brain-related findings and sketch recent research on learning by way of imagery and execution from a hierarchical, perceptual-cognitive approach to motor control and learning. These findings provide insights into the learning of intelligent systems from a perceptual-cognitive, representation-based perspective and as such add to our current understanding of action representation in memory and its changes with practice. Future research should build bridges between approaches in order to more thoroughly understand functional changes throughout the learning process and to facilitate motor learning, which may have particular importance for cognitive systems research in robotics, rehabilitation, and sports. PMID:28588510

The Basal Ganglia and Adaptive Motor Control

NASA Astrophysics Data System (ADS)

Graybiel, Ann M.; Aosaki, Toshihiko; Flaherty, Alice W.; Kimura, Minoru

1994-09-01

The basal ganglia are neural structures within the motor and cognitive control circuits in the mammalian forebrain and are interconnected with the neocortex by multiple loops. Dysfunction in these parallel loops caused by damage to the striatum results in major defects in voluntary movement, exemplified in Parkinson's disease and Huntington's disease. These parallel loops have a distributed modular architecture resembling local expert architectures of computational learning models. During sensorimotor learning, such distributed networks may be coordinated by widely spaced striatal interneurons that acquire response properties on the basis of experienced reward.

Toward Solutions: The Work of the Chemistry Action-Research Group. Learning in Science Project. Working Paper No. 35.

ERIC Educational Resources Information Center

Osborne, Roger; And Others

In the action-research phase of the Learning in Science Project, four groups of people worked on problems identified in the project's second (in-depth) phase. The Chemistry Action-Research Group considered problems related to the teaching and learning of ideas associated with particles and physical/chemical changes. Based on findings during the…

The role of dopamine in positive and negative prediction error utilization during incidental learning - Insights from Positron Emission Tomography, Parkinson's disease and Huntington's disease.

PubMed

Mathar, David; Wilkinson, Leonora; Holl, Anna K; Neumann, Jane; Deserno, Lorenz; Villringer, Arno; Jahanshahi, Marjan; Horstmann, Annette

2017-05-01

Incidental learning of appropriate stimulus-response associations is crucial for optimal functioning within our complex environment. Positive and negative prediction errors (PEs) serve as neural teaching signals within distinct ('direct'/'indirect') dopaminergic pathways to update associations and optimize subsequent behavior. Using a computational reinforcement learning model, we assessed learning from positive and negative PEs on a probabilistic task (Weather Prediction Task - WPT) in three populations that allow different inferences on the role of dopamine (DA) signals: (1) Healthy volunteers that repeatedly underwent [ 11 C]raclopride Positron Emission Tomography (PET), allowing for assessment of striatal DA release during learning, (2) Parkinson's disease (PD) patients tested both on and off L-DOPA medication, (3) early Huntington's disease (HD) patients, a disease that is associated with hyper-activation of the 'direct' pathway. Our results show that learning from positive and negative feedback on the WPT is intimately linked to different aspects of dopaminergic transmission. In healthy individuals, the difference in [ 11 C]raclopride binding potential (BP) as a measure for striatal DA release was linearly associated with the positive learning rate. Further, asymmetry between baseline DA tone in the left and right ventral striatum was negatively associated with learning from positive PEs. Female patients with early HD exhibited exaggerated learning rates from positive feedback. In contrast, dopaminergic tone predicted learning from negative feedback, as indicated by an inverted u-shaped association observed with baseline [ 11 C]raclopride BP in healthy controls and the difference between PD patients' learning rate on and off dopaminergic medication. Thus, the ability to learn from positive and negative feedback is a sensitive marker for the integrity of dopaminergic signal transmission in the 'direct' and 'indirect' dopaminergic pathways. The present data are interesting beyond clinical context in that imbalances of dopaminergic signaling have not only been observed for neurological and psychiatric conditions but also been proposed for obesity and adolescence. Copyright © 2016 Elsevier Ltd. All rights reserved.

Using Participatory Action Research to Increase Learning Transfer of Recovery-Based Principles

ERIC Educational Resources Information Center

Barish, Diane J.

2009-01-01

This study questions whether or not participatory action research is an effective and practical method for increasing learning transfer of recovery-based principles. The participants (N = 250) were ethnically and educationally diverse clinicians, in an urban state mental health institute. The Self-Assessment of Recovery-Based Behaviors survey ( n…

The Role of the Dorsal Anterior Cingulate in Evaluating Behavior for Achieving Gains and Avoiding Losses

ERIC Educational Resources Information Center

Magno, Elena; Simoes-Franklin, Cristina; Robertson, Ian H.; Garavan, Hugh

2009-01-01

Effective goal-directed behavior relies on a network of regions including anterior cingulate cortex and ventral striatum to learn from negative outcomes in order to improve performance. We employed fMRI to determine if this frontal-striatal system is also involved in instances of behavior that do not presume negative circumstances. Participants…

Model-free and model-based reward prediction errors in EEG.

PubMed

Sambrook, Thomas D; Hardwick, Ben; Wills, Andy J; Goslin, Jeremy

2018-05-24

Learning theorists posit two reinforcement learning systems: model-free and model-based. Model-based learning incorporates knowledge about structure and contingencies in the world to assign candidate actions with an expected value. Model-free learning is ignorant of the world's structure; instead, actions hold a value based on prior reinforcement, with this value updated by expectancy violation in the form of a reward prediction error. Because they use such different learning mechanisms, it has been previously assumed that model-based and model-free learning are computationally dissociated in the brain. However, recent fMRI evidence suggests that the brain may compute reward prediction errors to both model-free and model-based estimates of value, signalling the possibility that these systems interact. Because of its poor temporal resolution, fMRI risks confounding reward prediction errors with other feedback-related neural activity. In the present study, EEG was used to show the presence of both model-based and model-free reward prediction errors and their place in a temporal sequence of events including state prediction errors and action value updates. This demonstration of model-based prediction errors questions a long-held assumption that model-free and model-based learning are dissociated in the brain. Copyright © 2018 Elsevier Inc. All rights reserved.

[The Influence of the Functioning of Brain Regulatory Systems onto the Voluntary Regulation of Cognitive Performance in Children. Report 2. Neuropsychological and Electrophysiological Assessment of Brain Regulatory Functions in Children Aged 10-12 with Learning Difficulties].

PubMed

Semenova, O A; Machinskaya, R I

2015-01-01

A total number of 172 children aged 10-12 were electrophysiologically and neuropsychologically assessed in order to analyze the influence of the functioning of brain regulatory systems onto the voluntary regulation of cognitive performance during the preteen years. EEG patterns associated with the nonoptimal functioning of brain regulatory systems, particularly fronto-thalamic, limbic and fronto-striatal structures were significantly more often observed in children with learning and behavioral difficulties, as compared to the control group. Neuropsychological assessment showed that the nonoptimal functioning of different brain regulatory systems specifically affect the voluntary regulation of cognitive performance. Children with EEG patterns of fronto-thalamic nonoptimal functioning demonstrated poor voluntary regulation such as impulsiveness and difficulties in continuing the same algorithms. Children with EEG patterns of limbic nonoptimal functioning showed a less pronounced executive dysfunction manifested only in poor switching between program units within a task. Children with EEG patterns of fronto-striatal nonoptimal functioning struggled with such executive dysfunctions as motor and tactile perseverations and emotional-motivational deviations such as poor motivation and communicative skills.

The prefrontal cortex: a target for antipsychotic drugs.

PubMed

Artigas, F

2010-01-01

At therapeutic doses, classical antipsychotic drugs occupy a large proportion of subcortical dopamine D2 receptors, whereas atypical antipsychotics preferentially occupy cortical 5-HT(2) receptors. However, the exact cellular and network basis of their therapeutic action is not fully understood. To review the mechanism of action of antipsychotic drugs with a particular emphasis on their action in the prefrontal cortex (PFC). The PFC controls a large number of higher brain functions altered in schizophrenia. Histological studies indicate the presence of a large proportion of PFC neurons expressing monoaminergic receptors sensitive to the action of atypical- and to a lesser extentclassical antipsychotic drugs. Functional studies also indicate that both drug families act at PFC level. Atypical antipsychotic drugs likely exert their therapeutic activity by a preferential action on PFC neurons, thus modulating the PFC output to basal ganglia circuits. Classical antipsychotics also interact with these PFC targets in addition to blocking massively striatal D2 receptors.

Striatal dopamine transporter binding for predicting the development of delayed neuropsychological sequelae in suicide attempters by carbon monoxide poisoning: A SPECT study.

PubMed

Yang, Kai-Chun; Ku, Hsiao-Lun; Wu, Chia-Liang; Wang, Shyh-Jen; Yang, Chen-Chang; Deng, Jou-Fang; Lee, Ming-Been; Chou, Yuan-Hwa

2011-12-30

Carbon monoxide poisoning (COP) after charcoal burning results in delayed neuropsychological sequelae (DNS), which show clinical resemblance to Parkinson's disease, without adequate predictors at present. This study examined the role of dopamine transporter (DAT) binding for the prediction of DNS. Twenty-seven suicide attempters with COP were recruited. Seven of them developed DNS, while the remainder did not. The striatal DAT binding was measured by single photon emission computed tomography with (99m)Tc-TRODAT. The specific uptake ratio was derived based on a ratio equilibrium model. Using a logistic regression model, multiple clinical variables were examined as potential predictors for DNS. COP patients with DNS had a lower binding on left striatal DAT binding than patients without DNS. Logistic regression analysis showed that a combination of initial loss of consciousness and lower left striatal DAT binding predicted the development of DNS. Our data indicate that the left striatal DAT binding could help to predict the development of DNS. This finding not only demonstrates the feasibility of brain imaging techniques for predicting the development of DNS but will also help clinicians to improve the quality of care for COP patients. 2011 Elsevier Ireland Ltd. All rights reserved.

Bimodal control of stimulated food intake by the endocannabinoid system.

PubMed

Bellocchio, Luigi; Lafenêtre, Pauline; Cannich, Astrid; Cota, Daniela; Puente, Nagore; Grandes, Pedro; Chaouloff, Francis; Piazza, Pier Vincenzo; Marsicano, Giovanni

2010-03-01

Activation of cannabinoid type-1 receptors (CB(1)) is universally recognized as a powerful endogenous orexigenic signal, but the detailed underlying neuronal mechanisms are not fully understood. Using combined genetic and pharmacological approaches in mice, we found that ventral striatal CB(1) receptors exerted a hypophagic action through inhibition of GABAergic transmission. Conversely, brain CB(1) receptors modulating excitatory transmission mediated the well-known orexigenic effects of cannabinoids.

Face-Name Association Learning and Brain Structural Substrates in Alcoholism

PubMed Central

Pitel, Anne-Lise; Chanraud, Sandra; Rohlfing, Torsten; Pfefferbaum, Adolf; Sullivan, Edith V.

2011-01-01

Background Associative learning is required for face-name association and is impaired in alcoholism, but the cognitive processes and brain structural components underlying this deficit remain unclear. It is also unknown whether prompting alcoholics to implement a deep level of processing during face-name encoding would enhance performance. Methods Abstinent alcoholics and controls performed a levels-of-processing face-name learning task. Participants indicated whether the face was that of an honest person (deep encoding) or that of a man (shallow encoding). Retrieval was examined using an associative (face-name) recognition task and a single-item (face or name only) recognition task. Participants also underwent a 3T structural MRI. Results Compared with controls, alcoholics had poorer associative and single-item recognition, each impaired to the same extent. Level of processing at encoding had little effect on recognition performance but affected reaction time. Correlations with brain volumes were generally modest and based primarily on reaction time in alcoholics, where the deeper the processing at encoding, the more restricted the correlations with brain volumes. In alcoholics, longer control task reaction times correlated modestly with volumes across several anterior to posterior brain regions; shallow encoding correlated with calcarine and striatal volumes; deep encoding correlated with precuneus and parietal volumes; associative recognition RT correlated with cerebellar volumes. In controls, poorer associative recognition with deep encoding correlated significantly with smaller volumes of frontal and striatal structures. Conclusions Despite prompting, alcoholics did not take advantage of encoding memoranda at a deep level to enhance face-name recognition accuracy. Nonetheless, conditions of deeper encoding resulted in faster reaction times and more specific relations with regional brain volumes than did shallow encoding. The normal relation between associative recognition and corticostriatal volumes was not present in alcoholics. Rather, their speeded reaction time occurred at the expense of accuracy and was related most robustly to cerebellar volumes. PMID:22509954

Facilitating Systemic Research and Learning and the Transition to Agricultural Sustainability

ERIC Educational Resources Information Center

Eksvard, Karin

2010-01-01

This article focuses on how a facilitated process of triple loop learning can enable transition toward more sustainable forms of farming. The article is a case-based study of Participatory Learning and Action Research with organic tomato growers in Malardalen, Sweden. The importance of negotiating learning and action, capacity building, and…

MK-801 protection against methamphetamine-induced striatal dopamine terminal injury is associated with attenuated dopamine overflow.

PubMed

Weihmuller, F B; O'Dell, S J; Marshall, J F

1992-06-01

Repeated administrations of methamphetamine (m-AMPH) produce high extracellular levels of dopamine (DA) and subsequent striatal DA terminal damage. Pharmacological blockade of N-methyl-D-aspartate (NMDA) receptors has been shown previously to prevent m-AMPH-induced striatal DA terminal injury, but the mechanism for this protection is unclear. In the present study, in vivo microdialysis was used to determine the effects of blockade of NMDA receptors with the noncompetitive antagonist MK-801 on m-AMPH-induced striatal DA overflow. Four injections of MK-801 (0.5 mg/kg, ip) alone did not significantly change extracellular striatal DA concentrations from pretreatment values. Four treatments with m-AMPH (4.0 mg/kg, sc at 2-hr intervals) increased striatal DA overflow, and the overflow was particularly extensive following the fourth injection. This m-AMPH regimen produced a 40% reduction in striatal DA tissue content 1 week later. Treatment with MK-801 15 min before each of the four m-AMPH injections or prior to only the last two m-AMPH administrations attenuated the m-AMPH-induced increase in striatal DA overflow and protected completely against striatal DA depletions. Other MK-801 treatment regimens less effectively reduced the m-AMPH-induced striatal DA efflux and were ineffective in protecting against striatal DA depletions. Linear regression analysis indicated that cumulative DA overflow was strongly predictive (r = -.68) of striatal DA tissue levels measured one week later. These findings suggest that the extensive DA overflow seen during a neurotoxic regimen of m-AMPH is a crucial component of the subsequent neurotoxicity.(ABSTRACT TRUNCATED AT 250 WORDS)

Geldanamycin attenuates 3-nitropropionic acid-induced apoptosis and JNK activation through the expression of HSP 70 in striatal cells

PubMed Central

CHOI, YONG-JOON; KIM, NAM HO; LIM, MAN SUP; LEE, HEE JAE; KIM, SUNG SOO; CHUN, WANJOO

2014-01-01

Although selective striatal cell death is a characteristic hallmark in the pathogenesis of Huntington’s disease (HD), the underlying mechanism of striatal susceptibility remains to be clarified. Heat shock proteins (HSPs) have been reported to suppress the aggregate formation of mutant huntingtin and concurrent striatal cell death. In a previous study, we observed that heat shock transcription factor 1 (HSF1), a major transcription factor of HSPs, significantly attenuated 3-nitropropionic acid (3NP)-induced reactive oxygen species (ROS) production and apoptosis through the expression of HSP 70 in striatal cells. To investigate the differential roles of HSPs in 3NP-induced striatal cell death, the effect of geldanamycin (GA), an HSP 90 inhibitor, was examined in 3NP-stimulated striatal cells. GA significantly attenuated 3NP-induced striatal apoptosis and ROS production with an increased expression of HSP 70. Triptolide (TL), an HSP 70 inhibitor, abolished GA-mediated protective effects in 3NP-stimulated striatal cells. To understand the underlying mechanism by which GA-mediated HSP 70 protects striatal cells against 3NP stimulation, the involvement of various signaling pathways was examined. GA significantly attenuated 3NP-induced c-Jun N-terminal kinase (JNK) phosphorylation and subsequent c-Jun phosphorylation in striatal cells. Taken together, the present study demonstrated that GA exhibits protective properties against 3NP-induced apoptosis and JNK activation via the induction of HSP 70 in striatal cells, suggesting that expression of HSP 70 may be a valuable therapeutic target in the treatment of HD. PMID:24756698

Geldanamycin attenuates 3‑nitropropionic acid‑induced apoptosis and JNK activation through the expression of HSP 70 in striatal cells.

PubMed

Choi, Yong-Joon; Kim, Nam Ho; Lim, Man Sup; Lee, Hee Jae; Kim, Sung Soo; Chun, Wanjoo

2014-07-01

Although selective striatal cell death is a characteristic hallmark in the pathogenesis of Huntington's disease (HD), the underlying mechanism of striatal susceptibility remains to be clarified. Heat shock proteins (HSPs) have been reported to suppress the aggregate formation of mutant huntingtin and concurrent striatal cell death. In a previous study, we observed that heat shock transcription factor 1 (HSF1), a major transcription factor of HSPs, significantly attenuated 3‑nitropropionic acid (3NP)‑induced reactive oxygen species (ROS) production and apoptosis through the expression of HSP 70 in striatal cells. To investigate the differential roles of HSPs in 3NP‑induced striatal cell death, the effect of geldanamycin (GA), an HSP 90 inhibitor, was examined in 3NP‑stimulated striatal cells. GA significantly attenuated 3NP‑induced striatal apoptosis and ROS production with an increased expression of HSP 70. Triptolide (TL), an HSP 70 inhibitor, abolished GA‑mediated protective effects in 3NP‑stimulated striatal cells. To understand the underlying mechanism by which GA‑mediated HSP 70 protects striatal cells against 3NP stimulation, the involvement of various signaling pathways was examined. GA significantly attenuated 3NP‑induced c‑Jun N‑terminal kinase (JNK) phosphorylation and subsequent c‑Jun phosphorylation in striatal cells. Taken together, the present study demonstrated that GA exhibits protective properties against 3NP‑induced apoptosis and JNK activation via the induction of HSP 70 in striatal cells, suggesting that expression of HSP 70 may be a valuable therapeutic target in the treatment of HD.

Altered neural reward and loss processing and prediction error signalling in depression

PubMed Central

Ubl, Bettina; Kuehner, Christine; Kirsch, Peter; Ruttorf, Michaela

2015-01-01

Dysfunctional processing of reward and punishment may play an important role in depression. However, functional magnetic resonance imaging (fMRI) studies have shown heterogeneous results for reward processing in fronto-striatal regions. We examined neural responsivity associated with the processing of reward and loss during anticipation and receipt of incentives and related prediction error (PE) signalling in depressed individuals. Thirty medication-free depressed persons and 28 healthy controls performed an fMRI reward paradigm. Regions of interest analyses focused on neural responses during anticipation and receipt of gains and losses and related PE-signals. Additionally, we assessed the relationship between neural responsivity during gain/loss processing and hedonic capacity. When compared with healthy controls, depressed individuals showed reduced fronto-striatal activity during anticipation of gains and losses. The groups did not significantly differ in response to reward and loss outcomes. In depressed individuals, activity increases in the orbitofrontal cortex and nucleus accumbens during reward anticipation were associated with hedonic capacity. Depressed individuals showed an absence of reward-related PEs but encoded loss-related PEs in the ventral striatum. Depression seems to be linked to blunted responsivity in fronto-striatal regions associated with limited motivational responses for rewards and losses. Alterations in PE encoding might mirror blunted reward- and enhanced loss-related associative learning in depression. PMID:25567763

Disruption of the ErbB signaling in adolescence increases striatal dopamine levels and affects learning and hedonic-like behavior in the adult mouse.

PubMed

Golani, Idit; Tadmor, Hagar; Buonanno, Andres; Kremer, Ilana; Shamir, Alon

2014-11-01

The ErbB signaling pathway has been genetically and functionally implicated in schizophrenia. Numerous findings support the dysregulation of Neuregulin (NRG) and epidermal growth factor (EGF) signaling in schizophrenia. However, it is unclear whether alterations of these pathways in the adult brain or during development are involved in the pathophysiology of schizophrenia. Herein we characterized the behavioral profile and molecular changes resulting from pharmacologically blocking the ErbB signaling pathway during a critical period in the development of decision making, planning, judgments, emotions, social cognition and cognitive skills, namely adolescence. We demonstrate that chronic administration of the pan-ErbB kinase inhibitor JNJ-28871063 (JNJ) to adolescent mice elevated striatal dopamine levels and reduced preference for sucrose without affecting locomotor activity and exploratory behavior. In adulthood, adolescent JNJ-treated mice continue to consume less sucrose and needed significantly more correct-response trials to reach the learning criterion during the discrimination phase of the T-maze reversal learning task than their saline-injected controls. In addition, JNJ mice exhibited deficit in reference memory but not in working memory as measured in the radial arm maze. Inhibition of the pathway during adolescence did not affect exploratory behavior and locomotor activity in the open field, social interaction, social memory, and reversal learning in adult mice. Our data suggest that alteration of ErbB signaling during adolescence resulted in changes in the dopaminergic systems that emerge in pathological learning and hedonic behavior in adulthood, and pinpoints the possible role of the pathway in the development of cognitive skills and motivated behavior. Copyright © 2014 Elsevier B.V. and ECNP. All rights reserved.

Influence of action-effect associations acquired by ideomotor learning on imitation.

PubMed

Bunlon, Frédérique; Marshall, Peter J; Quandt, Lorna C; Bouquet, Cedric A

2015-01-01

According to the ideomotor theory, actions are represented in terms of their perceptual effects, offering a solution for the correspondence problem of imitation (how to translate the observed action into a corresponding motor output). This effect-based coding of action is assumed to be acquired through action-effect learning. Accordingly, performing an action leads to the integration of the perceptual codes of the action effects with the motor commands that brought them about. While ideomotor theory is invoked to account for imitation, the influence of action-effect learning on imitative behavior remains unexplored. In two experiments, imitative performance was measured in a reaction time task following a phase of action-effect acquisition. During action-effect acquisition, participants freely executed a finger movement (index or little finger lifting), and then observed a similar (compatible learning) or a different (incompatible learning) movement. In Experiment 1, finger movements of left and right hands were presented as action-effects during acquisition. In Experiment 2, only right-hand finger movements were presented during action-effect acquisition and in the imitation task the observed hands were oriented orthogonally to participants' hands in order to avoid spatial congruency effects. Experiments 1 and 2 showed that imitative performance was improved after compatible learning, compared to incompatible learning. In Experiment 2, although action-effect learning involved perception of finger movements of right hand only, imitative capabilities of right- and left-hand finger movements were equally affected. These results indicate that an observed movement stimulus processed as the effect of an action can later prime execution of that action, confirming the ideomotor approach to imitation. We further discuss these findings in relation to previous studies of action-effect learning and in the framework of current ideomotor approaches to imitation.

Influence of Action-Effect Associations Acquired by Ideomotor Learning on Imitation

PubMed Central

Bunlon, Frédérique; Marshall, Peter J.; Quandt, Lorna C.; Bouquet, Cedric A.

2015-01-01

According to the ideomotor theory, actions are represented in terms of their perceptual effects, offering a solution for the correspondence problem of imitation (how to translate the observed action into a corresponding motor output). This effect-based coding of action is assumed to be acquired through action-effect learning. Accordingly, performing an action leads to the integration of the perceptual codes of the action effects with the motor commands that brought them about. While ideomotor theory is invoked to account for imitation, the influence of action-effect learning on imitative behavior remains unexplored. In two experiments, imitative performance was measured in a reaction time task following a phase of action-effect acquisition. During action-effect acquisition, participants freely executed a finger movement (index or little finger lifting), and then observed a similar (compatible learning) or a different (incompatible learning) movement. In Experiment 1, finger movements of left and right hands were presented as action-effects during acquisition. In Experiment 2, only right-hand finger movements were presented during action-effect acquisition and in the imitation task the observed hands were oriented orthogonally to participants’ hands in order to avoid spatial congruency effects. Experiments 1 and 2 showed that imitative performance was improved after compatible learning, compared to incompatible learning. In Experiment 2, although action-effect learning involved perception of finger movements of right hand only, imitative capabilities of right- and left-hand finger movements were equally affected. These results indicate that an observed movement stimulus processed as the effect of an action can later prime execution of that action, confirming the ideomotor approach to imitation. We further discuss these findings in relation to previous studies of action-effect learning and in the framework of current ideomotor approaches to imitation. PMID:25793755

Exposure to predator odor influences the relative use of multiple memory systems: role of basolateral amygdala.

PubMed

Leong, Kah-Chung; Packard, Mark G

2014-03-01

In a dual-solution plus-maze task in which both hippocampus-dependent place learning and dorsolateral striatal-dependent response learning provide an adequate solution, the relative use of multiple memory systems can be influenced by emotional state. Specifically, pre-training peripheral or intra-basolateral (BLA) administration of anxiogenic drugs result in the predominant use of response learning. The present experiments were designed to extend these findings by examining whether exposure to a putatively ethologically valid stressor would also produce a predominant use of response learning. In experiment 1, adult male Long-Evans rats were exposed to either a predator odor (trimethylthiazoline [TMT], a component of fox feces) or distilled water prior to training in a dual-solution water plus maze task. On a probe trial 24h following task acquisition, rats previously exposed to TMT predominantly displayed response learning relative to control animals. In experiment 2, rats trained on a single-solution plus maze task that required the use of response learning displayed enhanced acquisition following pre-training TMT exposure. In experiment 3, rats exposed to TMT or distilled water were trained in the dual-solution task and received post-training intra-BLA injections of the sodium channel blocker bupivacaine (1.0% solution, 0.5 μl) or saline. Relative to control animals, rats exposed to TMT predominantly displayed response learning on the probe trial, and this effect was blocked by neural inactivation of the BLA. The findings indicate that (1) the use of dorsal striatal-dependent habit memory produced by emotional arousal generalizes from anxiogenic drug administration to a putatively ecologically valid stressor (i.e. predator odor), and (2) the BLA mediates the modulatory effect of exposure to predator odor on the relative use of multiple memory systems. Copyright © 2013 Elsevier Inc. All rights reserved.

Ventral striatum and the evaluation of memory retrieval strategies.

PubMed

Badre, David; Lebrecht, Sophie; Pagliaccio, David; Long, Nicole M; Scimeca, Jason M

2014-09-01

Adaptive memory retrieval requires mechanisms of cognitive control that facilitate the recovery of goal-relevant information. Frontoparietal systems are known to support control of memory retrieval. However, the mechanisms by which the brain acquires, evaluates, and adapts retrieval strategies remain unknown. Here, we provide evidence that ventral striatal activation tracks the success of a retrieval strategy and correlates with subsequent reliance on that strategy. Human participants were scanned with fMRI while performing a lexical decision task. A rule was provided that indicated the likely semantic category of a target word given the category of a preceding prime. Reliance on the rule improved decision-making, as estimated within a drift diffusion framework. Ventral striatal activation tracked the benefit that relying on the rule had on decision-making. Moreover, activation in ventral striatum correlated with a participant's subsequent reliance on the rule. Taken together, these results support a role for ventral striatum in learning and evaluating declarative retrieval strategies.

Leadership Development in SMEs: An Action Learning Approach

ERIC Educational Resources Information Center

Leitch, Claire M.; McMullan, Christel; Harrison, Richard T.

2009-01-01

In this paper we evaluate an action learning-based, leadership development programme designed for founders and leaders of growth-oriented, entrepreneurial small to medium-sized enterprises. Based on in-depth, qualitative interviews with participants on one cohort, undertaken two years after completion of the seven-month programme, we demonstrate…

Corticostriatal Divergent Function in Determining the Temporal and Spatial Properties of Motor Tics

PubMed Central

Israelashvili, Michal

2015-01-01

Striatal disinhibition leads to the formation of motor tics resembling those expressed during Tourette syndrome and other tic disorders. The spatial properties of these tics are dependent on the location of the focal disinhibition within the striatum; however, the factors affecting the temporal properties of tic expression are still unknown. Here, we used microstimulation within the motor cortex of freely behaving rats before and after striatal disinhibition to explore the factors underlying the timing of individual tics. Cortical activation determined the timing of individual tics via an accumulation process of inputs that was dependent on the frequency and amplitude of the inputs. The resulting tics and their neuronal representation within the striatum were highly stereotypic and independent of the cortical activity properties. The generation of tics was limited by absolute and relative tic refractory periods that were derived from an internal striatal state. Thus, the precise time of the tic expression depends on the interaction between the summation of incoming excitatory inputs to the striatum and the timing of the previous tic. A data-driven computational model of corticostriatal function closely replicated the temporal properties of tic generation and enabled the prediction of tic timing based on incoming cortical activity and tic history. These converging experimental and computational findings suggest a clear functional dichotomy within the corticostriatal network, pointing to disparate temporal (cortical) versus spatial (striatal) encoding. Thus, the abnormal striatal inhibition typical of Tourette syndrome and other tic disorders results in tics due to cortical activation of the abnormal striatal network. SIGNIFICANCE STATEMENT The factors underlying the temporal properties of tics expressed in Tourette syndrome and other tic disorders have eluded clinicians and scientists for decades. In this study, we highlight the key role of corticostriatal activity in determining the timing of individual tics. We found that cortical activation determined the timing of tics but did not determine their form. A data-driven computational model of the corticostriatal network closely replicated the temporal properties of tic generation and enabled the prediction of tic timing based on incoming cortical activity and tic history. This study thus shows that, although tics originate in the striatum, their timing depends on the interplay between incoming excitatory corticostriatal inputs and the internal striatal state. PMID:26674861

Corticostriatal Divergent Function in Determining the Temporal and Spatial Properties of Motor Tics.

PubMed

Israelashvili, Michal; Bar-Gad, Izhar

2015-12-16

Striatal disinhibition leads to the formation of motor tics resembling those expressed during Tourette syndrome and other tic disorders. The spatial properties of these tics are dependent on the location of the focal disinhibition within the striatum; however, the factors affecting the temporal properties of tic expression are still unknown. Here, we used microstimulation within the motor cortex of freely behaving rats before and after striatal disinhibition to explore the factors underlying the timing of individual tics. Cortical activation determined the timing of individual tics via an accumulation process of inputs that was dependent on the frequency and amplitude of the inputs. The resulting tics and their neuronal representation within the striatum were highly stereotypic and independent of the cortical activity properties. The generation of tics was limited by absolute and relative tic refractory periods that were derived from an internal striatal state. Thus, the precise time of the tic expression depends on the interaction between the summation of incoming excitatory inputs to the striatum and the timing of the previous tic. A data-driven computational model of corticostriatal function closely replicated the temporal properties of tic generation and enabled the prediction of tic timing based on incoming cortical activity and tic history. These converging experimental and computational findings suggest a clear functional dichotomy within the corticostriatal network, pointing to disparate temporal (cortical) versus spatial (striatal) encoding. Thus, the abnormal striatal inhibition typical of Tourette syndrome and other tic disorders results in tics due to cortical activation of the abnormal striatal network. The factors underlying the temporal properties of tics expressed in Tourette syndrome and other tic disorders have eluded clinicians and scientists for decades. In this study, we highlight the key role of corticostriatal activity in determining the timing of individual tics. We found that cortical activation determined the timing of tics but did not determine their form. A data-driven computational model of the corticostriatal network closely replicated the temporal properties of tic generation and enabled the prediction of tic timing based on incoming cortical activity and tic history. This study thus shows that, although tics originate in the striatum, their timing depends on the interplay between incoming excitatory corticostriatal inputs and the internal striatal state. Copyright © 2015 the authors 0270-6474/15/3516340-12$15.00/0.

Prefrontal and Striatal Glutamate Differently Relate to Striatal Dopamine: Potential Regulatory Mechanisms of Striatal Presynaptic Dopamine Function?

PubMed

Gleich, Tobias; Deserno, Lorenz; Lorenz, Robert Christian; Boehme, Rebecca; Pankow, Anne; Buchert, Ralph; Kühn, Simone; Heinz, Andreas; Schlagenhauf, Florian; Gallinat, Jürgen

2015-07-01

Theoretical and animal work has proposed that prefrontal cortex (PFC) glutamate inhibits dopaminergic inputs to the ventral striatum (VS) indirectly, whereas direct VS glutamatergic afferents have been suggested to enhance dopaminergic inputs to the VS. In the present study, we aimed to investigate relationships of glutamate and dopamine measures in prefrontostriatal circuitries of healthy humans. We hypothesized that PFC and VS glutamate, as well as their balance, are differently associated with VS dopamine. Glutamate concentrations in the left lateral PFC and left striatum were assessed using 3-Tesla proton magnetic resonance spectroscopy. Striatal presynaptic dopamine synthesis capacity was measured by fluorine-18-l-dihydroxyphenylalanine (F-18-FDOPA) positron emission tomography. First, a negative relationship was observed between glutamate concentrations in lateral PFC and VS dopamine synthesis capacity (n = 28). Second, a positive relationship was revealed between striatal glutamate and VS dopamine synthesis capacity (n = 26). Additionally, the intraindividual difference between PFC and striatal glutamate concentrations correlated negatively with VS dopamine synthesis capacity (n = 24). The present results indicate an involvement of a balance in PFC and striatal glutamate in the regulation of VS dopamine synthesis capacity. This notion points toward a potential mechanism how VS presynaptic dopamine levels are kept in a fine-tuned range. A disruption of this mechanism may account for alterations in striatal dopamine turnover as observed in mental diseases (e.g., in schizophrenia). The present work demonstrates complementary relationships between prefrontal and striatal glutamate and ventral striatal presynaptic dopamine using human imaging measures: a negative correlation between prefrontal glutamate and presynaptic dopamine and a positive relationship between striatal glutamate and presynaptic dopamine are revealed. The results may reflect a regulatory role of prefrontal and striatal glutamate for ventral striatal presynaptic dopamine levels. Such glutamate-dopamine relationships improve our understanding of neurochemical interactions in prefrontostriatal circuits and have implications for the neurobiology of mental disease. Copyright © 2015 the authors 0270-6474/15/359615-07$15.00/0.

Video Game Learning Dynamics: Actionable Measures of Multidimensional Learning Trajectories

ERIC Educational Resources Information Center

Reese, Debbie Denise; Tabachnick, Barbara G.; Kosko, Robert E.

2015-01-01

Valid, accessible, reusable methods for instructional video game design and embedded assessment can provide actionable information enhancing individual and collective achievement. Cyberlearning through game-based, metaphor-enhanced learning objects (CyGaMEs) design and embedded assessment quantify player behavior to study knowledge discovery and…

Service Learning: An Action Oriented Program Evaluation

ERIC Educational Resources Information Center

Kelley, George

2013-01-01

Service learning is an academic discipline that provides students with "hands-on" opportunities for developing skills in real-world, community-based projects that serve and benefit community members. This dissertation reflects an action-oriented process for improving the quality of the Service Learning Program at City University of…

Striatal GABA-MRS predicts response inhibition performance and its cortical electrophysiological correlates.

PubMed

Quetscher, Clara; Yildiz, Ali; Dharmadhikari, Shalmali; Glaubitz, Benjamin; Schmidt-Wilcke, Tobias; Dydak, Ulrike; Beste, Christian

2015-11-01

Response inhibition processes are important for performance monitoring and are mediated via a network constituted by different cortical areas and basal ganglia nuclei. At the basal ganglia level, striatal GABAergic medium spiny neurons are known to be important for response selection, but the importance of the striatal GABAergic system for response inhibition processes remains elusive. Using a novel combination of behavior al, EEG and magnetic resonance spectroscopy (MRS) data, we examine the relevance of the striatal GABAergic system for response inhibition processes. The study shows that striatal GABA levels modulate the efficacy of response inhibition processes. Higher striatal GABA levels were related to better response inhibition performance. We show that striatal GABA modulate specific subprocesses of response inhibition related to pre-motor inhibitory processes through the modulation of neuronal synchronization processes. To our knowledge, this is the first study providing direct evidence for the relevance of the striatal GABAergic system for response inhibition functions and their cortical electrophysiological correlates in humans.

Differential inputs to striatal cholinergic and parvalbumin interneurons imply functional distinctions

PubMed Central

Klug, Jason R; Engelhardt, Max D; Cadman, Cara N; Li, Hao; Smith, Jared B; Ayala, Sarah; Williams, Elora W; Hoffman, Hilary

2018-01-01

Striatal cholinergic (ChAT) and parvalbumin (PV) interneurons exert powerful influences on striatal function in health and disease, yet little is known about the organization of their inputs. Here using rabies tracing, electrophysiology and genetic tools, we compare the whole-brain inputs to these two types of striatal interneurons and dissect their functional connectivity in mice. ChAT interneurons receive a substantial cortical input from associative regions of cortex, such as the orbitofrontal cortex. Amongst subcortical inputs, a previously unknown inhibitory thalamic reticular nucleus input to striatal PV interneurons is identified. Additionally, the external segment of the globus pallidus targets striatal ChAT interneurons, which is sufficient to inhibit tonic ChAT interneuron firing. Finally, we describe a novel excitatory pathway from the pedunculopontine nucleus that innervates ChAT interneurons. These results establish the brain-wide direct inputs of two major types of striatal interneurons and allude to distinct roles in regulating striatal activity and controlling behavior. PMID:29714166

Exercise attenuates neuropathology and has greater benefit on cognitive than motor deficits in the R6/1 Huntington's disease mouse model.

PubMed

Harrison, David J; Busse, Monica; Openshaw, Rebecca; Rosser, Anne E; Dunnett, Stephen B; Brooks, Simon P

2013-10-01

Huntington's disease (HD) is a neurodegenerative disease caused by a mutation within the huntingtin gene that induces degeneration within the striatal nuclei, progressing to widespread brain atrophy and death. The neurodegeneration produces symptoms that reflect a corticostriatal disconnection syndrome involving motor, cognitive and psychiatric disturbance. Environmental enrichment has been demonstrated to be beneficial to patients with neurological disorders, with exercise being central to this effect. Rodent studies have confirmed exercise-induced neurogenesis and increased growth factor levels in the brain and improved behavioural function. The present study sought to determine whether an extended regime of exercise could retard disease progression in the R6/1 mouse model of HD. The study was designed specifically with a translational focus, selecting behavioural assessments with high clinical predictive validity. We found that exercise improved gait function in both control and HD mice and selectively improved performance in the R6/1 mice on a motor coordination aspect of the balance beam task. Exercise also retarded the progression of cognitive dysfunction on water T-maze procedural and reversal learning probes presented serially to probe cognitive flexibility. In addition, exercise reduced striatal neuron loss in the R6/1 mice but increased striatal neuronal intra-nuclear inclusion size and number relative to non-exercised R6/1 mice which demonstrated increased numbers of extra-neuronal inclusions, suggesting that the functional effects were striatally mediated. These results confirm and extend those from previous studies that demonstrate that HD may be amenable to exercise-mediated therapeutics, but suggest that the impact of such interventions may be primarily cognitive. © 2013.

Hypoactivity of the central dopaminergic system and autistic-like behavior induced by a single early prenatal exposure to lipopolysaccharide.

PubMed

Kirsten, Thiago B; Chaves-Kirsten, Gabriela P; Chaible, Lucas M; Silva, Ana C; Martins, Daniel O; Britto, Luiz R G; Dagli, Maria L Z; Torrão, Andrea S; Palermo-Neto, João; Bernardi, Maria M

2012-10-01

The aim of the present study was to evaluate the behavioral patterns associated with autism and the prevalence of these behaviors in males and females, to verify whether our model of lipopolysaccharide (LPS) administration represents an experimental model of autism. For this, we prenatally exposed Wistar rats to LPS (100 μg/kg, intraperitoneally, on gestational day 9.5), which mimics infection by gram-negative bacteria. Furthermore, because the exact mechanisms by which autism develops are still unknown, we investigated the neurological mechanisms that might underlie the behavioral alterations that were observed. Because we previously had demonstrated that prenatal LPS decreases striatal dopamine (DA) and metabolite levels, the striatal dopaminergic system (tyrosine hydroxylase [TH] and DA receptors D1a and D2) and glial cells (astrocytes and microglia) were analyzed by using immunohistochemistry, immunoblotting, and real-time PCR. Our results show that prenatal LPS exposure impaired communication (ultrasonic vocalizations) in male pups and learning and memory (T-maze spontaneous alternation) in male adults, as well as inducing repetitive/restricted behavior, but did not change social interactions in either infancy (play behavior) or adulthood in females. Moreover, although the expression of DA receptors was unchanged, the experimental animals exhibited reduced striatal TH levels, indicating that reduced DA synthesis impaired the striatal dopaminergic system. The expression of glial cell markers was not increased, which suggests that prenatal LPS did not induce permanent neuroinflammation in the striatum. Together with our previous finding of social impairments in males, the present findings demonstrate that prenatal LPS induced autism-like effects and also a hypoactivation of the dopaminergic system. Copyright © 2012 Wiley Periodicals, Inc.

Acute restriction impairs memory in the elevated T-maze (ETM) and modifies serotonergic activity in the dorsolateral striatum.

PubMed

Cruz-Morales, Sara Eugenia; García-Saldívar, Norma Laura; González-López, María Reyes; Castillo-Roberto, Georgina; Monroy, Juana; Domínguez, Roberto

2008-12-16

Serotonin (5-HT) is involved in behaviors such as sleep, eating, memory, in mental disorders like anxiety and depression and plays an important role in the modulation of stress. On the other hand, exposure to stress influence learning as well as declarative and non-declarative memory. These effects are dependent on the type of stressor, their magnitude, and the type of memory. The striatum has been associated with non-declarative procedural memory, while the information about stress effects on procedural memory and their relation with striatal serotonin is scarce. The objective of this study was to evaluate the effects of stress on the modifications of the striatal serotonergic system. In Experiment 1, the effects of either 60 min of restraint (R) or exposure to the elevated T-maze (ETM) was assessed. Exposure to ETM decreased 5-HT concentration and to R increased 5-HT activity ([metabolite]/[neurotransmitter]). In Experiment 2, we evaluated the effects of restraint on ETM trained immediately, 24 or 48 h after restraint. No effects were detected in acquisition or escape latencies, while retention latencies were lower in all groups compared with the non-restrained group, although significant effects were detected immediately and 24h after restraint. The memory impairment seems to be associated with changes in striatal serotonergic system, given that 5-HT concentration increased, while serotonergic activity decreased. The differences in the activity of 5-HT detected in each experiment could be explained by the effects of different stressors on the serotonergic neurons ability to synthesize the neurotransmitter. Thus, we suggest that exposure to stress impairs procedural memory and that striatal serotonin modulates this effect.

Learning relative values in the striatum induces violations of normative decision making

PubMed Central

Klein, Tilmann A.; Ullsperger, Markus; Jocham, Gerhard

2017-01-01

To decide optimally between available options, organisms need to learn the values associated with these options. Reinforcement learning models offer a powerful explanation of how these values are learnt from experience. However, human choices often violate normative principles. We suggest that seemingly counterintuitive decisions may arise as a natural consequence of the learning mechanisms deployed by humans. Here, using fMRI and a novel behavioural task, we show that, when suddenly switched to novel choice contexts, participants’ choices are incongruent with values learnt by standard learning algorithms. Instead, behaviour is compatible with the decisions of an agent learning how good an option is relative to an option with which it had previously been paired. Striatal activity exhibits the characteristics of a prediction error used to update such relative option values. Our data suggest that choices can be biased by a tendency to learn option values with reference to the available alternatives. PMID:28631734

Enhanced Striatal β1-Adrenergic Receptor Expression Following Hormone Loss in Adulthood Is Programmed by Both Early Sexual Differentiation and Puberty: A Study of Humans and Rats

PubMed Central

Perry, Adam N.; Westenbroek, Christel; Hedges, Valerie L.; Becker, Jill B.; Mermelstein, Paul G.

2013-01-01

After reproductive senescence or gonadectomy, changes occur in neural gene expression, ultimately altering brain function. The endocrine mechanisms underlying these changes in gene expression beyond immediate hormone loss are poorly understood. To investigate this, we measured changes in gene expression the dorsal striatum, where 17β-estradiol modulates catecholamine signaling. In human caudate, quantitative PCR determined a significant elevation in β1-adrenergic receptor (β1AR) expression in menopausal females when compared with similarly aged males. No differences were detected in β2-adrenergic and D1- and D2-dopamine receptor expression. Consistent with humans, adult ovariectomized female rats exhibited a similar increase in β1AR expression when compared with gonadectomized males. No sex difference in β1AR expression was detected between intact adults, prepubertal juveniles, or adults gonadectomized before puberty, indicating the necessity of pubertal development and adult ovariectomy. Additionally, increased β1AR expression in adult ovariectomized females was not observed if animals were masculinized/defeminized with testosterone injections as neonates. To generate a model system for assessing functional impact, increased β1AR expression was induced in female-derived cultured striatal neurons via exposure to and then removal of hormone-containing serum. Increased β1AR action on cAMP formation, cAMP response element-binding protein phosphorylation and gene expression was observed. This up-regulation of β1AR action was eliminated with 17β-estradiol addition to the media, directly implicating this hormone as a regulator of β1AR expression. Beyond having implications for the known sex differences in striatal function and pathologies, these data collectively demonstrate that critical periods early in life and at puberty program adult gene responsiveness to hormone loss after gonadectomy and potentially reproductive senescence. PMID:23533220

Impaired prefrontal activity to regulate the intrinsic motivation-action link in schizophrenia.

PubMed

Takeda, Kazuyoshi; Matsumoto, Madoka; Ogata, Yousuke; Maida, Keiko; Murakami, Hiroki; Murayama, Kou; Shimoji, Keigo; Hanakawa, Takashi; Matsumoto, Kenji; Nakagome, Kazuyuki

2017-01-01

A core feature of schizophrenia (SCZ) is impairment in intrinsic motivation. Although intrinsic motivation plays an important role in enhancing improvement of the social functioning, its neural mechanisms of impairment have yet to be clarified. We hypothesized that abnormal function of the frontostriatal loop consisting of the striatum and lateral prefrontal cortex (LPFC) may be related to impaired intrinsic motivation in SCZ. We tested this by comparing the brain activity measured by functional magnetic resonance imaging and behavioral parameters associated with movement, motivation, and cognitive control between 18 stable SCZ patients and 17 healthy control (HC) participants during a task that elicits intrinsic motivation. We also compared the functional connectivity during resting-state and the fractional anisotropy using diffusion tensor imaging analysis between the two groups. We adopted an enjoyable timing task to stop a stopwatch at an exact time, which in our previous study has demonstrated to elicit intrinsic motivation. Although the performance level in general was not different between groups, the SCZ group performed worse than the HC group in trials following "overshoot" errors (i.e., the response was too late). SCZ participants showed lower intrinsic motivation to the task than the HC group in an inventory report. The striatal activity during the prediction at the task cue period was consistently lower in SCZ participants than in HC. The LPFC activity at the task cue period positively correlated with intrinsic motivation and also with the rate of success following overshoot errors in the HC group, but not in the SCZ group. The LPFC activity at the task cue period was also positively correlated with the striatal activity in both groups. The striatal activity during the feedback period was not significantly different between groups. These results suggest that, unlike HC, the neural activity in the LPFC fails to mediate between prediction of hedonic events and cognitive control of action plans in SCZ, whereas the hedonic response is retained.

Building Civic Bridges: Community-Centered Action Civics

ERIC Educational Resources Information Center

LeCompte, Karon; Blevins, Brooke

2015-01-01

Project-based learning is an example of powerful social studies learning in which student engage in active inquiry. Action civics is a relatively new educational practice in which students "act as citizens" through a cycle of research, action, and reflection about problems they care about in their community. "Building Civic…

Future View: Web Navigation based on Learning User's Browsing Strategy

NASA Astrophysics Data System (ADS)

Nagino, Norikatsu; Yamada, Seiji

In this paper, we propose a Future View system that assists user's usual Web browsing. The Future View will prefetch Web pages based on user's browsing strategies and present them to a user in order to assist Web browsing. To learn user's browsing strategy, the Future View uses two types of learning classifier systems: a content-based classifier system for contents change patterns and an action-based classifier system for user's action patterns. The results of learning is applied to crawling by Web robots, and the gathered Web pages are presented to a user through a Web browser interface. We experimentally show effectiveness of navigation using the Future View.

Preserved Fronto-Striatal Plasticity and Enhanced Procedural Learning in a Transgenic Mouse Model of Alzheimer's Disease Overexpressing Mutant "hAPPswe"

ERIC Educational Resources Information Center

Middei, Silvia; Geracitano, Raffaella; Caprioli, Antonio; Mercuri, Nicola; Ammassari-Teule, Martine

2004-01-01

Mutations in the amyloid precursor protein (APP) gene inducing abnormal processing and deposition of [beta]-amyloid protein in the brain have been implicated in the pathogenesis of Alzheimer's disease (AD). Although Tg2576 mice with the Swedish mutation ("hAPPswe") exhibit age-related [Alpha][beta]-plaque formation in brain regions like the…

Dorsal and Dorsal and Ventral Striatal Protein Synthesis Inhibition Affect Reinforcer Valuation but Not the Consolidation of Instrumental Learning

ERIC Educational Resources Information Center

Jonkman, Sietse; Everitt, Barry J.

2011-01-01

The evidence for a role of the striatum in the acquisition of uncued instrumental responding is ambiguous. It has been shown that post-session infusions of anisomycin into the core of the nucleus accumbens (NAcc) impaired instrumental acquisition, but pre-training lesions of the NAcc suggest that it is not necessary. Recently, we demonstrated that…

Evaluating the Impact of Action Plans on Trainee Compliance with Learning Objectives

ERIC Educational Resources Information Center

Aumann, Michael J.

2013-01-01

This mixed methods research study evaluated the use of technology-based action plans as a way to help improve compliance with the learning objectives of an online training event. It explored how the action planning strategy impacted subjects in a treatment group and compared them to subjects in a control group who did not get the action plan. The…

Sensorimotor Learning Biases Choice Behavior: A Learning Neural Field Model for Decision Making

PubMed Central

Schöner, Gregor; Gail, Alexander

2012-01-01

According to a prominent view of sensorimotor processing in primates, selection and specification of possible actions are not sequential operations. Rather, a decision for an action emerges from competition between different movement plans, which are specified and selected in parallel. For action choices which are based on ambiguous sensory input, the frontoparietal sensorimotor areas are considered part of the common underlying neural substrate for selection and specification of action. These areas have been shown capable of encoding alternative spatial motor goals in parallel during movement planning, and show signatures of competitive value-based selection among these goals. Since the same network is also involved in learning sensorimotor associations, competitive action selection (decision making) should not only be driven by the sensory evidence and expected reward in favor of either action, but also by the subject's learning history of different sensorimotor associations. Previous computational models of competitive neural decision making used predefined associations between sensory input and corresponding motor output. Such hard-wiring does not allow modeling of how decisions are influenced by sensorimotor learning or by changing reward contingencies. We present a dynamic neural field model which learns arbitrary sensorimotor associations with a reward-driven Hebbian learning algorithm. We show that the model accurately simulates the dynamics of action selection with different reward contingencies, as observed in monkey cortical recordings, and that it correctly predicted the pattern of choice errors in a control experiment. With our adaptive model we demonstrate how network plasticity, which is required for association learning and adaptation to new reward contingencies, can influence choice behavior. The field model provides an integrated and dynamic account for the operations of sensorimotor integration, working memory and action selection required for decision making in ambiguous choice situations. PMID:23166483

Sex differences of gray matter morphology in cortico-limbic-striatal neural system in major depressive disorder.

PubMed

Kong, Lingtao; Chen, Kaiyuan; Womer, Fay; Jiang, Wenyan; Luo, Xingguang; Driesen, Naomi; Liu, Jie; Blumberg, Hilary; Tang, Yanqing; Xu, Ke; Wang, Fei

2013-06-01

Sex differences are observed in both epidemiological and clinical aspects of major depressive disorder (MDD). The cortico-limbic-striatal neural system, including the prefrontal cortex, amygdala, hippocampus, and striatum, have shown sexually dimorphic morphological features and have been implicated in the dysfunctional regulation of mood and emotion in MDD. In this study, we utilized a whole-brain, voxel-based approach to examine sex differences in the regional distribution of gray matter (GM) morphological abnormalities in medication-naïve participants with MDD. Participants included 29 medication-naïve individuals with MDD (16 females and 13 males) and 33 healthy controls (HC) (17 females and 16 males). Gray matter morphology of the cortico-limbic-striatal neural system was examined using voxel-based morphometry analyzes of high-resolution structural magnetic resonance imaging scans. The main effect of diagnosis and interaction effect of diagnosis by sex on GM morphology were statistically significant (p < 0.05, corrected) in the left ventral prefrontal cortex, right amygdala, right hippocampus and bilateral caudate when comparing the MDD and HC groups. Posthoc analyzes showed that females with MDD had significant GM decreases in limbic regions (p < 0.05, corrected), compared to female HC; while males with MDD demonstrated significant GM reduction in striatal regions, (p < 0.05, corrected), compared to HC males. The observed sex-related patterns of abnormalities within the cortico-limbic-strial neural system, such as predominant prefrontal-limbic abnormalities in MDD females vs. predominant prefrontal-striatal abnormalities in MDD males, suggest differences in neural circuitry that may mediate sex differences in the clinical presentation of MDD and potential targets for sex-differentiated treatment of the disorder. Copyright © 2013 Elsevier Ltd. All rights reserved.

Brain dopamine and serotonin transporter binding are associated with visual attention bias for food in lean men.

PubMed

Koopman, K E; Roefs, A; Elbers, D C E; Fliers, E; Booij, J; Serlie, M J; la Fleur, S E

2016-06-01

In rodents, the striatal dopamine (DA) system and the (hypo)thalamic serotonin (5-HT) system are involved in the regulation of feeding behavior. In lean humans, little is known about the relationship between these brain neurotransmitter systems and feeding. We studied the relationship between striatal DA transporters (DAT) and diencephalic 5-HT transporters (SERT), behavioral tasks and questionnaires, and food intake. We measured striatal DAT and diencephalic SERT binding with [123I]FP-CIT SPECT in 36 lean male subjects. Visual attention bias for food (detection speed and distraction time) and degree of impulsivity were measured using response-latency-based computer tasks. Craving and emotional eating were assessed with questionnaires and ratings of hunger by means of VAS scores. Food intake was assessed through a self-reported online diet journal. Striatal DAT and diencephalic SERT binding negatively correlated with food detection speed (p = 0.008, r = -0.50 and p = 0.002, r = -0.57, respectively), but not with food distraction time, ratings of hunger, craving or impulsivity. Striatal DAT and diencephalic SERT binding did not correlate with free choice food intake, whereas food detection speed positively correlated with total caloric intake (p = 0.001, r = 0.60), protein intake (p = 0.01, r = 0.44), carbohydrate intake (p = 0.03, r = 0.39) and fat intake (p = 0.06, r = 0.35). These results indicate a role for the central 5-HT and DA system in the regulation of visual attention bias for food, which contributes to the motivation to eat, in non-obese, healthy humans. In addition, this study confirms that food detection speed, measured with the latency-based computer task, positively correlates with total food and macronutrient intake.

The many facets of motor learning and their relevance for Parkinson's disease.

PubMed

Marinelli, Lucio; Quartarone, Angelo; Hallett, Mark; Frazzitta, Giuseppe; Ghilardi, Maria Felice

2017-07-01

The final goal of motor learning, a complex process that includes both implicit and explicit (or declarative) components, is the optimization and automatization of motor skills. Motor learning involves different neural networks and neurotransmitters systems depending on the type of task and on the stage of learning. After the first phase of acquisition, a motor skill goes through consolidation (i.e., becoming resistant to interference) and retention, processes in which sleep and long-term potentiation seem to play important roles. The studies of motor learning in Parkinson's disease have yielded controversial results that likely stem from the use of different experimental paradigms. When a task's characteristics, instructions, context, learning phase and type of measures are taken into consideration, it is apparent that, in general, only learning that relies on attentional resources and cognitive strategies is affected by PD, in agreement with the finding of a fronto-striatal deficit in this disease. Levodopa administration does not seem to reverse the learning deficits in PD, while deep brain stimulation of either globus pallidus or subthalamic nucleus appears to be beneficial. Finally and most importantly, patients with PD often show a decrease in retention of newly learned skill, a problem that is present even in the early stages of the disease. A thorough dissection and understanding of the processes involved in motor learning is warranted to provide solid bases for effective medical, surgical and rehabilitative approaches in PD. Copyright © 2017 International Federation of Clinical Neurophysiology. All rights reserved.

Task-Based Language Learning and Teaching: An Action-Research Study

ERIC Educational Resources Information Center

Calvert, Megan; Sheen, Younghee

2015-01-01

The creation, implementation, and evaluation of language learning tasks remain a challenge for many teachers, especially those with limited experience with using tasks in their teaching. This action-research study reports on one teacher's experience of developing, implementing, critically reflecting on, and modifying a language learning task…

Learning Networks--Enabling Change through Community Action Research

ERIC Educational Resources Information Center

Bleach, Josephine

2016-01-01

Learning networks are a critical element of ethos of the community action research approach taken by the Early Learning Initiative at the National College of Ireland, a community-based educational initiative in the Dublin Docklands. Key criteria for networking, whether at local, national or international level, are the individual's and…

Dissociable Learning Processes Underlie Human Pain Conditioning.

PubMed

Zhang, Suyi; Mano, Hiroaki; Ganesh, Gowrishankar; Robbins, Trevor; Seymour, Ben

2016-01-11

Pavlovian conditioning underlies many aspects of pain behavior, including fear and threat detection [1], escape and avoidance learning [2], and endogenous analgesia [3]. Although a central role for the amygdala is well established [4], both human and animal studies implicate other brain regions in learning, notably ventral striatum and cerebellum [5]. It remains unclear whether these regions make different contributions to a single aversive learning process or represent independent learning mechanisms that interact to generate the expression of pain-related behavior. We designed a human parallel aversive conditioning paradigm in which different Pavlovian visual cues probabilistically predicted thermal pain primarily to either the left or right arm and studied the acquisition of conditioned Pavlovian responses using combined physiological recordings and fMRI. Using computational modeling based on reinforcement learning theory, we found that conditioning involves two distinct types of learning process. First, a non-specific "preparatory" system learns aversive facial expressions and autonomic responses such as skin conductance. The associated learning signals-the learned associability and prediction error-were correlated with fMRI brain responses in amygdala-striatal regions, corresponding to the classic aversive (fear) learning circuit. Second, a specific lateralized system learns "consummatory" limb-withdrawal responses, detectable with electromyography of the arm to which pain is predicted. Its related learned associability was correlated with responses in ipsilateral cerebellar cortex, suggesting a novel computational role for the cerebellum in pain. In conclusion, our results show that the overall phenotype of conditioned pain behavior depends on two dissociable reinforcement learning circuits. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Learning to reach by reinforcement learning using a receptive field based function approximation approach with continuous actions.

PubMed

Tamosiunaite, Minija; Asfour, Tamim; Wörgötter, Florentin

2009-03-01

Reinforcement learning methods can be used in robotics applications especially for specific target-oriented problems, for example the reward-based recalibration of goal directed actions. To this end still relatively large and continuous state-action spaces need to be efficiently handled. The goal of this paper is, thus, to develop a novel, rather simple method which uses reinforcement learning with function approximation in conjunction with different reward-strategies for solving such problems. For the testing of our method, we use a four degree-of-freedom reaching problem in 3D-space simulated by a two-joint robot arm system with two DOF each. Function approximation is based on 4D, overlapping kernels (receptive fields) and the state-action space contains about 10,000 of these. Different types of reward structures are being compared, for example, reward-on- touching-only against reward-on-approach. Furthermore, forbidden joint configurations are punished. A continuous action space is used. In spite of a rather large number of states and the continuous action space these reward/punishment strategies allow the system to find a good solution usually within about 20 trials. The efficiency of our method demonstrated in this test scenario suggests that it might be possible to use it on a real robot for problems where mixed rewards can be defined in situations where other types of learning might be difficult.

Grounding the Meanings in Sensorimotor Behavior using Reinforcement Learning

PubMed Central

Farkaš, Igor; Malík, Tomáš; Rebrová, Kristína

2012-01-01

The recent outburst of interest in cognitive developmental robotics is fueled by the ambition to propose ecologically plausible mechanisms of how, among other things, a learning agent/robot could ground linguistic meanings in its sensorimotor behavior. Along this stream, we propose a model that allows the simulated iCub robot to learn the meanings of actions (point, touch, and push) oriented toward objects in robot’s peripersonal space. In our experiments, the iCub learns to execute motor actions and comment on them. Architecturally, the model is composed of three neural-network-based modules that are trained in different ways. The first module, a two-layer perceptron, is trained by back-propagation to attend to the target position in the visual scene, given the low-level visual information and the feature-based target information. The second module, having the form of an actor-critic architecture, is the most distinguishing part of our model, and is trained by a continuous version of reinforcement learning to execute actions as sequences, based on a linguistic command. The third module, an echo-state network, is trained to provide the linguistic description of the executed actions. The trained model generalizes well in case of novel action-target combinations with randomized initial arm positions. It can also promptly adapt its behavior if the action/target suddenly changes during motor execution. PMID:22393319

Fully Automated Quantification of the Striatal Uptake Ratio of [99mTc]-TRODAT with SPECT Imaging: Evaluation of the Diagnostic Performance in Parkinson's Disease and the Temporal Regression of Striatal Tracer Uptake

PubMed Central

Fang, Yu-Hua Dean; Chiu, Shao-Chieh; Lu, Chin-Song; Weng, Yi-Hsin

2015-01-01

Purpose. We aimed at improving the existing methods for the fully automatic quantification of striatal uptake of [99mTc]-TRODAT with SPECT imaging. Procedures. A normal [99mTc]-TRODAT template was first formed based on 28 healthy controls. Images from PD patients (n = 365) and nPD subjects (28 healthy controls and 33 essential tremor patients) were spatially normalized to the normal template. We performed an inverse transform on the predefined striatal and reference volumes of interest (VOIs) and applied the transformed VOIs to the original image data to calculate the striatal-to-reference ratio (SRR). The diagnostic performance of the SRR was determined through receiver operating characteristic (ROC) analysis. Results. The SRR measured with our new and automatic method demonstrated excellent diagnostic performance with 92% sensitivity, 90% specificity, 92% accuracy, and an area under the curve (AUC) of 0.94. For the evaluation of the mean SRR and the clinical duration, a quadratic function fit the data with R 2 = 0.84. Conclusions. We developed and validated a fully automatic method for the quantification of the SRR in a large study sample. This method has an excellent diagnostic performance and exhibits a strong correlation between the mean SRR and the clinical duration in PD patients. PMID:26366413

Fully Automated Quantification of the Striatal Uptake Ratio of [(99m)Tc]-TRODAT with SPECT Imaging: Evaluation of the Diagnostic Performance in Parkinson's Disease and the Temporal Regression of Striatal Tracer Uptake.

PubMed

Fang, Yu-Hua Dean; Chiu, Shao-Chieh; Lu, Chin-Song; Yen, Tzu-Chen; Weng, Yi-Hsin

2015-01-01

We aimed at improving the existing methods for the fully automatic quantification of striatal uptake of [(99m)Tc]-TRODAT with SPECT imaging. A normal [(99m)Tc]-TRODAT template was first formed based on 28 healthy controls. Images from PD patients (n = 365) and nPD subjects (28 healthy controls and 33 essential tremor patients) were spatially normalized to the normal template. We performed an inverse transform on the predefined striatal and reference volumes of interest (VOIs) and applied the transformed VOIs to the original image data to calculate the striatal-to-reference ratio (SRR). The diagnostic performance of the SRR was determined through receiver operating characteristic (ROC) analysis. The SRR measured with our new and automatic method demonstrated excellent diagnostic performance with 92% sensitivity, 90% specificity, 92% accuracy, and an area under the curve (AUC) of 0.94. For the evaluation of the mean SRR and the clinical duration, a quadratic function fit the data with R (2) = 0.84. We developed and validated a fully automatic method for the quantification of the SRR in a large study sample. This method has an excellent diagnostic performance and exhibits a strong correlation between the mean SRR and the clinical duration in PD patients.

Professional Learning in Canada: Learning Forward Releases a Landmark Study and Call to Action

ERIC Educational Resources Information Center

Learning Professional, 2017

2017-01-01

Learning Forward recently released findings from a new study that fills a long-standing gap in existing Pan-Canadian research, identifying key components of effective professional learning based on findings from educators' experiences in Canada. Accompanying the study is a call to action by Michael Fullan and Andy Hargreaves making the case for a…

Scaffolding Strategies for Wiki-Based Collaboration: Action Research in a Multicultural Japanese Language Program

ERIC Educational Resources Information Center

Jung, Insung; Suzuki, Yoko

2015-01-01

Wikis can be used to encourage and support collaborative constructivist learning. However, their effectiveness depends upon the use of scaffolding strategies to guide the students in their use. This action research investigated three scaffolding strategies for wiki-based multicultural Japanese language learning: worked examples, grouping and peer…

Revans Reversed: Focusing on the Positive for a Change

ERIC Educational Resources Information Center

Gold, Jeffrey

2014-01-01

The classical principles of action learning, based on the work of Revans, usually include working with problems as the core. This article aims, by contrast, to show how a recent project of change has incorporated principles of appreciative inquiry (AI) based on social constructionism and positive psychology into an action learning process…

Cellular delivery of human CNTF prevents motor and cognitive dysfunction in a rodent model of Huntington's disease.

PubMed

Emerich, D F; Cain, C K; Greco, C; Saydoff, J A; Hu, Z Y; Liu, H; Lindner, M D

1997-01-01

The delivery of ciliary neurotrophic factor (CNTF) to the central nervous system has recently been proposed as a potential means of halting or slowing the neural degeneration associated with Huntington's disease (HD). The following set of experiments examined, in detail, the ability of human CNTF (hCNTF) to prevent the onset of behavioral dysfunction in a rodent model of HD. A DHFR-based expression vector containing the hCNTF gene was transfected into a baby hamster kidney fibroblast cell line (BHK). Using a polymeric device, encapsulated BHK-control cells and those secreting hCNTF were transplanted bilaterally into rat lateral ventricles. Eight days later, the same animals received bilateral injections of quinolinic acid (QA, 225 nmol) into the previously implanted striata. A third group received sham surgery (incision only) and served as a normal control group. Bilateral infusions of QA produced a significant loss of body weight and mortality that was prevented by prior implantation with hCNTF-secreting cells. Moreover, QA produced a marked hyperactivity, an inability to use the forelimbs to retrieve food pellets in a staircase test, increased the latency of the rats to remove adhesive stimuli from their paws, and decreased the number of steps taken in a bracing test that assessed motor rigidity. Finally, the QA-infused animals were impaired in tests of cognitive function-the Morris water maze spatial learning task, and the delayed nonmatching-to-position operant test of working memory. Prior implantation with hCNTF-secreting cells prevented the onset of all the above deficits such that implanted animals were nondistinguishable from sham-lesioned controls. At the conclusion of behavioral testing, 19 days following QA, the animals were sacrificed for neurochemical determination of striatal choline acetyltransferase (ChAT) and glutamic acid decarboxylase (GAD) levels. This analysis revealed that QA decreased striatal ChAT levels by 35% and striatal GAD levels by 45%. In contrast, hCNTF-treated animals did not exhibit any decrease in ChAT levels and only a 10% decrease in GAD levels. These results support the concepts that implants of polymer-encapsulated hCNTF-releasing cells can be used to protect striatal neurons from excitotoxic damage, produce extensive behavioral protection as a result of that neuronal sparing, and that this strategy may ultimately prove relevant for the treatment of HD.

Cross-Situational Learning with Bayesian Generative Models for Multimodal Category and Word Learning in Robots

PubMed Central

Taniguchi, Akira; Taniguchi, Tadahiro; Cangelosi, Angelo

2017-01-01

In this paper, we propose a Bayesian generative model that can form multiple categories based on each sensory-channel and can associate words with any of the four sensory-channels (action, position, object, and color). This paper focuses on cross-situational learning using the co-occurrence between words and information of sensory-channels in complex situations rather than conventional situations of cross-situational learning. We conducted a learning scenario using a simulator and a real humanoid iCub robot. In the scenario, a human tutor provided a sentence that describes an object of visual attention and an accompanying action to the robot. The scenario was set as follows: the number of words per sensory-channel was three or four, and the number of trials for learning was 20 and 40 for the simulator and 25 and 40 for the real robot. The experimental results showed that the proposed method was able to estimate the multiple categorizations and to learn the relationships between multiple sensory-channels and words accurately. In addition, we conducted an action generation task and an action description task based on word meanings learned in the cross-situational learning scenario. The experimental results showed that the robot could successfully use the word meanings learned by using the proposed method. PMID:29311888

Model-based hierarchical reinforcement learning and human action control

PubMed Central

Botvinick, Matthew; Weinstein, Ari

2014-01-01

Recent work has reawakened interest in goal-directed or ‘model-based’ choice, where decisions are based on prospective evaluation of potential action outcomes. Concurrently, there has been growing attention to the role of hierarchy in decision-making and action control. We focus here on the intersection between these two areas of interest, considering the topic of hierarchical model-based control. To characterize this form of action control, we draw on the computational framework of hierarchical reinforcement learning, using this to interpret recent empirical findings. The resulting picture reveals how hierarchical model-based mechanisms might play a special and pivotal role in human decision-making, dramatically extending the scope and complexity of human behaviour. PMID:25267822

Intranasal Dopamine Reduces In Vivo [(123)I]FP-CIT Binding to Striatal Dopamine Transporter: Correlation with Behavioral Changes and Evidence for Pavlovian Conditioned Dopamine Response.

PubMed

de Souza Silva, Maria A; Mattern, Claudia; Decheva, Cvetana; Huston, Joseph P; Sadile, Adolfo G; Beu, Markus; Müller, H-W; Nikolaus, Susanne

2016-01-01

Dopamine (DA), which does not cross the blood-brain barrier, has central and behavioral effects when administered via the nasal route. Neither the mechanisms of central action of intranasal dopamine (IN-DA), nor its mechanisms of diffusion and transport into the brain are well understood. We here examined whether IN-DA application influences dopamine transporter (DAT) binding in the dorsal striatum and assessed the extent of binding in relation to motor and exploratory behaviors. We hypothesized that, based on the finding of increased extracellular DA in the striatum induced by application of IN-DA, binding of [(123)I]FP-CIT to the DAT should be decreased due to competition at the receptor. Rats were administered 3 mg/kg IN-DA and vehicle (VEH), with IN-DA injection either preceding or following VEH. Then motor and exploratory behaviors (traveled distance, velocity, center time, sitting, rearing, head-shoulder motility, grooming) were assessed for 30 min in an open field prior to administration of [(123)I]FP-CIT. DAT binding after IN-DA and VEH was measured with small animal SPECT 2 h following administration of the radioligand. (1) After IN-DA application, striatal DAT binding was significantly lower as compared to VEH, indicating that the nasally delivered DA had central action and increased DA levels comparable to that found previously with L-DOPA administration; and (2) DAT binding in response to intranasal VEH was lower when IN-DA application preceded VEH treatment. This finding is suggestive of Pavlovian conditioning of DA at the level of the DAT, since the DA treatment modified (decreased) the binding in response to the subsequent VEH treatment. VEH treatment also reduced motor and exploratory behaviors more when applied before, as compared to when it followed IN-DA application, also indicative of behavioral Pavlovian conditioning akin to that found upon application of various psychostimulant drugs. (a) demonstrate a direct central action of intranasally applied DA on the DAT in the dorsal striatum, indicating enhanced DA availability; and (b) provide first evidence of a Pavlovian conditioned DA response at the DAT. The latter results have relevance to understanding neurochemical mechanisms that underlie placebo action in the treatment of Parkinsonian patients.

Quantifying Learning in Young Infants: Tracking Leg Actions During a Discovery-learning Task.

PubMed

Sargent, Barbara; Reimann, Hendrik; Kubo, Masayoshi; Fetters, Linda

2015-06-01

Task-specific actions emerge from spontaneous movement during infancy. It has been proposed that task-specific actions emerge through a discovery-learning process. Here a method is described in which 3-4 month old infants learn a task by discovery and their leg movements are captured to quantify the learning process. This discovery-learning task uses an infant activated mobile that rotates and plays music based on specified leg action of infants. Supine infants activate the mobile by moving their feet vertically across a virtual threshold. This paradigm is unique in that as infants independently discover that their leg actions activate the mobile, the infants' leg movements are tracked using a motion capture system allowing for the quantification of the learning process. Specifically, learning is quantified in terms of the duration of mobile activation, the position variance of the end effectors (feet) that activate the mobile, changes in hip-knee coordination patterns, and changes in hip and knee muscle torque. This information describes infant exploration and exploitation at the interplay of person and environmental constraints that support task-specific action. Subsequent research using this method can investigate how specific impairments of different populations of infants at risk for movement disorders influence the discovery-learning process for task-specific action.

Segregation and Crosstalk of D1 Receptor-Mediated Activation of ERK in Striatal Medium Spiny Neurons upon Acute Administration of Psychostimulants

PubMed Central

Gutierrez-Arenas, Omar; Eriksson, Olivia; Hellgren Kotaleski, Jeanette

2014-01-01

The convergence of corticostriatal glutamate and dopamine from the midbrain in the striatal medium spiny neurons (MSN) triggers synaptic plasticity that underlies reinforcement learning and pathological conditions such as psychostimulant addiction. The increase in striatal dopamine produced by the acute administration of psychostimulants has been found to activate not only effectors of the AC5/cAMP/PKA signaling cascade such as GluR1, but also effectors of the NMDAR/Ca2+/RAS cascade such as ERK. The dopamine-triggered effects on both these cascades are mediated by D1R coupled to Golf but while the phosphorylation of GluR1 is affected by reductions in the available amount of Golf but not of D1R, the activation of ERK follows the opposite pattern. This segregation is puzzling considering that D1R-induced Golf activation monotonically increases with DA and that there is crosstalk from the AC5/cAMP/PKA cascade to the NMDAR/Ca2+/RAS cascade via a STEP (a tyrosine phosphatase). In this work, we developed a signaling model which accounts for this segregation based on the assumption that a common pool of D1R and Golf is distributed in two D1R/Golf signaling compartments. This model integrates a relatively large amount of experimental data for neurons in vivo and in vitro. We used it to explore the crosstalk topologies under which the sensitivities of the AC5/cAMP/PKA signaling cascade to reductions in D1R or Golf are transferred or not to the activation of ERK. We found that the sequestration of STEP by its substrate ERK together with the insensitivity of STEP activity on targets upstream of ERK (i.e. Fyn and NR2B) to PKA phosphorylation are able to explain the experimentally observed segregation. This model provides a quantitative framework for simulation based experiments to study signaling required for long term potentiation in MSNs. PMID:24499932

Prepuberal intranasal dopamine treatment in an animal model of ADHD ameliorates deficient spatial attention, working memory, amino acid transmitters and synaptic markers in prefrontal cortex, ventral and dorsal striatum.

PubMed

Ruocco, L A; Treno, C; Gironi Carnevale, U A; Arra, C; Mattern, C; Huston, J P; de Souza Silva, M A; Nikolaus, S; Scorziello, A; Nieddu, M; Boatto, G; Illiano, P; Pagano, C; Tino, A; Sadile, A G

2014-09-01

Intranasal application of dopamine (IN-DA) has been shown to increase motor activity and to release DA in the ventral (VS) and dorsal striatum (DS) of rats. The aim of the present study was to assess the effects of IN-DA treatment on parameters of DA and excitatory amino acid (EAA) function in prepuberal rats of the Naples high-excitability (NHE) line, an animal model for attention-deficit hyperactivity disorder (ADHD) and normal random bred (NRB) controls. NHE and NRB rats were daily administered IN-DA (0.075, 0.15, 0.30 mg/kg) or vehicle for 15 days from postnatal days 28-42 and subsequently tested in the Làt maze and in the Eight-arm radial Olton maze. Soluble and membrane-trapped L-glutamate (L-Glu) and L-aspartate (L-Asp) levels as well as NMDAR1 subunit protein levels were determined after sacrifice in IN-DA- and vehicle-treated NHE and NRB rats in prefrontal cortex (PFc), DS and VS. Moreover, DA transporter (DAT) protein and tyrosine hydroxylase (TH) levels were assessed in PFc, DS, VS and mesencephalon (MES) and in ventral tegmental area (VTA) and substantia nigra, respectively. In NHE rats, IN-DA (0.30 mg/kg) decreased horizontal activity and increased nonselective attention relative to vehicle, whereas the lower dose (0.15 mg/kg) increased selective spatial attention. In NHE rats, basal levels of soluble EAAs were reduced in PFc and DS relative to NRB controls, while membrane-trapped EAAs were elevated in VS. Moreover, basal NMDAR1 subunit protein levels were increased in PFc, DS and VS relative to NRB controls. In addition, DAT protein levels were elevated in PFc and VS relative to NRB controls. IN-DA led to a number of changes of EAA, NMDAR1 subunit protein, TH and DAT protein levels in PFc, DS, VS, MES and VTA, in both NHE and NRB rats with significant differences between lines. Our findings indicate that the NHE rat model of ADHD may be characterized by (1) prefrontal and striatal DAT hyperfunction, indicative of DA hyperactivty, and (2) prefrontal and striatal NMDA receptor hyperfunction indicative of net EAA hyperactivty. IN-DA had ameliorative effects on activity level, attention, and working memory, which are likely to be associated with DA action at inhibitory D2 autoreceptors, leading to a reduction in striatal DA hyperactivity and, possibly, DA action on striatal EAA levels, resulting in a decrease of striatal EAA hyperfunction (with persistence of prefrontal EAA hyperfunction). Previous studies on IN-DA treatment in rodents have indicated antidepressant, anxiolytic and anti-parkinsonian effects in relation to enhanced central DAergic activity. Our present results strengthen the prospects of potential therapeutic applications of intranasal  DA by indicating an enhancement of selective attention and working memory in a deficit model.

Agroecology Education: Action-Oriented Learning and Research

ERIC Educational Resources Information Center

Lieblein, Geir; Breland, Tor Arvid; Francis, Charles; Ostergaard, Edvin

2012-01-01

Purpose: This article examines and evaluates the potential contributions from action learning and action research with stakeholders to higher education in agriculture and food systems. Design/Methodology/Approach: The research is based on our experiences over the past two decades of running PhD courses and an MSc degree programme in Agroecology in…

Using Action Verbs as Learning Outcomes: Applying Bloom's Taxonomy in Measuring Instructional Objectives in Introductory Psychology

ERIC Educational Resources Information Center

Nevid, Jeffrey S.; McClelland, Nate

2013-01-01

We used a set of action verbs based on Bloom's taxonomy to assess learning outcomes in two college-level introductory psychology courses. The action verbs represented an acronym, IDEA, comprising skills relating to identifying, defining or describing, evaluating or explaining, and applying psychological knowledge. Exam performance demonstrated…

Cholinergic Interneurons Mediate Fast VGluT3-Dependent Glutamatergic Transmission in the Striatum

PubMed Central

Higley, Michael J.; Balthasar, Nina; Seal, Rebecca P.; Edwards, Robert H.; Lowell, Bradford B.; Kreitzer, Anatol C.; Sabatini, Bernardo L.

2011-01-01

The neurotransmitter glutamate is released by excitatory projection neurons throughout the brain. However, non-glutamatergic cells, including cholinergic and monoaminergic neurons, express markers that suggest that they are also capable of vesicular glutamate release. Striatal cholinergic interneurons (CINs) express the Type-3 vesicular glutamate transporter (VGluT3), although whether they form functional glutamatergic synapses is unclear. To examine this possibility, we utilized mice expressing Cre-recombinase under control of the endogenous choline acetyltransferase locus and conditionally expressed light-activated Channelrhodopsin2 in CINs. Optical stimulation evoked action potentials in CINs and produced postsynaptic responses in medium spiny neurons that were blocked by glutamate receptor antagonists. CIN-mediated glutamatergic responses exhibited a large contribution of NMDA-type glutamate receptors, distinguishing them from corticostriatal inputs. CIN-mediated glutamatergic responses were insensitive to antagonists of acetylcholine receptors and were not seen in mice lacking VGluT3. Our results indicate that CINs are capable of mediating fast glutamatergic transmission, suggesting a new role for these cells in regulating striatal activity. PMID:21544206

Modification of opiate agonist binding by pertussis toxin

DOE Office of Scientific and Technical Information (OSTI.GOV)

Abood, M.E.; Lee, N.M.; Loh, H.H.

1986-03-05

Opiate agonist binding is decreased by GTP, suggesting the possible involvement of GTP binding proteins in regulation of opiate receptor binding. This possibility was addressed by asking whether pertussis toxin treatment, which results in ADP-ribosylation and modification of G proteins, would alter opiate agonist binding. The striatum was chosen for the initial brain area to be studied, since regulation of opiate action in this area had been shown to be modified by pertussis toxin. Treatment of striatal membranes with pertussis toxin results in up to a 55% decrease in /sup 3/(H)-DADLE binding as compared with membranes treated identically without toxin.more » This corresponds to a near complete ADP-ribosylation of both G proteins in the striatal membrane. The decrease in agonist binding appears to be due to an altered affinity of the receptor for agonist as opposed to a decrease in the number of sites. This effect of pertussis toxin on opiate agonist binding demonstrates the actual involvement of G proteins in regulation of opiate receptor binding.« less

Social information signaling by neurons in primate striatum.

PubMed

Klein, Jeffrey T; Platt, Michael L

2013-04-22

Social decisions depend on reliable information about others. Consequently, social primates are motivated to acquire information about the identity, social status, and reproductive quality of others. Neurophysiological and neuroimaging studies implicate the striatum in the motivational control of behavior. Neuroimaging studies specifically implicate the ventromedial striatum in signaling motivational aspects of social interaction. Despite this evidence, precisely how striatal neurons encode social information remains unknown. Therefore, we probed the activity of single striatal neurons in monkeys choosing between visual social information at the potential expense of fluid reward. We show for the first time that a population of neurons located primarily in medial striatum selectively signals social information. Surprisingly, representation of social information was unrelated to simultaneously expressed social preferences. A largely nonoverlapping population of neurons that was not restricted to the medial striatum signaled information about fluid reward. Our findings demonstrate that information about social context and nutritive reward are maintained largely independently in striatum, even when both influence decisions to execute a single action. Copyright © 2013 Elsevier Ltd. All rights reserved.

Drug Addiction: Updating Actions to Habits to Compulsions Ten Years On.

PubMed

Everitt, Barry J; Robbins, Trevor W

2016-01-01

A decade ago, we hypothesized that drug addiction can be viewed as a transition from voluntary, recreational drug use to compulsive drug-seeking habits, neurally underpinned by a transition from prefrontal cortical to striatal control over drug seeking and taking as well as a progression from the ventral to the dorsal striatum. Here, in the light of burgeoning, supportive evidence, we reconsider and elaborate this hypothesis, in particular the refinements in our understanding of ventral and dorsal striatal mechanisms underlying goal-directed and habitual drug seeking, the influence of drug-associated Pavlovian-conditioned stimuli on drug seeking and relapse, and evidence for impairments in top-down prefrontal cortical inhibitory control over this behavior. We further review animal and human studies that have begun to define etiological factors and individual differences in the propensity to become addicted to drugs, leading to the description of addiction endophenotypes, especially for cocaine addiction. We consider the prospect of novel treatments for addiction that promote abstinence from and relapse to drug use.

Basal Ganglia Disorders Associated with Imbalances in the Striatal Striosome and Matrix Compartments

PubMed Central

Crittenden, Jill R.; Graybiel, Ann M.

2011-01-01

The striatum is composed principally of GABAergic, medium spiny striatal projection neurons (MSNs) that can be categorized based on their gene expression, electrophysiological profiles, and input–output circuits. Major subdivisions of MSN populations include (1) those in ventromedial and dorsolateral striatal regions, (2) those giving rise to the direct and indirect pathways, and (3) those that lie in the striosome and matrix compartments. The first two classificatory schemes have enabled advances in understanding of how basal ganglia circuits contribute to disease. However, despite the large number of molecules that are differentially expressed in the striosomes or the extra-striosomal matrix, and the evidence that these compartments have different input–output connections, our understanding of how this compartmentalization contributes to striatal function is still not clear. A broad view is that the matrix contains the direct and indirect pathway MSNs that form parts of sensorimotor and associative circuits, whereas striosomes contain MSNs that receive input from parts of limbic cortex and project directly or indirectly to the dopamine-containing neurons of the substantia nigra, pars compacta. Striosomes are widely distributed within the striatum and are thought to exert global, as well as local, influences on striatal processing by exchanging information with the surrounding matrix, including through interneurons that send processes into both compartments. It has been suggested that striosomes exert and maintain limbic control over behaviors driven by surrounding sensorimotor and associative parts of the striatal matrix. Consistent with this possibility, imbalances between striosome and matrix functions have been reported in relation to neurological disorders, including Huntington’s disease, L-DOPA-induced dyskinesias, dystonia, and drug addiction. Here, we consider how signaling imbalances between the striosomes and matrix might relate to symptomatology in these disorders. PMID:21941467

Canceling actions involves a race between basal ganglia pathways

PubMed Central

Schmidt, Robert; Leventhal, Daniel K.; Mallet, Nicolas; Chen, Fujun; Berke, Joshua D.

2013-01-01

Salient cues can prompt the rapid interruption of planned actions. It has been proposed that fast, reactive behavioral inhibition involves specific basal ganglia pathways, and we tested this by comparing activity in multiple rat basal ganglia structures during performance of a stop-signal task. Subthalamic nucleus (STN) neurons showed low-latency responses to Stop cues, irrespective of whether actions were successfully canceled or not. By contrast, neurons downstream in the substantia nigra pars reticulata (SNr) responded to Stop cues only in trials with successful cancellation. Recordings and simulations together indicate that this sensorimotor gating arises from the relative timing of two distinct inputs to neurons in the SNr dorsolateral “core” subregion: cue-related excitation from STN and movement-related inhibition from striatum. Our results support race models of action cancellation, with successful stopping requiring Stop cue information to be transmitted from STN to SNr before increased striatal input creates a point of no return. PMID:23852117

Striatal response to reward anticipation: evidence for a systems-level intermediate phenotype for schizophrenia.

PubMed

Grimm, Oliver; Heinz, Andreas; Walter, Henrik; Kirsch, Peter; Erk, Susanne; Haddad, Leila; Plichta, Michael M; Romanczuk-Seiferth, Nina; Pöhland, Lydia; Mohnke, Sebastian; Mühleisen, Thomas W; Mattheisen, Manuel; Witt, Stephanie H; Schäfer, Axel; Cichon, Sven; Nöthen, Markus; Rietschel, Marcella; Tost, Heike; Meyer-Lindenberg, Andreas

2014-05-01

Attenuated ventral striatal response during reward anticipation is a core feature of schizophrenia that is seen in prodromal, drug-naive, and chronic schizophrenic patients. Schizophrenia is highly heritable, raising the possibility that this phenotype is related to the genetic risk for the disorder. To examine a large sample of healthy first-degree relatives of schizophrenic patients and compare their neural responses to reward anticipation with those of carefully matched controls without a family psychiatric history. To further support the utility of this phenotype, we studied its test-retest reliability, its potential brain structural contributions, and the effects of a protective missense variant in neuregulin 1 (NRG1) linked to schizophrenia by meta-analysis (ie, rs10503929). Examination of a well-established monetary reward anticipation paradigm during functional magnetic resonance imaging at a university hospital; voxel-based morphometry; test-retest reliability analysis of striatal activations in an independent sample of 25 healthy participants scanned twice with the same task; and imaging genetics analysis of the control group. A total of 54 healthy first-degree relatives of schizophrenic patients and 80 controls matched for demographic, psychological, clinical, and task performance characteristics were studied. Blood oxygen level-dependent response during reward anticipation, analysis of intraclass correlations of functional contrasts, and associations between striatal gray matter volume and NRG1 genotype. Compared with controls, healthy first-degree relatives showed a highly significant decrease in ventral striatal activation during reward anticipation (familywise error-corrected P < .03 for multiple comparisons across the whole brain). Supplemental analyses confirmed that the identified systems-level functional phenotype is reliable (with intraclass correlation coefficients of 0.59-0.73), independent of local gray matter volume (with no corresponding group differences and no correlation to function, and with all uncorrected P values >.05), and affected by the NRG1 genotype (higher striatal responses in controls with the protective rs10503929 C allele; familywise error-corrected P < .03 for ventral striatal response). Healthy first-degree relatives of schizophrenic patients show altered striatal activation during reward anticipation in a directionality and localization consistent with prior patient findings. This provides evidence for a functional neural system mechanism related to familial risk. The phenotype can be assessed reliably, is independent of alterations in striatal structure, and is influenced by a schizophrenia candidate gene variant in NRG1. These data encourage us to further investigate the genetic and molecular contributions to this phenotype.

Learning to Internalize Action Dialogue

ERIC Educational Resources Information Center

Cotter, Teresa Ellen

2011-01-01

The purpose of this case study was to explore how participants of a communications workshop, "Action Dialogue," perceived their ability to engage in dialogue was improved and enhanced. The study was based on the following assumptions: (1) dialogue skills can be learned and people are able to learn these skills; (2) context and emotion influence…

Changes in corticostriatal connectivity during reinforcement learning in humans.

PubMed

Horga, Guillermo; Maia, Tiago V; Marsh, Rachel; Hao, Xuejun; Xu, Dongrong; Duan, Yunsuo; Tau, Gregory Z; Graniello, Barbara; Wang, Zhishun; Kangarlu, Alayar; Martinez, Diana; Packard, Mark G; Peterson, Bradley S

2015-02-01

Many computational models assume that reinforcement learning relies on changes in synaptic efficacy between cortical regions representing stimuli and striatal regions involved in response selection, but this assumption has thus far lacked empirical support in humans. We recorded hemodynamic signals with fMRI while participants navigated a virtual maze to find hidden rewards. We fitted a reinforcement-learning algorithm to participants' choice behavior and evaluated the neural activity and the changes in functional connectivity related to trial-by-trial learning variables. Activity in the posterior putamen during choice periods increased progressively during learning. Furthermore, the functional connections between the sensorimotor cortex and the posterior putamen strengthened progressively as participants learned the task. These changes in corticostriatal connectivity differentiated participants who learned the task from those who did not. These findings provide a direct link between changes in corticostriatal connectivity and learning, thereby supporting a central assumption common to several computational models of reinforcement learning. © 2014 Wiley Periodicals, Inc.

Superior cognitive mapping through single landmark-related learning than through boundary-related learning.

PubMed

Zhou, Ruojing; Mou, Weimin

2016-08-01

Cognitive mapping is assumed to be through hippocampus-dependent place learning rather than striatum-dependent response learning. However, we proposed that either type of spatial learning, as long as it involves encoding metric relations between locations and reference points, could lead to a cognitive map. Furthermore, the fewer reference points to specify individual locations, the more accurate a cognitive map of these locations will be. We demonstrated that participants have more accurate representations of vectors between 2 locations and of configurations among 3 locations when locations are individually encoded in terms of a single landmark than when locations are encoded in terms of a boundary. Previous findings have shown that learning locations relative to a boundary involve stronger place learning and higher hippocampal activation whereas learning relative to a single landmark involves stronger response learning and higher striatal activation. Recognizing this, we have provided evidence challenging the cognitive map theory but favoring our proposal. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

How Does the Hippocampal Formation Mediate Memory for Stimuli Processed by the Magnocellular and Parvocellular Visual Pathways? Evidence from the Comparison of Schizophrenia and Amnestic Mild Cognitive Impairment (aMCI)

ERIC Educational Resources Information Center

Keri, Szabolcs; Szamosi, Andras; Benedek, Gyorgy; Kelemen, Oguz

2012-01-01

Paired associates learning is impaired in both schizophrenia and amnestic mild cognitive impairment (aMCI), which may reflect hippocampal pathology. In addition, schizophrenia is characterized by the dysfunction of the retino-geniculo-striatal magnocellular (M) visual pathway. The purpose of this study was to investigate the interaction between…

A dissociation of dorso-lateral striatum and amygdala function on the same stimulus-response habit task.

PubMed

McDonald, R J; Hong, N S

2004-01-01

This experiment tested the idea that the amygdala-based learning and memory system covertly acquires a stimulus-reward (stimulus-outcome) association during acquisition of a stimulus-response (S-R) habit task developed for the eight-arm radial maze. Groups of rats were given dorso-lateral striatal or amygdala lesions and then trained on the S-R habit task on the eight-arm radial maze. Rats with neurotoxic damage to the dorso-lateral striatum were severely impaired on the acquisition of the S-R habit task but showed a conditioned-cue preference for the stimulus reinforced during S-R habit training. Rats with neurotoxic damage to the amygdala were able to acquire the S-R habit task but did not show a conditioned-cue preference for the stimulus reinforced during S-R habit training. This pattern of results represents a dissociation of learning and memory functions of the dorsal striatum and amygdala on the same task.

Motor memory is encoded as a gain-field combination of intrinsic and extrinsic action representations.

PubMed

Brayanov, Jordan B; Press, Daniel Z; Smith, Maurice A

2012-10-24

Actions can be planned in either an intrinsic (body-based) reference frame or an extrinsic (world-based) frame, and understanding how the internal representations associated with these frames contribute to the learning of motor actions is a key issue in motor control. We studied the internal representation of this learning in human subjects by analyzing generalization patterns across an array of different movement directions and workspaces after training a visuomotor rotation in a single movement direction in one workspace. This provided a dense sampling of the generalization function across intrinsic and extrinsic reference frames, which allowed us to dissociate intrinsic and extrinsic representations and determine the manner in which they contributed to the motor memory for a trained action. A first experiment showed that the generalization pattern reflected a memory that was intermediate between intrinsic and extrinsic representations. A second experiment showed that this intermediate representation could not arise from separate intrinsic and extrinsic learning. Instead, we find that the representation of learning is based on a gain-field combination of local representations in intrinsic and extrinsic coordinates. This gain-field representation generalizes between actions by effectively computing similarity based on the (Mahalanobis) distance across intrinsic and extrinsic coordinates and is in line with neural recordings showing mixed intrinsic-extrinsic representations in motor and parietal cortices.

CNTNAP2 is a direct FoxP2 target in vitro and in vivo in zebra finches: complex regulation by age and activity.

PubMed

Adam, I; Mendoza, E; Kobalz, U; Wohlgemuth, S; Scharff, C

2017-07-01

Mutations of FOXP2 are associated with altered brain structure, including the striatal part of the basal ganglia, and cause a severe speech and language disorder. Songbirds serve as a tractable neurobiological model for speech and language research. Experimental downregulation of FoxP2 in zebra finch Area X, a nucleus of the striatal song control circuitry, affects synaptic transmission and spine densities. It also renders song learning and production inaccurate and imprecise, similar to the speech impairment of patients carrying FOXP2 mutations. Here we show that experimental downregulation of FoxP2 in Area X using lentiviral vectors leads to reduced expression of CNTNAP2, a FOXP2 target gene in humans. In addition, natural downregulation of FoxP2 by age or by singing also downregulated CNTNAP2 expression. Furthermore, we report that FoxP2 binds to and activates the avian CNTNAP2 promoter in vitro. Taken together these data establish CNTNAP2 as a direct FoxP2 target gene in songbirds, likely affecting synaptic function relevant for song learning and song maintenance. © 2017 The Authors. Genes, Brain and Behavior published by International Behavioural and Neural Genetics Society and John Wiley & Sons Ltd.

Age-related differences in striatal, medial temporal, and frontal involvement during value-based decision processing.

PubMed

Su, Yu-Shiang; Chen, Jheng-Ting; Tang, Yong-Jheng; Yuan, Shu-Yun; McCarrey, Anna C; Goh, Joshua Oon Soo

2018-05-21

Appropriate neural representation of value and application of decision strategies are necessary to make optimal investment choices in real life. Normative human aging alters neural selectivity and control processing in brain regions implicated in value-based decision processing including striatal, medial temporal, and frontal areas. However, the specific neural mechanisms of how these age-related functional brain changes modulate value processing in older adults remain unclear. Here, young and older adults performed a lottery-choice functional magnetic resonance imaging experiment in which probabilities of winning different magnitudes of points constituted expected values of stakes. Increasing probability of winning modulated striatal responses in young adults, but modulated medial temporal and ventromedial prefrontal areas instead in older adults. Older adults additionally engaged higher responses in dorso-medio-lateral prefrontal cortices to more unfavorable stakes. Such extrastriatal involvement mediated age-related increase in risk-taking decisions. Furthermore, lower resting-state functional connectivity between lateral prefrontal and striatal areas also predicted lottery-choice task risk-taking that was mediated by higher functional connectivity between prefrontal and medial temporal areas during the task, with this mediation relationship being stronger in older than younger adults. Overall, we report evidence of a systemic neural mechanistic change in processing of probability in mixed-lottery values with age that increases risk-taking of unfavorable stakes in older adults. Moreover, individual differences in age-related effects on baseline frontostriatal communication may be a central determinant of such subsequent age differences in value-based decision neural processing and resulting behaviors. Copyright © 2018 Elsevier Inc. All rights reserved.

Community Based Learning and Civic Engagement: Informal Learning among Adult Volunteers in Community Organizations

ERIC Educational Resources Information Center

Mundel, Karsten; Schugurensky, Daniel

2008-01-01

Many iterations of community based learning employ models, such as consciousness raising groups, cultural circles, and participatory action research. In all of them, learning is a deliberate part of an explicit educational activity. This article explores another realm of community learning: the informal learning that results from volunteering in…

Agent Reward Shaping for Alleviating Traffic Congestion

NASA Technical Reports Server (NTRS)

Tumer, Kagan; Agogino, Adrian

2006-01-01

Traffic congestion problems provide a unique environment to study how multi-agent systems promote desired system level behavior. What is particularly interesting in this class of problems is that no individual action is intrinsically "bad" for the system but that combinations of actions among agents lead to undesirable outcomes, As a consequence, agents need to learn how to coordinate their actions with those of other agents, rather than learn a particular set of "good" actions. This problem is ubiquitous in various traffic problems, including selecting departure times for commuters, routes for airlines, and paths for data routers. In this paper we present a multi-agent approach to two traffic problems, where far each driver, an agent selects the most suitable action using reinforcement learning. The agent rewards are based on concepts from collectives and aim to provide the agents with rewards that are both easy to learn and that if learned, lead to good system level behavior. In the first problem, we study how agents learn the best departure times of drivers in a daily commuting environment and how following those departure times alleviates congestion. In the second problem, we study how agents learn to select desirable routes to improve traffic flow and minimize delays for. all drivers.. In both sets of experiments,. agents using collective-based rewards produced near optimal performance (93-96% of optimal) whereas agents using system rewards (63-68%) barely outperformed random action selection (62-64%) and agents using local rewards (48-72%) performed worse than random in some instances.

The prefrontal cortex and hybrid learning during iterative competitive games.

PubMed

Abe, Hiroshi; Seo, Hyojung; Lee, Daeyeol

2011-12-01

Behavioral changes driven by reinforcement and punishment are referred to as simple or model-free reinforcement learning. Animals can also change their behaviors by observing events that are neither appetitive nor aversive when these events provide new information about payoffs available from alternative actions. This is an example of model-based reinforcement learning and can be accomplished by incorporating hypothetical reward signals into the value functions for specific actions. Recent neuroimaging and single-neuron recording studies showed that the prefrontal cortex and the striatum are involved not only in reinforcement and punishment, but also in model-based reinforcement learning. We found evidence for both types of learning, and hence hybrid learning, in monkeys during simulated competitive games. In addition, in both the dorsolateral prefrontal cortex and orbitofrontal cortex, individual neurons heterogeneously encoded signals related to actual and hypothetical outcomes from specific actions, suggesting that both areas might contribute to hybrid learning. © 2011 New York Academy of Sciences.

Transplantation of induced pluripotent stem cells improves functional recovery in Huntington's disease rat model.

PubMed

Mu, Shuhua; Wang, Jiachuan; Zhou, Guangqian; Peng, Wenda; He, Zhendan; Zhao, Zhenfu; Mo, CuiPing; Qu, Junle; Zhang, Jian

2014-01-01

The purpose of this study was to determine the functional recovery of the transplanted induced pluripotent stem cells in a rat model of Huntington's disease with use of 18F-FDG microPET/CT imaging. In a quinolinic acid-induced rat model of striatal degeneration, induced pluripotent stem cells were transplanted into the ipsilateral lateral ventricle ten days after the quinolinic acid injection. The response to the treatment was evaluated by serial 18F-FDG PET/CT scans and Morris water maze test. Histological analyses and Western blotting were performed six weeks after stem cell transplantation. After induced pluripotent stem cells transplantation, higher 18F-FDG accumulation in the injured striatum was observed during the 4 to 6-weeks period compared with the quinolinic acid-injected group, suggesting the metabolic recovery of injured striatum. The induced pluripotent stem cells transplantation improved learning and memory function (and striatal atrophy) of the rat in six week in the comparison with the quinolinic acid-treated controls. In addition, immunohistochemical analysis demonstrated that transplanted stem cells survived and migrated into the lesioned area in striatum, and most of the stem cells expressed protein markers of neurons and glial cells. Our findings show that induced pluripotent stem cells can survive, differentiate to functional neurons and improve partial striatal function and metabolism after implantation in a rat Huntington's disease model.

The effects of gestational and chronic atrazine exposure on motor behaviors and striatal dopamine in male Sprague-Dawley rats

DOE Office of Scientific and Technical Information (OSTI.GOV)

Walters, Jennifer L., E-mail: Jennifer.l.walters@wmich.edu; Lansdell, Theresa A., E-mail: lansdel1@msu.edu; Lookingland, Keith J., E-mail: lookingl@msu.edu

This study sought to investigate the effects of environmentally relevant gestational followed by continued chronic exposure to the herbicide, atrazine, on motor function, cognition, and neurochemical indices of nigrostriatal dopamine (DA) activity in male rats. Dams were treated with 100 μg/kg atrazine, 10 mg/kg atrazine, or vehicle on gestational day 1 through postnatal day 21. Upon weaning, male offspring continued daily vehicle or atrazine gavage treatments for an additional six months. Subjects were tested in a series of behavioral assays, and 24 h after the last treatment, tissue samples from the striatum were analyzed for DA and 3,4-dihydroxyphenylacetic acid (DOPAC).more » At 10 mg/kg, this herbicide was found to produce modest disruptions in motor functioning, and at both dose levels it significantly lowered striatal DA and DOPAC concentrations. These results suggest that exposures to atrazine have the potential to disrupt nigrostriatal DA neurons and behaviors associated with motor functioning. - Highlights: • Male rats received gestational and chronic exposure to ATZ (10 mg/kg and 100 μg/kg). • ATZ altered locomotor activity and impaired motor coordination. • ATZ lowered striatal DA and DOPAC concentrations. • ATZ produced a potential anxiogenic effect. • ATZ did not impair performance in learning and memory assessments.« less

Comparing Team Learning Approaches through the Lens of Activity Theory

ERIC Educational Resources Information Center

Park, Sunyoung; Cho, Yonjoo; Yoon, Seung Won; Han, Heeyoung

2013-01-01

Purpose: The purpose of this study is to examine the distinctive features of three team learning approaches (action learning, problem-based learning, and project-based learning), compare and contrast them, and discuss implications for practice and research. Design/methodology/approach: The authors used Torraco's integrative literature review…

Facilitating the learning process in design-based learning practices: an investigation of teachers' actions in supervising students

NASA Astrophysics Data System (ADS)

Gómez Puente, S. M.; van Eijck, M.; Jochems, W.

2013-11-01

Background: In research on design-based learning (DBL), inadequate attention is paid to the role the teacher plays in supervising students in gathering and applying knowledge to design artifacts, systems, and innovative solutions in higher education. Purpose: In this study, we examine whether teacher actions we previously identified in the DBL literature as important in facilitating learning processes and student supervision are present in current DBL engineering practices. Sample: The sample (N=16) consisted of teachers and supervisors in two engineering study programs at a university of technology: mechanical and electrical engineering. We selected randomly teachers from freshman and second-year bachelor DBL projects responsible for student supervision and assessment. Design and method: Interviews with teachers, and interviews and observations of supervisors were used to examine how supervision and facilitation actions are applied according to the DBL framework. Results: Major findings indicate that formulating questions is the most common practice seen in facilitating learning in open-ended engineering design environments. Furthermore, other DBL actions we expected to see based upon the literature were seldom observed in the coaching practices within these two programs. Conclusions: Professionalization of teachers in supervising students need to include methods to scaffold learning by supporting students in reflecting and in providing formative feedback.

Nature or nurture? Determining the heritability of human striatal dopamine function: an [18F]-DOPA PET study.

PubMed

Stokes, Paul R A; Shotbolt, Paul; Mehta, Mitul A; Turkheimer, Eric; Benecke, Aaf; Copeland, Caroline; Turkheimer, Federico E; Lingford-Hughes, Anne R; Howes, Oliver D

2013-02-01

Striatal dopamine function is important for normal personality, cognitive processes and behavior, and abnormalities are linked to a number of neuropsychiatric disorders. However, no studies have examined the relative influence of genetic inheritance and environmental factors in determining striatal dopamine function. Using [18F]-DOPA positron emission tomography (PET), we sought to determine the heritability of presynaptic striatal dopamine function by comparing variability in uptake values in same sex monozygotic (MZ) twins to dizygotic (DZ) twins. Nine MZ and 10 DZ twin pairs underwent high-resolution [18F]-DOPA PET to assess presynaptic striatal dopamine function. Uptake values for the overall striatum and functional striatal subdivisions were determined by a Patlak analysis using a cerebellar reference region. Heritability, shared environmental effects and non-shared individual-specific effects were estimated using a region of interest (ROI) analysis and a confirmatory parametric analysis. Overall striatal heritability estimates from the ROI and parametric analyses were 0.44 and 0.33, respectively. We found a distinction between striatal heritability in the functional subdivisions, with the greatest heritability estimates occurring in the sensorimotor striatum and the greatest effect of individual-specific environmental factors in the limbic striatum. Our results indicate that variation in overall presynaptic striatal dopamine function is determined by a combination of genetic factors and individual-specific environmental factors, with familial environmental effects having no effect. These findings underline the importance of individual-specific environmental factors for striatal dopaminergic function, particularly in the limbic striatum, with implications for understanding neuropsychiatric disorders such as schizophrenia and addictions.

Nature or Nurture? Determining the Heritability of Human Striatal Dopamine Function: an [18F]-DOPA PET Study

PubMed Central

Stokes, Paul R A; Shotbolt, Paul; Mehta, Mitul A; Turkheimer, Eric; Benecke, Aaf; Copeland, Caroline; Turkheimer, Federico E; Lingford-Hughes, Anne R; Howes, Oliver D

2013-01-01

Striatal dopamine function is important for normal personality, cognitive processes and behavior, and abnormalities are linked to a number of neuropsychiatric disorders. However, no studies have examined the relative influence of genetic inheritance and environmental factors in determining striatal dopamine function. Using [18F]-DOPA positron emission tomography (PET), we sought to determine the heritability of presynaptic striatal dopamine function by comparing variability in uptake values in same sex monozygotic (MZ) twins to dizygotic (DZ) twins. Nine MZ and 10 DZ twin pairs underwent high-resolution [18F]-DOPA PET to assess presynaptic striatal dopamine function. Uptake values for the overall striatum and functional striatal subdivisions were determined by a Patlak analysis using a cerebellar reference region. Heritability, shared environmental effects and non-shared individual-specific effects were estimated using a region of interest (ROI) analysis and a confirmatory parametric analysis. Overall striatal heritability estimates from the ROI and parametric analyses were 0.44 and 0.33, respectively. We found a distinction between striatal heritability in the functional subdivisions, with the greatest heritability estimates occurring in the sensorimotor striatum and the greatest effect of individual-specific environmental factors in the limbic striatum. Our results indicate that variation in overall presynaptic striatal dopamine function is determined by a combination of genetic factors and individual-specific environmental factors, with familial environmental effects having no effect. These findings underline the importance of individual-specific environmental factors for striatal dopaminergic function, particularly in the limbic striatum, with implications for understanding neuropsychiatric disorders such as schizophrenia and addictions. PMID:23093224

Developing Deep Group Reflection within a Critical Reflection Action Learning Set

ERIC Educational Resources Information Center

Shepherd, Gary

2016-01-01

This account of practice describes how a manufacturing company in the North of England transformed their approach to problem-solving and action through the use of a Critical Reflection Action Learning (CRAL) methodology. The company, who had been in business for over 25 years, experienced problems due to a diminishing customer base and substantial…

Inhibition of striatal cholinergic interneuron activity by the Kv7 opener retigabine and the nonsteroidal anti-inflammatory drug diclofenac.

PubMed

Paz, Rodrigo Manuel; Tubert, Cecilia; Stahl, Agostina; Díaz, Analía López; Etchenique, Roberto; Murer, Mario Gustavo; Rela, Lorena

2018-05-11

Striatal cholinergic interneurons provide modulation to striatal circuits involved in voluntary motor control and goal-directed behaviors through their autonomous tonic discharge and their firing "pause" responses to novel and rewarding environmental events. Striatal cholinergic interneuron hyperactivity was linked to the motor deficits associated with Parkinson's disease and the adverse effects of chronic antiparkinsonian therapy like l-DOPA-induced dyskinesia. Here we addressed whether Kv7 channels, which provide negative feedback to excitation in other neuron types, are involved in the control of striatal cholinergic interneuron tonic activity and response to excitatory inputs. We found that autonomous firing of striatal cholinergic interneurons is not regulated by Kv7 channels. In contrast, Kv7 channels limit the summation of excitatory postsynaptic potentials in cholinergic interneurons through a postsynaptic mechanism. Striatal cholinergic interneurons have a high reserve of Kv7 channels, as their opening using pharmacological tools completely silenced the tonic firing and markedly reduced their intrinsic excitability. A strong inhibition of striatal cholinergic interneurons was also observed in response to the anti-inflammatory drugs diclofenac and meclofenamic acid, however, this effect was independent of Kv7 channels. These data bring attention to new potential molecular targets and pharmacological tools to control striatal cholinergic interneuron activity in pathological conditions where they are believed to be hyperactive, including Parkinson's disease. Copyright © 2018 Elsevier Ltd. All rights reserved.

Associative processes in addiction and reward. The role of amygdala-ventral striatal subsystems.

PubMed

Everitt, B J; Parkinson, J A; Olmstead, M C; Arroyo, M; Robledo, P; Robbins, T W

1999-06-29

Only recently have the functional implications of the organization of the ventral striatum, amygdala, and related limbic-cortical structures, and their neuroanatomical interactions begun to be clarified. Processes of activation and reward have long been associated with the NAcc and its dopamine innervation, but the precise relationships between these constructs have remained elusive. We have sought to enrich our understanding of the special role of the ventral striatum in coordinating the contribution of different functional subsystems to confer flexibility, as well as coherence and vigor, to goal-directed behavior, through different forms of associative learning. Such appetitive behavior comprises many subcomponents, some of which we have isolated in these experiments to reveal that, not surprisingly, the mechanisms by which an animal sequences responding to reach a goal are complex. The data reveal how the different components, pavlovian approach (or sign-tracking), conditioned reinforcement (whereby pavlovian stimuli control goal-directed action), and also more general response-invigorating processes (often called "activation," "stress," or "drive") may be integrated within the ventral striatum through convergent interactions of the amygdala, other limbic cortical structures, and the mesolimbic dopamine system to produce coherent behavior. The position is probably not far different when considering aversively motivated behavior. Although it may be necessary to employ simplified, even abstract, paradigms for isolating these mechanisms, their concerted action can readily be appreciated in an adaptive, functional setting, such as the responding by rats for intravenous cocaine under a second-order schedule of reinforcement. Here, the interactions of primary reinforcement, psychomotor activation, pavlovian conditioning, and the control that drug cues exert over the integrated drug-seeking response can be seen to operate both serially and concurrently. The power of our analytic techniques for understanding complex motivated behavior has been evident for some time. However, the crucial point is that we are now able to map these components with increasing certainty onto discrete amygdaloid, and other limbic cortical-ventral striatal subsystems. The neural dissection of these mechanisms also serves an important theoretical purpose in helping to validate the various hypothetical constructs and further developing theory. Major challenges remain, not the least of which is an understanding of the operation of the ventral striatum together with its dopaminergic innervation and its interactions with the basolateral amygdala, hippocampal formation, and prefrontal cortex at a more mechanistic, neuronal level.

Differential loss of striatal projection neurons in Huntington disease

DOE Office of Scientific and Technical Information (OSTI.GOV)

Reiner, A.; Albin, R.L.; Anderson, K.D.

1988-08-01

Huntington disease (HD) is characterized by the loss of striatal projection neurons, which constitute the vast majority of striatal neurons. To determine whether there is differential loss among different populations of striatal projection neurons, the integrity of the axon terminal plexuses arising from the different populations of substance P-containing and enkephalin-containing striatal projection neurons was studied in striatal target areas by immunohistochemistry. Analysis of 17 HD specimens indicated that in early and middle stages of HD, enkephalin-containing neurons projecting to the external segment of the globus pallidus were much more affected than substance P-containing neurons projecting to the internal pallidalmore » segment. Furthermore, substance P-containing neurons projecting to the substantia nigra pars reticulata were more affected than those projecting to the substantia nigra pars compacta. At the most advanced stages of the disease, projections to all striatal target areas were depleted, with the exception of some apparent sparing of the striatal projection to the substantia nigra pars compacta. These finding may explain some of the clinical manifestations and pharmacology of HD. They also may aid in identifying the neural defect underlying HD and provide additional data with which to evaluate current models of HD pathogenesis.« less

Repetitive behaviors in autism are linked to imbalance of corticostriatal connectivity: a functional connectivity MRI study.

PubMed

Abbott, Angela E; Linke, Annika C; Nair, Aarti; Jahedi, Afrooz; Alba, Laura A; Keown, Christopher L; Fishman, Inna; Müller, Ralph-Axel

2018-01-01

The neural underpinnings of repetitive behaviors (RBs) in autism spectrum disorders (ASDs), ranging from cognitive to motor characteristics, remain unknown. We assessed RB symptomatology in 50 ASD and 52 typically developing (TD) children and adolescents (ages 8-17 years), examining intrinsic functional connectivity (iFC) of corticostriatal circuitry, which is important for reward-based learning and integration of emotional, cognitive and motor processing, and considered impaired in ASDs. Connectivity analyses were performed for three functionally distinct striatal seeds (limbic, frontoparietal and motor). Functional connectivity with cortical regions of interest was assessed for corticostriatal circuit connectivity indices and ratios, testing the balance of connectivity between circuits. Results showed corticostriatal overconnectivity of limbic and frontoparietal seeds, but underconnectivity of motor seeds. Correlations with RBs were found for connectivity between the striatal motor seeds and cortical motor clusters from the whole-brain analysis, and for frontoparietal/limbic and motor/limbic connectivity ratios. Division of ASD participants into high (n = 17) and low RB subgroups (n = 19) showed reduced frontoparietal/limbic and motor/limbic circuit ratios for high RB compared to low RB and TD groups in the right hemisphere. Results suggest an association between RBs and an imbalance of corticostriatal iFC in ASD, being increased for limbic, but reduced for frontoparietal and motor circuits. © The Author (2017). Published by Oxford University Press.

Repetitive behaviors in autism are linked to imbalance of corticostriatal connectivity: a functional connectivity MRI study

PubMed Central

Abbott, Angela E; Linke, Annika C; Nair, Aarti; Jahedi, Afrooz; Alba, Laura A; Keown, Christopher L; Fishman, Inna

2018-01-01

Abstract The neural underpinnings of repetitive behaviors (RBs) in autism spectrum disorders (ASDs), ranging from cognitive to motor characteristics, remain unknown. We assessed RB symptomatology in 50 ASD and 52 typically developing (TD) children and adolescents (ages 8–17 years), examining intrinsic functional connectivity (iFC) of corticostriatal circuitry, which is important for reward-based learning and integration of emotional, cognitive and motor processing, and considered impaired in ASDs. Connectivity analyses were performed for three functionally distinct striatal seeds (limbic, frontoparietal and motor). Functional connectivity with cortical regions of interest was assessed for corticostriatal circuit connectivity indices and ratios, testing the balance of connectivity between circuits. Results showed corticostriatal overconnectivity of limbic and frontoparietal seeds, but underconnectivity of motor seeds. Correlations with RBs were found for connectivity between the striatal motor seeds and cortical motor clusters from the whole-brain analysis, and for frontoparietal/limbic and motor/limbic connectivity ratios. Division of ASD participants into high (n = 17) and low RB subgroups (n = 19) showed reduced frontoparietal/limbic and motor/limbic circuit ratios for high RB compared to low RB and TD groups in the right hemisphere. Results suggest an association between RBs and an imbalance of corticostriatal iFC in ASD, being increased for limbic, but reduced for frontoparietal and motor circuits. PMID:29177509

Attenuated response to methamphetamine sensitization and deficits in motor learning and memory after selective deletion of β-catenin in dopamine neurons.

PubMed

Diaz-Ruiz, Oscar; Zhang, Yajun; Shan, Lufei; Malik, Nasir; Hoffman, Alexander F; Ladenheim, Bruce; Cadet, Jean Lud; Lupica, Carl R; Tagliaferro, Adriana; Brusco, Alicia; Bäckman, Cristina M

2012-07-20

In the present study, we analyzed mice with a targeted deletion of β-catenin in DA neurons (DA-βcat KO mice) to address the functional significance of this molecule in the shaping of synaptic responses associated with motor learning and following exposure to drugs of abuse. Relative to controls, DA-βcat KO mice showed significant deficits in their ability to form long-term memories and displayed reduced expression of methamphetamine-induced behavioral sensitization after subsequent challenge doses with this drug, suggesting that motor learning and drug-induced learning plasticity are altered in these mice. Morphological analyses showed no changes in the number or distribution of tyrosine hydroxylase-labeled neurons in the ventral midbrain. While electrochemical measurements in the striatum determined no changes in acute DA release and uptake, a small but significant decrease in DA release was detected in mutant animals after prolonged repetitive stimulation, suggesting a possible deficit in the DA neurotransmitter vesicle reserve pool. However, electron microscopy analyses did not reveal significant differences in the content of synaptic vesicles per terminal, and striatal DA levels were unchanged in DA-βcat KO animals. In contrast, striatal mRNA levels for several markers known to regulate synaptic plasticity and DA neurotransmission were altered in DA-βcat KO mice. This study demonstrates that ablation of β-catenin in DA neurons leads to alterations of motor and reward-associated memories and to adaptations of the DA neurotransmitter system and suggests that β-catenin signaling in DA neurons is required to facilitate the synaptic remodeling underlying the consolidation of long-term memories.

Catecholaminergic challenge uncovers distinct Pavlovian and instrumental mechanisms of motivated (in)action.

PubMed

Swart, Jennifer C; Froböse, Monja I; Cook, Jennifer L; Geurts, Dirk Em; Frank, Michael J; Cools, Roshan; den Ouden, Hanneke Em

2017-05-15

Catecholamines modulate the impact of motivational cues on action. Such motivational biases have been proposed to reflect cue-based, 'Pavlovian' effects. Here, we assess whether motivational biases may also arise from asymmetrical instrumental learning of active and passive responses following reward and punishment outcomes. We present a novel paradigm, allowing us to disentangle the impact of reward and punishment on instrumental learning from Pavlovian response biasing. Computational analyses showed that motivational biases reflect both Pavlovian and instrumental effects: reward and punishment cues promoted generalized (in)action in a Pavlovian manner, whereas outcomes enhanced instrumental (un)learning of chosen actions. These cue- and outcome-based biases were altered independently by the catecholamine enhancer melthylphenidate. Methylphenidate's effect varied across individuals with a putative proxy of baseline dopamine synthesis capacity, working memory span. Our study uncovers two distinct mechanisms by which motivation impacts behaviour, and helps refine current models of catecholaminergic modulation of motivated action.

Student Perceptions of Academic Service Learning: Using Mixed Content Analysis to Examine the Effectiveness of the International Baccalaureate Creativity, Action, Service Programme

ERIC Educational Resources Information Center

Hatziconstantis, Christos; Kolympari, Tania

2016-01-01

The International Baccalaureate Diploma Programme for secondary education students requires the successful completion of the Creativity, Action, Service (CAS) component (more recently renamed Creativity, Activity, Service) which is based on the philosophy of experiential learning and Academic Service Learning. In this article, the technique of…

Collaborative Action Research on Technology Integration for Science Learning

ERIC Educational Resources Information Center

Wang, Chien-hsing; Ke, Yi-Ting; Wu, Jin-Tong; Hsu, Wen-Hua

2012-01-01

This paper briefly reports the outcomes of an action research inquiry on the use of blogs, MS PowerPoint [PPT], and the Internet as learning tools with a science class of sixth graders for project-based learning. Multiple sources of data were essential to triangulate the key findings articulated in this paper. Corresponding to previous studies,…

Living While Being Alive: Education and Learning in the Treatment Action Campaign

ERIC Educational Resources Information Center

Endresen, Kristin; Von Kotze, Astrid

2005-01-01

This paper is based on research into the Treatment Action Campaign (TAC) in South Africa. The research investigated whether, through being active members of this social movement, HIV-positive activists learn things they could not otherwise learn about their status and the epidemic, and how they put such knowledge to use. We show how activists…

Low Dopamine D2/D3 Receptor Availability is Associated with Steep Discounting of Delayed Rewards in Methamphetamine Dependence

PubMed Central

Ballard, Michael E.; Mandelkern, Mark A.; Monterosso, John R.; Hsu, Eustace; Robertson, Chelsea L.; Ishibashi, Kenji; Dean, Andy C.

2015-01-01

Background: Individuals with substance use disorders typically exhibit a predilection toward instant gratification with apparent disregard for the future consequences of their actions. Indirect evidence suggests that low dopamine D2-type receptor availability in the striatum contributes to the propensity of these individuals to sacrifice long-term goals for short-term gain; however, this possibility has not been tested directly. We investigated whether striatal D2/D3 receptor availability is negatively correlated with the preference for smaller, more immediate rewards over larger, delayed alternatives among research participants who met DSM-IV criteria for methamphetamine (MA) dependence. Methods: Fifty-four adults (n = 27 each: MA-dependent, non-user controls) completed the Kirby Monetary Choice Questionnaire, and underwent positron emission tomography scanning with [18F]fallypride. Results: MA users displayed steeper temporal discounting (p = 0.030) and lower striatal D2/D3 receptor availability (p < 0.0005) than controls. Discount rate was negatively correlated with striatal D2/D3 receptor availability, with the relationship reaching statistical significance in the combined sample (r = -0.291, p = 0.016) and among MA users alone (r = -0.342, p = 0.041), but not among controls alone (r = -0.179, p = 0.185); the slopes did not differ significantly between MA users and controls (p = 0.5). Conclusions: These results provide the first direct evidence of a link between deficient D2/D3 receptor availability and steep temporal discounting. This finding fits with reports that low striatal D2/D3 receptor availability is associated with a higher risk of relapse among stimulant users, and may help to explain why some individuals choose to continue using drugs despite knowledge of their eventual negative consequences. Future research directions and therapeutic implications are discussed. PMID:25603861

Low Dopamine D2/D3 Receptor Availability is Associated with Steep Discounting of Delayed Rewards in Methamphetamine Dependence.

PubMed

Ballard, Michael E; Mandelkern, Mark A; Monterosso, John R; Hsu, Eustace; Robertson, Chelsea L; Ishibashi, Kenji; Dean, Andy C; London, Edythe D

2015-01-20

Individuals with substance use disorders typically exhibit a predilection toward instant gratification with apparent disregard for the future consequences of their actions. Indirect evidence suggests that low dopamine D2-type receptor availability in the striatum contributes to the propensity of these individuals to sacrifice long-term goals for short-term gain; however, this possibility has not been tested directly. We investigated whether striatal D2/D3 receptor availability is negatively correlated with the preference for smaller, more immediate rewards over larger, delayed alternatives among research participants who met DSM-IV criteria for methamphetamine (MA) dependence. Fifty-four adults (n = 27 each: MA-dependent, non-user controls) completed the Kirby Monetary Choice Questionnaire, and underwent positron emission tomography scanning with [(18)F]fallypride. MA users displayed steeper temporal discounting (p = 0.030) and lower striatal D2/D3 receptor availability (p < 0.0005) than controls. Discount rate was negatively correlated with striatal D2/D3 receptor availability, with the relationship reaching statistical significance in the combined sample (r = -0.291, p = 0.016) and among MA users alone (r = -0.342, p = 0.041), but not among controls alone (r = -0.179, p = 0.185); the slopes did not differ significantly between MA users and controls (p = 0.5). These results provide the first direct evidence of a link between deficient D2/D3 receptor availability and steep temporal discounting. This finding fits with reports that low striatal D2/D3 receptor availability is associated with a higher risk of relapse among stimulant users, and may help to explain why some individuals choose to continue using drugs despite knowledge of their eventual negative consequences. Future research directions and therapeutic implications are discussed. © The Author 2015. Published by Oxford University Press on behalf of CINP.

Statistical learning of action: the role of conditional probability.

PubMed

Meyer, Meredith; Baldwin, Dare

2011-12-01

Identification of distinct units within a continuous flow of human action is fundamental to action processing. Such segmentation may rest in part on statistical learning. In a series of four experiments, we examined what types of statistics people can use to segment a continuous stream involving many brief, goal-directed action elements. The results of Experiment 1 showed no evidence for sensitivity to conditional probability, whereas Experiment 2 displayed learning based on joint probability. In Experiment 3, we demonstrated that additional exposure to the input failed to engender sensitivity to conditional probability. However, the results of Experiment 4 showed that a subset of adults-namely, those more successful at identifying actions that had been seen more frequently than comparison sequences-were also successful at learning conditional-probability statistics. These experiments help to clarify the mechanisms subserving processing of intentional action, and they highlight important differences from, as well as similarities to, prior studies of statistical learning in other domains, including language.

Differential excitability and modulation of striatal medium spiny neuron dendrites

PubMed Central

Day, Michelle; Wokosin, David; Plotkin, Joshua L.; Tian, Xinyoung; Surmeier, D. James

2011-01-01

The loss of striatal dopamine (DA) in Parkinson's disease (PD) models triggers a cell-type specific reduction in the density of dendritic spines in D2 receptor-expressing striatopallidal medium spiny neurons (D2 MSNs). How the intrinsic properties of MSN dendrites, where the vast majority of DA receptors are found, contribute to this adaptation is not clear. To address this question, two-photon laser scanning microscopy (2PLSM) was performed in patch-clamped mouse MSNs identified in striatal slices by expression of green fluorescent protein (eGFP) controlled by DA receptor promoters. These studies revealed that single back-propagating action potentials (bAP) produced more reliable elevations in cytosolic Ca2+ concentration at distal dendritic locations in D2 MSNs than at similar locations in D1 receptor-expressing striatonigral MSNs (D1 MSNs). In both cell types, the dendritic Ca2+ entry elicited by bAPs was enhanced by pharmacological blockade of Kv4, but not Kv1 K+ channels. Local application of DA depressed dendritic bAP-evoked Ca2+ transients, whereas application of ACh increased these Ca2+ transients in D2 MSNs—but not in D1 MSNs. Following DA depletion, bAP-evoked Ca2+ transients were enhanced in distal dendrites and spines in D2 MSNs. Taken together, these results suggest that normally D2 MSN dendrites are more excitable than those of D1 MSNs and that DA depletion exaggerates this asymmetry, potentially contributing to adaptations in PD models. PMID:18987196

GA-based fuzzy reinforcement learning for control of a magnetic bearing system.

PubMed

Lin, C T; Jou, C P

2000-01-01

This paper proposes a TD (temporal difference) and GA (genetic algorithm)-based reinforcement (TDGAR) learning method and applies it to the control of a real magnetic bearing system. The TDGAR learning scheme is a new hybrid GA, which integrates the TD prediction method and the GA to perform the reinforcement learning task. The TDGAR learning system is composed of two integrated feedforward networks. One neural network acts as a critic network to guide the learning of the other network (the action network) which determines the outputs (actions) of the TDGAR learning system. The action network can be a normal neural network or a neural fuzzy network. Using the TD prediction method, the critic network can predict the external reinforcement signal and provide a more informative internal reinforcement signal to the action network. The action network uses the GA to adapt itself according to the internal reinforcement signal. The key concept of the TDGAR learning scheme is to formulate the internal reinforcement signal as the fitness function for the GA such that the GA can evaluate the candidate solutions (chromosomes) regularly, even during periods without external feedback from the environment. This enables the GA to proceed to new generations regularly without waiting for the arrival of the external reinforcement signal. This can usually accelerate the GA learning since a reinforcement signal may only be available at a time long after a sequence of actions has occurred in the reinforcement learning problem. The proposed TDGAR learning system has been used to control an active magnetic bearing (AMB) system in practice. A systematic design procedure is developed to achieve successful integration of all the subsystems including magnetic suspension, mechanical structure, and controller training. The results show that the TDGAR learning scheme can successfully find a neural controller or a neural fuzzy controller for a self-designed magnetic bearing system.

[Cognition, schizophrenia and the effect of antipsychotics].

PubMed

Stip, E

2006-01-01

In this review, we conclude that cognitive impairments are as important as positive and negative symptoms in the clinical assessment and management of patients with schizophrenia. This is not a comprehensive review, considering that the new Measurement And Treatment Research to Improve Cognition in Schizophrenia (MATRICS) model will soon provide valuable data. It is however a product of the collective efforts of a French Canadian clinical research team that proposes a synthesis of data of pragmatic interest to clinicians. Medication with improved safety and cognition profile, gene-rally lead to better outcomes by facilitating compliance with drug regimens and rehabilitation programs. In addition, measures of attention and executive function (EF) appear to improve with novel antipsychotics when compared to traditional neuroleptics. Nevertheless, evaluating cognitive performance is not a routine procedure outside the domain of research. For example, procedural learning (PL) -- an important measure of cognitive function -- refers to cognitive and motor learning processes in which execution strategies cannot be explicitly described (ie learning by doing). These actions or procedures are then progressively learned through trial and error until automation of optimal performance is established. Procedural learning is rarely assessed in clinical practice. Inconsistent findings regarding the effects of neuroleptic drugs on PL have been reported. Trials using acute administration of chlorpromazine in normal subjects induced PL deficits, suggesting the direct effect of neuroleptics, presumably via a D(2) dopamine blockade in the striatum. In a recent study by our group, schizophrenia patients, divided into three groups according to their pharmacological treatment (haloperidol, clozapine and risperidone) were compared to normal controls on two PL tasks; a visuomotor learning task (mirror drawing) and a problem solving learning task (Tower of Toronto). No deficits were detected in patients receiving clozapine, while haloperidol was associated with deleterious effects in both tasks. Risperidone, however, produced different effects depending on the task performed. Another 6-month double-blind Canadian study confirmed the beneficial effect of olanzapine on PL compared to haloperidol and risperidone. The differential effects of drugs on the striatal D(2) receptors, -irrespective of their classification as conventional or atypical neuroleptics and the specific process implicated in each of these PL tasks may explain these results. Tracer studies using radioactive benzamides (IBZM) specific to striatal D receptors determined a relationship between striatal D(2) receptor occupancy and PL performance such as the mirror drawing task. Using this method, data obtained in Montreal on schizophrenia patients receiving olanzapine and haloperidol have shown that the coefficient of determination in a visuomotor PL task varied inversely with D2 receptor saturation. This review probes the effect of impaired cognitive functions on schizophrenia patients' quality of life. Cognitive deficits found in schizophrenia affect planning, along with the aptitude to initiate and -regulate a goal-directed behaviour. These impairments have been repeatedly, yet inconclusively, attributed to frontal lobe dysfunction. Morphological findings obtained from neuroimaging studies remain inconsistent, some noting no differences between patients and controls while others observing reduced prefrontal volumes in schizophrenia patients. Conversely, functional neuroimaging (fMRI) demonstrated reduced frontal blood flow relative to global cerebral perfusion in schizophrenia patients. Overall, neuroimaging literature provides reliable evidence of frontal impairments in schizophrenia, although the average magnitude of difference between patients and controls is insufficient to defend a frontal lobe dysfunction hypo-thesis, as far as brain volume, resting cerebral metabolism or blood flow are concerned. The only measurement clearly distinguishing between patients and controls is fMRI of the frontal lobe while performing an experimentally controlled task. Here, schizophrenia patients fail to activate their frontal cortex when required. Sensitive to frontal lobe dysfunction are Neuropsychological tests of executive function. A study conducted in Montreal assessed the relation between EF impairments and difficulties in planning daily activities in schizophrenia patients scoring more than 3 on at least 4 items of the PANSS negative subscale. Performances on EF, memory and script generation were measured and compared to controls. Script production task required that subjects recite 10-20 actions that would normally be carried out for during daily life activity (going to a restaurant, buying groceries, etc.). Patients' performances were significantly lower with higher perserveration and sequencing impairments. Routine activities such as the ability to cook a meal were similarly investigated. Patients were videotaped in a kitchen while preparing a specific meal. Optimal sequence of micro- and macro-steps necessary to prepare the meal in a minimal time were measured. Sequencing errors, repetitions and omissions were significantly higher compared to controls. In addition, temporal organization was positively correlated with negative symptoms and low EF performance on neuro-psychological tasks. Thus concluding that EF impairment interferes with basic routine activities in schizophrenia patients, notably those with negative symptoms. Last but not least, we assessed the progress of patients' subjective complaints with regards to their cognitive functions using tests such as the SSTICS, specifically developed to address subjective cognitive complaints and insight. This review concludes that from now on cognitive deficit should be recognized as a major element in social and professional integration of schizophrenia patients, and should become a standardized assessment approach in clinical practice.

Improving 10th Graders' English Communicative Competence through the Implementation of the Task-Based Learning Approach

ERIC Educational Resources Information Center

Buitrago Campo, Ana Carolina

2016-01-01

This article reports the results of an action-research project focused on improving students' communicative competence in English through the task-based learning approach. This study was conducted in a co-educational public school in Medellín (Colombia) with thirty-four tenth graders. Actions implemented include the development of a series of…

Student participation in World Wide Web-based curriculum development of general chemistry

NASA Astrophysics Data System (ADS)

Hunter, William John Forbes

1998-12-01

This thesis describes an action research investigation of improvements to instruction in General Chemistry at Purdue University. Specifically, the study was conducted to guide continuous reform of curriculum materials delivered via the World Wide Web by involving students, instructors, and curriculum designers. The theoretical framework for this study was based upon constructivist learning theory and knowledge claims were developed using an inductive analysis procedure. This results of this study are assertions made in three domains: learning chemistry content via the World Wide Web, learning about learning via the World Wide Web, and learning about participation in an action research project. In the chemistry content domain, students were able to learn chemical concepts that utilized 3-dimensional visualizations, but not textual and graphical information delivered via the Web. In the learning via the Web domain, the use of feedback, the placement of supplementary aids, navigation, and the perception of conceptual novelty were all important to students' use of the Web. In the participation in action research domain, students learned about the complexity of curriculum. development, and valued their empowerment as part of the process.

Productive Learning Practice--A Theoretical Discussion Based on Two Cases

ERIC Educational Resources Information Center

Lillejord, Solvi; Dysthe, Olga

2008-01-01

In this article, we frame "productive learning" in a sociocultural perspective to show how it ties into a cluster of concepts on activity and transformation and illuminates the relation between learning processes and learning products. Based on two case studies, we argue that understanding learning as action entails developing the students'…

Temporal Prediction Errors Affect Short-Term Memory Scanning Response Time.

PubMed

Limongi, Roberto; Silva, Angélica M

2016-11-01

The Sternberg short-term memory scanning task has been used to unveil cognitive operations involved in time perception. Participants produce time intervals during the task, and the researcher explores how task performance affects interval production - where time estimation error is the dependent variable of interest. The perspective of predictive behavior regards time estimation error as a temporal prediction error (PE), an independent variable that controls cognition, behavior, and learning. Based on this perspective, we investigated whether temporal PEs affect short-term memory scanning. Participants performed temporal predictions while they maintained information in memory. Model inference revealed that PEs affected memory scanning response time independently of the memory-set size effect. We discuss the results within the context of formal and mechanistic models of short-term memory scanning and predictive coding, a Bayes-based theory of brain function. We state the hypothesis that our finding could be associated with weak frontostriatal connections and weak striatal activity.

Cognitive components underpinning the development of model-based learning.

PubMed

Potter, Tracey C S; Bryce, Nessa V; Hartley, Catherine A

2017-06-01

Reinforcement learning theory distinguishes "model-free" learning, which fosters reflexive repetition of previously rewarded actions, from "model-based" learning, which recruits a mental model of the environment to flexibly select goal-directed actions. Whereas model-free learning is evident across development, recruitment of model-based learning appears to increase with age. However, the cognitive processes underlying the development of model-based learning remain poorly characterized. Here, we examined whether age-related differences in cognitive processes underlying the construction and flexible recruitment of mental models predict developmental increases in model-based choice. In a cohort of participants aged 9-25, we examined whether the abilities to infer sequential regularities in the environment ("statistical learning"), maintain information in an active state ("working memory") and integrate distant concepts to solve problems ("fluid reasoning") predicted age-related improvements in model-based choice. We found that age-related improvements in statistical learning performance did not mediate the relationship between age and model-based choice. Ceiling performance on our working memory assay prevented examination of its contribution to model-based learning. However, age-related improvements in fluid reasoning statistically mediated the developmental increase in the recruitment of a model-based strategy. These findings suggest that gradual development of fluid reasoning may be a critical component process underlying the emergence of model-based learning. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Towards tailored teaching: using participatory action research to enhance the learning experience of Longitudinal Integrated Clerkship students in a South African rural district hospital.

PubMed

von Pressentin, Klaus B; Waggie, Firdouza; Conradie, Hoffie

2016-03-08

The introduction of Stellenbosch University's Longitudinal Integrated Clerkship (LIC) model as part of the undergraduate medical curriculum offers a unique and exciting training model to develop generalist doctors for the changing South African health landscape. At one of these LIC sites, the need for an improvement of the local learning experience became evident. This paper explores how to identify and implement a tailored teaching and learning intervention to improve workplace-based learning for LIC students. A participatory action research approach was used in a co-operative inquiry group (ten participants), consisting of the students, clinician educators and researchers, who met over a period of 5 months. Through a cyclical process of action and reflection this group identified a teaching intervention. The results demonstrate the gaps and challenges identified when implementing a LIC model of medical education. A structured learning programme for the final 6 weeks of the students' placement at the district hospital was designed by the co-operative inquiry group as an agreed intervention. The post-intervention group reflection highlighted a need to create a structured programme in the spirit of local collaboration and learning across disciplines. The results also enhance our understanding of both students and clinician educators' perceptions of this new model of workplace-based training. This paper provides practical strategies to enhance teaching and learning in a new educational context. These strategies illuminate three paradigm shifts: (1) from the traditional medical education approach towards a transformative learning approach advocated for the 21(st) century health professional; (2) from the teaching hospital context to the district hospital context; and (3) from block-based teaching towards a longitudinal integrated learning model. A programme based on balancing structured and tailored learning activities is recommended in order to address the local learning needs of students in the LIC model. We recommend that action learning sets should be developed at these LIC sites, where the relevant aspects of work-place based learning are negotiated.

Using Science to Take a Stand: Action-Oriented Learning in an Afterschool Science Club

NASA Astrophysics Data System (ADS)

Hagenah, Sara

This dissertation study investigates what happens when students participate in an afterschool science club designed around action-oriented science instruction, a set of curriculum design principles based on social justice pedagogy. Comprised of three manuscripts written for journal publication, the dissertation includes 1) Negotiating community-based action-oriented science teaching and learning: Articulating curriculum design principles, 2) Middle school girls' socio-scientific participation pathways in an afterschool science club, and 3) Laughing and learning together: Productive science learning spaces for middle school girls. By investigating how action-oriented science design principles get negotiated, female identity development in and with science, and the role of everyday social interactions as students do productive science, this research fills gaps in the understanding of how social justice pedagogy gets enacted and negotiated among multiple stakeholders including students, teachers, and community members along what identity development looks like across social and scientific activity. This study will be of interest to educators thinking about how to enact social justice pedagogy in science learning spaces and those interested in identity development in science.

The mediating role of phosphodiesterase type 4 in the dopaminergic modulation of motor impulsivity.

PubMed

Heckman, P R A; Blokland, A; Van Goethem, N P; Van Hagen, B T J; Prickaerts, J

2018-09-17

The current study investigated the mediating role of phosphodiesterase type 4 (PDE4) regulated cAMP in the dopaminergic modulation of premature responding (action restraint) in rats. Response inhibition, which includes action restraint, finds its neurobiological origin in cortico-striatal-thalamic circuitry and can be modulated by dopamine. Intracellularly, the effect of dopamine is largely mediated through the cAMP/PKA signaling cascade. Areas in the prefrontal cortex are very sensitive to their neurochemical environment, including catecholamine levels. As a result, we investigated the effects of intracellular modulation of the dopamine cascade by means of PDE4 inhibition by roflumilast on premature responding in a hypo, normal and hyper dopaminergic state of the brain. As a hypo dopaminergic model we induced a 6-OHDA lesion in the (rat) prefrontal cortex, more specifically the infralimbic cortex. For the hyper dopaminergic state we also turned to a well-established model of impaired action restraint, namely the systemic administration of d-amphetamine. In line with the notion of a U-shaped relation between dopamine and impulsive responding, we found that both increasing and decreasing dopamine levels resulted in an increase in premature responding in the choice serial reaction time task (CSRTT). The PDE4 inhibitor roflumilast increased premature responses in combination with d-amphetamine, whereas a decrease in premature responding after roflumilast treatment was found in the 6-OHDA lesioned animals. As a result, it would be interesting to test the effects of PDE4 inhibition in disorders affected by disrupted impulse control related to cortico-striatal-thalamic hypodopaminergia including attention deficit hyperactivity disorder (ADHD). Copyright © 2018 The Authors. Published by Elsevier B.V. All rights reserved.

Inter-individual differences in decision-making, flexible and goal-directed behaviors: novel insights within the prefronto-striatal networks.

PubMed

Fitoussi, Aurélie; Renault, Prisca; Le Moine, Catherine; Coutureau, Etienne; Cador, Martine; Dellu-Hagedorn, Françoise

2018-03-01

Inflexible behavior is a hallmark of several decision-making-related disorders such as ADHD and addiction. As in humans, a subset of healthy rats makes poor decisions and prefers immediate larger rewards despite suffering large losses in a rat gambling task (RGT). They also display a combination of traits reminiscent of addiction, notably inflexible behavior and perseverative responses. The goal of the present work was twofold: (1) to elucidate if behavioral inflexibility of poor decision-makers could be related to a lower quality of goal-directed behavior (action-outcome associations); (2) to uncover the neural basis of inter-individual differences in goal-directed behavior. We specifically assessed inter-individual differences in decision-making in the RGT, flexibility in the RGT-reversed version and goal-directed behavior in a contingency degradation test, i.e., response adaptation when dissociating reward delivery from the animal's action. The contributions of the medial prefrontal cortex and the dorsal striatum to action-outcome associations were assessed using Zif268 immunodetection. Inflexible behavior was related to a lower sensitivity to contingency degradation in all poor decision-makers and only in a few good decision-makers. This poorer sensitivity was associated with a lower immunoreactivity in prelimbic and infralimbic cortices and a higher one in the dorsomedial and dorsolateral striatum. These findings suggest that an imbalanced prefronto-striatal activity could underlie inaccurate goal representation in changing environments and may promote maladaptive habit formation among poor decision-makers. These data strengthen our previous work identifying biomarkers of vulnerability to develop psychiatric disorders and demonstrate the relevance of inter-individual differences to model maladaptive behaviors.

Thinking outside the cortex: social motivation in the evolution and development of language.

PubMed

Syal, Supriya; Finlay, Barbara L

2011-03-01

Alteration of the organization of social and motivational neuroanatomical circuitry must have been an essential step in the evolution of human language. Development of vocal communication across species, particularly birdsong, and new research on the neural organization and evolution of social and motivational circuitry, together suggest that human language is the result of an obligatory link of a powerful cortico-striatal learning system, and subcortical socio-motivational circuitry.

GluN2B in corticostriatal circuits governs choice learning and choice shifting

PubMed Central

Brigman, Jonathan L.; Daut, Rachel; Wright, Tara; Gunduz-Cinar, Ozge; Graybeal, Carolyn; Davis, Margaret I.; Jiang, Zhihong; Saksida, Lisa; Jinde, Seiichiro; Pease, Matthew; Bussey, Timothy J.; Lovinger, David M.; Nakazawa, Kazu; Holmes, Andrew

2013-01-01

A choice that reliably produces a preferred outcome can be automated to liberate cognitive resources for other tasks. Should an outcome become less desirable, behavior must adapt in parallel or become perseverative. Corticostriatal systems are known to mediate choice learning and flexibility, but the molecular mechanisms subserving the instantiation of these processes are not well understood. We integrated mouse behavioral, immunocytochemical, in vivo electrophysiological, genetic, and pharmacological approaches to study choice. We found that the dorsal striatum (DS) was increasingly activated with choice learning, whereas reversal of learned choice engaged prefrontal regions. In vivo, DS neurons showed activity associated with reward anticipation and receipt that emerged with learning and relearning. Corticostriatal or striatal GluN2B gene deletion, or DS-restricted GluN2B antagonism, impaired choice learning, whereas cortical GluN2B deletion or OFC GluN2B antagonism impaired shifting. Our convergent data demonstrate how corticostriatal GluN2B circuits govern the ability to learn and shift choice behavior. PMID:23831965

Keep focussing: striatal dopamine multiple functions resolved in a single mechanism tested in a simulated humanoid robot

PubMed Central

Fiore, Vincenzo G.; Sperati, Valerio; Mannella, Francesco; Mirolli, Marco; Gurney, Kevin; Friston, Karl; Dolan, Raymond J.; Baldassarre, Gianluca

2014-01-01

The effects of striatal dopamine (DA) on behavior have been widely investigated over the past decades, with “phasic” burst firings considered as the key expression of a reward prediction error responsible for reinforcement learning. Less well studied is “tonic” DA, where putative functions include the idea that it is a regulator of vigor, incentive salience, disposition to exert an effort and a modulator of approach strategies. We present a model combining tonic and phasic DA to show how different outflows triggered by either intrinsically or extrinsically motivating stimuli dynamically affect the basal ganglia by impacting on a selection process this system performs on its cortical input. The model, which has been tested on the simulated humanoid robot iCub interacting with a mechatronic board, shows the putative functions ascribed to DA emerging from the combination of a standard computational mechanism coupled to a differential sensitivity to the presence of DA across the striatum. PMID:24600422

Ventral Striatum and the Evaluation of Memory Retrieval Strategies

PubMed Central

Badre, David; Lebrecht, Sophie; Pagliaccio, David; Long, Nicole M.; Scimeca, Jason M.

2015-01-01

Adaptive memory retrieval requires mechanisms of cognitive control that facilitate the recovery of goal-relevant information. Frontoparietal systems are known to support control of memory retrieval. However, the mechanisms by which the brain acquires, evaluates, and adapts retrieval strategies remain unknown. Here, we provide evidence that ventral striatal activation tracks the success of a retrieval strategy and correlates with subsequent reliance on that strategy. Human participants were scanned with fMRI while performing a lexical decision task. A rule was provided that indicated the likely semantic category of a target word given the category of a preceding prime. Reliance on the rule improved decision-making, as estimated within a drift diffusion framework. Ventral striatal activation tracked the benefit that relying on the rule had on decision-making. Moreover, activation in ventral striatum correlated with a participant’s subsequent reliance on the rule. Taken together, these results support a role for ventral striatum in learning and evaluating declarative retrieval strategies. PMID:24564466

Two-photon imaging in mice shows striosomes and matrix have overlapping but differential reinforcement-related responses

PubMed Central

Sur, Mriganka

2017-01-01

Striosomes were discovered several decades ago as neurochemically identified zones in the striatum, yet technical hurdles have hampered the study of the functions of these striatal compartments. Here we used 2-photon calcium imaging in neuronal birthdate-labeled Mash1-CreER;Ai14 mice to image simultaneously the activity of striosomal and matrix neurons as mice performed an auditory conditioning task. With this method, we identified circumscribed zones of tdTomato-labeled neuropil that correspond to striosomes as verified immunohistochemically. Neurons in both striosomes and matrix responded to reward-predicting cues and were active during or after consummatory licking. However, we found quantitative differences in response strength: striosomal neurons fired more to reward-predicting cues and encoded more information about expected outcome as mice learned the task, whereas matrix neurons were more strongly modulated by recent reward history. These findings open the possibility of harnessing in vivo imaging to determine the contributions of striosomes and matrix to striatal circuit function. PMID:29251596

Effects of disulfiram on choice behavior in a rodent gambling task: association with catecholamine levels.

PubMed

Di Ciano, Patricia; Manvich, Daniel F; Pushparaj, Abhiram; Gappasov, Andrew; Hess, Ellen J; Weinshenker, David; Le Foll, Bernard

2018-01-01

Gambling disorder is a growing societal concern, as recognized by its recent classification as an addictive disorder in the DSM-5. Case reports have shown that disulfiram reduces gambling-related behavior in humans. The purpose of the present study was to determine whether disulfiram affects performance on a rat gambling task, a rodent version of the Iowa gambling task in humans, and whether any changes were associated with alterations in dopamine and/or norepinephrine levels. Rats were administered disulfiram prior to testing on the rat gambling task or prior to analysis of dopamine or norepinephrine levels in brain homogenates. Rats in the behavioral task were divided into two subgroups (optimal vs suboptimal) based on their baseline levels of performance in the rat gambling task. Rats in the optimal group chose the advantageous strategy more, and rats in the suboptimal group (a parallel to problem gambling) chose the disadvantageous strategy more. Rats were not divided into optimal or suboptimal groups prior to neurochemical analysis. Disulfiram administered 2 h, but not 30 min, before the task dose-dependently improved choice behavior in the rats with an initial disadvantageous "gambling-like" strategy, while having no effect on the rats employing an advantageous strategy. The behavioral effects of disulfiram were associated with increased striatal dopamine and decreased striatal norepinephrine. These findings suggest that combined actions on dopamine and norepinephrine may be a useful treatment for gambling disorders.

Do domestic dogs learn words based on humans' referential behaviour?

PubMed

Tempelmann, Sebastian; Kaminski, Juliane; Tomasello, Michael

2014-01-01

Some domestic dogs learn to comprehend human words, although the nature and basis of this learning is unknown. In the studies presented here we investigated whether dogs learn words through an understanding of referential actions by humans rather than simple association. In three studies, each modelled on a study conducted with human infants, we confronted four word-experienced dogs with situations involving no spatial-temporal contiguity between the word and the referent; the only available cues were referential actions displaced in time from exposure to their referents. We found that no dogs were able to reliably link an object with a label based on social-pragmatic cues alone in all the tests. However, one dog did show skills in some tests, possibly indicating an ability to learn based on social-pragmatic cues.

Action Recognition Using Nonnegative Action Component Representation and Sparse Basis Selection.

PubMed

Wang, Haoran; Yuan, Chunfeng; Hu, Weiming; Ling, Haibin; Yang, Wankou; Sun, Changyin

2014-02-01

In this paper, we propose using high-level action units to represent human actions in videos and, based on such units, a novel sparse model is developed for human action recognition. There are three interconnected components in our approach. First, we propose a new context-aware spatial-temporal descriptor, named locally weighted word context, to improve the discriminability of the traditionally used local spatial-temporal descriptors. Second, from the statistics of the context-aware descriptors, we learn action units using the graph regularized nonnegative matrix factorization, which leads to a part-based representation and encodes the geometrical information. These units effectively bridge the semantic gap in action recognition. Third, we propose a sparse model based on a joint l2,1-norm to preserve the representative items and suppress noise in the action units. Intuitively, when learning the dictionary for action representation, the sparse model captures the fact that actions from the same class share similar units. The proposed approach is evaluated on several publicly available data sets. The experimental results and analysis clearly demonstrate the effectiveness of the proposed approach.

Motor Memory Is Encoded as a Gain-Field Combination of Intrinsic and Extrinsic Action Representations

PubMed Central

Brayanov, Jordan B.; Press, Daniel Z.; Smith, Maurice A.

2013-01-01

Actions can be planned in either an intrinsic (body-based) reference frame or an extrinsic (world-based) frame, and understanding how the internal representations associated with these frames contribute to the learning of motor actions is a key issue in motor control. We studied the internal representation of this learning in human subjects by analyzing generalization patterns across an array of different movement directions and workspaces after training a visuomotor rotation in a single movement direction in one workspace. This provided a dense sampling of the generalization function across intrinsic and extrinsic reference frames, which allowed us to dissociate intrinsic and extrinsic representations and determine the manner in which they contributed to the motor memory for a trained action. A first experiment showed that the generalization pattern reflected a memory that was intermediate between intrinsic and extrinsic representations. A second experiment showed that this intermediate representation could not arise from separate intrinsic and extrinsic learning. Instead, we find that the representation of learning is based on a gain-field combination of local representations in intrinsic and extrinsic coordinates. This gain-field representation generalizes between actions by effectively computing similarity based on the (Mahalanobis) distance across intrinsic and extrinsic coordinates and is in line with neural recordings showing mixed intrinsic-extrinsic representations in motor and parietal cortices. PMID:23100418

Analytics4Action Evaluation Framework: A Review of Evidence-Based Learning Analytics Interventions at the Open University UK

ERIC Educational Resources Information Center

Rienties, Bart; Boroowa, Avinash; Cross, Simon; Kubiak, Chris; Mayles, Kevin; Murphy, Sam

2016-01-01

There is an urgent need to develop an evidence-based framework for learning analytics whereby stakeholders can manage, evaluate, and make decisions about which types of interventions work well and under which conditions. In this article, we will work towards developing a foundation of an Analytics4Action Evaluation Framework (A4AEF) that is…

Catechol-O-methyltransferase (COMT) genotype affects cognitive control during total sleep deprivation.

PubMed

Satterfield, Brieann C; Hinson, John M; Whitney, Paul; Schmidt, Michelle A; Wisor, Jonathan P; Van Dongen, Hans P A

2018-02-01

Adaptive decision making is profoundly impaired by total sleep deprivation (TSD). This suggests that TSD impacts fronto-striatal pathways involved in cognitive control, where dopamine is a key neuromodulator. In the prefrontal cortex (PFC), dopamine is catabolized by the enzyme catechol-O-methyltransferase (COMT). A functional polymorphism (Val158Met) influences COMT's enzymatic activity, resulting in markedly different levels of prefrontal dopamine. We investigated the effect of this polymorphism on adaptive decision making during TSD. Sixty-six healthy young adults participated in one of two in-laboratory studies. After a baseline day, subjects were randomized to either a TSD group (n = 32) with 38 h or 62 h of extended wakefulness or a well-rested control group (n = 34) with 10 h nighttime sleep opportunities. Subjects performed a go/no-go reversal learning (GNGr) task at well-rested baseline and again during TSD or equivalent control. During the task, subjects were required to learn stimulus-response relationships from accuracy feedback. The stimulus-response relationships were reversed halfway through the task, which required subjects to learn the new stimulus-response relationships from accuracy feedback. Performance on the GNGr task was quantified by discriminability (d') between go and no-go stimuli before and after the stimulus-response reversal. GNGr performance did not differ between COMT genotypes when subjects were well-rested. However, TSD exposed a significant vulnerability to adaptive decision making impairment in subjects with the Val allele. Our results indicate that sleep deprivation degrades cognitive control through a fronto-striatal, dopaminergic mechanism. Copyright © 2017 Elsevier Ltd. All rights reserved.

STRIATAL-ENRICHED PROTEIN TYROSINE PHOSPHATASE (STEP) KNOCKOUT MICE HAVE ENHANCED HIPPOCAMPAL MEMORY

PubMed Central

Venkitaramani, Deepa V.; Moura, Paula J.; Picciotto, Marina R.; Lombroso, Paul J.

2011-01-01

STEP is a brain-specific phosphatase that opposes synaptic strengthening by the regulation of key synaptic signaling proteins. Previous studies suggest a possible role for STriatal-Enriched protein tyrosine Phosphatase (STEP) in learning and memory. To demonstrate the functional importance of STEP in learning and memory, we generated STEP knockout (KO) mice and examined the effect of deletion of STEP on behavioral performance, as well as the phosphorylation and expression of its substrates. Here we report that loss of STEP leads to significantly enhanced performance in hippocampal-dependent learning and memory tasks. In addition, STEP KO mice displayed greater dominance behavior, although they were normal in their motivation, motor coordination, visual acuity and social interactions. STEP KO mice displayed enhanced tyrosine phosphorylation of extracellular-signal regulated kinase 1/2 (ERK1/2), the NR2B subunit of the N-methyl-D-aspartate receptor (NMDAR), Proline-rich tyrosine kinase (Pyk2), as well as an increased phosphorylation of ERK1/2 substrates. Concomitant to the increased phosphorylation of NR2B, synaptosomal expression of NR1/NR2B NMDARs was increased in STEP KO mice, as was the GluR1/GluR2 containing α-amino-3-hydroxy-5-methyl-4-isoxazole-propionic acid receptors (AMPAR), providing a potential molecular mechanism for the improved cognitive performance. The data support a role for STEP in the regulation of synaptic strengthening. The absence of STEP improves cognitive performance, and may do so by the regulation of downstream effectors necessary for synaptic transmission. PMID:21501258

Impaired functional connectivity within and between frontostriatal circuits and its association with compulsive drug use and trait impulsivity in cocaine addiction.

PubMed

Hu, Yuzheng; Salmeron, Betty Jo; Gu, Hong; Stein, Elliot A; Yang, Yihong

2015-06-01

Converging evidence has long identified both impulsivity and compulsivity as key psychological constructs in drug addiction. Although dysregulated striatal-cortical network interactions have been identified in cocaine addiction, the association between these brain networks and addiction is poorly understood. To test the hypothesis that cocaine addiction is associated with disturbances in striatal-cortical communication as captured by resting-state functional connectivity (rsFC), measured from coherent spontaneous fluctuations in the blood oxygenation level-dependent functional magnetic resonance imaging signal, and to explore the relationships between striatal rsFC, trait impulsivity, and uncontrolled drug use in cocaine addiction. A case-control, cross-sectional study was conducted at the National Institute on Drug Abuse Intramural Research Program outpatient magnetic resonance imaging facility. Data used in the present study were collected between December 8, 2005, and September 30, 2011. Participants included 56 non-treatment-seeking cocaine users (CUs) (52 with cocaine dependence and 3 with cocaine abuse) and 56 healthy individuals serving as controls (HCs) matched on age, sex, years of education, race, estimated intelligence, and smoking status. Voxelwise statistical parametric analysis testing the rsFC strength differences between CUs and HCs in brain regions functionally connected to 6 striatal subregions defined a priori. Increased rsFC strength was observed predominantly in striatal-frontal circuits; decreased rsFC was found between the striatum and cingulate, striatal, temporal, hippocampal/amygdalar, and insular regions in the CU group compared with the HCs. Increased striatal-dorsal lateral prefrontal cortex connectivity strength was positively correlated with the amount of recent cocaine use (uncorrected P < .046) and elevated trait impulsivity in the CUs (uncorrected P < .012), and an index reflecting the balance between striatal-dorsal anterior cingulate cortex and striatal-anterior prefrontal/orbitofrontal cortex circuits was significantly associated with loss of control over cocaine use (corrected P < .012). Cocaine addiction is associated with disturbed rsFC in several specific striatal-cortical circuits. Specifically, compulsive cocaine use, a defining characteristic of dependence, was associated with a balance of increased striatal-anterior prefrontal/orbitofrontal and decreased striatal-dorsal anterior cingulate connectivity; trait impulsivity, both a risk factor for and a consequence of cocaine use, was associated with increased dorsal striatal-dorsal lateral prefrontal cortex connectivity uniquely in CUs. These findings provide new insights toward the neurobiological mechanisms of addiction and suggest potential novel therapeutic targets for treatment.

Striatal norepinephrine efflux in l-DOPA-induced dyskinesia.

PubMed

Ostock, Corinne Y; Bhide, Nirmal; Goldenberg, Adam A; George, Jessica A; Bishop, Christopher

2018-03-01

l-DOPA remains the primary treatment for Parkinson's disease (PD). Unfortunately, its therapeutic benefits are compromised by the development of abnormal involuntary movements (AIMs) known as l-DOPA-induced dyskinesia (LID). The norepinephrine (NE) system originating in the locus coeruleus is profoundly affected in PD and known to influence dopamine (DA) signaling. However, the effect of noradrenergic loss on l-DOPA-induced striatal monoamine efflux and Parkinsonian motor behavior remains controversial and is frequently overlooked in traditional animal models of LID. Thus, the current study sought to determine whether degeneration of the DA and/or NE system(s) altered l-DOPA-induced striatal monoamine efflux in hemiparkinsonian rats with additional NE loss induced by the potent NE-toxin α DA beta hydroxylase (DBH)-saporin. Sham-, DA-, NE-, and dual DA + NE-lesioned rats were treated with l-DOPA (6 mg/kg, s.c.) for 2 weeks. Thereafter, l-DOPA-mediated striatal monoamine efflux was measured with in vivo microdialysis, and concurrent AIMs testing occurred to determine responsiveness to l-DOPA. Noradrenergic lesions exacerbated parkinsonian motor deficits but did not significantly alter LID expression or corresponding l-DOPA-induced striatal monoamine efflux. Interestingly, l-DOPA-induced striatal NE efflux rather than DA efflux, corresponded more closely with dyskinesia severity. Moreover, marked reductions in striatal NE tissue concentration did not appear to impact l-DOPA-induced striatal NE efflux. The current study implicates l-DOPA-induced striatal NE as an important factor in LID expression and demonstrates the importance of developing treatment strategies that co-modulate the NE and DA systems. Copyright © 2018 Elsevier Ltd. All rights reserved.

Aberrant striatal functional connectivity in children with autism.

PubMed

Di Martino, Adriana; Kelly, Clare; Grzadzinski, Rebecca; Zuo, Xi-Nian; Mennes, Maarten; Mairena, Maria Angeles; Lord, Catherine; Castellanos, F Xavier; Milham, Michael P

2011-05-01

Models of autism spectrum disorders (ASD) as neural disconnection syndromes have been predominantly supported by examinations of abnormalities in corticocortical networks in adults with autism. A broader body of research implicates subcortical structures, particularly the striatum, in the physiopathology of autism. Resting state functional magnetic resonance imaging has revealed detailed maps of striatal circuitry in healthy and psychiatric populations and vividly captured maturational changes in striatal circuitry during typical development. Using resting state functional magnetic resonance imaging, we examined striatal functional connectivity (FC) in 20 children with ASD and 20 typically developing children between the ages of 7.6 and 13.5 years. Whole-brain voxelwise statistical maps quantified within-group striatal FC and between-group differences for three caudate and three putamen seeds for each hemisphere. Children with ASD mostly exhibited prominent patterns of ectopic striatal FC (i.e., functional connectivity present in ASD but not in typically developing children), with increased functional connectivity between nearly all striatal subregions and heteromodal associative and limbic cortex previously implicated in the physiopathology of ASD (e.g., insular and right superior temporal gyrus). Additionally, we found striatal functional hyperconnectivity with the pons, thus expanding the scope of functional alterations implicated in ASD. Secondary analyses revealed ASD-related hyperconnectivity between the pons and insula cortex. Examination of FC of striatal networks in children with ASD revealed abnormalities in circuits involving early developing areas, such as the brainstem and insula, with a pattern of increased FC in ectopic circuits that likely reflects developmental derangement rather than immaturity of functional circuits. Copyright © 2011 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Are Striatal Tyrosine Hydroxylase Interneurons Dopaminergic?

PubMed Central

Xenias, Harry S.; Ibáñez-Sandoval, Osvaldo; Koós, Tibor

2015-01-01

Striatal GABAergic interneurons that express the gene for tyrosine hydroxylase (TH) have been identified previously by several methods. Although generally assumed to be dopaminergic, possibly serving as a compensatory source of dopamine (DA) in Parkinson's disease, this assumption has never been tested directly. In TH–Cre mice whose nigrostriatal pathway had been eliminated unilaterally with 6-hydroxydopamine, we injected a Cre-dependent virus coding for channelrhodopsin-2 and enhanced yellow fluorescent protein unilaterally into the unlesioned midbrain or bilaterally into the striatum. Fast-scan cyclic voltammetry in striatal slices revealed that both optical and electrical stimulation readily elicited DA release in control striata but not from contralateral striata when nigrostriatal neurons were transduced. In contrast, neither optical nor electrical stimulation could elicit striatal DA release in either the control or lesioned striata when the virus was injected directly into the striatum transducing only striatal TH interneurons. This demonstrates that striatal TH interneurons do not release DA. Fluorescence immunocytochemistry in enhanced green fluorescent protein (EGFP)–TH mice revealed colocalization of DA, l-amino acid decarboxylase, the DA transporter, and vesicular monoamine transporter-2 with EGFP in midbrain dopaminergic neurons but not in any of the striatal EGFP–TH interneurons. Optogenetic activation of striatal EGFP–TH interneurons produced strong GABAergic inhibition in all spiny neurons tested. These results indicate that striatal TH interneurons are not dopaminergic but rather are a type of GABAergic interneuron that expresses TH but none of the other enzymes or transporters necessary to operate as dopaminergic neurons and exert widespread GABAergic inhibition onto direct and indirect spiny neurons. PMID:25904808

Oculomotor learning revisited: a model of reinforcement learning in the basal ganglia incorporating an efference copy of motor actions

PubMed Central

Fee, Michale S.

2012-01-01

In its simplest formulation, reinforcement learning is based on the idea that if an action taken in a particular context is followed by a favorable outcome, then, in the same context, the tendency to produce that action should be strengthened, or reinforced. While reinforcement learning forms the basis of many current theories of basal ganglia (BG) function, these models do not incorporate distinct computational roles for signals that convey context, and those that convey what action an animal takes. Recent experiments in the songbird suggest that vocal-related BG circuitry receives two functionally distinct excitatory inputs. One input is from a cortical region that carries context information about the current “time” in the motor sequence. The other is an efference copy of motor commands from a separate cortical brain region that generates vocal variability during learning. Based on these findings, I propose here a general model of vertebrate BG function that combines context information with a distinct motor efference copy signal. The signals are integrated by a learning rule in which efference copy inputs gate the potentiation of context inputs (but not efference copy inputs) onto medium spiny neurons in response to a rewarded action. The hypothesis is described in terms of a circuit that implements the learning of visually guided saccades. The model makes testable predictions about the anatomical and functional properties of hypothesized context and efference copy inputs to the striatum from both thalamic and cortical sources. PMID:22754501

Oculomotor learning revisited: a model of reinforcement learning in the basal ganglia incorporating an efference copy of motor actions.

PubMed

Fee, Michale S

2012-01-01

In its simplest formulation, reinforcement learning is based on the idea that if an action taken in a particular context is followed by a favorable outcome, then, in the same context, the tendency to produce that action should be strengthened, or reinforced. While reinforcement learning forms the basis of many current theories of basal ganglia (BG) function, these models do not incorporate distinct computational roles for signals that convey context, and those that convey what action an animal takes. Recent experiments in the songbird suggest that vocal-related BG circuitry receives two functionally distinct excitatory inputs. One input is from a cortical region that carries context information about the current "time" in the motor sequence. The other is an efference copy of motor commands from a separate cortical brain region that generates vocal variability during learning. Based on these findings, I propose here a general model of vertebrate BG function that combines context information with a distinct motor efference copy signal. The signals are integrated by a learning rule in which efference copy inputs gate the potentiation of context inputs (but not efference copy inputs) onto medium spiny neurons in response to a rewarded action. The hypothesis is described in terms of a circuit that implements the learning of visually guided saccades. The model makes testable predictions about the anatomical and functional properties of hypothesized context and efference copy inputs to the striatum from both thalamic and cortical sources.

Cognitive Components Underpinning the Development of Model-Based Learning

PubMed Central

Potter, Tracey C.S.; Bryce, Nessa V.; Hartley, Catherine A.

2016-01-01

Reinforcement learning theory distinguishes “model-free” learning, which fosters reflexive repetition of previously rewarded actions, from “model-based” learning, which recruits a mental model of the environment to flexibly select goal-directed actions. Whereas model-free learning is evident across development, recruitment of model-based learning appears to increase with age. However, the cognitive processes underlying the development of model-based learning remain poorly characterized. Here, we examined whether age-related differences in cognitive processes underlying the construction and flexible recruitment of mental models predict developmental increases in model-based choice. In a cohort of participants aged 9–25, we examined whether the abilities to infer sequential regularities in the environment (“statistical learning”), maintain information in an active state (“working memory”) and integrate distant concepts to solve problems (“fluid reasoning”) predicted age-related improvements in model-based choice. We found that age-related improvements in statistical learning performance did not mediate the relationship between age and model-based choice. Ceiling performance on our working memory assay prevented examination of its contribution to model-based learning. However, age-related improvements in fluid reasoning statistically mediated the developmental increase in the recruitment of a model-based strategy. These findings suggest that gradual development of fluid reasoning may be a critical component process underlying the emergence of model-based learning. PMID:27825732

Problem-Based Learning Associated by Action-Process-Object-Schema (APOS) Theory to Enhance Students' High Order Mathematical Thinking Ability

ERIC Educational Resources Information Center

Mudrikah, Achmad

2016-01-01

The research has shown a model of learning activities that can be used to stimulate reflective abstraction in students. Reflective abstraction as a method of constructing knowledge in the Action-Process-Object-Schema theory, and is expected to occur when students are in learning activities, will be able to encourage students to make the process of…

Altered behavioral and neural responsiveness to counterfactual gains in the elderly.

PubMed

Tobia, Michael J; Guo, Rong; Gläscher, Jan; Schwarze, Ulrike; Brassen, Stefanie; Büchel, Christian; Obermayer, Klaus; Sommer, Tobias

2016-06-01

Counterfactual information processing refers to the consideration of events that did not occur in comparison to those actually experienced, in order to determine optimal actions, and can be formulated as computational learning signals, referred to as fictive prediction errors. Decision making and the neural circuitry for counterfactual processing are altered in healthy elderly adults. This experiment investigated age differences in neural systems for decision making with knowledge of counterfactual outcomes. Two groups of healthy adult participants, young (N = 30; ages 19-30 years) and elderly (N = 19; ages 65-80 years), were scanned with fMRI during 240 trials of a strategic sequential investment task in which a particular strategy of differentially weighting counterfactual gains and losses during valuation is associated with more optimal performance. Elderly participants earned significantly less than young adults, differently weighted counterfactual consequences and exploited task knowledge, and exhibited altered activity in a fronto-striatal circuit while making choices, compared to young adults. The degree to which task knowledge was exploited was positively correlated with modulation of neural activity by expected value in the vmPFC for young adults, but not in the elderly. These findings demonstrate that elderly participants' poor task performance may be related to different counterfactual processing.

Reward modulation of cognitive function in adult attention-deficit/hyperactivity disorder: a pilot study on the role of striatal dopamine.

PubMed

Aarts, Esther; van Holstein, Mieke; Hoogman, Martine; Onnink, Marten; Kan, Cornelis; Franke, Barbara; Buitelaar, Jan; Cools, Roshan

2015-02-01

Attention-deficit/hyperactivity disorder (ADHD) is accompanied by impairments in cognitive control, such as task-switching deficits. We investigated whether such problems, and their remediation by medication, reflect abnormal reward motivation and associated striatal dopamine transmission in ADHD. We used functional genetic neuroimaging to assess the effects of dopaminergic medication and reward motivation on task-switching and striatal BOLD signal in 23 adults with ADHD, ON and OFF methylphenidate, and 26 healthy controls. Critically, we took into account interindividual variability in striatal dopamine by exploiting a common genetic polymorphism (3'-UTR VNTR) in the DAT1 gene coding for the dopamine transporter. The results showed a highly significant group by genotype interaction in the striatum. This was because a subgroup of patients with ADHD showed markedly exaggerated effects of reward on the striatal BOLD signal during task-switching when they were OFF their dopaminergic medication. Specifically, patients carrying the 9R allele showed a greater striatal signal than healthy controls carrying this allele, whereas no effect of diagnosis was observed in 10R homozygotes. Aberrant striatal responses were normalized when 9R-carrying patients with ADHD were ON medication. These pilot data indicate an important role for aberrant reward motivation, striatal dopamine and interindividual genetic differences in cognitive processes in adult ADHD.

Reward modulation of cognitive function in adult attention-deficit/hyperactivity disorder: a pilot study on the role of striatal dopamine

PubMed Central

Aarts, Esther; Hoogman, Martine; Onnink, Marten; Kan, Cornelis; Franke, Barbara; Buitelaar, Jan; Cools, Roshan

2015-01-01

Attention-deficit/hyperactivity disorder (ADHD) is accompanied by impairments in cognitive control, such as task-switching deficits. We investigated whether such problems, and their remediation by medication, reflect abnormal reward motivation and associated striatal dopamine transmission in ADHD. We used functional genetic neuroimaging to assess the effects of dopaminergic medication and reward motivation on task-switching and striatal BOLD signal in 23 adults with ADHD, ON and OFF methylphenidate, and 26 healthy controls. Critically, we took into account interindividual variability in striatal dopamine by exploiting a common genetic polymorphism (3′-UTR VNTR) in the DAT1 gene coding for the dopamine transporter. The results showed a highly significant group by genotype interaction in the striatum. This was because a subgroup of patients with ADHD showed markedly exaggerated effects of reward on the striatal BOLD signal during task-switching when they were OFF their dopaminergic medication. Specifically, patients carrying the 9R allele showed a greater striatal signal than healthy controls carrying this allele, whereas no effect of diagnosis was observed in 10R homozygotes. Aberrant striatal responses were normalized when 9R-carrying patients with ADHD were ON medication. These pilot data indicate an important role for aberrant reward motivation, striatal dopamine and interindividual genetic differences in cognitive processes in adult ADHD. PMID:25485641

[18F]fallypride characterization of striatal and extrastriatal D2/3 receptors in Parkinson's disease.

PubMed

Stark, Adam J; Smith, Christopher T; Petersen, Kalen J; Trujillo, Paula; van Wouwe, Nelleke C; Donahue, Manus J; Kessler, Robert M; Deutch, Ariel Y; Zald, David H; Claassen, Daniel O

2018-01-01

Parkinson's disease (PD) is characterized by widespread degeneration of monoaminergic (especially dopaminergic) networks, manifesting with a number of both motor and non-motor symptoms. Regional alterations to dopamine D 2/3 receptors in PD patients are documented in striatal and some extrastriatal areas, and medications that target D 2/3 receptors can improve motor and non-motor symptoms. However, data regarding the combined pattern of D 2/3 receptor binding in both striatal and extrastriatal regions in PD are limited. We studied 35 PD patients off-medication and 31 age- and sex-matched healthy controls (HCs) using PET imaging with [ 18 F]fallypride, a high affinity D 2/3 receptor ligand, to measure striatal and extrastriatal D 2/3 nondisplaceable binding potential (BP ND ). PD patients completed PET imaging in the off medication state, and motor severity was concurrently assessed. Voxel-wise evaluation between groups revealed significant BP ND reductions in PD patients in striatal and several extrastriatal regions, including the locus coeruleus and mesotemporal cortex. A region-of-interest (ROI) based approach quantified differences in dopamine D 2/3 receptors, where reduced BP ND was noted in the globus pallidus, caudate, amygdala, hippocampus, ventral midbrain, and thalamus of PD patients relative to HC subjects. Motor severity positively correlated with D 2/3 receptor density in the putamen and globus pallidus. These findings support the hypothesis that abnormal D 2/3 expression occurs in regions related to both the motor and non-motor symptoms of PD, including areas richly invested with noradrenergic neurons.