Changes in expression of c-Fos protein following cocaine-cue extinction learning.
Nic Dhonnchadha, B Á; Lovascio, B F; Shrestha, N; Lin, A; Leite-Morris, K A; Man, H Y; Kaplan, G B; Kantak, K M
2012-09-01
Extinguishing abnormally strengthened learned responses to cues associated with drugs of abuse remains a key tactic for alleviating addiction. To assist in developing pharmacotherapies to augment exposure therapy for relapse prevention, investigation into neurobiological underpinnings of drug-cue extinction learning is needed. We used regional analyses of c-Fos and GluR2 protein expression to delineate neural activity and plasticity that may be associated with cocaine-cue extinction learning. Rats were trained to self-administer cocaine paired with a light cue, and later underwent a single 2h extinction session for which cocaine was withheld but response-contingent cues were presented (cocaine-cue extinction). Control groups consisted of rats yoked to animals self-administering cocaine and receiving saline non-contingently followed by an extinction session, or rats trained to self-administer cocaine followed by a no-extinction session for which levers were retracted, and cocaine and cues were withheld. Among 11 brain sites examined, extinction training increased c-Fos expression in basolateral amygdala and prelimbic prefrontal cortex of cocaine-cue extinguished rats relative to both control conditions. In dorsal subiculum and infralimbic prefrontal cortex, extinction training increased c-Fos expression in both cocaine-cue and saline-cue extinguished rats relative to the no-extinction control condition. GluR2 protein expression was not altered in any site examined after extinction or control training. Findings suggest that basolateral amygdala and prelimbic prefrontal cortex neurons are activated during acquisition of cocaine-cue extinction learning, a process that is independent of changes in GluR2 abundance. Other sites are implicated in processing the significance of cues that are present early in extinction training. Copyright © 2012 Elsevier B.V. All rights reserved.
Reminder Cues Modulate the Renewal Effect in Human Predictive Learning
Bustamante, Javier; Uengoer, Metin; Lachnit, Harald
2016-01-01
Associative learning refers to our ability to learn about regularities in our environment. When a stimulus is repeatedly followed by a specific outcome, we learn to expect the outcome in the presence of the stimulus. We are also able to modify established expectations in the face of disconfirming information (the stimulus is no longer followed by the outcome). Both the change of environmental regularities and the related processes of adaptation are referred to as extinction. However, extinction does not erase the initially acquired expectations. For instance, following successful extinction, the initially learned expectations can recover when there is a context change – a phenomenon called the renewal effect, which is considered as a model for relapse after exposure therapy. Renewal was found to be modulated by reminder cues of acquisition and extinction. However, the mechanisms underlying the effectiveness of reminder cues are not well understood. The aim of the present study was to investigate the impact of reminder cues on renewal in the field of human predictive learning. Experiment I demonstrated that renewal in human predictive learning is modulated by cues related to acquisition or extinction. Initially, participants received pairings of a stimulus and an outcome in one context. These stimulus-outcome pairings were preceded by presentations of a reminder cue (acquisition cue). Then, participants received extinction in a different context in which presentations of the stimulus were no longer followed by the outcome. These extinction trials were preceded by a second reminder cue (extinction cue). During a final phase conducted in a third context, participants showed stronger expectations of the outcome in the presence of the stimulus when testing was accompanied by the acquisition cue compared to the extinction cue. Experiment II tested an explanation of the reminder cue effect in terms of simple cue-outcome associations. Therefore, acquisition and extinction cues were equated for their associative histories in Experiment II, which should abolish their impact on renewal if based on simple cue-outcome associations. In contrast to this prediction, Experiment II replicated the findings from Experiment I indicating that the effectiveness of reminder cues did not require direct reminder cue-outcome associations. PMID:28066293
Nothing is safe: Intolerance of uncertainty is associated with compromised fear extinction learning.
Morriss, Jayne; Christakou, Anastasia; van Reekum, Carien M
2016-12-01
Extinction-resistant fear is considered to be a central feature of pathological anxiety. Here we sought to determine if individual differences in Intolerance of Uncertainty (IU), a potential risk factor for anxiety disorders, underlies compromised fear extinction. We tested this hypothesis by recording electrodermal activity in 38 healthy participants during fear acquisition and extinction. We assessed the temporality of fear extinction, by examining early and late extinction learning. During early extinction, low IU was associated with larger skin conductance responses to learned threat vs. safety cues, whereas high IU was associated with skin conductance responding to both threat and safety cues, but no cue discrimination. During late extinction, low IU showed no difference in skin conductance between learned threat and safety cues, whilst high IU predicted continued fear expression to learned threat, indexed by larger skin conductance to threat vs. safety cues. These findings suggest a critical role of uncertainty-based mechanisms in the maintenance of learned fear. Copyright © 2016 The Authors. Published by Elsevier B.V. All rights reserved.
Context Switch Effects on Acquisition and Extinction in Human Predictive Learning
ERIC Educational Resources Information Center
Rosas, Juan M.; Callejas-Aguilera, Jose E.
2006-01-01
Four experiments tested context switch effects on acquisition and extinction in human predictive learning. A context switch impaired probability judgments about a cue-outcome relationship when the cue was trained in a context in which a different cue underwent extinction. The context switch also impaired judgments about a cue trained in a context…
Plasticity of Fear and Safety Neurons of the Amygdala in Response to Fear Extinction
Sangha, Susan
2015-01-01
Fear inhibition learning induces plasticity and remodeling of circuits within the amygdala. Most studies examine these changes in nondiscriminative fear conditioning paradigms. Using a discriminative fear, safety, and reward conditioning task, Sangha et al. (2013) have previously reported several neural microcircuits within the basal amygdala (BA) which discriminate among these cues, including a subpopulation of neurons responding selectively to a safety cue and not a fear cue. Here, the hypothesis that these “safety” neurons isolated during discriminative conditioning are biased to become fear cue responsive as a result of extinction, when fear behavior diminishes, was tested. Although 41% of “safety” neurons became fear cue responsive as a result of extinction, the data revealed that there was no bias for these neurons to become preferentially responsive during fear extinction compared to the other identified subgroups. In addition to the plasticity seen in the “safety” neurons, 44% of neurons unresponsive to either the fear cue or safety cue during discriminative conditioning became fear cue responsive during extinction. Together these emergent responses to the fear cue as a result of extinction support the hypothesis that new learning underlies extinction. In contrast, 47% of neurons responsive to the fear cue during discriminative conditioning became unresponsive to the fear cue during extinction. These findings are consistent with a suppression of neural responding mediated by inhibitory learning, or, potentially, by direct unlearning. Together, the data support extinction as an active process involving both gains and losses of responses to the fear cue and suggests the final output of the integrated BA circuit in influencing fear behavior is a balance of excitation and inhibition, and perhaps reversal of learning-induced changes. PMID:26733838
Applying extinction research and theory to cue-exposure addiction treatments.
Conklin, Cynthia A; Tiffany, Stephen T
2002-02-01
To evaluate the efficacy of cue-exposure addiction treatment and review modern animal learning research to generate recommendations for substantially enhancing the effectiveness of this treatment. Meta-analysis of cue-exposure addiction treatment outcome studies (N=9), review of animal extinction research and theory, and evaluation of whether major principles from this literature are addressed adequately in cue-exposure treatments. The meta-analytical review showed that there is no consistent evidence for the efficacy of cue-exposure treatment as currently implemented. Moreover, procedures derived from the animal learning literature that should maximize the potential of extinction training are rarely used in cue-exposure treatments. Given what is known from animal extinction theory and research about extinguishing learned behavior, it is not surprising that cue-exposure treatments so often fail. This paper reviews current animal research regarding the most salient threats to the development and maintenance of extinction, and suggests several major procedures for increasing the efficacy of cue-exposure addiction treatment.
Compound Stimulus Presentation Does Not Deepen Extinction in Human Causal Learning
Griffiths, Oren; Holmes, Nathan; Westbrook, R. Fred
2017-01-01
Models of associative learning have proposed that cue-outcome learning critically depends on the degree of prediction error encountered during training. Two experiments examined the role of error-driven extinction learning in a human causal learning task. Target cues underwent extinction in the presence of additional cues, which differed in the degree to which they predicted the outcome, thereby manipulating outcome expectancy and, in the absence of any change in reinforcement, prediction error. These prediction error manipulations have each been shown to modulate extinction learning in aversive conditioning studies. While both manipulations resulted in increased prediction error during training, neither enhanced extinction in the present human learning task (one manipulation resulted in less extinction at test). The results are discussed with reference to the types of associations that are regulated by prediction error, the types of error terms involved in their regulation, and how these interact with parameters involved in training. PMID:28232809
van den Akker, Karolien; Havermans, Remco C; Bouton, Mark E; Jansen, Anita
2014-10-01
Animals and humans can easily learn to associate an initially neutral cue with food intake through classical conditioning, but extinction of learned appetitive responses can be more difficult. Intermittent or partial reinforcement of food cues causes especially persistent behaviour in animals: after exposure to such learning schedules, the decline in responding that occurs during extinction is slow. After extinction, increases in responding with renewed reinforcement of food cues (reacquisition) might be less rapid after acquisition with partial reinforcement. In humans, it may be that the eating behaviour of some individuals resembles partial reinforcement schedules to a greater extent, possibly affecting dieting success by interacting with extinction and reacquisition. Furthermore, impulsivity has been associated with less successful dieting, and this association might be explained by impulsivity affecting the learning and extinction of appetitive responses. In the present two studies, the effects of different reinforcement schedules and impulsivity on the acquisition, extinction, and reacquisition of appetitive responses were investigated in a conditioning paradigm involving food rewards in healthy humans. Overall, the results indicate both partial reinforcement schedules and, possibly, impulsivity to be associated with worse extinction performance. A new model of dieting success is proposed: learning histories and, perhaps, certain personality traits (impulsivity) can interfere with the extinction and reacquisition of appetitive responses to food cues and they may be causally related to unsuccessful dieting. Copyright © 2014 Elsevier Ltd. All rights reserved.
Role of Dopamine 2 Receptor in Impaired Drug-Cue Extinction in Adolescent Rats.
Zbukvic, Isabel C; Ganella, Despina E; Perry, Christina J; Madsen, Heather B; Bye, Christopher R; Lawrence, Andrew J; Kim, Jee Hyun
2016-06-01
Adolescent drug users display resistance to treatment such as cue exposure therapy (CET), as well as increased liability to relapse. The basis of CET is extinction learning, which involves dopamine signaling in the medial prefrontal cortex (mPFC). This system undergoes dramatic alterations during adolescence. Therefore, we investigated extinction of a cocaine-associated cue in adolescent and adult rats. While cocaine self-administration and lever-alone extinction were not different between the two ages, we observed that cue extinction reduced cue-induced reinstatement in adult but not adolescent rats. Infusion of the selective dopamine 2 receptor (D2R)-like agonist quinpirole into the infralimbic cortex (IL) of the mPFC prior to cue extinction significantly reduced cue-induced reinstatement in adolescents. This effect was replicated by acute systemic treatment with the atypical antipsychotic aripiprazole (Abilify), a partial D2R-like agonist. These data suggest that adolescents may be more susceptible to relapse due to a deficit in cue extinction learning, and highlight the significance of D2R signaling in the IL for cue extinction during adolescence. These findings inspire new tactics for improving adolescent CET, with aripiprazole representing an exciting potential pharmacological adjunct for behavioral therapy. © The Author 2016. Published by Oxford University Press.
From lab to clinic: Extinction of cued cravings to reduce overeating.
Jansen, Anita; Schyns, Ghislaine; Bongers, Peggy; van den Akker, Karolien
2016-08-01
Food cue reactivity is a strong motivation to eat, even in the absence of hunger. Therefore, food cue reactivity might sabotage healthy eating, induce weight gain and impede weight loss or weight maintenance. Food cue reactivity can be learned via Pavlovian appetitive conditioning: It is easily acquired but the extinction of appetitive responding seems to be more challenging. Several properties of extinction make it fragile: extinction does not erase the original learning and extinction is context-dependent. These properties threaten full extinction and increase the risk of full relapse. Extinction procedures are discussed to reduce or prevent the occurrence of rapid reacquisition, spontaneous recovery, renewal and reinstatement after extinction. A translation to food cue exposure treatment is made and suggestions are provided, such as conducting the exposure in relevant contexts, using occasional reinforcement and targeting expectancy violation instead of habituation. A new hypothesis proposed here is that the adding of inhibition training to strengthen inhibition skills that reduce instrumental responding, might be beneficial to improve food cue exposure effects. Copyright © 2016 Elsevier Inc. All rights reserved.
Labrenz, Franziska; Icenhour, Adriane; Benson, Sven; Elsenbruch, Sigrid
2015-01-01
As a fundamental learning process, fear conditioning promotes the formation of associations between predictive cues and biologically significant signals. In its application to pain, conditioning may provide important insight into mechanisms underlying pain-related fear, although knowledge especially in interoceptive pain paradigms remains scarce. Furthermore, while the influence of contingency awareness on excitatory learning is subject of ongoing debate, its role in pain-related acquisition is poorly understood and essentially unknown regarding extinction as inhibitory learning. Therefore, we addressed the impact of contingency awareness on learned emotional responses to pain- and safety-predictive cues in a combined dataset of two pain-related conditioning studies. In total, 75 healthy participants underwent differential fear acquisition, during which rectal distensions as interoceptive unconditioned stimuli (US) were repeatedly paired with a predictive visual cue (conditioned stimulus; CS+) while another cue (CS−) was presented unpaired. During extinction, both CS were presented without US. CS valence, indicating learned emotional responses, and CS-US contingencies were assessed on visual analog scales (VAS). Based on an integrative measure of contingency accuracy, a median-split was performed to compare groups with low vs. high contingency accuracy regarding learned emotional responses. To investigate predictive value of contingency accuracy, regression analyses were conducted. Highly accurate individuals revealed more pronounced negative emotional responses to CS+ and increased positive responses to CS− when compared to participants with low contingency accuracy. Following extinction, highly accurate individuals had fully extinguished pain-predictive cue properties, while exhibiting persistent positive emotional responses to safety signals. In contrast, individuals with low accuracy revealed equally positive emotional responses to both, CS+ and CS−. Contingency accuracy predicted variance in the formation of positive responses to safety cues while no predictive value was found for danger cues following acquisition and for neither cue following extinction. Our findings underscore specific roles of learned danger and safety in pain-related acquisition and extinction. Contingency accuracy appears to distinctly impact learned emotional responses to safety and danger cues, supporting aversive learning to occur independently from CS-US awareness. The interplay of cognitive and emotional factors in shaping excitatory and inhibitory pain-related learning may contribute to altered pain processing, underscoring its clinical relevance in chronic pain. PMID:26640433
Labrenz, Franziska; Icenhour, Adriane; Benson, Sven; Elsenbruch, Sigrid
2015-01-01
As a fundamental learning process, fear conditioning promotes the formation of associations between predictive cues and biologically significant signals. In its application to pain, conditioning may provide important insight into mechanisms underlying pain-related fear, although knowledge especially in interoceptive pain paradigms remains scarce. Furthermore, while the influence of contingency awareness on excitatory learning is subject of ongoing debate, its role in pain-related acquisition is poorly understood and essentially unknown regarding extinction as inhibitory learning. Therefore, we addressed the impact of contingency awareness on learned emotional responses to pain- and safety-predictive cues in a combined dataset of two pain-related conditioning studies. In total, 75 healthy participants underwent differential fear acquisition, during which rectal distensions as interoceptive unconditioned stimuli (US) were repeatedly paired with a predictive visual cue (conditioned stimulus; CS(+)) while another cue (CS(-)) was presented unpaired. During extinction, both CS were presented without US. CS valence, indicating learned emotional responses, and CS-US contingencies were assessed on visual analog scales (VAS). Based on an integrative measure of contingency accuracy, a median-split was performed to compare groups with low vs. high contingency accuracy regarding learned emotional responses. To investigate predictive value of contingency accuracy, regression analyses were conducted. Highly accurate individuals revealed more pronounced negative emotional responses to CS(+) and increased positive responses to CS(-) when compared to participants with low contingency accuracy. Following extinction, highly accurate individuals had fully extinguished pain-predictive cue properties, while exhibiting persistent positive emotional responses to safety signals. In contrast, individuals with low accuracy revealed equally positive emotional responses to both, CS(+) and CS(-). Contingency accuracy predicted variance in the formation of positive responses to safety cues while no predictive value was found for danger cues following acquisition and for neither cue following extinction. Our findings underscore specific roles of learned danger and safety in pain-related acquisition and extinction. Contingency accuracy appears to distinctly impact learned emotional responses to safety and danger cues, supporting aversive learning to occur independently from CS-US awareness. The interplay of cognitive and emotional factors in shaping excitatory and inhibitory pain-related learning may contribute to altered pain processing, underscoring its clinical relevance in chronic pain.
Cannady, Reginald; McGonigal, Justin T.; Newsom, Ryan J.; Woodward, John J.
2017-01-01
Identifying novel treatments that facilitate extinction learning could enhance cue-exposure therapy and reduce high relapse rates in alcoholics. Activation of mGlu5 receptors in the infralimbic prefrontal cortex (IL-PFC) facilitates learning during extinction of cue-conditioned alcohol-seeking behavior. Small-conductance calcium-activated potassium (KCa2) channels have also been implicated in extinction learning of fear memories, and mGlu5 receptor activation can reduce KCa2 channel function. Using a combination of electrophysiological, pharmacological, and behavioral approaches, this study examined KCa2 channels as a novel target to facilitate extinction of alcohol-seeking behavior in rats. This study also explored related neuronal and synaptic mechanisms within the IL-PFC that underlie mGlu5-dependent enhancement of extinction learning. Using whole-cell patch-clamp electrophysiology, activation of mGlu5 in ex vivo slices significantly reduced KCa2 channel currents in layer V IL-PFC pyramidal neurons, confirming functional downregulation of KCa2 channel activity by mGlu5 receptors. Additionally, positive modulation of KCa2 channels prevented mGlu5 receptor-dependent facilitation of long-term potentiation in the IL-PFC. Systemic and intra-IL-PFC treatment with apamin (KCa2 channel allosteric inhibitor) significantly enhanced extinction of alcohol-seeking behavior across multiple extinction sessions, an effect that persisted for 3 weeks, but was not observed after apamin microinfusions into the prelimbic PFC. Positive modulation of IL-PFC KCa2 channels significantly attenuated mGlu5-dependent facilitation of alcohol cue-conditioned extinction learning. These data suggest that mGlu5-dependent facilitation of extinction learning and synaptic plasticity in the IL-PFC involves functional inhibition of KCa2 channels. Moreover, these findings demonstrate that KCa2 channels are a novel target to facilitate long-lasting extinction of alcohol-seeking behavior. SIGNIFICANCE STATEMENT Alcohol use disorder is a chronic relapsing disorder that is associated with compulsive alcohol-seeking behavior. One of the main causes of alcohol relapse is the craving caused by environmental cues that are associated with alcohol. These cues are formed by normal learning and memory principles, and the understanding of the brain mechanisms that help form these associations can lead to the development of drugs and/or behavior therapies that reduce the impact that these cues have on relapse in alcoholics. PMID:28320841
Myers, Karyn M; Carlezon, William A
2010-11-01
Conditioned drug craving and withdrawal elicited by cues paired with drug use or acute withdrawal are among the many factors contributing to compulsive drug taking. Understanding how to stop these cues from having these effects is a major goal of addiction research. Extinction is a form of learning in which associations between cues and the events they predict are weakened by exposure to the cues in the absence of those events. Evidence from animal models suggests that conditioned responses to drug cues can be extinguished, although the degree to which this occurs in humans is controversial. Investigations into the neurobiological substrates of extinction of conditioned drug craving and withdrawal may facilitate the successful use of drug cue extinction within clinical contexts. While this work is still in the early stages, there are indications that extinction of drug- and withdrawal-paired cues shares neural mechanisms with extinction of conditioned fear. Using the fear extinction literature as a template, it is possible to organize the observations on drug cue extinction into a cohesive framework. Copyright © 2010 Elsevier Ltd. All rights reserved.
Early life programming of innate fear and fear learning in adult female rats.
Stevenson, Carl W; Meredith, John P; Spicer, Clare H; Mason, Rob; Marsden, Charles A
2009-03-02
The early rearing environment can impact on emotional reactivity and learning later in life. In this study the effects of neonatal maternal separation (MS) on innate fear and fear learning were assessed in the adult female rat. Pups were subjected to MS (360 min), brief handling (H; 15 min), or animal facility rearing (AFR) on post-natal days 2-14. In the first experiment, innate fear was tested in the open field. No differences between the early rearing groups were observed in unconditioned fear. In the second experiment, separate cohorts were used in a 3-day fear learning paradigm which tested the acquisition (Day 1), expression and extinction (both Day 2) of conditioning to an auditory cue; extinction recall was determined as well (Day 3). Contextual fear conditioning was also assessed prior to cue presentations on Days 2 and 3. Whereas MS attenuated the acquisition and expression of fear conditioning to the cue, H potentiated extinction learning. Cue-induced fear was reduced on Day 3, compared to Day 2, indicating that the recall of extinction learning was evident; however, no early rearing group differences in extinction recall were observed. Similarly, while contextual fear was decreased on Day 3, compared to Day 2, there were no differences between the early rearing groups on either day tested. The present findings of altered cue-conditioned fear learning, in the absence of innate fear changes, lend further support for the important role of the early rearing environment in mediating cognition in adulthood.
Anastasio, Thomas J
2013-01-01
Fear conditioning, in which a cue is conditioned to elicit a fear response, and extinction, in which a previously conditioned cue no longer elicits a fear response, depend on neural plasticity occurring within the amygdala. Projection neurons in the basolateral amygdala (BLA) learn to respond to the cue during fear conditioning, and they mediate fear responding by transferring cue signals to the output stage of the amygdala. Some BLA projection neurons retain their cue responses after extinction. Recent work shows that activation of the endocannabinoid system is necessary for extinction, and it leads to long-term depression (LTD) of the GABAergic synapses that inhibitory interneurons make onto BLA projection neurons. Such GABAergic LTD would enhance the responses of the BLA projection neurons that mediate fear responding, so it would seem to oppose, rather than promote, extinction. To address this paradox, a computational analysis of two well-known conceptual models of amygdaloid plasticity was undertaken. The analysis employed exhaustive state-space search conducted within a declarative programming environment. The analysis reveals that GABAergic LTD actually increases the number of synaptic strength configurations that achieve extinction while preserving the cue responses of some BLA projection neurons in both models. The results suggest that GABAergic LTD helps the amygdala retain cue memory during extinction even as the amygdala learns to suppress the previously conditioned response. The analysis also reveals which features of both models are essential for their ability to achieve extinction with some cue memory preservation, and suggests experimental tests of those features.
Anastasio, Thomas J.
2013-01-01
Fear conditioning, in which a cue is conditioned to elicit a fear response, and extinction, in which a previously conditioned cue no longer elicits a fear response, depend on neural plasticity occurring within the amygdala. Projection neurons in the basolateral amygdala (BLA) learn to respond to the cue during fear conditioning, and they mediate fear responding by transferring cue signals to the output stage of the amygdala. Some BLA projection neurons retain their cue responses after extinction. Recent work shows that activation of the endocannabinoid system is necessary for extinction, and it leads to long-term depression (LTD) of the GABAergic synapses that inhibitory interneurons make onto BLA projection neurons. Such GABAergic LTD would enhance the responses of the BLA projection neurons that mediate fear responding, so it would seem to oppose, rather than promote, extinction. To address this paradox, a computational analysis of two well-known conceptual models of amygdaloid plasticity was undertaken. The analysis employed exhaustive state-space search conducted within a declarative programming environment. The analysis reveals that GABAergic LTD actually increases the number of synaptic strength configurations that achieve extinction while preserving the cue responses of some BLA projection neurons in both models. The results suggest that GABAergic LTD helps the amygdala retain cue memory during extinction even as the amygdala learns to suppress the previously conditioned response. The analysis also reveals which features of both models are essential for their ability to achieve extinction with some cue memory preservation, and suggests experimental tests of those features. PMID:23761759
Cannady, Reginald; McGonigal, Justin T; Newsom, Ryan J; Woodward, John J; Mulholland, Patrick J; Gass, Justin T
2017-04-19
Identifying novel treatments that facilitate extinction learning could enhance cue-exposure therapy and reduce high relapse rates in alcoholics. Activation of mGlu 5 receptors in the infralimbic prefrontal cortex (IL-PFC) facilitates learning during extinction of cue-conditioned alcohol-seeking behavior. Small-conductance calcium-activated potassium (K Ca 2) channels have also been implicated in extinction learning of fear memories, and mGlu 5 receptor activation can reduce K Ca 2 channel function. Using a combination of electrophysiological, pharmacological, and behavioral approaches, this study examined K Ca 2 channels as a novel target to facilitate extinction of alcohol-seeking behavior in rats. This study also explored related neuronal and synaptic mechanisms within the IL-PFC that underlie mGlu 5 -dependent enhancement of extinction learning. Using whole-cell patch-clamp electrophysiology, activation of mGlu 5 in ex vivo slices significantly reduced K Ca 2 channel currents in layer V IL-PFC pyramidal neurons, confirming functional downregulation of K Ca 2 channel activity by mGlu 5 receptors. Additionally, positive modulation of K Ca 2 channels prevented mGlu 5 receptor-dependent facilitation of long-term potentiation in the IL-PFC. Systemic and intra-IL-PFC treatment with apamin (K Ca 2 channel allosteric inhibitor) significantly enhanced extinction of alcohol-seeking behavior across multiple extinction sessions, an effect that persisted for 3 weeks, but was not observed after apamin microinfusions into the prelimbic PFC. Positive modulation of IL-PFC K Ca 2 channels significantly attenuated mGlu 5 -dependent facilitation of alcohol cue-conditioned extinction learning. These data suggest that mGlu 5 -dependent facilitation of extinction learning and synaptic plasticity in the IL-PFC involves functional inhibition of K Ca 2 channels. Moreover, these findings demonstrate that K Ca 2 channels are a novel target to facilitate long-lasting extinction of alcohol-seeking behavior. SIGNIFICANCE STATEMENT Alcohol use disorder is a chronic relapsing disorder that is associated with compulsive alcohol-seeking behavior. One of the main causes of alcohol relapse is the craving caused by environmental cues that are associated with alcohol. These cues are formed by normal learning and memory principles, and the understanding of the brain mechanisms that help form these associations can lead to the development of drugs and/or behavior therapies that reduce the impact that these cues have on relapse in alcoholics. Copyright © 2017 the authors 0270-6474/17/374359-11$15.00/0.
Effects of a Context Shift and Multiple Context Extinction on Reactivity to Alcohol Cues
MacKillop, James; Lisman, Stephen A.
2008-01-01
Cue exposure treatment (CET) attempts to reduce the influence of conditioned substance cues on addictive behavior via prolonged cue exposure with response prevention (i.e., extinction), but has received only modest empirical support in clinical trials. This may be because extinction learning appears to be context dependent and a change in context may result in a return of conditioned responding (i.e., renewal), although this has received only limited empirical examination. The current study used a four-session laboratory analogue of CET to examine whether a change in context following three sessions of alcohol cue exposure with response prevention would result in renewal of conditioned responding. In addition, this study examined whether conducting extinction in multiple contexts would attenuate renewal of conditioned responding. In a one-way between-subjects design, 73 heavy drinkers (71% male) were randomized to three conditions: 1) single context extinction (extinction to alcohol cues in the same context for three sessions followed by a context shift at the fourth session); 2) multiple context extinction (extinction to alcohol cues in different contexts each day for all four sessions); and 3) pseudo-extinction control condition (exposure to neutral cues in the same context for three sessions followed by exposure to alcohol cues at the fourth session). The results revealed the predicted cue reactivity and extinction effects, but the hypotheses that a context shift would generate renewed cue reactivity and that multiple contexts would enhance extinction were not supported. Methodological aspects of the study and the need for parametric data on the context dependency of extinction to alcohol cues are discussed. PMID:18729687
Extinction Generates Outcome-Specific Conditioned Inhibition.
Laurent, Vincent; Chieng, Billy; Balleine, Bernard W
2016-12-05
Extinction involves altering a previously established predictive relationship between a cue and its outcome by repeatedly presenting that cue alone. Although it is widely accepted that extinction generates some form of inhibitory learning [1-4], direct evidence for this claim has been lacking, and the nature of the associative changes induced by extinction have, therefore, remained a matter of debate [5-8]. In the current experiments, we used a novel behavioral approach that we recently developed and that provides a direct measure of conditioned inhibition [9] to compare the influence of extinguished and non-extinguished cues on choice between goal-directed actions. Using this approach, we provide direct evidence that extinction generates outcome-specific conditioned inhibition. Furthermore, we demonstrate that this inhibitory learning is controlled by the infralimbic cortex (IL); inactivation of the IL using M4 DREADDs abolished outcome-specific inhibition and rendered the cue excitatory. Importantly, we found that context modulated this inhibition. Outside its extinction context, the cue was excitatory and functioned as a specific predictor of its previously associated outcome, biasing choice toward actions earning the same outcome. In its extinction context, however, the cue acted as a specific inhibitor and biased choice toward actions earning different outcomes. Context modulation of these excitatory and inhibitory memories was mediated by the dorsal hippocampus (HPC), suggesting that the HPC and IL act in concert to control the influence of conditioned inhibitors on choice. These findings demonstrate for the first time that extinction turns a cue into a net inhibitor that can influence choice via counterfactual action-outcome associations. Copyright © 2016 Elsevier Ltd. All rights reserved.
The effects of extinction-aroused attention on context conditioning.
Nelson, James Byron; Fabiano, Andrew M; Lamoureux, Jeffrey A
2018-04-01
Two experiments assessed the effects of extinguishing a conditioned cue on subsequent context conditioning. Each experiment used a different video-game method where sensors predicted attacking spaceships and participants responded to the sensor in a way that prepared them for the upcoming attack. In Experiment 1 extinction of a cue which signaled a spaceship-attack outcome facilitated subsequent learning when the attack occurred unsignaled. In Experiment 2 extinction of a cue facilitated subsequent learning, regardless of whether the spaceship outcome was the same or different as used in the earlier training. In neither experiment did the extinction context become inhibitory. Results are discussed in terms of current associative theories of attention and conditioning. © 2018 Nelson et al.; Published by Cold Spring Harbor Laboratory Press.
Early life programming of fear conditioning and extinction in adult male rats.
Stevenson, Carl W; Spicer, Clare H; Mason, Rob; Marsden, Charles A
2009-12-28
The early rearing environment programs corticolimbic function and neuroendocrine stress reactivity in adulthood. Although early environmental programming of innate fear has been previously examined, its impact on fear learning and memory later in life remains poorly understood. Here we examined the role of the early rearing environment in programming fear conditioning and extinction in adult male rats. Pups were subjected to maternal separation (MS; 360 min), brief handling (H; 15 min), or animal facility rearing (AFR) on post-natal days 2-14. As adults, animals were tested in a 3-day fear learning and memory paradigm which assessed the acquisition, expression and extinction of fear conditioning to an auditory cue; the recall of extinction was also assessed. In addition, contextual fear was assessed prior to cued extinction and its recall. We found that the acquisition of fear conditioning to the cue was modestly impaired by MS. However, no early rearing group differences were observed in cue-induced fear expression. In contrast, both the rate of extinction and extinction recall were attenuated by H. Finally, although contextual fear was reduced after extinction to the cue, no differences in context-induced fear were observed between the early rearing groups. These results add to a growing body of evidence supporting an important role for early environmental programming of fear conditioning and extinction. They also indicate that different early rearing conditions can program varying effects on distinct fear learning and memory processes in adulthood.
Elgier, Angel M; Jakovcevic, Adriana; Mustaca, Alba E; Bentosela, Mariana
2009-05-01
Domestic dogs are very successful at following human cues like gazing or pointing to find hidden food in an object choice task. They solve this kind of situation at their first attempts and from early stages of their development and perform better than wolves. Most of the authors proposed that these abilities are a domestication product, and independent from learning processes. There are few systematic studies on the effects of learning on dogs' communicative skills. We aim to evaluate the effect of extinction and reversal learning procedures on the use of the pointing gesture in an object choice task. The results showed that dogs stopped following the pointing cue in the extinction and that they learned to choose the not pointed container in the reversal learning. Results suggest that instrumental learning plays an important role in interspecific communication mechanisms between humans and dogs. In both experiments for half of the subjects the pointer was the owner and for the rest was a stranger. A differential effect was found: extinction was slower but reversal learning was faster when the owner gave the cue. This data indicates that the relationship of the dog with the person who emits the cue influences performance.
Rosenthal, M Zachary; Kutlu, Munir G
2014-09-01
Despite experimental findings and some treatment research supporting the use of cues as a means to induce and extinguish cravings, interventions using cue exposure have not been well integrated into contemporary substance abuse treatments. A primary problem with exposure-based interventions for addiction is that after learning not to use substances in the presence of addiction cues inside the clinic (i.e., extinction), stimuli in the naturalistic setting outside the clinic may continue to elicit craving, drug use, or other maladaptive conditioned responses. For exposure-based substance use interventions to be efficacious, new approaches are needed that can prevent relapse by directly generalizing learning from the therapeutic setting into naturalistic settings associated with a high risk for relapse. Basic research suggests that extinction reminders (ERs) can be paired with the context of learning new and more adaptive conditioned responses to substance abuse cues in exposure therapies for addiction. Using mobile phones and automated dialing and data collection software, ERs can be delivered in everyday high-risk settings to inhibit conditioned responses to substance-use-related stimuli. In this review, we describe how associative learning mechanisms (e.g., conditioned inhibition) can inform how ERs are conceptualized, learned, and implemented to prevent substance use when delivered via mobile phones. This approach, exposure with portable reminders of extinction, is introduced as an adjunctive intervention that uses brief automated ERs between clinic visits when individuals are in high-risk settings for drug use.
Olshavsky, Megan E; Song, Bryan J; Powell, Daniel J; Jones, Carolyn E; Monfils, Marie-H; Lee, Hongjoo J
2013-01-01
When presented with a light cue followed by food, some rats simply approach the foodcup (Nonorienters), while others first orient to the light in addition to displaying the food-cup approach behavior (Orienters). Cue-directed orienting may reflect enhanced attentional and/or emotional processing of the cue, suggesting divergent natures of cue-information processing in Orienters and Nonorienters. The current studies investigate how differences in cue processing might manifest in appetitive memory retrieval and updating using a paradigm developed to persistently attenuate fear responses (Retrieval-extinction paradigm; Monfils et al., 2009). First, we examined whether the retrieval-extinction paradigm could attenuate appetitive responses in Orienters and Nonorienters. Next, we investigated if the appetitive memory could be updated using reversal learning (fear conditioning) during the reconsolidation window (as opposed to repeated unreinforced trials, i.e., extinction). Both extinction and new fear learning given within the reconsolidation window were effective at persistently updating the initial appetitive memory in the Orienters, but not the Nonorienters. Since conditioned orienting is mediated by the amygdala central nucleus (CeA), our final experiment examined the CeA's role in the retrieval-extinction process. Bilateral CeA lesions interfered with the retrieval-extinction paradigm-did not prevent spontaneous recovery of food-cup approach. Together, our studies demonstrate the critical role of conditioned orienting behavior and the CeA in updating appetitive memory during the reconsolidation window.
Attenuating fearful memories: effect of cued extinction on intrusions.
Marks, Elizabeth H; Zoellner, Lori A
2014-12-01
Exposure-based therapies for posttraumatic stress disorder are thought to reduce intrusive memories through extinction processes. Methods that enhance extinction may translate to improved treatment. Rat research suggests retrieving a memory via a conditioned stimulus (CS) cue, and then modifying the retrieved memory within a specific reconsolidation window may enhance extinction. In humans, studies (e.g., Kindt & Soeter, 2013; Schiller et al., 2010) using basic learning paradigms show discrepant findings. Using a distressing film paradigm, participants (N = 148) completed fear acquisition and extinction. At extinction, they were randomized to 1 of 3 groups: CS cue within reconsolidation window, CS cue outside window, or non-CS cue within window. Intrusions were assessed 24 hr after extinction. Participants receiving the CS cue and completing extinction within the reconsolidation window had more intrusions (M = 2.40, SD = 2.54) than those cued outside (M = 1.65, SD = 1.70) or those receiving a non-CS cue (M = 1.24, SD = 1.26), F(2, 145) = 4.52, p = .01, d = 0.55. Consistent with the reconsolidation hypothesis, presenting a CS cue does appear to activate a specific period of time during which a memory can be updated. However, the CS cue caused increased, rather than decreased, frequency of intrusions. Understanding parameters of preextinction cueing may help us better understand reconsolidation as a potential memory updating mechanism.
Opposite effects of fear conditioning and extinction on dendritic spine remodelling.
Lai, Cora Sau Wan; Franke, Thomas F; Gan, Wen-Biao
2012-02-19
It is generally believed that fear extinction is a form of new learning that inhibits rather than erases previously acquired fear memories. Although this view has gained much support from behavioural and electrophysiological studies, the hypothesis that extinction causes the partial erasure of fear memories remains viable. Using transcranial two-photon microscopy, we investigated how neural circuits are modified by fear learning and extinction by examining the formation and elimination of postsynaptic dendritic spines of layer-V pyramidal neurons in the mouse frontal association cortex. Here we show that fear conditioning by pairing an auditory cue with a footshock increases the rate of spine elimination. By contrast, fear extinction by repeated presentation of the same auditory cue without a footshock increases the rate of spine formation. The degrees of spine remodelling induced by fear conditioning and extinction strongly correlate with the expression and extinction of conditioned fear responses, respectively. Notably, spine elimination and formation induced by fear conditioning and extinction occur on the same dendritic branches in a cue- and location-specific manner: cue-specific extinction causes formation of dendritic spines within a distance of two micrometres from spines that were eliminated after fear conditioning. Furthermore, reconditioning preferentially induces elimination of dendritic spines that were formed after extinction. Thus, within vastly complex neuronal networks, fear conditioning, extinction and reconditioning lead to opposing changes at the level of individual synapses. These findings also suggest that fear memory traces are partially erased after extinction.
Janak, Patricia H; Bowers, M Scott; Corbit, Laura H
2012-03-01
Drug abstinence is frequently compromised when addicted individuals are re-exposed to environmental stimuli previously associated with drug use. Research with human addicts and in animal models has demonstrated that extinction learning (non-reinforced cue-exposure) can reduce the capacity of such stimuli to induce relapse, yet extinction therapies have limited long-term success under real-world conditions (Bouton, 2002; O'Brien, 2008). We hypothesized that enhancing extinction would reduce the later ability of drug-predictive cues to precipitate drug-seeking behavior. We, therefore, tested whether compound stimulus presentation and pharmacological treatments that augment noradrenergic activity (atomoxetine; norepinephrine reuptake inhibitor) during extinction training would facilitate the extinction of drug-seeking behaviors, thus reducing relapse. Rats were trained that the presentation of a discrete cue signaled that a lever press response would result in cocaine reinforcement. Rats were subsequently extinguished and spontaneous recovery of drug-seeking behavior following presentation of previously drug-predictive cues was tested 4 weeks later. We find that compound stimulus presentations or pharmacologically increasing noradrenergic activity during extinction training results in less future recovery of responding, whereas propranolol treatment reduced the benefit seen with compound stimulus presentation. These data may have important implications for understanding the biological basis of extinction learning, as well as for improving the outcome of extinction-based therapies.
Ebrahimi, Claudia; Koch, Stefan P; Friedel, Eva; Crespo, Ilsoray; Fydrich, Thomas; Ströhle, Andreas; Heinz, Andreas; Schlagenhauf, Florian
2017-07-01
Appetitive Pavlovian conditioning plays a crucial role in the pathogenesis of drug addiction and conditioned reward cues can trigger craving and relapse even after long phases of abstinence. Promising preclinical work showed that the NMDA-receptor partial agonist D-cycloserine (DCS) facilitates Pavlovian extinction learning of fear and drug cues. Furthermore, DCS-augmented exposure therapy seems to be beneficial in various anxiety disorders, while the supposed working mechanism of DCS during human appetitive or aversive extinction learning is still not confirmed. To test the hypothesis that DCS administration before extinction training improves extinction learning, healthy adults (n=32) underwent conditioning, extinction, and extinction recall on three successive days in a randomized, double-blind, placebo-controlled fMRI design. Monetary wins and losses served as unconditioned stimuli during conditioning to probe appetitive and aversive learning. An oral dose of 50mg of DCS or placebo was administered 1h before extinction training and DCS effects during extinction recall were evaluated on a behavioral and neuronal level. We found attenuated amygdala activation in the DCS compared to the placebo group during recall of the extinguished appetitive cue, along with evidence for enhanced functional amygdala-vmPFC coupling in the DCS group. While the absence of additional physiological measures of conditioned responses during recall in this study prevent the evaluation of a behavioral DCS effect, our neuronal findings are in accordance with recent theories linking successful extinction recall in humans to modulatory top-down influences from the vmPFC that inhibit amygdala activation. Our results should encourage further translational studies concerning the usefulness of DCS to target maladaptive Pavlovian reward associations. Copyright © 2017 Elsevier Inc. All rights reserved.
Lissek, Silke; Glaubitz, Benjamin; Güntürkün, Onur; Tegenthoff, Martin
2015-01-01
Renewal in extinction learning describes the recovery of an extinguished response if the extinction context differs from the context present during acquisition and recall. Attention may have a role in contextual modulation of behavior and contribute to the renewal effect, while noradrenaline (NA) is involved in attentional processing. In this functional magnetic resonance imaging (fMRI) study we investigated the role of the noradrenergic system for behavioral and brain activation correlates of contextual extinction and renewal, with a particular focus upon hippocampus and ventromedial prefrontal cortex (PFC), which have crucial roles in processing of renewal. Healthy human volunteers received a single dose of the NA reuptake inhibitor atomoxetine prior to extinction learning. During extinction of previously acquired cue-outcome associations, cues were presented in a novel context (ABA) or in the acquisition context (AAA). In recall, all cues were again presented in the acquisition context. Atomoxetine participants (ATO) showed significantly faster extinction compared to placebo (PLAC). However, atomoxetine did not affect renewal. Hippocampal activation was higher in ATO during extinction and recall, as was ventromedial PFC activation, except for ABA recall. Moreover, ATO showed stronger recruitment of insula, anterior cingulate, and dorsolateral/orbitofrontal PFC. Across groups, cingulate, hippocampus and vmPFC activity during ABA extinction correlated with recall performance, suggesting high relevance of these regions for processing the renewal effect. In summary, the noradrenergic system appears to be involved in the modification of established associations during extinction learning and thus has a role in behavioral flexibility. The assignment of an association to a context and the subsequent decision on an adequate response, however, presumably operate largely independently of noradrenergic mechanisms. PMID:25745389
Decline in Cue-Provoked Craving During Cue Exposure Therapy for Smoking Cessation
Unrod, Marina; Drobes, David J.; Stasiewicz, Paul R.; Ditre, Joseph W.; Heckman, Bryan; Miller, Ralph R.; Sutton, Steven K.
2014-01-01
Introduction: Based on the principles of Pavlovian learning and extinction, cue exposure therapy (CET) involves repeated exposure to substance-associated cues to extinguish conditioned cravings and reduce the likelihood of relapse. The efficacy of CET is predicated on successful extinction, yet the process of extinction in CET trials has rarely been demonstrated. This study explored the extinction process using a cue-reactivity paradigm in smokers undergoing multiple CET sessions as part of a comprehensive smoking cessation treatment. Methods: The sample comprised 76 moderately dependent, treatment-seeking smokers who completed at least 4 CET sessions and 6 counseling sessions. The CET and counseling sessions were scheduled twice weekly, and participants began using transdermal nicotine replacement therapy on their quit day, which occurred prior to initiation of CET. Each CET session consisted of presentation of 140 images on a computer screen, with self-reported craving as the primary measure of cue reactivity. Results: Mixed-model analyses revealed a progressive decline in cue-provoked craving both within and across 6 sessions of CET. Moderator analyses showed that the decline in craving was greatest among those who displayed initial cue reactivity. Conclusions: These data are consistent with the premise that CET can produce extinction of laboratory-based cue-provoked smoking cravings and highlight important individual differences that may influence extinction. Implications for conducting cue exposure research and interventions are discussed. PMID:24078760
Sharko, Amanda C; Fadel, Jim R; Kaigler, Kris F; Wilson, Marlene A
2017-09-01
Identifying the neurobiological mechanisms that underlie differential sensitivity to stress is critical for understanding the development and expression of stress-induced disorders, such as post-traumatic stress disorder (PTSD). Preclinical studies have suggested that rodents display different phenotypes associated with extinction of Pavlovian conditioned fear responses, with some rodent populations being resistant to extinction. An emerging literature also suggests a role for orexins in the consolidation processes associated with fear learning and extinction. To examine the possibility that the orexin system might be involved in individual differences in fear extinction, we used a Pavlovian conditioning paradigm in outbred Long-Evans rats. Rats showed significant variability in the extinction of cue-conditioned freezing and extinction recall, and animals were divided into groups based on their extinction profiles based on a median split of percent freezing behavior during repeated exposure to the conditioned cue. Animals resistant to extinction (high freezers) showed more freezing during repeated cue presentations during the within trial and between trial extinction sessions compared with the group showing significant extinction (low freezers), although there were no differences between these groups in freezing upon return to the conditioned context or during the conditioning session. Following the extinction recall session, activation of orexin neurons was determined using dual label immunohistochemistry for cFos in orexin positive neurons in the hypothalamus. Individual differences in the extinction of cue conditioned fear were associated with differential activation of hypothalamic orexin neurons. Animals showing poor extinction of cue-induced freezing (high freezers) had significantly greater percentage of orexin neurons with Fos in the medial hypothalamus than animals displaying significant extinction and good extinction recall (low freezers). Further, the freezing during extinction learning was positively correlated with the percentage of activated orexin neurons in both the lateral and medial hypothalamic regions. No differences in the overall density of orexin neurons or Fos activation were seen between extinction phenotypes. Although correlative, our results support other studies implicating a role of the orexinergic system in regulating extinction of conditioned responses to threat. Copyright © 2016 Elsevier Inc. All rights reserved.
Hafenbreidel, Madalyn; Rafa Todd, Carolynn; Mueller, Devin
2017-04-01
Addiction is characterized by high relapse susceptibility, and relapse can be triggered by drug-associated cues. Cue presentation induces retrieval of the drug-cue memory, which becomes labile and must be reconsolidated into long-term storage. Repeated unpaired cue presentation, however, promotes extinction. Cue-reactivity can be reduced by blocking reconsolidation or facilitating extinction, which are mediated by NMDA receptors (NMDArs). However, the role of NMDArs in either process following self-administration is unclear. Thus, to determine their role in extinction, rats learned to self-administer cocaine before receiving injections of the NMDAr antagonist CPP immediately after four 45-min extinction sessions. During a subsequent 90-min extinction retention test, CPP-treated rats lever pressed less than saline-treated rats indicating that NMDAr blockade facilitated extinction or disrupted drug-cue memory reconsolidation. In addition, infusing CPP into the infralimbic medial prefrontal cortex (IL-mPFC), a structure implicated in extinction, before four 45-min or immediately after four 30min extinction sessions, had similar results during the extinction retention tests. Next, the GluN2A-selective antagonist NVP or GluN2B-selective antagonist Ro25 was infused into IL-mPFC or nucleus accumbens (NAc) shell, another structure implicated in extinction, after four 45-min extinction sessions. Blocking GluN2A-, but not GluN2B-, containing NMDArs, in IL-mPFC or NAc shell reduced lever pressing during the extinction retention tests. Finally, to dissociate reconsolidation from extinction, NVP was infused into IL-mPFC after four 10-min reactivation sessions, which resulted in reduced lever pressing during the retention test. These results indicate that IL-mPFC GluN2A-containing NMDArs modulate reconsolidation, and suggest a novel treatment strategy, as reducing cue reactivity could limit relapse susceptibility.
Cognitive Enhancers for Facilitating Drug Cue Extinction: Insights from Animal Models
Nic Dhonnchadha, Bríd Áine; Kantak, Kathleen M.
2011-01-01
Given the success of cue exposure (extinction) therapy combined with a cognitive enhancer for reducing anxiety, it is anticipated that this approach will prove more efficacious than exposure therapy alone in preventing relapse in individuals with substance use disorders. Several factors may undermine the efficacy of exposure therapy for substance use disorders, but we suspect that neurocognitive impairments associated with chronic drug use are an important contributing factor. Numerous insights on these issues are gained from research using animal models of addiction. In this review, the relationship between brain sites whose learning, memory and executive functions are impaired by chronic drug use and brain sites that are important for effective drug cue extinction learning is explored first. This is followed by an overview of animal research showing improved treatment outcome for drug addiction (e.g. alcohol, amphetamine, cocaine, heroin) when explicit extinction training is conducted in combination with acute dosing of a cognitive-enhancing drug. The mechanism by which cognitive enhancers are thought to exert their benefits is by facilitating consolidation of drug cue extinction memory after activation of glutamatergic receptors. Based on the encouraging work in animals, factors that may be important for the treatment of drug addiction are considered. PMID:21295059
Cholinergic regulation of fear learning and extinction.
Wilson, Marlene A; Fadel, Jim R
2017-03-01
Cholinergic activation regulates cognitive function, particularly long-term memory consolidation. This Review presents an overview of the anatomical, neurochemical, and pharmacological evidence supporting the cholinergic regulation of Pavlovian contextual and cue-conditioned fear learning and extinction. Basal forebrain cholinergic neurons provide inputs to neocortical regions and subcortical limbic structures such as the hippocampus and amygdala. Pharmacological manipulations of muscarinic and nicotinic receptors support the role of cholinergic processes in the amygdala, hippocampus, and prefrontal cortex in modulating the learning and extinction of contexts or cues associated with threat. Additional evidence from lesion studies and analysis of in vivo acetylcholine release with microdialysis similarly support a critical role of cholinergic neurotransmission in corticoamygdalar or corticohippocampal circuits during acquisition of fear extinction. Although a few studies have suggested a complex role of cholinergic neurotransmission in the cellular plasticity essential for extinction learning, more work is required to elucidate the exact cholinergic mechanisms and physiological role of muscarinic and nicotinic receptors in these fear circuits. Such studies are important for elucidating the role of cholinergic neurotransmission in disorders such as posttraumatic stress disorder that involve deficits in extinction learning as well as for developing novel therapeutic approaches for such disorders. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.
Prisciandaro, James J; Myrick, Hugh; Henderson, Scott; McRae-Clark, Aimee L; Santa Ana, Elizabeth J; Saladin, Michael E; Brady, Kathleen T
2013-09-01
The development of addiction is marked by a pathological associative learning process that imbues incentive salience to stimuli associated with drug use. Recent efforts to treat addiction have targeted this learning process using cue exposure therapy augmented with d-cycloserine (DCS), a glutamatergic agent hypothesized to enhance extinction learning. To better understand the impact of DCS-facilitated extinction on neural reactivity to drug cues, the present study reports fMRI findings from a randomized, double-blind, placebo-controlled trial of DCS-facilitated cue exposure for cocaine dependence. Twenty-five participants completed two MRI sessions (before and after intervention), with a cocaine-cue reactivity fMRI task. The intervention consisted of 50mg of DCS or placebo, combined with two sessions of cocaine cue exposure and skills training. Participants demonstrated cocaine cue activation in a variety of brain regions at baseline. From the pre- to post-study scan, participants experienced decreased activation to cues in a number of regions (e.g., accumbens, caudate, frontal poles). Unexpectedly, placebo participants experienced decreases in activation to cues in the left angular and middle temporal gyri and the lateral occipital cortex, while DCS participants did not. Three trials of DCS-facilitated cue exposure therapy for cocaine dependence have found that DCS either increases or does not significantly impact response to cocaine cues. The present study adds to this literature by demonstrating that DCS may prevent extinction to cocaine cues in temporal and occipital brain regions. Although consistent with past research, results from the present study should be considered preliminary until replicated in larger samples. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.
Attentional Control and Fear Extinction in Subclinical Fear: An Exploratory Study
Forcadell, Eduard; Torrents-Rodas, David; Treen, Devi; Fullana, Miquel A.; Tortella-Feliu, Miquel
2017-01-01
Attentional control (AC) and fear extinction learning are known to be involved in pathological anxiety. In this study we explored whether individual differences in non-emotional AC were associated with individual differences in the magnitude and gradient of fear extinction (learning and recall). In 50 individuals with fear of spiders, we collected measures of non-emotional AC by means of self-report and by assessing the functioning of the major attention networks (executive control, orienting, and alerting). The participants then underwent a paradigm assessing fear extinction learning and extinction recall. The two components of the orienting network functioning (costs and benefits) were significantly associated with fear extinction gradient over and above the effects of trait anxiety. Specifically, participants with enhanced orienting costs (i.e., difficulties in disengaging attention from cues not relevant for the task) showed faster extinction learning, while those with enhanced orienting benefits (i.e., attention facilitated by valid cues) exhibited faster extinction recall as measured by fear-potentiated startle and Unconditioned Stimulus expectancies, respectively. Our findings suggest that, in non-emotional conditions, the orienting component of attention may be predictive of fear extinction. They also show that the use of fear extinction gradients and the exploration of individual differences in non-emotional AC (using performance-based measures of attentional network functioning) can provide a better understanding of individual differences in fear learning. Our findings also may help to understand differences in exposure therapy outcomes. PMID:29018384
Chesworth, Rose; Corbit, Laura H
2017-01-01
One of the principal barriers to overcoming addiction is the propensity to relapse, even after months or years of abstinence. Relapse can be precipitated by cues and contexts associated with drug use; thus, decreasing the conditioned properties of these cues and contexts may assist in preventing relapse. The predictive power of drug cues and contexts can be reduced by repeatedly presenting them in the absence of the drug reinforcer, a process known as extinction. The potential of extinction to limit relapse has generated considerable interest and research over the past few decades. While pre-clinical animal models suggest extinction learning assists relapse prevention, treatment efficacy is often lacking when extinction learning principles are translated into clinical trials. Conklin and Tiffany (Addiction, 2002) suggest the lack of efficacy in clinical practice may be due to limited translation of procedures demonstrated through animal research and propose several methodological improvements to enhance extinction learning for drug addiction. This review will examine recent advances in the behavioural and pharmacological manipulation of extinction learning, based on research from pre-clinical models. In addition, the translation of pre-clinical findings-both those suggested by Conklin and Tiffany () and novel demonstrations from the past 13 years-into clinical trials and the efficacy of these methods in reducing craving and relapse, where available, will be discussed. Finally, we highlight areas where promising pre-clinical models have not yet been integrated into current clinical practice but, if applied, could improve upon existing behavioural and pharmacological methods. © 2015 Society for the Study of Addiction.
Cognitive enhancers for facilitating drug cue extinction: insights from animal models.
Nic Dhonnchadha, Bríd Áine; Kantak, Kathleen M
2011-08-01
Given the success of cue exposure (extinction) therapy combined with a cognitive enhancer for reducing anxiety, it is anticipated that this approach will prove more efficacious than exposure therapy alone in preventing relapse in individuals with substance use disorders. Several factors may undermine the efficacy of exposure therapy for substance use disorders, but we suspect that neurocognitive impairments associated with chronic drug use are an important contributing factor. Numerous insights on these issues are gained from research using animal models of addiction. In this review, the relationship between brain sites whose learning, memory and executive functions are impaired by chronic drug use and brain sites that are important for effective drug cue extinction learning is explored first. This is followed by an overview of animal research showing improved treatment outcome for drug addiction (e.g. alcohol, amphetamine, cocaine, heroin) when explicit extinction training is conducted in combination with acute dosing of a cognitive-enhancing drug. The mechanism by which cognitive enhancers are thought to exert their benefits is by facilitating consolidation of drug cue extinction memory after activation of glutamatergic receptors. Based on the encouraging work in animals, factors that may be important for the treatment of drug addiction are considered. Copyright © 2011. Published by Elsevier Inc.
Increasing the efficacy of cue exposure treatment in preventing relapse of addictive behavior.
Havermans, Remco C; Jansen, Anita T M
2003-07-01
Theoretically, cue exposure treatment should be able to prevent relapse by extinguishing conditioned drug responding (e.g. cue-elicited craving). According to contemporary learning theory, though, extinction does not eliminate conditioned responding. Analogous cue exposure with response prevention (CERP) as a treatment of addictive behavior might not eliminate the learned relation between drug-related cues and drug use. This does not necessarily mean that cue exposure cannot successfully prevent relapse. Various suggestions for increasing the efficacy of cue exposure treatment are being discussed from a contemporary learning theory perspective. It is suggested that cue exposure treatment incorporating retrieval cues can be a beneficial treatment in preventing relapse of addictive behavior.
Hafenbreidel, Madalyn; Rafa Todd, Carolynn; Mueller, Devin
2017-01-01
Addiction is characterized by high relapse susceptibility, and relapse can be triggered by drug-associated cues. Cue presentation induces retrieval of the drug-cue memory, which becomes labile and must be reconsolidated into long-term storage. Repeated unpaired cue presentation, however, promotes extinction. Cue-reactivity can be reduced by blocking reconsolidation or facilitating extinction, which are mediated by NMDA receptors (NMDArs). However, the role of NMDArs in either process following self-administration is unclear. Thus, to determine their role in extinction, rats learned to self-administer cocaine before receiving injections of the NMDAr antagonist CPP immediately after four 45-min extinction sessions. During a subsequent 90-min extinction retention test, CPP-treated rats lever pressed less than saline-treated rats indicating that NMDAr blockade facilitated extinction or disrupted drug-cue memory reconsolidation. In addition, infusing CPP into the infralimbic medial prefrontal cortex (IL-mPFC), a structure implicated in extinction, before four 45-min or immediately after four 30min extinction sessions, had similar results during the extinction retention tests. Next, the GluN2A-selective antagonist NVP or GluN2B-selective antagonist Ro25 was infused into IL-mPFC or nucleus accumbens (NAc) shell, another structure implicated in extinction, after four 45-min extinction sessions. Blocking GluN2A-, but not GluN2B-, containing NMDArs, in IL-mPFC or NAc shell reduced lever pressing during the extinction retention tests. Finally, to dissociate reconsolidation from extinction, NVP was infused into IL-mPFC after four 10-min reactivation sessions, which resulted in reduced lever pressing during the retention test. These results indicate that IL-mPFC GluN2A-containing NMDArs modulate reconsolidation, and suggest a novel treatment strategy, as reducing cue reactivity could limit relapse susceptibility. PMID:28042872
Pharmacological enhancement of drug cue extinction learning: translational challenges
Kantak, K.M.; Nic Dhonnchadha, B.Á.
2010-01-01
Augmentation of cue exposure (extinction) therapy with cognitive-enhancing pharmacotherapy may constitute a rational strategy for the clinical management of drug relapse. While certain success has been reported for this form of therapy in anxiety disorders, in this article we highlight several obstacles that may undermine the efficacy of exposure therapy for substance use disorders. We also review translational studies that have evaluated the facilitative effects of the cognitive enhancer D-cycloserine on extinction targeting drug-related cues. Finally, important considerations for the design and implementation of future studies evaluating exposure therapy combined with pharmacotherapy for substance use disorders are discussed. PMID:21272016
Orexin/hypocretin receptor 1 signaling mediates Pavlovian cue-food conditioning and extinction.
Keefer, Sara E; Cole, Sindy; Petrovich, Gorica D
2016-08-01
Learned food cues can drive feeding in the absence of hunger, and orexin/hypocretin signaling is necessary for this type of overeating. The current study examined whether orexin also mediates cue-food learning during the acquisition and extinction of these associations. In Experiment 1, rats underwent two sessions of Pavlovian appetitive conditioning, consisting of tone-food presentations. Prior to each session, rats received either the orexin 1 receptor antagonist SB-334867 (SB) or vehicle systemically. SB treatment did not affect conditioned responses during the first conditioning session, measured as food cup behavior during the tone and latency to approach the food cup after the tone onset, compared to the vehicle group. During the second conditioning session, SB treatment attenuated learning. All groups that received SB, prior to either the first or second conditioning session, displayed significantly less food cup behavior and had longer latencies to approach the food cup after tone onset compared to the vehicle group. These findings suggest orexin signaling at the 1 receptor mediates the consolidation and recall of cue-food acquisition. In Experiment 2, another group of rats underwent tone-food conditioning sessions (drug free), followed by two extinction sessions under either SB or vehicle treatment. Similar to Experiment 1, SB did not affect conditioned responses during the first session. During the second extinction session, the group that received SB prior to the first extinction session, but vehicle prior to the second, expressed conditioned food cup responses longer after tone offset, when the pellets were previously delivered during conditioning, and maintained shorter latencies to approach the food cup compared to the other groups. The persistence of these conditioned behaviors indicates impairment in extinction consolidation due to SB treatment during the first extinction session. Together, these results demonstrate an important role for orexin signaling during Pavlovian appetitive conditioning and extinction. Copyright © 2016 Elsevier Inc. All rights reserved.
Orexin/hypocretin receptor 1 signaling mediates Pavlovian cue-food conditioning and extinction
Keefer, Sara E.; Cole, Sindy; Petrovich, Gorica D.
2016-01-01
Learned food cues can drive feeding in the absence of hunger, and orexin/hypocretin signaling is necessary for this type of overeating. The current study examined whether orexin also mediates cue-food learning during the acquisition and extinction of these associations. In Experiment 1, rats underwent two sessions of Pavlovian appetitive conditioning, consisting of tone-food presentations. Prior to each session, rats received either the orexin 1 receptor antagonist SB-334867 (SB) or vehicle systemically. SB treatment did not affect conditioned responses during the first conditioning session, measured as food cup behavior during the tone and latency to approach the food cup after the tone onset, compared to the vehicle group. During the second conditioning session, SB treatment attenuated learning. All groups that received SB, prior to either the first or second conditioning session, displayed significantly less food cup behavior and had longer latencies to approach the food cup after tone onset compared to the vehicle group. These findings suggest orexin signaling at the 1 receptor mediates the consolidation and recall of cue-food acquisition. In Experiment 2, another group of rats underwent tone-food conditioning sessions (drug free), followed by two extinction sessions under either SB or vehicle treatment. Similar to Experiment 1, SB did not affect conditioned responses during the first session. During the second extinction session, the group that received SB prior to the first extinction session, but vehicle prior to the second, expressed conditioned food cup responses longer after tone offset, when the pellets were previously delivered during conditioning, and maintained shorter latencies to approach the food cup compared to the other groups. The persistence of these conditioned behaviors indicates impairment in extinction consolidation due to SB treatment during the first extinction session. Together, these results demonstrate an important role for orexin signaling during Pavlovian appetitive conditioning and extinction. PMID:26945612
Yang, Chih-Hao; Huang, Chiung-Chun; Hsu, Kuei-Sen
2011-01-01
Repetitive replay of fear memories may precipitate the occurrence of post-traumatic stress disorder and other anxiety disorders. Hence, the suppression of fear memory retrieval may help prevent and treat these disorders. The formation of fear memories is often linked to multiple environmental cues and these interconnected cues may act as reminders for the recall of traumatic experiences. However, as a convenience, a simple paradigm of one cue pairing with the aversive stimulus is usually used in studies of fear conditioning in animals. Here, we built a more complex fear conditioning model by presenting several environmental stimuli during fear conditioning and characterize the effectiveness of extinction training and the disruption of reconsolidation process on the expression of learned fear responses. We demonstrate that extinction training with a single-paired cue resulted in cue-specific attenuation of fear responses but responses to other cures were unchanged. The cue-specific nature of the extinction persisted despite training sessions combined with -cycloserine treatment reveals a significant weakness in extinction-based treatment. In contrast, the inhibition of the dorsal hippocampus (DH) but not the basolateral amygdala (BLA)-dependent memory reconsolidation process using either protein synthesis inhibitors or genetic disruption of cAMP-response-element-binding protein-mediated transcription comprehensively disrupted the learned connections between fear responses and all paired environmental cues. These findings emphasize the distinct role of the DH and the BLA in the reconsolidation process of fear memories and further indicate that the disruption of memory reconsolidation process in the DH may result in generalization of fear inhibition. PMID:21593730
Yang, Chih-Hao; Huang, Chiung-Chun; Hsu, Kuei-Sen
2011-09-01
Repetitive replay of fear memories may precipitate the occurrence of post-traumatic stress disorder and other anxiety disorders. Hence, the suppression of fear memory retrieval may help prevent and treat these disorders. The formation of fear memories is often linked to multiple environmental cues and these interconnected cues may act as reminders for the recall of traumatic experiences. However, as a convenience, a simple paradigm of one cue pairing with the aversive stimulus is usually used in studies of fear conditioning in animals. Here, we built a more complex fear conditioning model by presenting several environmental stimuli during fear conditioning and characterize the effectiveness of extinction training and the disruption of reconsolidation process on the expression of learned fear responses. We demonstrate that extinction training with a single-paired cue resulted in cue-specific attenuation of fear responses but responses to other cures were unchanged. The cue-specific nature of the extinction persisted despite training sessions combined with D-cycloserine treatment reveals a significant weakness in extinction-based treatment. In contrast, the inhibition of the dorsal hippocampus (DH) but not the basolateral amygdala (BLA)-dependent memory reconsolidation process using either protein synthesis inhibitors or genetic disruption of cAMP-response-element-binding protein-mediated transcription comprehensively disrupted the learned connections between fear responses and all paired environmental cues. These findings emphasize the distinct role of the DH and the BLA in the reconsolidation process of fear memories and further indicate that the disruption of memory reconsolidation process in the DH may result in generalization of fear inhibition.
Trantham-Davidson, Heather; Kassab, Amanda S.; Glen, William B.; Olive, M. Foster; Chandler, L. Judson
2014-01-01
Addiction is a chronic relapsing disorder in which relapse is often initiated by exposure to drug-related cues. The present study examined the effects of mGluR5 activation on extinction of ethanol-cue-maintained responding, relapse-like behavior, and neuronal plasticity. Rats were trained to self-administer ethanol and then exposed to extinction training during which they were administered either vehicle or the mGluR5 positive allosteric modulator 3-cyano-N-(1,3-diphenyl-1H-pyrazol-5-yl) or CDPPB. CDPPB treatment reduced active lever responding during extinction, decreased the total number of extinction sessions required to meet criteria, and attenuated cue-induced reinstatement of ethanol seeking. CDPPB facilitation of extinction was blocked by the local infusion of the mGluR5 antagonist 3-((2-methyl-4-thiazolyl)ethynyl) pyridine into the infralimbic (IfL) cortex, but had no effect when infused into the prelimbic (PrL) cortex. Analysis of dendritic spines revealed alterations in structural plasticity, whereas electrophysiological recordings demonstrated differential alterations in glutamatergic neurotransmission in the PrL and IfL cortex. Extinction was associated with increased amplitude of evoked synaptic PrL and IfL NMDA currents but reduced amplitude of PrL AMPA currents. Treatment with CDPPB prevented the extinction-induced enhancement of NMDA currents in PrL without affecting NMDA currents in the IfL. Whereas CDPPB treatment did not alter the amplitude of PrL or IfL AMPA currents, it did promote the expression of IfL calcium-permeable GluR2-lacking receptors in both abstinence- and extinction-trained rats, but had no effect in ethanol-naive rats. These results confirm changes in the PrL and IfL cortex in glutamatergic neurotransmission during extinction learning and demonstrate that manipulation of mGluR5 facilitates extinction of ethanol cues in association with neuronal plasticity. PMID:24872560
Gass, Justin T; Trantham-Davidson, Heather; Kassab, Amanda S; Glen, William B; Olive, M Foster; Chandler, L Judson
2014-05-28
Addiction is a chronic relapsing disorder in which relapse is often initiated by exposure to drug-related cues. The present study examined the effects of mGluR5 activation on extinction of ethanol-cue-maintained responding, relapse-like behavior, and neuronal plasticity. Rats were trained to self-administer ethanol and then exposed to extinction training during which they were administered either vehicle or the mGluR5 positive allosteric modulator 3-cyano-N-(1,3-diphenyl-1H-pyrazol-5-yl) or CDPPB. CDPPB treatment reduced active lever responding during extinction, decreased the total number of extinction sessions required to meet criteria, and attenuated cue-induced reinstatement of ethanol seeking. CDPPB facilitation of extinction was blocked by the local infusion of the mGluR5 antagonist 3-((2-methyl-4-thiazolyl)ethynyl) pyridine into the infralimbic (IfL) cortex, but had no effect when infused into the prelimbic (PrL) cortex. Analysis of dendritic spines revealed alterations in structural plasticity, whereas electrophysiological recordings demonstrated differential alterations in glutamatergic neurotransmission in the PrL and IfL cortex. Extinction was associated with increased amplitude of evoked synaptic PrL and IfL NMDA currents but reduced amplitude of PrL AMPA currents. Treatment with CDPPB prevented the extinction-induced enhancement of NMDA currents in PrL without affecting NMDA currents in the IfL. Whereas CDPPB treatment did not alter the amplitude of PrL or IfL AMPA currents, it did promote the expression of IfL calcium-permeable GluR2-lacking receptors in both abstinence- and extinction-trained rats, but had no effect in ethanol-naive rats. These results confirm changes in the PrL and IfL cortex in glutamatergic neurotransmission during extinction learning and demonstrate that manipulation of mGluR5 facilitates extinction of ethanol cues in association with neuronal plasticity. Copyright © 2014 the authors 0270-6474/14/347562-13$15.00/0.
A Memory Retrieval-Extinction Procedure to Prevent Drug Craving and Relapse
Xue, Yan-Xue; Luo, Yi-Xiao; Wu, Ping; Shi, Hai-Shui; Xue, Li-Fen; Chen, Chen; Zhu, Wei-Li; Ding, Zeng-Bo; Bao, Yan-ping; Shi, Jie; Epstein, David H.; Shaham, Yavin; Lu, Lin
2013-01-01
Drug use and relapse involve learned associations between drug-associated environmental cues and drug effects. Extinction procedures in the clinic can suppress conditioned responses to drug cues, but the extinguished responses typically reemerge after exposure to the drug itself (reinstatement), the drug-associated environment (renewal), or the passage of time (spontaneous recovery). We describe a memory retrieval-extinction procedure that decreases conditioned drug effects and drug seeking in rat models of relapse, and drug craving in abstinent heroin addicts. In rats, daily retrieval of drug-associated memories 10 minutes or 1 hour but not 6 hours before extinction sessions attenuated drug-induced reinstatement, spontaneous recovery, and renewal of conditioned drug effects and drug seeking. In heroin addicts, retrieval of drug-associated memories 10 minutes before extinction sessions attenuated cue-induced heroin craving 1, 30, and 180 days later. The memory retrieval-extinction procedure is a promising nonpharmacological method for decreasing drug craving and relapse during abstinence. PMID:22499948
Lucantonio, Federica; Kambhampati, Sarita; Haney, Richard Z; Atalayer, Deniz; Rowland, Neil E; Shaham, Yavin; Schoenbaum, Geoffrey
2015-05-15
Addiction is characterized by an inability to stop using drugs, despite adverse consequences. One contributing factor to this compulsive drug taking could be the impact of drug use on the ability to extinguish drug seeking after changes in expected outcomes. Here, we compared effects of cocaine, morphine, and heroin self-administration on two forms of extinction learning: standard extinction driven by reward omission and extinction driven by reward overexpectation. In experiment 1, we trained rats to self-administer cocaine, morphine, or sucrose for 3 hours per day (limited access). In experiment 2, we trained rats to self-administer heroin or sucrose for 12 hours per day (extended access). Three weeks later, we trained the rats to associate several cues with palatable food reward, after which we assessed extinction of the learned Pavlovian response, first by pairing two cues together in the overexpectation procedure and later by omitting the food reward. Rats trained under limited access conditions to self-administer sucrose or morphine demonstrated normal extinction in response to both overexpectation and reward omission, whereas cocaine-experienced rats or rats trained to self-administer heroin under extended access conditions exhibited normal extinction in response to reward omission but failed to show extinction in response to overexpectation. Here we show that cocaine and heroin can induce long-lasting deficits in the ability to extinguish reward seeking. These deficits were not observed in a standard extinction procedure but instead only affected extinction learning driven by a more complex phenomenon of overexpectation. Published by Elsevier Inc.
Lissek, Silke; Glaubitz, Benjamin; Schmidt-Wilcke, Tobias; Tegenthoff, Martin
2016-05-01
Renewal is defined as the recovery of an extinguished response if extinction and retrieval contexts differ. The context dependency of extinction, as demonstrated by renewal, has important implications for extinction-based therapies. Persons showing renewal (REN) exhibit higher hippocampal activation during extinction in associative learning than those without renewal (NOREN), demonstrating hippocampal context processing, and recruit ventromedial pFC in retrieval. Apart from these findings, brain processes generating renewal remain largely unknown. Conceivably, processing differences in task-relevant brain regions that ultimately lead to renewal may occur already in initial acquisition of associations. Therefore, in two fMRI studies, we investigated overall brain activation and hippocampal activation in REN and NOREN during acquisition of an associative learning task in response to presentation of a context alone or combined with a cue. Results of two studies demonstrated significant activation differences between the groups: In Study 1, a support vector machine classifier correctly assigned participants' brain activation patterns to REN and NOREN groups, respectively. In Study 2, REN and NOREN showed similar hippocampal involvement during context-only presentation, suggesting processing of novelty, whereas overall hippocampal activation to the context-cue compound, suggesting compound encoding, was higher in REN. Positive correlations between hippocampal activation and renewal level indicated more prominent hippocampal processing in REN. Results suggest that hippocampal processing of the context-cue compound rather than of context only during initial learning is related to a subsequent renewal effect. Presumably, REN participants use distinct encoding strategies during acquisition of context-related tasks, which reflect in their brain activation patterns and contribute to a renewal effect.
Bustamante, Javier; Uengoer, Metin; Thorwart, Anna; Lachnit, Harald
2016-09-01
In two human predictive-learning experiments, we investigated the effects of extinction in multiple contexts on the rate of extinction and the strength of response recovery. In each experiment, participants initially received acquisition training with a target cue in one context, followed by extinction either in a different context (extinction in a single context) or in three different contexts (extinction in multiple contexts). The results of both experiments showed that conducting extinction in multiple contexts led to higher levels of responding during extinction than did extinction in a single context. Additionally, Experiment 2 showed that extinction in multiple contexts prevented ABC renewal but had no detectable impact on ABA renewal. Our results are discussed within the framework of contemporary learning theories of contextual control and extinction.
Sleep Deprivation Disrupts Recall of Conditioned Fear Extinction.
Straus, Laura D; Acheson, Dean T; Risbrough, Victoria B; Drummond, Sean P A
2017-03-01
Learned fear is crucial in the development and maintenance of posttraumatic stress disorder (PTSD) and other anxiety disorders, and extinction of learned fear is necessary for response to exposure-based treatments. In humans, research suggests disrupted sleep impairs consolidation of extinction, though no studies have examined this experimentally using total sleep deprivation. Seventy-one healthy controls underwent a paradigm to acquire conditioned fear to a visual cue. Twenty-four hours after fear conditioning, participants underwent extinction learning. Twenty-four hours after extinction learning, participants underwent extinction recall. Participants were randomized to three groups: 1) well-rested throughout testing ("normal sleep"; n = 21); 2) 36 hours total sleep deprivation before extinction learning ("pre-extinction deprivation"; n = 25); or 3) 36 hours total sleep deprivation after extinction learning and before extinction recall ("post-extinction deprivation"; n = 25). The groups were compared on blink EMG reactivity to the condition stimulus during extinction learning and recall. There were no differences among the three groups during extinction learning. During extinction recall, the pre-extinction deprivation group demonstrated significantly less extinction recall than the normal sleep group. There was no significant difference between the normal sleep and post-extinction deprivation group during extinction recall. Results indicated sleep deprivation prior to extinction training significantly disrupts extinction recall. These findings suggest that (1) sleep deprivation in the immediate aftermath of trauma could be a potential contributor to PTSD development and maintenance via interference with natural extinction processes and (2) management of sleep symptoms should be considered during extinction-based therapy.
Comparing Context Specificity of Extinction and Latent Inhibition
Miller, Ralph R.; Laborda, Mario A.; Polack, Cody W.; Miguez, Gonzalo
2015-01-01
Exposure to a cue alone either before (i.e., latent inhibition treatment) or after (i.e., extinction) the cue is paired with an unconditioned stimulus (US) results in attenuated conditioned responding to the cue. Here we report two experiments in which potential parallels between the context specificity of the effects of extinction and latent inhibition treatments were directly compared in a lick suppression preparation with rats. The reversed ordering of conditioning and nonreinforcement in extinction and latent inhibition designs allowed us to examine the effect of training order on the context specificity of what is learned given phasic reinforcement and nonreinforcement of a target cue. Experiment 1 found that when CS conditioning and CS nonreinforcement were administered in the same context, both extinction and latent inhibition treatments had reduced impact on test performance relative to excitatory conditioning when testing occurred outside the treatment context. Similarly, Experiment 2 found that when conditioning was administered in one context and nonreinforcement was administered in a second context, the effects of both extinction and latent inhibition treatments were attenuated when testing occurred in a neutral context relative to the context in which the CS was nonreinforced. The observed context specificity of extinction and latent inhibition treatments have both been previously reported, but not in a single experiment under otherwise identical conditions. The results of the two experiments convergently suggest that memory of nonreinforcement becomes context dependent after a cue is both reinforced and nonreinforced independent of the order of training. PMID:26100525
Comparing the context specificity of extinction and latent inhibition.
Miller, Ralph R; Laborda, Mario A; Polack, Cody W; Miguez, Gonzalo
2015-12-01
Exposure to a cue alone either before (i.e., latent inhibition treatment) or after (i.e., extinction) the cue is paired with an unconditioned stimulus results in attenuated conditioned responding to the cue. Here we report two experiments in which potential parallels between the context specificity of the effects of extinction and latent inhibition treatments were directly compared in a lick suppression preparation with rats. The reversed ordering of conditioning and nonreinforcement in extinction and latent inhibition designs allowed us to examine the effect of training order on the context specificity of what is learned given phasic reinforcement and nonreinforcement of a target cue. Experiment 1 revealed that when conditioned-stimulus (CS) conditioning and CS nonreinforcement were administered in the same context, both extinction and latent inhibition treatments had reduced impacts on test performance, relative to excitatory conditioning when testing occurred outside the treatment context. Similarly, Experiment 2 showed that when conditioning was administered in one context and nonreinforcement was administered in a second context, the effects of both extinction and latent inhibition treatments were attenuated when testing occurred in a neutral context, relative to the context in which the CS was nonreinforced. The observed context specificity of extinction and latent inhibition treatments has been previously reported in both cases, but not in a single experiment under otherwise identical conditions. The results of the two experiments convergently suggest that memory of nonreinforcement becomes context dependent after a cue is both reinforced and nonreinforced, independent of the order of training.
Davis, Catherine M; de Brugada, Isabel; Riley, Anthony L
2010-05-01
The attenuation of an LiCl-induced conditioned taste aversion (CTA) by LiCl preexposure is mediated primarily by associative blocking via injection-related cues. Given that preexposure to morphine attenuates morphine-induced CTAs, it was of interest to determine whether injection cues also mediate this effect. Certain morphine-induced behaviors such as analgesic tolerance are controlled associatively, via injection-related cues. Accordingly, animals in the present experiments were preexposed to morphine (or vehicle) every other day for five total exposures, followed by an extinction phase, in which the subjects were given saline injections (or no treatment) for 8 (Experiment 1) or 16 (Experiment 2) consecutive days. All of the animals then received five CTA trials with morphine (or vehicle). The morphine-preexposed animals in Experiment 1 displayed an attenuation of the morphine CTA that was unaffected by extinction saline injections, suggesting that blocking by injection cues during morphine preexposure does not mediate this effect. All of the morphine-preexposed subjects in Experiment 2 displayed a weakened preexposure effect, an effect inconsistent with a selective extinction of drug-associated stimuli. The attenuating effects of morphine preexposure in aversion learning are most likely controlled by nonassociative mechanisms, like drug tolerance.
D-cycloserine Deters Reacquisition of Cocaine Self-Administration by Augmenting Extinction Learning
Nic Dhonnchadha, Bríd Á; Szalay, Jonathan J; Achat-Mendes, Cindy; Platt, Donna M; Otto, Michael W; Spealman, Roger D; Kantak, Kathleen M
2010-01-01
Augmentation of cue exposure (extinction) therapy with cognitive-enhancing pharmacotherapy may offer an effective strategy to combat cocaine relapse. To investigate this possibility at the preclinical level, rats and squirrel monkeys were trained to self-administer cocaine paired with a brief visual cue. Lever pressing was subsequently extinguished by withholding cocaine injections while maintaining response-contingent presentations of the cue. The glycine partial agonist D-cycloserine (DCS; 15 and 30 mg/kg in rats, 3 and 10 mg/kg in monkeys) was evaluated for its effects on the rate of extinction and subsequent reacquisition of cocaine self-administration. Compared with vehicle, pretreatment with 30 mg/kg DCS 0.5 h before extinction training reduced the number of responses and latency to reach the extinction criterion in rats, but neither dose of DCS altered these measures in monkeys. In both species, pretreatment with the higher dose of DCS before extinction training significantly attenuated reacquisition of cocaine self-administration compared with either extinction training in the absence of DCS or DCS in the absence of explicit extinction. Furthermore, treatment with 30 mg/kg DCS accompanied by brief handling (a stress induction) immediately after but not 6 h after extinction training attenuated reacquisition of cocaine self-administration in rats. No adverse effects of 10 mg/kg DCS were evident in quantitative observational studies in monkeys. The results suggest that DCS augmented consolidation of extinction learning to deter reacquisition of cocaine self-administration in rats and monkeys. The results suggest that DCS combined with exposure therapy may constitute a rational strategy for the clinical management of cocaine relapse. PMID:19741593
Gass, J T; McGonigal, J T; Chandler, L J
2017-02-01
Alcoholism is a chronic relapsing disorder characterized by periods of heavy alcohol consumption and unsuccessful attempts at abstinence. Relapse is one of the most problematic aspects in the treatment of alcoholism and is triggered by ethanol-associated cues. Extinction-based cue exposure therapies have proven ineffective in the treatment of alcoholism. However, positive allosteric modulation of mGlu5 with CDPPB enhances the extinction learning of alcohol-seeking behavior. The current study investigated the impact of chronic alcohol exposure on the extinction of ethanol-seeking behavior. Adult Wistar rats were trained to self-administer alcohol with a light/tone stimulus serving as the alcohol cue. After training, one group of rats was exposed to chronic intermittent ethanol (CIE) daily for a period of 2 weeks to induce ethanol dependence. Control rats were exposed to air for the same period of time. Both groups were then retrained to self-administer ethanol and subsequently tested for changes in extinction learning. CIE exposed rats consumed more ethanol compared to their pre-CIE levels and to control rats. During extinction training, CIE rats responded significantly more on the previously active lever and required more sessions to reach extinction criteria compared to control rats. Treatment with CDPPB facilitated extinction in control rats and attenuated the increased resistance to extinction in CIE-exposed rats. These results demonstrate that chronic ethanol exposure not only alters ethanol intake, but also the extinction of ethanol-seeking behaviors. The ability to attenuate deficits through modulation of mGlu5 provides a potential target for pharmacological manipulation that could ultimately reduce relapse in alcoholics. Copyright © 2016 Elsevier Ltd. All rights reserved.
Ziminski, Joseph J; Hessler, Sabine; Margetts-Smith, Gabriella; Sieburg, Meike C; Crombag, Hans S; Koya, Eisuke
2017-03-22
Cues that predict the availability of food rewards influence motivational states and elicit food-seeking behaviors. If a cue no longer predicts food availability, then animals may adapt accordingly by inhibiting food-seeking responses. Sparsely activated sets of neurons, coined "neuronal ensembles," have been shown to encode the strength of reward-cue associations. Although alterations in intrinsic excitability have been shown to underlie many learning and memory processes, little is known about these properties specifically on cue-activated neuronal ensembles. We examined the activation patterns of cue-activated orbitofrontal cortex (OFC) and nucleus accumbens (NAc) shell ensembles using wild-type and Fos-GFP mice, which express green fluorescent protein (GFP) in activated neurons, after appetitive conditioning with sucrose and extinction learning. We also investigated the neuronal excitability of recently activated, GFP+ neurons in these brain areas using whole-cell electrophysiology in brain slices. Exposure to a sucrose cue elicited activation of neurons in both the NAc shell and OFC. In the NAc shell, but not the OFC, these activated GFP+ neurons were more excitable than surrounding GFP- neurons. After extinction, the number of neurons activated in both areas was reduced and activated ensembles in neither area exhibited altered excitability. These data suggest that learning-induced alterations in the intrinsic excitability of neuronal ensembles is regulated dynamically across different brain areas. Furthermore, we show that changes in associative strength modulate the excitability profile of activated ensembles in the NAc shell. SIGNIFICANCE STATEMENT Sparsely distributed sets of neurons called "neuronal ensembles" encode learned associations about food and cues predictive of its availability. Widespread changes in neuronal excitability have been observed in limbic brain areas after associative learning, but little is known about the excitability changes that occur specifically on neuronal ensembles that encode appetitive associations. Here, we reveal that sucrose cue exposure recruited a more excitable ensemble in the nucleus accumbens, but not orbitofrontal cortex, compared with their surrounding neurons. This excitability difference was not observed when the cue's salience was diminished after extinction learning. These novel data provide evidence that the intrinsic excitability of appetitive memory-encoding ensembles is regulated differentially across brain areas and adapts dynamically to changes in associative strength. Copyright © 2017 the authors 0270-6474/17/373160-11$15.00/0.
ERIC Educational Resources Information Center
Briggs, James F.; Olson, Brian P.
2013-01-01
We investigated whether reexposure to an amnestic agent would reverse amnesia for extinction of learned fear similar to that of a reactivated memory. When cycloheximide (CHX) was administered immediately after a brief cue-induced memory reactivation (15 sec) and an extended extinction session (12 min) rats showed retrograde amnesia for both…
Lissek, Silke; Glaubitz, Benjamin; Wolf, Oliver T.; Tegenthoff, Martin
2015-01-01
Renewal describes the recovery of an extinguished response if recall is tested in a context different from the extinction context. Behavioral studies demonstrated that attention to relevant context strengthens renewal. Neurotransmitters mediating attention and learning such as the dopaminergic (DA) system presumably modulate extinction learning and renewal. However, the role of DA for non-fear-based extinction learning and renewal in humans has not yet been investigated. This fMRI study investigated effects of DA-antagonism upon context-related extinction in a predictive learning task in which extinction occurred either in a novel (ABA) or an unchanged (AAA) context. The tiapride-treated group (TIA) showed significantly impaired ABA extinction learning and a significant within-group difference between ABA and AAA extinction, compared to placebo (PLAC). Groups did not differ in their level of ABA renewal. In ABA extinction, TIA showed reduced activation in dlPFC and OFC, hippocampus, and temporal regions. Across groups, activation in PFC and hippocampus correlated negatively with ABA extinction errors. Results suggest that in context-related extinction learning DA in PFC and hippocampus is involved in readjusting the cue-outcome relationship in the presence of a novel context. However, relating context to the appropriate association during recall does not appear to rely exclusively on DA signaling. PMID:26388752
New approaches to addiction treatment based on learning and memory.
Kiefer, Falk; Dinter, Christina
2013-01-01
Preclinical studies suggest that physiological learning processes are similar to changes observed in addicts at the molecular, neuronal, and structural levels. Based on the importance of classical and instrumental conditioning in the development and maintenance of addictive disorders, many have suggested cue-exposure-based extinction training of conditioned, drug-related responses as a potential new treatment of addiction. It may also be possible to facilitate this extinction training with pharmacological compounds that strengthen memory consolidation during cue exposure. Another potential therapeutic intervention would be based on the so-called reconsolidation theory. According to this hypothesis, already-consolidated memories return to a labile state when reactivated, allowing them to undergo another phase of consolidation-reconsolidation, which can be pharmacologically manipulated. These approaches suggest that the extinction of drug-related memories may represent a viable treatment strategy in the future treatment of addiction.
Gass, J. T.; Chandler, L. J.
2013-01-01
Theories of drug addiction that incorporate various concepts from the fields of learning and memory have led to the idea that classical and operant conditioning principles underlie the compulsiveness of addictive behaviors. Relapse often results from exposure to drug-associated cues, and the ability to extinguish these conditioned behaviors through inhibitory learning could serve as a potential therapeutic approach for those who suffer from addiction. This review will examine the evidence that extinction learning alters neuronal plasticity in specific brain regions and pathways. In particular, subregions of the prefrontal cortex (PFC) and their projections to other brain regions have been shown to differentially modulate drug-seeking and extinction behavior. Additionally, there is a growing body of research demonstrating that manipulation of neuronal plasticity can alter extinction learning. Therefore, the ability to alter plasticity within areas of the PFC through pharmacological manipulation could facilitate the acquisition of extinction and provide a novel intervention to aid in the extinction of drug-related memories. PMID:23750137
Barker, Jacqueline M.; Taylor, Jane R.; De Vries, Taco J.; Peters, Jamie
2015-01-01
Many abused drugs lead to changes in endogenous brain-derived neurotrophic factor (BDNF) expression in neural circuits responsible for addictive behaviors. BDNF is a known molecular mediator of memory consolidation processes, evident at both behavioral and neurophysiological levels. Specific neural circuits are responsible for storing and executing drug-procuring motor programs, whereas other neural circuits are responsible for the active suppression of these “seeking” systems. These seeking-circuits are established as associations are formed between drug-associated cues and the conditioned responses they elicit. Such conditioned responses (e.g. drug seeking) can be diminished either through a passive weakening of seeking-circuits or an active suppression of those circuits through extinction. Extinction learning occurs when the association between cues and drug are violated, for example, by cue exposure without the drug present. Cue exposure therapy has been proposed as a therapeutic avenue for the treatment of addictions. Here we explore the role of BDNF in extinction circuits, compared to seeking-circuits that “incubate” over prolonged withdrawal periods. We begin by discussing the role of BDNF in extinction memory for fear and cocaine-seeking behaviors, where extinction circuits overlap in infralimbic prefrontal cortex (PFC). We highlight the ability of estrogen to promote BDNF-like effects in hippocampal–prefrontal circuits and consider the role of sex differences in extinction and incubation of drug-seeking behaviors. Finally, we examine how opiates and alcohol “break the mold” in terms of BDNF function in extinction circuits. PMID:25451116
Brenhouse, Heather C; Thompson, Britta S; Sonntag, Kai C; Andersen, Susan L
2015-08-01
Extinction of behaviors in response to drug-associated cues and prevention of reinstatement are integral for addiction treatment, and can reverse or ameliorate the harmful consequences of drug use. The mechanisms controlling extinction and reinstatement involve prefrontal cortical dopamine receptors, which change in expression and activity during the juvenile and adolescent transitions until they mature in adulthood. Little is known about the role that PFC D1 dopamine receptors play in extinction of drug-paired associations early in life. We used extinction of place preferences for cocaine in juvenile male and female rats following genetic, cell-specific overexpression of D1 on glutamatergic cells in the PFC. All subjects needed to demonstrate cocaine preferences for inclusion in the extinction studies. Here, male juveniles with a preference to 10 mg/kg cocaine took longer to extinguish preferences compared to both male adults and female juveniles. Female juveniles extinguished more rapidly than male juveniles at 20 mg/kg cocaine. Overexpression of D1 in juvenile males significantly facilitated extinction relative to juvenile male controls, whereas D1 prolonged expression of extinction in adults overexpressing D1 and adolescents who naturally have elevated D1 expression. These data suggest that an immature D1 profile in juveniles prevented the learning of new associations, and D1 overexpression may provide sufficient activity to facilitate extinction learning. D1 overexpression reduced reinstatement to a priming dose of cocaine in juvenile males. Together, these data show D1 expression may re-program motivational circuitry to facilitate extinction learning during juvenility that is normally unavailable to juveniles and that sex differences exist. Copyright © 2015 Elsevier Ltd. All rights reserved.
Brenhouse, Heather C.; Thompson, Britta S.; Sonntag, Kai C.; Andersen, Susan L.
2015-01-01
Extinction of behaviors in response to drug-associated cues and prevention of reinstatement are integral for addiction treatment, and can reverse or ameliorate the harmful consequences of drug use. The mechanisms controlling extinction and reinstatement involve prefrontal cortical dopamine receptors, which change in expression and activity during the juvenile and adolescent transitions until they mature in adulthood. Little is known about the role that PFC D1 dopamine receptors play in extinction of drug-paired associations early in life. We used extinction of place preferences for cocaine in juvenile male and female rats following genetic, cell-specific overexpression of D1 on glutamatergic cells in the PFC. All subjects needed to demonstrate cocaine preferences for inclusion in the extinction studies. Here, male juveniles with a preference to 10 mg/kg cocaine took longer to extinguish preferences compared to both male adults and female juveniles. Female juveniles extinguished more rapidly than male juveniles at 20 mg/kg cocaine. Overexpression of D1 in juvenile males significantly facilitated extinction relative to juvenile male controls, whereas D1 prolonged expression of extinction in adults overexpressing D1 and adolescents who naturally have elevated D1 expression. These data suggest that an immature D1 profile in juveniles prevented the learning of new associations, and D1 overexpression may provide sufficient activity to facilitate extinction learning. D1 overexpression reduced reinstatement to a priming dose of cocaine in juvenile males. Together, these data show D1 expression may re-program motivational circuitry to facilitate extinction learning during juvenility that is normally unavailable to juveniles and that sex differences exist. PMID:25749358
ERIC Educational Resources Information Center
Baker, Kathryn D.; McNally, Gavan P.; Richardson, Rick
2012-01-01
The NMDA receptor partial agonist d-cycloserine (DCS) enhances the extinction of learned fear in rats and exposure therapy in humans with anxiety disorders. Despite these benefits, little is known about the mechanisms by which DCS promotes the loss of fear. The present study examined whether DCS augments extinction retention (1) through reductions…
Meir Drexler, Shira; Hamacher-Dang, Tanja C; Wolf, Oliver T
2017-05-01
In extinction learning, the individual learns that a previously acquired association (e.g. between a threat and its predictor) is no longer valid. This learning is the principle underlying many cognitive-behavioral psychotherapeutic treatments, e.g. 'exposure therapy'. However, extinction is often highly-context dependent, leading to renewal (relapse of extinguished conditioned response following context change). We have previously shown that post-extinction stress leads to a more context-dependent extinction memory in a predictive learning task. Yet as stress prior to learning can impair the integration of contextual cues, here we aim to create a more generalized extinction memory by inducing stress prior to extinction. Forty-nine men and women learned the associations between stimuli and outcomes in a predictive learning task (day 1), extinguished them shortly after an exposure to a stress/control condition (day 2), and were tested for renewal (day 3). No group differences were seen in acquisition and extinction learning, and a renewal effect was present in both groups. However, the groups differed in the strength and context-dependency of the extinction memory. Compared to the control group, the stress group showed an overall reduced recovery of responding to the extinguished stimuli, in particular in the acquisition context. These results, together with our previous findings, demonstrate that the effects of stress exposure on extinction memory depend on its timing. While post-extinction stress makes the memory more context-bound, pre-extinction stress strengthens its consolidation for the acquisition context as well, making it potentially more resistant to relapse. These results have implications for the use of glucocorticoids as extinction-enhancers in exposure therapy. Copyright © 2017 Elsevier Inc. All rights reserved.
Vagus nerve stimulation reduces cocaine seeking and alters plasticity in the extinction network.
Childs, Jessica E; DeLeon, Jaime; Nickel, Emily; Kroener, Sven
2017-01-01
Drugs of abuse cause changes in the prefrontal cortex (PFC) and associated regions that impair inhibitory control over drug-seeking. Breaking the contingencies between drug-associated cues and the delivery of the reward during extinction learning reduces rates of relapse. Here we used vagus nerve stimulation (VNS) to induce targeted synaptic plasticity to facilitate extinction of appetitive behaviors and to reduce relapse. Rats self-administered cocaine and were given VNS during extinction. Relapse to drug-seeking was assessed in a cued reinstatement session. We used immunohistochemistry to measure changes in the expression of the phosphorylated transcription factor cAMP response-element binding protein (pCREB) in the PFC and the basolateral amygdala (BLA), which regulate cue learning and extinction. In vivo recordings of evoked field potentials measured drug- and VNS-induced changes in metaplasticity in the pathway from the PFC to the BLA. VNS-treated rats showed improved rates of extinction and reduced reinstatement. Following reinstatement, pCREB levels were reduced in the IL and BLA of VNS-treated rats. Evoked responses in the BLA were greatly reduced in VNS-treated rats, and these rats were also resistant to the induction of LTD. Taken together, these results show that VNS facilitates extinction and reduces reinstatement. Changes in the pathway between the PFC and the amygdala may contribute to these beneficial effects. © 2016 Childs et al.; Published by Cold Spring Harbor Laboratory Press.
Vagus nerve stimulation reduces cocaine seeking and alters plasticity in the extinction network
Childs, Jessica E.; DeLeon, Jaime; Nickel, Emily
2017-01-01
Drugs of abuse cause changes in the prefrontal cortex (PFC) and associated regions that impair inhibitory control over drug-seeking. Breaking the contingencies between drug-associated cues and the delivery of the reward during extinction learning reduces rates of relapse. Here we used vagus nerve stimulation (VNS) to induce targeted synaptic plasticity to facilitate extinction of appetitive behaviors and to reduce relapse. Rats self-administered cocaine and were given VNS during extinction. Relapse to drug-seeking was assessed in a cued reinstatement session. We used immunohistochemistry to measure changes in the expression of the phosphorylated transcription factor cAMP response-element binding protein (pCREB) in the PFC and the basolateral amygdala (BLA), which regulate cue learning and extinction. In vivo recordings of evoked field potentials measured drug- and VNS-induced changes in metaplasticity in the pathway from the PFC to the BLA. VNS-treated rats showed improved rates of extinction and reduced reinstatement. Following reinstatement, pCREB levels were reduced in the IL and BLA of VNS-treated rats. Evoked responses in the BLA were greatly reduced in VNS-treated rats, and these rats were also resistant to the induction of LTD. Taken together, these results show that VNS facilitates extinction and reduces reinstatement. Changes in the pathway between the PFC and the amygdala may contribute to these beneficial effects. PMID:27980074
West, Elizabeth A.; Forcelli, Patrick A.; McCue, David L.; Malkova, Ludise
2013-01-01
The orbitofrontal cortex (OFC) is critical for behavioral adaptation in response to changes in reward value. Here we investigated, in rats, the role of OFC and, specifically, serotonergic neurotransmission within OFC in a reinforcer devaluation task (which measures behavioral flexibility). This task used two visual cues, each predicting one of two foods, with the spatial position (left-right) of the cues above two levers pseudorandomized across trials. An instrumental action (lever press) was required for reinforcer delivery. After training, rats received either excitotoxic OFC lesions made by NMDA (N-methyl-D-aspartic acid), serotonin-specific OFC lesions made by 5,7-DHT (5,7-dihydroxytryptamine), or sham lesions. In sham-lesioned rats, devaluation of one food (by feeding to satiety) significantly decreased responding to the cue associated with that food, when both cues were presented simultaneously during extinction. Both types of OFC lesions disrupted the devaluation effect. In contrast, extinction learning was not affected by serotonin-specific lesions and was only mildly retarded in rats with excitotoxic lesions. Thus, serotonin within OFC is necessary for appropriately adjusting behavior towards cues that predict reward but not for reducing responses in the absence of reward. Our results are the first to demonstrate that serotonin in OFC is necessary for reinforcer devaluation, but not extinction. PMID:23458741
West, Elizabeth A; Forcelli, Patrick A; McCue, David L; Malkova, Ludise
2013-06-01
The orbitofrontal cortex (OFC) is critical for behavioral adaptation in response to changes in reward value. Here we investigated, in rats, the role of OFC and, specifically, serotonergic neurotransmission within OFC in a reinforcer devaluation task (which measures behavioral flexibility). This task used two visual cues, each predicting one of two foods, with the spatial position (left-right) of the cues above two levers pseudorandomized across trials. An instrumental action (lever press) was required for reinforcer delivery. After training, rats received either excitotoxic OFC lesions made by NMDA (N-methyl-d-aspartic acid), serotonin-specific OFC lesions made by 5,7-DHT (5,7-dihydroxytryptamine), or sham lesions. In sham-lesioned rats, devaluation of one food (by feeding to satiety) significantly decreased responding to the cue associated with that food, when both cues were presented simultaneously during extinction. Both types of OFC lesions disrupted the devaluation effect. In contrast, extinction learning was not affected by serotonin-specific lesions and was only mildly retarded in rats with excitotoxic lesions. Thus, serotonin within OFC is necessary for appropriately adjusting behavior toward cues that predict reward but not for reducing responses in the absence of reward. Our results are the first to demonstrate that serotonin in OFC is necessary for reinforcer devaluation, but not extinction. Copyright © 2013 Elsevier B.V. All rights reserved.
Extinction and renewal of cue-elicited reward-seeking.
Bezzina, Louise; Lee, Jessica C; Lovibond, Peter F; Colagiuri, Ben
2016-12-01
Reward cues can contribute to overconsumption of food and drugs and can relapse. The failure of exposure therapies to reduce overconsumption and relapse is generally attributed to the context-specificity of extinction. However, no previous study has examined whether cue-elicited reward-seeking (as opposed to cue-reactivity) is sensitive to context renewal. We tested this possibility in 160 healthy volunteers using a Pavlovian-instrumental transfer (PIT) design involving voluntary responding for a high value natural reward (chocolate). One reward cue underwent Pavlovian extinction in the same (Group AAA) or different context (Group ABA) to all other phases. This cue was compared with a second non-extinguished reward cue and an unpaired control cue. There was a significant overall PIT effect with both reward cues eliciting reward-seeking on test relative to the unpaired cue. Pavlovian extinction substantially reduced this effect, with the extinguished reward cue eliciting less reward-seeking than the non-extinguished reward cue. Most interestingly, extinction of cue-elicited reward-seeking was sensitive to renewal, with extinction less effective for reducing PIT when conducted in a different context. These findings have important implications for extinction-based interventions for reducing maladaptive reward-seeking in practice. Copyright © 2016 Elsevier Ltd. All rights reserved.
Acute stress impairs the retrieval of extinction memory in humans
Raio, Candace M.; Brignoni-Perez, Edith; Goldman, Rachel; Phelps, Elizabeth A.
2014-01-01
Extinction training is a form of inhibitory learning that allows an organism to associate a previously aversive cue with a new, safe outcome. Extinction does not erase a fear association, but instead creates a competing association that may or may not be retrieved when a cue is subsequently encountered. Characterizing the conditions under which extinction learning is expressed is important to enhancing the treatment of anxiety disorders that rely on extinction-based exposure therapy as a primary treatment technique. The ventromedial prefrontal cortex, which plays an important role in the expression of extinction memory, has been shown to be functionally impaired after stress exposure. Further, recent research in rodents found that exposure to stress led to deficits in extinction retrieval, although this has yet to be tested in humans. To explore how stress might influence extinction retrieval in humans, participants underwent a differential aversive learning paradigm, in which one image was probabilistically paired with an aversive shock while the other image denoted safety. Extinction training directly followed, at which point reinforcement was omitted. A day later, participants returned to the lab and either completed an acute stress manipulation (i.e., cold pressor), or a control task, before undergoing an extinction retrieval test. Skin conductance responses and salivary cortisol concentrations were measured throughout each session as indices of fear arousal and neuroendocrine stress responses, respectively. The efficacy of our stress induction was established by observing significant increases in cortisol for the stress condition only. We examined extinction retrieval by comparing conditioned responses during the last trial of extinction (day 1) with that of the first trial of re-extinction (day 2). Groups did not differ on initial fear acquisition or extinction, however, one day later participants in the stress group (n = 27) demonstrated significantly less extinction retrieval (i.e., greater fear recovery) than those in the control group (n = 25). Our results suggest that acute stress impairs extinction memory retrieval and offers insight into why treatment strategies used in the clinic may be challenging to recruit in daily life where stress is pervasive. PMID:24508065
Postretrieval Extinction Attenuates Alcohol Cue Reactivity in Rats.
Cofresí, Roberto U; Lewis, Suzanne M; Chaudhri, Nadia; Lee, Hongjoo J; Monfils, Marie-H; Gonzales, Rueben A
2017-03-01
Conditioned responses to alcohol-associated cues can hinder recovery from alcohol use disorder (AUD). Cue exposure (extinction) therapy (CET) can reduce reactivity to alcohol cues, but its efficacy is limited by phenomena such as spontaneous recovery and reinstatement that can cause a return of conditioned responding after extinction. Using a preclinical model of alcohol cue reactivity in rats, we evaluated whether the efficacy of alcohol CET could be improved by conducting CET during the memory reconsolidation window after retrieval of cue-alcohol associations. Rats were provided with intermittent access to unsweetened alcohol. Rats were then trained to predict alcohol access based on a visual cue. Next, rats were treated with either standard extinction (n = 14) or postretrieval extinction (n = 13). Rats were then tested for long-term memory of extinction and susceptibility to spontaneous recovery and reinstatement. Despite equivalent extinction, rats treated with postretrieval extinction exhibited reduced spontaneous recovery and reinstatement relative to rats treated with standard extinction. Postretrieval CET shows promise for persistently attenuating the risk to relapse posed by alcohol cues in individuals with AUD. Copyright © 2017 by the Research Society on Alcoholism.
POST-RETRIEVAL EXTINCTION ATTENUATES ALCOHOL CUE REACTIVITY IN RATS
Cofresí, Roberto U.; Lewis, Suzanne M.; Chaudhri, Nadia; Lee, Hongjoo J.; Monfils, Marie-H.; Gonzales, Rueben A.
2017-01-01
BACKGROUND Conditioned responses to alcohol-associated cues can hinder recovery from alcohol use disorder (AUD). Cue exposure (extinction) therapy (CET) can reduce reactivity to alcohol cues, but its efficacy is limited by phenomena such as spontaneous recovery and reinstatement that can cause a return of conditioned responding after extinction. Using a preclinical model of alcohol cue reactivity in rats, we evaluated whether the efficacy of alcohol CET could be improved by conducting CET during the memory reconsolidation window after retrieval of a cue-alcohol association. METHODS Rats were provided with intermittent access to unsweetened alcohol. Rats were then trained to predict alcohol access based on a visual cue. Next, rats were treated with either standard extinction (n=14) or post-retrieval extinction (n=13). Rats were then tested for long-term memory of extinction and susceptibility to spontaneous recovery and reinstatement. RESULTS Despite equivalent extinction, rats treated with post-retrieval extinction exhibited reduced spontaneous recovery and reinstatement relative to rats treated with standard extinction. CONCLUSIONS Post-retrieval CET shows promise for persistently attenuating the risk to relapse posed by alcohol cues in individuals with AUD. PMID:28169439
Stasiewicz, Paul R.; Brandon, Thomas H.; Bradizza, Clara M.
2013-01-01
Pavlovian conditioning models have led to cue-exposure treatments for drug abuse. However, conditioned responding to drug stimuli can return (be renewed) following treatment. Animal research and a previous study of social drinkers indicated that extinction is highly context dependent but that renewal could be reduced by the inclusion of a cue from the extinction context. This study extends this research to a clinical sample. Alcohol-dependent outpatients (N = 143) completed an extinction trial to reduce craving and salivation responses to alcohol cues. They were then randomized to renewal tests in either the same context as extinction, a different context, the different context containing an extinction cue, or the different context with cue plus a manipulation to increase the salience of the cue. Contrary to predictions, the different context did not produce the expected renewal effect. Although the generalization of extinction effects beyond the cue-exposure context is a positive clinical finding, it is inconsistent with basic research findings on the context dependence of extinction. Possible explanations for this inconsistency are discussed. PMID:17563145
Stasiewicz, Paul R; Brandon, Thomas H; Bradizza, Clara M
2007-06-01
Pavlovian conditioning models have led to cue-exposure treatments for drug abuse. However, conditioned responding to drug stimuli can return (be renewed) following treatment. Animal research and a previous study of social drinkers indicated that extinction is highly context dependent but that renewal could be reduced by the inclusion of a cue from the extinction context. This study extends this research to a clinical sample. Alcohol-dependent outpatients (N = 143) completed an extinction trial to reduce craving and salivation responses to alcohol cues. They were then randomized to renewal tests in either the same context as extinction, a different context, the different context containing an extinction cue, or the different context with cue plus a manipulation to increase the salience of the cue. Contrary to predictions, the different context did not produce the expected renewal effect. Although the generalization of extinction effects beyond the cue-exposure context is a positive clinical finding, it is inconsistent with basic research findings on the context dependence of extinction. Possible explanations for this inconsistency are discussed.
Leite-Morris, Kimberly A; Kobrin, Kendra L; Guy, Marsha D; Young, Angela J; Heinrichs, Stephen C; Kaplan, Gary B
2014-04-15
Recurrent opiate use combined with environmental cues, in which the drug was administered, provokes cue-induced drug craving and conditioned drug reward. Drug abuse craving is frequently linked with stimuli from a prior drug-taking environment via classical conditioning and associative learning. We modeled the conditioned morphine reward process by using acquisition and extinction of conditioned place preference (CPP) in C57BL/6 mice. Mice were trained to associate a morphine injection with a drug context using a classical conditioning paradigm. In morphine conditioning (0, 0.25, 0.5, 1, 5, or 10 mg/kg) experimental mice acquired a morphine CPP dose response with 10mg/kg as most effective. During morphine CPP extinction experiments, mice were divided into three test groups: morphine CPP followed by extinction training, morphine CPP followed by sham extinction, and saline controls. Extinction of morphine CPP developed within one extinction experiment (4 days) that lasted over two more trials (another 8 days). However, the morphine CPP/sham extinction group retained a place preference that endured through all three extinction trials. Brains were harvested following CPP extinction and processed using Golgi-Cox impregnation. Changes in dendritic morphology and spine quantity were examined in the nucleus accumbens (NAc) Core and Shell neurons. In the NAcCore only, morphine CPP/extinguished mice produced less dendritic arborization, and a decrease in neuronal activity marker c-Fos compared to the morphine CPP/sham extinction group. Extinction of morphine CPP is associated with decreased structural complexity of dendrites in the NAcCore and may represent a substrate for learning induced structural plasticity relevant to addiction. Published by Elsevier B.V.
In Search for Boundary Conditions of Reconsolidation: A Failure of Fear Memory Interference
Schroyens, Natalie; Beckers, Tom; Kindt, Merel
2017-01-01
The presentation of a fear memory cue can result in mere memory retrieval, destabilization of the reactivated memory trace, or the formation of an extinction memory. The interaction between the degree of novelty during reactivation and previous learning conditions is thought to determine the outcome of a reactivation session. This study aimed to evaluate whether contextual novelty can prevent cue-induced destabilization and disruption of a fear memory acquired by non-asymptotic learning. To this end, fear memory was reactivated in a novel context or in the original context of learning, and fear memory reactivation was followed by the administration of propranolol, an amnestic drug. Remarkably, fear memory was not impaired by post-reactivation propranolol administration or extinction training under the usual conditions used in our lab, irrespective of the reactivation context. These unexpected findings are discussed in the light of our current experimental parameters and alleged boundary conditions on memory destabilization. PMID:28469565
Vagus Nerve Stimulation Reduces Cocaine Seeking and Alters Plasticity in the Extinction Network
ERIC Educational Resources Information Center
Childs, Jessica E.; DeLeon, Jaime; Nickel, Emily; Kroener, Sven
2017-01-01
Drugs of abuse cause changes in the prefrontal cortex (PFC) and associated regions that impair inhibitory control over drug-seeking. Breaking the contingencies between drug-associated cues and the delivery of the reward during extinction learning reduces rates of relapse. Here we used vagus nerve stimulation (VNS) to induce targeted synaptic…
Buffalari, Deanne M; Feltenstein, Matthew W; See, Ronald E
2013-11-01
Cue exposure therapy, which attempts to limit relapse by reducing reactivity to cocaine-paired cues through repeated exposures, has had limited success. The current experiments examined cocaine cue-induced anxiogenesis and investigated whether a model of cue exposure therapy would reduce reinstatement of cocaine seeking in rats with a history of cocaine self-administration. Male rats experienced daily intravenous cocaine self-administration. Rats then experienced exposure to either the self-administration context or the context plus noncontingent presentations of cocaine-paired cues. Immediately following exposure, anxiety-like behavior was measured using elevated plus maze and defensive burying tests. In a second group of rats, self-administration was followed by 7 days of exposure to the context, context + noncontingent cue exposure, lever extinction, or cue + lever extinction. All animals then underwent two contingent cue-induced reinstatement tests separated by 7 days of lever extinction. Exposure to noncontingent cocaine-paired cues in the self-administration context increased anxiety-like behavior on the defensive burying test. Animals that experienced lever + cue extinction displayed the least cocaine seeking on the first reinstatement test, and lever extinction reduced cocaine seeking below context exposure or context + noncontingent cue exposure. All animals had similar levels of cocaine seeking on the second reinstatement test. Noncontingent cue exposure causes anxiety, and noncontingent cue and context exposure are less effective at reducing contingent cue-induced reinstatement than lever or lever + cue extinction. These data indicate that active extinction of the drug-taking response may be critical for reduction of relapse proclivity in former cocaine users.
Social modulation of associative fear learning by pheromone communication
Bredy, Timothy W.; Barad, Mark
2009-01-01
Mice communicate through visual, vocal, and olfactory cues that influence innate, nonassociative behavior. We here report that exposure to a recently fear-conditioned familiar mouse impairs acquisition of conditioned fear and facilitates fear extinction, effects mimicked by both an olfactory chemosignal emitted by a recently fear-conditioned familiar mouse and by the putative stress-related anxiogenic pheromone β-phenylethylamine (β-PEA). Together, these findings suggest social modulation of higher-order cognitive processing through pheromone communication and support the concurrent excitor hypothesis of extinction learning. PMID:19117912
Social modulation of associative fear learning by pheromone communication.
Bredy, Timothy W; Barad, Mark
2009-01-01
Mice communicate through visual, vocal, and olfactory cues that influence innate, nonassociative behavior. We here report that exposure to a recently fear-conditioned familiar mouse impairs acquisition of conditioned fear and facilitates fear extinction, effects mimicked by both an olfactory chemosignal emitted by a recently fear-conditioned familiar mouse and by the putative stress-related anxiogenic pheromone beta-phenylethylamine (beta-PEA). Together, these findings suggest social modulation of higher-order cognitive processing through pheromone communication and support the concurrent excitor hypothesis of extinction learning.
Suppression of Striatal Prediction Errors by the Prefrontal Cortex in Placebo Hypoalgesia.
Schenk, Lieven A; Sprenger, Christian; Onat, Selim; Colloca, Luana; Büchel, Christian
2017-10-04
Classical learning theories predict extinction after the discontinuation of reinforcement through prediction errors. However, placebo hypoalgesia, although mediated by associative learning, has been shown to be resistant to extinction. We tested the hypothesis that this is mediated by the suppression of prediction error processing through the prefrontal cortex (PFC). We compared pain modulation through treatment cues (placebo hypoalgesia, treatment context) with pain modulation through stimulus intensity cues (stimulus context) during functional magnetic resonance imaging in 48 male and female healthy volunteers. During acquisition, our data show that expectations are correctly learned and that this is associated with prediction error signals in the ventral striatum (VS) in both contexts. However, in the nonreinforced test phase, pain modulation and expectations of pain relief persisted to a larger degree in the treatment context, indicating that the expectations were not correctly updated in the treatment context. Consistently, we observed significantly stronger neural prediction error signals in the VS in the stimulus context compared with the treatment context. A connectivity analysis revealed negative coupling between the anterior PFC and the VS in the treatment context, suggesting that the PFC can suppress the expression of prediction errors in the VS. Consistent with this, a participant's conceptual views and beliefs about treatments influenced the pain modulation only in the treatment context. Our results indicate that in placebo hypoalgesia contextual treatment information engages prefrontal conceptual processes, which can suppress prediction error processing in the VS and lead to reduced updating of treatment expectancies, resulting in less extinction of placebo hypoalgesia. SIGNIFICANCE STATEMENT In aversive and appetitive reinforcement learning, learned effects show extinction when reinforcement is discontinued. This is thought to be mediated by prediction errors (i.e., the difference between expectations and outcome). Although reinforcement learning has been central in explaining placebo hypoalgesia, placebo hypoalgesic effects show little extinction and persist after the discontinuation of reinforcement. Our results support the idea that conceptual treatment beliefs bias the neural processing of expectations in a treatment context compared with a more stimulus-driven processing of expectations with stimulus intensity cues. We provide evidence that this is associated with the suppression of prediction error processing in the ventral striatum by the prefrontal cortex. This provides a neural basis for persisting effects in reinforcement learning and placebo hypoalgesia. Copyright © 2017 the authors 0270-6474/17/379715-09$15.00/0.
Boutelle, Kerri N; Liang, June; Knatz, Stephanie; Matheson, Brittany; Risbrough, Victoria; Strong, David; Rhee, Kyung E; Craske, Michelle G; Zucker, Nancy; Bouton, Mark E
2015-01-01
Obesity and its health sequelae affect a significant portion of children in the United States. Yet, the current gold-standard family-based behavioral weight-loss treatments are only effective for one-third of children long-term. Therefore, we developed iROC (Intervention for Regulation of Cues) to specifically target a method to decrease overeating in overweight children, based on learning theory, to inform and enhance interventions targeting diet and obesity in youth. This study will rigorously test extinction processes as a method of decreasing physiological and psychological responses to food cues in overweight and obese children. Through exposing children to their highly craved foods, and 'training the brain and body' to decrease overeating, we are hoping to produce longer-lasting weight loss or weight-gain prevention over time. Copyright © 2014 Elsevier Inc. All rights reserved.
A reminder of extinction reduces relapse in an animal model of voluntary behavior.
Nieto, Javier; Uengoer, Metin; Bernal-Gamboa, Rodolfo
2017-02-01
One experiment with rats explored whether an extinction-cue prevents the recovery of extinguished lever-pressing responses. Initially, rats were trained to perform one instrumental response (R1) for food in Context A, and a different instrumental response (R2) in Context B. Then, responses were extinguished each in the alternate context (R1 in Context B; R2 in Context A). For one group, extinction of both responses was conducted in the presence of an extinction-cue, whereas in a second group, the extinction-cue only accompanied extinction of R1. During a final test, we observed that returning the rats to the initial acquisition context renewed performance and that response recovery was attenuated in the presence of the cue that accompanied extinction of the response. The impact of the extinction-cue, however, was not transferred to the response that has been extinguished without the cue. Our results are consistent with the idea that extinction established an inhibitory cue-response association. © 2017 Nieto et al.; Published by Cold Spring Harbor Laboratory Press.
Learning and the persistence of appetite: extinction and the motivation to eat and overeat.
Bouton, Mark E
2011-04-18
The modern world is saturated with highly palatable and highly available food, providing many opportunities to associate food with environmental cues and actions (through Pavlovian and operant or instrumental learning, respectively). Basic learning processes can often increase the tendency to approach and consume food, whereas extinction, in which Pavlovian and operant behaviors decline when the reinforcer is withheld, weakens but does not erase those tendencies. Contemporary research suggests that extinction involves an inhibitory form of new learning that appears fragile because it is highly dependent on the context for expression. These ideas are supported by the phenomena of renewal, spontaneous recovery, resurgence, reinstatement, and rapid reacquisition in appetitive learning, which together may help explain why overeating may be difficult to suppress permanently, and why appetitive behavior may seem so persistent. Copyright © 2010. Published by Elsevier Inc.
Implications of learning theory for developing programs to decrease overeating
Boutelle, Kerri N.; Bouton, Mark E.
2015-01-01
Childhood obesity is associated with medical and psychological comorbidities, and interventions targeting overeating could be pragmatic and have a significant impact on weight. Calorically dense foods are easily available, variable, and tasty which allows for effective opportunities to learn to associate behaviors and cues in the environment with food through fundamental conditioning processes, resulting in measurable psychological and physiological food cue reactivity in vulnerable children. Basic research suggests that initial learning is difficult to erase, and that it is vulnerable to a number of phenomena that will allow the original learning to re-emerge after it is suppressed or replaced. These processes may help explain why it may be difficult to change food cue reactivity and overeating over the long term. Extinction theory may be used to develop effective cue-exposure treatments to decrease food cue reactivity through inhibitory learning, although these processes are complex and require an integral understanding of the theory and individual differences. Additionally, learning theory can be used to develop other interventions that may prove to be useful. Through an integration of learning theory, basic and translational research, it may be possible to develop interventions that can decrease the urges to overeat, and improve the weight status of children. PMID:25998235
Williams, Keith L.; Harding, Kaitlyn M.
2014-01-01
Cues associated with alcohol can stimulate subjective states that increase relapse. Alcohol-cue associations may be strengthened by enhancing adrenergic activity with yohimbine or weakened by blocking adrenergic activity with propranolol. Alcohol-cue associations may also be weakened by long cue exposure sessions or strengthened by short cue exposure sessions. A useful treatment approach for alcoholism may combine adrenergic manipulation with cue exposure sessions of a specific duration. The present study sought to determine if cue exposure during long- or short-duration extinction sessions with post-session yohimbine or propranolol would alter alcohol cue-induced responding and self-administration. Rats were trained to respond for alcohol during sessions that included an olfactory cue given at the beginning of the session and a visual/auditory cue complex delivered concurrently with alcohol. Cue-induced responding was assessed before and after the repeated extinction sessions. Repeated alcohol extinction sessions of long duration (45 min) or short duration (5 min) were followed immediately by injections of saline, yohimbine, or propranolol. After the second set of cue-induced responding tests, reacquisition of operant alcohol self-administration was examined. To determine if the experimental procedures were sensitive to memory manipulation through other pharmacological mechanisms, the NMDA receptor antagonist MK-801 was given 20 min prior to long-duration extinction sessions. Both the long- and short-duration extinction sessions decreased cue-induced responding. Neither yohimbine nor propranolol, given post-session, had subsequent effects on cue-induced responding or alcohol self-administration. MK-801 blocked the effect of extinction sessions on cue-induced responding but had no effect on self-administration. The present study shows that manipulation of the NMDA system in combination with alcohol cue exposure therapy during extinction-like sessions may be more effective than manipulation of the adrenergic system in reducing the strength of alcohol-cue associations in this specific model of alcohol relapse. PMID:24269546
Oxytocin differentially modulates pavlovian cue and context fear acquisition.
Cavalli, Juliana; Ruttorf, Michaela; Pahi, Mario Rosero; Zidda, Francesca; Flor, Herta; Nees, Frauke
2017-06-01
Fear acquisition and extinction have been demonstrated as core mechanisms for the development and maintenance of mental disorders, with different contributions of processing cues vs contexts. The hypothalamic peptide oxytocin (OXT) may have a prominent role in this context, as it has been shown to affect fear learning. However, investigations have focused on cue conditioning, and fear extinction. Its differential role for cue and context fear acquisition is still not known. In a randomized, double-blind, placebo (PLC)-controlled design, we administered an intranasal dose of OXT or PLC before the acquisition of cue and context fear conditioning in healthy individuals (n = 52), and assessed brain responses, skin conductance responses and self-reports (valence/arousal/contingency). OXT compared with PLC significantly induced decreased responses in the nucleus accumbens during early cue and context acquisition, and decreased responses of the anterior cingulate cortex and insula during early as well as increased hippocampal response during late context, but not cue acquisition. The OXT group additionally showed significantly higher arousal in late cue and context acquisition. OXT modulates various aspects of cue and context conditioning, which is relevant from a mechanism-based perspective and might have implications for the treatment of fear and anxiety. © The Author (2017). Published by Oxford University Press.
Temporal factors in the extinction of fear in inbred mouse strains differing in extinction efficacy.
MacPherson, Kathryn; Whittle, Nigel; Camp, Marguerite; Gunduz-Cinar, Ozge; Singewald, Nicolas; Holmes, Andrew
2013-07-05
Various neuropsychiatric conditions, including posttraumatic stress disorder (PTSD), are characterized by deficient fear extinction, but individuals differ greatly in risk for these. While there is growing evidence that fear extinction is influenced by certain procedural variables, it is unclear how these influences might vary across individuals and subpopulations. To model individual differences in fear extinction, prior studies identified a strain of inbred mouse, 129S1/SvImJ (S1), which exhibits a profound deficit in fear extinction, as compared to other inbred strains, such as C57BL/6J (B6). Here, we assessed the effects of procedural variables on the impaired extinction phenotype of the S1 strain and, by comparison, the extinction-intact B6 strain. The variables studied were 1) the interval between conditioning and extinction, 2) the interval between cues during extinction training, 3) single-cue exposure before extinction training, and 4) extinction of a second-order conditioned cue. Conducting extinction training soon after ('immediately') conditioning attenuated fear retrieval in S1 mice and impaired extinction in B6 mice. Spacing cue presentations with long inter-trial intervals during extinction training augmented fear in S1 and B6 mice. The effect of spacing was lost with one-trial fear conditioning in B6, but not S1 mice. A single exposure to a conditioned cue before extinction training did not alter extinction retrieval, either in B6 or S1 mice. Both the S1 and B6 strains exhibited robust second-order fear conditioning, in which a cue associated with footshock was sufficient to serve as a conditioned exciter to condition a fear association to a second cue. B6 mice extinguished the fear response to the second-order conditioned cue, but S1 mice failed to do so. These data provide further evidence that fear extinction is strongly influenced by multiple procedural variables and is so in a highly strain-dependent manner. This suggests that the efficacy of extinction-based behavioral interventions, such as exposure therapy, for trauma-related anxiety disorders will be determined by the procedural parameters employed and the degree to which the patient can extinguish.
Gauthier, Jamie M; Lin, Amy; Nic Dhonnchadha, Bríd Á; Spealman, Roger D; Man, Heng-Ye; Kantak, Kathleen M
2017-01-01
This study investigated the combination of environmental enrichment (EE) with cocaine-cue extinction training on reacquisition of cocaine self-administration. Rats were trained under a second-order schedule for which responses were maintained by cocaine injections and cocaine-paired stimuli. During three weekly extinction sessions, saline was substituted for cocaine but cocaine-paired stimuli were presented. Rats received 4-h periods of EE at strategic time points during extinction training, or received NoEE. Additional control rats received EE or NoEE without extinction training. One week later, reacquisition of cocaine self-administration was evaluated for 15 sessions, and then GluA1 expression, a cellular substrate for learning and memory, was measured in selected brain regions. EE provided both 24 h before and immediately after extinction training facilitated extinction learning and deterred reacquisition of cocaine self-administration for up to 13 sessions. Each intervention by itself (EE alone or extinction alone) was ineffective, as was EE scheduled at individual time points (EE 4 h or 24 h before, or EE immediately or 6 h after, each extinction training session). Under these conditions, rats rapidly reacquired baseline rates of cocaine self-administration. Cocaine self-administration alone decreased total GluA1 and/or pSer845GluA1 expression in basolateral amygdala and nucleus accumbens. Extinction training, with or without EE, opposed these changes and also increased total GluA1 in ventromedial prefrontal cortex and dorsal hippocampus. EE alone increased pSer845GluA1 and EE combined with extinction training decreased pSer845GluA1 in ventromedial prefrontal cortex. EE might be a useful adjunct to extinction therapy by enabling neuroplasticity that deters relapse to cocaine self-administration. © 2015 Society for the Study of Addiction.
Caloric restriction enhances fear extinction learning in mice.
Riddle, Megan C; McKenna, Morgan C; Yoon, Yone J; Pattwell, Siobhan S; Santos, Patricia Mae G; Casey, B J; Glatt, Charles E
2013-05-01
Fear extinction learning, the ability to reassess a learned cue of danger as safe when it no longer predicts aversive events, is often dysregulated in anxiety disorders. Selective serotonin reuptake inhibitors (SSRI's) enhance neural plasticity and their ability to enhance fear extinction learning may explain their anxiolytic properties. Caloric restriction (CR) has SSRI-like effects on neural plasticity and anxiety-related behavior. We implemented CR in mice to determine its effects on conditioned-fear responses. Wild type and serotonin transporter (SERT) knockout mice underwent CR for 7 days leading to significant weight loss. Mice were then tested for cued fear learning and anxiety-related behavior. CR markedly enhanced fear extinction learning and its retention in adolescent female mice, and adults of both sexes. These effects of CR were absent in SERT knockout mice. Moreover, CR phenocopied behavioral and molecular effects of chronic fluoxetine, but there was no additive effect of CR in fluoxetine-treated mice. These results demonstrate that CR enhances fear extinction learning through a SERT-dependent mechanism. These results may have implications for eating disorders such as anorexia nervosa (AN), in which there is a high prevalence of anxiety before the onset of dietary restriction and support proposals that in AN, CR is a motivated effort to control dysregulated fear responses and elevated anxiety.
Age and adolescent social stress effects on fear extinction in female rats.
McCormick, C M; Mongillo, D L; Simone, J J
2013-11-01
We previously observed that social instability stress (SS: daily 1 h isolation and change of cage partners for 16 days) in adolescence, but not in adulthood, decreased context and cue memory after fear conditioning in male rats. Effects of stress are typically sex-specific, and so here we investigated adolescent and adult SS effects in females on the strength of acquired contextual and cued fear conditioning, as well as extinction learning, beginning either the day after the stress procedure or four weeks later. For SS in adolescence, SS females spent more time freezing (fear measure) during extinction than did controls, whereas SS in adulthood had no effect on any measure of fear conditioning. The results also indicated an effect of age: females in late adolescence show more rapid extinction of cue and better memory of extinction of context compared to adult females, which may indicate resilience to acute footshock in adolescence. Thus fear circuitry continues to mature into late adolescence, which may underlie the heightened plasticity in response to chronic stressors of adolescents compared to adults.
2-arachidonoylglycerol signaling impairs short-term fear extinction
Hartley, N D; Gunduz-Cinar, O; Halladay, L; Bukalo, O; Holmes, A; Patel, S
2016-01-01
Impairments in fear extinction are thought to be central to the psychopathology of posttraumatic stress disorder, and endocannabinoid (eCB) signaling has been strongly implicated in extinction learning. Here we utilized the monoacylglycerol lipase inhibitor JZL184 to selectively augment brain 2-AG levels combined with an auditory cue fear-conditioning paradigm to test the hypothesis that 2-AG-mediated eCB signaling modulates short-term fear extinction learning in mice. We show that systemic JZL184 impairs short-term extinction learning in a CB1 receptor-dependent manner without affecting non-specific freezing behavior or the acquisition of conditioned fear. This effect was also observed in over-conditioned mice environmentally manipulated to re-acquire fear extinction. Cumulatively, the effects of JZL184 appear to be partly due to augmentation of 2-AG signaling in the basolateral nucleus of the amygdala (BLA), as direct microinfusion of JZL184 into the BLA produced similar results. Moreover, we elucidate a short ~3-day temporal window during which 2-AG augmentation impairs extinction behavior, suggesting a preferential role for 2-AG-mediated eCB signaling in the modulation of short-term behavioral sequelae to acute traumatic stress exposure. PMID:26926885
Icenhour, A; Langhorst, J; Benson, S; Schlamann, M; Hampel, S; Engler, H; Forsting, M; Elsenbruch, S
2015-01-01
Altered pain anticipation likely contributes to disturbed central pain processing in chronic pain conditions like irritable bowel syndrome (IBS), but the learning processes shaping the expectation of pain remain poorly understood. We assessed the neural circuitry mediating the formation, extinction, and reactivation of abdominal pain-related memories in IBS patients compared to healthy controls (HC) in a differential fear conditioning paradigm. During fear acquisition, predictive visual cues (CS(+)) were paired with rectal distensions (US), while control cues (CS(-)) were presented unpaired. During extinction, only CSs were presented. Subsequently, memory reactivation was assessed with a reinstatement procedure involving unexpected USs. Using functional magnetic resonance imaging, group differences in neural activation to CS(+) vs CS(-) were analyzed, along with skin conductance responses (SCR), CS valence, CS-US contingency, state anxiety, salivary cortisol, and alpha-amylase activity. The contribution of anxiety symptoms was addressed in covariance analyses. Fear acquisition was altered in IBS, as indicated by more accurate contingency awareness, greater CS-related valence change, and enhanced CS(+)-induced differential activation of prefrontal cortex and amygdala. IBS patients further revealed enhanced differential cingulate activation during extinction and greater differential hippocampal activation during reinstatement. Anxiety affected neural responses during memory formation and reinstatement. Abdominal pain-related fear learning and memory processes are altered in IBS, mediated by amygdala, cingulate cortex, prefrontal areas, and hippocampus. Enhanced reinstatement may contribute to hypervigilance and central pain amplification, especially in anxious patients. Preventing a 'relapse' of learned fear utilizing extinction-based interventions may be a promising treatment goal in IBS. © 2014 John Wiley & Sons Ltd.
Integration of contextual cues into memory depends on "prefrontal" N-methyl-D-aspartate receptors.
Starosta, Sarah; Bartetzko, Isabelle; Stüttgen, Maik C; Güntürkün, Onur
2017-10-01
Every learning event is embedded in a context, but not always does the context become an integral part of the memory; however, for extinction learning it usually does, resulting in context-specific conditioned responding. The neuronal mechanisms underlying contextual control have been mainly investigated for Pavlovian fear extinction with a focus on hippocampal structures. However, the initial acquisition of novel responses can be subject to contextual control as well, although the neuronal mechanisms are mostly unknown. Here, we tested the hypothesis that contextual control of acquisition depends on glutamatergic transmission underlying executive functions in forebrain areas, e.g. by shifting attention to critical cues. Thus, we antagonized N-methyl-D-aspartate (NMDA) receptors with 2-amino-5-phosphonovaleric acid (AP5) in the pigeon nidopallium caudolaterale, the functional analogue of mammalian prefrontal cortex, during the concomitant acquisition and extinction of conditioned responding to two different stimuli. This paradigm has previously been shown to lead to contextual control over extinguished as well as non-extinguished responding. NMDA receptor blockade resulted in an impairment of extinction learning, but left the acquisition of responses to a novel stimulus unaffected. Critically, when responses were tested in a different context in the retrieval phase, we observed that NMDA receptor blockade led to the abolishment of contextual control over acquisition performance. This result is predicted by a model describing response inclination as the product of associative strength and contextual gain. In this model, learning under AP5 leads to a change in the contextual gain on the learned association, possibly via the modulation of attentional mechanisms. Copyright © 2017 Elsevier Inc. All rights reserved.
Implications of learning theory for developing programs to decrease overeating.
Boutelle, Kerri N; Bouton, Mark E
2015-10-01
Childhood obesity is associated with medical and psychological comorbidities, and interventions targeting overeating could be pragmatic and have a significant impact on weight. Calorically dense foods are easily available, variable, and tasty which allows for effective opportunities to learn to associate behaviors and cues in the environment with food through fundamental conditioning processes, resulting in measurable psychological and physiological food cue reactivity in vulnerable children. Basic research suggests that initial learning is difficult to erase, and that it is vulnerable to a number of phenomena that will allow the original learning to re-emerge after it is suppressed or replaced. These processes may help explain why it may be difficult to change food cue reactivity and overeating over the long term. Extinction theory may be used to develop effective cue-exposure treatments to decrease food cue reactivity through inhibitory learning, although these processes are complex and require an integral understanding of the theory and individual differences. Additionally, learning theory can be used to develop other interventions that may prove to be useful. Through an integration of learning theory, basic and translational research, it may be possible to develop interventions that can decrease the urges to overeat, and improve the weight status of children. Copyright © 2015 Elsevier Ltd. All rights reserved.
Temporal factors in the extinction of fear in inbred mouse strains differing in extinction efficacy
2013-01-01
Background Various neuropsychiatric conditions, including posttraumatic stress disorder (PTSD), are characterized by deficient fear extinction, but individuals differ greatly in risk for these. While there is growing evidence that fear extinction is influenced by certain procedural variables, it is unclear how these influences might vary across individuals and subpopulations. To model individual differences in fear extinction, prior studies identified a strain of inbred mouse, 129S1/SvImJ (S1), which exhibits a profound deficit in fear extinction, as compared to other inbred strains, such as C57BL/6J (B6). Methods Here, we assessed the effects of procedural variables on the impaired extinction phenotype of the S1 strain and, by comparison, the extinction-intact B6 strain. The variables studied were 1) the interval between conditioning and extinction, 2) the interval between cues during extinction training, 3) single-cue exposure before extinction training, and 4) extinction of a second-order conditioned cue. Results Conducting extinction training soon after (‘immediately’) conditioning attenuated fear retrieval in S1 mice and impaired extinction in B6 mice. Spacing cue presentations with long inter-trial intervals during extinction training augmented fear in S1 and B6 mice. The effect of spacing was lost with one-trial fear conditioning in B6, but not S1 mice. A single exposure to a conditioned cue before extinction training did not alter extinction retrieval, either in B6 or S1 mice. Both the S1 and B6 strains exhibited robust second-order fear conditioning, in which a cue associated with footshock was sufficient to serve as a conditioned exciter to condition a fear association to a second cue. B6 mice extinguished the fear response to the second-order conditioned cue, but S1 mice failed to do so. Conclusions These data provide further evidence that fear extinction is strongly influenced by multiple procedural variables and is so in a highly strain-dependent manner. This suggests that the efficacy of extinction-based behavioral interventions, such as exposure therapy, for trauma-related anxiety disorders will be determined by the procedural parameters employed and the degree to which the patient can extinguish. PMID:23830244
An instance theory of associative learning.
Jamieson, Randall K; Crump, Matthew J C; Hannah, Samuel D
2012-03-01
We present and test an instance model of associative learning. The model, Minerva-AL, treats associative learning as cued recall. Memory preserves the events of individual trials in separate traces. A probe presented to memory contacts all traces in parallel and retrieves a weighted sum of the traces, a structure called the echo. Learning of a cue-outcome relationship is measured by the cue's ability to retrieve a target outcome. The theory predicts a number of associative learning phenomena, including acquisition, extinction, reacquisition, conditioned inhibition, external inhibition, latent inhibition, discrimination, generalization, blocking, overshadowing, overexpectation, superconditioning, recovery from blocking, recovery from overshadowing, recovery from overexpectation, backward blocking, backward conditioned inhibition, and second-order retrospective revaluation. We argue that associative learning is consistent with an instance-based approach to learning and memory.
Form preferences in successive discrimination learning of young chicks.
Zolman, J F; Pursley, D G; Hall, J A; Sahley, C L
1975-12-01
In four experiments the effects of form and orientation pecking preferences of 1- and 3-day old Vantress X Arbor Acre chicks on successive discrimination learning were determined, using heat reinforcement. Major findings were as follows: (a) The young chick has both circle and verticle orientation pecking preferences that are present during at least the first 3 days after hatching; (b) when either of these preferred cues is the nonreinforced cue, the young chick has difficulty in learning not to respond to it but learns quickly not to respond to an unpreferred cue (e.g., triangle and horizontal oriented dots or bar); and (c) these pecking preferences can be modified by heat reinforcement, and the effects of this conditioning is evidenct in subsequent extinction and retention tests. The main conclusion from these experiments is that form and orientation preferences, like brightness and color preferences, are important developmental constraints on conditioning of the young chick.
Targeting extinction and reconsolidation mechanisms to combat the impact of drug cues on addiction.
Taylor, Jane R; Olausson, Peter; Quinn, Jennifer J; Torregrossa, Mary M
2009-01-01
Drug addiction is a progressive and compulsive disorder, where recurrent craving and relapse to drug-seeking occur even after long periods of abstinence. A major contributing factor to relapse is drug-associated cues. Here we review behavioral and pharmacological studies outlining novel methods of effective and persistent reductions in cue-induced relapse behavior in animal models. We focus on extinction and reconsolidation of cue-drug associations as the memory processes that are the most likely targets for interventions. Extinction involves the formation of new inhibitory memories rather than memory erasure; thus, it should be possible to facilitate the extinction of cue-drug memories to reduce relapse. We propose that context-dependency of extinction might be altered by mnemonic agents, thereby enhancing the efficacy of cue-exposure therapy as treatment strategy. In contrast, interfering with memory reconsolidation processes can disrupt the integrity or strength of specific cue-drug memories. Reconsolidation is argued to be a distinct process that occurs over a brief time period after memory is reactivated/retrieved - when the memory becomes labile and vulnerable to disruption. Reconsolidation is thought to be an independent, perhaps opposing, process to extinction and disruption of reconsolidation has recently been shown to directly affect subsequent cue-drug memory retrieval in an animal model of relapse. We hypothesize that a combined approach aimed at both enhancing the consolidation of cue-drug extinction and interfering with the reconsolidation of cue-drug memories will have a greater potential for persistently inhibiting cue-induced relapse than either treatment alone.
d-Cycloserine reduces context specificity of sexual extinction learning.
Brom, Mirte; Laan, Ellen; Everaerd, Walter; Spinhoven, Philip; Trimbos, Baptist; Both, Stephanie
2015-11-01
d-Cycloserine (DCS) enhances extinction processes in animals. Although classical conditioning is hypothesized to play a pivotal role in the aetiology of appetitive motivation problems, no research has been conducted on the effect of DCS on the reduction of context specificity of extinction in human appetitive learning, while facilitation hereof is relevant in the context of treatment of problematic reward-seeking behaviors. Female participants were presented with two conditioned stimuli (CSs) that either predicted (CS+) or did not predict (CS-) a potential sexual reward (unconditioned stimulus (US); genital vibrostimulation). Conditioning took place in context A and extinction in context B. Subjects received DCS (125mg) or placebo directly after the experiment on day 1 in a randomized, double-blind, between-subject fashion (Placebo n=31; DCS n=31). Subsequent testing for CS-evoked conditioned responses (CRs) in both the conditioning (A) and the extinction context (B) took place 24h later on day 2. Drug effects on consolidation were then assessed by comparing the recall of sexual extinction memories between the DCS and the placebo groups. Post learning administration of DCS facilitates sexual extinction memory consolidation and affects extinction's fundamental context specificity, evidenced by reduced conditioned genital and subjective sexual responses, relative to placebo, for presentations of the reward predicting cue 24h later outside the extinction context. DCS makes appetitive extinction memories context-independent and prevents the return of conditioned response. NMDA receptor glycine site agonists may be potential pharmacotherapies for the prevention of relapse of appetitive motivation disorders with a learned component. Copyright © 2015 Elsevier Inc. All rights reserved.
From Pavlov to PTSD: The extinction of conditioned fear in rodents, humans, and in anxiety disorders
VanElzakker, Michael B.; Dahlgren, M. Kathryn; Davis, F. Caroline; Dubois, Stacey; Shin, Lisa M.
2014-01-01
Nearly 100 years ago, Ivan Pavlov demonstrated that dogs could learn to use a neutral cue to predict a biologically relevant event: after repeated predictive pairings, Pavlov's dogs were conditioned to anticipate food at the sound of a bell, which caused them to salivate. Like sustenance, danger is biologically relevant, and neutral cues can take on great salience when they predict a threat to survival. In anxiety disorders such as posttraumatic stress disorder (PTSD), this type of conditioned fear fails to extinguish, and reminders of traumatic events can cause pathological conditioned fear responses for decades after danger has passed. In this review, we use fear conditioning and extinction studies to draw a direct line from Pavlov to PTSD and other anxiety disorders. We explain how rodent studies have informed neuroimaging studies of healthy humans and humans with PTSD. We describe several genes that have been linked to both PTSD and fear conditioning and extinction and explain how abnormalities in fear conditioning or extinction may reflect a general biomarker of anxiety disorders. Finally, we explore drug and neuromodulation treatments that may enhance therapeutic extinction in anxiety disorders. PMID:24321650
From Pavlov to PTSD: the extinction of conditioned fear in rodents, humans, and anxiety disorders.
VanElzakker, Michael B; Dahlgren, M Kathryn; Davis, F Caroline; Dubois, Stacey; Shin, Lisa M
2014-09-01
Nearly 100 years ago, Ivan Pavlov demonstrated that dogs could learn to use a neutral cue to predict a biologically relevant event: after repeated predictive pairings, Pavlov's dogs were conditioned to anticipate food at the sound of a bell, which caused them to salivate. Like sustenance, danger is biologically relevant, and neutral cues can take on great salience when they predict a threat to survival. In anxiety disorders such as posttraumatic stress disorder (PTSD), this type of conditioned fear fails to extinguish, and reminders of traumatic events can cause pathological conditioned fear responses for decades after danger has passed. In this review, we use fear conditioning and extinction studies to draw a direct line from Pavlov to PTSD and other anxiety disorders. We explain how rodent studies have informed neuroimaging studies of healthy humans and humans with PTSD. We describe several genes that have been linked to both PTSD and fear conditioning and extinction and explain how abnormalities in fear conditioning or extinction may reflect a general biomarker of anxiety disorders. Finally, we explore drug and neuromodulation treatments that may enhance therapeutic extinction in anxiety disorders. Copyright © 2013 Elsevier Inc. All rights reserved.
Martel, Guillaume; Hevi, Charles; Wong, Alexandra; Zushida, Ko; Uchida, Shusaku; Shumyatsky, Gleb P.
2012-01-01
Extinction is an integral part of normal healthy fear responses, while it is compromised in several fear-related mental conditions in humans, such as post-traumatic stress disorder (PTSD). Although much research has recently been focused on fear extinction, its molecular and cellular underpinnings are still unclear. The development of animal models for extinction will greatly enhance our approaches to studying its neural circuits and the mechanisms involved. Here, we describe two gene-knockout mouse lines, one with impaired and another with enhanced extinction of learned fear. These mutant mice are based on fear memory-related genes, stathmin and gastrin-releasing peptide receptor (GRPR). Remarkably, both mutant lines showed changes in fear extinction to the cue but not to the context. We performed indirect imaging of neuronal activity on the second day of cued extinction, using immediate-early gene c-Fos. GRPR knockout mice extinguished slower (impaired extinction) than wildtype mice, which was accompanied by an increase in c-Fos activity in the basolateral amygdala and a decrease in the prefrontal cortex. By contrast, stathmin knockout mice extinguished faster (enhanced extinction) and showed a decrease in c-Fos activity in the basolateral amygdala and an increase in the prefrontal cortex. At the same time, c-Fos activity in the dentate gyrus was increased in both mutant lines. These experiments provide genetic evidence that the balance between neuronal activities of the amygdala and prefrontal cortex defines an impairment or facilitation of extinction to the cue while the hippocampus is involved in the context-specificity of extinction. PMID:22312434
Martel, Guillaume; Hevi, Charles; Wong, Alexandra; Zushida, Ko; Uchida, Shusaku; Shumyatsky, Gleb P
2012-01-01
Extinction is an integral part of normal healthy fear responses, while it is compromised in several fear-related mental conditions in humans, such as post-traumatic stress disorder (PTSD). Although much research has recently been focused on fear extinction, its molecular and cellular underpinnings are still unclear. The development of animal models for extinction will greatly enhance our approaches to studying its neural circuits and the mechanisms involved. Here, we describe two gene-knockout mouse lines, one with impaired and another with enhanced extinction of learned fear. These mutant mice are based on fear memory-related genes, stathmin and gastrin-releasing peptide receptor (GRPR). Remarkably, both mutant lines showed changes in fear extinction to the cue but not to the context. We performed indirect imaging of neuronal activity on the second day of cued extinction, using immediate-early gene c-Fos. GRPR knockout mice extinguished slower (impaired extinction) than wildtype mice, which was accompanied by an increase in c-Fos activity in the basolateral amygdala and a decrease in the prefrontal cortex. By contrast, stathmin knockout mice extinguished faster (enhanced extinction) and showed a decrease in c-Fos activity in the basolateral amygdala and an increase in the prefrontal cortex. At the same time, c-Fos activity in the dentate gyrus was increased in both mutant lines. These experiments provide genetic evidence that the balance between neuronal activities of the amygdala and prefrontal cortex defines an impairment or facilitation of extinction to the cue while the hippocampus is involved in the context-specificity of extinction.
The Effect of an Extinction Cue on ABA-Renewal: Does Valence Matter?
ERIC Educational Resources Information Center
Dibbets, Pauline; Maes, Joseph H. R.
2011-01-01
The present human fear conditioning study examined whether the valence of an extinction cue has a differential effect on attenuating renewal that is induced by removal of the extinction context. Additionally, the study aimed to assess whether such attenuating effect is based on a modulatory or safety-signal role of the cue. In acquisition,…
Madsen, Heather B; Zbukvic, Isabel C; Luikinga, Sophia J; Lawrence, Andrew J; Kim, Jee Hyun
2017-09-01
Relapse to drug use is often precipitated by exposure to drug associated cues that evoke craving. Cue-induced drug craving has been observed in both animals and humans to increase over the first few weeks of abstinence and remain high over extended periods, a phenomenon known as 'incubation of craving'. As adolescence represents a period of vulnerability to developing drug addiction, potentially due to persistent reactivity to drug associated cues, we first compared incubation of cocaine craving in adolescent and adult rats. Adolescent (P35) and adult (P70) rats were trained to lever press to obtain intravenous cocaine, with each drug delivery accompanied by a light cue that served as the conditioned stimulus (CS). Following acquisition of stable responding, rats were tested for cue-induced cocaine-seeking after either 1 or 30days of abstinence. Additional groups of rats were also tested after 30days of abstinence, however these rats were subjected to a cue extinction session 1week into the abstinence period. Rats were injected with aripiprazole, a dopamine 2 receptor (D2R)-like partial agonist, or vehicle, 30min prior to cue extinction. We found that adolescent and adult rats acquired and maintained a similar level of cocaine self-administration, and rats of both ages exhibited a higher level of cue-induced cocaine-seeking if they were tested after 30days of abstinence compared to 1day. Incubation of cocaine craving was significantly reduced to 1day levels in both adults and adolescents that received cue extinction training. Administration of aripiprazole prior to cue extinction did not further reduce cue-induced drug-seeking. These results indicate that cue extinction training during abstinence may effectively reduce cue-induced relapse at a time when cue-induced drug craving is usually high. Copyright © 2016 Elsevier Inc. All rights reserved.
Stress enhances the consolidation of extinction memory in a predictive learning task
Hamacher-Dang, Tanja C.; Engler, Harald; Schedlowski, Manfred; Wolf, Oliver T.
2013-01-01
Extinction is not always permanent, as indicated by several types of recovery effects, such as the renewal effect, which may occur after a context change and points towards the importance of contextual cues. Strengthening the retrieval of extinction memory is a crucial aim of extinction-based psychotherapeutic treatments of anxiety disorders to prevent relapse. Stress is known to modulate learning and memory, with mostly enhancing effects on memory consolidation. However, whether such a consolidation-enhancing effect of acute stress can also be found for extinction memory has not yet been examined in humans. In this study, we investigated the effect of stress after extinction learning on the retrieval of extinction memory in a predictive learning renewal paradigm. Participants took the part of being the doctor of a fictitious patient and learned to predict whether certain food stimuli were associated with “stomach trouble” in two different restaurants (contexts). On the first day, critical stimuli were associated with stomach trouble in context A (acquisition phase). On the second day, these associations were extinguished in context B. Directly after extinction, participants were either exposed to a stressor (socially evaluated cold pressor test; n = 22) or a control condition (n = 24). On the third day, we tested retrieval of critical associations in contexts A and B. Participants exposed to stress after extinction exhibited a reduced recovery of responding at test in context B, suggesting that stress may context-dependently enhance the consolidation of extinction memory. Furthermore, the increase in cortisol in response to the stressor was negatively correlated with the recovery of responding in context A. Our findings suggest that in parallel to the known effects of stress on the consolidation of episodic memory, stress also enhances the consolidation of extinction memory, which might be relevant for potential applications in extinction-based psychotherapy. PMID:23986667
Eyeblink Conditioning Deficits Indicate Timing and Cerebellar Abnormalities in Schizophrenia
ERIC Educational Resources Information Center
Brown, S.M.; Kieffaber, P.D.; Carroll, C.A.; Vohs, J.L.; Tracy, J.A.; Shekhar, A.; O'Donnell, B.F.; Steinmetz, J.E.; Hetrick, W.P.
2005-01-01
Accumulating evidence indicates that individuals with schizophrenia manifest abnormalities in structures (cerebellum and basal ganglia) and neurotransmitter systems (dopamine) linked to internal-timing processes. A single-cue tone delay eyeblink conditioning paradigm comprised of 100 learning and 50 extinction trials was used to examine cerebellar…
Extinction Can Reduce the Impact of Reward Cues on Reward-Seeking Behavior.
Lovibond, Peter F; Satkunarajah, Michelle; Colagiuri, Ben
2015-07-01
Reward-associated cues are thought to promote relapse after treatment of appetitive disorders such as drug-taking, binge eating, and gambling. This process has been modelled in the laboratory using a Pavlovian-instrumental transfer (PIT) design in which Pavlovian cues facilitate instrumental reward-directed action. Attempts to reduce facilitation by cue exposure (extinction) have produced mixed results. We tested the effect of extinction in a recently developed PIT procedure using a natural reward, chocolate, in human participants. Facilitation of instrumental responding was only observed in participants who were aware of the Pavlovian contingencies. Pavlovian extinction successfully reduced, but did not completely eliminate, expectancy of reward and facilitation of instrumental responding. The results indicate that exposure can reduce the ability of cues to promote reward-directed behavior in the laboratory. However, the residual potency of extinguished cues means that additional active strategies may be needed in clinical practice to train patients to resist the impact of these cues in their environment. Copyright © 2015. Published by Elsevier Ltd.
Extinction of Contextual Fear with Timed Exposure to Enriched Environment: A Differential Effect
Hegde, Preethi; O'Mara, Shane; Laxmi, Thenkanidiyoor Rao
2017-01-01
Background Extinction of fear memory depends on the environmental and emotional cues. Furthermore, consolidation of extinction is also dependent on the environmental exposure. But, the relationship of the time of the exposure to a variety of environmental cues is not well known. The important region involved in facilitation of extinction of fear memory is through diversion of the flow of information leaving the lateral nucleus of amygdala. Purpose The study aimed to address a question to explain how these brain regions react to environmental stimulation during the retention and extinction of fear memory. Methods An enriched environment (EE) is assumed to mediate extinction of fear memory, we examined the apparent discrepancy between the effects of defensive response, the freezing behavior induced by Pavlovian classical fear conditioning by subjecting them to variance in the timing to EE. The different timing of EE exposure was 10 days of EE either before fear conditioning and/or after extinction training to the rats. The local field potentials was recorded from CA1 hippocampus, lateral nucleus of amygdala and infralimbic region of medial prefrontal cortex (mPFC) during the fear learning and extinction from the control rats and rats exposed to EE before and after fear conditioning. Results Exposure to EE before the fear conditioning and after extinction training was more effective in the extinction fear memory. In addition, we also found switching from exploratory locomotion to freezing during retention of contextual fear memory which was associated with decreased theta power and reduced synchronized theta oscillations in CA1-hippocampus, lateral nucleus of amygdala, and infralimbic region of mPFC. Conclusion Thus, we propose that the timing of exposure to EE play a key role in the extinction of fear memory. PMID:28588364
Social Modulation of Associative Fear Learning by Pheromone Communication
ERIC Educational Resources Information Center
Bredy, Timothy W.; Barad, Mark
2009-01-01
Mice communicate through visual, vocal, and olfactory cues that influence innate, nonassociative behavior. We here report that exposure to a recently fear-conditioned familiar mouse impairs acquisition of conditioned fear and facilitates fear extinction, effects mimicked by both an olfactory chemosignal emitted by a recently fear-conditioned…
Extinction of relapsed fear does not require the basolateral amygdala.
Lingawi, Nura W; Westbrook, R Frederick; Laurent, Vincent
2017-03-01
It is well established that extinguished fears are restored with the passage of time or a change in physical context. These fear restoration phenomena are believed to mimic the conditions under which relapse occurs in patients that have been treated for anxiety disorders by means of cue-exposure therapy. Here, we used a rodent model to extinguish relapsed fear and assess whether this new extinction prevents further relapse. We found that activity in the basolateral amygdala (BLA) is required to initially extinguish conditioned fear, but this activity was not necessary to subsequently extinguish relapsed fear. That is, extinction of spontaneously recovered or renewed fear was spared by BLA inactivation. Yet, this BLA-independent learning of extinction did not protect against further relapse: extinction of relapsed fear conducted without BLA activity was still likely to return after the passage of time or a shift in physical context. These findings have important clinical implications. They indicate that pharmacological agents with anxiolytic properties may disrupt initial cue-exposure therapy but may be useful when therapy is again needed due to relapse. However, they also suggest that these agents will not protect against further relapse, implying the need for developing drugs that target other brain regions involved in fear inhibition. Copyright © 2017 Elsevier Inc. All rights reserved.
Adhikary, Sweta; Caprioli, Daniele; Venniro, Marco; Kallenberger, Paige; Shaham, Yavin; Bossert, Jennifer M
2017-07-01
In rats trained to self-administer methamphetamine, extinction responding in the presence of drug-associated contextual and discrete cues progressively increases after withdrawal (incubation of methamphetamine craving). The conditioning factors underlying this incubation are unknown. Here, we studied incubation of methamphetamine craving under different experimental conditions to identify factors contributing to this incubation. We also determined whether the rats' response to methamphetamine priming incubates after withdrawal. We trained rats to self-administer methamphetamine in a distinct context (context A) for 14 days (6 hours/day). Lever presses were paired with a discrete light cue. We then tested groups of rats in context A or a different non-drug context (context B) after 1 day, 1 week or 1 month for extinction responding with or without the discrete cue. Subsequently, we tested the rats for reinstatement of drug seeking induced by exposure to contextual, discrete cue, or drug priming (0, 0.25 and 0.5 mg/kg). Operant responding in the extinction sessions in contexts A or B was higher after 1 week and 1 month of withdrawal than after 1 day; this effect was context-independent. Independent of the withdrawal period, operant responding in the extinction sessions was higher when responding led to contingent delivery of the discrete cue. After extinction, discrete cue-induced reinstatement, but not context- or drug priming-induced reinstatement, progressively increased after withdrawal. Together, incubation of methamphetamine craving, as assessed in extinction tests, is primarily mediated by time-dependent increases in non-reinforced operant responding, and this effect is potentiated by exposure to discrete, but not contextual, cues. Published 2016. This article is a U.S. Government work and is in the public domain in the USA.
Adhikary, Sweta; Caprioli, Daniele; Venniro, Marco; Kallenberger, Paige; Shaham, Yavin; Bossert, Jennifer M.
2016-01-01
In rats trained to self-administer methamphetamine, extinction responding in the presence of drug-associated contextual and discrete cues progressively increases after withdrawal (incubation of methamphetamine craving). The conditioning factors underlying this incubation are unknown. Here, we studied incubation of methamphetamine craving under different experimental conditions to identify factors contributing to this incubation. We also determined whether the rats’ response to methamphetamine priming incubates after withdrawal. We trained rats to self-administer methamphetamine in a distinct context (context A) for 14 days (6-h/day). Lever presses were paired with a discrete light cue. We then tested groups of rats in context A or a different non-drug context (context B) after 1 day, 1 week, or 1 month for extinction responding with or without the discrete cue. Subsequently, we tested the rats for reinstatement of drug seeking induced by exposure to contextual, discrete cue, or drug priming (0, 0.25, and 0.5 mg/kg). Operant responding in the extinction sessions in contexts A or B was higher after 1 week and 1 month of withdrawal than after 1 day; this effect was context-independent. Independent of the withdrawal period, operant responding in the extinction sessions was higher when responding led to contingent delivery of the discrete cue. After extinction, discrete cue-induced reinstatement, but not context- or drug priming-induced reinstatement, progressively increased after withdrawal. Together, incubation of methamphetamine craving, as assessed in extinction tests, is primarily mediated by time-dependent increases in non-reinforced operant responding, and this effect is potentiated by exposure to discrete, but not contextual, cues. PMID:26989042
Meulders, Ann; Meulders, Michel; Vlaeyen, Johan W S
2014-06-01
From a treatment perspective, it is highly relevant to pinpoint individual vulnerability factors for resistance to exposure treatment in highly fearful chronic pain patients. Previous fear conditioning research showed that healthy individuals scoring relatively high on trait anxiety display sustained fear to safety cues during extinction. In the context of fear of movement-related pain, this intriguing question has been largely neglected so far. Even more importantly, positive psychological traits such as trait positive affect may function as protective factors against the spreading of fear to safe movements and improve exposure treatment outcomes. In this study, healthy participants completed a trait anxiety and trait positive affect questionnaire and underwent acquisition and extinction of fear of movement-related pain using an experimental voluntary movement paradigm. During acquisition, one movement (CS+) was paired with a painful stimulus and another movement was not (CS-). During extinction, the CS+ was no longer reinforced. Results show failure of fear inhibition to the CS- during extinction in healthy individuals scoring relatively high on trait anxiety or relatively low on positive affect. These findings seem to suggest that safety learning is more vulnerable in healthy people with a high anxious disposition and/or relatively lower levels of positive affect. In addition, this is the first study to show that the negative impact of high trait anxiety on fear inhibition to safety cues during extinction can be countered by high levels of positive affect. These findings may have important clinical implications. Both low positive affect and high trait anxiety are associated with impaired fear inhibition to nonpainful movements during fear extinction. Interestingly, high levels of positive affect buffer against the negative impact of trait anxiety. Increasing positive affect during exposure may counter the effects of trait vulnerabilities and improve treatment outcomes. Copyright © 2014 American Pain Society. Published by Elsevier Inc. All rights reserved.
Vicarious extinction learning during reconsolidation neutralizes fear memory.
Golkar, Armita; Tjaden, Cathelijn; Kindt, Merel
2017-05-01
Previous studies have suggested that fear memories can be updated when recalled, a process referred to as reconsolidation. Given the beneficial effects of model-based safety learning (i.e. vicarious extinction) in preventing the recovery of short-term fear memory, we examined whether consolidated long-term fear memories could be updated with safety learning accomplished through vicarious extinction learning initiated within the reconsolidation time-window. We assessed this in a final sample of 19 participants that underwent a three-day within-subject fear-conditioning design, using fear-potentiated startle as our primary index of fear learning. On day 1, two fear-relevant stimuli (reinforced CSs) were paired with shock (US) and a third stimulus served as a control (CS). On day 2, one of the two previously reinforced stimuli (the reminded CS) was presented once in order to reactivate the fear memory 10 min before vicarious extinction training was initiated for all CSs. The recovery of the fear memory was tested 24 h later. Vicarious extinction training conducted within the reconsolidation time window specifically prevented the recovery of the reactivated fear memory (p = 0.03), while leaving fear-potentiated startle responses to the non-reactivated cue intact (p = 0.62). These findings are relevant to both basic and clinical research, suggesting that a safe, non-invasive model-based exposure technique has the potential to enhance the efficiency and durability of anxiolytic therapies. Copyright © 2017 Elsevier Ltd. All rights reserved.
Counterconditioning reduces cue-induced craving and actual cue-elicited consumption.
Van Gucht, Dinska; Baeyens, Frank; Vansteenwegen, Debora; Hermans, Dirk; Beckers, Tom
2010-10-01
Cue-induced craving is not easily reduced by an extinction or exposure procedure and may constitute an important route toward relapse in addictive behavior after treatment. In the present study, we investigated the effectiveness of counterconditioning as an alternative procedure to reduce cue-induced craving, in a nonclinical population. We found that a cue, initially paired with chocolate consumption, did not cease to elicit craving for chocolate after extinction (repeated presentation of the cue without chocolate consumption), but did so after counterconditioning (repeated pairing of the cue with consumption of a highly disliked liquid, Polysorbate 20). This effect persisted after 1 week. Counterconditioning moreover was more effective than extinction in disrupting reported expectancy to get to eat chocolate, and also appeared to be more effective in reducing actual cue-elicited chocolate consumption. These results suggest that counterconditioning may be more promising than cue exposure for the prevention of relapse in addictive behavior. (PsycINFO Database Record (c) 2010 APA, all rights reserved).
Manwell, Laurie A; Mallet, Paul E
2015-05-01
Evidence suggesting that the endogenous cannabinoid (eCB) system can be manipulated to facilitate or impair extinction of learned behaviours has important consequences for opiate withdrawal and abstinence. We demonstrated that the fatty acid amide hydrolase (FAAH) inhibitor URB597, which increases eCB levels, facilitates extinction of a naloxone-precipitated morphine withdrawal-induced conditioned place aversion (CPA). The potential of the exogenous CB1 ligand, Δ(9)-tetrahydrocannabinol (Δ(9)-THC), to facilitate extinction of this CPA was tested. Effects of both pulmonary and parenteral Δ(9)-THC exposure were evaluated using comparable doses previously determined. Rats trained to associate a naloxone-precipitated morphine withdrawal with a floor cue were administered Δ(9)-THC-pulmonary (1, 5, 10 mg vapour inhalation) or parenteral (0.5, 1.0, 1.5 mg/kg intraperitoneal injection)-prior to each of 20 to 28 extinction/testing trials. Vapourized Δ(9)-THC facilitated extinction of the CPA in a dose- and time-dependent manner: 5 and 10 mg facilitated extinction compared to vehicle and 1 mg Δ(9)-THC. Injected Δ(9)-THC significantly impaired extinction only for the 1.0-mg/kg dose: it prolonged the CPA fourfold longer than the vehicle and 0.5- and 1.5-mg/kg doses. These data suggest that both dose and route of Δ(9)-THC administration have important consequences for its pharmacokinetic and behavioural effects; specifically, pulmonary exposure at higher doses facilitates, whereas pulmonary and parenteral exposure at lower doses impairs, rates of extinction learning for CPA. Pulmonary-administered Δ(9)-THC may prove beneficial for potentiation of extinction learning for aversive memories, such as those supporting drug-craving/seeking in opiate withdrawal syndrome, and other causes of conditioned aversions, such as illness and stress.
Reducing spontaneous recovery and reinstatement of operant performance through extinction-cues.
Bernal-Gamboa, Rodolfo; Gámez, A Matías; Nieto, Javier
2017-02-01
It has been argued that the response recovery effects share a common mechanism. A possible way to test it is evaluating whether the techniques that impaired renewal would impair the other recovery effects as well. Two experiments with rats used a free operant procedure to explore whether an extinction-cue could prevent the spontaneous recovery and reinstatement of an extinguished lever-pressing. Both experiments consisted of four phases: Acquisition, Extinction and Test 1 and Test 2. First, all rats were trained to perform one instrumental response (R1) for food in context A, and a different instrumental response (R2) for food in context B. Then, responses were extinguished within the same context: R1 in context A and R2 in context B. Throughout this phase all rats received brief presentations of a tone (extinction-cue). In both experiments animals were tested twice. The first test was conducted immediately after the last extinction session. In this test, rats received the extinction-cue for both responses. During the second test, rats experienced the tone only for R1. In Experiment 1 rats were tested after 5days, while for Experiment 2 test 2 took place after a single session of re-exposure to the food. Both experiments showed a recovery effect (spontaneous recovery in Experiment 1 and reinstatement in Experiment 2) for both responses. However, a cue featured in extinction attenuated recovery of R1 in both experiments when presented on the test. The findings suggest that spontaneous recovery, reinstatement and renewal might share a common mechanism. In addition, the present data shows that using an extinction-cue could help to reduces relapsing of voluntary behaviors. Copyright © 2016 Elsevier B.V. All rights reserved.
Peters, Jamie; De Vries, Taco J
2014-01-01
Novel stimuli paired with exposure to addictive drugs can elicit approach through Pavlovian learning. While such approach behavior, or sign tracking, has been documented for cocaine and alcohol, it has not been shown to occur with opiate drugs like heroin. Most Pavlovian conditioned approach paradigms use an operandum as the sign, so that sign tracking can be easily automated. We were interested in assessing whether approach behavior occurs to an audiovisual cue paired with an intravenous heroin infusion. If so, would this behavior exhibit characteristics of other Pavlovian conditioned behaviors, such as extinction and spontaneous recovery? Rats were repeatedly exposed to an audiovisual cue, similar to that used in standard self-administration models, along with an intravenous heroin infusion. Sign tracking was measured in an automated fashion by analyzing motion pixels within the cue zone during each cue presentation. We were able to observe significant sign tracking after only five pairings of the conditioned stimulus (CS) with the unconditioned stimulus (US). This behavior rapidly extinguished over 2 days, but exhibited pronounced spontaneous recovery 3 weeks later. We conclude that sign tracking measured by these methods exhibits all the characteristics of a classically conditioned behavior. This model can be used to examine the Pavlovian component of drug memories, alone, or in combination with self-administration methods.
Mierzejewski, Pawel; Olczak, Mieszko; Rogowski, Artur; Kostowski, Wojciech; Samochowiec, Jerzy; Filip, Malgorzata; Przegalinski, Edmund; Bienkowski, Przemyslaw
2008-08-29
Little is known about the role of new protein synthesis in extinction of operant responding for natural and chemical reinforcers. In the present study, the authors investigated whether the effects of a protein synthesis inhibitor, cycloheximide (CHX) on extinction of operant responding for sweet reward depended on the duration of re-exposure sessions. In addition, the authors investigated whether the effects of CHX on extinction could generalize to relapse of saccharin seeking induced by discrete cues. CHX injected after short re-exposure sessions (5min) accelerated extinction of non-reinforced responding. In contrast, the drug injected after long re-exposure sessions (30min) partially inhibited extinction. Reinstatement of saccharin seeking induced by the saccharin-paired discrete cues was not altered by the previous treatment with CHX. Concluding, the results of the present study indicate that: (i) the protein synthesis inhibitor, CHX can alter extinction of operant responding for sweet reward in rats; (ii) the effects of CHX on extinction critically depend on the duration of re-exposure/extinction sessions and do not generalize to relapse of saccharin seeking induced by discrete cues.
Haaker, J; Lonsdorf, T B; Schümann, D; Menz, M; Brassen, S; Bunzeck, N; Gamer, M; Kalisch, R
2015-10-01
Impaired fear inhibition has been described as a hallmark of pathological anxiety. We aimed at further characterizing the relation between fear inhibition and anxiety by extending previous work to contextual safety stimuli as well as to dimensional scores of trait anxiety in a large sample. We employed a validated paradigm for context-dependent fear acquisition/extinction (day 1) and retrieval/expression (day 2) in 377 healthy individuals. This large sample size allowed the employment of a dimensional rather than binary approach with respect to individual differences in trait anxiety. We observed a positive correlation on day 1 between trait anxiety with all CSs that possess an inherent inhibitory component, conveyed either by reliable non-reinforcement of a specific CS in a dangerous context (safe cue) or by the context itself (i.e., safe context). No correlation however was observed for a CS that possesses excitatory (threatening) properties only. These results were observed during fear learning (day 1) for US expectancy and fear ratings but not for SCRs. No such pattern was evident during fear and extinction retrieval/expression (day 2). We provide further evidence that high trait anxiety is associated with the inability to take immediate advantage of environmental safety cues (cued and contextual), which might represent a promising trans-diagnostic marker for different anxiety disorders. Consequently, the incorporation of methods to optimize inhibitory learning in current cognitive behavioral therapy (CBT) treatments might open up a promising avenue for precision medicine in anxiety disorders. We did not include patients diagnosed with anxiety disorders. Copyright © 2015. Published by Elsevier B.V.
Pires, Rita G W; Pereira, Sílvia R C; Carvalho, Fabiana M; Oliveira-Silva, Ieda F; Ferraz, Vany P; Ribeiro, Angela M
2007-06-04
The effects of chronic ethanol and thiamine deficiency, alone or associated, on hippocampal protein phosphorylation profiles ranging in molecular weight from 30 to 250kDa molecular weight, in stimulated (high K(+) concentration) and unstimulated (basal) conditions were investigated. These treatments significantly changed the phosphorylation level of an 86kDa phosphoprotein. Thiamine deficiency, but not chronic ethanol, induced a decrease in a behavioural extinction index, which is significantly correlated to the phosphorylation level of the p86 protein. These data add to and extend previous findings by our laboratory implicating the involvement of hippocampal neurotransmission components in extinction of a behaviour which involves learning of environmental spatial cues.
Maximizing Exposure Therapy: An Inhibitory Learning Approach
Craske, Michelle G.; Treanor, Michael; Conway, Chris; Zbozinek, Tomislav; Vervliet, Bram
2014-01-01
Exposure therapy is an effective approach for treating anxiety disorders, although a substantial number of individuals fail to benefit or experience a return of fear after treatment. Research suggests that anxious individuals show deficits in the mechanisms believed to underlie exposure therapy, such as inhibitory learning. Targeting these processes may help improve the efficacy of exposure-based procedures. Although evidence supports an inhibitory learning model of extinction, there has been little discussion of how to implement this model in clinical practice. The primary aim of this paper is to provide examples to clinicians for how to apply this model to optimize exposure therapy with anxious clients, in ways that distinguish it from a ‘fear habituation’ approach and ‘belief disconfirmation’ approach within standard cognitive-behavior therapy. Exposure optimization strategies include 1) expectancy violation, 2) deepened extinction, 3) occasional reinforced extinction, 4) removal of safety signals, 5) variability, 6) retrieval cues, 7) multiple contexts, and 8) affect labeling. Case studies illustrate methods of applying these techniques with a variety of anxiety disorders, including obsessive-compulsive disorder, posttraumatic stress disorder, social phobia, specific phobia, and panic disorder. PMID:24864005
Role of ventral medial prefrontal cortex in incubation of cocaine craving
Koya, Eisuke; Uejima, Jamie L.; Wihbey, Kristina A.; Bossert, Jennifer M.; Hope, Bruce T.; Shaham, Yavin
2009-01-01
Cue-induced drug-seeking in rodents progressively increases after withdrawal from cocaine, suggesting that cue-induced cocaine craving incubates over time. Here, we explored the role of the medial prefrontal cortex (mPFC, a brain area previously implicated in cue-induced cocaine seeking) in this incubation. We trained rats to self-administer cocaine for 10 d (6 h/d, infusions were paired with a tone-light cue), and then assessed after 1 or 30 withdrawal days the effect of exposure to cocaine cues on lever presses in extinction tests. We found that cue-induced cocaine-seeking in the extinction tests was higher after 30 withdrawal days than after 1 day. The time-dependent increases in extinction responding were associated with large (ventral mPFC) or modest (dorsal mPFC) increases in ERK phosphorylation (a measure of ERK activity and an index of neuronal activation). After 30 withdrawal days, ventral but not dorsal injections of muscimol+baclofen (GABAa+GABAb receptor agonists that inhibit neuronal activity) decreased extinction responding. After 1 withdrawal day, ventral but not dorsal mPFC injections of bicuculline+saclofen (GABAa+GABAb receptor antagonists that increase neuronal activity) strongly increased extinction responding. Finally, muscimol+baclofen had minimal effect on extinction responding after 1 day, and in cocaine-experienced rats, ventral mPFC injections of muscimol+baclofen or bicuculline+saclofen had no effect on lever presses for an oral sucrose solution. The present results indicate that ventral mPFC neuronal activity plays an important role in the incubation of cocaine craving. PMID:18565549
Salling, Michael C.; Hodge, Christopher J.; Psilos, Kelly E.; Eastman, Vallari R.; Faccidomo, Sara P.; Hodge, Clyde W.
2018-01-01
Cue-induced reinstatement of alcohol-seeking is a hallmark behavioral pathology of addiction. Evidence suggests that reinstatement (e.g., relapse), may be regulated by cell signaling systems that underlie neuroplasticity. A variety of plasticity events require activation of calcium calmodulin-dependent protein kinase II (CaMKII) in components of the reward pathway, such as the nucleus accumbens and amygdala. We sought to determine if cue-induced reinstatement of alcohol-seeking behavior is associated with changes in the activation state (e.g., phosphorylation) of CaMKII-T286. Male C57BL/6J mice (n = 14) were trained to lever press on a fixed-ratio-4 schedule of sweetened alcohol (2% sucrose + 9% EtOH) reinforcement. After 14-d of extinction (no cues or reinforcers), mice underwent a response-contingent reinstatement (n = 7) vs. an additional day of extinction (n = 7). Brains were removed immediately after the test and processed for evaluation of pCaMKII-T286 immunoreactivity (IR). Number of pCaMKII-T286 positive cells/mm2 was quantified from coronal brain sections using Bioquant Image Analysis software. Mice emitted significantly more responses on the alcohol vs. the inactive lever throughout the baseline phase with average alcohol intake of 1.1 ± 0.03 g/kg/1-h. During extinction, responses on the alcohol lever decreased to inactive lever levels by day 7. Significant cue-induced reinstatement of alcohol-seeking was observed during a single test with no effects on the inactive lever. Reinstatement was associated with increased pCaMKII-T286 IR specifically in amygdala (LA and BLA), nucleus accumbens (AcbSh), lateral septum, mediodorsal thalamus, and piriform cortex as compared to extinction control. Brain regions showing no change included the dorsal striatum, medial septum, cingulate cortex, habenula, paraventricular thalamus, and ventral hypothalamus. These results show response contingent cue-induced reinstatement of alcohol-seeking behavior is associated with selective increases in pCaMKII-T286 in specific reward- and memory-related brain regions of male C57BL/6J mice. Primary molecular mechanisms of associative learning and memory may regulate relapse in alcohol addiction. PMID:29100991
Violation of eating expectancies does not reduce conditioned desires for chocolate.
van den Akker, Karolien; van den Broek, Myrr; Havermans, Remco C; Jansen, Anita
2016-05-01
Although eating desires can be easily learned, their extinction appears more difficult. The present two-session study aimed to investigate the role of eating expectancies in the short and longer-term extinction of eating desires. In addition, the relationship between eating desires and conditioned evaluations was examined to test whether they might share a similar mechanism. It was hypothesized that the short-term extinction of eating desires would be more successful after the disconfirmation of eating expectancies (instructed extinction or IE), while resulting in worse longer-term extinction because omission of the food reward during extinction is not surprising. In contrast to the hypotheses, it was found that IE had no effect on the short-term and longer-term extinction of eating desires. Eating desires correlated with conditioned evaluations only to some extent. It is concluded that eating expectancies do not mediate the short-term extinction of conditioned eating desires. In addition, their longer-term extinction does not appear to be facilitated by a greater violation of eating expectancies. This suggests that it might not be necessary to focus on expectancy violation in cue exposure therapy to reduce eating desires. Copyright © 2016 Elsevier Ltd. All rights reserved.
Brinks, V; de Kloet, E R; Oitzl, M S
2009-04-01
Corticosterone, the naturally occurring glucocorticoid of rodents is secreted in response to stressors and is known for its facilitating and detrimental effects on emotional learning and memory. The large variability in the action of corticosterone on processing of emotional memories is postulated to depend on genetic background and the spatio-temporal domain in which the hormone operates. To address this hypothesis, mice of two strains with distinct corticosterone secretory patterns and behavioural phenotype (BALB/c and C57BL/6J) were treated with corticosterone (250 microg/kg, i.p.), either 5 min before or directly after acquisition in a fear conditioning task. As the paradigm allowed assessing in one experimental procedure both context- and cue-related fear behaviour, we were able to detect generalization and specificity of fear. BALB/c showed generalized strong fear memory, while C57BL/6J mice discriminated between freezing during context- and cue episodes. Corticosterone had opposite effects on fear memory depending on the strain and time of injection. Corticosterone after acquisition did not affect C57BL/6J mice, but destabilized consolidation and facilitated extinction in BALB/c. Corticosterone 5 min before acquisition strengthened stress-associated signals: BALB/c no longer showed lower fear memory, while C57BL/6J mice displayed increased fear memory and impaired extinction in cue episodes. We propose that corticosterone-induced facilitation of fear memory in C57BL/6J mice can be used to study the development of fear memories, corticosterone administration in BALB/c mice presents a model to examine treatment. We conclude that genetic background and time of corticosterone action are modifiers of fear memory with interesting translational implications for anxiety-related diseases.
Cubillas, Carmelo P.; Vadillo, Miguel A.; Matute, Helena
2017-01-01
Decades of research in extinction and interference show that contexts can play a critical role at disambiguating the meaning of cues that have been paired with different outcomes at different times. For instance, if a cue x is followed by outcome 1 in the first phase of an experiment and by outcome 2 in a second phase, responses to cue x tend to be consistent with outcome 2 when tested in a context similar to that of the second phase of the experiment. However, if participants are taken back to the original context of the first phase (i.e., ABA renewal) or to a completely new context (i.e., ABC or AAB renewal), their responses to x tend to be more consistent with outcome 1. Although the role of physical and temporal contexts has been well studied, other factors that can also modulate the selective retrieval of information after interference have received less attention. The present series of experiments shows how changes in cue configuration can modulate responding in a similar manner. Across five experiments using a human predictive learning task, we found that adding, removing or replacing elements from a compound cue that had undergone an interference treatment gave rise to a recovery of responding akin to that observed after context changes in AAB renewal. These results are consistent with those of previous studies exploring the effect of changes of cue configuration on interference. Taken together, these studies suggest that a change in cue configuration can have the functional properties of a context change, a finding with important implications for formal models of configural learning and for classical accounts of interference and information retrieval. PMID:28111562
Cubillas, Carmelo P; Vadillo, Miguel A; Matute, Helena
2016-01-01
Decades of research in extinction and interference show that contexts can play a critical role at disambiguating the meaning of cues that have been paired with different outcomes at different times. For instance, if a cue x is followed by outcome 1 in the first phase of an experiment and by outcome 2 in a second phase, responses to cue x tend to be consistent with outcome 2 when tested in a context similar to that of the second phase of the experiment. However, if participants are taken back to the original context of the first phase (i.e., ABA renewal) or to a completely new context (i.e., ABC or AAB renewal), their responses to x tend to be more consistent with outcome 1. Although the role of physical and temporal contexts has been well studied, other factors that can also modulate the selective retrieval of information after interference have received less attention. The present series of experiments shows how changes in cue configuration can modulate responding in a similar manner. Across five experiments using a human predictive learning task, we found that adding, removing or replacing elements from a compound cue that had undergone an interference treatment gave rise to a recovery of responding akin to that observed after context changes in AAB renewal. These results are consistent with those of previous studies exploring the effect of changes of cue configuration on interference. Taken together, these studies suggest that a change in cue configuration can have the functional properties of a context change, a finding with important implications for formal models of configural learning and for classical accounts of interference and information retrieval.
Delamater, Andrew R; Schneider, Kevin; Derman, Rifka C
2017-07-01
Three experiments with male and female rats were conducted to examine the effects of Pavlovian extinction training on Pavlovian-to-instrumental transfer (PIT) in a task in which the unconditioned stimulus (US) was presented at an early time point within an extended conditioned stimulus (CS). Two instrumental responses were trained with different reinforcing outcomes (R1-O1, R2-O2) and then, independently, 2 stimuli were trained with those outcomes (S1-O1, S2-O2). One group then underwent an extinction treatment (S1-, S2-) and a second was merely exposed to the experimental contexts without any stimulus events. Finally, the effects of the 2 stimuli on instrumental responding were assessed in PIT tests. Across experiments we varied the number of Pavlovian training trials prior to extinction (8, 16, or 64 trials) and the length of time following extinction prior to test (i.e., 1 or 21 days, in a test for spontaneous recovery). We observed that outcome-specific PIT was reduced by extinction in all of our training conditions and that this extinction effect was durable, surviving a 3-week spontaneous recovery interval even though conditioned magazine approach spontaneously recovered over this interval. Although extinction reduced the magnitude of PIT, the temporal expression of PIT was mostly unaffected. We found these effects in both male and female rats, though in 1 study females were extinction-resistant. These data suggest that under the conditions studied here Pavlovian extinction may permanently weaken the ability of Pavlovian cues to retrieve a representation of their associated outcomes without impacting the temporal organization of responding. This suggests that different features of learning may be differentially sensitive to extinction. (PsycINFO Database Record (c) 2017 APA, all rights reserved).
Augur, Isabel F; Wyckoff, Andrew R; Aston-Jones, Gary; Kalivas, Peter W; Peters, Jamie
2016-09-28
The ventromedial prefrontal cortex (vmPFC) has been shown to negatively regulate cocaine-seeking behavior, but the precise conditions by which vmPFC activity can be exploited to reduce cocaine relapse are currently unknown. We used viral-mediated gene transfer of designer receptors (DREADDs) to activate vmPFC neurons and examine the consequences on cocaine seeking in a rat self-administration model of relapse. Activation of vmPFC neurons with the Gq-DREADD reduced reinstatement of cocaine seeking elicited by cocaine-associated cues, but not by cocaine itself. We used a retro-DREADD approach to confine the Gq-DREADD to vmPFC neurons that project to the medial nucleus accumbens shell, confirming that these neurons are responsible for the decreased cue-induced reinstatement of cocaine seeking. The effects of vmPFC activation on cue-induced reinstatement depended on prior extinction training, consistent with the reported role of this structure in extinction memory. These data help define the conditions under which chemogenetic activation of extinction neural circuits can be exploited to reduce relapse triggered by reminder cues. The ventromedial prefrontal cortex (vmPFC) projection to the nucleus accumbens shell is important for extinction of cocaine seeking, but its anatomical proximity to the relapse-promoting projection from the dorsomedial prefrontal cortex to the nucleus accumbens core makes it difficult to selectively enhance neuronal activity in one pathway or the other using traditional pharmacotherapy (e.g., systemically administered drugs). Viral-mediated gene delivery of an activating Gq-DREADD to vmPFC and/or vmPFC projections to the nucleus accumbens shell allows the chemogenetic exploitation of this extinction neural circuit to reduce cocaine seeking and was particularly effective against relapse triggered by cocaine reminder cues. Copyright © 2016 the authors 0270-6474/16/3610174-07$15.00/0.
Biesdorf, C; Wang, A-L; Topic, B; Petri, D; Milani, H; Huston, J P; de Souza Silva, M A
2015-09-01
Microdialysis studies in rat have generally shown that appetitive stimuli release dopamine (DA) in the nucleus accumbens (NAc) shell and core. Here we examined the release of DA in the NAc during delivery of reward (food) and during extinction of food reward in the freely moving animal by use of in vivo microdialysis and HPLC. Fifty-two male Wistar rats were trained to receive food reward associated with appearance of cue-lights in a Skinner-box during in vivo microdialysis. Different behavioral protocols were used to assess the effects of extinction on DA and its metabolites. Results Exp. 1: (a) During a 20-min period of cued reward delivery, DA increased significantly in the NAc core, but not shell subregion; (b) for the next 60min period half of the rats underwent immediate extinction (with the CS light presented during non-reward) and the other half did not undergo extinction to the cue lights (CS was not presented during non-reward). DA remained significantly increased in both groups, providing no evidence for a decrease in DA during extinction in either NAc core or shell regions. (c) In half of the animals of the group that was not subjected to extinction, the cue lights were turned on for 30min, thus, initiating extinction to cue CS at a 1h delay from the period of reward. In this group DA in the NAc core, but not shell, significantly decreased. Behavioral analysis showed that while grooming is an indicator of extinction-induced behavior, glances toward the cue-lights (sign tracking) are an index of resistance to extinction. Results Exp. 2: (a) As in Exp. 1, during a 30-min period of cued reward delivery, DA levels again increased significantly in the NAc core but not in the NAc shell. (b) When extinction (the absence of reward with the cue lights presented) was administered 24h after the last reward session, DA again significantly decreased in the NAc core, but not in the NAc shell. (a) These results confirm the importance of DA release in the NAc for reward-related states, with DA increasing in the core, but not shell subregion. (b) They provide first evidence that during the withholding of expected reward, DA decreases in the NAc core, but not shell region. (c) This decrease in DA appears only after a delay between delivery of reward and extinction likely due to it being masked by persisting DA release. We hypothesize the decrease in extinction-induced release of DA in the NAc core to be a marker for the despair/depression that is known to accompany the failure to obtain expected rewards/reinforcers. Copyright © 2015 Elsevier Inc. All rights reserved.
Latagliata, Emanuele Claudio; Saccoccio, Pamela; Milia, Chiara; Puglisi-Allegra, Stefano
2016-03-01
Drug-associated cues exposure to induce extinction is a useful strategy to contrast cue-induced drug seeking. Treatments aimed at reducing motivational properties of cues are considered highly promising since they could decrease their ability to induce drug-conditioned behaviors. Norepinephrine (NE) in the medial prefrontal cortex (mPFC) is critical for attribution of motivational salience to highly salient stimuli, suggesting a major role in prelimbic (PL) mpFC to modulate the motivational properties of drug-related cues, invigorating them, and consequently, delaying extinction. To investigate if NE in PL fosters the maintenance of drug-seeking behavior, we assessed its role on amphetamine-induced conditioned place preference (CPP). Moreover, to affirm the specificity of NE in PL, we also assessed the role of NE in the infralimbic (IL) mPFC. The effects of selective NE depletion in the PL or in the IL of C57BL/6J mice were assessed on the expression of amphetamine-induced CPP before and after extinction procedure. NE-depleted mice in PL extinguished preference for Amph-paired chamber long before sham animals. By contrast, IL-depleted animals maintained place preference for more than 4 weeks after the procedure of extinction, having at that moment interrupted the test. Inactivation of NE in PL cortex blunts amphetamine-induced CPP, thus fostering extinction and showing to be critical for the maintenance of conditioned Amph-seeking behavior. Opposite effects of NE depletion in IL, seemingly in agreement with literature on extinction, are discussed in terms of balance of activity between PL and IL in extinction.
Bouchet, Courtney A; Lloyd, Brian A; Loetz, Esteban C; Farmer, Caroline E; Ostrovskyy, Mykola; Haddad, Natalie; Foright, Rebecca M; Greenwood, Benjamin N
2017-08-01
Fear extinction-based exposure therapy is the most common behavioral therapy for anxiety and trauma-related disorders, but fear extinction memories are labile and fear tends to return even after successful extinction. The relapse of fear contributes to the poor long-term efficacy of exposure therapy. A single session of voluntary exercise can enhance the acquisition and consolidation of fear extinction in male rats, but the effects of exercise on relapse of fear after extinction are not well understood. Here, we characterized the effects of 2 h of voluntary exercise during the consolidation phase of contextual or auditory fear extinction learning on long-term fear extinction memory and renewal in adult, male and female, Long-Evans rats. Results indicate that exercise enhances consolidation of fear extinction memory and reduces fear relapse after extinction in a sex-dependent manner. These data suggest that brief bouts of exercise could be used as an augmentation strategy for exposure therapy, even in previously sedentary subjects. Fear memories of discrete cues, rather than of contextual ones, may be most susceptible to exercise-augmented extinction, especially in males. Additionally, exercise seems to have the biggest impact on fear relapse phenomena, even if fear extinction memories themselves are only minimally enhanced. © 2017 Bouchet et al.; Published by Cold Spring Harbor Laboratory Press.
Reactivated Memories Compete for Expression After Pavlovian Extinction
Laborda, Mario A.; Miller, Ralph R.
2012-01-01
We view the response decrement resulting from extinction treatment as an interference effect, in which the reactivated memory from acquisition competes with the reactivated memory from extinction for behavioral expression. For each of these memories, reactivation is proportional to both the strength of the stimulus-outcome association and the quality of the facilitatory cues for that association which are present at test. Here we review basic extinction and recovery-from-extinction phenomena, showing how these effects are explicable in this associative interference framework. Moreover, this orientation has and continues to dictate efficient manipulations for minimizing recovery from extinction. This in turn suggests procedures that might reduce relapse from exposure therapy for a number of psychological disorders. Some of these manipulations enhance the facilitatory cues from extinction that are present at test, others strengthen the extinction association (i.e., CS-no outcome), and yet others seem to work by a combination of these two processes. PMID:22326812
Evidence for a shared representation of sequential cues that engage sign-tracking.
Smedley, Elizabeth B; Smith, Kyle S
2018-06-19
Sign-tracking is a phenomenon whereby cues that predict rewards come to acquire their own motivational value (incentive salience) and attract appetitive behavior. Typically, sign-tracking paradigms have used single auditory, visual, or lever cues presented prior to a reward delivery. Yet, real world examples of events often can be predicted by a sequence of cues. We have shown that animals will sign-track to multiple cues presented in temporal sequence, and with time develop a bias in responding toward a reward distal cue over a reward proximal cue. Further, extinction of responding to the reward proximal cue directly decreases responding to the reward distal cue. One possible explanation of this result is that serial cues become representationally linked with one another. Here we provide further support of this by showing that extinction of responding to a reward distal cue directly reduces responding to a reward proximal cue. We suggest that the incentive salience of one cue can influence the incentive salience of the other cue. Copyright © 2018. Published by Elsevier B.V.
Kattoor, Joswin; Gizewski, Elke R.; Kotsis, Vassilios; Benson, Sven; Gramsch, Carolin; Theysohn, Nina; Maderwald, Stefan; Forsting, Michael; Schedlowski, Manfred; Elsenbruch, Sigrid
2013-01-01
Fear conditioning is relevant for elucidating the pathophysiology of anxiety, but may also be useful in the context of chronic pain syndromes which often overlap with anxiety. Thus far, no fear conditioning studies have employed aversive visceral stimuli from the lower gastrointestinal tract. Therefore, we implemented a fear conditioning paradigm to analyze the conditioned response to rectal pain stimuli using fMRI during associative learning, extinction and reinstatement. In N = 21 healthy humans, visual conditioned stimuli (CS+) were paired with painful rectal distensions as unconditioned stimuli (US), while different visual stimuli (CS−) were presented without US. During extinction, all CSs were presented without US, whereas during reinstatement, a single, unpaired US was presented. In region-of-interest analyses, conditioned anticipatory neural activation was assessed along with perceived CS-US contingency and CS unpleasantness. Fear conditioning resulted in significant contingency awareness and valence change, i.e., learned unpleasantness of a previously neutral stimulus. This was paralleled by anticipatory activation of the anterior cingulate cortex, the somatosensory cortex and precuneus (all during early acquisition) and the amygdala (late acquisition) in response to the CS+. During extinction, anticipatory activation of the dorsolateral prefrontal cortex to the CS− was observed. In the reinstatement phase, a tendency for parahippocampal activation was found. Fear conditioning with rectal pain stimuli is feasible and leads to learned unpleasantness of previously neutral stimuli. Within the brain, conditioned anticipatory activations are seen in core areas of the central fear network including the amygdala and the anterior cingulate cortex. During extinction, conditioned responses quickly disappear, and learning of new predictive cue properties is paralleled by prefrontal activation. A tendency for parahippocampal activation during reinstatement could indicate a reactivation of the old memory trace. Together, these findings contribute to our understanding of aversive visceral learning and memory processes relevant to the pathophysiology of chronic abdominal pain. PMID:23468832
Rabinak, Christine A; Mori, Shoko; Lyons, Maryssa; Milad, Mohammed R; Phan, K Luan
2017-01-01
Fear-based disorders, like social anxiety disorder (SAD) and posttraumatic stress disorder (PTSD), are characterized by an exaggerated fear response and avoidance to trigger cues, suggesting a transdiagnostic mechanism of psychopathology. Current theories suggest that abnormalities in conditioned fear is a primary contributor to the pathophysiology of these disorders. The primary goal of this study was to compare acquisition of conditioned stimulus (CS) and aversive unconditioned stimulus (US) contingencies during fear learning and extinction in individuals with SAD and PTSD. In a standard Pavlovian fear conditioning-extinction paradigm we measured subjective US expectancy ratings to different CSs in patients with SAD (n=16) compared to patients with PTSD (n=13) and healthy controls (n=15) RESULTS: Both patient groups (SAD, PTSD) acquired differential conditioning between a CS that predicted US (CS+) and a CS that never predicted the US (CS-), however, both groups reported an increased expectancy that the US would occur following the CS-. Additionally, the PTSD group overestimated that the US would occur in general. Neither patient group showed evidence of successful extinction of the CS+-US contingency nor differentiated their expectation of US occurrence between the CS+ and CS- during extinction learning. Group sample sizes were small and we did not include a trauma-exposed group without PTSD CONCLUSIONS: Both SAD and PTSD generalize expectations of an aversive outcome across CSs, even when a CS never signals an aversive outcome and PTSD may tend to over-expect threat. Fear learning and extinction abnormalities may be a core feature underlying shared symptoms across fear-based disorders. Copyright © 2016 Elsevier B.V. All rights reserved.
The hypocretin/orexin system mediates the extinction of fear memories.
Flores, África; Valls-Comamala, Victòria; Costa, Giulia; Saravia, Rocío; Maldonado, Rafael; Berrendero, Fernando
2014-11-01
Anxiety disorders are often associated with an inability to extinguish learned fear responses. The hypocretin/orexin system is involved in the regulation of emotional states and could also participate in the consolidation and extinction of aversive memories. Using hypocretin receptor-1 and hypocretin receptor-2 antagonists, hypocretin-1 and hypocretin-2 peptides, and hypocretin receptor-1 knockout mice, we investigated the role of the hypocretin system in cue- and context-dependent fear conditioning and extinction. Hypocretins were crucial for the consolidation of fear conditioning, and this effect was mainly observed in memories with a high emotional component. Notably, after the acquisition of fear memory, hypocretin receptor-1 blockade facilitated fear extinction, whereas hypocretin-1 administration impaired this extinction process. The extinction-facilitating effects of the hypocretin receptor-1 antagonist SB334867 were associated with increased expression of cFos in the basolateral amygdala and the infralimbic cortex. Intra-amygdala, but neither intra-infralimbic prefrontal cortex nor intra-dorsohippocampal infusion of SB334867 enhanced fear extinction. These results reveal a key role for hypocretins in the extinction of aversive memories and suggest that hypocretin receptor-1 blockade could represent a novel therapeutic target for the treatment of diseases associated with inappropriate retention of fear, such as post-traumatic stress disorder and phobias.
The Hypocretin/Orexin System Mediates the Extinction of Fear Memories
Flores, África; Valls-Comamala, Victòria; Costa, Giulia; Saravia, Rocío; Maldonado, Rafael; Berrendero, Fernando
2014-01-01
Anxiety disorders are often associated with an inability to extinguish learned fear responses. The hypocretin/orexin system is involved in the regulation of emotional states and could also participate in the consolidation and extinction of aversive memories. Using hypocretin receptor-1 and hypocretin receptor-2 antagonists, hypocretin-1 and hypocretin-2 peptides, and hypocretin receptor-1 knockout mice, we investigated the role of the hypocretin system in cue- and context-dependent fear conditioning and extinction. Hypocretins were crucial for the consolidation of fear conditioning, and this effect was mainly observed in memories with a high emotional component. Notably, after the acquisition of fear memory, hypocretin receptor-1 blockade facilitated fear extinction, whereas hypocretin-1 administration impaired this extinction process. The extinction-facilitating effects of the hypocretin receptor-1 antagonist SB334867 were associated with increased expression of cFos in the basolateral amygdala and the infralimbic cortex. Intra-amygdala, but neither intra-infralimbic prefrontal cortex nor intra-dorsohippocampal infusion of SB334867 enhanced fear extinction. These results reveal a key role for hypocretins in the extinction of aversive memories and suggest that hypocretin receptor-1 blockade could represent a novel therapeutic target for the treatment of diseases associated with inappropriate retention of fear, such as post-traumatic stress disorder and phobias. PMID:24930888
Early-life inflammation with LPS delays fear extinction in adult rodents.
Doenni, V M; Song, C M; Hill, M N; Pittman, Q J
2017-07-01
A large body of evidence has been brought forward connecting developmental immune activation to abnormal fear and anxiety levels. Anxiety disorders have extremely high lifetime prevalence, yet susceptibility factors that contribute to their emergence are poorly understood. In this research we investigated whether an inflammatory insult early in life can alter the response to fear conditioning in adulthood. Fear learning and extinction are important and adaptive behaviors, mediated largely by the amygdala and its interconnectivity with cortico-limbic circuits. Male and female rat pups were given LPS (100μg/kg i.p.) or saline at postnatal day 14; LPS activated cFos expression in the central amygdala 2.5h after exposure, but not the basal or lateral nuclei. When tested in adulthood, acquisition of an auditory cued or contextual learned fear memory was largely unaffected as was the extinction of fear to a conditioned context. However, we detected a deficit in auditory fear extinction in male and female rats that experienced early-life inflammation, such that there is a significant delay in fear extinction processes resulting in more sustained fear behaviors in response to a conditioned cue. This response was specific to extinction training and did not persist into extinction recall. The effect could not be explained by differences in pain threshold (unaltered) or in baseline anxiety, which was elevated in adolescent females only and unaltered in adolescent males and adult males and females. This research provides further evidence for the involvement of the immune system during development in the shaping of fear and anxiety related behaviors. Copyright © 2016 Elsevier Inc. All rights reserved.
Su, Zu-In; Wenzel, Jennifer; Baird, Rebeccah; Ettenberg, Aaron
2011-04-01
Evidence suggests that responsiveness to a drug-paired cue is predicted by the reinforcing magnitude of the drug during prior self-administration. It remains unclear, however, if this principle holds true when comparisons are made across drug reinforcers. The current study was therefore devised to test the hypothesis that differences in the animals' responsiveness to a cocaine- or heroin-paired cue presented during extinction would reflect differences in the patterns of prior cocaine and heroin runway self-administration. Rats ran a straight alley for single intravenous injections of either heroin (0.1 mg/kg/inj) or cocaine (1.0 mg/kg/inj) each paired with a distinct olfactory cue. Animals experienced 15 trials with each drug reinforcer in a counterbalanced manner. Start latencies, run times, and retreat behaviors (a form of approach-avoidance conflict) provided behavioral indices of the subjects' motivation to seek the reinforcer on each trial. Responsiveness to each drug-paired cue was assessed after 7, 14, or 21 days of non-reinforced extinction trials. Other animals underwent conditioned place preference (CPP) testing to ensure that the two drug reinforcers were capable of producing drug-cue associations. While both drugs produced comparable CPPs, heroin served as a stronger incentive stimulus in the runway as evidenced by faster start and run times and fewer retreats. In contrast, cocaine- but not heroin-paired cues produced increases in drug-seeking behavior during subsequent extinction trials. The subjects' responsiveness to drug-paired cues during extinction was not predicted by differences in the motivation to seek heroin versus cocaine during prior drug self-administration.
Fear extinction requires Arc/Arg3.1 expression in the basolateral amygdala.
Onoue, Kousuke; Nakayama, Daisuke; Ikegaya, Yuji; Matsuki, Norio; Nomura, Hiroshi
2014-04-23
Prolonged re-exposure to a fear-eliciting cue in the absence of an aversive event extinguishes the fear response to the cue, and has been clinically used as an exposure therapy. Arc (also known as Arg3.1) is implicated in synaptic and experience-dependent plasticity. Arc is regulated by the transcription factor cAMP response element binding protein, which is upregulated with and necessary for fear extinction. Because Arc expression is also activated with fear extinction, we hypothesized that Arc expression is required for fear extinction. Extinction training increased the proportion of Arc-labeled cells in the basolateral amygdala (BLA). Arc was transcribed during latter part of extinction training, which is possibly associated with fear extinction, as well as former part of extinction training. Intra-BLA infusions of Arc antisense oligodeoxynucleotide (ODN) before extinction training impaired long-term but not short-term extinction memory. Intra-BLA infusions of Arc antisense ODN 3 h after extinction training had no effect on fear extinction. Our findings demonstrate that Arc is required for long-term extinction of conditioned fear and contribute to the understanding of extinction as a therapeutic manner.
Santa Ana, Elizabeth J; Prisciandaro, James J; Saladin, Michael E; McRae-Clark, Aimee L; Shaftman, Stephanie R; Nietert, Paul J; Brady, Kathleen T
2015-04-01
Based on preclinical studies showing that the partial N-methyl-D-aspartate (NMDA) agonist D-cycloserine (DCS) facilitates extinction of cocaine self-administration and cocaine-induced conditioned place preference, we evaluated whether 50 mg of DCS would reduce craving to cocaine cues when combined with cue exposure (CE) in cocaine dependent humans. In this double-blind placebo-controlled pilot study, 47 cocaine dependent participants were randomized to DCS or placebo (PBO), plus CE. Participants received DCS or PBO 30 minutes prior to two CE sessions, conducted one day apart. Craving and heart rate was assessed prior to CE sessions, during CE trials, and after CE trials. These measures were assessed again at a 1-week follow-up (session 3) after the second CE session. DCS failed to significantly attenuate cocaine cue reactivity based on subjective craving and physiological reactivity (heart rate) compared to PBO. The CE protocol, consisting of repeated exposure to drug cues combined with skills training, resulted in extinction to cocaine cues as suggested by decreased craving within and between sessions in both treatment conditions. All participants exhibited elevated heart rate with repeated exposures, demonstrating a potentiation in heart rate between sessions. 50 mg of DCS may not be effective for extinguishing reactivity to drug cues for individuals with cocaine dependence. Future studies examining the effect of DCS on facilitating extinction to drug cues should examine variations in cue exposure length, number of CE presentations, and timing of DCS dose administration prior to cue exposures, which may differentially impact drug cue reactivity. © American Academy of Addiction Psychiatry.
Shaping memory consolidation via targeted memory reactivation during sleep.
Cellini, Nicola; Capuozzo, Alessandra
2018-05-15
Recent studies have shown that the reactivation of specific memories during sleep can be modulated using external stimulation. Specifically, it has been reported that matching a sensory stimulus (e.g., odor or sound cue) with target information (e.g., pairs of words, pictures, and motor sequences) during wakefulness, and then presenting the cue alone during sleep, facilitates memory of the target information. Thus, presenting learned cues while asleep may reactivate related declarative, procedural, and emotional material, and facilitate the neurophysiological processes underpinning memory consolidation in humans. This paradigm, which has been named targeted memory reactivation, has been successfully used to improve visuospatial and verbal memories, strengthen motor skills, modify implicit social biases, and enhance fear extinction. However, these studies also show that results depend on the type of memory investigated, the task employed, the sensory cue used, and the specific sleep stage of stimulation. Here, we present a review of how memory consolidation may be shaped using noninvasive sensory stimulation during sleep. © 2018 New York Academy of Sciences.
Baclofen facilitates the extinction of methamphetamine-induced conditioned place preference in rats
Voigt, Robin M.; Herrold, Amy A.; Napier, T. Celeste
2011-01-01
The powerful, long-lasting association between the rewarding effects of a drug and contextual cues associated with drug administration can be studied using conditioned place preference (CPP). The GABAB receptor agonist baclofen facilitates the extinction of morphine-induced CPP in mice. The current study extended this work by determining if baclofen could enhance the extinction of methamphetamine (Meth) CPP. CPP was established using a six day conditioning protocol wherein Meth-pairings were alternated with saline-pairings. Rats were subsequently administered baclofen (2mg/kg i.p. or vehicle) immediately after each daily forced extinction session, which consisted of a saline injection immediately prior to being placed into the previously Meth- or saline-paired chamber. One extinction training cycle, consisted of six once-daily forced extinction sessions, mimicking the alternating procedure established during conditioning, followed by a test for preference (Ext test). CPP persisted for at least four extinction cycles in vehicle-treated rats. In contrast, CPP was inhibited following a single extinction training cycle. These data indicate that Meth-induced CPP was resistant to extinction, but extinction training was rendered effective when the training was combined with baclofen. These findings converge with the prior demonstration of baclofen facilitating the extinction of morphine-induced CPP indicating that GABAB receptor actions are independent of the primary (unconditioned) stimulus (i.e., the opiate or the stimulant) and likely reflect mechanisms engaged by extinction learning processes per se. Thus, baclofen administered in conjunction with extinction training may be of value for addiction therapy regardless of the class of drug being abused. PMID:21463025
Naloxone effects on extinction of ethanol- and cocaine-induced conditioned place preference in mice.
Font, Laura; Houck, Christa A; Cunningham, Christopher L
2017-09-01
Previous studies found that naloxone (NLX) facilitated choice extinction of ethanol conditioned place preference (CPP) using long (60 min) test sessions, but there is little information on the variables determining this effect. These studies examined repeated exposure to NLX during extinction of ethanol- or cocaine-induced CPP using both short and long tests. DBA/2J mice were injected with NLX (0 or 10 mg/kg) before three 10- or 60-min choice extinction tests (experiment 1). All mice received a final 60-min test without NLX. Post-test NLX was given in experiment 2. Experiment 3 tested whether NLX would affect a forced extinction procedure. Experiment 4 tested its effect on extinction of cocaine-induced CPP. Pre-test (but not post-test) injections of NLX-facilitated choice extinction of ethanol CPP at both test durations. Pre-test NLX also facilitated forced extinction. However, pre-test NLX had no effect on choice extinction of cocaine CPP. Extinction test duration is not critical for engaging the opioid system during ethanol CPP extinction (experiment 1). Moreover, NLX's effect does not depend on CPP expression during extinction, just exposure to previously conditioned cues (experiment 3). The null effect of post-test NLX eliminates a memory consolidation interpretation (experiment 2) and the failure to alter cocaine CPP extinction argues against alteration of general learning or memory processes (experiment 4). Overall, these data suggest that the endogenous opioid system mediates a conditioned motivational effect that normally maintains alcohol-induced seeking behavior, which may underlie the efficacy of opiate antagonists in the treatment of alcoholism.
Extinction of cue-evoked drug-seeking relies on degrading hierarchical instrumental expectancies
Hogarth, Lee; Retzler, Chris; Munafò, Marcus R.; Tran, Dominic M.D.; Troisi, Joseph R.; Rose, Abigail K.; Jones, Andrew; Field, Matt
2014-01-01
There has long been need for a behavioural intervention that attenuates cue-evoked drug-seeking, but the optimal method remains obscure. To address this, we report three approaches to extinguish cue-evoked drug-seeking measured in a Pavlovian to instrumental transfer design, in non-treatment seeking adult smokers and alcohol drinkers. The results showed that the ability of a drug stimulus to transfer control over a separately trained drug-seeking response was not affected by the stimulus undergoing Pavlovian extinction training in experiment 1, but was abolished by the stimulus undergoing discriminative extinction training in experiment 2, and was abolished by explicit verbal instructions stating that the stimulus did not signal a more effective response-drug contingency in experiment 3. These data suggest that cue-evoked drug-seeking is mediated by a propositional hierarchical instrumental expectancy that the drug-seeking response is more likely to be rewarded in that stimulus. Methods which degraded this hierarchical expectancy were effective in the laboratory, and so may have therapeutic potential. PMID:25011113
Stimulus Processing and Associative Learning in Wistar and WKHA Rats
Chess, Amy C.; Keene, Christopher S.; Wyzik, Elizabeth C.; Bucci, David J.
2007-01-01
This study assessed basic learning and attention abilities in WKHA (Wistar-Kyoto Hyperactive) rats using appetitive conditioning preparations. Two measures of conditioned responding to a visual stimulus, orienting behavior (rearing on the hindlegs) and food cup behavior (placing the head inside the recessed food cup) were measured. In Experiment 1, simple conditioning but not extinction was impaired in WKHA rats compared to Wistar rats. In Experiment 2, non-reinforced presentations of the visual cue preceded the conditioning sessions. WKHA rats displayed less orienting behavior than Wistar rats, but comparable levels of food cup behavior. These data suggest that WKHA rats exhibit specific abnormalities in attentional processing as well as learning stimulus-reward relationships. PMID:15998198
He, Ying-Ying; Xue, Yan-Xue; Wang, Ji-shi; Fang, Qin; Liu, Jian-Feng; Xue, Li-Fen; Lu, Lin
2011-01-01
The intense associative memories that develop between drug-paired contextual cues and rewarding stimuli or the drug withdrawal-associated aversive feeling have been suggested to contribute to the high rate of relapse. Various studies have elucidated the mechanisms underlying the formation and expression of drug-related cue memories, but how this mechanism is maintained is unknown. Protein kinase M ζ (PKMζ) was recently shown to be necessary and sufficient for long-term potentiation maintenance and memory storage. In the present study, we used conditioned place preference (CPP) and aversion (CPA) to examine whether PKMζ maintains both morphine-associated reward memory and morphine withdrawal-associated aversive memory in the basolateral amygdala (BLA). We also investigate the role of PKMζ in the infralimbic cortex in the extinction memory of morphine reward-related cues and morphine withdrawal-related aversive cues. We found that intra-BLA but not central nucleus of the amygdala injection of the selective PKMζ inhibitor ZIP 1 day after CPP and CPA training impaired the expression of CPP and CPA 1 day later, and the effect of ZIP on memory lasted at least 2 weeks. Inhibiting PKMζ activity in the infralimbic cortex, but not prelimbic cortex, disrupted the expression of the extinction memory of CPP and CPA. These results indicate that PKMζ in the BLA is required for the maintenance of associative morphine reward memory and morphine withdrawal-associated aversion memory, and PKMζ in the infralimbic cortex is required for the maintenance of extinction memory of morphine reward-related cues and morphine withdrawal-related aversive cues. PMID:21633338
Swalve, Natashia; Smethells, John R; Carroll, Marilyn E
2016-07-15
Tobacco use is the largest cause of preventable mortality in the western world. Even after treatment, relapse rates for tobacco are high, and more effective pharmacological treatments are needed. Progesterone (PRO), a female hormone used in contraceptives, reduces stimulant use but its effects on tobacco addiction are unknown. Varenicline (VAR) is a commonly used medication that reduces tobacco use. The present study examined sex differences in the individual vs. combined effects of PRO and VAR on reinstatement of nicotine-seeking behavior in a rat model of relapse. Adult female and male Wistar rats self-administered nicotine (NIC, 0.03mg/kg/infusion) for 14days followed by 21days of extinction when no cues or drug were present. Rats were then divided into 4 treatment groups: control (VEH+SAL), PRO alone (PRO+SAL), VAR alone (VEH+VAR) and the combination (PRO+VAR). Reinstatement of nicotine-seeking behavior induced by priming injections of NIC or caffeine (CAF), presentation of cues (CUES), and the combination of drugs and cues (e.g. NIC+CUES, CAF+CUES) were tested after extinction. Male and female rats did not differ in self-administration of nicotine or extinction responding, and both showed elevated levels of responding to the CAF+CUES condition. However, males, but not females, reinstated active lever-pressing to the NIC+CUES condition, and that was attenuated by both VAR and VAR+PRO treatment. Thus, males were more sensitive to NIC+CUE-induced reinstatement than females, and VAR alone and VAR combined with PRO effectively reduced nicotine relapse. Copyright © 2016 Elsevier B.V. All rights reserved.
A conflict rat model of cue-induced relapse to cocaine seeking.
Cooper, Ayelet; Barnea-Ygael, Noam; Levy, Dino; Shaham, Yavin; Zangen, Abraham
2007-09-01
Relapse to drug use in humans can be induced by exposure to drug-associated cues. The ability of drug cues to provoke 'relapse' has been studied in laboratory animals using a reinstatement model in which resumption of drug seeking is assessed after extinction of drug-reinforced responding. In this model, there are no adverse consequences of drug-seeking behavior. However, in humans, abstinence is often self-imposed, and relapse episodes likely involve making a choice between the desire for the drug and the negative consequences of pursuing it (a conflict situation). In this paper, we describe a conflict model of cue-induced relapse in rats that approximate the human condition. Rats were trained to lever press for cocaine; infusions were paired with a discrete light cue. An 'electric barrier' was then introduced by electrifying the floor area near the levers. Responding decreased over days with increasing shock intensities, until the rats did not approach the levers for 3 days. Subsequently, the effect of intermittent noncontingent light-cue presentations on resumption of lever responding (relapse) was assessed in extinction tests, with the electric barrier remaining activated; during testing, lever presses led to contingent light-cue presentations. Noncontingent cue exposure led to resumption of lever presses during the relapse tests in 14 of the 24 rats. Surprisingly, 24 h later, 11 of the 24 rats resumed lever responding in a subsequent post-noncontingent cue test under similar extinction conditions. Large individual differences in responding were observed during both tests. At its current stage of development, the conflict relapse model appears particularly suitable for studying individual differences in cue-induced relapse to cocaine seeking or factors that promote this relapse.
Shi, Hai-Shui; Luo, Yi-Xiao; Yin, Xi; Wu, Hong-Hai; Xue, Gai; Geng, Xu-Hong; Hou, Yan-Ning
2015-01-01
Drug addiction is considered an aberrant form of learning, and drug-associated memories evoked by the presence of associated stimuli (drug context or drug-related cues) contribute to recurrent craving and reinstatement. Epigenetic changes mediated by DNA methyltransferase (DNMT) have been implicated in the reconsolidation of fear memory. Here, we investigated the role of DNMT activity in the reconsolidation of cocaine-associated memories. Rats were trained over 10 days to intravenously self-administer cocaine by nosepokes. Each injection was paired with a light/tone conditioned stimulus (CS). After acquisition of stable self-administration behaviour, rats underwent nosepoke extinction (10 d) followed by cue-induced reactivation and subsequent cue-induced and cocaine-priming + cue-induced reinstatement tests or subsequently tested to assess the strength of the cocaine-associated cue as a conditioned reinforcer to drive cocaine seeking behaviour. Bilateral intra-basolateral amygdala (BLA) infusion of the DNMT inhibitor5-azacytidine (5-AZA, 1 μg per side) immediately following reactivation decreased subsequent reinstatement induced by cues or cocaine priming as well as cue-maintained cocaine-seeking behaviour. In contrast, delayed intra-BLA infusion of 5-AZA 6 h after reactivation or 5-AZA infusion without reactivation had no effect on subsequent cue-induced reinstatement. These findings indicate that memory reconsolidation for a cocaine-paired stimulus depends critically on DNMT activity in the BLA. PMID:26289919
Warren, Victor Taylor; Anderson, Kemp M.; Kwon, Cliffe; Bosshardt, Lauren; Jovanovic, Tanja; Bradley, Bekh; Norrholm, Seth Davin
2015-01-01
Disruption of the reconsolidation of conditioned fear memories has been suggested as a non-pharmacological means of preventing the return of learned fear in human populations. A reconsolidation update paradigm was developed in which a reconsolidation window is opened by a single isolated retrieval trial of a previously reinforced CS+ which is then followed by Extinction Training within that window. However, follow-up studies in humans using multi-methods fear conditioning indices (e.g., fear-potentiated startle, skin conductance, US-expectancy) have failed to replicate the retrieval + extinction effects. In the present study, we further investigated the retrieval + extinction reconsolidation update paradigm by directly comparing the acquisition, extinction, and return of fear-potentiated startle in the absence or presence of US-expectancy measures (using a trial-by-trial response keypad) with and without retrieval of a previously acquired CS-US association. Participants were fear conditioned to two visual cue CS+'s, one of which was presented as a single, isolated retrieval trial before Extinction Training and one that was extinguished as usual. The results show that the inclusion of US-expectancy measures strengthens the CS–US association to provide enhanced fear conditioning and maintenance of fear memories over the experimental sessions. In addition, in the groups that used on-line US-expectancy measures, the retrieval + extinction procedure reduced reinstatement of fear-potentiated startle to both previously reinforced CS+'s, as compared to the extinction as usual group. PMID:24183839
Low-Cost Avoidance Behaviors are Resistant to Fear Extinction in Humans
Vervliet, Bram; Indekeu, Ellen
2015-01-01
Elevated levels of fear and avoidance are core symptoms across the anxiety disorders. It has long been known that fear serves to motivate avoidance. Consequently, fear extinction has been the primary focus in pre-clinical anxiety research for decades, under the implicit assumption that removing the motivator of avoidance (fear) would automatically mitigate the avoidance behaviors as well. Although this assumption has intuitive appeal, it has received little scientific scrutiny. The scarce evidence from animal studies is mixed, while the assumption remains untested in humans. The current study applied an avoidance conditioning protocol in humans to investigate the effects of fear extinction on the persistence of low-cost avoidance. Online danger-safety ratings and skin conductance responses documented the dynamics of conditioned fear across avoidance and extinction phases. Anxiety- and avoidance-related questionnaires explored individual differences in rates of avoidance. Participants first learned to click a button during a predictive danger signal, in order to cancel an upcoming aversive electrical shock (avoidance conditioning). Next, fear extinction was induced by presenting the signal in the absence of shocks while button-clicks were prevented (by removing the button in Experiment 1, or by instructing not to click the button in Experiment 2). Most importantly, post-extinction availability of the button caused a significant return of avoidant button-clicks. In addition, trait-anxiety levels correlated positively with rates of avoidance during a predictive safety signal, and with the rate of pre- to post-extinction decrease during this signal. Fear measures gradually decreased during avoidance conditioning, as participants learned that button-clicks effectively canceled the shock. Preventing button-clicks elicited a sharp increase in fear, which subsequently extinguished. Fear remained low during avoidance testing, but danger-safety ratings increased again when button-clicks were subsequently prevented. Together, these results show that low-cost avoidance behaviors can persist following fear extinction and induce increased threat appraisal. On the other hand, fear extinction did reduce augmented rates of unnecessary avoidance during safety in trait-anxious individuals, and instruction-based response prevention was more effective than removal of response cues. More research is needed to characterize the conditions under which fear extinction might mitigate avoidance. PMID:26733837
Lee, Anni S.; Fischer, Delaney K.; Van Kempen, Tracey A.; Mudragel, Vladimir; Glass, Michael J.
2017-01-01
Exposure to cocaine-associated contextual cues contributes significantly to relapse. Extinction of these contextual associations, which involves a new form of learning, reduces cocaine-seeking behavior; however, the molecular mechanisms underlying this process remain largely unknown. We report that extinction, but not acquisition, of cocaine conditioned place preference (CPP) in male mice increased Cav1.2 L-type Ca2+ channel mRNA and protein in postsynaptic density (PSD) fractions of the hippocampus, a brain region involved in drug–context associations. Moreover, viral-mediated deletion of Cav1.2 in the dorsal hippocampus attenuated extinction of cocaine CPP. Molecular studies examining downstream Cav1.2 targets revealed that extinction recruited calcium/calmodulin (Ca2+/CaMK)-dependent protein kinase II (CaMKII) to the hippocampal PSD. This occurred in parallel with an increase in phosphorylation of the AMPA GluA1 receptor subunit at serine 831 (S831), a CaMKII site, along with an increase in total PSD GluA1. The necessity of S831 GluA1 was further demonstrated by the lack of extinction in S831A GluA1 phosphomutant mice. Of note hippocampal GluA1 levels remained unaltered at the PSD, but were reduced near the PSD and at perisynaptic sites of dendritic spines in extinction-resistant S831A mutant mice. Finally, conditional knock-out of Cav1.2 in dopamine D1 receptor (D1R)-expressing cells resulted in attenuation of cocaine CPP extinction and lack of extinction-dependent changes in hippocampal PSD CaMKII expression and S831 GluA1 phosphorylation. In summary, we demonstrate an essential role for the hippocampal Cav1.2/CaMKII/S831 GluA1 pathway in cocaine CPP extinction, with data supporting contribution of hippocampal D1R-expressing cells in this process. These findings demonstrate a novel role for Cav1.2 channels in extinction of contextual cocaine-associated memories. SIGNIFICANCE STATEMENT Continued drug-seeking behavior, a defining characteristic of cocaine addiction, can be precipitated by contextual cues, yet the molecular mechanisms required for extinction of these context-specific memories remain poorly understood. Here, we have uncovered a novel and selective role of the Cav1.2 L-type Ca2+ channel and its downstream signaling pathway in the hippocampus that mediate extinction of cocaine conditioned place preference (CPP). We additionally provide evidence that supports a role of Cav1.2 within dopamine D1 receptor-expressing cells of the hippocampus for extinction of cocaine CPP. Therefore, these findings reveal a previously unknown role of Cav1.2 channels within the hippocampus and in D1 receptor-expressing cells in extinction of cocaine-associated memories, providing a framework for further exploration of mechanisms underlying extinction of cocaine-seeking behavior. PMID:29089442
Peña, David F.; Engineer, Navzer D.; McIntyre, Christa K.
2012-01-01
Background Fearful experiences can produce long-lasting and debilitating memories. Extinction of conditioned fear requires consolidation of new memories that compete with fearful associations. In human subjects, as well as rats, posttraining stimulation of the vagus nerve enhances memory consolidation. Subjects with posttraumatic stress disorder (PTSD) show impaired extinction of conditioned fear. The objective of this study was to determine whether vagus nerve stimulation (VNS) can enhance the consolidation of extinction of conditioned fear. Methods Male Sprague-Dawley rats were trained on an auditory fear conditioning task followed by 1–10 days of extinction training. Treatment with vagus nerve or sham stimulation was administered concurrently with exposure to the fear conditioned stimulus. Another group was given VNS and extinction training but the VNS was not paired with exposure to conditioned cues. Retention of fear conditioning was tested 24 hours after each treatment. Results VNS paired with exposure to conditioned cues enhanced the extinction of conditioned fear. After a single extinction trial, rats given VNS stimulation demonstrated a significantly lower level of freezing, compared to that of sham controls. When extinction trials were extended to 10 days, paired VNS accelerated extinction of the conditioned response. Conclusions Extinction paired with VNS is more rapid than extinction paired with sham stimulation. As it is currently approved by the Federal Food and Drug Administration for depression and seizure prevention, VNS is a readily-available and promising adjunct to exposure therapy for the treatment of severe anxiety disorders. PMID:23245749
Sheynin, Jony; Beck, Kevin D; Servatius, Richard J; Myers, Catherine E
2014-01-01
While avoidance behavior is often an adaptive strategy, exaggerated avoidance can be detrimental and result in the development of psychopathologies, such as anxiety disorders. A large animal literature shows that the acquisition and extinction of avoidance behavior in rodents depends on individual differences (e.g., sex, strain) and might be modulated by the presence of environmental cues. However, there is a dearth of such reports in human literature, mainly due to the lack of adequate experimental paradigms. In the current study, we employed a computer-based task, where participants control a spaceship and attempt to gain points by shooting an enemy spaceship that appears on the screen. Warning signals predict on-screen aversive events; the participants can learn a protective response to escape or avoid these events. This task has been recently used to reveal facilitated acquisition of avoidance behavior in individuals with anxiety vulnerability due to female sex or inhibited personality. Here, we extended the task to include an extinction phase, and tested the effect of signals that appeared during "safe" periods. Healthy young adults (n = 122) were randomly assigned to a testing condition with or without such signals. Results showed that the addition of safety signals during the acquisition phase impaired acquisition (in females) and facilitated extinction of the avoidance behavior. We also replicated our recent finding of an association between female sex and longer avoidance duration and further showed that females continued to demonstrate more avoidance behavior even on extinction trials when the aversive events no longer occurred. This study is the first to show sex differences on the acquisition and extinction of human avoidance behavior and to demonstrate the role of safety signals in such behavior, highlighting the potential relevance of safety signals for cognitive therapies that focus on extinction learning to treat anxiety symptoms.
Sheynin, Jony; Beck, Kevin D.; Servatius, Richard J.; Myers, Catherine E.
2014-01-01
While avoidance behavior is often an adaptive strategy, exaggerated avoidance can be detrimental and result in the development of psychopathologies, such as anxiety disorders. A large animal literature shows that the acquisition and extinction of avoidance behavior in rodents depends on individual differences (e.g., sex, strain) and might be modulated by the presence of environmental cues. However, there is a dearth of such reports in human literature, mainly due to the lack of adequate experimental paradigms. In the current study, we employed a computer-based task, where participants control a spaceship and attempt to gain points by shooting an enemy spaceship that appears on the screen. Warning signals predict on-screen aversive events; the participants can learn a protective response to escape or avoid these events. This task has been recently used to reveal facilitated acquisition of avoidance behavior in individuals with anxiety vulnerability due to female sex or inhibited personality. Here, we extended the task to include an extinction phase, and tested the effect of signals that appeared during “safe” periods. Healthy young adults (n = 122) were randomly assigned to a testing condition with or without such signals. Results showed that the addition of safety signals during the acquisition phase impaired acquisition (in females) and facilitated extinction of the avoidance behavior. We also replicated our recent finding of an association between female sex and longer avoidance duration and further showed that females continued to demonstrate more avoidance behavior even on extinction trials when the aversive events no longer occurred. This study is the first to show sex differences on the acquisition and extinction of human avoidance behavior and to demonstrate the role of safety signals in such behavior, highlighting the potential relevance of safety signals for cognitive therapies that focus on extinction learning to treat anxiety symptoms. PMID:25309373
Latagliata, Emanuele C; Lo Iacono, Luisa; Chiacchierini, Giulia; Sancandi, Marco; Rava, Alessandro; Oliva, Valeria; Puglisi-Allegra, Stefano
2017-01-01
Exposure to drug-associated cues to induce extinction is a useful strategy to contrast cue-induced drug seeking. Norepinephrine (NE) transmission in medial prefrontal cortex has a role in the acquisition and extinction of conditioned place preference induced by amphetamine. We have reported recently that NE in prelimbic cortex delays extinction of amphetamine-induced conditioned place preference (CPP). A potential involvement of α1-adrenergic receptors in the extinction of appetitive conditioned response has been also suggested, although their role in prelimbic cortex has not been yet fully investigated. Here, we investigated the effects of the α1-adrenergic receptor antagonist prazosin infusion in the prelimbic cortex of C57BL/6J mice on expression and extinction of amphetamine-induced CPP. Acute prelimbic prazosin did not affect expression of amphetamine-induced CPP on the day of infusion, while in subsequent days it produced a clear-cut advance of extinction of preference for the compartment previously paired with amphetamine (Conditioned stimulus, CS). Moreover, prazosin-treated mice that had extinguished CS preference showed increased mRNA expression of brain-derived neurotrophic factor ( BDNF ) and post-synaptic density 95 ( PSD-95 ) in the nucleus accumbens shell or core, respectively, thus suggesting that prelimbic α1-adrenergic receptor blockade triggers neural adaptations in subcortical areas that could contribute to the extinction of cue-induced drug-seeking behavior. These results show that the pharmacological blockade of α1-adrenergic receptors in prelimbic cortex by a single infusion is able to induce extinction of amphetamine-induced CPP long before control (vehicle) animals, an effect depending on contingent exposure to retrieval, since if infused far from or after reactivation it did not affect preference. Moreover, they suggest strongly that the behavioral effects depend on post-treatment neuroplasticity changes in corticolimbic network, triggered by a possible "priming" effect of prazosin, and point to a potential therapeutic power of the antagonist for maladaptive memories.
Shen, Ying-Ling; Chen, Shao-Tsu; Chan, Tzu-Yi; Hung, Tsai-Wei; Tao, Pao-Luh; Liao, Ruey-Ming; Chan, Ming-Huan; Chen, Hwei-Hsien
2016-02-01
Prenatal morphine (PM) affects the development of brain reward system and cognitive function. The present study aimed to determine whether PM exposure increases the vulnerability to MA addiction. Pregnant Sprague-Dawley rats were administered saline or morphine during embryonic days 3-20. The acquisition, extinction and reinstatement of methamphetamine (MA) conditioned place preference (CPP) and intravenous self-administration (SA) paradigms were assessed in the male adult offspring. There was no difference in the acquisition and expression of MA CPP between saline- and PM-exposed rats, whereas PM-exposed rats exhibited slower extinction and greater MA priming-induced reinstatement of drug-seeking behavior than controls. Similarly, MA SA under progressive ratio and fixed ratio schedules was not affected by PM exposure, but PM-exposed rats required more extinction sessions to reach the extinction criteria and displayed more severe MA priming-, but not cue-induced, reinstatement. Such alterations in extinction and reinstatement were not present when PM-exposed rats were tested in an equivalent paradigm assessing operant responding for food pellets. Our results demonstrate that PM exposure did not affect the association memory formation during acquisition of MA CPP or SA, but impaired extinction learning and increased MA-primed reinstatement in both tasks. These findings suggest that the offspring of women using morphine or heroin during pregnancy might predict persistent MA seeking during extinction and enhanced propensity to MA relapse although they might not be more susceptible to the reinforcing effect of MA during initiation of drug use. Copyright © 2015 Elsevier Inc. All rights reserved.
Berro, Laís F; Andersen, Monica L; Tufik, Sergio; Howell, Leonard L
2016-04-01
The objective of this study was to investigate nighttime activity of nonhuman primates during extinction and cue- and drug-primed reinstatement of methamphetamine self-administration. Adult rhesus monkeys (Macaca mulatta; n = 5) self-administered methamphetamine (0.01 mg/kg/injection, i.v.) under a fixed-ratio 20 schedule of reinforcement. Saline infusions were then substituted for methamphetamine and stimulus light (drug-conditioned stimulus presented during drug self-administration) withheld until subjects reached extinction criteria. Drug- and cue-induced reinstatement effects were evaluated after i.v. noncontingent priming injections of methamphetamine (0.03, 0.1, or 0.3 mg/kg). Activity-based sleep measures were evaluated with Actiwatch monitors a week before (baseline nighttime activity parameters) and throughout the protocol. Although methamphetamine self-administration did not significantly affect nighttime activity compared to baseline, sleeplike parameters were improved during extinction compared to self-administration maintenance. Priming injection of 0.1 mg/kg methamphetamine, but not 0.03 or 0.3 mg/kg, induced significant reinstatement effects. These behavioral responses were accompanied by nighttime outcomes, with increased sleep fragmentation and decreased sleep efficiency in the night following 0.1 mg/kg methamphetamine-induced reinstatement. In the absence of both drug and drug-paired cues (extinction conditions), nighttime activity decreased compared to self-administration maintenance. Additionally, effective reinstatement conditions impaired sleeplike measures. Our data indicate that the reintroduction of the stimulus light as a drug-paired cue increased nighttime activity. (c) 2016 APA, all rights reserved).
The Extinction and Return of Fear of Public Speaking.
Laborda, Mario A; Schofield, Casey A; Johnson, Emily M; Schubert, Jessica R; George-Denn, Daniel; Coles, Meredith E; Miller, Ralph R
2016-11-01
Prior studies indicate extinguished fear often partially returns when participants are later tested outside the extinction context. Cues carried from the extinction context to the test context sometimes reduce return of fear, but it is unclear whether such extinction cues (ECs) reduce return of fear of public speaking. Here we assessed return of fear of public speaking, and whether either of two types of ECs can attenuate it. Participants gave speeches of increasing difficulty during an exposure practice session and were tested 2 days later in a different context. Testing occurred in the presence of physical ECs, after mentally rehearsing the exposure session, or without either reminder. Practice reduced fear of public speaking, but fear partially returned at test. Neither physical nor mental ECs reduced partial return of fear of public speaking. The return of extinguished fear of public speaking, although small, was reliable, but not appreciably sensitive to presence of ECs. © The Author(s) 2016.
Su, Zu-In; Kichaev, Gleb; Wenzel, Jennifer; Ben-Shahar, Osnat; Ettenberg, Aaron
2012-01-01
Cocaine has been shown to have initial positive (euphoric) and delayed negative (anxiogenic) effects in both humans and animals. Cocaine-paired cues are consequently imbued with mixed positive and negative associations. The current study examines the relative roles of these dual associations in the enhanced drug-seeking observed upon presentation of cocaine-paired cues. Rats ran a straight alley once/day for a single i.v. injection of cocaine (1.0 mg/kg/inj) in the presence of a distinctive olfactory cue (scented cotton swabs placed under the apparatus). An alternate scent was presented in a separate cage 2-h prior to runway testing. After 15 trials/days, the scents and cocaine reinforcer were removed and a series of extinction trials (lasting for 1 or 3 weeks) was initiated. Immediately following extinction, runway responding was tested during a single trial in the presence of the cocaine-paired or non-paired cue. As previously reported, while subjects initiated responding faster over trials (reduced latencies to leave the start box), they exhibited a progressive increase in approach-avoidance conflict behavior ("retreats") regarding goal-box entry, reflecting cocaine's dual positive+negative effects. Once established, retreat behaviors persisted over the course of 1 or 3 weeks days of extinction. However, both run times and retreats decreased in response to presentation of the cocaine-paired but not the non-paired scent. These data suggest that, after reinforcer removal, cue-induced cocaine-seeking stems in part from a reduction in approach-avoidance conflict; i.e., a greater weakening of the negative relative to the positive associations that animals form with cocaine-paired stimuli. Copyright © 2011 Elsevier Inc. All rights reserved.
Theberge, Florence R.; Li, Xuan; Kambhampati, Sarita; Pickens, Charles L.; St. Laurent, Robyn; Bossert, Jennifer M.; Baumann, Michael H.; Hutchinson, Mark R.; Rice, Kenner C.; Watkins, Linda R.; Shaham, Yavin
2013-01-01
Background Recent evidence implicates toll-like receptor 4 (TLR4) in opioid analgesia, tolerance, conditioned place preference, and self-administration. Here we determined the effect of the TLR4 antagonist (+)-naltrexone (a μ-opioid receptor inactive isomer) on the time-dependent increases in cue-induced heroin seeking after withdrawal (incubation of heroin craving). Methods In an initial experiment, we trained rats for 9 h/day to self-administer heroin (0.1 mg/kg/infusion) for 9 days; lever presses were paired with a 5-sec tone-light cue. We then assessed cue-induced heroin seeking in 30-min extinction sessions on withdrawal day 1; immediately after testing, we surgically implanted rats with Alzet minipumps delivering (+)-naltrexone (0, 7.5, 15, 30 mg/kg/day, s.c.) for 14 days. We then tested the rats for incubated cue-induced heroin seeking in 3-h extinction tests on withdrawal day 13. Results We found that chronic delivery of (+)-naltrexone via minipumps during the withdrawal phase decreased incubated cue-induced heroin seeking. In follow-up experiments, we found that acute injections of (+)-naltrexone immediately before withdrawal day 13 extinction test had no effect on incubated cue-induced heroin seeking. Furthermore, chronic delivery of (+)-naltrexone (15 or 30 mg/kg/day) or acute systemic injections (15 or 30 mg/kg) had no effect on ongoing extended access heroin self-administration. Finally, in rats trained to self-administer methamphetamine (0.1 mg/kg/infusion, 9 h/d, 9 days), chronic delivery of (+)-naltrexone (30 mg/kg/day) during the withdrawal phase had no effect on incubated cue-induced methamphetamine seeking. Conclusions The present results suggest a critical role of TLR4 in the development of incubation of heroin, but not methamphetamine, craving. PMID:23384483
Inhibition of spontaneous recovery of fear by mGluR5 after prolonged extinction training.
Mao, Sheng-Chun; Chang, Chih-Hua; Wu, Chia-Chen; Orejarena, M Juliana; Orejanera, Maria Juliana; Manzoni, Olivier J; Gean, Po-Wu
2013-01-01
Fear behavior is vital for survival and involves learning contingent associations of non-threatening cues with aversive stimuli. In contrast, excessive levels of fear can be maladaptive and lead to anxiety disorders. Generally, extensive sessions of extinction training correlates with reduced spontaneous recovery. The molecular mechanisms underlying the long-term inhibition of fear recovery following repeated extinction training are not fully understood. Here we show that in rats, prolonged extinction training causes greater reduction in both fear-potentiated startle and spontaneous recovery. This effect was specifically blocked by metabotropic glutamate receptor 5 (mGluR5), but not by mGluR1 antagonists and by a protein synthesis inhibitor. Similar inhibition of memory recovery following prolonged extinction training was also observed in mice. In agreement with the instrumental role of mGluR5 in the prolonged inhibition of fear recovery, we found that FMR1-/- mice which exhibit enhanced mGluR5-mediated signaling exhibit lower spontaneous recovery of fear after extinction training than wild-type littermates. At the molecular level, we discovered that prolonged extinction training reversed the fear conditioning-induced increase in surface expression of GluR1, AMPA/NMDA ratio, postsynaptic density-95 (PSD-95) and synapse-associated protein-97 (SAP97). Accordingly, delivery of Tat-GluR2(3Y), a synthetic peptide that blocks AMPA receptor endocytosis, inhibited prolonged extinction training-induced inhibition of fear recovery. Together, our results demonstrate that prolonged extinction training results in the mGluR5-dependent long-term inhibition of fear recovery. This effect may involve the degradation of original memory and may explain the beneficial effects of prolonged exposure therapy for the treatment of phobias.
Kamboj, Sunjeev K; Massey-Chase, Rachel; Rodney, Lydia; Das, Ravi; Almahdi, Basil; Curran, H Valerie; Morgan, Celia J A
2011-09-01
The effects of D-cycloserine (DCS) in animal models of anxiety disorders and addiction indicate a role for N-methyl D-aspartate (NMDA) receptors in extinction learning. Exposure/response prevention treatments for anxiety disorders in humans are enhanced by DCS, suggesting a promising co-therapy regime, mediated by NMDA receptors. Exposure/response prevention may also be effective in problematic drinkers, and DCS might enhance habituation to cues in these individuals. Since heavy drinkers show ostensible conditioned responses to alcohol cues, habituation following exposure/response prevention should be evident in these drinkers, with DCS enhancing this effect. The objective of this study is to investigate the effect of DCS on exposure/response prevention in heavy drinkers. In a randomised, double-blind, placebo-controlled study, heavy social drinkers recruited from the community received either DCS (125 mg; n = 19) or placebo (n = 17) 1 h prior to each of two sessions of exposure/response prevention. Cue reactivity and attentional bias were assessed during these two sessions and at a third follow-up session. Between-session drinking behaviour was recorded. Robust cue reactivity and attentional bias to alcohol cues was evident, as expected of heavy drinkers. Within- and between-session habituation of cue reactivity, as well as a reduction in attentional bias to alcohol cues over time was found. However, there was no evidence of greater habituation in the DCS group. Subtle stimulant effects (increased subjective contentedness and euphoria) which were unrelated to exposure/response prevention were found following DCS. DCS does not appear to enhance habituation of alcohol cue reactivity in heavy non-dependent drinkers. Its utility in enhancing treatments based on exposure/response prevention in dependent drinkers or drug users remains open.
Jernigan, Courtney
2013-01-01
Rationale Caffeine and nicotine are the most commonly co-used psychostimulants. However, it is still unclear whether caffeine exposure enhances nicotine-seeking behavior. Objective The present study examined the effects of caffeine on nicotine-seeking in rats trained to self-administer nicotine with and without presession administration of caffeine. Methods Male Sprague–Dawley rats were trained to intravenously self-administer nicotine (0.03 mg/kg/infusion, freebase) on a fixed ratio 5 schedule of reinforcement and associate a stimulus cue with each nicotine administration. Five minutes before the sessions, the rats received an intraperitoneal administration of caffeine (5 mg/kg). Extinction tests were conducted under four conditions: presession caffeine administration, response-contingent presentation of nicotine cues, neither condition, or both conditions. Reinstatement tests were conducted after responding was extinguished by withholding presession caffeine, nicotine, and its cues. A separate group of rats trained without presession caffeine exposure was also subjected to the reinstatement tests. Results In the rats trained with presession caffeine exposure, continued caffeine administration sustained nicotine-seeking responses and interacted with nicotine cues to significantly delay the extinction of nicotine-seeking behavior. Readministration of caffeine after extinction effectively reinstated nicotine-seeking behavior. In caffeine-naive rats, caffeine administration did not reinstate extinguished nicotine-seeking behavior but significantly potentiated the cue-induced reinstatement of nicotine-seeking. Conclusion These data demonstrate that caffeine administration sustained and reinstated nicotine-seeking behavior, possibly via its acquired discriminative-stimulus properties predictive of nicotine availability. These findings suggest that smokers who attempt to quit may benefit from stopping caffeine consumption. PMID:21947355
Rihm, Julia S.; Sollberger, Silja B.; Soravia, Leila M.; Rasch, Björn
2016-01-01
Exposure therapy induces extinction learning and is an effective treatment for specific phobias. Sleep after learning promotes extinction memory and benefits therapy success. As sleep-dependent memory-enhancing effects are based on memory reactivations during sleep, here we aimed at applying the beneficial effect of sleep on therapy success by cueing memories of subjective therapy success during non-rapid eye movement sleep after in vivo exposure-based group therapy for spider phobia. In addition, oscillatory correlates of re-presentation during sleep (i.e., sleep spindles and slow oscillations) were investigated. After exposure therapy, spider-phobic patients verbalized their subjectively experienced therapy success under presence of a contextual odor. Then, patients napped for 90 min recorded by polysomnography. Half of the sleep group received the odor during sleep while the other half was presented an odorless vehicle as control. A third group served as a wake control group without odor presentation. While exposure therapy significantly reduced spider-phobic symptoms in all subjects, these symptoms could not be further reduced by re-presenting the odor associated with therapy success, probably due to a ceiling effect of the highly effective exposure therapy. However, odor re-exposure during sleep increased left-lateralized frontal slow spindle (11.0–13.0 Hz) and right-lateralized parietal fast spindle (13.0–15.0 Hz) activity, suggesting the possibility of a successful re-presentation of therapy-related memories during sleep. Future studies need to further examine the possibility to enhance therapy success by targeted memory reactivation (TMR) during sleep. PMID:27445775
Keistler, Colby R; Hammarlund, Emma; Barker, Jacqueline M; Bond, Colin W; DiLeone, Ralph J; Pittenger, Christopher; Taylor, Jane R
2017-04-26
The ability to inhibit drinking is a significant challenge for recovering alcoholics, especially in the presence of alcohol-associated cues. Previous studies have demonstrated that the regulation of cue-guided alcohol seeking is mediated by the basolateral amygdala (BLA), nucleus accumbens (NAc), and medial prefrontal cortex (mPFC). However, given the high interconnectivity between these structures, it is unclear how mPFC projections to each subcortical structure, as well as projections between BLA and NAc, mediate alcohol-seeking behaviors. Here, we evaluate how cortico-striatal, cortico-amygdalar, and amygdalo-striatal projections control extinction and relapse in a rat model of alcohol seeking. Specifically, we used a combinatorial viral technique to express diphtheria toxin receptors in specific neuron populations based on their projection targets. We then used this strategy to create directionally selective ablations of three distinct pathways after acquisition of ethanol self-administration but before extinction and reinstatement. We demonstrate that ablation of mPFC neurons projecting to NAc, but not BLA, blocks cue-induced reinstatement of alcohol seeking and neither pathway is necessary for extinction of responding. Further, we show that ablating BLA neurons that project to NAc disrupts extinction of alcohol approach behaviors and attenuates reinstatement. Together, these data provide evidence that the mPFC→NAc pathway is necessary for cue-induced reinstatement of alcohol seeking, expand our understanding of how the BLA→NAc pathway regulates alcohol behavior, and introduce a new methodology for the manipulation of target-specific neural projections. SIGNIFICANCE STATEMENT The vast majority of recovering alcoholics will relapse at least once and understanding how the brain regulates relapse will be key to developing more effective behavior and pharmacological therapies for alcoholism. Given the high interconnectivity of cortical, striatal, and limbic structures that regulate alcohol intake, it has been difficult to disentangle how separate projections between them may control different aspects of these complex behaviors. Here, we demonstrate a new approach for noninvasively ablating each of these pathways and testing their necessity for both extinction and relapse. We show that inputs to the nucleus accumbens from medial prefrontal cortex and amygdala regulate alcohol-seeking behaviors differentially, adding to our understanding of the neural control of alcoholism. Copyright © 2017 the authors 0270-6474/17/374462-10$15.00/0.
Bond, Colin W.; DiLeone, Ralph J.
2017-01-01
The ability to inhibit drinking is a significant challenge for recovering alcoholics, especially in the presence of alcohol-associated cues. Previous studies have demonstrated that the regulation of cue-guided alcohol seeking is mediated by the basolateral amygdala (BLA), nucleus accumbens (NAc), and medial prefrontal cortex (mPFC). However, given the high interconnectivity between these structures, it is unclear how mPFC projections to each subcortical structure, as well as projections between BLA and NAc, mediate alcohol-seeking behaviors. Here, we evaluate how cortico-striatal, cortico-amygdalar, and amygdalo-striatal projections control extinction and relapse in a rat model of alcohol seeking. Specifically, we used a combinatorial viral technique to express diphtheria toxin receptors in specific neuron populations based on their projection targets. We then used this strategy to create directionally selective ablations of three distinct pathways after acquisition of ethanol self-administration but before extinction and reinstatement. We demonstrate that ablation of mPFC neurons projecting to NAc, but not BLA, blocks cue-induced reinstatement of alcohol seeking and neither pathway is necessary for extinction of responding. Further, we show that ablating BLA neurons that project to NAc disrupts extinction of alcohol approach behaviors and attenuates reinstatement. Together, these data provide evidence that the mPFC→NAc pathway is necessary for cue-induced reinstatement of alcohol seeking, expand our understanding of how the BLA→NAc pathway regulates alcohol behavior, and introduce a new methodology for the manipulation of target-specific neural projections. SIGNIFICANCE STATEMENT The vast majority of recovering alcoholics will relapse at least once and understanding how the brain regulates relapse will be key to developing more effective behavior and pharmacological therapies for alcoholism. Given the high interconnectivity of cortical, striatal, and limbic structures that regulate alcohol intake, it has been difficult to disentangle how separate projections between them may control different aspects of these complex behaviors. Here, we demonstrate a new approach for noninvasively ablating each of these pathways and testing their necessity for both extinction and relapse. We show that inputs to the nucleus accumbens from medial prefrontal cortex and amygdala regulate alcohol-seeking behaviors differentially, adding to our understanding of the neural control of alcoholism. PMID:28336571
Deschaux, Olivier; Spennato, Guillaume; Moreau, Jean-Luc; Garcia, René
2011-05-01
We have recently shown that post-extinction exposure of rats to a sub-threshold reminder shock can reactivate extinguished context-related freezing and found that chronic treatment with fluoxetine before fear extinction prevents this phenomenon. In the present study, we examined whether these findings would be confirmed with auditory fear conditioning. Rats were initially submitted to a session of five tone-shock pairings with either a 0.7- or 0.1-mA shock and underwent, 3 days later, a session of 20 tone-alone trials. At the beginning of this latter session, we observed cue-conditioned freezing in rats that received the strong, but not the weak, shock. At the end, both groups (strong and weak shocks) displayed similar low levels of freezing, indicating fear extinction in rats exposed to the strong shock. These rats exhibited again high levels of cue-evoked freezing when exposed to three tone-shock pairings with 0.1-mA shock. This reemergence of cue-conditioned fear was completely abolished by chronic (over a 21-day period) fluoxetine treatment which spared, when administered before the initial fear conditioning, the original tone-shock association. These data extend our previous findings and suggest that chronic fluoxetine treatment favor extinction memory by dampening the reactivation of the original tone-shock association.
Burgdorf, Caitlin E; Schierberl, Kathryn C; Lee, Anni S; Fischer, Delaney K; Van Kempen, Tracey A; Mudragel, Vladimir; Huganir, Richard L; Milner, Teresa A; Glass, Michael J; Rajadhyaksha, Anjali M
2017-12-06
Exposure to cocaine-associated contextual cues contributes significantly to relapse. Extinction of these contextual associations, which involves a new form of learning, reduces cocaine-seeking behavior; however, the molecular mechanisms underlying this process remain largely unknown. We report that extinction, but not acquisition, of cocaine conditioned place preference (CPP) in male mice increased Ca v 1.2 L-type Ca 2+ channel mRNA and protein in postsynaptic density (PSD) fractions of the hippocampus, a brain region involved in drug-context associations. Moreover, viral-mediated deletion of Ca v 1.2 in the dorsal hippocampus attenuated extinction of cocaine CPP. Molecular studies examining downstream Ca v 1.2 targets revealed that extinction recruited calcium/calmodulin (Ca 2+ /CaMK)-dependent protein kinase II (CaMKII) to the hippocampal PSD. This occurred in parallel with an increase in phosphorylation of the AMPA GluA1 receptor subunit at serine 831 (S831), a CaMKII site, along with an increase in total PSD GluA1. The necessity of S831 GluA1 was further demonstrated by the lack of extinction in S831A GluA1 phosphomutant mice. Of note hippocampal GluA1 levels remained unaltered at the PSD, but were reduced near the PSD and at perisynaptic sites of dendritic spines in extinction-resistant S831A mutant mice. Finally, conditional knock-out of Ca v 1.2 in dopamine D1 receptor (D1R)-expressing cells resulted in attenuation of cocaine CPP extinction and lack of extinction-dependent changes in hippocampal PSD CaMKII expression and S831 GluA1 phosphorylation. In summary, we demonstrate an essential role for the hippocampal Ca v 1.2/CaMKII/S831 GluA1 pathway in cocaine CPP extinction, with data supporting contribution of hippocampal D1R-expressing cells in this process. These findings demonstrate a novel role for Ca v 1.2 channels in extinction of contextual cocaine-associated memories. SIGNIFICANCE STATEMENT Continued drug-seeking behavior, a defining characteristic of cocaine addiction, can be precipitated by contextual cues, yet the molecular mechanisms required for extinction of these context-specific memories remain poorly understood. Here, we have uncovered a novel and selective role of the Ca v 1.2 L-type Ca 2+ channel and its downstream signaling pathway in the hippocampus that mediate extinction of cocaine conditioned place preference (CPP). We additionally provide evidence that supports a role of Ca v 1.2 within dopamine D1 receptor-expressing cells of the hippocampus for extinction of cocaine CPP. Therefore, these findings reveal a previously unknown role of Ca v 1.2 channels within the hippocampus and in D1 receptor-expressing cells in extinction of cocaine-associated memories, providing a framework for further exploration of mechanisms underlying extinction of cocaine-seeking behavior. Copyright © 2017 the authors 0270-6474/17/3711895-18$15.00/0.
Rewards modulate saccade latency but not exogenous spatial attention.
Dunne, Stephen; Ellison, Amanda; Smith, Daniel T
2015-01-01
The eye movement system is sensitive to reward. However, whilst the eye movement system is extremely flexible, the extent to which changes to oculomotor behavior induced by reward paradigms persist beyond the training period or transfer to other oculomotor tasks is unclear. To address these issues we examined the effects of presenting feedback that represented small monetary rewards to spatial locations on the latency of saccadic eye movements, the time-course of learning and extinction of the effects of rewarding saccades on exogenous spatial attention and oculomotor inhibition of return. Reward feedback produced a relative facilitation of saccadic latency in a stimulus driven saccade task which persisted for three blocks of extinction trials. However, this hemifield-specific effect failed to transfer to peripheral cueing tasks. We conclude that rewarding specific spatial locations is unlikely to induce long-term, systemic changes to the human oculomotor or attention systems.
Chen, Weisheng; Wang, Yiqi; Sun, Anna; Zhou, Linyi; Xu, Wenjin; Zhu, Huaqiang; Zhuang, Dingding; Lai, Miaojun; Zhang, Fuqiang; Zhou, Wenhua; Liu, Huifen
2016-01-26
Infralimbic cortex (IL) is proposed to suppress cocaine seeking after extinction, but whether the IL regulates the extinction and reinstatement of heroin-seeking behavior is unknown. To address this issue, the male SD rats were trained to self-administer heroin under a FR1 schedule for consecutive 14 days, then the rats underwent 7 daily 2h extinction session in the operant chamber. The activation of IL by microinjection PEPA, an allosteric AMPA receptor potentiator into IL before each of extinction session facilitated the extinction responding after heroin self-administration, but did not alter the locomotor activity in an open field testing environment. Other rats were first trained under a FR1 schedule for heroin self-administration for 14 days, followed by 14 days of extinction training, and reinstatement of heroin-seeking induced by cues was measured for 2h. Intra-IL microinjecting of PEPA at 15min prior to test inhibited the reinstatement of heroin-seeking induced by cues. Moreover, the expression of GluR1 in the IL and NAc remarkably increased after treatment with PEPA during the reinstatement. These finding suggested that activation of glutamatergic projection from IL to NAc shell may be involved in the extinction and reinstatement of heroin-seeking. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.
Harrison, Erin; Biswas, Lisa; Avusula, Ramachandram; Zhang, Meiyu; Gong, Yongzhen; Liu, Xiu
2017-12-01
Increasing clinical evidence suggests that menthol, a significant flavoring additive in tobacco products, may contribute to smoking and nicotine dependence. Relapse to smoking behavior presents a formidable challenge for the treatment of tobacco addiction. An unresolved issue is whether the mentholation of tobacco products precipitates relapse to tobacco use in abstinent smokers. The present study examined the effects of menthol on the perseverance and relapse of nicotine-seeking behavior in rats. Male Sprague-Dawley rats were trained to press a lever for intravenous nicotine self-administration (0.03 mg/kg/infusion) under a fixed-ratio five schedule of reinforcement. Each nicotine infusion was signaled by the presentation of a sensory stimulus that was established as a discrete nicotine-conditioned cue. Five minutes prior to the sessions, the rats received an intraperitoneal injection of menthol (0.1 mg/kg) or vehicle. In the subsequent extinction test sessions, nicotine was unavailable with or without menthol and/or the nicotine-conditioned cue. The reinstatement tests were performed the following day after the extinction criterion was met. Menthol was also tested on food-seeking responses. In a subset of nicotine-trained rats, a transient receptor potential melastatin 8 (TRPM8) antagonist RQ-00203078 was given prior to menthol administration. Continued administration of menthol sustained responses on the previously active and nicotine-reinforced lever in the extinction tests. The readministration of menthol after extinction reinstated active lever responses. In both the extinction and the reinstatement tests, a combination of pre-session menthol administration and cue representation during the session produced a more robust behavioral effect than either menthol or the cue alone. No such effects of menthol was observed in food trained rats. RQ-00203078 did not change menthol effect on nicotine seeking. These data demonstrated that menthol specifically sustained and reinstated nicotine-seeking behavior, and this effect was independent of TRPM8 activity. These findings suggest that menthol in most tobacco products, even not menthol labeled, may contribute to the perseverance of and relapse to tobacco-seeking behavior.
Role of orbitofrontal cortex neuronal ensembles in the expression of incubation of heroin craving
Fanous, Sanya; Goldart, Evan M.; Theberge, Florence R.M.; Bossert, Jennifer M.; Shaham, Yavin; Hope, Bruce T.
2012-01-01
In humans, exposure to cues previously associated with heroin use often provokes relapse after prolonged withdrawal periods. In rats, cue-induced heroin-seeking progressively increases after withdrawal (incubation of heroin craving). Here, we examined the role of orbitofrontal cortex (OFC) neuronal ensembles in the enhanced response to heroin cues after prolonged withdrawal or the expression of incubation of heroin craving. We trained rats to self-administer heroin (6-h/d for 10 d) and assessed cue-induced heroin-seeking in extinction tests after 1 or 14 withdrawal days. Cue-induced heroin-seeking increased from 1 day to 14 days and was accompanied by increased Fos expression in ~12% of OFC neurons. Non-selective inactivation of OFC neurons with the GABA agonists baclofen+muscimol decreased cue-induced heroin-seeking on withdrawal day 14 but not day 1. We then used the Daun02 inactivation procedure to assess a causal role of the minority of selectively activated Fos-expressing OFC neurons (that presumably form cue-encoding neuronal ensembles) in cue-induced heroin-seeking after 14 withdrawal days. We trained cfos-lacZ transgenic rats to self-administer heroin and 11 days later re-exposed them to heroin-associated cues or novel cues for 15 min (induction day) followed by OFC Daun02 or vehicle injections 90 min later; we then tested the rats in extinction tests 3 days later. Daun02 selectively decreased cue-induced heroin-seeking in rats previously re-exposed to the heroin-associated cues on induction day, but not in rats previously exposed to novel cues. Results suggest that heroin-cue-activated OFC neuronal ensembles contribute to the expression of incubation of heroin craving. PMID:22915104
ERIC Educational Resources Information Center
Fricks-Gleason, Ashley N.; Marshall, John F.
2008-01-01
Contexts and discrete cues associated with drug-taking are often responsible for relapse among addicts. Animal models have shown that interference with the reconsolidation of drug-cue memories can reduce seeking of drugs or drug-paired stimuli. One such model is conditioned place preference (CPP) in which an animal is trained to associate a…
Rich, Matthew T.; Abbott, Thomas B.; Chung, Lisa; Gulcicek, Erol E.; Stone, Kathryn L.; Colangelo, Christopher M.; Lam, TuKiet T.; Nairn, Angus C.; Taylor, Jane R.
2016-01-01
Successful addiction treatment depends on maintaining long-term abstinence, making relapse prevention an essential therapeutic goal. However, exposure to environmental cues associated with drug use often thwarts abstinence efforts by triggering drug using memories that drive craving and relapse. We sought to develop a dual approach for weakening cocaine memories through phosphoproteomic identification of targets regulated in opposite directions by memory extinction compared with reconsolidation in male Sprague-Dawley rats that had been trained to self-administer cocaine paired with an audiovisual cue. We discovered a novel, inversely regulated, memory-dependent phosphorylation event on calcium-calmodulin-dependent kinase II α (CaMKIIα) at serine (S)331. Correspondingly, extinction-associated S331 phosphorylation inhibited CaMKIIα activity. Intra-basolateral amygdala inhibition of CaMKII promoted memory extinction and disrupted reconsolidation, leading to a reduction in subsequent cue-induced reinstatement. CaMKII inhibition had no effect if the memory was neither retrieved nor extinguished. Therefore, inhibition of CaMKII represents a novel mechanism for memory-based addiction treatment that leverages both extinction enhancement and reconsolidation disruption to reduce relapse-like behavior. SIGNIFICANCE STATEMENT Preventing relapse to drug use is an important goal for the successful treatment of addictive disorders. Relapse-prevention therapies attempt to interfere with drug-associated memories, but are often hindered by unintentional memory strengthening. In this study, we identify phosphorylation events that are bidirectionally regulated by the reconsolidation versus extinction of a cocaine-associated memory, including a novel site on CaMKIIα. Additionally, using a rodent model of addiction, we show that CaMKII inhibition in the amygdala can reduce relapse-like behavior. Together, our data supports the existence of mechanisms that can be used to enhance current strategies for addiction treatment. PMID:27445140
Ketamine accelerates fear extinction via mTORC1 signaling
Girgenti, Matthew J.; Ghosal, Sriparna; LoPresto, Dora; Taylor, Jane R.; Duman, Ronald S.
2018-01-01
Impaired fear extinction contributes to the persistence of post-traumatic stress disorder (PTSD), and can be utilized for the study of novel therapeutic agents. Glutamate plays an important role in the formation of traumatic memories, and in the pathophysiology and treatment of PTSD, highlighting several possible drug targets. Recent clinical studies demonstrate that infusion of ketamine, a glutamate NMDA receptor antagonist, rapidly and significantly reduces symptom severity in PTSD patients. In the present study, we examine the mechanisms underlying the actions of ketamine in a rodent model of fear conditioning, extinction, and renewal. Rats received ketamine or saline 24 h after fear conditioning and were then subjected to extinction-training on each of the following three days. Ketamine administration enhanced extinction on the second day of training (i.e., reduced freezing behavior to cue) and produced a long-lasting reduction in freezing on exposure to cue plus context 8 days later. Additionally, ketamine and extinction exposure increased levels of mTORC1 in the medial prefrontal cortex (mPFC), a region involved in the acquisition and retrieval of extinction, and infusion of the selective mTORC1 inhibitor rapamycin into the mPFC blocked the effects of ketamine on extinction. Ketamine plus extinction also increased cFos in the mPFC and administration of a glutamate-AMPA receptor antagonist blocked the effects of ketamine. These results support the hypothesis that ketamine produces long-lasting mTORC1/protein synthesis and activity dependent effects on neuronal circuits that enhance the expression of extinction and could represent a novel approach for the treatment of PTSD. PMID:28043916
Astié, Andrea A; Scardamaglia, Romina C; Muzio, Rubén N; Reboreda, Juan C
2015-10-01
Females of avian brood parasites, like the shiny cowbird (Molothrus bonariensis), locate host nests and on subsequent days return to parasitize them. This ecological pressure for remembering the precise location of multiple host nests may have selected for superior spatial memory abilities. We tested the hypothesis that shiny cowbirds show sex differences in spatial memory abilities associated with sex differences in host nest searching behavior and relative hippocampus volume. We evaluated sex differences during acquisition, reversal and retention after extinction in a visual and a spatial discrimination learning task. Contrary to our prediction, females did not outperform males in the spatial task in either the acquisition or the reversal phases. Similarly, there were no sex differences in either phase in the visual task. During extinction, in both tasks the retention of females was significantly higher than expected by chance up to 50 days after the last rewarded session (∼85-90% of the trials with correct responses), but the performance of males at that time did not differ than that expected by chance. This last result shows a long-term memory capacity of female shiny cowbirds, which were able to remember information learned using either spatial or visual cues after a long retention interval. Copyright © 2015 Elsevier B.V. All rights reserved.
Sharpe, Melissa; Killcross, Simon
2015-02-01
Previous research suggests the prelimbic (PL) cortex is involved in expression of conditioned fear (Burgos-Robles, Vidal-Gonzalez, & Quirk, 2009; Corcoran & Quirk, 2007). However, there is a long history of research in the appetitive domain which implicates this region in using higher-order cues to modulate a behavioural response (Birrell & Brown, 2000; Floresco, Block, & Tse, 2008; Marquis, Killcross, & Haddon, 2007; Sharpe & Killcross, 2014). For example, the PL cortex is necessary to allow animals to use contextual cues to disambiguate response conflict in ambiguous circumstances (Marquis et al., 2007). Using an ABA fear renewal procedure, we assessed the role of the PL cortex in using contextual cues to modulate a response towards a conditioned stimulus (CS) in an aversive setting. We found that pre-training lesions of the PL cortex did not impact on the expression or extinction of conditioned fear. Rather, they selectively abolished renewal. Functional inactivation of the PL cortex during extinction did not disrupt the subsequent renewal of conditioned fear or the ability of animals to exhibit fear towards a CS during the extinction session. However, PL inactivation during the renewal test session disrupted the ability of animals to demonstrate a reinstatement of responding in the renewal context. An analysis of orienting responses showed that renewal deficits were accompanied by a lack of change in attentional responding towards the CS. These data suggest the PL cortex uses contextual cues to modulate both a behavioural and an attentional response during aversive procedures. We argue that the role of the PL cortex in the expression of conditioned fear is to use higher-order information to modulate responding towards predictive cues in ambiguous circumstance. Copyright © 2014 Elsevier Inc. All rights reserved.
Smoking cue reactivity across massed extinction trials: negative affect and gender effects.
Collins, Bradley N; Nair, Uma S; Komaroff, Eugene
2011-04-01
Designing and implementing cue exposure procedures to treat nicotine dependence remains a challenge. This study tested the hypothesis that gender and negative affect (NA) influence changes in smoking urge over time using data from a pilot project testing the feasibility of massed extinction procedures. Forty-three smokers and ex-smokers completed the behavioral laboratory procedures. All participants were over 17 years old, smoked at least 10 cigarettes daily over the last year (or the year prior to quitting) and had expired CO below 10 ppm at the beginning of the ~4-hour session. After informed consent, participants completed 45 min of baseline assessments, and then completed a series of 12 identical, 5-minute exposure trials with inter-trial breaks. Smoking cues included visual, tactile, and olfactory cues with a lit cigarette, in addition to smoking-related motor behaviors without smoking. After each trial, participants reported urge and negative affect (NA). Logistic growth curve models supported the hypothesis that across trials, participants would demonstrate an initial linear increase followed by a decrease in smoking urge (quadratic effect). Data supported hypothesized gender, NA, and gender×NA effects. Significant linear increases in urge were observed among high and low NA males, but not among females in either NA subgroup. A differential quadratic effect showed a significant decrease in urge for the low NA subgroup, but a non-significant decrease in urge in the high NA group. This is the first study to demonstrate gender differences and the effects of NA on the extinction process using a smoking cue exposure paradigm. Results could guide future cue reactivity research and exposure interventions for nicotine dependence. Copyright © 2010 Elsevier B.V. All rights reserved.
Chen, Yu-Wei; Fiscella, Kimberly A.; Bacharach, Samuel Z.; Calu, Donna J.
2014-01-01
Background Relapse to unhealthy eating habits is a major problem in human dietary treatment. The individuals most commonly seeking dietary treatment are overweight or obese women, yet the commonly used rat reinstatement model to study relapse to palatable food seeking during dieting primarily uses normal-weight male rats. To increase the clinical relevance of the relapse to palatable food seeking model, here we pre-expose female rats to a calorically-dense cafeteria diet in the home-cage to make them overweight prior to examining the effect of this diet history on cue-, pellet-priming- and footshock-induced reinstatement of food seeking. Methods Post-natal day 32 female Long-Evans rats had seven weeks of home-cage access to either chow only or daily or intermittent cafeteria diet alongside chow. Next, they were trained to self-administer normally preferred 45 mg food pellets accompanied by a tone-light cue. After extinction, all rats were tested for reinstatement induced by discrete cue, pellet-priming, and intermittent footshock under extinction conditions. Results Access to daily cafeteria diet and to a lesser degree access to intermittent cafeteria diet decreased food pellet self-administration compared to chow-only. Prior history of these cafeteria diets also reduced extinction responding, cue- and pellet-priming-induced reinstatement. In contrast, modest stress-induced reinstatement was only observed in rats with a history of daily cafeteria diet. Conclusion A history of cafeteria diet does not increase the propensity for cue- and pellet-priming-induced relapse in the rat reinstatement model but does appear to make rats more susceptible to footshock stress-induced reinstatement. PMID:25025329
Kiefer, Falk; Kirsch, Martina; Bach, Patrick; Hoffmann, Sabine; Reinhard, Iris; Jorde, Anne; von der Goltz, Christoph; Spanagel, Rainer; Mann, Karl; Loeber, Sabine; Vollstädt-Klein, Sabine
2015-07-01
Mesocorticolimbic reactivity to alcohol-associated cues has been shown to be associated with relapse to renewed drinking and to be decreased by cue-exposure-based extinction training (CET). Evidence from preclinical studies suggests that the extinction of conditioned alcohol-seeking behavior might be facilitated by drugs increasing N-methyl-D-aspartate (NMDA) receptor-associated memory consolidation. In this study, we assessed the efficacy of CET treatment supplemented with the partial NMDA-receptor agonist D-cycloserine (DCS) at reducing mesolimbic cue reactivity (CR), craving, and relapse risk in alcoholism. In a randomized, placebo-controlled, double-blind study, we recruited 76 recently detoxified abstinent alcohol-dependent patients. Thirty-two (16 DCS, 16 placebo) patients showed cue-induced ventral-striatal activation measured with functional magnetic resonance imaging (fMRI) prior to treatment and were thus included in the efficacy analyses. After inpatient detoxification, patients underwent nine sessions of CET spaced over 3 weeks, receiving either 50 mg DCS or placebo 1 h prior to each CET session. FMRI was conducted before treatment and 3 weeks after treatment onset. Following treatment with CET plus DCS, cue-induced brain activation in the ventral and dorsal striatum was decreased compared to treatment with CET plus placebo. Elevated posttreatment ventral striatal CR and increased craving (assessed using the Obsessive Compulsive Drinking Scale) were associated with increased relapse risk. DCS was shown to augment the effect of CET for alcohol-dependent subjects. The interaction between craving and ventral-striatal CR on treatment outcome suggests that CET might be especially effective in patients exhibiting both high craving and elevated CR.
MDMA reinstates cocaine-seeking behaviour in mice.
Trigo, José Manuel; Orejarena, Maria Juliana; Maldonado, Rafael; Robledo, Patricia
2009-06-01
MDMA effects are mediated by monoaminergic systems, which seem to play a central role in cocaine craving and relapse. CD1 mice trained to self-administer cocaine (1 mg/kg/infusion) underwent an extinction procedure in which the cues contingent with drug self-administration remained present. Mice achieving extinction were injected with MDMA (10 mg/kg), d-amphetamine (1 and 2 mg/kg) or saline and tested for reinstatement. Acute MDMA, but not d-amphetamine or saline reinstated cocaine-seeking behaviour in mice in which cocaine self-administration and contingent cues were previously extinguished. Acute MDMA can reinstate cocaine-seeking behaviour in mice.
Coleman, Brian R; Carlezon, William A; Myers, Karyn M
2013-04-29
Maladaptive conditioned responses (CRs) contribute to psychiatric disorders including anxiety disorders and addiction. Methods of reducing these CRs have been considered as possible therapeutic approaches. One such method is extinction, which involves exposure to CR-eliciting cues in the absence of the event they once predicted. In animal models, extinction reduces both fear and addiction-related CRs, and in humans, extinction-based cue exposure therapy (CET) reduces fear CRs. However, CET is less effective in drug addicts, for reasons that are not clear. Increased understanding of the neurobiology of extinction of drug-related CRs as compared to fear CRs may help illuminate this issue. Here, we examine the N-methyl-d-aspartate (NMDA) receptor-dependence of extinction of conditioned opiate withdrawal in rats. Using a place conditioning paradigm, we trained morphine-dependent rats to associate an environment with naloxone-precipitated withdrawal. We then extinguished that association by returning the rats repeatedly to the environment in the absence of acute withdrawal. In some rats we administered the NMDA receptor antagonist d,l-2-amino-5-phosphovaleric acid (AP5) intracerebroventricularly immediately prior to extinction training. In a subsequent test session, these rats avoided the formerly naloxone-paired environment, similar to rats that had not undergone extinction training. By contrast, rats that received vehicle prior to extinction training did not avoid the formerly naloxone-paired environment. This finding indicates that extinction of a drug-related CR (conditioned opiate withdrawal) is dependent on NMDA receptors, similar to extinction of conditioned fear. The locus of the critical NMDA receptors is unclear but may include basolateral amygdala and/or medial prefrontal cortex. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.
Coleman, Brian R.; Carlezon, William A.; Myers, Karyn M.
2015-01-01
Maladaptive conditioned responses (CRs) contribute to psychiatric disorders including anxiety disorders and addiction. Methods of reducing these CRs have been considered as possible therapeutic approaches. One such method is extinction, which involves exposure to CR-eliciting cues in the absence of the event they once predicted. In animal models, extinction reduces both fear and addiction-related CRs, and in humans, extinction-based cue exposure therapy (CET) reduces fear CRs. However, CET is less effective in drug addicts, for reasons that are not clear. Increased understanding of the neurobiology of extinction of drug-related CRs as compared to fear CRs may help illuminate this issue. Here, we examine the N-methyl-D-aspartate (NMDA) receptor-dependence of extinction of conditioned opiate withdrawal in rats. Using a place conditioning paradigm, we trained morphine-dependent rats to associate an environment with naloxone-precipitated withdrawal. We then extinguished that association by returning the rats repeatedly to the environment in the absence of acute withdrawal. In some rats we administered the NMDA receptor antagonist D,L-2-amino-5-phosphovaleric acid (AP5) intracerebroventricularly immediately prior to extinction training. In a subsequent test session, these rats avoided the formerly naloxone-paired environment, similar to rats that had not undergone extinction training. By contrast, rats that received vehicle prior to extinction training did not avoid the formerly naloxone-paired environment. This finding indicates that extinction of a drug-related CR (conditioned opiate withdrawal) is dependent on NMDA receptors, similar to extinction of conditioned fear. The locus of the critical NMDA receptors is unclear but may include basolateral amygdala and/or medial prefrontal cortex. PMID:23416323
An unconditioned stimulus retrieval extinction procedure to prevent the return of fear memory.
Liu, Jianfeng; Zhao, Liyan; Xue, Yanxue; Shi, Jie; Suo, Lin; Luo, Yixiao; Chai, Baisheng; Yang, Chang; Fang, Qin; Zhang, Yan; Bao, Yanping; Pickens, Charles L; Lu, Lin
2014-12-01
Conditioned fear memories can be updated by extinction during reconsolidation, and this effect is specific to the reactivated conditioned stimulus (CS). However, a traumatic event can be associated with several cues, and each cue can potentially trigger recollection of the event. We introduced a technique to target all diverse cues associated with an aversive event that causes fear. In human experiments, 161 subjects underwent modified fear conditioning, in which they were exposed to an unconditioned stimulus (US) or unreinforced CS to reactivate the memory and then underwent extinction, spontaneous recovery, and reinstatement. In animal experiments, 343 rats underwent contextual fear conditioning under a similar protocol as that used in the human experiments. We also explored the molecular alterations after US reactivation in rats. Presentation of a lower intensity US before extinction disrupted the associations between the different CS and reactivated US in both humans and rats. This effect persisted for at least 6 months in humans and was selective to the reactivated US. This procedure was also effective for remote memories in both humans and rats. Compared with the CS, the US induced stronger endocytosis of alpha-amino-3-hydroxy-5-methyl-4-isoxazole propionic acid glutamate receptors 1 and 2 and stronger activation of protein kinase A, p70S6 kinase, and cyclic adenosine monophosphate response element binding protein in the dorsal hippocampus in rats. These findings demonstrate that a modified US retrieval extinction strategy may have a potential impact on therapeutic approaches to prevent the return of fear. Copyright © 2014 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.
Ploense, Kyle L; Kerstetter, Kerry A; Wade, Matthew A; Woodward, Nicholas C; Maliniak, Dan; Reyes, Michael; Uchizono, Russell S; Bredy, Timothy W; Kippin, Tod E
2013-06-01
Histone deacetylase inhibitors (HDACIs) strengthen memory following fear conditioning and cocaine-induced conditioned place preference. Here, we examined the effects of two nonspecific HDACIs, valproic acid (VPA) and sodium butyrate (NaB), on appetitive learning measured by conditioned stimulus (CS)-induced reinstatement of operant responding. Rats were trained to lever press for food reinforcement and then injected with VPA (50-200 mg/kg, i.p.), NaB (250-1000 mg/kg, i.p.), or saline vehicle (1.0 ml/kg), 2 h before receiving pairings of noncontingent presentation of food pellets preceded by a tone+light cue CS. Rats next underwent extinction of operant responding followed by response-contingent re-exposure to the CS. Rats receiving VPA (100 mg/kg) or NaB (1000 mg/kg) before conditioning displayed significantly higher cue-induced reinstatement than did saline controls. Rats that received either vehicle or VPA (100 mg/kg) before a conditioning session with a randomized relation between presentation of food pellets and the CS failed to show subsequent cue-induced reinstatement with no difference between the two groups. These findings indicate that, under certain contexts, HDACIs strengthen memory formation by specifically increasing the associative strength of the CS, not through an increasing motivation to seek reinforcement. © 2013 Wolters Kluwer Health | Lippincott Williams & Wilkins.
Ploense, Kyle L.; Kerstetter, Kerry A.; Wade, Matthew A.; Woodward, Nicholas C.; Maliniak, Dan; Reyes, Michael; Uchizono, Russell S.; Bredy, Timothy W.; Kippin, Tod E.
2014-01-01
Histone deacetylase inhibitors (HDACIs) strengthen memory following fear conditioning and cocaine-induced conditioned place preference. Here, we examined the effects of two non-specific HDACIs, valproic acid (VPA) and sodium butyrate (NaB), on appetitive learning measured via conditioned stimulus (CS)-induced reinstatement of operant responding. Rats were trained to lever press for food reinforcement and then injected with VPA (50–200 mg/kg, i.p.), NaB (250–1000 mg/kg, i.p.), or saline vehicle (1.0 ml/kg), 2h before receiving pairings of noncontingent presentation of food pellets preceded by a tone+light cue CS. Rats next underwent extinction of operant responding followed by response-contingent re-exposure to the CS. Rats receiving VPA (100 mg/kg) or NaB (1000 mg/kg) prior to conditioning displayed significantly higher cue-induced reinstatement than did saline controls. Rats that receiving either vehicle or VPA (100 mg/kg) prior to a conditioning session with a randomized relation between presentation of food pellets and the CS failed to show subsequent cue-induced reinstatement with no difference between the two groups. These findings indicate that, under certain contexts, HDACIs strengthen memory formation by specifically increasing the associative strength of the CS, not through an increasing motivation to seek reinforcement. PMID:23604166
Lindner, Katja; Neubert, Jörg; Pfannmöller, Jörg; Lotze, Martin; Hamm, Alfons O; Wendt, Julia
2015-12-01
Studying neural networks and behavioral indices such as potentiated startle responses during fear conditioning has a long tradition in both animal and human research. However, most of the studies in humans do not link startle potentiation and neural activity during fear acquisition and extinction. Therefore, we examined startle blink responses measured with electromyography (EMG) and brain activity measured with functional MRI simultaneously during differential conditioning. Furthermore, we combined these behavioral fear indices with brain network activity by analyzing the brain activity evoked by the startle probe stimulus presented during conditioned visual threat and safety cues as well as in the absence of visual stimulation. In line with previous research, we found a fear-induced potentiation of the startle blink responses when elicited during a conditioned threat stimulus and a rapid decline of amygdala activity after an initial differentiation of threat and safety cues in early acquisition trials. Increased activation during processing of threat cues was also found in the anterior insula, the anterior cingulate cortex (ACC), and the periaqueductal gray (PAG). More importantly, our results depict an increase of brain activity to probes presented during threatening in comparison to safety cues indicating an involvement of the anterior insula, the ACC, the thalamus, and the PAG in fear-potentiated startle processing during early extinction trials. Our study underlines that parallel assessment of fear-potentiated startle in fMRI paradigms can provide a helpful method to investigate common and distinct processing pathways in humans and animals and, thus, contributes to translational research. Copyright © 2015 Elsevier B.V. All rights reserved.
Santa Ana, Elizabeth J.; Prisciandaro, James J.; Saladin, Michael E.; McRae-Clark, Aimee L.; Shaftman, Stephanie R.; Nietert, Paul J.; Brady, Kathleen T.
2014-01-01
Background Based on preclinical studies showing that the partial N-methyl-d-aspartate (NMDA) agonist d-cycloserine (DCS) facilitates extinction of cocaine self-administration and cocaine-induced conditioned place preference, we evaluated whether 50 mg of DCS would reduce craving to cocaine cues when combined with cue exposure (CE) in cocaine dependent humans. Methods In this double-blind placebo-controlled pilot study, 47 cocaine dependent participants were randomized to DCS or placebo (PBO), plus CE. Participants received DCS or PBO 30 minutes prior to two CE sessions, conducted one day apart. Craving and heart rate was assessed prior to CE sessions, during CE trials, and after CE trials. These measures were assessed again at a 1-week follow-up (session 3) after the second CE session. Results DCS failed to significantly attenuate cocaine cue reactivity based on subjective craving and physiological reactivity (heart rate) compared to PBO. The CE protocol, consisting of repeated exposure to drug cues combined with skills training, resulted in extinction to cocaine cues as suggested by decreased craving within and between sessions in both treatment conditions. All participants exhibited elevated heart rate with repeated exposures, demonstrating a potentiation in heart rate between sessions. PMID:25808169
Ketamine accelerates fear extinction via mTORC1 signaling.
Girgenti, Matthew J; Ghosal, Sriparna; LoPresto, Dora; Taylor, Jane R; Duman, Ronald S
2017-04-01
Impaired fear extinction contributes to the persistence of post-traumatic stress disorder (PTSD), and can be utilized for the study of novel therapeutic agents. Glutamate plays an important role in the formation of traumatic memories, and in the pathophysiology and treatment of PTSD, highlighting several possible drug targets. Recent clinical studies demonstrate that infusion of ketamine, a glutamate NMDA receptor antagonist, rapidly and significantly reduces symptom severity in PTSD patients. In the present study, we examine the mechanisms underlying the actions of ketamine in a rodent model of fear conditioning, extinction, and renewal. Rats received ketamine or saline 24h after fear conditioning and were then subjected to extinction-training on each of the following three days. Ketamine administration enhanced extinction on the second day of training (i.e., reduced freezing behavior to cue) and produced a long-lasting reduction in freezing on exposure to cue plus context 8days later. Additionally, ketamine and extinction exposure increased levels of mTORC1 in the medial prefrontal cortex (mPFC), a region involved in the acquisition and retrieval of extinction, and infusion of the selective mTORC1 inhibitor rapamycin into the mPFC blocked the effects of ketamine on extinction. Ketamine plus extinction also increased cFos in the mPFC and administration of a glutamate-AMPA receptor antagonist blocked the effects of ketamine. These results support the hypothesis that ketamine produces long-lasting mTORC1/protein synthesis and activity dependent effects on neuronal circuits that enhance the expression of extinction and could represent a novel approach for the treatment of PTSD. Copyright © 2017 Elsevier Inc. All rights reserved.
Troisi, Joseph R.
2014-01-01
Drug abuse remains costly. Drug-related cues can evoke cue-reactivity and craving, contributing to relapse. The Pavlovian extinction-based cue-exposure therapy (CET) has not been very successful in treating drug abuse. A functional operant analysis of complex rituals involved in CET is outlined and reinterpreted as an operant heterogeneous chain maintained by observing responses, conditioned reinforcers, and discriminative stimuli. It is further noted that operant functions are not predicated on Pavlovian processes but can be influenced by them in contributing to relapse; several empirical studies from the animal and human literature highlight this view. Cue-reactivity evoked by Pavlovian processes is conceptualized as an operant establishing/motivating operation. CET may be more effective in incorporating an operant-based approach that takes into account the complexity of Pavlovian–operant interaction. Extinction of the operant chain coupled with the shaping of alternative behaviors is proposed as an integrated therapy. It is proposed that operant-based drug abuse treatments (contingency management, voucher programs, and the therapeutic work environment) might consider incorporating cue-reactivity, as establishing/motivating operations, to increase long-term success—a hybrid approach based on Pavlovian–operant interaction. PMID:25346551
Troisi, Joseph R
2013-01-01
Drug abuse remains costly. Drug-related cues can evoke cue-reactivity and craving, contributing to relapse. The Pavlovian extinction-based cue-exposure therapy (CET) has not been very successful in treating drug abuse. A functional operant analysis of complex rituals involved in CET is outlined and reinterpreted as an operant heterogeneous chain maintained by observing responses, conditioned reinforcers, and discriminative stimuli. It is further noted that operant functions are not predicated on Pavlovian processes but can be influenced by them in contributing to relapse; several empirical studies from the animal and human literature highlight this view. Cue-reactivity evoked by Pavlovian processes is conceptualized as an operant establishing/motivating operation. CET may be more effective in incorporating an operant-based approach that takes into account the complexity of Pavlovian-operant interaction. Extinction of the operant chain coupled with the shaping of alternative behaviors is proposed as an integrated therapy. It is proposed that operant-based drug abuse treatments (contingency management, voucher programs, and the therapeutic work environment) might consider incorporating cue-reactivity, as establishing/motivating operations, to increase long-term success-a hybrid approach based on Pavlovian-operant interaction.
Sex differences in discriminating between cues predicting threat and safety.
Day, Harriet L L; Reed, Molly M; Stevenson, Carl W
2016-09-01
Post-traumatic stress disorder (PTSD) is more prevalent in women than men. PTSD is characterized by overgeneralization of fear to innocuous stimuli and involves impaired inhibition of learned fear by cues that predict safety. While evidence indicates that learned fear inhibition through extinction differs in males and females, less is known about sex differences in fear discrimination and safety learning. Here we examined auditory fear discrimination in male and female rats. In Experiment 1A, rats underwent 1-3days of discrimination training consisting of one tone predicting threat (CS+; presented with footshock) and another tone predicting safety (CS-; presented alone). Females, but not males, discriminated between the CS+ and CS- after one day of training. After 2-3days of training, however, males discriminated whereas females generalized between the CS+ and CS-. In Experiment 1B, females showed enhanced anxiety-like behaviour and locomotor activity in the open field, although these results were unlikely to explain the sex differences in fear discrimination. In Experiment 2, we found no differences in shock sensitivity between males and females. In Experiment 3, males and females again discriminated and generalized, respectively, after three days of training. Moreover, fear generalization in females resulted from impaired safety learning, as shown by a retardation test. Whereas subsequent fear conditioning to the previous CS- retarded learning in males, females showed no such retardation. These results suggest that, while females show fear discrimination with limited training, they show fear generalization with extended training due to impaired safety learning. Copyright © 2016 The Author(s). Published by Elsevier Inc. All rights reserved.
Orexin / hypocretin signaling at the OX1 receptor regulates cue-elicited cocaine-seeking
Smith, Rachel J.; See, Ronald E.; Aston-Jones, Gary
2009-01-01
The orexin / hypocretin system has recently been implicated in reward-processing and addiction. We examined the involvement of the orexin system in cue-induced reinstatement of extinguished cocaine-seeking by administering the orexin 1 receptor (OX1R) antagonist SB-334867, or the orexin 2 receptor (OX2R) antagonist 4-pyridylmethyl (S)-tert-leucyl 6,7-dimethoxy-1,2,3,4-tetrahydroisoquinoline (4PT), prior to reinstatement testing. Male Sprague-Dawley rats self-administered cocaine in 2-hour sessions for 10 days, followed by extinction training. Reinstatement of cocaine-seeking was elicited by presentation of tone + light cues previously paired with cocaine infusions. SB-334867 (10, 20, 30 mg/kg) dose-dependently decreased cue-induced reinstatement of cocaine-seeking without significantly affecting responding during late extinction. 4PT (10, 30 mg/kg) did not significantly alter cue-induced reinstatement. In separate experiments, the highest doses of SB-334867 and 4PT had no significant effect on established cocaine self-administration, and 4PT reduced spontaneous activity in a locomotor test to a greater extent than SB-334867. Finally, SB-334867 (30 mg/kg) had no effect on the acquisition of cocaine-paired cues during a Pavlovian cocaine-stimulus conditioning session in the operant chamber. Pretreatment with SB-334867 prior to the Pavlovian acquisition session had no effect on subsequent cue-induced reinstatement of cocaine-seeking elicited by those cues. However, pretreatment with SB-334867 prior to a second reinstatement session significantly attenuated the expression of cue-induced reinstatement. These results show that orexin transmission at OX1R, but not OX2R, is necessary for the reinstatement of cocaine-seeking elicited by drug-paired cues, and that orexin signaling is not critical for cocaine reinforcement or cocaine-stimulus conditioning. PMID:19656173
Degoulet, Mickael; Stelly, Claire E.; Ahn, Kee-Chan; Morikawa, Hitoshi
2015-01-01
Drug addiction is driven, in part, by powerful and enduring memories of sensory cues associated with drug intake. As such, relapse to drug use during abstinence is frequently triggered by an encounter with drug-associated cues, including the drug itself. L-type Ca2+ channels (LTCCs) are known to regulate different forms of synaptic plasticity, the major neural substrate for learning and memory, in various brain areas. Long-term potentiation (LTP) of NMDA receptor (NMDAR)-mediated glutamatergic transmission in the ventral tegmental area (VTA) may contribute to the increased motivational valence of drug-associated cues triggering relapse. In this study, using rat brain slices, we found that isradipine, a general LTCC antagonist used as antihypertensive medication, not only blocks the induction of NMDAR LTP but also promotes the reversal of previously induced LTP in the VTA. In behaving rats, isradipine injected into the VTA suppressed the acquisition of cocaine-paired contextual cue memory assessed using a conditioned place preference (CPP) paradigm. Furthermore, administration of isradipine or a CaV1.3 subtype-selective LTCC antagonist (systemic or intra-VTA) before a single extinction or reinstatement session, while having no immediate effect at the time of administration, abolished previously acquired cocaine and alcohol (ethanol) CPP on subsequent days. Notably, CPP thus extinguished cannot be reinstated by drug re-exposure, even after 2 weeks of withdrawal. These results suggest that LTCC blockade during exposure to drug-associated cues may cause unlearning of the increased valence of those cues, presumably via reversal of glutamatergic synaptic plasticity in the VTA. PMID:26100537
Degoulet, M; Stelly, C E; Ahn, K-C; Morikawa, H
2016-03-01
Drug addiction is driven, in part, by powerful and enduring memories of sensory cues associated with drug intake. As such, relapse to drug use during abstinence is frequently triggered by an encounter with drug-associated cues, including the drug itself. L-type Ca(2+) channels (LTCCs) are known to regulate different forms of synaptic plasticity, the major neural substrate for learning and memory, in various brain areas. Long-term potentiation (LTP) of NMDA receptor (NMDAR)-mediated glutamatergic transmission in the ventral tegmental area (VTA) may contribute to the increased motivational valence of drug-associated cues triggering relapse. In this study, using rat brain slices, we found that isradipine, a general LTCC antagonist used as antihypertensive medication, not only blocks the induction of NMDAR LTP but also promotes the reversal of previously induced LTP in the VTA. In behaving rats, isradipine injected into the VTA suppressed the acquisition of cocaine-paired contextual cue memory assessed using a conditioned place preference (CPP) paradigm. Furthermore, administration of isradipine or a CaV1.3 subtype-selective LTCC antagonist (systemic or intra-VTA) before a single extinction or reinstatement session, while having no immediate effect at the time of administration, abolished previously acquired cocaine and alcohol (ethanol) CPP on subsequent days. Notably, CPP thus extinguished cannot be reinstated by drug re-exposure, even after 2 weeks of withdrawal. These results suggest that LTCC blockade during exposure to drug-associated cues may cause unlearning of the increased valence of those cues, presumably via reversal of glutamatergic synaptic plasticity in the VTA.
Lu, Guan-Yi; Wu, Ning; Zhang, Zhao-Long; Ai, Jing; Li, Jin
2011-10-10
d-Cycloserine (DCS), a partial agonist at the strychnine-insensitive glycine recognition site on the N-methyl-d-aspartate (NMDA) receptor complex, has been shown to facilitate the extinction and prevent the relapse of cocaine-induced conditioned place preference (CPP) when administered before or after each extinction trail. However, some studies have suggested that DCS does not influence or even enhance relapse of seeking behavior on cocaine self-administration (SA) in rats or cocaine-dependent individuals undergoing clinical exposure treatment. Furthermore, there are no reports on the effects of DCS and the extinction of morphine-conditioned behaviors in mice. The present study investigated the effects of DCS on extinction by exposing mice to drug-paired cues and the subsequent reinstatement of morphine-primed CPP. Our results showed that DCS at doses of 7.5, 15, and 30mg/kg did not induce conditioned appetitive or aversive effects and DCS combined with morphine conditioning failed to affect the acquisition of morphine-induced CPP. Moreover, pretreatment with DCS (7.5, 15, and 30mg/kg, i.p.) prior to extinction training had no significant effects on the extinction and subsequent morphine-primed reinstatement of morphine-induced CPP. These results suggested that DCS may not be a powerful adjunct for cue exposure therapy of opioid addiction. In view of differing outcomes in both preclinical and clinical studies, the potential of DCS in exposure treatment of drug-seeking behaviors should be carefully evaluated. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.
Merlo, Emiliano; Milton, Amy L; Goozée, Zara Y; Theobald, David E; Everitt, Barry J
2014-02-12
Memory persistence is critically influenced by retrieval. In rats, a single presentation of a conditioned fear stimulus induces memory reconsolidation and fear memory persistence, while repeated fear cue presentations result in loss of fear through extinction. These two opposite behavioral outcomes are operationally linked by the number of cue presentations at memory retrieval. However, the behavioral properties and mechanistic determinants of the transition have not yet been explored; in particular, whether reconsolidation and extinction processes coexist or are mutually exclusive, depending on the exposure to non-reinforced retrieval events. We characterized both behaviorally and molecularly the transition from reconsolidation to extinction of conditioned fear and showed that an increase in calcineurin (CaN) in the basolateral amygdala (BLA) supports the shift from fear maintenance to fear inhibition. Gradually increasing the extent of retrieval induces a gradual decrease in freezing responses to the conditioned stimulus and a gradual increase in amygdala CaN level. This newly synthesized CaN is required for the extinction, but not the reconsolidation, of conditioned fear. During the transition from reconsolidation to extinction, we have revealed an insensitive state of the fear memory where NMDA-type glutamate receptor agonist and antagonist drugs are unable either to modulate CaN levels in the BLA or alter the reconsolidation or extinction processes. Together, our data indicate both that reconsolidation and extinction are mutually exclusive processes and also reveal the presence of a transitional, or "limbo," state of the original memory between these two alternative outcomes of fear memory retrieval, when neither process is engaged.
Psychological and Neural Mechanisms of Experimental Extinction: A Selective Review
Delamater, Andrew R.; Westbrook, R. Frederick
2013-01-01
The present review examines key psychological concepts in the study of experimental extinction and implications these have for an understanding of the underlying neurobiology of extinction learning. We suggest that many of the signature characteristics of extinction learning (spontaneous recovery, renewal, reinstatement, rapid reacquisition) can be accommodated by the standard associative learning theory assumption that extinction results in partial erasure of the original learning together with new inhibitory learning. Moreover, we consider recent behavioral and neural evidence that supports the partial erasure view of extinction, but also note shortcomings in our understanding of extinction circuits as these relate to the negative prediction error concept. Recent work suggests that common prediction error and stimulus-specific prediction error terms both may be required to explain neural plasticity both in acquisition and extinction learning. In addition, we suggest that many issues in the content of extinction learning have not been fully addressed in current research, but that neurobiological approaches should be especially helpful in addressing such issues. These include questions about the nature of extinction learning (excitatory CS-No US, inhibitory CS-US learning, occasion setting processes), especially as this relates to studies of the micro-circuitry of extinction, as well as its representational content (sensory, motivational, response). An additional understudied problem in extinction research is the role played by attention processes and their underlying neural networks, although some research and theory converge on the idea that extinction is accompanied by attention decrements (i.e., habituation-like processes). PMID:24104049
Psychological and neural mechanisms of experimental extinction: a selective review.
Delamater, Andrew R; Westbrook, R Frederick
2014-02-01
The present review examines key psychological concepts in the study of experimental extinction and implications these have for an understanding of the underlying neurobiology of extinction learning. We suggest that many of the signature characteristics of extinction learning (spontaneous recovery, renewal, reinstatement, rapid reacquisition) can be accommodated by the standard associative learning theory assumption that extinction results in partial erasure of the original learning together with new inhibitory learning. Moreover, we consider recent behavioral and neural evidence that supports the partial erasure view of extinction, but also note shortcomings in our understanding of extinction circuits as these relate to the negative prediction error concept. Recent work suggests that common prediction error and stimulus-specific prediction error terms both may be required to explain neural plasticity both in acquisition and extinction learning. In addition, we suggest that many issues in the content of extinction learning have not been fully addressed in current research, but that neurobiological approaches should be especially helpful in addressing such issues. These include questions about the nature of extinction learning (excitatory CS-No US, inhibitory CS-US learning, occasion setting processes), especially as this relates to studies of the micro-circuitry of extinction, as well as its representational content (sensory, motivational, response). An additional understudied problem in extinction research is the role played by attention processes and their underlying neural networks, although some research and theory converge on the idea that extinction is accompanied by attention decrements (i.e., habituation-like processes). Copyright © 2013 Elsevier Inc. All rights reserved.
Rich, Matthew T; Abbott, Thomas B; Chung, Lisa; Gulcicek, Erol E; Stone, Kathryn L; Colangelo, Christopher M; Lam, TuKiet T; Nairn, Angus C; Taylor, Jane R; Torregrossa, Mary M
2016-07-20
Successful addiction treatment depends on maintaining long-term abstinence, making relapse prevention an essential therapeutic goal. However, exposure to environmental cues associated with drug use often thwarts abstinence efforts by triggering drug using memories that drive craving and relapse. We sought to develop a dual approach for weakening cocaine memories through phosphoproteomic identification of targets regulated in opposite directions by memory extinction compared with reconsolidation in male Sprague-Dawley rats that had been trained to self-administer cocaine paired with an audiovisual cue. We discovered a novel, inversely regulated, memory-dependent phosphorylation event on calcium-calmodulin-dependent kinase II α (CaMKIIα) at serine (S)331. Correspondingly, extinction-associated S331 phosphorylation inhibited CaMKIIα activity. Intra-basolateral amygdala inhibition of CaMKII promoted memory extinction and disrupted reconsolidation, leading to a reduction in subsequent cue-induced reinstatement. CaMKII inhibition had no effect if the memory was neither retrieved nor extinguished. Therefore, inhibition of CaMKII represents a novel mechanism for memory-based addiction treatment that leverages both extinction enhancement and reconsolidation disruption to reduce relapse-like behavior. Preventing relapse to drug use is an important goal for the successful treatment of addictive disorders. Relapse-prevention therapies attempt to interfere with drug-associated memories, but are often hindered by unintentional memory strengthening. In this study, we identify phosphorylation events that are bidirectionally regulated by the reconsolidation versus extinction of a cocaine-associated memory, including a novel site on CaMKIIα. Additionally, using a rodent model of addiction, we show that CaMKII inhibition in the amygdala can reduce relapse-like behavior. Together, our data supports the existence of mechanisms that can be used to enhance current strategies for addiction treatment. Copyright © 2016 the authors 0270-6474/16/367613-15$15.00/0.
Mahler, Stephen V.; Moorman, David E.; Feltenstein, Matthew W.; Cox, Brittney M.; Ogburn, Katelyn B.; Bachar, Michal; McGonigal, Justin T.; Ghee, Shannon M.; See, Ronald E.
2012-01-01
Rats emit ultrasonic vocalizations (USVs) in a variety of contexts, and it is increasingly clear that USVs reflect more complex information than mere positive and negative affect states. We sought to examine USVs in a common model of addiction and relapse, the self-administration/reinstatement paradigm, in order to gain insight into subjective states experienced by rats during various types of methamphetamine seeking. We measured three subtypes of “50kHz” USVs [flats, trills, and non-trill frequency modulated USVs (FMs)], as well as long and short duration “22kHz” USVs, during self-administration and extinction training, and during reinstatement elicited by cues, a methamphetamine prime, cues + prime, or the pharmacological stressor yohimbine. During self-administration and extinction, rats emitted many flats and FMs, (and short duration “22kHz” USVs on day 1 of self-administration), but few trills. In contrast, methamphetamine priming injections potently enhanced FMs and trills, and trill production was correlated with the degree of methamphetamine + cue-elicited reinstatement. Cues alone yielded increases only in flat USVs during reinstatement, though a subset of rats displaying strong cue-induced reinstatement also emitted long duration, aversion-related “22kHz” USVs. Although yohimbine administration caused reinstatement, it did not induce “22kHz” USVs in methamphetamine-experienced or methamphetamine-naïve rats (unlike footshock stress, which did induce long duration “22kHz” USVs). These findings demonstrate heterogeneity of rat USVs emitted during different types of methamphetamine seeking, and highlight their potential usefulness for gaining insight into the subjective states of rats in rodent models of drug addiction and relapse. PMID:22940018
A hierarchical instrumental decision theory of nicotine dependence.
Hogarth, Lee; Troisi, Joseph R
2015-01-01
It is important to characterize the learning processes governing tobacco-seeking in order to understand how best to treat this behavior. Most drug learning theories have adopted a Pavlovian framework wherein the conditioned response is the main motivational process. We favor instead a hierarchical instrumental decision account, wherein expectations about the instrumental contingency between voluntary tobacco-seeking and the receipt of nicotine reward determines the probability of executing this behavior. To support this view, we review titration and nicotine discrimination research showing that internal signals for deprivation/satiation modulate expectations about the current incentive value of smoking, thereby modulating the propensity of this behavior. We also review research on cue-reactivity which has shown that external smoking cues modulate expectations about the probability of the tobacco-seeking response being effective, thereby modulating the propensity of this behavior. Economic decision theory is then considered to elucidate how expectations about the value and probability of response-nicotine contingency are integrated to form an overall utility estimate for that option for comparison with qualitatively different, nonsubstitute reinforcers, to determine response selection. As an applied test for this hierarchical instrumental decision framework, we consider how well it accounts for individual liability to smoking uptake and perseveration, pharmacotherapy, cue-extinction therapies, and plain packaging. We conclude that the hierarchical instrumental account is successful in reconciling this broad range of phenomenon precisely because it accepts that multiple diverse sources of internal and external information must be integrated to shape the decision to smoke.
A requirement for memory retrieval during and after long-term extinction learning
Ouyang, Ming; Thomas, Steven A.
2005-01-01
Current learning theories are based on the idea that learning is driven by the difference between expectations and experience (the delta rule). In extinction, one learns that certain expectations no longer apply. Here, we test the potential validity of the delta rule by manipulating memory retrieval (and thus expectations) during extinction learning. Adrenergic signaling is critical for the time-limited retrieval (but not acquisition or consolidation) of contextual fear. Using genetic and pharmacologic approaches to manipulate adrenergic signaling, we find that long-term extinction requires memory retrieval but not conditioned responding. Identical manipulations of the adrenergic system that do not affect memory retrieval do not alter extinction. The results provide substantial support for the delta rule of learning theory. In addition, the timing over which extinction is sensitive to adrenergic manipulation suggests a model whereby memory retrieval occurs during, and several hours after, extinction learning to consolidate long-term extinction memory. PMID:15947076
Domain general learning: Infants use social and non-social cues when learning object statistics
Barry, Ryan A.; Graf Estes, Katharine; Rivera, Susan M.
2015-01-01
Previous research has shown that infants can learn from social cues. But is a social cue more effective at directing learning than a non-social cue? This study investigated whether 9-month-old infants (N = 55) could learn a visual statistical regularity in the presence of a distracting visual sequence when attention was directed by either a social cue (a person) or a non-social cue (a rectangle). The results show that both social and non-social cues can guide infants’ attention to a visual shape sequence (and away from a distracting sequence). The social cue more effectively directed attention than the non-social cue during the familiarization phase, but the social cue did not result in significantly stronger learning than the non-social cue. The findings suggest that domain general attention mechanisms allow for the comparable learning seen in both conditions. PMID:25999879
d-Cycloserine facilitates extinction learning and enhances extinction-related brain activation.
Klass, Anne; Glaubitz, Benjamin; Tegenthoff, Martin; Lissek, Silke
2017-10-01
Extinction learning is modulated by N-methyl d-aspartate receptors (NMDAR) particularly in prefrontal and hippocampal brain regions. The use of of NMDA agonists in exposure therapy of anxiety disorders has been investigated in various patient groups. Behavioral results showed beneficial effects of pre-learning administration of the partial NMDAR agonist d-Cycloserine (DCS) on therapy success. However, the impact of DCS upon non-fear-related contextual extinction, and associated recruitment of extinction-relevant brain regions is as yet unknown. In the present fMRI study, healthy human participants performed a context-related associative learning and extinction task. A single dose of DCS, administered prior to extinction learning, enhanced extinction learning performance in an identical context, and increased activation in prefrontal, temporal as well as hippocampal/insular regions, compared to placebo controls. In contrast, DCS did not affect extinction learning in a novel context, nor the renewal effect, which describes the recovery of an extinguished response if the context of extinction differs from the context of recall. Our findings demonstrate a specific involvement of prefrontal and hippocampal NMDAR in the modification of established stimulus-outcome associations in identical contexts and thus their role in behavioral flexibility, underlining their potential for enhancing AAA extinction learning. Copyright © 2017. Published by Elsevier Inc.
Bouton, Mark E.; Winterbauer, Neil E.; Todd, Travis P.
2012-01-01
It is widely recognized that extinction (the procedure in which a Pavlovian conditioned stimulus or an instrumental action is repeatedly presented without its reinforcer) weakens behavior without erasing the original learning. Most of the experiments that support this claim have focused on several “relapse” effects that occur after Pavlovian extinction, which collectively suggest that the original learning is saved through extinction. However, although such effects do occur after instrumental extinction, they have not been explored there in as much detail. This article reviews recent research in our laboratory that has investigated three relapse effects that occur after the extinction of instrumental (operant) learning. In renewal, responding returns after extinction when the behavior is tested in a different context; in resurgence, responding recovers when a second response that has been reinforced during extinction of the first is itself put on extinction; and in rapid reacquisition, extinguished responding returns rapidly when the response is reinforced again. The results provide new insights into extinction and relapse, and are consistent with principles that have been developed to explain extinction and relapse as they occur after Pavlovian conditioning. Extinction of instrumental learning, like Pavlovian learning, involves new learning that is relatively dependent on the context for expression. PMID:22450305
Wan, Xun; Torregrossa, Mary M; Sanchez, Hayde; Nairn, Angus C; Taylor, Jane R
2014-01-01
The intracellular mechanisms underlying memory reconsolidation critically involve cAMP signaling. These events were originally attributed to PKA activation by cAMP, but the identification of Exchange Protein Activated by cAMP (Epac), as a distinct mediator of cAMP signaling, suggests that cAMP-regulated processes that subserve memory reconsolidation are more complex. Here we investigated how activation of Epac with 8-pCPT-cAMP (8-CPT) impacts reconsolidation of a memory that had been associated with cocaine self-administration. Rats were trained to lever press for cocaine on an FR-1 schedule, in which each cocaine delivery was paired with a tone+light cue. Lever pressing was then extinguished in the absence of cue presentations and cocaine delivery. Following the last day of extinction, rats were put in a novel context, in which the conditioned cue was presented to reactivate the cocaine-associated memory. Immediate bilateral infusions of 8-CPT into the basolateral amygdala (BLA) following reactivation disrupted subsequent cue-induced reinstatement in a dose-dependent manner, and modestly reduced responding for conditioned reinforcement. When 8-CPT infusions were delayed for 3 hours after the cue reactivation session or were given after a cue extinction session, no effect on cue-induced reinstatement was observed. Co-administration of 8-CPT and the PKA activator 6-Bnz-cAMP (10 nmol/side) rescued memory reconsolidation while 6-Bnz alone had no effect, suggesting an antagonizing interaction between the two cAMP signaling substrates. Taken together, these studies suggest that activation of Epac represents a parallel cAMP-dependent pathway that can inhibit reconsolidation of cocaine-cue memories and reduce the ability of the cue to produce reinstatement of cocaine-seeking behavior.
Sanchez, Hayde; Nairn, Angus C.; Taylor, Jane R.
2014-01-01
The intracellular mechanisms underlying memory reconsolidation critically involve cAMP signaling. These events were originally attributed to PKA activation by cAMP, but the identification of Exchange Protein Activated by cAMP (Epac), as a distinct mediator of cAMP signaling, suggests that cAMP-regulated processes that subserve memory reconsolidation are more complex. Here we investigated how activation of Epac with 8-pCPT-cAMP (8-CPT) impacts reconsolidation of a memory that had been associated with cocaine self-administration. Rats were trained to lever press for cocaine on an FR-1 schedule, in which each cocaine delivery was paired with a tone+light cue. Lever pressing was then extinguished in the absence of cue presentations and cocaine delivery. Following the last day of extinction, rats were put in a novel context, in which the conditioned cue was presented to reactivate the cocaine-associated memory. Immediate bilateral infusions of 8-CPT into the basolateral amygdala (BLA) following reactivation disrupted subsequent cue-induced reinstatement in a dose-dependent manner, and modestly reduced responding for conditioned reinforcement. When 8-CPT infusions were delayed for 3 hours after the cue reactivation session or were given after a cue extinction session, no effect on cue-induced reinstatement was observed. Co-administration of 8-CPT and the PKA activator 6-Bnz-cAMP (10 nmol/side) rescued memory reconsolidation while 6-Bnz alone had no effect, suggesting an antagonizing interaction between the two cAMP signaling substrates. Taken together, these studies suggest that activation of Epac represents a parallel cAMP-dependent pathway that can inhibit reconsolidation of cocaine-cue memories and reduce the ability of the cue to produce reinstatement of cocaine-seeking behavior. PMID:25259911
Forcadell, Eduard; Torrents-Rodas, David; Vervliet, Bram; Leiva, David; Tortella-Feliu, Miquel; Fullana, Miquel A
2017-11-01
Fear extinction models have a key role in our understanding of anxiety disorders and their treatment with exposure therapy. Here, we tested whether individual differences in fear extinction learning and fear extinction recall in the laboratory were associated with the outcomes of an exposure therapy analog (ETA). Fifty adults with fear of spiders participated in a two-day fear-learning paradigm assessing fear extinction learning and fear extinction recall, and then underwent a brief ETA. Correlational analyses indicated that enhanced extinction learning was associated with better ETA outcome. Our results partially support the idea that individual differences in fear extinction learning may be associated with exposure therapy outcome, but suggest that further research in this area is needed. Copyright © 2017 Elsevier B.V. All rights reserved.
Tomilenko, R A; Dubrovina, N I
2006-03-01
Influence of agonist (D-cycloserine) and antagonist (dizocilpine) N-methyl-D-aspartate receptors on learning and extinction of passive avoidance response in medium-, high-, and low-anxious mice was studied. In medium-anxious mice, D-cycloserine (30 mg/kg) although not changing learning accelerated development of extinction, whereas dizocilpine (0.15 mg/kg), while impairing passive avoidance learning, detained the extinction. In high-anxious mice with good retrieval of memory trace and absence of extinction, D-cycloserine was ineffective, whereas dizocilpine reduced learning and promoted retention of memory trace retrieval at the generated level on extinction. In low-anxious mice, D-cycloserine impaired learning and accelerated extinction, whereas dizocilpine completely blocked learning and retention of passive avoidance response.
Orbitofrontal Cortical Neurons Encode Expectation-Driven Initiation of Reward-Seeking
Aston-Jones, Gary
2014-01-01
Adaptive execution and inhibition of behavior are guided by the activity of neuronal populations across multiple frontal cortical areas. The rodent medial prefrontal cortex has been well studied with respect to these behaviors, influencing behavioral execution/inhibition based on context. Other frontal regions, in particular the orbitofrontal cortex (OFC), are critical in directing behavior to obtain rewards, but the relationship between OFC neuronal activity and response execution or inhibition has been poorly characterized. In particular, little is known about OFC with respect to extinction learning, an important example of context-guided response inhibition. Here, we recorded the activity of OFC neurons while rats performed a discriminative-stimulus (DS)-driven sucrose-seeking task followed by multiple days of extinction of the DS. OFC neuronal activity was maximally responsive (1) to reward-predicting stimuli (RS) that triggered a lever press (i.e., lever-response initiation) and (2) during reward-well approach in pursuit of sucrose (i.e., well-response initiation). RS presentation that was not followed by a lever press or RS presentation during extinction produced weak activation, as did nonrewarded stimulus (NS) presentation regardless of response (press or withhold) or session (DS-sucrose or extinction). Activity related to nonrewarded well entry was minor, and activity was significantly inhibited during reward consumption. Finally, OFC neuronal activity switched selectivity to track rewarded behaviors when the RS/NS contingencies were reversed. Thus, rather than signaling variables related to extinction or response inhibition, activity in OFC was strongest at the initiation of multiple components of reward-seeking behavior, most prominently when valid reward-predicting cues drove these behaviors. PMID:25080585
Golisch, Anne; Heba, Stefanie; Glaubitz, Benjamin; Tegenthoff, Martin; Lissek, Silke
2017-01-01
A distributed network including prefrontal and hippocampal regions is involved in context-related extinction learning as well as in renewal. Renewal describes the recovery of an extinguished response if the context of extinction differs from the context of recall. Animal studies have demonstrated that prefrontal, but not hippocampal N-methyl-D-aspartate receptor (NMDAR) antagonism disrupted extinction learning and processing of task context. However, human studies of NMDAR in extinction learning are lacking, while NMDAR antagonism yielded contradictory results in other learning tasks. This fMRI study investigated the role of NMDAR for human behavioral and brain activation correlates of extinction and renewal. Healthy volunteers received a single dose of the NMDAR antagonist memantine prior to extinction of previously acquired stimulus-outcome associations presented in either identical or novel contexts. We observed better, and partly faster, extinction learning in participants receiving the NMDAR antagonist compared to placebo. However, memantine did not affect renewal. In both extinction and recall, the memantine group showed a deactivation in extinction-related brain regions, particularly in the prefrontal cortex, while hippocampal activity was increased. This higher hippocampal activation was in turn associated with the participants' body mass index (BMI) and extinction errors. Our results demonstrate potentially dose-related enhancing effects of memantine and highlight involvement of hippocampal NMDAR in context-related extinction learning. PMID:28326025
ERIC Educational Resources Information Center
Redish, A. David; Jensen, Steve; Johnson, Adam; Kurth-Nelson, Zeb
2007-01-01
Because learned associations are quickly renewed following extinction, the extinction process must include processes other than unlearning. However, reinforcement learning models, such as the temporal difference reinforcement learning (TDRL) model, treat extinction as an unlearning of associated value and are thus unable to capture renewal. TDRL…
Social Cues Alter Implicit Motor Learning in a Serial Reaction Time Task.
Geiger, Alexander; Cleeremans, Axel; Bente, Gary; Vogeley, Kai
2018-01-01
Learning is a central ability for human development. Many skills we learn, such as language, are learned through observation or imitation in social contexts. Likewise, many skills are learned implicitly, that is, without an explicit intent to learn and without full awareness of the acquired knowledge. Here, we asked whether performance in a motor learning task is modulated by social vs. object cues of varying validity. To address this question, we asked participants to carry out a serial reaction time (SRT) task in which, on each trial, people have to respond as fast and as accurately as possible to the appearance of a stimulus at one of four possible locations. Unbeknownst to participants, the sequence of successive locations was sequentially structured, so that knowledge of the sequence facilitates anticipation of the next stimulus and hence faster motor responses. Crucially, each trial also contained a cue pointing to the next stimulus location. Participants could thus learn based on the cue, or on learning about the sequence of successive locations, or on a combination of both. Results show an interaction between cue type and cue validity for the motor responses: social cues (vs. object cues) led to faster responses in the low validity (LV) condition only. Concerning the extent to which learning was implicit, results show that in the cued blocks only, the highly valid social cue led to implicit learning. In the uncued blocks, participants showed no implicit learning in the highly valid social cue condition, but did in all other combinations of stimulus type and cueing validity. In conclusion, our results suggest that implicit learning is context-dependent and can be influenced by the cue type, e.g., social and object cues.
McHugh, Stephen B; Marques-Smith, Andre; Li, Jennifer; Rawlins, J N P; Lowry, John; Conway, Michael; Gilmour, Gary; Tricklebank, Mark; Bannerman, David M
2013-01-01
Lesion and electrophysiological studies in rodents have identified the amygdala and hippocampus (HPC) as key structures for Pavlovian fear conditioning, but human functional neuroimaging studies have not consistently found activation of these structures. This could be because hemodynamic responses cannot detect the sparse neuronal activity proposed to underlie conditioned fear. Alternatively, differences in experimental design or fear levels could account for the discrepant findings between rodents and humans. To help distinguish between these alternatives, we used tissue oxygen amperometry to record hemodynamic responses from the basolateral amygdala (BLA), dorsal HPC (dHPC) and ventral HPC (vHPC) in freely-moving rats during the acquisition and extinction of conditioned fear. To enable specific comparison with human studies we used a discriminative paradigm, with one auditory cue [conditioned stimulus (CS)+] that was always followed by footshock, and another auditory cue (CS−) that was never followed by footshock. BLA tissue oxygen signals were significantly higher during CS+ than CS− trials during training and early extinction. In contrast, they were lower during CS+ than CS− trials by the end of extinction. dHPC and vHPC tissue oxygen signals were significantly lower during CS+ than CS− trials throughout extinction. Thus, hemodynamic signals in the amygdala and HPC can detect the different patterns of neuronal activity evoked by threatening vs. neutral stimuli during fear conditioning. Discrepant neuroimaging findings may be due to differences in experimental design and/or fear levels evoked in participants. Our methodology offers a way to improve translation between rodent models and human neuroimaging. PMID:23173719
New operant model of reinstatement of food-seeking behavior in mice.
Martín-García, Elena; Burokas, Aurelijus; Kostrzewa, Elzbieta; Gieryk, Agnieszka; Korostynski, Michal; Ziolkowska, Barbara; Przewlocka, Barbara; Przewlocki, Ryszard; Maldonado, Rafael
2011-05-01
A major problem in treating obesity is the high rate of relapse to abnormal food-taking behavior when maintaining diet. The present study evaluates the reinstatement of extinguished palatable food-seeking behavior induced by cues previously associated with the palatable food, re-exposure to this food, or stress. The participation of the opioid and dopamine mechanisms in the acquisition, extinction, and cue-induced reinstatement was also investigated. C57BL/6 mice were first trained on a fixed-ratio-1 schedule of reinforcement to obtain chocolate-flavored pellets during 20 days, which was associated to a stimulus light. Operant behavior was then extinguished during 20 daily sessions. mRNA levels of opioid peptide precursors and dopamine receptors were evaluated in the brain by in situ hybridization and RT-PCR techniques. A reinstatement of food-seeking behavior was only obtained after exposure to the food-associated cue. A down-regulation of prodynorphin mRNA was found in the dorsal striatum and nucleus accumbens after the acquisition, extinction, and reinstatement of the operant behavior. Extinction and reinstatement of this operant response enhanced proenkephalin mRNA in the dorsal striatum and/or the nucleus accumbens core. Down-regulation of D2 receptor expression was observed in the dorsal striatum and nucleus accumbens after reinstatement. An up-regulation of PDYN mRNA expression was found in the hypothalamus after extinction and reinstatement. This study provides a new operant model in mice for the evaluation of food-taking behavior and reveals specific changes in the dopamine and opioid system associated to the behavioral responses directed to obtain a natural reward.
A Reminder of Extinction Reduces Relapse in an Animal Model of Voluntary Behavior
ERIC Educational Resources Information Center
Nieto, Javier; Uengoer, Metin; Bernal-Gamboa, Rodolfo
2017-01-01
One experiment with rats explored whether an extinction-cue prevents the recovery of extinguished lever-pressing responses. Initially, rats were trained to perform one instrumental response (R1) for food in Context A, and a different instrumental response (R2) in Context B. Then, responses were extinguished each in the alternate context (R1 in…
Mao, Yu; Yang, Shang-Chuan; Liu, Chang; Ma, Yuan-Ye; Hu, Xin-Tian
2011-12-01
To interfere with the drug-cue memory processes of addicts such as reconsolidation by the administration of the β-adrenergic receptor (β-AR) of norepinephrine (NE) antagonist propranolol (PRO) has become a potential therapy in the future to decrease or inhibit relapse. However, the relationship between PRO and the acquisition or retrieval of morphine-cue memory is not clear. This study examined the effects of PRO on the acquisition and retrieval of memories in morphine-induced conditioned place preference (CPP) mice model. We found that during memory acquisition period, PRO had no effects on the expression and extinction of morphine-CPP, which suggests that the β-AR was irrelevant to the CPP memory acquisition. However, during memory retrieval period, although PRO did not affect the expression of CPP, but it delayed the occurrence of CPP extinction, which indicates that PRO has an inhibit effect on CPP memory extinction, and β-AR plays an important role in modulating the extinction of morphine-CPP. Our study further improved the relationship between drug addiction and β-AR, and proposed a new theory to help developing potential therapy to cure addiction and other neuropsychiatric disorders.
Vieira, Philip A; Corches, Alex; Lovelace, Jonathan W; Westbrook, Kevin B; Mendoza, Michael; Korzus, Edward
2015-03-01
N-methyl-D-aspartate receptors (NMDARs) are critically involved in various learning mechanisms including modulation of fear memory, brain development and brain disorders. While NMDARs mediate opposite effects on medial prefrontal cortex (mPFC) interneurons and excitatory neurons, NMDAR antagonists trigger profound cortical activation. The objectives of the present study were to determine the involvement of NMDARs expressed specifically in excitatory neurons in mPFC-dependent adaptive behaviors, specifically fear discrimination and fear extinction. To achieve this, we tested mice with locally deleted Grin1 gene encoding the obligatory NR1 subunit of the NMDAR from prefrontal CamKIIα positive neurons for their ability to distinguish frequency modulated (FM) tones in fear discrimination test. We demonstrated that NMDAR-dependent signaling in the mPFC is critical for effective fear discrimination following initial generalization of conditioned fear. While mice with deficient NMDARs in prefrontal excitatory neurons maintain normal responses to a dangerous fear-conditioned stimulus, they exhibit abnormal generalization decrement. These studies provide evidence that NMDAR-dependent neural signaling in the mPFC is a component of a neural mechanism for disambiguating the meaning of fear signals and supports discriminative fear learning by retaining proper gating information, viz. both dangerous and harmless cues. We also found that selective deletion of NMDARs from excitatory neurons in the mPFC leads to a deficit in fear extinction of auditory conditioned stimuli. These studies suggest that prefrontal NMDARs expressed in excitatory neurons are involved in adaptive behavior. Copyright © 2015 Elsevier Inc. All rights reserved.
Meng, Min; Zhao, Xinhan; Dang, Yonghui; Ma, Jingyuan; Li, Lixu; Gu, Shanzhi
2013-06-26
It is well established that brain-derived neurotrophic factor (BDNF) plays a pivotal role in brain plasticity-related processes, such as learning, memory and drug addiction. However, changes in expression of BDNF splice variants after acquisition, extinction and reinstatement of cue-elicited morphine seeking behavior have not yet been investigated. Real-time PCR was used to assess BDNF splice variants (I, II, IV and VI) in various brain regions during acquisition, extinction and reinstatement of morphine-conditioned place preference (CPP) in mice. Repeated morphine injections (10mg/kg, i.p.) increased expression of BDNF splice variants II, IV and VI in the hippocampus, caudate putamen (CPu) and nucleus accumbens (NAcc). Levels of BDNF splice variants decreased after extinction training and continued to decrease during reinstatement induced by a morphine priming injection (10mg/kg, i.p.). However, after reinstatement induced by exposure to 6 min of forced swimming (FS), expression of BDNF splice variants II, IV and VI was increased in the hippocampus, CPu, NAcc and prefrontal cortex (PFC). After reinstatement induced by 40 min of restraint, expression of BDNF splice variants was increased in PFC. These results show that exposure to either morphine or acute stress can induce reinstatement of drug-seeking, but expression of BDNF splice variants is differentially affected by chronic morphine and acute stress. Furthermore, BDNF splice variants II, IV and VI may play a role in learning and memory for morphine addiction in the hippocampus, CPu and NAcc. Crown Copyright © 2013. Published by Elsevier B.V. All rights reserved.
Hogarth, Lee; Chase, Henry W
2012-06-01
Individual differences in drug dependence may be mediated by several abnormalities in associative learning, including perseveration of drug-seeking following contingency change, greater control over drug-seeking by Pavlovian stimuli, or greater sensitivity to drug reinforcement establishing higher rates of drug-seeking. To evaluate these three candidate markers for nicotine dependence, Experiment 1 contrasted daily (N = 22) and nondaily smoker groups (N = 22) on a novel instrumental learning task, where one S+ was first trained as a predictor of tobacco reward before being extinguished. Experiment 2 compared daily (N = 18) and nondaily smoker groups (N = 18) on a concurrent-choice task for tobacco and chocolate reward before an extinction test in which the tobacco response was extinguished, followed by a Pavlovian-to-instrumental transfer test, wherein the impact of tobacco and chocolate cues on concurrent choice was measured (gender was balanced within each smoker group). The results showed no group difference in sensitivity to extinction of either the stimulus-drug or response-drug contingency in Experiments 1 and 2, respectively, nor did groups show a difference in Pavlovian-to-instrumental transfer of control over tobacco choice. By contrast, nicotine-dependence status was marked by a higher frequency of tobacco choice in the concurrent-choice procedure, and this choice preference was associated with subjective craving (gender did not affect any behavioral measure). These results favor the view that nicotine dependence in this sample is not determined by individual predilection for perseveration or stimulus-control over drug-seeking, but by greater sensitivity to reinforcement of instrumental drug choice. Value-based decision theories of dependence are discussed.
Ebner, Stephanie R; Larson, Erin B; Hearing, Matthew C; Ingebretson, Anna E; Thomas, Mark J
2018-06-07
Experience-dependent synaptic plasticity is an important component of both learning and motivational disturbances found in addicted individuals. Here, we investigated the role of cocaine experience-dependent plasticity at excitatory synapses in the nucleus accumbens shell (NAcSh) in relapse-related behavior in mice with a history of volitional cocaine self-administration. Using an extinction/reinstatement paradigm of cocaine-seeking behavior, we demonstrate that cocaine-experienced mice with extinguished cocaine-seeking behavior show potentiation of synaptic strength at excitatory inputs onto NAcSh medium spiny neurons (MSNs). Conversely, we found that exposure to various distinct types of reinstating stimuli (cocaine, cocaine-associated cues, yohimbine "stress") after extinction can produce a relative depotentiation of NAcSh synapses that is strongly associated with the magnitude of cocaine-seeking behavior exhibited in response to these challenges. Furthermore, we show that these effects are due to α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid receptor (AMPAR)-specific mechanisms that differ depending on the nature and context of the reinstatement-inducing stimuli. Together, our findings identify common themes as well as differential mechanisms that are likely important for the ability of diverse environmental stimuli to drive relapse to addictive-like cocaine-seeking behavior. Copyright © 2018. Published by Elsevier Ltd.
Restoration of Kv7 Channel-Mediated Inhibition Reduces Cued-Reinstatement of Cocaine Seeking.
Parrilla-Carrero, Jeffrey; Buchta, William C; Goswamee, Priyodarshan; Culver, Oliver; McKendrick, Greer; Harlan, Benjamin; Moutal, Aubin; Penrod, Rachel; Lauer, Abigail; Ramakrishnan, Viswanathan; Khanna, Rajesh; Kalivas, Peter; Riegel, Arthur C
2018-04-25
Cocaine addicts display increased sensitivity to drug-associated cues, due in part to changes in the prelimbic prefrontal cortex (PL-PFC). The cellular mechanisms underlying cue-induced reinstatement of cocaine seeking remain unknown. Reinforcement learning for addictive drugs may produce persistent maladaptations in intrinsic excitability within sparse subsets of PFC pyramidal neurons. Using a model of relapse in male rats, we sampled >600 neurons to examine spike frequency adaptation (SFA) and afterhyperpolarizations (AHPs), two systems that attenuate low-frequency inputs to regulate neuronal synchronization. We observed that training to self-administer cocaine or nondrug (sucrose) reinforcers decreased SFA and AHPs in a subpopulation of PL-PFC neurons. Only with cocaine did the resulting hyperexcitability persist through extinction training and increase during reinstatement. In neurons with intact SFA, dopamine enhanced excitability by inhibiting Kv7 potassium channels that mediate SFA. However, dopamine effects were occluded in neurons from cocaine-experienced rats, where SFA and AHPs were reduced. Pharmacological stabilization of Kv7 channels with retigabine restored SFA and Kv7 channel function in neuroadapted cells. When microinjected bilaterally into the PL-PFC 10 min before reinstatement testing, retigabine reduced cue-induced reinstatement of cocaine seeking. Last, using cFos-GFP transgenic rats, we found that the loss of SFA correlated with the expression of cFos-GFP following both extinction and re-exposure to drug-associated cues. Together, these data suggest that cocaine self-administration desensitizes inhibitory Kv7 channels in a subpopulation of PL-PFC neurons. This subpopulation of neurons may represent a persistent neural ensemble responsible for driving drug seeking in response to cues. SIGNIFICANCE STATEMENT Long after the cessation of drug use, cues associated with cocaine still elicit drug-seeking behavior, in part by activation of the prelimbic prefrontal cortex (PL-PFC). The underlying cellular mechanisms governing these activated neurons remain unclear. Using a rat model of relapse to cocaine seeking, we identified a population of PL-PFC neurons that become hyperexcitable following chronic cocaine self-administration. These neurons show persistent loss of spike frequency adaptation, reduced afterhyperpolarizations, decreased sensitivity to dopamine, and reduced Kv7 channel-mediated inhibition. Stabilization of Kv7 channel function with retigabine normalized neuronal excitability, restored Kv7 channel currents, and reduced drug-seeking behavior when administered into the PL-PFC before reinstatement. These data highlight a persistent adaptation in a subset of PL-PFC neurons that may contribute to relapse vulnerability. Copyright © 2018 the authors 0270-6474/18/384212-18$15.00/0.
Stress-enhanced fear learning in rats is resistant to the effects of immediate massed extinction
Long, Virginia A.; Fanselow, Michael S.
2014-01-01
Enhanced fear learning occurs subsequent to traumatic or stressful events and is a persistent challenge to the treatment of post-traumatic stress disorder (PTSD). Facilitation of learning produced by prior stress can elicit an exaggerated fear response to a minimally aversive event or stimulus. Stress-enhanced fear learning (SEFL) is a rat model of PTSD; rats previously exposed to the SEFL 15 electrical shocks procedure exhibit several behavioral responses similar to those seen in patients with PTSD. However, past reports found that SEFL is not mitigated by extinction (a model of exposure therapy) when the spaced extinction began 24 h after stress. Recent studies found that extinction from 10 min to 1 h subsequent to fear conditioning “erased” learning, whereas later extinction, occurring from 24 to 72 h after conditioning did not. Other studies indicate that massed extinction is more effective than spaced procedures. Therefore, we examined the time-dependent nature of extinction on the stress-induced enhancement of fear learning using a massed trial’s procedure. Experimental rats received 15 foot shocks and were given either no extinction or massed extinction 10 min or 72 h later. Our present data indicate that SEFL, following traumatic stress, is resistant to immediate massed extinction. Experimental rats showed exaggerated new fear learning regardless of when extinction training occurred. Thus, post-traumatic reactivity such as SEFL does not seem responsive to extinction treatments. PMID:22176467
Interaction between scene-based and array-based contextual cueing.
Rosenbaum, Gail M; Jiang, Yuhong V
2013-07-01
Contextual cueing refers to the cueing of spatial attention by repeated spatial context. Previous studies have demonstrated distinctive properties of contextual cueing by background scenes and by an array of search items. Whereas scene-based contextual cueing reflects explicit learning of the scene-target association, array-based contextual cueing is supported primarily by implicit learning. In this study, we investigated the interaction between scene-based and array-based contextual cueing. Participants searched for a target that was predicted by both the background scene and the locations of distractor items. We tested three possible patterns of interaction: (1) The scene and the array could be learned independently, in which case cueing should be expressed even when only one cue was preserved; (2) the scene and array could be learned jointly, in which case cueing should occur only when both cues were preserved; (3) overshadowing might occur, in which case learning of the stronger cue should preclude learning of the weaker cue. In several experiments, we manipulated the nature of the contextual cues present during training and testing. We also tested explicit awareness of scenes, scene-target associations, and arrays. The results supported the overshadowing account: Specifically, scene-based contextual cueing precluded array-based contextual cueing when both were predictive of the location of a search target. We suggest that explicit, endogenous cues dominate over implicit cues in guiding spatial attention.
Fenton, Georgina E; Halliday, David M; Mason, Rob; Bredy, Timothy W; Stevenson, Carl W
2016-11-01
Sex differences in learned fear expression and extinction involve the medial prefrontal cortex (mPFC). We recently demonstrated that enhanced learned fear expression during auditory fear extinction and its recall is linked to persistent theta activation in the prelimbic (PL) but not infralimbic (IL) cortex of female rats. Emerging evidence indicates that gamma oscillations in mPFC are also implicated in the expression and extinction of learned fear. Therefore we re-examined our in vivo electrophysiology data and found that females showed persistent PL gamma activation during extinction and a failure of IL gamma activation during extinction recall. Altered prefrontal gamma oscillations thus accompany sex differences in learned fear expression and its extinction. These findings are relevant for understanding the neural basis of post-traumatic stress disorder, which is more prevalent in women and involves impaired extinction and mPFC dysfunction. Copyright © 2016 Elsevier Inc. All rights reserved.
Javanbakht, Arash; Duval, Elizabeth R; Cisneros, Maria E; Taylor, Stephan F; Kessler, Daniel; Liberzon, Israel
2017-08-01
The effects of instruction on learning of fear and safety are rarely studied. We aimed to examine the effects of cognitive information and experience on fear learning. Fourty healthy participants, randomly assigned to three groups, went through fear conditioning, extinction learning, and extinction recall with two conditioned stimuli (CS+). Information was presented about the presence or absence of conditioned stimulus-unconditioned stimulus (CS-US) contingency at different stages of the experiment. Information about the CS-US contingency prior to fear conditioning enhanced fear response and reduced extinction recall. Information about the absence of CS-US contingency promoted extinction learning and recall, while omission of this information prior to recall resulted in fear renewal. These findings indicate that contingency information can facilitate fear expression during fear learning, and can facilitate extinction learning and recall. Information seems to function as an element of the larger context in which conditioning occurs.
Tomilenko, R A; Dubrovina, N I
2007-06-01
The effects of an agonist (D-cycloserine) and an antagonist (dizocilpine) of N-methyl-D-aspartate (NMDA) receptors on the learning and extinction of a conditioned passive avoidance response were studied in mice with low, intermediate, and high levels of anxiety. In intermediate-anxiety mice, D-cycloserine (30 mg/kg) had no effect on learning but accelerated extinction, while dizocilpine (0.15 mg/kg) degraded acquisition of the reflex but delayed extinction. In high-anxiety mice, with good learning and no extinction, D-cycloserine had no effect, while dizocilpine decreased learning and facilitated retention of performance of the memory trace at the ongoing level in conditions promoting extinction. In low-anxiety mice, D-cycloserine degraded learning and accelerated extinction, while dizocilpine completely blocked learning and the retention of the passive avoidance response.
Effects of sleep on memory for conditioned fear and fear extinction
Pace-Schott, Edward F.; Germain, Anne; Milad, Mohammed R.
2015-01-01
Learning and memory for extinction of conditioned fear is a basic mammalian mechanism for regulating negative emotion. Sleep promotes both the consolidation of memory and the regulation of emotion. Sleep can influence consolidation and modification of memories associated with both fear and its extinction. After brief overviews of the behavior and neural circuitry associated with fear conditioning, extinction learning and extinction memory in the rodent and human, interactions of sleep with these processes will be examined. Animal and human studies suggest that sleep can serve to consolidate both fear and extinction memory. In humans, sleep also promotes generalization of extinction memory. Time-of-day effects on extinction learning and generalization are also seen. REM may be a sleep stage of particular importance for the consolidation of both fear and extinction memory as evidenced by selective REM deprivation experiments. REM sleep is accompanied by selective activation of the same limbic structures implicated in the learning and memory of fear and extinction. Preliminary evidence also suggests extinction learning can take place during slow wave sleep. Study of low-level processes such as conditioning, extinction and habituation may allow sleep effects on emotional memory to be identified and inform study of sleep’s effects on more complex, emotionally salient declarative memories. Anxiety disorders are marked by impairments of both sleep and extinction memory. Improving sleep quality may ameliorate anxiety disorders by strengthening naturally acquired extinction. Strategically timed sleep may be used to enhance treatment of anxiety by strengthening therapeutic extinction learned via exposure therapy. PMID:25894546
Effects of sleep on memory for conditioned fear and fear extinction.
Pace-Schott, Edward F; Germain, Anne; Milad, Mohammed R
2015-07-01
Learning and memory for extinction of conditioned fear is a basic mammalian mechanism for regulating negative emotion. Sleep promotes both the consolidation of memory and the regulation of emotion. Sleep can influence consolidation and modification of memories associated with both fear and its extinction. After brief overviews of the behavior and neural circuitry associated with fear conditioning, extinction learning, and extinction memory in the rodent and human, interactions of sleep with these processes will be examined. Animal and human studies suggest that sleep can serve to consolidate both fear and extinction memory. In humans, sleep also promotes generalization of extinction memory. Time-of-day effects on extinction learning and generalization are also seen. Rapid eye movement (REM) may be a sleep stage of particular importance for the consolidation of both fear and extinction memory as evidenced by selective REM deprivation experiments. REM sleep is accompanied by selective activation of the same limbic structures implicated in the learning and memory of fear and extinction. Preliminary evidence also suggests extinction learning can take place during slow wave sleep. Study of low-level processes such as conditioning, extinction, and habituation may allow sleep effects on emotional memory to be identified and inform study of sleep's effects on more complex, emotionally salient declarative memories. Anxiety disorders are marked by impairments of both sleep and extinction memory. Improving sleep quality may ameliorate anxiety disorders by strengthening naturally acquired extinction. Strategically timed sleep may be used to enhance treatment of anxiety by strengthening therapeutic extinction learned via exposure therapy. (PsycINFO Database Record (c) 2015 APA, all rights reserved).
Tiger salamanders' (Ambystoma tigrinum) response learning and usage of visual cues.
Kundey, Shannon M A; Millar, Roberto; McPherson, Justin; Gonzalez, Maya; Fitz, Aleyna; Allen, Chadbourne
2016-05-01
We explored tiger salamanders' (Ambystoma tigrinum) learning to execute a response within a maze as proximal visual cue conditions varied. In Experiment 1, salamanders learned to turn consistently in a T-maze for reinforcement before the maze was rotated. All learned the initial task and executed the trained turn during test, suggesting that they learned to demonstrate the reinforced response during training and continued to perform it during test. In a second experiment utilizing a similar procedure, two visual cues were placed consistently at the maze junction. Salamanders were reinforced for turning towards one cue. Cue placement was reversed during test. All learned the initial task, but executed the trained turn rather than turning towards the visual cue during test, evidencing response learning. In Experiment 3, we investigated whether a compound visual cue could control salamanders' behaviour when it was the only cue predictive of reinforcement in a cross-maze by varying start position and cue placement. All learned to turn in the direction indicated by the compound visual cue, indicating that visual cues can come to control their behaviour. Following training, testing revealed that salamanders attended to stimuli foreground over background features. Overall, these results suggest that salamanders learn to execute responses over learning to use visual cues but can use visual cues if required. Our success with this paradigm offers the potential in future studies to explore salamanders' cognition further, as well as to shed light on how features of the tiger salamanders' life history (e.g. hibernation and metamorphosis) impact cognition.
Yohimbine stress potentiates conditioned cue-induced reinstatement of heroin-seeking in rats.
Banna, Kelly M; Back, Sudie E; Do, Phong; See, Ronald E
2010-03-17
Stress and drug-associated cues can trigger craving and relapse in abstinent drug-dependent individuals. Although the role of these two critical factors in relapse has been extensively studied, the interaction between stress and drug-associated cues in relapse has been less well characterized. Using an animal model of relapse, we assessed the effects of the pharmacological stressor, yohimbine (1.25 or 2.5mg/kg), on reinstatement of extinguished heroin-seeking in rats either in the presence or absence of heroin-associated cues. Yohimbine, in the absence of heroin-associated cues, and cues by themselves reliably reinstated heroin-seeking over extinction levels. Notably, animals showed significantly potentiated responding when yohimbine preceded cue-induced reinstatement (3-4x higher over cues or yohimbine alone). These results demonstrate that exposure to heroin-paired cues during yohimbine-induced stress greatly potentiates heroin-seeking, and support the simultaneous targeting of both stress and cue activation during relapse intervention. Copyright 2009 Elsevier B.V. All rights reserved.
Can Transcranial Direct Current Stimulation Augment Extinction of Conditioned Fear?
van ’t Wout, Mascha; Mariano, Timothy Y.; Garnaat, Sarah L.; Reddy, Madhavi K.; Rasmussen, Steven A.; Greenberg, Benjamin D.
2016-01-01
Background Exposure-based therapy parallels extinction learning of conditioned fear. Prior research points to the ventromedial prefrontal cortex as a potential site for the consolidation of extinction learning and subsequent retention of extinction memory. Objective/hypothesis The present study aimed to evaluate whether the application of non-invasive transcranial direct current stimulation (tDCS) during extinction learning enhances late extinction and early recall in human participants. Methods Forty-four healthy volunteers completed a 2-day Pavlovian fear conditioning, extinction, and recall paradigm while skin conductance activity was continuously measured. Twenty-six participants received 2 mA anodal tDCS over EEG coordinate AF3 during extinction of a first conditioned stimulus. The remaining 18 participants received similar tDCS during extinction of a second conditioned stimulus. Sham stimulation was applied for the balance of extinction trials in both groups. Normalized skin conductance changes were analyzed using linear mixed models to evaluate effects of tDCS over late extinction and early recall trials. Results We observed a significant interaction between timing of tDCS during extinction blocks and changes in skin conductance reactivity over late extinction trials. These data indicate that tDCS was associated with accelerated late extinction learning of a second conditioned stimulus after tDCS was combined with extinction learning of a previous conditioned stimulus. No significant effects of tDCS timing were observed on early extinction recall. Conclusions Results could be explained by an anxiolytic aftereffect of tDCS and extend previous studies on tDCS-induced modulation of fear and threat related learning processes. These findings support further exploration of the clinical use of tDCS. PMID:27037186
West, Elizabeth A.
2016-01-01
Nucleus accumbens (NAc) neurons encode features of stimulus learning and action selection associated with rewards. The NAc is necessary for using information about expected outcome values to guide behavior after reinforcer devaluation. Evidence suggests that core and shell subregions may play dissociable roles in guiding motivated behavior. Here, we recorded neural activity in the NAc core and shell during training and performance of a reinforcer devaluation task. Long–Evans male rats were trained that presses on a lever under an illuminated cue light delivered a flavored sucrose reward. On subsequent test days, each rat was given free access to one of two distinctly flavored foods to consume to satiation and were then immediately tested on the lever pressing task under extinction conditions. Rats decreased pressing on the test day when the reinforcer earned during training was the sated flavor (devalued) compared with the test day when the reinforcer was not the sated flavor (nondevalued), demonstrating evidence of outcome-selective devaluation. Cue-selective encoding during training by NAc core (but not shell) neurons reliably predicted subsequent behavioral performance; that is, the greater the percentage of neurons that responded to the cue, the better the rats suppressed responding after devaluation. In contrast, NAc shell (but not core) neurons significantly decreased cue-selective encoding in the devalued condition compared with the nondevalued condition. These data reveal that NAc core and shell neurons encode information differentially about outcome-specific cues after reinforcer devaluation that are related to behavioral performance and outcome value, respectively. SIGNIFICANCE STATEMENT Many neuropsychiatric disorders are marked by impairments in behavioral flexibility. Although the nucleus accumbens (NAc) is required for behavioral flexibility, it is not known how NAc neurons encode this information. Here, we recorded NAc neurons during a training session in which rats learned that a cue predicted a specific reward and during a test session when that reward value was changed. Although encoding in the core during training predicted the ability of rats to change behavior after the reward value was altered, the NAc shell encoded information about the change in reward value during the test session. These findings suggest differential roles of the core and shell in behavioral flexibility. PMID:26818502
REINSTATEMENT OF ETHANOL AND SUCROSE SEEKING BY THE NEUROSTEROID ALLOPREGNANOLONE IN C57BL/6 MICE
Finn, Deborah A.; Mark, Gregory P.; Fretwell, Andrea M.; Gililland, Katherine R.; Strong, Moriah N.; Ford, Matthew M.
2016-01-01
Rationale Recent work in our laboratory documented that the “sipper” method of operant ethanol self-administration produced high ethanol intake and blood ethanol concentrations as well as the typical extinction “burst” in responding under non-reinforced conditions in male C57BL/6 mice. However, the neurochemical basis for reinstatement of responding following extinction has not been examined in mice with this model. Objectives Based on findings that the GABAergic neurosteroid allopregnanolone (ALLO) significantly increased the consummatory phase of ethanol self-administration, the present study determined the effect of ALLO on reinstatement of extinguished ethanol-seeking behavior and compared this effect to reinstatement of responding for sucrose reward. Methods Separate groups of male C57BL/6 mice were trained to lever press for access to a 10% ethanol (10E) or a 5% sucrose (5S) solution. A single response requirement of 16 presses (RR16) on an active lever resulted in 30 min of continuous access to the 10E or 5S solution. After the animals responded on the RR16 schedule for 14 weeks, mice were exposed to 30 min extinction sessions where responding had no scheduled consequence. Once responding stabilized below the pre-extinction baseline, mice received an IP injection of ALLO (0, 3.2, 5.6, 10 or 17 mg/kg) 15 min prior to the extinction session in a within-subjects design. Results ALLO produced a dose-dependent increase in responding under non-reinforced conditions in both the 10E and 5S groups. Additional work documented the ability of a conditioned cue light or a compound cue (light+lever retraction) to reinstate non-reinforced responding on the previously active lever. Conclusions These findings definitively show that conditioned cues and priming with ALLO are potent stimuli for reinstating both ethanol and sucrose seeking behavior in C57BL/6 mice. PMID:18758755
Theberge, Florence R M; Pickens, Charles L; Goldart, Evan; Fanous, Sanya; Hope, Bruce T; Liu, Qing-Rong; Shaham, Yavin
2012-12-01
Responding to heroin cues progressively increases after cessation of heroin self-administration (incubation of heroin craving). We investigated whether this incubation is associated with time-dependent changes in brain-derived neurotrophic factor (BDNF) and methyl-CpG binding protein 2 (MeCP2) signaling and mu opioid receptor (MOR) expression in nucleus accumbens (NAc), dorsal striatum (DS), and medial prefrontal cortex (mPFC). We also investigated the effect of the preferential MOR antagonist naloxone on cue-induced heroin seeking during abstinence. We trained rats to self-administer heroin or saline for 9-10 days and then dissected the NAc, DS, and mPFC at different abstinence days and measured mRNA and protein levels of BDNF, TrkB, and MeCP2, as well as MOR mRNA (Oprm1). In other groups, we assessed cue-induced heroin seeking in extinction tests after 1, 11, and 30 abstinence days, and naloxone's (0-1.0 mg/kg) effect on extinction responding after 1 and 15 days. Cue-induced heroin seeking progressively increased or incubated during abstinence. This incubation was not associated with changes in BDNF, TrkB, or MeCP2 mRNA or protein levels in NAc, DS, or mPFC; additionally, no molecular changes were observed after extinction tests on day 11. In NAc, but not DS or mPFC, MOR mRNA decreased on abstinence day 1 and returned to basal levels over time. Naloxone significantly decreased cue-induced heroin seeking after 15 abstinence days but not 1 day. Results suggest a role of MOR in incubation of heroin craving. As previous studies implicated NAc BDNF in incubation of cocaine craving, our data suggest that different mechanisms contribute to incubation of heroin versus cocaine craving.
Theberge, Florence R. M.; Pickens, Charles L.; Goldart, Evan; Fanous, Sanya; Hope, Bruce T.; Liu, Qing-Rong
2013-01-01
Rationale and objectives Responding to heroin cues progressively increases after cessation of heroin self-administration (incubation of heroin craving). We investigated whether this incubation is associated with time-dependent changes in brain-derived neurotrophic factor (BDNF) and methyl-CpG binding protein 2 (MeCP2) signaling and mu opioid receptor (MOR) expression in nucleus accumbens (NAc), dorsal striatum (DS), and medial pre-frontal cortex (mPFC). We also investigated the effect of the preferential MOR antagonist naloxone on cue-induced heroin seeking during abstinence. Methods We trained rats to self-administer heroin or saline for 9–10 days and then dissected the NAc, DS, and mPFC at different abstinence days and measured mRNA and protein levels of BDNF, TrkB, and MeCP2, as well as MOR mRNA (Oprm1). In other groups, we assessed cue-induced heroin seeking in extinction tests after 1, 11, and 30 abstinence days, and naloxone’s (0–1.0 mg/kg) effect on extinction responding after 1 and 15 days. Results Cue-induced heroin seeking progressively increased or incubated during abstinence. This incubation was not associated with changes in BDNF, TrkB, or MeCP2 mRNA or protein levels in NAc, DS, or mPFC; additionally, no molecular changes were observed after extinction tests on day 11. In NAc, but not DS or mPFC, MOR mRNA decreased on abstinence day 1 and returned to basal levels over time. Naloxone significantly decreased cue-induced heroin seeking after 15 abstinence days but not 1 day. Conclusions Results suggest a role of MOR in incubation of heroin craving. As previous studies implicated NAc BDNF in incubation of cocaine craving, our data suggest that different mechanisms contribute to incubation of heroin versus cocaine craving. PMID:22790874
Incubation of sucrose craving: effects of reduced training and sucrose pre-loading
Grimm, Jeffrey W.; Fyall, Amber M.; Osincup, Dan P.
2010-01-01
Time-dependent increases in cue-induced reward seeking after forced abstinence were described in rats with a history of cocaine or sucrose self-administration, suggesting reward craving incubates over time. In the present study, we examined the effects of reduced training experience, or sucrose pre-loading just prior to testing, on the incubation of sucrose craving. Sucrose seeking (responding in extinction and then for a sucrose-paired cue) increased over time in groups of rats that self-administered sucrose 6 h/day for 10 days and were tested at 1, 7, or 30 days of forced abstinence. We found that groups of rats that had self-administered 2 instead of 6 h/day showed a similar profile of responding. Incubation of sucrose craving was attenuated by free access to sucrose in home cages for 17 h immediately prior to testing assessed as extinction responding on days 1 and 30. However, this sucrose pre-loading had no effect on the time-dependent increase in responding for the sucrose-paired cue. In summary, reducing the training experience had no effect on the incubation of sucrose craving and free access to sucrose had only a limited effect–attenuating extinction responding. These results illustrate the strength of the incubation of craving and further suggest long-term changes in brain motivational circuitry following sucrose self-administration. PMID:15642609
Effects of D-cycloserine on the extinction of appetitive operant learning
Vurbic, Drina; Gold, Benjamin; Bouton, Mark E.
2011-01-01
Four experiments with rat subjects examined whether D-cycloserine (DCS), a partial NMDA agonist, facilitates the extinction of operant lever-pressing reinforced by food. Previous research has demonstrated that DCS facilitates extinction learning with methods that involve Pavlovian extinction. In the current experiments, operant conditioning occurred in Context A, extinction in Context B, and then testing occurred in both the extinction and conditioning contexts. Experiments 1a and 1b tested the effects of three doses of DCS (5, 15, and 30 mg/kg) on the extinction of lever pressing trained as a free operant. Experiment 2 examined their effects when extinction of the free operant was conducted in the presence of non-response-contingent deliveries of the reinforcer (which theoretically reduced the role of generalization decrement in suppressing responding). Experiment 3 examined their effects on extinction of a discriminated operant, i.e., one that had been reinforced in the presence of a discriminative stimulus, but not in its absence. A strong ABA renewal effect was observed in all four experiments during testing. However, despite the use of DCS doses and a drug administration procedure that facilitates the extinction of Pavlovian learning, there was no evidence in any experiment that DCS facilitated operant extinction learning assessed in either the extinction or the conditioning context. DCS may primarily facilitate learning processes that underlie Pavlovian, rather than purely operant, extinction. PMID:21688894
Hippocampus NMDA receptors selectively mediate latent extinction of place learning.
Goodman, Jarid; Gabriele, Amanda; Packard, Mark G
2016-09-01
Extinction of maze learning may be achieved with or without the animal performing the previously acquired response. In typical "response extinction," animals are given the opportunity to make the previously acquired approach response toward the goal location of the maze without reinforcement. In "latent extinction," animals are not given the opportunity to make the previously acquired response and instead are confined to the previous goal location without reinforcement. Previous evidence indicates that the effectiveness of these protocols may depend on the type of memory being extinguished. Thus, one aim of the present study was to further examine the effectiveness of response and latent extinction protocols across dorsolateral striatum (DLS)-dependent response learning and hippocampus-dependent place learning tasks. In addition, previous neural inactivation experiments indicate a selective role for the hippocampus in latent extinction, but have not investigated the precise neurotransmitter mechanisms involved. Thus, the present study also examined whether latent extinction of place learning might depend on NMDA receptor activity in the hippocampus. In experiment 1, adult male Long-Evans rats were trained in a response learning task in a water plus-maze, in which animals were reinforced to make a consistent body-turn response to reach an invisible escape platform. Results indicated that response extinction, but not latent extinction, was effective at extinguishing memory in the response learning task. In experiment 2, rats were trained in a place learning task, in which animals were reinforced to approach a consistent spatial location containing the hidden escape platform. In experiment 2, animals also received intra-hippocampal infusions of the NMDA receptor antagonist 2-amino-5-phosphopentanoic acid (AP5; 5.0 or 7.5 ug/0.5 µg) or saline vehicle immediately before response or latent extinction training. Results indicated that both extinction protocols were effective at extinguishing memory in the place learning task. In addition, intra-hippocampal AP5 (7.5 µg) impaired latent extinction, but not response extinction, suggesting that hippocampal NMDA receptors are selectively involved in latent extinction. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.
Cannabinoid facilitation of fear extinction memory recall in humans
Rabinak, Christine A.; Angstadt, Mike; Sripada, Chandra S.; Abelson, James L.; Liberzon, Israel; Milad, Mohammed R.; Phan, K. Luan
2012-01-01
A first-line approach to treat anxiety disorders is exposure-based therapy, which relies on extinction processes such as repeatedly exposing the patient to stimuli (conditioned stimuli; CS) associated with the traumatic, fear-related memory. However, a significant number of patients fail to maintain their gains, partly attributed to the fact that this inhibitory learning and its maintenance is temporary and conditioned fear responses can return. Animal studies have shown that activation of the cannabinoid system during extinction learning enhances fear extinction and its retention. Specifically, CB1 receptor agonists, such as Δ9-tetrahydrocannibinol (THC), can facilitate extinction recall by preventing recovery of extinguished fear in rats. However, this phenomenon has not been investigated in humans. We conducted a study using a randomized, double-blind, placebo-controlled, between-subjects design, coupling a standard Pavlovian fear extinction paradigm and simultaneous skin conductance response (SCR) recording with an acute pharmacological challenge with oral dronabinol (synthetic THC) or placebo (PBO) 2 hours prior to extinction learning in 29 healthy adult volunteers (THC = 14; PBO = 15) and tested extinction retention 24 hours after extinction learning. Compared to subjects that received PBO, subjects that received THC showed low SCR to a previously extinguished CS when extinction memory recall was tested 24 hours after extinction learning, suggesting that THC prevented the recovery of fear. These results provide the first evidence that pharmacological enhancement of extinction learning is feasible in humans using cannabinoid system modulators, which may thus warrant further development and clinical testing. PMID:22796109
Derringer, Cory; Rottman, Benjamin Margolin
2018-05-01
Four experiments tested how people learn cause-effect relations when there are many possible causes of an effect. When there are many cues, even if all the cues together strongly predict the effect, the bivariate relation between each individual cue and the effect can be weak, which can make it difficult to detect the influence of each cue. We hypothesized that when detecting the influence of a cue, in addition to learning from the states of the cues and effect (e.g., a cue is present and the effect is present), which is hypothesized by multiple existing theories of learning, participants would also learn from transitions - how the cues and effect change over time (e.g., a cue turns on and the effect turns on). We found that participants were better able to identify positive and negative cues in an environment in which only one cue changed from one trial to the next, compared to multiple cues changing (Experiments 1A, 1B). Within a single learning sequence, participants were also more likely to update their beliefs about causal strength when one cue changed at a time ('one-change transitions') than when multiple cues changed simultaneously (Experiment 2). Furthermore, learning was impaired when the trials were grouped by the state of the effect (Experiment 3) or when the trials were grouped by the state of a cue (Experiment 4), both of which reduce the number of one-change transitions. We developed a modification of the Rescorla-Wagner algorithm to model this 'Informative Transitions' learning processes. Copyright © 2018 Elsevier Inc. All rights reserved.
Ball, Kevin T; Stone, Eric; Best, Olivia; Collins, Tyler; Edson, Hunter; Hagan, Erin; Nardini, Salvatore; Neuciler, Phelan; Smolinsky, Michael; Tosh, Lindsay; Woodlen, Kristin
2018-06-01
A major obstacle in the treatment of individuals with cocaine addiction is their high propensity for relapse. Although the clinical scenario of acute stress-induced relapse has been well studied in animal models, few pre-clinical studies have investigated the role of chronic stress in relapse or the interaction between chronic stress and other relapse triggers. We tested the effect of chronic restraint stress on cocaine seeking in rats using both extinction- and abstinence-based animal relapse models. Rats were trained to press a lever for I.V. cocaine infusions (0.50 mg/kg/infusion) paired with a discrete tone + light cue in daily 3-h sessions. Following self-administration, rats were exposed to a chronic restraint stress procedure (3 h/day) or control procedure (unstressed) during the first seven days of a 13-day extinction period during which lever presses had no programmed consequences. This was followed by cue- and cocaine priming-induced drug seeking tests. In a separate group of rats, cocaine seeking was assessed during forced abstinence both before and after the same chronic stress procedure. A history of chronic restraint stress was associated with increased cocaine priming-induced drug seeking, an effect attenuated by co-administration of SCH-23390 (10.0 μg/kg; i.p.), a dopamine D 1 -like receptor antagonist, with daily restraint. Repeated SCH-23390 administration but not stress during extinction increased cue-induced reinstatement. Exposure to chronic stress during early withdrawal may confer lasting vulnerability to some types of relapse, and dopamine D 1 -like receptors appear to mediate both chronic stress effects on cocaine seeking and extinction of cocaine seeking. Copyright © 2018 Elsevier B.V. All rights reserved.
Impaired fear extinction learning in adult heterozygous BDNF knock-out mice.
Psotta, Laura; Lessmann, Volkmar; Endres, Thomas
2013-07-01
Brain-derived neurotrophic factor (BDNF) is a crucial regulator of neuroplasticity, which underlies learning and memory processes in different brain areas. To investigate the role of BDNF in the extinction of amygdala-dependent cued fear memories, we analyzed fear extinction learning in heterozygous BDNF knock-out mice, which possess a reduction of endogenous BDNF protein levels to ~50% of wild-type animals. Since BDNF expression has been shown to decline with aging of animals, we tested the performance in extinction learning of these mice at 2 months (young adults) and 7 months (older adults) of age. The present study shows that older adult heterozygous BDNF knock-out mice, which have a chronic 50% lack of BDNF, also possess a deficit in the acquisition of extinction memory, while extinction learning remains unaffected in young adult heterozygous BDNF knock-out mice. This deficit in extinction learning is accompanied by a reduction of BDNF protein in the hippocampus, amygdala and the prefrontal cortex. Copyright © 2013 Elsevier Inc. All rights reserved.
Troisi, Joseph R; Dooley, Thomas F; Craig, Elizabeth M
2013-12-01
Nicotine and ethyl alcohol (EtOH) interact neurophysiologically and induce internal sensory states that contribute to their coabuse. Evaluating the combined internal sensory effects of nicotine and alcohol may be important for understanding this nexus. With rats, this investigation used an operant drug discrimination procedure to establish discriminative stimulus control with a mixture of nicotine plus EtOH (NE) at doses of nicotine (0.3 mg/kg) and EtOH (1.0 g/kg) that have previously been shown to be equally salient (Gauvin & Holloway, 1993). In Experiment (Exp) 1 the NE compound mixture continued to evoke responding despite extinction of responding with nicotine and EtOH alone. In Exp 2 the NE mixture was reliably discriminated from the nicotine and EtOH elements. Experiment 3 showed that the discriminative functions of the NE mixture emerged when the nicotine and EtOH elements were combined following their initial establishment as separate discriminative stimuli; however, nicotine evoked more control than EtOH. Extinction of responding with the NE mixture impacted rates of responding with nicotine and EtOH alone. The results of the all three studies parallel findings with exteroceptive Pavlovian literature in showing that extinction of responding with the elemental parts does not appear to impact the whole-but, extinction with the whole appears to affect its parts. The multielement discriminative function of a NE mixture appears to be a "unique cue" that differs qualitatively from nicotine or EtOH alone. Associative factors related to compound conditioning (i.e., configural learning) play an important role in mediating the discriminative functions of drug mixtures.
Zhang, Yue; Kibaly, Cherkaouia; Xu, Chi; Loh, Horace H; Law, Ping-Yee
2017-11-01
The treatment of opioid addiction is challenging because addicts are highly prone to relapse when the memory of the former drug experience is triggered by emotional or environmental cues. An emerging and promising concept in addiction biology is that by manipulating adult hippocampal neurogenesis, a phenomenon involved in learning and memory, drug reward-like behaviors and relapse can be attenuated. We tested a new synthetic compound, KHS101, in an animal model of drug-associated contextual memory. KHS101 has been reported to increase the expression of neurogenic differentiation 1 (NeuroD1), a transcription factor involved in adult neurogenesis, and to specifically induce neuronal differentiation both in vitro and in vivo. Our results indicated that the subcutaneous injection of 3 mg/kg KHS101 for 7 days before conditioned place preference (CPP) training prolonged CPP extinction, while the same treatment after training accelerated extinction. This effect paralleled that observed following temporally controlled, tetracycline-induced NeuroD1 overexpression. Furthermore, the effect of KHS101 may occur via its induction of NeuroD1 expression as demonstrated by the abolition of the KHS101-mediated modulation of morphine-induced CPP extinction after the stereotaxic injection of lentiviral NeuroD1 small interfering RNA into the dentate gyrus (DG) of the hippocampus. These results suggest that the KHS101-mediated modulation of neurogenesis at a critical stage of the conditioning or the extinction of an opioid-associated experience may disrupt the memory trace of the existing opioid-associated experience to facilitate the extinction of drug-associated contextual memory. This implies that KHS101 has therapeutic potential for the treatment of opioid addiction. Copyright © 2017 Elsevier Ltd. All rights reserved.
Dunsmoor, Joseph E.; Niv, Yael; Daw, Nathaniel; Phelps, Elizabeth A.
2015-01-01
Extinction serves as the leading theoretical framework and experimental model to describe how learned behaviors diminish through absence of anticipated reinforcement. In the past decade, extinction has moved beyond the realm of associative learning theory and behavioral experimentation in animals and has become a topic of considerable interest in the neuroscience of learning, memory, and emotion. Here, we review research and theories of extinction, both as a learning process and as a behavioral technique, and consider whether traditional understandings warrant a re-examination. We discuss the neurobiology, cognitive factors, and major computational theories, and revisit the predominant view that extinction results in new learning that interferes with expression of the original memory. Additionally, we reconsider the limitations of extinction as a technique to prevent the relapse of maladaptive behavior, and discuss novel approaches, informed by contemporary theoretical advances, that augment traditional extinction methods to target and potentially alter maladaptive memories. PMID:26447572
Waters, Allison M; Kershaw, Rachel
2015-01-01
Anxious children show attention biases towards and away from threat stimuli. Moreover, threat avoidance compared to vigilance predicts a poorer outcome from exposure-based treatments, such as cognitive-behavioural therapy (CBT), yet the mechanisms underlying this differential response are unclear. Pavlovian fear conditioning is a widely accepted theory to explain the acquisition and extinction of fear, including exposure-based treatments, such as CBT. In typical fear conditioning experiments, anxious children have shown larger physiological responses to an aversive unconditional stimulus (i.e., US on CS+ trials) and to non-reinforced stimuli (CS-) during fear acquisition and to both CSs during fear extinction compared to non-anxious peers. This study examined whether threat avoidance compared to threat vigilance was related to differences in fear acquisition and extinction in anxious children. Thirty-four clinically-anxious children completed a visual probe task including angry-neutral face pairs to determine the direction of threat attention bias as well as a discriminant conditioning and extinction task in which a geometric shape CS+ was paired with an aversive tone US, while the CS- geometric shape was always presented alone during acquisition trials. Both CSs were presented alone during extinction trials. Fear acquisition and extinction were indexed by skin conductance responses (SCR) and subjective measures. Children were classified as threat vigilant (N = 18) and threat avoidant (n = 16) based on the direction of threat attention bias on the visual probe task. During acquisition, threat avoidant relative to threat vigilant anxious children displayed larger orienting SCRs to both CSs during the first block of trials and larger third interval SCRs to the US on CS+ trials as well as on CS- trials. During extinction, threat avoidant anxious children showed delayed extinction of SCRs to both the CS+ and CS- and reported higher subjective anxiety ratings after extinction compared to threat vigilant anxious children. Threat avoidant anxious children may be more reactive physiologically to novel cues and to stimuli that become associated with threat and this may interfere with extinction learning. These findings could help explain previous evidence that threat avoidant anxious children do not respond as well as threat vigilant anxious children to exposure-based CBT. Copyright © 2014 Elsevier Ltd. All rights reserved.
The extinction context enables extinction performance after a change in context
Nelson, James Byron; Gregory, Pamela; Sanjuan, Maria del Carmen
2012-01-01
One experiment with human participants determined the extent to which recovery of extinguished responding with a context switch was due to a failure to retrieve contextually-controlled learning, or some other process such as participants learning that context changes signal reversals in the meaning of stimulus – outcome relationships. In a video game, participants learned to suppress mouse clicking in the presence of a stimulus that predicted an attack. Then, that stimulus underwent extinction in a different context (environment within the game). Following extinction, suppression was recovered and then extinguished again during testing in the conditioning context. In a final test, participants that were tested in the context where extinction first took place showed less of a recovery than those tested in a neutral context, but they showed a recovery of suppression nevertheless. A change in context tended to cause a change in the meaning of the stimulus, leading to recovery in both the neutral and extinction contexts. The extinction context attenuated that recovery, perhaps by enabling retrieval of the learning that took place in extinction. Recovery outside an extinction context is due to a failure of the context to enable the learning acquired during extinction, but only in part. PMID:22521549
The Central Amygdala Nucleus is Critical for Incubation of Methamphetamine Craving
Li, Xuan; Zeric, Tamara; Kambhampati, Sarita; Bossert, Jennifer M; Shaham, Yavin
2015-01-01
Cue-induced methamphetamine seeking progressively increases after withdrawal but mechanisms underlying this ‘incubation of methamphetamine craving' are unknown. Here we studied the role of central amygdala (CeA), ventral medial prefrontal cortex (vmPFC), and orbitofrontal cortex (OFC), brain regions implicated in incubation of cocaine and heroin craving, in incubation of methamphetamine craving. We also assessed the role of basolateral amygdala (BLA) and dorsal medial prefrontal cortex (dmPFC). We trained rats to self-administer methamphetamine (10 days; 9 h/day, 0.1 mg/kg/infusion) and tested them for cue-induced methamphetamine seeking under extinction conditions during early (2 days) or late (4–5 weeks) withdrawal. We first confirmed that ‘incubation of methamphetamine craving' occurs under our experimental conditions. Next, we assessed the effect of reversible inactivation of CeA or BLA by GABAA+GABAB receptor agonists (muscimol+baclofen, 0.03+0.3 nmol) on cue-induced methamphetamine seeking during early and late withdrawal. We also assessed the effect of muscimol+baclofen reversible inactivation of vmPFC, dmPFC, and OFC on ‘incubated' cue-induced methamphetamine seeking during late withdrawal. Lever presses in the cue-induced methamphetamine extinction tests were higher during late withdrawal than during early withdrawal (incubation of methamphetamine craving). Muscimol+baclofen injections into CeA but not BLA decreased cue-induced methamphetamine seeking during late but not early withdrawal. Muscimol+baclofen injections into dmPFC, vmPFC, or OFC during late withdrawal had no effect on incubated cue-induced methamphetamine seeking. Together with previous studies, results indicate that the CeA has a critical role in incubation of both drug and non-drug reward craving and demonstrate an unexpected dissociation in mechanisms of incubation of methamphetamine vs cocaine craving. PMID:25475163
Swalve, Natashia; Smethells, John R; Zlebnik, Natalie E; Carroll, Marilyn E
2016-06-01
Two repurposed medications have been proposed to treat cocaine abuse. Progesterone, a gonadal hormone, and atomoxetine, a medication commonly used to treat attention deficit/hyperactivity disorder, have both been separately shown to reduce cocaine self-administration and reinstatement (i.e., relapse). The goal of the present study was to examine sex differences in the individual effects of PRO and ATO as well as the combination PRO+ATO treatment on cocaine (COC), caffeine (CAF), and/or cue-primed reinstatement of cocaine-seeking. Adult male and female Wistar rats lever-pressed under a FR 1 schedule for cocaine infusions (0.4mg/kg/inf). After 14 sessions of stable responding in daily 2-h sessions, rats underwent a 21-day extinction period when no drug or drug-related stimuli were present. Rats were then separated into four groups that received PRO (0.5mg/kg) alone (PRO+SAL), ATO (1.5mg/kg) alone (VEH+ATO), control (VEH+SAL) or combination (PRO+ATO) treatments prior to the reinstatement condition. Reinstatement of cocaine-seeking to cues and/or drug injections of cocaine or caffeine was tested after extinction. During maintenance, females self-administered more cocaine than males, but no sex differences were seen during extinction. Females showed greater cocaine-seeking than males after a CAF priming injection. Individual treatment with ATO did not decrease reinstatement under any priming condition; however, the combination treatment decreased cocaine-seeking under the COC+CUES priming condition in males, and both PRO alone and the combination treatment decreased cocaine-seeking in the CAF+CUES condition in females. Overall, PRO alone was only effective in reducing reinstatement in females, while the combination treatment was consistently effective in reducing reinstatement in both sexes. Copyright © 2016 Elsevier Inc. All rights reserved.
ERIC Educational Resources Information Center
Rolison, Jonathan J.; Evans, Jonathan St. B. T.; Dennis, Ian; Walsh, Clare R.
2012-01-01
Multiple cue probability learning (MCPL) involves learning to predict a criterion based on a set of novel cues when feedback is provided in response to each judgment made. But to what extent does MCPL require controlled attention and explicit hypothesis testing? The results of two experiments show that this depends on cue polarity. Learning about…
Development of fear acquisition and extinction in children: effects of age and anxiety.
Jovanovic, Tanja; Nylocks, Karin Maria; Gamwell, Kaitlyn L; Smith, Ami; Davis, Telsie A; Norrholm, Seth Davin; Bradley, Bekh
2014-09-01
Development of anxiety disorders is associated with neurobiological changes in areas that are a critical part of the fear neurocircuitry. Fear conditioning paradigms can offer insight into the mechanisms underlying the neurobiological ontogeny of anxiety. A small number of studies have focused on the effects of age and anxiety separately in school age children. The present study aimed to investigate these effects in 8-13 year old children with higher and lower trait anxiety. We examined differential fear conditioning and extinction using skin conductance responses and fear-potentiated startle in 60 children recruited from a low-income urban population. The results indicated that children under 10 years of age show poor discrimination of conditioned stimuli, and that anxiety increases fear responses during fear acquisition. After controlling for age and trauma exposure, fear-potentiated startle to the safety cue predicted child anxiety levels suggesting that impaired safety signal learning may be a risk factor for anxiety disorders in adulthood. Identifying risk phenotypes in children may provide opportunities for early intervention and prevention of illness. Copyright © 2013 Elsevier Inc. All rights reserved.
Development of Fear Acquisition and Extinction in Children: Effects of Age and Anxiety
Jovanovic, Tanja; Nylocks, Karin Maria; Gamwell, Kaitlyn L.; Smith, Ami; Davis, Telsie A.; Norrholm, Seth Davin; Bradley, Bekh
2013-01-01
Development of anxiety disorders is associated with neurobiological changes in areas that are a critical part of the fear neurocircuitry. Fear conditioning paradigms can offer insight into the mechanisms underlying the neurobiological ontogeny of anxiety. A small number of studies have focused on the effects of age and anxiety separately in school age children. The present study aimed to investigate these effects in 8-13 year old children with higher and lower trait anxiety. We examined differential fear conditioning and extinction using skin conductance responses and fear-potentiated startle in 60 children recruited from a low-income urban population. The results indicated that children under 10 years of age show poor discrimination of conditioned stimuli, and that anxiety increases fear responses during fear acquisition. After controlling for age and trauma exposure, fear-potentiated startle to the safety cue predicted child anxiety levels suggesting that impaired safety signal learning may be a risk factor for anxiety disorders in adulthood. Identifying risk phenotypes in children may provide opportunities for early intervention and prevention of illness. PMID:24183838
The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards
Burke, Kathryn A.; Franz, Theresa M.; Miller, Danielle N.; Schoenbaum, Geoffrey
2009-01-01
Cues that reliably predict rewards trigger the thoughts and emotions normally evoked by those rewards. Humans and other animals will work, often quite hard, for these cues. This is termed conditioned reinforcement. The ability to use conditioned reinforcers to guide our behaviour is normally beneficial; however, it can go awry. For example, corporate icons, such as McDonald’s Golden Arches, influence consumer behaviour in powerful and sometimes surprising ways1, and drug-associated cues trigger relapse to drug seeking in addicts and animals exposed to addictive drugs, even after abstinence or extinction2,3. Yet, despite their prevalence, it is not known how conditioned reinforcers control human or other animal behaviour. One possibility is that they act through the use of the specific rewards they predict; alternatively, they could control behaviour directly by activating emotions that are independent of any specific reward. In other words, the Golden Arches may drive business because they evoke thoughts of hamburgers and fries, or instead, may be effective because they also evoke feelings of hunger or happiness. Moreover, different brain circuits could support conditioned reinforcement mediated by thoughts of specific outcomes versus more general affective information. Here we have attempted to address these questions in rats. Rats were trained to learn that different cues predicted different rewards using specialized conditioning procedures that controlled whether the cues evoked thoughts of specific outcomes or general affective representations common to different outcomes. Subsequently, these rats were given the opportunity to press levers to obtain short and otherwise unrewarded presentations of these cues. We found that rats were willing to work for cues that evoked either outcome-specific or general affective representations. Furthermore the orbitofrontal cortex, a prefrontal region important for adaptive decision-making4, was critical for the former but not for the latter form of conditioned reinforcement. PMID:18563088
The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards.
Burke, Kathryn A; Franz, Theresa M; Miller, Danielle N; Schoenbaum, Geoffrey
2008-07-17
Cues that reliably predict rewards trigger the thoughts and emotions normally evoked by those rewards. Humans and other animals will work, often quite hard, for these cues. This is termed conditioned reinforcement. The ability to use conditioned reinforcers to guide our behaviour is normally beneficial; however, it can go awry. For example, corporate icons, such as McDonald's Golden Arches, influence consumer behaviour in powerful and sometimes surprising ways, and drug-associated cues trigger relapse to drug seeking in addicts and animals exposed to addictive drugs, even after abstinence or extinction. Yet, despite their prevalence, it is not known how conditioned reinforcers control human or other animal behaviour. One possibility is that they act through the use of the specific rewards they predict; alternatively, they could control behaviour directly by activating emotions that are independent of any specific reward. In other words, the Golden Arches may drive business because they evoke thoughts of hamburgers and fries, or instead, may be effective because they also evoke feelings of hunger or happiness. Moreover, different brain circuits could support conditioned reinforcement mediated by thoughts of specific outcomes versus more general affective information. Here we have attempted to address these questions in rats. Rats were trained to learn that different cues predicted different rewards using specialized conditioning procedures that controlled whether the cues evoked thoughts of specific outcomes or general affective representations common to different outcomes. Subsequently, these rats were given the opportunity to press levers to obtain short and otherwise unrewarded presentations of these cues. We found that rats were willing to work for cues that evoked either outcome-specific or general affective representations. Furthermore the orbitofrontal cortex, a prefrontal region important for adaptive decision-making, was critical for the former but not for the latter form of conditioned reinforcement.
No two cues are alike: Depth of learning during infancy is dependent on what orients attention.
Wu, Rachel; Kirkham, Natasha Z
2010-10-01
Human infants develop a variety of attentional mechanisms that allow them to extract relevant information from a cluttered multimodal world. We know that both social and nonsocial cues shift infants' attention, but not how these cues differentially affect learning of multimodal events. Experiment 1 used social cues to direct 8- and 4-month-olds' attention to two audiovisual events (i.e., animations of a cat or dog accompanied by particular sounds) while identical distractor events played in another location. Experiment 2 directed 8-month-olds' attention with colorful flashes to the same events. Experiment 3 measured baseline learning without attention cues both with the familiarization and test trials (no cue condition) and with only the test trials (test control condition). The 8-month-olds exposed to social cues showed specific learning of audiovisual events. The 4-month-olds displayed only general spatial learning from social cues, suggesting that specific learning of audiovisual events from social cues may be a function of experience. Infants cued with the colorful flashes looked indiscriminately to both cued locations during test (similar to the 4-month-olds learning from social cues) despite attending for equal duration to the training trials as the 8-month-olds with the social cues. Results from Experiment 3 indicated that the learning effects in Experiments 1 and 2 resulted from exposure to the different cues and multimodal events. We discuss these findings in terms of the perceptual differences and relevance of the cues. Copyright 2010 Elsevier Inc. All rights reserved.
Extinction of Learned Fear Induces Hippocampal Place Cell Remapping
Wang, Melissa E.; Yuan, Robin K.; Keinath, Alexander T.; Ramos Álvarez, Manuel M.
2015-01-01
The extinction of learned fear is a hippocampus-dependent process thought to embody new learning rather than erasure of the original fear memory, although it is unknown how these competing contextual memories are represented in the hippocampus. We previously demonstrated that contextual fear conditioning results in hippocampal place cell remapping and long-term stabilization of novel representations. Here we report that extinction learning also induces place cell remapping in C57BL/6 mice. Specifically, we observed cells that preferentially remapped during different stages of learning. While some cells remapped in both fear conditioning and extinction, others responded predominantly during extinction, which may serve to modify previous representations as well as encode new safe associations. Additionally, we found cells that remapped primarily during fear conditioning, which could facilitate reacquisition of the original fear association. Moreover, we also observed cells that were stable throughout learning, which may serve to encode the static aspects of the environment. The short-term remapping observed during extinction was not found in animals that did not undergo fear conditioning, or when extinction was conducted outside of the conditioning context. Finally, conditioning and extinction produced an increase in spike phase locking to the theta and gamma frequencies. However, the degree of remapping seen during conditioning and extinction only correlated with gamma synchronization. Our results suggest that the extinction learning is a complex process that involves both modification of pre-existing memories and formation of new ones, and these traces coexist within the same hippocampal representation. PMID:26085635
Combating Drug Abuse by Targeting Toll-Like Receptor 4 (TLR)
2015-12-01
animals continued with cocaine self-administration for an additional 4 days. The animals then underwent six days of extinction training followed by cue... extinction conditions to identify the indirect effects of (+)- naltrexone administration on cocaine seeking. Animals administered (+)-naltrexone during...sterile water and implanted after the last day of self-administration on FR5 (one day prior to the start of the progressive ratio schedule). The animals
Hamm, Alfons O
2009-09-01
Exposure based treatments in which patients are systematically confronted with their feared objects of situations are highly effective in the treatment of specific phobias and produce stable improvement both in reported fear and behavioral avoidance. Exposure in reality is more effective in most cases than exposure in sensu. For situations that are difficult to realize, exposure in virtual environments has become increasingly valuable. Exposure in vivo is clearly superior to pharmacotherapy, although cognitive enhancers have been successfully used recently to increase the effect of exposure therapy. The induction of relaxation is not a necessary precondition for exposure therapy. Rather the current mechanisms of change focus on extinction learning as being the central mechanism both on a cognitive level namely that the feared object is no longer associated with severely threatening consequence but also on an affective level, meaning that feared cue is no longer capable to activate the fear circuit in the brain. Accordingly future diagnostic categorizations of phobic disorders in the DSM-V should rather focus on the pattern of the fear response that needs to be changed than on the eliciting cues or situations that are avoided.
IMPAIRED FEAR EXTINCTION ASSOCIATED WITH PTSD INCREASES WITH HOURS-SINCE-WAKING.
Zuj, Daniel V; Palmer, Matthew A; Hsu, Chia-Ming K; Nicholson, Emma L; Cushing, Pippa J; Gray, Kate E; Felmingham, Kim L
2016-03-01
Prior research has demonstrated that time-of-day may play an important role in the extinction of conditioned fear, with extinction better learned earlier in the day rather than later. Impaired fear extinction memory is widely considered a key mechanism of posttraumatic stress disorder (PTSD). The relationship between fear extinction and PTSD symptoms may be moderated by hours-since-waking. In the present experiment, we examined whether hours-since-waking would moderate fear extinction learning ability in a clinical PTSD sample (n = 15), compared to trauma-exposed (n = 33) and nonexposed controls (n = 22). Participants completed a standardized differential fear conditioning and extinction paradigm, providing skin conductance response measures to quantify conditioned responding. Mixed-model analysis of variance revealed a PTSD-specific impairment in extinction learning ability in the late extinction phase. A moderation analysis showed that hours-since-waking was a significant moderator of the relationship between impaired late extinction and PTSD symptoms. Specifically, we found that participants with higher PTSD symptoms demonstrated poorer fear extinction learning ability as they were awake for longer. The results of the current study add to a growing literature indicating deficits in fear extinction learning in PTSD samples, compared to trauma-exposed and nonexposed controls. These results support previous findings that fear extinction is impaired later in the day, and extends this to a clinical sample, suggesting that exposure-therapy may be optimized by scheduling sessions in the morning. © 2016 Wiley Periodicals, Inc.
Effects of D-cycloserine on the extinction of appetitive operant learning.
Vurbic, Drina; Gold, Benjamin; Bouton, Mark E
2011-08-01
Four experiments with rat subjects examined whether D-cycloserine (DCS), a partial NMDA agonist, facilitates the extinction of operant lever-pressing reinforced by food. Previous research has demonstrated that DCS facilitates extinction learning with methods that involve Pavlovian extinction. In the current experiments, operant conditioning occurred in Context A, extinction in Context B, and then testing occurred in both the extinction and conditioning contexts. Experiments 1A and 1B tested the effects of three doses of DCS (5, 15, and 30 mg/kg) on the extinction of lever pressing trained as a free operant. Experiment 2 examined their effects when extinction of the free operant was conducted in the presence of nonresponse-contingent deliveries of the reinforcer (that theoretically reduced the role of generalization decrement in suppressing responding). Experiment 3 examined their effects on extinction of a discriminated operant, that is, one that had been reinforced in the presence of a discriminative stimulus, but not in its absence. A strong ABA renewal effect was observed in all four experiments during testing. However, despite the use of DCS doses and a drug administration procedure that facilitates the extinction of Pavlovian learning, there was no evidence in any experiment that DCS facilitated operant extinction learning assessed in either the extinction or the conditioning context. DCS may primarily facilitate learning processes that underlie Pavlovian, rather than purely operant, extinction. (PsycINFO Database Record (c) 2011 APA, all rights reserved).
Shin, Jung-Won; Park, Hyunwoo; Cho, Yoonju; Lee, Suck; Yoon, Jiwon; Maeng, Sungho
2017-01-01
The therapeutic goal for the treatment of posttraumatic stress disorder (PTSD) is to promote extinction and to prevent the relapse of fearful memories. Research has identified pharmacological treatments that may regulate the formation and extinction of fear memories, but not many reagents that block the relapse of extinguished fear are known. Radix Polygalae (RP) is an Asian herb used for sedation, and its ingredients have anxiolytic and antidepressant properties. As various neurological effects have been identified, we tested whether RP affects the relapse of fear. Freezing in response to a conditioned context and cues was used to measure the effects of RP in mice. In cohort 1 (n = 30), consolidation, extinction, and reinstatement were tested during the course of 18 days of treatment. In cohort 2 (n = 30), consolidation, extinction, and renewal were tested during 10 days of treatment. The consolidation, extinction, reinstatement, and possibly the renewal of context-induced freezing were inhibited due to the administration of RP in animal subjects. However, the effects of RP on the freezing responses of subjects elicited by conditioned auditory cues were less obvious. Because it effectively suppresses the consolidation of fear memories, RP may be used for primary and secondary prevention of symptoms in PTSD patients. Additionally, because it effectively suppresses the reinstatement and renewal of fear memories, RP may be applied for the prevention of fear relapse in PTSD patients who have undergone exposure therapy. PMID:28620325
Genetic disruptions of Drosophila Pavlovian learning leave extinction learning intact.
Qin, H; Dubnau, J
2010-03-01
Individuals who experience traumatic events may develop persistent posttraumatic stress disorder. Patients with this disorder are commonly treated with exposure therapy, which has had limited long-term success. In experimental neurobiology, fear extinction is a model for exposure therapy. In this behavioral paradigm, animals are repeatedly exposed in a safe environment to the fearful stimulus, which leads to greatly reduced fear. Studying animal models of extinction already has lead to better therapeutic strategies and development of new candidate drugs. Lack of a powerful genetic model of extinction, however, has limited progress in identifying underlying molecular and genetic factors. In this study, we established a robust behavioral paradigm to study the short-term effect (acquisition) of extinction in Drosophila melanogaster. We focused on the extinction of olfactory aversive 1-day memory with a task that has been the main workhorse for genetics of memory in flies. Using this paradigm, we show that extinction can inhibit each of two genetically distinct forms of consolidated memory. We then used a series of single-gene mutants with known impact on associative learning to examine the effects on extinction. We find that extinction is intact in each of these mutants, suggesting that extinction learning relies on different molecular mechanisms than does Pavlovian learning.
Transfer of absolute and relative predictiveness in human contingency learning.
Kattner, Florian
2015-03-01
Previous animal-learning studies have shown that the effect of the predictive history of a cue on its associability depends on whether priority was set to the absolute or relative predictiveness of that cue. The present study tested this assumption in a human contingency-learning task. In both experiments, one group of participants was trained with predictive and nonpredictive cues that were presented according to an absolute-predictiveness principle (either continuously or partially reinforced cue configurations), whereas a second group was trained with co-occurring cues that differed in predictiveness (emphasizing the relative predictive validity of the cues). In both groups, later test discriminations were learned more readily if the discriminative cues had been predictive in the previous learning stage than if they had been nonpredictive. These results imply that both the absolute and relative predictiveness of a cue lead positive transfer with regard to its associability. The data are discussed with respect to attentional models of associative learning.
A novel UCS memory retrieval-extinction procedure to inhibit relapse to drug seeking.
Luo, Yi-xiao; Xue, Yan-xue; Liu, Jian-feng; Shi, Hai-shui; Jian, Min; Han, Ying; Zhu, Wei-li; Bao, Yan-ping; Wu, Ping; Ding, Zeng-bo; Shen, Hao-wei; Shi, Jie; Shaham, Yavin; Lu, Lin
2015-07-14
We recently reported that a conditioned stimulus (CS) memory retrieval-extinction procedure decreases reinstatement of cocaine and heroin seeking in rats and heroin craving in humans. Here we show that non-contingent cocaine or methylphenidate injections (UCS retrieval) 1 h before the extinction sessions decreases cocaine-priming-induced reinstatement, spontaneous recovery, and renewal of cocaine seeking in rats. Unlike the CS-based memory retrieval-extinction procedure, the UCS memory retrieval manipulation decreases renewal and reinstatement of cocaine seeking in the presence of cocaine cues that were not present during extinction training and also decreases cocaine seeking when the procedure commences after 28 days of abstinence. The inhibitory effect of the UCS retrieval manipulation on cocaine-priming-induced reinstatement is mediated by regulation of AMPA-receptor endocytosis in the basolateral amygdala. The UCS memory retrieval-extinction procedure has superior relapse prevention characteristics than the CS memory retrieval-extinction procedure and could be a promising method for decreasing relapse in human addicts.
A novel UCS memory retrieval-extinction procedure to inhibit relapse to drug seeking
Luo, Yi-xiao; Xue, Yan-xue; Liu, Jian-feng; Shi, Hai-shui; Jian, Min; Han, Ying; Zhu, Wei-li; Bao, Yan-ping; Wu, Ping; Ding, Zeng-bo; Shen, Hao-wei; Shi, Jie; Shaham, Yavin; Lu, Lin
2015-01-01
We recently reported that a conditioned stimulus (CS) memory retrieval-extinction procedure decreases reinstatement of cocaine and heroin seeking in rats and heroin craving in humans. Here we show that non-contingent cocaine or methylphenidate injections (UCS retrieval) 1 h before the extinction sessions decreases cocaine-priming-induced reinstatement, spontaneous recovery, and renewal of cocaine seeking in rats. Unlike the CS-based memory retrieval-extinction procedure, the UCS memory retrieval manipulation decreases renewal and reinstatement of cocaine seeking in the presence of cocaine cues that were not present during extinction training and also decreases cocaine seeking when the procedure commences after 28 days of abstinence. The inhibitory effect of the UCS retrieval manipulation on cocaine-priming-induced reinstatement is mediated by regulation of AMPA-receptor endocytosis in the basolateral amygdala. The UCS memory retrieval-extinction procedure has superior relapse prevention characteristics than the CS memory retrieval-extinction procedure and could be a promising method for decreasing relapse in human addicts. PMID:26169171
Duits, Puck; Cath, Danielle C.; Heitland, Ivo; Baas, Johanna M. P.
2016-01-01
Although impaired fear extinction has repeatedly been demonstrated in patients with anxiety disorders, little is known about whether these impairments persist after treatment. The current comparative exploratory study investigated fear extinction in 26 patients treated for their anxiety disorder in the years preceding the study as compared to 17 healthy control subjects. Fear-potentiated startle and subjective fear were measured in a cue and context fear conditioning paradigm within a virtual reality environment. Results indicated no differences in fear extinction between treated anxiety patients and control subjects. However, scores on the Beck Anxiety Inventory across all participants revealed impaired extinction of fear potentiated startle in subjects with high compared to low anxiety symptoms over the past week. Taken together, this exploratory study found no support for impaired fear extinction in treated anxiety patients, and implies that current anxiety symptoms rather than previous patient status determine the success of extinction. PMID:26955364
Gong, Zhiwen; Wang, Chao; Nieh, James C; Tan, Ken
2016-07-01
DNA methylation plays a key role in invertebrate acquisition and extinction memory. Honey bees have excellent olfactory learning, but the role of DNA methylation in memory formation has, to date, only been studied in Apis mellifera. We inhibited DNA methylation by inhibiting DNA methyltransferase (DNMT) with zebularine (zeb) and studied the resulting effects upon olfactory acquisition and extinction memory in two honey bee species, Apis cerana and A. mellifera. We used the proboscis extension reflex (PER) assay to measure memory. We provide the first demonstration that DNA methylation is also important in the olfactory extinction learning of A. cerana. DNMT did not reduce acquisition learning in either species. However, zeb bidirectionally and differentially altered extinction learning in both species. In particular, zeb provided 1h before acquisition learning improved extinction memory retention in A. mellifera, but reduced extinction memory retention in A. cerana. The reasons for these differences are unclear, but provide a basis for future studies to explore species-specific differences in the effects of methylation on memory formation. Copyright © 2016 Elsevier Ltd. All rights reserved.
Itzhak, Yossef; Roger-Sánchez, Concepción; Kelley, Jonathan B; Anderson, Karen L
2010-03-01
The conditioned place preference (CPP) paradigm entails appetitive learning and is utilized to investigate the motivational effects of drug and natural reward in rodents. However, a typical CPP design does not allow dissociation between cue- and context-dependent appetitive learning. In humans, context and cues that had been associated with drug reward can elicit conditioned response and drug craving. Therefore, we investigated (a) methods by which to discriminate between cue- and context-dependent appetitive learning, and (b) the role of the neuronal nitric oxide synthase (nNOS) gene in appetitive learning. Wild-type (WT) and nNOS knockout (KO) mice were trained by cocaine (20 mg/kg) in a discrete context paired with a light cue (a compound context-cue stimulus). In test 1, approach behaviour to either the training context or to the cue in a novel context was determined. WT mice showed robust preference for both cocaine-associated context and cue. nNOS KO mice acquired approach behaviour for the cocaine-associated context but not cue. This finding suggests that the nNOS gene is required for cue-dependent appetitive learning. On the following day (test 2), mice were tested for approach behaviour to the compound context-cue stimulus. Context but not cue exposure in test 1 reduced approach behaviour to the compound context-cue stimulus in test 2, suggesting that repeated context but not cue exposures diminished the conditioned response. Hence, this modified CPP paradigm is useful for the investigation of approach behaviour for both drug-associated context and cue, and allows further investigation of mechanisms underlying cue- and context-dependent appetitive learning.
Hippocampal Regulation of Contextual Cue-Induced Reinstatement of Cocaine-Seeking Behavior
Atkins, Alison L.; Mashhoon, Yasmin; Kantak, Kathleen M.
2008-01-01
Associations between cocaine and cues facilitate development and maintenance of addiction. We hypothesized that the ventral hippocampus is important for acquisition of these associations. Rats were trained to self-administer cocaine, with or without pre-exposure to distinct sets of cocaine- and saline-paired contextual cues. Next, rats were conditioned for 3 days with the distinct sets of contextual cues paired with cocaine and saline along with distinct discrete cues. Vehicle or lidocaine was infused into the ventral hippocampus prior to conditioning sessions. Following extinction, reinstatement of cocaine-seeking behavior was examined following exposure to contextual cues, discrete cues, or their combination. Inactivation of the ventral hippocampus during conditioning blocked acquisition of the association between cocaine and cocaine-paired contextual cues in that only lidocaine-treated rats with short-term cue exposure failed to reinstate responding in the presence of cocaine-paired contextual cues. Lidocaine also prevented rats in both cue exposure groups from discriminating between cocaine-and saline-paired contextual cues during reinstatement tests. Reinstatement induced by cocaine-paired discrete cues or by contextual and discrete cues together was not impaired for either cue exposure condition. The hippocampus is important for acquisition of the association between cocaine and context and in maintaining discrimination between cocaine-relevant and -irrelevant contextual cues. PMID:18499239
Fanous, Sanya; Guez-Barber, Danielle H; Goldart, Evan M; Schrama, Regina; Theberge, Florence R M; Shaham, Yavin; Hope, Bruce T
2013-01-01
Cue-induced heroin seeking after prolonged withdrawal is associated with neuronal activation and altered gene expression in prefrontal cortex (PFC). However, these previous studies assessed gene expression in all neurons regardless of their activity state during heroin seeking. Using Fos as a marker of neural activity, we describe distinct molecular alterations induced in activated versus non-activated neurons during cue-induced heroin seeking after prolonged withdrawal. We trained rats to self-administer heroin for 10 days (6 h/day) and assessed cue-induced heroin seeking in extinction tests after 14 or 30 days. We used fluorescent-activated cell sorting (FACS) to purify Fos-positive and Fos-negative neurons from PFC 90 min after extinction testing. Flow cytometry showed that Fos-immunoreactivity was increased in less than 10% of sparsely distributed PFC neurons. mRNA levels of the immediate early genes fosB, arc, egr1, and egr2, as well as npy and map2k6, were increased in Fos-positive, but not Fos-negative, neurons. In support of these findings, double-label immunohistochemistry indicated substantial coexpression of neuropeptide Y (NPY)- and Arc-immunoreactivity in Fos-positive neurons. Our data indicate that cue-induced relapse to heroin seeking after prolonged withdrawal induces unique molecular alterations within activated PFC neurons that are distinct from those observed in the surrounding majority of non-activated neurons. Published 2012. This article is a US Government work and is in the public domain in the USA.
The Effect of D-Cycloserine on Immediate vs. Delayed Extinction of Learned Fear
ERIC Educational Resources Information Center
Langton, Julia M.; Richardson, Rick
2010-01-01
We compared the effect of D-cycloserine (DCS) on immediate (10 min after conditioning) and delayed (24 h after conditioning) extinction of learned fear in rats. DCS facilitated both immediate and delayed extinction when the drug was administered after extinction training. However, DCS did not facilitate immediate extinction when administered prior…
Rats that sign-track are resistant to Pavlovian but not instrumental extinction
Ahrens, Allison M.; Singer, Bryan F.; Fitzpatrick, Christopher J.; Morrow, Jonathan D.; Robinson, Terry E.
2015-01-01
Individuals vary in the extent to which they attribute incentive salience to a discrete cue (conditioned stimulus; CS) that predicts reward delivery (unconditioned stimulus; US), which results in some individuals approaching and interacting with the CS (sign-trackers; STs) more than others (goal-trackers; GTs). Here we asked how periods of non-reinforcement influence conditioned responding in STs vs. GTs, in both Pavlovian and instrumental tasks. After classifying rats as STs or GTs by pairing a retractable lever (the CS) with the delivery of a food pellet (US), we introduced periods of non-reinforcement, first by simply withholding the US (i.e., extinction training; experiment 1), then by signaling alternating periods of reward (R) and non-reward (NR) within the same session (experiments 2 and 3). We also examined how alternating R and NR periods influenced instrumental responding for food (experiment 4). STs and GTs did not differ in their ability to discriminate between R and NR periods in the instrumental task. However, in Pavlovian settings STs and GTs responded to periods of non-reward very differently. Relative to STs, GTs very rapidly modified their behavior in response to periods of non-reward, showing much faster extinction and better and faster discrimination between R and NR conditions. These results highlight differences between Pavlovian and instrumental extinction learning, and suggest that if a Pavlovian CS is strongly attributed with incentive salience, as in STs, it may continue to bias attention toward it, and to facilitate persistent and relatively inflexible responding, even when it is no longer followed by reward. PMID:26235331
Gao, Meng; Lengersdorf, Daniel; Stüttgen, Maik C; Güntürkün, Onur
2018-05-02
Extinction learning is an essential mechanism that enables constant adaptation to ever-changing environmental conditions. The underlying neural circuit is mostly studied with rodent models using auditory cued fear conditioning. In order to uncover the variant and the invariant neural properties of extinction learning, we adopted pigeons as an animal model in an appetitive sign-tracking paradigm. The animals firstly learned to respond to two conditioned stimuli in two different contexts (CS-1 in context A and CS-2 in context B), before conditioned responses to the stimuli were extinguished in the opposite contexts (CS-1 in context B and CS-2 in context A). Subsequently, responding to both stimuli was tested in both contexts. Prior to extinction training, we locally injected the N-methyl-d-aspartate receptor (NMDAR) antagonist 2-Amino-5-phosphonovaleric acid (APV) in either the amygdala or the (pre)motor arcopallium to investigate their involvement in extinction learning. Our findings suggest that the encoding of extinction memory required the activation of amygdala, as visible by an impairment of extinction acquisition by concurrent inactivation of local NMDARs. In contrast, consolidation and subsequent retrieval of extinction memory recruited the (pre)motor arcopallium. Also, the inactivation of arcopallial NMDARs induced a general motoric slowing during extinction training. Thus, our results reveal a double dissociation between arcopallium and amygdala with respect to acquisition and consolidation of extinction, respectively. Our study therefore provides new insights on the two key components of the avian extinction network and their resemblance to the data obtained from mammals, possibly indicating a shared neural mechanism underlying extinction learning shaped by evolution. Copyright © 2018 Elsevier B.V. All rights reserved.
Monitoring and regulation of learning in medical education: the need for predictive cues.
de Bruin, Anique B H; Dunlosky, John; Cavalcanti, Rodrigo B
2017-06-01
Being able to accurately monitor learning activities is a key element in self-regulated learning in all settings, including medical schools. Yet students' ability to monitor their progress is often limited, leading to inefficient use of study time. Interventions that improve the accuracy of students' monitoring can optimise self-regulated learning, leading to higher achievement. This paper reviews findings from cognitive psychology and explores potential applications in medical education, as well as areas for future research. Effective monitoring depends on students' ability to generate information ('cues') that accurately reflects their knowledge and skills. The ability of these 'cues' to predict achievement is referred to as 'cue diagnosticity'. Interventions that improve the ability of students to elicit predictive cues typically fall into two categories: (i) self-generation of cues and (ii) generation of cues that is delayed after self-study. Providing feedback and support is useful when cues are predictive but may be too complex to be readily used. Limited evidence exists about interventions to improve the accuracy of self-monitoring among medical students or trainees. Developing interventions that foster use of predictive cues can enhance the accuracy of self-monitoring, thereby improving self-study and clinical reasoning. First, insight should be gained into the characteristics of predictive cues used by medical students and trainees. Next, predictive cue prompts should be designed and tested to improve monitoring and regulation of learning. Finally, the use of predictive cues should be explored in relation to teaching and learning clinical reasoning. Improving self-regulated learning is important to help medical students and trainees efficiently acquire knowledge and skills necessary for clinical practice. Interventions that help students generate and use predictive cues hold the promise of improved self-regulated learning and achievement. This framework is applicable to learning in several areas, including the development of clinical reasoning. © 2017 The Authors Medical Education published by Association for the Study of Medical Education and John Wiley & Sons Ltd.
Pre-trauma individual differences in extinction learning predict posttraumatic stress.
Lommen, Miriam J J; Engelhard, Iris M; Sijbrandij, Marit; van den Hout, Marcel A; Hermans, Dirk
2013-02-01
In the aftermath of a traumatic event, many people suffer from psychological distress, but only a minority develops posttraumatic stress disorder (PTSD). Pre-trauma individual differences in fear conditioning, most notably reduced extinction learning, have been proposed as playing an important role in the etiology of PTSD. However, prospective data are lacking. In this study, we prospectively tested whether reduced extinction was a predictor for later posttraumatic stress. Dutch soldiers (N = 249) were administered a conditioning task before their four-month deployment to Afghanistan to asses individual differences in extinction learning. After returning home, posttraumatic stress was measured. Results showed that reduced extinction learning before deployment predicted subsequent PTSD symptom severity, over and beyond degree of pre-deployment stress symptoms, neuroticism, and exposure to stressors on deployment. The findings suggest that reduced extinction learning may play a role in the development of PTSD. Copyright © 2012 Elsevier Ltd. All rights reserved.
Beyond Nonutilization: Irrelevant Cues Can Gate Learning in Probabilistic Categorization
ERIC Educational Resources Information Center
Little, Daniel R.; Lewandowsky, Stephan
2009-01-01
In probabilistic categorization, also known as multiple cue probability learning (MCPL), people learn to predict a discrete outcome on the basis of imperfectly valid cues. In MCPL, normatively irrelevant cues are usually ignored, which stands in apparent conflict with recent research in deterministic categorization that has shown that people…
Extinction of Conditioned Fear is Better Learned and Recalled in the Morning than in the Evening
Pace-Schott, Edward F.; Spencer, Rebecca M.C.; Vijayakumar, Shilpa; Ahmed, Nafis; Verga, Patrick W.; Orr, Scott P.; Pitman, Roger K.; Milad, Mohammed R.
2013-01-01
Sleep helps emotional memories consolidate and may promote generalization of fear extinction memory. We examined whether extinction learning and memory might differ in the morning and evening due, potentially, to circadian and/or sleep-homeostatic factors. Healthy men (N=109) in 6 groups completed a 2-session protocol. In Session 1, fear conditioning was followed by extinction learning. Partial reinforcement with mild electric shock produced conditioned skin conductance responses (SCR) to 2 differently colored lamps (CS+), but not a third color (CS−), within the computer image of a room (conditioning context). One CS+ (CS+E) but not the other (CS+U) was immediately extinguished by un-reinforced presentations in a different room (extinction context). Delay durations of 3 hr (within AM or PM), 12 hr (morning-to-evening or evening-to-morning) or 24 hr (morning-to-morning or evening-to-evening) followed. In Session 2, extinction recall and contextual fear renewal were tested. We observed no significant effects of the delay interval on extinction memory but did observe an effect of time-of-day. Fear extinction was significantly better if learned in the morning (p=.002). Collapsing across CS+ type, there was smaller morning differential SCR at both extinction recall (p=.003) and fear renewal (p=.005). Morning extinction recall showed better generalization from the CS+E to CS+U with the response to the CS+U significantly larger than to the CS+E only in the evening (p=.028). Thus, extinction is learned faster and its memory is better generalized in the morning. Cortisol and testosterone showed the expected greater salivary levels in the morning when higher testosterone/cortisol ratio also predicting better extinction learning. Circadian factors may promote morning extinction. Alternatively, evening homeostatic sleep pressure may impede extinction and favor recall of conditioned fear. PMID:23992769
Extinction of conditioned fear is better learned and recalled in the morning than in the evening.
Pace-Schott, Edward F; Spencer, Rebecca M C; Vijayakumar, Shilpa; Ahmed, Nafis A K; Verga, Patrick W; Orr, Scott P; Pitman, Roger K; Milad, Mohammed R
2013-11-01
Sleep helps emotional memories consolidate and may promote generalization of fear extinction memory. We examined whether extinction learning and memory might differ in the morning and evening due, potentially, to circadian and/or sleep-homeostatic factors. Healthy men (N = 109) in 6 groups completed a 2-session protocol. In Session 1, fear conditioning was followed by extinction learning. Partial reinforcement with mild electric shock produced conditioned skin conductance responses (SCRs) to 2 differently colored lamps (CS+), but not a third color (CS-), within the computer image of a room (conditioning context). One CS+ (CS + E) but not the other (CS + U) was immediately extinguished by un-reinforced presentations in a different room (extinction context). Delay durations of 3 h (within AM or PM), 12 h (morning-to-evening or evening-to-morning) or 24 h (morning-to-morning or evening-to-evening) followed. In Session 2, extinction recall and contextual fear renewal were tested. We observed no significant effects of the delay interval on extinction memory but did observe an effect of time-of-day. Fear extinction was significantly better if learned in the morning (p = .002). Collapsing across CS + type, there was smaller morning differential SCR at both extinction recall (p = .003) and fear renewal (p = .005). Morning extinction recall showed better generalization from the CS + E to CS + U with the response to the CS + U significantly larger than to the CS + E only in the evening (p = .028). Thus, extinction is learned faster and its memory is better generalized in the morning. Cortisol and testosterone showed the expected greater salivary levels in the morning when higher testosterone/cortisol ratio also predicted better extinction learning. Circadian factors may promote morning extinction. Alternatively, evening homeostatic sleep pressure may impede extinction and favor recall of conditioned fear. Copyright © 2013 Elsevier Ltd. All rights reserved.
Reed, Phil; Broomfield, Laura; McHugh, Louise; McCausland, Aisling; Leader, Geraldine
2009-02-01
Two experiments examined whether over-selectivity is the product of a post-acquisition performance deficit, rather than an attention problem. In both experiments, children with Autistic Spectrum Disorder were presented with a trial-and-error discrimination task using two, two-element stimuli and over-selected in both studies. After behavioral control by the previously over-selected stimulus was extinguished, behavioral control by the previously under-selected cue emerged without direct training. However, this effect was only found in higher-functioning children, and not with more severely impaired children. These findings suggest that over-selectivity is not simply due to a failure to attend to all of the stimuli presented. They also suggest that extinction of over-selected stimuli may be a fruitful line of intervention for clinical intervention for some individuals.
Arico, Carolyn; Bagley, Elena E; Carrive, Pascal; Assareh, Neda; McNally, Gavan P
2017-10-01
The midbrain periaqueductal gray (PAG) has been implicated in the generation and transmission of a prediction error signal that instructs amygdala-based fear and extinction learning. However, the PAG also plays a key role in the expression of conditioned fear responses. The evidence for a role of the PAG in fear learning and extinction learning has been obtained almost exclusively using PAG-dependent fear responses. It is less clear whether the PAG regulates fear learning when other measures of learned fear are used. Here we combined a chemogenetic approach, permitting excitation or inhibition of neurons in the ventrolateral PAG (VLPAG), with conditioned suppression as the measure of learned fear to assess the role of VLPAG in the acquisition and extinction of fear learning. We show that chemogenetic excitation of VLPAG (with some encroachment on lateral PAG [LPAG]) impairs acquisition of fear and, conversely, chemogenetic inhibition impairs extinction of fear. These effects on fear and extinction learning were specific to the combination of DREADD expression and injection of CNO because they were observed relative to both eYFP controls injected with CNO as well as DREADD expressing controls injected with vehicle. Taken together, these results show that activity of L/VLPAG neurons regulates both the acquisition and extinction of Pavlovian fear learning. Copyright © 2017 Elsevier Inc. All rights reserved.
Kristjánsson, Arni
2009-04-24
Previously demonstrated learning effects in shifts of transient attention have only been shown to result in beneficial effects upon secondary discrimination tasks and affect landing points of express saccades. Can such learning result in more direct effects upon perception than previously demonstrated? Observers performed a cued Vernier acuity discrimination task where the cue was one of a set of ambiguous figure-ground displays (with a black and white part). The critical measure was whether, if a target appeared consistently within a part of a cue of a certain brightness, this would result in learning effects and whether such learning would then affect recognition of the cue parts. Critically the target always appeared within the same part of each individual cue. Some cues were used in early parts of streaks of repetition of cue-part brightness, and others in latter parts of such streaks. All the observers showed learning in shifts of transient attention, with improved performance the more often the target appeared within the part of the cue of the same brightness. Subsequently the observers judged whether cue-parts had been parts of the cues used on the preceding discrimination task. Recognition of the figure parts, where the target had consistently appeared, improved strongly with increased length of streaks of repetition of cue-part brightness. Learning in shifts of transient attention leads not only to faster attention shifts but to direct effects upon perception, in this case recognition of parts of figure-ground ambiguous cues.
Attention to irrelevant cues is related to positive symptoms in schizophrenia.
Morris, Richard; Griffiths, Oren; Le Pelley, Michael E; Weickert, Thomas W
2013-05-01
Many modern learning theories assume that the amount of attention to a cue depends on how well that cue predicted important events in the past. Schizophrenia is associated with deficits in attention and recent theories of psychosis have argued that positive symptoms such as delusions and hallucinations are related to a failure of selective attention. However, evidence demonstrating that attention to irrelevant cues is related to positive symptoms in schizophrenia is lacking. We used a novel method of measuring attention to nonpredictive (and thus irrelevant) cues in a causal learning test (Le Pelley ME, McLaren IP. Learned associability and associative change in human causal learning. Q J Exp Psychol B. 2003;56:68-79) to assess whether healthy adults and people with schizophrenia discriminate previously predictive and nonpredictive cues. In a series of experiments with independent samples, we demonstrated: (1) when people with schizophrenia who had severe positive symptoms successfully distinguished between predictive and nonpredictive cues during training, they failed to discriminate between predictive and nonpredictive cues relative to healthy adults during subsequent testing and (2) learning about nonpredictive cues was correlated with more severe positive symptoms scores in schizophrenia. These results suggest that positive symptoms of schizophrenia are related to increased attention to nonpredictive cues during causal learning. This deficit in selective attention results in learning irrelevant causal associations and may be the basis of positive symptoms in schizophrenia.
Nett, Kelle E.; Cosme, Caitlin V.; Worth, Wensday R.; Wemmie, John A.
2017-01-01
The infralimbic cortex (IL) mediates extinction learning and the active suppression of cocaine-seeking behavior. However, the precise temporal relationship among IL activity, lever pressing, and extinction learning is unclear. To address this issue, we used activity-guided optogenetics in male Sprague Dawley rats to silence IL pyramidal neurons optically for 20 s immediately after unreinforced lever presses during early extinction training after cocaine self-administration. Optical inhibition of the IL increased active lever pressing during shortened extinction sessions, but did not alter the retention of the extinction learning as assessed in ensuing extinction sessions with no optical inhibition. During subsequent cued reinstatement sessions, rats that had previously received optical inhibition during the extinction sessions showed increased cocaine-seeking behavior. These findings appeared to be specific to inhibition during the post-lever press period because IL inhibition given in a noncontingent, pseudorandom manner during extinction sessions did not produce the same effects. Illumination alone (i.e., with no opsin expression) and food-seeking control experiments also failed to produce the same effects. In another experiment, IL inhibition after lever presses during cued reinstatement sessions increased cocaine seeking during those sessions. Finally, inhibition of the prelimbic cortex immediately after unreinforced lever presses during shortened extinction sessions decreased lever pressing during these sessions, but had no effect on subsequent reinstatement. These results indicate that IL activity immediately after unreinforced lever presses is necessary for normal extinction of cocaine seeking, suggesting that critical encoding of the new contingencies between a lever press and a cocaine reward occurs during that period. SIGNIFICANCE STATEMENT The infralimbic cortex (IL) contributes to the extinction of cocaine-seeking behavior, but the precise relationship among IL activity, lever pressing during extinction, and extinction learning has not been elucidated using traditional methods. Using a closed-loop optogenetic approach, we found that selective inhibition of the IL immediately after unreinforced lever pressing impaired within-session extinction learning and promoted the subsequent cued reinstatement of cocaine seeking. These studies suggest that IL activity immediately after the instrumental response during extinction learning of cocaine seeking encodes information required for such learning and that altering such activity produces long-lasting changes in subsequent measures of cocaine craving/relapse. PMID:28539416
Gutman, Andrea L; Nett, Kelle E; Cosme, Caitlin V; Worth, Wensday R; Gupta, Subhash C; Wemmie, John A; LaLumiere, Ryan T
2017-06-21
The infralimbic cortex (IL) mediates extinction learning and the active suppression of cocaine-seeking behavior. However, the precise temporal relationship among IL activity, lever pressing, and extinction learning is unclear. To address this issue, we used activity-guided optogenetics in male Sprague Dawley rats to silence IL pyramidal neurons optically for 20 s immediately after unreinforced lever presses during early extinction training after cocaine self-administration. Optical inhibition of the IL increased active lever pressing during shortened extinction sessions, but did not alter the retention of the extinction learning as assessed in ensuing extinction sessions with no optical inhibition. During subsequent cued reinstatement sessions, rats that had previously received optical inhibition during the extinction sessions showed increased cocaine-seeking behavior. These findings appeared to be specific to inhibition during the post-lever press period because IL inhibition given in a noncontingent, pseudorandom manner during extinction sessions did not produce the same effects. Illumination alone (i.e., with no opsin expression) and food-seeking control experiments also failed to produce the same effects. In another experiment, IL inhibition after lever presses during cued reinstatement sessions increased cocaine seeking during those sessions. Finally, inhibition of the prelimbic cortex immediately after unreinforced lever presses during shortened extinction sessions decreased lever pressing during these sessions, but had no effect on subsequent reinstatement. These results indicate that IL activity immediately after unreinforced lever presses is necessary for normal extinction of cocaine seeking, suggesting that critical encoding of the new contingencies between a lever press and a cocaine reward occurs during that period. SIGNIFICANCE STATEMENT The infralimbic cortex (IL) contributes to the extinction of cocaine-seeking behavior, but the precise relationship among IL activity, lever pressing during extinction, and extinction learning has not been elucidated using traditional methods. Using a closed-loop optogenetic approach, we found that selective inhibition of the IL immediately after unreinforced lever pressing impaired within-session extinction learning and promoted the subsequent cued reinstatement of cocaine seeking. These studies suggest that IL activity immediately after the instrumental response during extinction learning of cocaine seeking encodes information required for such learning and that altering such activity produces long-lasting changes in subsequent measures of cocaine craving/relapse. Copyright © 2017 the authors 0270-6474/17/376075-12$15.00/0.
Vernetti, Angélina; Smith, Tim J; Senju, Atsushi
2017-03-15
While numerous studies have demonstrated that infants and adults preferentially orient to social stimuli, it remains unclear as to what drives such preferential orienting. It has been suggested that the learned association between social cues and subsequent reward delivery might shape such social orienting. Using a novel, spontaneous indication of reinforcement learning (with the use of a gaze contingent reward-learning task), we investigated whether children and adults' orienting towards social and non-social visual cues can be elicited by the association between participants' visual attention and a rewarding outcome. Critically, we assessed whether the engaging nature of the social cues influences the process of reinforcement learning. Both children and adults learned to orient more often to the visual cues associated with reward delivery, demonstrating that cue-reward association reinforced visual orienting. More importantly, when the reward-predictive cue was social and engaging, both children and adults learned the cue-reward association faster and more efficiently than when the reward-predictive cue was social but non-engaging. These new findings indicate that social engaging cues have a positive incentive value. This could possibly be because they usually coincide with positive outcomes in real life, which could partly drive the development of social orienting. © 2017 The Authors.
Recovery effects after extinction in the Morris swimming pool navigation task.
Prados, José; Manteiga, Raúl D; Sansa, Joan
2003-08-01
In three experiments in which rats were used as subjects, we developed an extinction procedure using a Morris pool. The animals were trained to find a hidden platform located at a fixed position and were then given extinction trials in which the platform was removed from the pool. When training and extinction were carried out in the same context and time was allowed to elapse between extinction and test, spontaneous recovery of learning was observed. On the other hand, those rats that received extinction in a context different from the one used for training failed to show spontaneous recovery of learning when tested in the extinction context after an interval of 96 h. However, they did show renewal of spatial learning when tested in the training context. These results show that extinction in the spatial domain behaves like extinction in standard conditioning preparations.
Soeter, Marieke; Kindt, Merel
2015-01-01
Disrupting the process of memory reconsolidation may point to a novel therapeutic strategy for the permanent reduction of fear in patients suffering from anxiety disorders. However both in animal and human studies the retrieval cue typically involves a re-exposure to the original fear-conditioned stimulus (CS). A relevant question is whether abstract cues not directly associated with the threat event also trigger reconsolidation, given that anxiety disorders often result from vicarious or unobtrusive learning for which no explicit memory exists. Insofar as the fear memory involves a flexible representation of the original learning experience, we hypothesized that the process of memory reconsolidation may also be triggered by abstract cues. We addressed this hypothesis by using a differential human fear-conditioning procedure in two distinct fear-learning groups. We predicted that if fear learning involves discrimination on basis of perceptual cues within one semantic category (i.e., the perceptual-learning group, n = 15), the subsequent ambiguity of the abstract retrieval cue would not trigger memory reconsolidation. In contrast, if fear learning involves discriminating between two semantic categories (i.e., categorical-learning group, n = 15), an abstract retrieval cue would unequivocally reactivate the fear memory and might subsequently trigger memory reconsolidation. Here we show that memory reconsolidation may indeed be triggered by another cue than the one that was present during the original learning occasion, but this effect depends on the learning history. Evidence for fear memory reconsolidation was inferred from the fear-erasing effect of one pill of propranolol (40 mg) systemically administered upon exposure to the abstract retrieval cue. Our finding that reconsolidation of a specific fear association does not require exposure to the original retrieval cue supports the feasibility of reconsolidation-based interventions for emotional disorders.
A configural dominant account of contextual cueing: Configural cues are stronger than colour cues.
Kunar, Melina A; John, Rebecca; Sweetman, Hollie
2014-01-01
Previous work has shown that reaction times to find a target in displays that have been repeated are faster than those for displays that have never been seen before. This learning effect, termed "contextual cueing" (CC), has been shown using contexts such as the configuration of the distractors in the display and the background colour. However, it is not clear how these two contexts interact to facilitate search. We investigated this here by comparing the strengths of these two cues when they appeared together. In Experiment 1, participants searched for a target that was cued by both colour and distractor configural cues, compared with when the target was only predicted by configural information. The results showed that the addition of a colour cue did not increase contextual cueing. In Experiment 2, participants searched for a target that was cued by both colour and distractor configuration compared with when the target was only cued by colour. The results showed that adding a predictive configural cue led to a stronger CC benefit. Experiments 3 and 4 tested the disruptive effects of removing either a learned colour cue or a learned configural cue and whether there was cue competition when colour and configural cues were presented together. Removing the configural cue was more disruptive to CC than removing colour, and configural learning was shown to overshadow the learning of colour cues. The data support a configural dominant account of CC, where configural cues act as the stronger cue in comparison to colour when they are presented together.
Aging and Retrospective Revaluation of Causal Learning
Mutter, Sharon A.; Atchley, Anthony R.; Plumlee, Leslie M.
2011-01-01
In a two-stage causal learning task, young and older participants first learned which foods presented in compound were followed by an allergic reaction (e.g., STEAK - BEANS → REACTION) and then the causal efficacy of one food from these compounds was revalued (e.g., BEANS → NO REACTION). In Experiment 1, unrelated food pairs were used and although there were no age differences in compound or single cue – outcome learning, older adults did not retrospectively revalue the causal efficacy of the absent target cues (e.g. STEAK). However, they had weaker within – compound associations for the unrelated foods and this may have prevented them from retrieving the representations of these cues. In Experiment 2, older adults still showed no retrospective revaluation of absent cues even though compound food cues with pre-existing associations were used (e.g., STEAK - POTATO) and they received additional learning trials. Finally, in Experiment 3, older adults revalued the causal efficacy of the target cues when small, unobtrusive icons of these cues were present during single cue revaluation. These findings suggest that age – related deficits in causal learning for absent cues are due to ineffective associative binding and reactivation processes. PMID:21843025
Manassa, R P; McCormick, M I; Chivers, D P; Ferrari, M C O
2013-08-22
The ability of prey to observe and learn to recognize potential predators from the behaviour of nearby individuals can dramatically increase survival and, not surprisingly, is widespread across animal taxa. A range of sensory modalities are available for this learning, with visual and chemical cues being well-established modes of transmission in aquatic systems. The use of other sensory cues in mediating social learning in fishes, including mechano-sensory cues, remains unexplored. Here, we examine the role of different sensory cues in social learning of predator recognition, using juvenile damselfish (Amphiprion percula). Specifically, we show that a predator-naive observer can socially learn to recognize a novel predator when paired with a predator-experienced conspecific in total darkness. Furthermore, this study demonstrates that when threatened, individuals release chemical cues (known as disturbance cues) into the water. These cues induce an anti-predator response in nearby individuals; however, they do not facilitate learnt recognition of the predator. As such, another sensory modality, probably mechano-sensory in origin, is responsible for information transfer in the dark. This study highlights the diversity of sensory cues used by coral reef fishes in a social learning context.
Auchter, Allison M.; Shumake, Jason; Gonzalez-Lima, Francisco; Monfils, Marie H.
2017-01-01
Many factors account for how well individuals extinguish conditioned fears, such as genetic variability, learning capacity and conditions under which extinction training is administered. We predicted that memory-based interventions would be more effective to reduce the reinstatement of fear in subjects genetically predisposed to display more extinction learning. We tested this hypothesis in rats genetically selected for differences in fear extinction using two strategies: (1) attenuation of fear memory using post-retrieval extinction training, and (2) pharmacological enhancement of the extinction memory after extinction training by low-dose USP methylene blue (MB). Subjects selectively bred for divergent extinction phenotypes were fear conditioned to a tone stimulus and administered either standard extinction training or retrieval + extinction. Following extinction, subjects received injections of saline or MB. Both reconsolidation updating and MB administration showed beneficial effects in preventing fear reinstatement, but differed in the groups they targeted. Reconsolidation updating showed an overall effect in reducing fear reinstatement, whereas pharmacological memory enhancement using MB was an effective strategy, but only for individuals who were responsive to extinction. PMID:28397861
Reinstatement of MDMA (ecstasy) seeking by exposure to discrete drug-conditioned cues
Ball, Kevin T.; Walsh, Kelly M.; Rebec, George V.
2007-01-01
The widely used recreational drug MDMA (ecstasy) supports self-administration in animals, but it is not known whether MDMA-associated cues are able to reinstate drug seeking in a relapse model of drug addiction. To assess this possibility, drug-naïve rats were trained to press a lever for MDMA infusions (0.30 mg/kg/infusion, i.v.) paired with a compound cue (light and tone) in daily 2 hr sessions. Responding was reinforced contingent on a modified fixed-ratio 5 schedule of reinforcement. Conditioned cue-induced reinstatement tests were conducted after lever pressing was extinguished in the absence of MDMA and the conditioned cues. Conditioned cues reinstated lever pressing after extinction, and the magnitude of reinstatement was positively correlated with the level of responding during MDMA self-administration. These results show for the first time that conditioned cues can trigger reinstatement of MDMA-seeking behavior in rats, and that individual differences in the pattern of MDMA self-administration can predict the magnitude of reinstatement responding. PMID:17602729
ROLES OF OPIOID RECEPTOR SUBTYPES IN MEDIATING ALCOHOL SEEKING INDUCED BY DISCRETE CUES AND CONTEXT
Marinelli, Peter W.; Funk, Douglas; Harding, Stephen; Li, Zhaoxia; Juzytsch, Walter; Lê, A.D.
2009-01-01
The aim of this study was to assess the effects of selective blockade of the delta (DOP) or mu opioid (MOP) receptors on alcohol seeking induced by discrete cues and context. In Experiment 1, rats were trained to self-administer alcohol in an environment with distinct sensory properties. After extinction in a different context with separate sensory properties, rats were tested for context-induced renewal in the original context following treatment with the DOP receptor antagonist naltrindole (0 – 15-mg/kg, IP) or the MOP receptor antagonist CTOP (0 – 3-µg/kg ICV). In a separate set of experiments, reinstatement was tested with the presentation of a discrete light+tone cue previously associated with alcohol delivery, following extinction without the cue. In Experiment 2, the effects of naltrindole (0 – 5-mg/kg, IP) or CTOP (0 – 3-µg/kg µg ICV) were assessed. For context-induced renewal, 7.5-mg/kg naltrindole reduced responding without affecting locomotor activity. Both doses of CTOP attenuated responding in the first 15 min of the renewal test session; however, total responses did not differ at the end of the session. For discrete cue-induced reinstatement, 1 and 5-mg/kg naltrindole attenuated responding, but CTOP had no effect. We conclude that while DOP receptors mediate alcohol seeking induced by discrete cues and context, MOP receptors may play a modest role only in context-induced renewal. These findings point to a differential involvement of opioid receptor subtypes in the effects of different kinds of conditioned stimuli on alcohol seeking, and support a more prominent role for DOP receptors. PMID:19686472
Caprioli, Daniele; Venniro, Marco; Zeric, Tamara; Li, Xuan; Adhikary, Sweta; Madangopal, Rajtarun; Marchant, Nathan J; Lucantonio, Federica; Schoenbaum, Geoffrey; Bossert, Jennifer M; Shaham, Yavin
2015-10-01
Cue-induced methamphetamine craving increases after prolonged forced (experimenter-imposed) abstinence from the drug (incubation of methamphetamine craving). Here, we determined whether this incubation phenomenon would occur under conditions that promote voluntary (self-imposed) abstinence. We also determined the effect of the novel metabotropic glutamate receptor 2 positive allosteric modulator, AZD8529, on incubation of methamphetamine craving after forced or voluntary abstinence. We trained rats to self-administer palatable food (6 sessions) and then to self-administer methamphetamine under two conditions: 12 sessions (9 hours/day) or 50 sessions (3 hours/day). We then assessed cue-induced methamphetamine seeking in extinction tests after 1 or 21 abstinence days. Between tests, the rats underwent either forced abstinence (no access to the food- or drug-paired levers) or voluntary abstinence (achieved via a discrete choice procedure between methamphetamine and palatable food; 20 trials per day) for 19 days. We also determined the effect of subcutaneous injections of AZD8529 (20 and 40 mg/kg) on cue-induced methamphetamine seeking 1 day or 21 days after forced or voluntary abstinence. Under both training and abstinence conditions, cue-induced methamphetamine seeking in the extinction tests was higher after 21 abstinence days than after 1 day (incubation of methamphetamine craving). AZD8529 decreased cue-induced methamphetamine seeking on day 21 but not day 1 of forced or voluntary abstinence. We introduce a novel animal model to study incubation of drug craving and cue-induced drug seeking after prolonged voluntary abstinence, mimicking the human condition of relapse after successful contingency management treatment. Our data suggest that positive allosteric modulators of metabotropic glutamate receptor 2 should be considered for relapse prevention. Published by Elsevier Inc.
Kaiyala, Karl J; Woods, Stephen C; Ramsay, Douglas S
2014-01-01
We asked whether chronic tolerance and the hyperthermic sign-reversal induced by repeated 60% N 2 O exposures could be extinguished using a cue-exposure paradigm. Rats received 18 N 2 O administrations in a total calorimetry system that simultaneously measures core temperature (Tc), metabolic heat production (HP), and body heat loss (HL). Each exposure entailed a 2-h baseline period followed by a 1.5-h N 2 O exposure. The 18 drug exposures induced a robust intra-administration hyperthermia in which the initial hypothermic effect of N 2 O inverted to a significant hyperthermic sign-reversal during N 2 O inhalation due primarily to an acquired robust increase in HP. The rats were then randomized to one of three extinction procedures (n=8/procedure) over a 20-d interval: 1) a N 2 O-abstinent home-cage group (HC) that received only the usual animal care; 2) a cue-exposure group (CEXP) in which the animals were placed in the calorimeter 8 times but received no N 2 O; and 3) a drug-onset-cue group (DOC) in which animals received a brief N 2 O exposure in the calorimeter that mimicked the first 3 min of an actual 60% N 2 O trial. Following the extinction sessions, all rats received a 60% N 2 O test trial and Tc, HP and HL were assessed. The hyperthermic sign-reversal remained fully intact during the test trial, with no significant differences observed among groups in any post-baseline change in any thermal outcome. These data suggest that cue exposure may not be an efficacious strategy to reduce sign-reversals that develop with chronic drug use.
ERIC Educational Resources Information Center
Felsenberg, Johannes; Dombrowski, Vincent; Eisenhardt, Dorothea
2012-01-01
Protein degradation is known to affect memory formation after extinction learning. We demonstrate here that an inhibitor of protein degradation, MG132, interferes with memory formation after extinction learning in a classical appetitive conditioning paradigm. In addition, we find an enhancement of memory formation when the same inhibitor is…
Panayi, Marios C; Killcross, Simon
2014-02-01
The orbitofrontal cortex (OFC) is argued to be the neural locus of Pavlovian outcome expectancies. Reinforcement learning theories argue that extinction learning in Pavlovian procedures is caused by the discrepancy between the expected value of the outcome (US) that is elicited by a predictive stimulus (CS), and the lack of experienced US. If the OFC represents Pavlovian outcome expectancies that are necessary for extinction learning, then disrupting OFC function prior to extinction training should impair extinction learning. This was tested. In experiment 1, Long Evans rats received infusions of saline or muscimol targeting the lateral OFC prior to three appetitive Pavlovian extinction sessions. Muscimol infused into the OFC disrupted between-session but not within-session extinction behaviour. This finding was not due to muscimol infusions disrupting the memory consolidation process per se as there was no effect of muscimol infusion when administered immediately post session (experiment 2). These findings support a role for the OFC in representing outcome expectancies that are necessary for learning. A number of ways in which disrupting outcome expectancy information might block learning will be discussed in the context of traditional associative learning theories and the associative structures they depend on. Copyright © 2013 Elsevier Inc. All rights reserved.
Comparative learning theory and its application in the training of horses.
Cooper, J J
1998-11-01
Training can best be explained as a process that occurs through stimulus-response-reinforcement chains, whereby animals are conditioned to associate cues in their environment, with specific behavioural responses and their rewarding consequences. Research into learning in horses has concentrated on their powers of discrimination and on primary positive reinforcement schedules, where the correct response is paired with a desirable consequence such as food. In contrast, a number of other learning processes that are used in training have been widely studied in other species, but have received little scientific investigation in the horse. These include: negative reinforcement, where performance of the correct response is followed by removal of, or decrease in, intensity of a unpleasant stimulus; punishment, where an incorrect response is paired with an undesirable consequence, but without consistent prior warning; secondary conditioning, where a natural primary reinforcer such as food is closely associated with an arbitrary secondary reinforcer such as vocal praise; and variable or partial conditioning, where once the correct response has been learnt, reinforcement is presented according to an intermittent schedule to increase resistance to extinction outside of training.
Maeng, Lisa Y; Cover, Kara K; Taha, Mohamad B; Landau, Aaron J; Milad, Mohammed R; Lebrón-Milad, Kelimer
2017-01-02
There is growing evidence that estradiol (E2) enhances fear extinction memory consolidation. However, it is unclear how E2 influences the nodes of the fear extinction network to enhance extinction memory. This study begins to delineate the neural circuits underlying the influence of E2 on fear extinction acquisition and consolidation in female rats. After fear conditioning (day 1), naturally cycling female rats underwent extinction learning (day 2) in a low-E2 state, receiving a systemic administration of either E2 or vehicle prior to extinction training. Extinction memory recall was then tested 24 hr later (day 3). We measured immediate early gene c-fos expression within the extinction network during fear extinction learning and extinction recall. During extinction learning, E2 treatment increased centrolateral amygdala c-fos activity and reduced lateral amygdala activity relative to vehicle. During extinction recall, E2-treated rats exhibited reduced c-fos expression in the centromedial amygdala. There were no group differences in c-fos expression within the medial prefrontal cortex or dorsal hippocampus. Examining c-fos ratios with the infralimbic cortex (IL) revealed that, despite the lack of group differences within the IL, E2 treatment induced greater IL activity relative to both prelimbic cortex and central amygdala (CeA) activity during extinction memory recall. Only the relationship between IL and CeA activity positively correlated with extinction retention. In conclusion, E2 appears to modify interactions between the IL and the CeA in females, shifting from stronger amygdalar modulation of fear during extinction learning to stronger IL control during extinction recall. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.
2009-07-01
reduced extinction of cue- conditioned fear. The temporal characteristics of the model must be amenable to testing acute drug treatment in the...that is sensitive to both enhanced and attenuated fear conditioning and extinction -Established a drug treatment regimen that is feasible in the...nonassociative theories of the UCS preexposure phenomenon: Implications for Pavlovian conditioning . Psychol Bull 86: 523-548 Stam R (2007) PTSD and stress
How food cues can enhance and inhibit motivation to obtain and consume food.
Colagiuri, Ben; Lovibond, Peter F
2015-01-01
Learning may play an important role in over-eating. One example is Pavlovian-to-instrumental transfer (PIT), whereby reward cues facilitate responding to obtain that reward. Whilst there is increasing research indicating PIT for food in humans, these studies have exclusively tested PIT under instrumental extinction (i.e. when the food is no longer available), which may reduce their ecological validity. To address this, we conducted two experiments exploring PIT for food in humans when tested under instrumental reinforcement. Participants first underwent Pavlovian discrimination training with an auditory cue paired with a chocolate reward (CS+) and another auditory cue unpaired (CS-). In instrumental training participants learnt to press a button to receive the chocolate reward on a VR10 schedule. In the test phase, each CS was presented whilst participants maintained the opportunity to press the button to receive chocolate. In Experiment 1, the PIT test was implemented after up to 20 min of instrumental training (satiation) whereas in Experiment 2 it was implemented after only 4 min of instrumental training. In both experiments there was evidence for differential PIT, but the pattern differed according to the rate of responding at the time of the PIT test. In low baseline responders the CS+ facilitated both button press responding and consumption, whereas in high baseline responders the CS- suppressed responding. These findings suggest that both excitatory and inhibitory associations may be learnt during PIT training and that the expression of these associations depends on motivation levels at the time the cues are encountered. Particularly concerning is that a food-paired cue can elicit increased motivation to obtain and consume food even when the participant is highly satiated and no longer actively seeking food, as this may be one mechanism by which over-consumption is maintained. Copyright © 2014 Elsevier Ltd. All rights reserved.
Schroeder, Jason P.; Spanos, Marina; Stevenson, Jennie R.; Besheer, Joyce; Salling, Michael; Hodge, Clyde W.
2008-01-01
Relapse to alcohol use after periods of abstinence is a hallmark behavioral pathology of alcoholism and a major clinical problem. Emerging evidence indicates that metabotropic glutamate receptor 5 (mGluR5) antagonists attenuate relapse to alcohol-seeking behavior but the molecular mechanisms of this potential therapeutic effect remain unexplored. The extracellular signal-regulated kinase (ERK1/2) pathway is downstream of mGluR5 and has been implicated in addiction. We sought to determine if cue-induced reinstatement of alcohol-seeking behavior, and its reduction by an mGluR5 antagonist, is associated with changes in ERK1/2 activation in reward-related limbic brain regions. Selectively bred alcohol-preferring (P) rats were trained to lever press on a concurrent schedule of alcohol (15% v/v) vs. water reinforcement. Following 9 days of extinction, rats were given an additional extinction trial or injected with the mGluR5 antagonist MPEP (0, 1, 3, or 10 mg/kg) and tested for cue-induced reinstatement. Brains were removed 90-min later from the rats in the extinction and MPEP (0 or 10 mg/kg) conditions for analysis of p-ERK1/2, total ERK1/2, and p-ERK5 immunoreactivity (IR). Cue-induced reinstatement of alcohol-seeking behavior was associated with a 3–5 fold increase in p-ERK1/2 IR in the basolateral amygdala and nucleus accumbens shell. MPEP administration blocked both the relapse-like behavior and increase in p-ERK1/2 IR. P-ERK1/2 IR in the central amygdala and NAcb core was dissociated with the relapse-like behavior and the pharmacological effect of mGluR5 blockade. No changes in total ERK or p-ERK5 were observed. These results suggest that exposure to cues previously associated with alcohol self-administration is sufficient to produce concomitant increases in relapse-like behavior and ERK1/2 activation in specific limbic brain regions. Pharmacological compounds, such as mGluR5 antagonists, that reduce cue-induced ERK1/2 activation may be useful for treatment of relapse in alcoholics that is triggered by exposure to environmental events. PMID:18619984
Associative learning versus fear habituation as predictors of long-term extinction retention.
Brown, Lily A; LeBeau, Richard T; Chat, Ka Yi; Craske, Michelle G
2017-06-01
Violation of unconditioned stimulus (US) expectancy during extinction training may enhance associative learning and result in improved long-term extinction retention compared to within-session habituation. This experiment examines variation in US expectancy (i.e., expectancy violation) as a predictor of long-term extinction retention. It also examines within-session habituation of fear-potentiated startle (electromyography, EMG) and fear of conditioned stimuli (CS) throughout extinction training as predictors of extinction retention. Participants (n = 63) underwent fear conditioning, extinction and retention and provided continuous ratings of US expectancy and EMG, as well as CS fear ratings before and after each phase. Variation in US expectancy throughout extinction and habituation of EMG and fear was entered into a regression as predictors of retention and reinstatement of levels of expectancy and fear. Greater variation in US expectancy throughout extinction training was significantly predictive of enhanced extinction performance measured at retention test, although not after reinstatement test. Slope of EMG and CS fear during extinction did not predict retention of extinction. Within-session habituation of EMG and self-reported fear is not sufficient for long-term retention of extinction learning, and models emphasizing expectation violation may result in enhanced outcomes.
Gaudio, Jennifer L; Snowdon, Charles T
2008-11-01
Animals living in stable home ranges have many potential cues to locate food. Spatial and color cues are important for wild Callitrichids (marmosets and tamarins). Field studies have assigned the highest priority to distal spatial cues for determining the location of food resources with color cues serving as a secondary cue to assess relative ripeness, once a food source is located. We tested two hypotheses with captive cotton-top tamarins: (a) Tamarins will demonstrate higher rates of initial learning when rewarded for attending to spatial cues versus color cues. (b) Tamarins will show higher rates of correct responses when transferred from color cues to spatial cues than from spatial cues to color cues. The results supported both hypotheses. Tamarins rewarded based on spatial location made significantly more correct choices and fewer errors than tamarins rewarded based on color cues during initial learning. Furthermore, tamarins trained on color cues showed significantly increased correct responses and decreased errors when cues were reversed to reward spatial cues. Subsequent reversal to color cues induced a regression in performance. For tamarins spatial cues appear more salient than color cues in a foraging task. (PsycINFO Database Record (c) 2008 APA, all rights reserved).
Implicit sequence learning and contextual cueing do not compete for central cognitive resources.
Jiménez, Luis; Vázquez, Gustavo A
2011-02-01
Sequence learning and contextual cueing explore different forms of implicit learning, arising from practice with a structured serial task, or with a search task with informative contexts. We assess whether these two learning effects arise simultaneously when both remain implicit. Experiments 1 and 2 confirm that a cueing effect can be observed under a continuous setting and that there is no interference between contextual cueing and sequence learning. Experiments 3a and 3b tested whether an interference arises specifically when the sequence becomes explicit. Results show that the expression of contextual cueing disappeared in those conditions but that context information is still acquired, and it affects performance when the sequence is removed. The results are discussed in relation to the current debates about the automaticity of implicit learning, and about the role of attention in the acquisition and expression of contextual cueing. (c) 2010 APA, all rights reserved.
Visual Cues, Verbal Cues and Child Development
ERIC Educational Resources Information Center
Valentini, Nadia
2004-01-01
In this article, the author discusses two strategies--visual cues (modeling) and verbal cues (short, accurate phrases) which are related to teaching motor skills in maximizing learning in physical education classes. Both visual and verbal cues are strong influences in facilitating and promoting day-to-day learning. Both strategies reinforce…
Out with the old and in with the new: Synaptic mechanisms of extinction in the amygdala
Maren, Stephen
2014-01-01
Considerable research indicates that long-term synaptic plasticity in the amygdala underlies the acquisition of emotional memories, including those learned during Pavlovian fear conditioning. Much less is known about the synaptic mechanisms involved in other forms of associative learning, including extinction, that update fear memories. Extinction learning might reverse conditioning-related changes (e.g., depotentiation) or induce plasticity at inhibitory synapses (e.g., long-term potentiation) to suppress conditioned fear responses. Either mechanism must account for fear recovery phenomena after extinction, as well as savings of extinction after fear recovery. PMID:25312830
Neural Changes Developed during the Extinction of Cocaine Self-Administration Behavior
Higuera-Matas, Alejandro; Miguens, Miguel; del Olmo, Nuria; García-Lecumberri, Carmen; Ambrosio, Emilio
2011-01-01
The high rate of recidivism in cocaine addiction after prolonged periods of abstinence poses a significant problem for the effective treatment of this condition. Moreover, the neurobiological basis of this relapse phenomenon remains poorly understood. In this review, we will discuss the evidence currently available regarding the neurobiological changes during the extinction of cocaine self-administration. Specifically, we will focus on alterations in the dopaminergic, opioidergic, glutamatergic, cholinergic, serotoninergic and CRF systems described in self-administration experiments and extinction studies after chronic cocaine administration. We will also discuss the differences related to contingent versus non-contingent cocaine administration, which highlights the importance of environmental cues on drug effects and extinction. The findings discussed in this review may aid the development of more effective therapeutic approaches to treat cocaine relapse. PMID:26791639
Boddez, Yannick; Haesen, Kim; Baeyens, Frank; Beckers, Tom
2014-01-01
Blocking is the most important phenomenon in the history of associative learning theory: for over 40 years, blocking has inspired a whole generation of learning models. Blocking is part of a family of effects that are typically termed “cue competition” effects. Common amongst all cue competition effects is that a cue-outcome relation is poorly learned or poorly expressed because the cue is trained in the presence of an alternative predictor or cause of the outcome. We provide an overview of the cognitive processes involved in cue competition effects in humans and propose a stage framework that brings these processes together. The framework contends that the behavioral display of cue competition is cognitively construed following three stages that include (1) an encoding stage, (2) a retention stage, and (3) a performance stage. We argue that the stage framework supports a comprehensive understanding of cue competition effects. PMID:25429280
The Infralimbic Cortex Regulates the Consolidation of Extinction after Cocaine Self-Administration
ERIC Educational Resources Information Center
LaLumiere, Ryan T.; Niehoff, Kate E.; Kalivas, Peter W.
2010-01-01
The infralimbic cortex (IL) regulates the consolidation of extinction learning for fear conditioning. Whether the IL influences the consolidation of extinction learning for cocaine self-administration is unknown. To address this issue, male Sprague-Dawley rats underwent 2 wk of cocaine self-administration followed by extinction training. On the…
Slower Reacquisition after Partial Extinction in Human Contingency Learning
ERIC Educational Resources Information Center
Morís, Joaquín; Barberia, Itxaso; Vadillo, Miguel A.; Andrades, Ainhoa; López, Francisco J.
2017-01-01
Extinction is a very relevant learning phenomenon from a theoretical and applied point of view. One of its most relevant features is that relapse phenomena often take place once the extinction training has been completed. Accordingly, as extinction-based therapies constitute the most widespread empirically validated treatment of anxiety disorders,…
Pittig, Andre; van den Berg, Linda; Vervliet, Bram
2016-01-01
Extinction learning is a major mechanism for fear reduction by means of exposure. Current research targets innovative strategies to enhance fear extinction and thereby optimize exposure-based treatments for anxiety disorders. This selective review updates novel behavioral strategies that may provide cutting-edge clinical implications. Recent studies provide further support for two types of enhancement strategies. Procedural enhancement strategies implemented during extinction training translate to how exposure exercises may be conducted to optimize fear extinction. These strategies mostly focus on a maximized violation of dysfunctional threat expectancies and on reducing context and stimulus specificity of extinction learning. Flanking enhancement strategies target periods before and after extinction training and inform optimal preparation and post-processing of exposure exercises. These flanking strategies focus on the enhancement of learning in general, memory (re-)consolidation, and memory retrieval. Behavioral strategies to enhance fear extinction may provide powerful clinical applications to further maximize the efficacy of exposure-based interventions. However, future replications, mechanistic examinations, and translational studies are warranted to verify long-term effects and naturalistic utility. Future directions also comprise the interplay of optimized fear extinction with (avoidance) behavior and motivational antecedents of exposure.
Slower reacquisition after partial extinction in human contingency learning.
Morís, Joaquín; Barberia, Itxaso; Vadillo, Miguel A; Andrades, Ainhoa; López, Francisco J
2017-01-01
Extinction is a very relevant learning phenomenon from a theoretical and applied point of view. One of its most relevant features is that relapse phenomena often take place once the extinction training has been completed. Accordingly, as extinction-based therapies constitute the most widespread empirically validated treatment of anxiety disorders, one of their most important limitations is this potential relapse. We provide the first demonstration of relapse reduction in human contingency learning using mild aversive stimuli. This effect was found after partial extinction (i.e., reinforced trials were occasionally experienced during extinction, Experiment 1) and progressive extinction treatments (Experiment 3), and it was not only because of differences in uncertainty levels between the partial and a standard extinction group (Experiment 2). The theoretical explanation of these results, the potential uses of this strategy in applied situations, and its current limitations are discussed. (PsycINFO Database Record (c) 2017 APA, all rights reserved).
Individual differences in learning predict the return of fear.
Gershman, Samuel J; Hartley, Catherine A
2015-09-01
Using a laboratory analogue of learned fear (Pavlovian fear conditioning), we show that there is substantial heterogeneity across individuals in spontaneous recovery of fear following extinction training. We propose that this heterogeneity might stem from qualitative individual differences in the nature of extinction learning. Whereas some individuals tend to form a new memory during extinction, leaving their fear memory intact, others update the original threat association with new safety information, effectively unlearning the fear memory. We formalize this account in a computational model of fear learning and show that individuals who, according to the model, are more likely to form new extinction memories tend to show greater spontaneous recovery compared to individuals who appear to only update a single memory. This qualitative variation in fear and extinction learning may have important implications for understanding vulnerability and resilience to fear-related psychiatric disorders.
Beyond naïve cue combination: salience and social cues in early word learning.
Yurovsky, Daniel; Frank, Michael C
2017-03-01
Children learn their earliest words through social interaction, but it is unknown how much they rely on social information. Some theories argue that word learning is fundamentally social from its outset, with even the youngest infants understanding intentions and using them to infer a social partner's target of reference. In contrast, other theories argue that early word learning is largely a perceptual process in which young children map words onto salient objects. One way of unifying these accounts is to model word learning as weighted cue combination, in which children attend to many potential cues to reference, but only gradually learn the correct weight to assign each cue. We tested four predictions of this kind of naïve cue combination account, using an eye-tracking paradigm that combines social word teaching and two-alternative forced-choice testing. None of the predictions were supported. We thus propose an alternative unifying account: children are sensitive to social information early, but their ability to gather and deploy this information is constrained by domain-general cognitive processes. Developmental changes in children's use of social cues emerge not from learning the predictive power of social cues, but from the gradual development of attention, memory, and speed of information processing. © 2015 John Wiley & Sons Ltd.
Beyond Naïve Cue Combination: Salience and Social Cues in Early Word Learning
Yurovsky, Daniel
2015-01-01
Children learn their earliest words through social interaction, but it is unknown how much they rely on social information. Some theories argue that word learning is fundamentally social from its outset, with even the youngest infants understanding intentions and using them to infer a social partner’s target of reference. In contrast, other theories argue that early word learning is largely a perceptual process in which young children map words onto salient objects. One way of unifying these accounts is to model word learning as weighted cue-combination, in which children attend to many potential cues to reference, but only gradually learn the correct weight to assign each cue. We tested four predictions of this kind of naïve cue-combination account, using an eye-tracking paradigm that combines social word-teaching and two-alternative forced-choice testing. None of the predictions were supported. We thus propose an alternative unifying account: children are sensitive to social information early, but their ability to gather and deploy this information is constrained by domain-general cognitive processes. Developmental changes in children’s use of social cues emerge not from learning the predictive power of social cues, but from the gradual development of attention, memory, and speed of information processing. PMID:26575408
Deepened extinction following compound stimulus presentation: Noradrenergic modulation
Janak, Patricia H.; Corbit, Laura H.
2011-01-01
Behavioral extinction is an active form of new learning involving the prediction of nonreward where reward has previously been present. The expression of extinction learning can be disrupted by the presentation of reward itself or reward-predictive stimuli (reinstatement) as well as the passage of time (spontaneous recovery) or contextual changes (renewal). The following experiments replicated the demonstration that presenting multiple previously rewarded stimuli in compound during extinction enhances extinction learning. To explore the pharmacological basis for this we next examined the effects of pharmacological treatments that either facilitated or blocked noradrenergic activity to test the hypothesis that increased noradrenergic activity at the time of extinction training would improve, whereas blockade of noradrenergic activity would impair the extinction of appetitive stimulus–reward memories. Different groups of rats were trained in a discriminative stimulus paradigm to lever-press for food reward. Once stable responding was achieved, responding was extinguished for 2 d. Prior to a third extinction session, rats received systemic administration of either saline, yohimbine (α2 antagonist), atomoxetine (norepinephrine reuptake inhibitor), or propranolol (β-receptor antagonist). Spontaneous recovery of responding to the stimuli was tested 4 wk later. Our results indicate that increasing noradrenergic activity during extinction augments extinction learning resulting in less recovery of responding at test. These results have important implications for models of relapse to drug seeking and the development of extinction-based therapies. PMID:21224211
McGuire, Joseph F.; Orr, Scott P.; Essoe, Joey K.-Y.; McCracken, James T.; Storch, Eric A.; Piacentini, John
2018-01-01
Introduction Threat conditioning and extinction play an important role in anxiety disorders, obsessive compulsive disorder (OCD), and posttraumatic stress disorder (PTSD). Although these conditions commonly affect children, threat conditioning and extinction have been primarily studied in adults. However, differences in phenomenology and neural architecture prohibit the generalization of adult findings to youth. Areas covered A comprehensive literature search using PubMed and PsycInfo was conducted to identify studies that have used differential conditioning tasks to examine threat acquisition and extinction in youth. The information obtained from this review helps to clarify the influence of these processes on the etiology and treatment of youth with OCD, PTSD and other anxiety disorders. Thirty studies of threat conditioning and extinction were identified. Expert Commentary Youth with anxiety disorders, OCD, and PTSD have largely comparable threat acquisition relative to unaffected controls, with some distinctions noted for youth with PTSD or youth who have suffered maltreatment. However, impaired extinction was consistently observed across youth with these disorders and appears to be consistent with deficiencies in inhibitory learning. Incorporating strategies to improve inhibitory learning may improve extinction learning within extinction-based treatments like cognitive behavioral therapy (CBT). Strategies to improve inhibitory learning in CBT are discussed. PMID:27275519
McGuire, Joseph F; Orr, Scott P; Essoe, Joey K-Y; McCracken, James T; Storch, Eric A; Piacentini, John
2016-10-01
Threat conditioning and extinction play an important role in anxiety disorders, obsessive compulsive disorder (OCD), and post-traumatic stress disorder (PTSD). Although these conditions commonly affect children, threat conditioning and extinction have been primarily studied in adults. However, differences in phenomenology and neural architecture prohibit the generalization of adult findings to youth. A comprehensive literature search using PubMed and PsycInfo was conducted to identify studies that have used differential conditioning tasks to examine threat acquisition and extinction in youth. The information obtained from this review helps to clarify the influence of these processes on the etiology and treatment of youth with OCD, PTSD and other anxiety disorders. Thirty studies of threat conditioning and extinction were identified Expert commentary: Youth with anxiety disorders, OCD, and PTSD have largely comparable threat acquisition relative to unaffected controls, with some distinctions noted for youth with PTSD or youth who have suffered maltreatment. However, impaired extinction was consistently observed across youth with these disorders and appears to be consistent with deficiencies in inhibitory learning. Incorporating strategies to improve inhibitory learning may improve extinction learning within extinction-based treatments like cognitive behavioral therapy (CBT). Strategies to improve inhibitory learning in CBT are discussed.
Knox, Dayan; Stanfield, Briana R; Staib, Jennifer M; David, Nina P; DePietro, Thomas; Chamness, Marisa; Schneider, Elizabeth K; Keller, Samantha M; Lawless, Caroline
2018-04-02
Neural circuits via which stress leads to disruptions in fear extinction is often explored in animal stress models. Using the single prolonged stress (SPS) model of post traumatic stress disorder and the immediate early gene (IEG) c-Fos as a measure of neural activity, we previously identified patterns of neural activity through which SPS disrupts extinction retention. However, none of these stress effects were specific to fear or extinction learning and memory. C-Jun is another IEG that is sometimes regulated in a different manner to c-Fos and could be used to identify emotional learning/memory specific patterns of neural activity that are sensitive to SPS. Animals were either fear conditioned (CS-fear) or presented with CSs only (CS-only) then subjected to extinction training and testing. C-Jun was then assayed within neural substrates critical for extinction memory. Inhibited c-Jun levels in the hippocampus (Hipp) and enhanced functional connectivity between the ventromedial prefrontal cortex (vmPFC) and basolateral amygdala (BLA) during extinction training was disrupted by SPS in the CS-fear group only. As a result, these effects were specific to emotional learning/memory. SPS also disrupted inhibited Hipp c-Jun levels, enhanced BLA c-Jun levels, and altered functional connectivity among the vmPFC, BLA, and Hipp during extinction testing in SPS rats in the CS-fear and CS-only groups. As a result, these effects were not specific to emotional learning/memory. Our findings suggest that SPS disrupts neural activity specific to extinction memory, but may also disrupt the retention of fear extinction by mechanisms that do not involve emotional learning/memory. Copyright © 2017 Elsevier B.V. All rights reserved.
Rabinak, Christine A.; Angstadt, Mike; Lyons, Maryssa; Mori, Shoko; Milad, Mohammed R.; Liberzon, Israel; Phan, K. Luan
2013-01-01
Pre-extinction administration of ∆9-tetrahydrocannibinol (THC) facilitates recall of extinction in healthy humans, and evidence from animal studies suggest that this likely involves via enhancement of the cannabinoid system within the ventromedial prefrontal cortex (vmPFC) and hippocampus (HIPP), brain structures critical to fear extinction. However, the effect of cannabinoids on the underlying neural circuitry of extinction memory recall in humans has not been demonstrated. We conducted a functional magnetic resonance imaging (fMRI) study using a randomized, double-blind, placebo-controlled, between-subjects design (N=14/group) coupled with a standard Pavlovian fear extinction paradigm and an acute pharmacological challenge with oral dronabinol (synthetic THC) in healthy adult volunteers. We examined the effects of THC on vmPFC and HIPP activation when tested for recall of extinction learning 24 hours after extinction learning. Compared to subjects who received placebo, participants who received THC showed increased vmPFC and HIPP activation to a previously extinguished conditioned stimulus (CS+E) during extinction memory recall. This study provides the first evidence that pre-extinction administration of THC modulates prefrontal-limbic circuits during fear extinction in humans and prompts future investigation to test if cannabinoid agonists can rescue or correct the impaired behavioral and neural function during extinction recall in patients with PTSD. Ultimately, the cannabinoid system may serve as a promising target for innovative intervention strategies (e.g. pharmacological enhancement of exposure-based therapy) in PTSD and other fear learning-related disorders. PMID:24055595
Capuchin monkeys' use of human and conspecific cues to solve a hidden object-choice task.
Essler, Jennifer L; Schwartz, Lindsay P; Rossettie, Mattea S; Judge, Peter G
2017-09-01
Learning by watching others can provide valuable information with adaptive consequences, such as identifying the presence of a predator or locating a food source. The extent to which nonhuman animals can gain information by reading the cues of others is often tested by evaluating responses to human gestures, such as a point, and less often evaluated by examining responses to conspecific cues. We tested whether ten brown capuchin monkeys (Cebus [Sapajus] apella) were able to use cues from monkeys and a pointing cue from a human to obtain hidden rewards. A monkey could gain access to a reward hidden in one of two locations by reading a cue from a conspecific (e.g., reaching) or a human pointing. We then tested whether they could transfer this skill from monkeys to humans, from humans to monkeys, and from one conspecific to another conspecific. One group of monkeys was trained and tested using a conspecific as the cue-giver and was then tested with a human cue-giver. The second group of monkeys was trained and tested with a human cue-giver and was then tested with a monkey cue-giver. Monkeys that were successful with a conspecific cue-giver were also tested with a novel conspecific cue-giver. Monkeys learned to use a human point and conspecific cues to obtain rewards. Monkeys that had learned to use the cues of a conspecific to obtain rewards performed significantly better than expected by chance when they were transferred to the cues of a novel conspecific. Monkeys that learned to use a human point to obtain rewards performed significantly better than expected by chance when tested while observing conspecific cues. Some evidence suggested that transferring between conspecific cue-givers occurred with more facility than transferring across species. Results may be explained by simple rules of association learning and stimulus generalization; however, spontaneous flexible use of gestures across conspecifics and between different species may indicate capuchins can generalize learned social cues within and partially across species.
ERIC Educational Resources Information Center
Baker, Kathryn D.; Richardson, Rick
2015-01-01
Fear inhibition is markedly impaired in adolescent rodents and humans. The present experiments investigated whether this impairment is critically determined by the animal's age at the time of fear learning or their age at fear extinction. Male rats (n = 170) were tested for extinction retention after conditioning and extinction at different ages.…
ERIC Educational Resources Information Center
Davis, Adeola R.; Shields, Angela D.; Brigman, Jonathan L.; Norcross, Maxine; McElligott, Zoe A.; Holmes, Andrew; Winder, Danny G.
2008-01-01
Extinction, a form of learning that has the ability to reshape learned behavior based on new experiences, has been heavily studied utilizing fear learning paradigms. Mechanisms underlying extinction of positive-valence associations, such as drug self-administration and place preference, are poorly understood yet may have important relevance to…
ERIC Educational Resources Information Center
Bredy, Timothy W.; Wu, Hao; Crego, Cortney; Zellhoefer, Jessica; Sun, Yi E.; Barad, Mark
2007-01-01
Extinction of conditioned fear is an important model both of inhibitory learning and of behavior therapy for human anxiety disorders. Like other forms of learning, extinction learning is long-lasting and depends on regulated gene expression. Epigenetic mechanisms make an important contribution to persistent changes in gene expression; therefore,…
Involvement of CRFR1 in the Basolateral Amygdala in the Immediate Fear Extinction Deficit
Sevelinges, Yannick; Zanoletti, Olivia
2016-01-01
Abstract Several animal and clinical studies have highlighted the ineffectiveness of fear extinction sessions delivered shortly after trauma exposure. This phenomenon, termed the immediate extinction deficit, refers to situations in which extinction programs applied shortly after fear conditioning may result in the reduction of fear behaviors (in rodents, frequently measured as freezing responses to the conditioned cue) during extinction training, but failure to consolidate this reduction in the long term. The molecular mechanisms driving this immediate extinction resistance remain unclear. Here we present evidence for the involvement of the corticotropin releasing factor (CRF) system in the basolateral amygdala (BLA) in male Wistar rats. Intra-BLA microinfusion of the CRFR1 antagonist NBI30775 enhances extinction recall, whereas administration of the CRF agonist CRF6–33 before delayed extinction disrupts recall of extinction. We link the immediate fear extinction deficit with dephosphorylation of GluA1 glutamate receptors at Ser845 and enhanced activity of the protein phosphatase calcineurin in the BLA. Their reversal after treatment with the CRFR1 antagonist indicates their dependence on CRFR1 actions. These findings can have important implications for the improvement of therapeutic approaches to trauma, as well as furthering our understanding of the neurobiological mechanisms underlying fear-related disorders. PMID:27844053
Involvement of CRFR1 in the Basolateral Amygdala in the Immediate Fear Extinction Deficit.
Hollis, Fiona; Sevelinges, Yannick; Grosse, Jocelyn; Zanoletti, Olivia; Sandi, Carmen
2016-01-01
Several animal and clinical studies have highlighted the ineffectiveness of fear extinction sessions delivered shortly after trauma exposure. This phenomenon, termed the immediate extinction deficit, refers to situations in which extinction programs applied shortly after fear conditioning may result in the reduction of fear behaviors (in rodents, frequently measured as freezing responses to the conditioned cue) during extinction training, but failure to consolidate this reduction in the long term. The molecular mechanisms driving this immediate extinction resistance remain unclear. Here we present evidence for the involvement of the corticotropin releasing factor (CRF) system in the basolateral amygdala (BLA) in male Wistar rats. Intra-BLA microinfusion of the CRFR 1 antagonist NBI30775 enhances extinction recall, whereas administration of the CRF agonist CRF 6-33 before delayed extinction disrupts recall of extinction. We link the immediate fear extinction deficit with dephosphorylation of GluA1 glutamate receptors at Ser 845 and enhanced activity of the protein phosphatase calcineurin in the BLA. Their reversal after treatment with the CRFR 1 antagonist indicates their dependence on CRFR 1 actions. These findings can have important implications for the improvement of therapeutic approaches to trauma, as well as furthering our understanding of the neurobiological mechanisms underlying fear-related disorders.
Ecological and evolutionary traps
Schlaepfer, Martin A.; Runge, M.C.; Sherman, P.W.
2002-01-01
Organisms often rely on environmental cues to make behavioral and life-history decisions. However, in environments that have been altered suddenly by humans, formerly reliable cues might no longer be associated with adaptive outcomes. In such cases, organisms can become 'trapped' by their evolutionary responses to the cues and experience reduced survival or reproduction. Ecological traps occur when organisms make poor habitat choices based on cues that correlated formerly with habitat quality. Ecological traps are part of a broader phenomenon, evolutionary traps, involving a dissociation between cues that organisms use to make any behavioral or life-history decision and outcomes normally associated with that decision. A trap can lead to extinction if a population falls below a critical size threshold before adaptation to the novel environment occurs. Conservation and management protocols must be designed in light of, rather than in spite of, the behavioral mechanisms and evolutionary history of populations and species to avoid 'trapping' them.
Learning Grammatical Categories from Distributional Cues: Flexible Frames for Language Acquisition
ERIC Educational Resources Information Center
St. Clair, Michelle C.; Monaghan, Padraic; Christiansen, Morten H.
2010-01-01
Numerous distributional cues in the child's environment may potentially assist in language learning, but what cues are useful to the child and when are these cues utilised? We propose that the most useful source of distributional cue is a flexible frame surrounding the word, where the language learner integrates information from the preceding and…
Craving by imagery cue reactivity in opiate dependence following detoxification
Behera, Debakanta; Goswami, Utpal; Khastgir, Udayan; Kumar, Satindra
2003-01-01
Background: Frequent relapses in opioid addiction may be a result of abstinentemergent craving. Exposure to various stimuli associated with drug use (drug cues) may trigger craving as a conditioned response to ′drug cues′. Aims: The present study explored the effects of imagery cue exposure on psychophysiological mechanisms of craving, viz. autonomic arousal, in detoxified opiate addicts. Methodology: Opiate dependent subjects (N=38) following detoxification underwent imagery cue reactivity trials.The subjects were asked to describe verbally and then imagine their craving experiences. Results: Craving was measured subjectively by using Visual Analogue Scale and autonomic parameters of galvanic skin resistance (GSR), pulse rate (PR), and skin temperature (ST) was taken during cue imagery. Spearman′s r and Wilcoxon signed ranks test were employed in analysis. Multivariate repeated measurement analysis (wilk′s Lambda) was employed wherever appropriate. Subjective measures of craving, GSR and PR increased significantly whereas ST decreased significantly during drug related cue imagery as compared to neutral cues. Conclusions: The results support that cue imagery is a powerful tool in eliciting craving. Hence, it can be used as a screening manoeuvre for detecting individuals with high cue reactivity, as well as for extinction of craving. PMID:21206851
Cellular and oscillatory substrates of fear extinction learning.
Davis, Patrick; Zaki, Yosif; Maguire, Jamie; Reijmers, Leon G
2017-11-01
The mammalian brain contains dedicated circuits for both the learned expression and suppression of fear. These circuits require precise coordination to facilitate the appropriate expression of fear behavior, but the mechanisms underlying this coordination remain unclear. Using a combination of chemogenetics, activity-based neuronal-ensemble labeling and in vivo electrophysiology, we found that fear extinction learning confers on parvalbumin-expressing (PV) interneurons in the basolateral amygdala (BLA) a dedicated role in the selective suppression of a previously encoded fear memory and BLA fear-encoding neurons. In addition, following extinction learning, PV interneurons enable a competing interaction between a 6-12 Hz oscillation and a fear-associated 3-6 Hz oscillation within the BLA. Loss of this competition increases a 3-6 Hz oscillatory signature, with BLA→medial prefrontal cortex directionality signaling the recurrence of fear expression. The discovery of cellular and oscillatory substrates of fear extinction learning that critically depend on BLA PV interneurons could inform therapies aimed at preventing the pathological recurrence of fear following extinction learning.
Cellular and Oscillatory Substrates of Fear Extinction Learning
Davis, Patrick; Zaki, Yosif; Maguire, Jamie; Reijmers, Leon G.
2018-01-01
The mammalian brain contains dedicated circuits for both the learned expression and suppression of fear. These circuits require precise coordination to facilitate the appropriate expression of fear behavior, but the mechanisms underlying this coordination remain unclear. Using a novel combination of chemogenetics, activity-based neuronal-ensemble labeling, and in vivo electrophysiology, we found that fear extinction learning confers parvalbumin-expressing (PV) interneurons in the basolateral amygdala (BLA) with a dedicated role in the selective suppression of a previously encoded fear memory and BLA fear-encoding neurons. In addition, following extinction learning, PV interneurons enable a competing interaction between a 6–12 Hz oscillation and a fear-associated 3–6 Hz oscillation within the BLA. Loss of this competition increases a 3–6 Hz oscillatory signature, with BLA→mPFC directionality signaling the recurrence of fear expression. The discovery of cellular and oscillatory substrates of fear extinction learning that critically depend on BLA PV-interneurons could inform therapies aimed at preventing the pathological recurrence of fear following extinction learning. PMID:28967909
Giustino, Thomas F; Seemann, Jocelyn R; Acca, Gillian M; Goode, Travis D; Fitzgerald, Paul J; Maren, Stephen
2017-12-01
Early psychological interventions, such as exposure therapy, rely on extinction learning to reduce the development of stress- and trauma-related disorders. However, recent research suggests that extinction often fails to reduce fear when administered soon after trauma. This immediate extinction deficit (IED) may be due to stress-induced dysregulation of neural circuits involved in extinction learning. We have shown that systemic β-adrenoceptor blockade with propranolol rescues the IED, but impairs delayed extinction. Here we sought to determine the neural locus of these effects. Rats underwent auditory fear conditioning and then received either immediate (30 min) or delayed (24 h) extinction training. We used bilateral intracranial infusions of propranolol into either the infralimbic division of the medial prefrontal cortex (mPFC) or the basolateral amygdala (BLA) to examine the effects of β-adrenoceptor blockade on immediate and delayed extinction learning. Interestingly, intra-BLA, but not intra-mPFC, propranolol rescued the IED; animals receiving intra-BLA propranolol prior to immediate extinction showed less spontaneous recovery of fear during extinction retrieval. Importantly, this was not due to impaired consolidation of the conditioning memory. In contrast, neither intra-BLA nor intra-mPFC propranolol affected delayed extinction learning. Overall, these data contribute to a growing literature suggesting dissociable roles for key nodes in the fear extinction circuit depending on the timing of extinction relative to conditioning. These data also suggest that heightened noradrenergic activity in the BLA underlies stress-induced extinction deficits. Propranolol may be a useful adjunct to behavioral therapeutic interventions in recently traumatized individuals who are at risk for developing trauma-related disorders.
Implicit Sequence Learning and Contextual Cueing Do Not Compete for Central Cognitive Resources
ERIC Educational Resources Information Center
Jimenez, Luis; Vazquez, Gustavo A.
2011-01-01
Sequence learning and contextual cueing explore different forms of implicit learning, arising from practice with a structured serial task, or with a search task with informative contexts. We assess whether these two learning effects arise simultaneously when both remain implicit. Experiments 1 and 2 confirm that a cueing effect can be observed…
Cross-Sensory Transfer of Reference Frames in Spatial Memory
ERIC Educational Resources Information Center
Kelly, Jonathan W.; Avraamides, Marios N.
2011-01-01
Two experiments investigated whether visual cues influence spatial reference frame selection for locations learned through touch. Participants experienced visual cues emphasizing specific environmental axes and later learned objects through touch. Visual cues were manipulated and haptic learning conditions were held constant. Imagined perspective…
Bergstra, Myrthe; DE Mulder, Hannah N M; Coopmans, Peter
2018-04-06
This study investigated how speaker certainty (a rational cue) and speaker benevolence (an emotional cue) influence children's willingness to learn words in a selective learning paradigm. In two experiments four- to six-year-olds learnt novel labels from two speakers and, after a week, their memory for these labels was reassessed. Results demonstrated that children retained the label-object pairings for at least a week. Furthermore, children preferred to learn from certain over uncertain speakers, but they had no significant preference for nice over nasty speakers. When the cues were combined, children followed certain speakers, even if they were nasty. However, children did prefer to learn from nice and certain speakers over nasty and certain speakers. These results suggest that rational cues regarding a speaker's linguistic competence trump emotional cues regarding a speaker's affective status in word learning. However, emotional cues were found to have a subtle influence on this process.
The dorsolateral striatum selectively mediates extinction of habit memory.
Goodman, Jarid; Ressler, Reed L; Packard, Mark G
2016-12-01
Previous research has indicated a role for the dorsolateral striatum (DLS) in acquisition and retrieval of habit memory. However, the neurobiological mechanisms guiding extinction of habit memory have not been extensively investigated. The present study examined whether the dorsolateral striatum (DLS) is involved in extinction of habit memory in a food-rewarded response learning version of the plus-maze in adult male Long-Evans rats (experiment 1). In addition, to determine whether the role of this brain region in extinction is selective to habit memory, we also examined whether the DLS is required for extinction of hippocampus-dependent spatial memory in a place learning version of the plus-maze (experiment 2). Following acquisition in either task, rats received two days of extinction training, in which the food reward was removed from the maze. The number of perseverative trials (a trial in which the rat made the same previously reinforced body-turn) and latency to reach the previously correct food well were used as measures of extinction. Animals were given immediate post-training intra-DLS administration of the sodium channel blocker bupivacaine or vehicle to determine the effect of DLS inactivation on consolidation of extinction memory in each task. In the response learning task, post-training DLS inactivation impaired consolidation of extinction memory. Injections of bupivacaine delayed 2 h post-training did not affect extinction, indicating a time-dependent effect of neural inactivation on consolidation of extinction memory in this task. In contrast, post-training DLS inactivation did not impair, but instead slightly enhanced, extinction memory in the place learning task. The present findings indicate a critical role for the DLS in extinction of habit memory in the response learning task, and may be relevant to understanding the neural mechanisms through which maladaptive habits in human psychopathologies (e.g. drug addiction) may be suppressed. Copyright © 2016 Elsevier Inc. All rights reserved.
Sleep supports cued fear extinction memory consolidation independent of circadian phase.
Melo, Irene; Ehrlich, Ingrid
2016-07-01
Sleep promotes memory, particularly for declarative learning. However, its role in non-declarative, emotional memories is less well understood. Some studies suggest that sleep may influence fear-related memories, and thus may be an important factor determining the outcome of treatments for emotional disorders such as post-traumatic stress disorder. Here, we investigated the effect of sleep deprivation and time of day on fear extinction memory consolidation. Mice were subjected to a cued Pavlovian fear and extinction paradigm at the beginning of their resting or active phase. Immediate post-extinction learning sleep deprivation for 5h compromised extinction memory when tested 24h after learning. Context-dependent extinction memory recall was completely prevented by sleep-manipulation during the resting phase, while impairment was milder during the active phase and extinction memory retained its context-specificity. Importantly, control experiments excluded confounding factors such as differences in baseline locomotion, fear generalization and stress hormone levels. Together, our findings indicate that post-learning sleep supports cued fear extinction memory consolidation in both circadian phases. The lack of correlation between memory efficacy and sleep time suggests that extinction memory may be influenced by specific sleep events in the early consolidation period. Copyright © 2016 Elsevier Inc. All rights reserved.
ERIC Educational Resources Information Center
Sangha, Susan; Ilenseer, Jasmin; Sosulina, Ludmila; Lesting, Jorg; Pape, Hans-Christian
2012-01-01
Extinction reduces fear to stimuli that were once associated with an aversive event by no longer coupling the stimulus with the aversive event. Extinction learning is supported by a network comprising the amygdala, hippocampus, and prefrontal cortex. Previous studies implicate a critical role of GABA in extinction learning, specifically the GAD65…
Interactions between statistical and semantic information in infant language development
Lany, Jill; Saffran, Jenny R.
2013-01-01
Infants can use statistical regularities to form rudimentary word categories (e.g. noun, verb), and to learn the meanings common to words from those categories. Using an artificial language methodology, we probed the mechanisms by which two types of statistical cues (distributional and phonological regularities) affect word learning. Because linking distributional cues vs. phonological information to semantics make different computational demands on learners, we also tested whether their use is related to language proficiency. We found that 22-month-old infants with smaller vocabularies generalized using phonological cues; however, infants with larger vocabularies showed the opposite pattern of results, generalizing based on distributional cues. These findings suggest that both phonological and distributional cues marking word categories promote early word learning. Moreover, while correlations between these cues are important to forming word categories, we found infants’ weighting of these cues in subsequent word-learning tasks changes over the course of early language development. PMID:21884336
Instant transformation of learned repulsion into motivational "wanting".
Robinson, Mike J F; Berridge, Kent C
2013-02-18
Learned cues for pleasant reward often elicit desire, which, in addicts, may become compulsive. According to the dominant view in addiction neuroscience and reinforcement modeling, such desires are the simple products of learning, coming from a past association with reward outcome. We demonstrate that cravings are more than merely the products of accumulated pleasure memories-even a repulsive learned cue for unpleasantness can become suddenly desired via the activation of mesocorticolimbic circuitry. Rats learned repulsion toward a Pavlovian cue (a briefly-inserted metal lever) that always predicted an unpleasant Dead Sea saltiness sensation. Yet, upon first reencounter in a novel sodium-depletion state to promote mesocorticolimbic reactivity (reflected by elevated Fos activation in ventral tegmentum, nucleus accumbens, ventral pallidum, and the orbitofrontal prefrontal cortex), the learned cue was instantly transformed into an attractive and powerful motivational magnet. Rats jumped and gnawed on the suddenly attractive Pavlovian lever cue, despite never having tasted intense saltiness as anything other than disgusting. Instant desire transformation of a learned cue contradicts views that Pavlovian desires are essentially based on previously learned values (e.g., prediction error or temporal difference models). Instead desire is recomputed at reencounter by integrating Pavlovian information with the current brain/physiological state. This powerful brain transformation reverses strong learned revulsion into avid attraction. When applied to addiction, related mesocorticolimbic transformations (e.g., drugs or neural sensitization) of cues for already-pleasant drug experiences could create even more intense cravings. This cue/state transformation helps define what it means to say that addiction hijacks brain limbic circuits of natural reward. Copyright © 2013 Elsevier Ltd. All rights reserved.
Post-Learning Sleep Transiently Boosts Context Specific Operant Extinction Memory.
Borquez, Margarita; Contreras, María P; Vivaldi, Ennio; Born, Jan; Inostroza, Marion
2017-01-01
Operant extinction is learning to supress a previously rewarded behavior. It is known to be strongly associated with the specific context in which it was acquired, which limits the therapeutic use of operant extinction in behavioral treatments, e.g., of addiction. We examined whether sleep influences contextual memory of operant extinction over time, using two different recall tests (Recent and Remote). Rats were trained in an operant conditioning task (lever press) in context A, then underwent extinction training in context B, followed by a 3-h retention period that contained either spontaneous morning sleep, morning sleep deprivation, or spontaneous evening wakefulness. A recall test was performed either immediately after the 3-h experimental retention period (Recent recall) or after 48 h (Remote), in the extinction context B and in a novel context C. The two main findings were: (i) at the Recent recall test, sleep in comparison with sleep deprivation and spontaneous wakefulness enhanced extinction memory but, only in the extinction context B; (ii) at the Remote recall, extinction performance after sleep was enhanced in both contexts B and C to an extent comparable to levels at Recent recall in context B. Interestingly, extinction performance at Remote recall was also improved in the sleep deprivation groups in both contexts, with no difference to performance in the sleep group. Our results suggest that 3 h of post-learning sleep transiently facilitate the context specificity of operant extinction at a Recent recall. However, the improvement and contextual generalization of operant extinction memory observed in the long-term, i.e., after 48 h, does not require immediate post-learning sleep.
ERIC Educational Resources Information Center
Jorge A. Pinto,; Vogel, Edgar H.; Núñez, Daniel E.
2017-01-01
The learned predictiveness effect or LPE is the finding that when people learn that certain cues are reliable predictors of an outcome in an initial stage of training (phase 1), they exhibit a learning bias in favor of these cues in a subsequent training involving new outcomes (phase 2) despite all cues being equally reliable in phase 2. In…
Blocking Spatial Navigation Across Environments That Have a Different Shape
2015-01-01
According to the geometric module hypothesis, organisms encode a global representation of the space in which they navigate, and this representation is not prone to interference from other cues. A number of studies, however, have shown that both human and non-human animals can navigate on the basis of local geometric cues provided by the shape of an environment. According to the model of spatial learning proposed by Miller and Shettleworth (2007, 2008), geometric cues compete for associative strength in the same manner as non-geometric cues do. The experiments reported here were designed to test if humans learn about local geometric cues in a manner consistent with the Miller-Shettleworth model. Experiment 1 replicated previous findings that humans transfer navigational behavior, based on local geometric cues, from a rectangle-shaped environment to a kite-shaped environment, and vice versa. In Experiments 2 and 3, it was observed that learning about non-geometric cues blocked, and were blocked by, learning about local geometric cues. The reciprocal blocking observed is consistent with associative theories of spatial learning; however, it is difficult to explain the observed effects with theories of global-shape encoding in their current form. PMID:26569017
Smith, Tim J.; Senju, Atsushi
2017-01-01
While numerous studies have demonstrated that infants and adults preferentially orient to social stimuli, it remains unclear as to what drives such preferential orienting. It has been suggested that the learned association between social cues and subsequent reward delivery might shape such social orienting. Using a novel, spontaneous indication of reinforcement learning (with the use of a gaze contingent reward-learning task), we investigated whether children and adults' orienting towards social and non-social visual cues can be elicited by the association between participants' visual attention and a rewarding outcome. Critically, we assessed whether the engaging nature of the social cues influences the process of reinforcement learning. Both children and adults learned to orient more often to the visual cues associated with reward delivery, demonstrating that cue–reward association reinforced visual orienting. More importantly, when the reward-predictive cue was social and engaging, both children and adults learned the cue–reward association faster and more efficiently than when the reward-predictive cue was social but non-engaging. These new findings indicate that social engaging cues have a positive incentive value. This could possibly be because they usually coincide with positive outcomes in real life, which could partly drive the development of social orienting. PMID:28250186
Wright, Victoria L; Georgiou, Polymnia; Bailey, Alexis; Heal, David J; Bailey, Christopher P; Wonnacott, Susan
2018-04-17
Recurrent relapse is a major problem in treating opiate addiction. Pavlovian conditioning plays a role in recurrent relapse whereby exposure to cues learned during drug intake can precipitate relapse to drug taking. α7 nicotinic acetylcholine receptors (nAChRs) have been implicated in attentional aspects of cognition and mechanisms of learning and memory. In this study we have investigated the role of α7 nAChRs in morphine-conditioned place preference (morphine-CPP). CPP provides a model of associative learning that is pertinent to associative aspects of drug dependence. The α7 nAChR antagonist methyllycaconitine (MLA; 4 mg/kg s.c.) had no effect on the acquisition, maintenance, reconsolidation or extinction of morphine-CPP but selectively attenuated morphine-primed reinstatement of CPP, in both mice and rats. Reinstatement of morphine-CPP in mice was accompanied by a selective increase in [ 3 H]-AMPA binding (but not in [ 3 H]-MK801 binding) in the ventral hippocampus that was prevented by prior treatment with MLA. Administration of MLA (6.7 μg) directly into the ventral hippocampus of rats prior to a systemic priming dose of morphine abolished reinstatement of morphine-CPP, whereas MLA delivered into the dorsal hippocampus or prefrontal cortex was without effect. These results suggest that α7 nAChRs in the ventral hippocampus play a specific role in the retrieval of associative drug memories following a period of extinction, making them potential targets for the prevention of relapse. © 2018 The Authors.Addiction Biology published by John Wiley & Sons Ltd on behalf of Society for the Study of Addiction.
Is an epigenetic switch the key to persistent extinction?
Stafford, James M.; Lattal, K. Matthew
2011-01-01
Many studies of learning have demonstrated that conditioned behavior can be eliminated when previously established relations between stimuli are severed. This extinction process has been extremely important for the development of learning theories and, more recently, for delineating the neurobiological mechanisms that underlie memory. A key finding from behavioral studies of extinction is that extinction eliminates behavior without eliminating the original memory; extinguished behavior often returns with time or with a return to the context in which the original learning occurred. This persistence of the original memory after extinction creates a challenge for clinical applications that use extinction as part of a treatment intervention. Consequently, a goal of recent neurobiological research on extinction is to identify potential pharmacological targets that may result in persistent extinction. Drugs that promote epigenetic changes are particularly promising because they can result in a long-term molecular signal that, combined with the appropriate behavioral treatment, can cause persistent changes in behavior induced by extinction. We will review evidence demonstrating extinction enhancements by drugs that target epigenetic mechanisms and will describe some of the challenges that epigenetic approaches face in promoting persistent suppression of memories. PMID:21536141
Abernethy, Bruce; Schorer, Jörg; Jackson, Robin C; Hagemann, Norbert
2012-06-01
The comparative efficacy of different perceptual training approaches for the improvement of anticipation was examined using a goalkeeping task from European handball that required the rapid prediction of shot direction. Novice participants (N = 60) were assigned equally to four different training groups and two different control groups (a placebo group and a group who undertook no training). The training groups received either (i) explicit rules to guide anticipation; (ii) direction as to the location of the key anticipatory cues provided either just verbally (verbal cueing) or supplemented with color highlighting (color cueing); or (iii) undertook a matching judgment task to encourage implicit learning. Performance of the groups was compared on an anticipation test administered before training, after the training intervention, under a condition involving evaluative stress, and after a 5-month retention period. The explicit learning, verbal cueing, and implicit learning conditions provided the greatest sustained improvements in performance whereas the group given color cueing performed no better than the control groups. Only the implicit learning group showed performance superior to the control groups under the stress situation. The verbal cueing, color cueing, and implicit learning groups formulated the lowest number of explicit rules related to the critical shoulder cue although the reported use of general cues and rules based on all cues did not differ between any of the groups. Anticipation can be improved through a variety of different perceptual training approaches with the relative efficacy of the different approaches being contingent upon both the time scale and conditions under which learning is assessed.
Bayesian Cue Integration as a Developmental Outcome of Reward Mediated Learning
Weisswange, Thomas H.; Rothkopf, Constantin A.; Rodemann, Tobias; Triesch, Jochen
2011-01-01
Average human behavior in cue combination tasks is well predicted by Bayesian inference models. As this capability is acquired over developmental timescales, the question arises, how it is learned. Here we investigated whether reward dependent learning, that is well established at the computational, behavioral, and neuronal levels, could contribute to this development. It is shown that a model free reinforcement learning algorithm can indeed learn to do cue integration, i.e. weight uncertain cues according to their respective reliabilities and even do so if reliabilities are changing. We also consider the case of causal inference where multimodal signals can originate from one or multiple separate objects and should not always be integrated. In this case, the learner is shown to develop a behavior that is closest to Bayesian model averaging. We conclude that reward mediated learning could be a driving force for the development of cue integration and causal inference. PMID:21750717
Enhancing a Multi-body Mechanism with Learning-Aided Cues in an Augmented Reality Environment
NASA Astrophysics Data System (ADS)
Singh Sidhu, Manjit
2013-06-01
Augmented Reality (AR) is a potential area of research for education, covering issues such as tracking and calibration, and realistic rendering of virtual objects. The ability to augment real world with virtual information has opened the possibility of using AR technology in areas such as education and training as well. In the domain of Computer Aided Learning (CAL), researchers have long been looking into enhancing the effectiveness of the teaching and learning process by providing cues that could assist learners to better comprehend the materials presented. Although a number of works were done looking into the effectiveness of learning-aided cues, but none has really addressed this issue for AR-based learning solutions. This paper discusses the design and model of an AR based software that uses visual cues to enhance the learning process and the outcome perception results of the cues.
Bastle, Ryan M; Kufahl, Peter R; Turk, Mari N; Weber, Suzanne M; Pentkowski, Nathan S; Thiel, Kenneth J; Neisewander, Janet L
2012-08-01
Cue reinstatement of extinguished cocaine-seeking behavior is a widely used model of cue-elicited craving in abstinent human addicts. This study examined Fos protein expression in response to cocaine cues or to novel cues as a control for activation produced by test novelty. Rats were trained to self-administer cocaine paired with either a light or a tone cue, or received yoked saline and cue presentations, and then underwent daily extinction training. They were then tested for reinstatement of extinguished cocaine-seeking behavior elicited by response-contingent presentations of either the cocaine-paired cue or a novel cue (that is, tone for those trained with a light or vice versa). Surprisingly, conditioned and novel cues both reinstated responding and increased Fos similarly in most brain regions. Exceptions included the anterior cingulate, which was sensitive to test cue modality in saline controls and the dorsomedial caudate-putamen, where Fos was correlated with responding in the novel, but not conditioned, cue groups. In subsequent experiments, we observed a similar pattern of reinstatement in rats trained and tested for sucrose-seeking behavior, whereas rats trained and tested with the cues only reinstated to a novel, and not a familiar, light or tone. The results suggest that novel cues reinstate responding to a similar extent as conditioned cues regardless of whether animals have a reinforcement history with cocaine or sucrose, and that both types of cues activate similar brain circuits. Several explanations as to why converging processes may drive drug and novel cue reinforcement and seeking behavior are discussed.
Knight, Christopher P; Hauser, Sheketha R; Deehan, Gerald A; Toalston, Jamie E; McBride, William J; Rodd, Zachary A
2016-04-01
Conditioned cues can elicit drug-seeking in both humans and rodents. The majority of preclinical research has employed excitatory conditioned cues (stimuli present throughout the availability of a reinforcer), but oral consumption of alcohol is similar to a conditional stimuli (presence of stimuli is paired with the delivery of the reinforcer) approach. The current experiments attempted to determine the effects of conditional stimuli (both excitatory and inhibitory) on the expression of context-induced ethanol (EtOH)-seeking. Alcohol-preferring (P) rats self-administered EtOH and water in standard 2-lever operant chambers. A flavor was added to the EtOH solution (CS+) during the EtOH self-administration sessions. After 10 weeks, rats underwent extinction training (7 sessions), followed by a 2-week home cage period. Another flavor was present during extinction (CS-). Rats were exposed to a third flavor in a non-drug-paired environment (CS(0)). EtOH-seeking was assessed in the presence of no cue, CS+, CS-, or CS(0) in the dipper previously associated with EtOH self-administration (no EtOH available). Rats were maintained a week in their home cage before being returned to the operant chambers with access to EtOH (flavored with no cue, CS+, CS-, or CS(0)). The results indicated that the presence of the CS+ enhanced EtOH-seeking, while the presence of the CS- suppressed EtOH-seeking. Similarly, adding the CS- flavor to 15% EtOH reduced responding for EtOH while the CS+ enhanced responding for EtOH during relapse testing. Overall, the data indicate that conditional stimuli are effective at altering both EtOH-seeking behavior and EtOH-relapse drinking. Copyright © 2016 by the Research Society on Alcoholism.
Knight, Christopher P.; Hauser, Sheketha R.; Deehan, Gerald A.; Toalston, Jamie E.; McBride, William J.; Rodd, Zachary A.
2016-01-01
Background Conditioned cues can elicit drug-seeking in both humans and rodents. The majority of preclinical research has employed excitatory conditioned cues (stimuli present throughout the availability of a reinforcer), but oral consumption of alcohol is similar to a conditional stimuli (presence of stimuli is paired with the delivery of the reinforcer) approach. The current experiments attempted to determine the effects of conditional stimuli (both excitatory and inhibitory) on the expression of context-induced ethanol (EtOH)-seeking. Methods Alcohol-preferring (P) rats self-administered EtOH and water in standard 2-lever operant chambers. A flavor was added to the EtOH solution (CS+) during the EtOH self-administration sessions. After 10 weeks, rats underwent extinction training (7 sessions), followed by a 2-week home cage period. Another flavor was present during extinction (CS-). Rats were exposed to a third flavor in a non-drug paired environment (CS0). EtOH-seeking was assessed in the presence of no cue, CS+, CS- or CS0 in the dipper previously associated with EtOH self-administration (no EtOH available). Rats were maintained a week in their home cage before being returned to the operant chambers with access to EtOH (flavored with no Cue, CS+, CS- or CS0). Results The results indicated that the presence of the CS+ enhanced EtOH-seeking, while the presence of the CS- suppressed EtOH-seeking. Similarly, adding the CS- flavor to 15% EtOH reduced responding for EtOH while the CS+ enhanced responding for EtOH during relapse testing. Conclusions Overall, the data indicate that conditional stimuli are effective at altering both EtOH-seeking behavior and EtOH relapse drinking. PMID:27038599
Context and Behavioral Processes in Extinction
ERIC Educational Resources Information Center
Bouton, Mark E.
2004-01-01
This article provides a selective review and integration of the behavioral literature on Pavlovian extinction. The first part reviews evidence that extinction does not destroy the original learning, but instead generates new learning that is especially context-dependent. The second part examines insights provided by research on several related…
Acheson, Dean T; Forsyth, John P; Moses, Erica
2012-03-01
Interoceptive fear conditioning is at the core of contemporary behavioral accounts of panic disorder. Yet, to date only one study has attempted to evaluate interoceptive fear conditioning in humans (see Acheson, Forsyth, Prenoveau, & Bouton, 2007). That study used brief (physiologically inert) and longer-duration (panicogenic) inhalations of 20% CO(2)-enriched air as an interoceptive conditioned (CS) and unconditioned (US) stimulus and evaluated fear learning in three conditions: CS only, CS-US paired, and CS-US unpaired. Results showed fear conditioning in the paired condition, and fearful responding and resistance to extinction in an unpaired condition. The authors speculated that such effects may be due to difficulty discriminating between the CS and the US. The aims of the present study are to (a) replicate and expand this line of work using an improved methodology, and (b) clarify the role of CS-US discrimination difficulties in either potentiating or depotentiating fear learning. Healthy participants (N=104) were randomly assigned to one of four conditions: (a) CS only, (b) contingent CS-US pairings, (c) unpaired CS and US presentations, or (d) an unpaired "discrimination" contingency, which included an exteroceptive discrimination cue concurrently with CS onset. Electrodermal and self-report ratings served as indices of conditioned responding. Consistent with expectation, the paired contingency and unpaired contingencies yielded elevated fearful responding to the CS alone. Moreover, adding a discrimination cue to the unpaired contingency effectively attenuated fearful responding. Overall, findings are consistent with modern learning theory accounts of panic and highlight the role of interoceptive conditioning and unpredictability in the etiology of panic disorder. Copyright © 2011. Published by Elsevier Ltd.
Sjouwerman, Rachel; Niehaus, Johanna; Lonsdorf, Tina B
2015-01-01
Context plays a central role in retrieving (fear) memories. Accordingly, context manipulations are inherent to most return of fear (ROF) paradigms (in particular renewal), involving contextual changes after fear extinction. Context changes are, however, also often embedded during earlier stages of ROF experiments such as context changes between fear acquisition and extinction (e.g., in ABC and ABA renewal). Previous studies using these paradigms have however focused exclusively on the context switch after extinction (i.e., renewal). Thus, the possibility of a general effect of context switch on conditioned responding that may not be conditional to preceding extinction learning remains unstudied. Hence, the current study investigated the impact of a context switch between fear acquisition and extinction on immediate conditioned responding and on the time-course of extinction learning by using a multimodal approach. A group that underwent contextual change after fear conditioning (AB; n = 36) was compared with a group without a contextual change from acquisition to extinction (AA; n = 149), while measuring physiological (skin conductance and fear potentiated startle) measures and subjective fear ratings. Contextual change between fear acquisition and extinction had a pronounced effect on both immediate conditioned responding and on the time course of extinction learning in skin conductance responses and subjective fear ratings. This may have important implications for the mechanisms underlying and the interpretation of the renewal effect (i.e., contextual switch after extinction). Consequently, future studies should incorporate designs and statistical tests that disentangle general effects of contextual change from genuine ROF effects.
Cue Cards: A Self-Regulatory Strategy for Students with Learning Disabilities
ERIC Educational Resources Information Center
Conderman, Greg; Hedin, Laura
2011-01-01
General and special educators have used many instructional strategies to help students with learning disabilities (LD) succeed in school. One of those strategies is cue cards. As a vehicle for supporting evidence-based practices, cue cards help students (a) learn academic and behavioral steps, principles, procedures, processes, and rules; (b)…
Neural Correlates of Contextual Cueing Are Modulated by Explicit Learning
ERIC Educational Resources Information Center
Westerberg, Carmen E.; Miller, Brennan B.; Reber, Paul J.; Cohen, Neal J.; Paller, Ken A.
2011-01-01
Contextual cueing refers to the facilitated ability to locate a particular visual element in a scene due to prior exposure to the same scene. This facilitation is thought to reflect implicit learning, as it typically occurs without the observer's knowledge that scenes repeat. Unlike most other implicit learning effects, contextual cueing can be…
Judging Words by Their Covers and the Company They Keep: Probabilistic Cues Support Word Learning
ERIC Educational Resources Information Center
Lany, Jill
2014-01-01
Statistical learning may be central to lexical and grammatical development. The phonological and distributional properties of words provide probabilistic cues to their grammatical and semantic properties. Infants can capitalize on such probabilistic cues to learn grammatical patterns in listening tasks. However, infants often struggle to learn…
The role of within-compound associations in learning about absent cues.
Witnauer, James E; Miller, Ralph R
2011-05-01
When two cues are reinforced together (in compound), most associative models assume that animals learn an associative network that includes direct cue-outcome associations and a within-compound association. All models of associative learning subscribe to the importance of cue-outcome associations, but most models assume that within-compound associations are irrelevant to each cue's subsequent behavioral control. In the present article, we present an extension of Van Hamme and Wasserman's (Learning and Motivation 25:127-151, 1994) model of retrospective revaluation based on learning about absent cues that are retrieved through within-compound associations. The model was compared with a model lacking retrieval through within-compound associations. Simulations showed that within-compound associations are necessary for the model to explain higher-order retrospective revaluation and the observed greater retrospective revaluation after partial reinforcement than after continuous reinforcement alone. These simulations suggest that the associability of an absent stimulus is determined by the extent to which the stimulus is activated through the within-compound association.
Galatzer-Levy, Isaac R; Andero, Raül; Sawamura, Takehito; Jovanovic, Tanja; Papini, Santiago; Ressler, Kerry J; Norrholm, Seth Davin
2017-04-01
Deficits in fear extinction learning are hypothesized to underlie the development of posttraumatic stress disorder (PTSD). Such deficits may, in part, be due to genetic and epigenetic variation in the stress related gene FKBP5. Conversely, altering FKBP5 epigenetic responses during memory consolidation may rescue extinction deficits making it a target for acute intervention to prevent the development of PTSD. Study 1 (Humans) examines if FKBP5 single nucleotide polymorphisms (SNPs) and PTSD symptom domains (re-experiencing, avoidance/numbing, hyperarousal) are associated with abnormal fear extinction phenotypes identified using latent growth mixture modeling (LGMM). Study 2 (Mice) tests if increasing doses of dexamethasone administered prior to extinction alters Fkbp5 mRNA production in the amygdala after extinction and recall and prevents the development of abnormal extinction phenotypes. In humans, abnormal extinction was associated with the TT homozygous genotype of FKBP5 SNPs RS9470080 and RS1360780, and hyperarousal symptoms. In mice, dexamethasone 300 μg/kg was associated with increased amygdala Fkbp5 mRNA following extinction and robust extinction learning while lower doses were not associated with amygdala Fkbp5 mRNA or differences in extinction learning. Further, mice that extinguished on dexamethasone 300 μg/kg maintained low levels of freezing behavior during recall training while mRNA levels were no longer elevated. Together, findings indicate that FKBP5 confers risk for fear extinction deficits. However, this risk may be ameliorated by increasing fkbp5 mRNA expression in the amygdala during memory consolidation making this mechanism a plausible point of acute intervention to prevent the development of PTSD. Copyright © 2016 Elsevier Ltd. All rights reserved.
Differential Endocannabinoid Regulation of Extinction in Appetitive and Aversive Barnes Maze Tasks
ERIC Educational Resources Information Center
Harloe, John P.; Thorpe, Andrew J.; Lichtman, Aron H.
2008-01-01
CB[subscript 1] receptor-compromised animals show profound deficits in extinguishing learned behavior from aversive conditioning tasks, but display normal extinction learning in appetitive operant tasks. However, it is difficult to discern whether the differential involvement of the endogenous cannabinoid system on extinction results from the…
Deepened Extinction following Compound Stimulus Presentation: Noradrenergic Modulation
ERIC Educational Resources Information Center
Janak, Patricia H.; Corbit, Laura H.
2011-01-01
Behavioral extinction is an active form of new learning involving the prediction of nonreward where reward has previously been present. The expression of extinction learning can be disrupted by the presentation of reward itself or reward-predictive stimuli (reinstatement) as well as the passage of time (spontaneous recovery) or contextual changes…
Cued Reacquisition Trials during Extinction Weaken Contextual Renewal in Human Predictive Learning
ERIC Educational Resources Information Center
Effting, Marieke; Vervliet, Bram; Beckers, Tom; Kindt, Merel
2013-01-01
Extinction is generally more context specific than acquisition, as illustrated by the renewal effect. While most strategies to counteract renewal focus on decreasing the context specificity of extinction, the present work aimed at increasing the context specificity of acquisition learning. Two experiments examined whether presenting cued…
Pavlovian Conditioning of Social Exploration in Adult Female Rats.
Sunsay, Ceyhun
2018-06-02
Social conditionaed place preference (SCPP) studies show that the reward value of social interaction is amenable to the laws of associative learning, such that it becomes associated with the physical properties of the context. However, social interaction can be initiated and maintained by a variety of motivations, such as the exploration of a novel conspecific, aggression, mutual grooming and mating-like actions. In order to study whether social exploration is rewarding, we used a conventional Pavlovian conditioning procedure in which access to a restrained same-sex rat served as a reward. Three dependent variables in two experiments showed that the reward value of social exploration becomes conditioned to a transient cue, and it is also subject to extinction and spontaneous recovery. The results may help to elucidate the mixed results obtained with SCPP procedures. Copyright © 2018. Published by Elsevier B.V.
A sphingolipid mechanism for behavioral extinction.
Huston, Joseph P; Kornhuber, Johannes; Mühle, Christiane; Japtok, Lukasz; Komorowski, Mara; Mattern, Claudia; Reichel, Martin; Gulbins, Erich; Kleuser, Burkhard; Topic, Bianca; De Souza Silva, Maria A; Müller, Christian P
2016-05-01
Reward-dependent instrumental behavior must continuously be re-adjusted according to environmental conditions. Failure to adapt to changes in reward contingencies may incur psychiatric disorders like anxiety and depression. When an expected reward is omitted, behavior undergoes extinction. While extinction involves active re-learning, it is also accompanied by emotional behaviors indicative of frustration, anxiety, and despair (extinction-induced depression). Here, we report evidence for a sphingolipid mechanism in the extinction of behavior. Rapid extinction, indicating efficient re-learning, coincided with a decrease in the activity of the enzyme acid sphingomyelinase (ASM), which catalyzes turnover of sphingomyelin to ceramide, in the dorsal hippocampus of rats. The stronger the decline in ASM activity, the more rapid was the extinction. Sphingolipid-focused lipidomic analysis showed that this results in a decline of local ceramide species in the dorsal hippocampus. Ceramides shape the fluidity of lipid rafts in synaptic membranes and by that way can control neural plasticity. We also found that aging modifies activity of enzymes and ceramide levels in selective brain regions. Aging also changed how the chronic treatment with corticosterone (stress) or intranasal dopamine modified regional enzyme activity and ceramide levels, coinciding with rate of extinction. These data provide first evidence for a functional ASM-ceramide pathway in the brain involved in the extinction of learned behavior. This finding extends the known cellular mechanisms underlying behavioral plasticity to a new class of membrane-located molecules, the sphingolipids, and their regulatory enzymes, and may offer new treatment targets for extinction- and learning-related psychopathological conditions. Sphingolipids are common lipids in the brain which form lipid domains at pre- and postsynaptic membrane compartments. Here we show a decline in dorsal hippocampus ceramide species together with a reduction of acid sphingomyelinase activity during extinction of conditioned behavior in rats. This reduction was associated with expression of re-learning-related behavior, but not with emotional behaviors. Read the Editorial Highlight for this article on page 485. © 2016 International Society for Neurochemistry.
Integrating advice and experience: learning and decision making with social and nonsocial cues.
Collins, Elizabeth C; Percy, Elise J; Smith, Eliot R; Kruschke, John K
2011-06-01
When making decisions, people typically gather information from both social and nonsocial sources, such as advice from others and direct experience. This research adapted a cognitive learning paradigm to examine the process by which people learn what sources of information are credible. When participants relied on advice alone to make decisions, their learning of source reliability proceeded in a manner analogous to traditional cue learning processes and replicated the established learning phenomena. However, when advice and nonsocial cues were encountered together as an established phenomenon, blocking (ignoring redundant information) did not occur. Our results suggest that extant cognitive learning models can accommodate either advice or nonsocial cues in isolation. However, the combination of advice and nonsocial cues (a context more typically encountered in daily life) leads to different patterns of learning, in which mutually supportive information from different types of sources is not regarded as redundant and may be particularly compelling. For these situations, cognitive learning models still constitute a promising explanatory tool but one that must be expanded. As such, these findings have important implications for social psychological theory and for cognitive models of learning. 2011 APA, all rights reserved
Behavioral tagging of extinction learning.
de Carvalho Myskiw, Jociane; Benetti, Fernando; Izquierdo, Iván
2013-01-15
Extinction of contextual fear in rats is enhanced by exposure to a novel environment at 1-2 h before or 1 h after extinction training. This effect is antagonized by administration of protein synthesis inhibitors anisomycin and rapamycin into the hippocampus, but not into the amygdala, immediately after either novelty or extinction training, as well as by the gene expression blocker 5,6-dichloro-1-beta-D-ribofuranosylbenzimidazole administered after novelty training, but not after extinction training. Thus, this effect can be attributed to a mechanism similar to synaptic tagging, through which long-term potentiation can be enhanced by other long-term potentiations or by exposure to a novel environment in a protein synthesis-dependent fashion. Extinction learning produces a tag at the appropriate synapses, whereas novelty learning causes the synthesis of plasticity-related proteins that are captured by the tag, strengthening the synapses that generated this tag.
André, Marion Agnes Emma; Güntürkün, Onur; Manahan-Vaughan, Denise
2015-01-01
The metabotropic glutamate (mGlu) receptors and, in particular, mGlu5 are crucially involved in multiple forms of synaptic plasticity that are believed to underlie explicit memory. MGlu5 is also required for information transfer through neuronal oscillations and for spatial memory. Furthermore, mGlu5 is involved in extinction of implicit forms of learning. This places this receptor in a unique position with regard to information encoding. Here, we explored the role of this receptor in context-dependent extinction learning under constant, or changed, contextual conditions. Animals were trained over 3 days to take a left turn under 25% reward probability in a T-maze with a distinct floor pattern (Context A). On Day 4, they experienced either a floor pattern change (Context B) or the same floor pattern (Context A) in the absence of reward. After acquisition of the task, the animals were returned to the maze once more on Day 5 (Context A, no reward). Treatment with the mGlu5 antagonist, 2-methyl-6-(phenylethynyl) pyridine, before maze exposure on Day 4 completely inhibited extinction learning in the AAA paradigm but had no effect in the ABA paradigm. A subsequent return to the original context (A, on Day 5) revealed successful extinction in the AAA paradigm, but impairment of extinction in the ABA paradigm. These data support that although extinction learning in a new context is unaffected by mGlu5 antagonism, extinction of the consolidated context is impaired. This suggests that mGlu5 is intrinsically involved in enabling learning that once-relevant information is no longer valid. © 2014 The Authors. Hippocampus Published by Wiley Periodicals, Inc. PMID:25160592
André, Marion Agnes Emma; Güntürkün, Onur; Manahan-Vaughan, Denise
2015-02-01
The metabotropic glutamate (mGlu) receptors and, in particular, mGlu5 are crucially involved in multiple forms of synaptic plasticity that are believed to underlie explicit memory. MGlu5 is also required for information transfer through neuronal oscillations and for spatial memory. Furthermore, mGlu5 is involved in extinction of implicit forms of learning. This places this receptor in a unique position with regard to information encoding. Here, we explored the role of this receptor in context-dependent extinction learning under constant, or changed, contextual conditions. Animals were trained over 3 days to take a left turn under 25% reward probability in a T-maze with a distinct floor pattern (Context A). On Day 4, they experienced either a floor pattern change (Context B) or the same floor pattern (Context A) in the absence of reward. After acquisition of the task, the animals were returned to the maze once more on Day 5 (Context A, no reward). Treatment with the mGlu5 antagonist, 2-methyl-6-(phenylethynyl) pyridine, before maze exposure on Day 4 completely inhibited extinction learning in the AAA paradigm but had no effect in the ABA paradigm. A subsequent return to the original context (A, on Day 5) revealed successful extinction in the AAA paradigm, but impairment of extinction in the ABA paradigm. These data support that although extinction learning in a new context is unaffected by mGlu5 antagonism, extinction of the consolidated context is impaired. This suggests that mGlu5 is intrinsically involved in enabling learning that once-relevant information is no longer valid. © 2014 The Authors. Hippocampus Published by Wiley Periodicals, Inc.
Temporal Dynamics of Recovery from Extinction Shortly after Extinction Acquisition
ERIC Educational Resources Information Center
Archbold, Georgina E.; Dobbek, Nick; Nader, Karim
2013-01-01
Evidence suggests that extinction is new learning. Memory acquisition involves both short-term memory (STM) and long-term memory (LTM) components; however, few studies have examined early phases of extinction retention. Retention of auditory fear extinction was examined at various time points. Shortly (1-4 h) after extinction acquisition…
Enhanced extinction of cocaine seeking in brain-derived neurotrophic factor Val66Met knock-in mice.
Briand, Lisa A; Lee, Francis S; Blendy, Julie A; Pierce, R Christopher
2012-03-01
The Val66Met polymorphism in the brain-derived neurotropic factor (BDNF) gene results in alterations in fear extinction behavior in both human populations and mouse models. However, it is not clear whether this polymorphism plays a similar role in extinction of appetitive behaviors. Therefore, we examined operant learning and extinction of both food and cocaine self-administration behavior in an inbred genetic knock-in mouse strain expressing the variant Bdnf. These mice provide a unique opportunity to relate alterations in aversive and appetitive extinction learning as well as provide insight into how human genetic variation can lead to differences in behavior. BDNF(Met/Met) mice exhibited a severe deficit in operant learning as demonstrated by an inability to learn the food self-administration task. Therefore, extinction experiments were performed comparing wildtype (BDNF(Val/Val) ) animals to mice heterozygous for the Met allele (BDNF(Val/Met) ), which did not differ in food or cocaine self-administration behavior. In contrast to the deficit in fear extinction previously demonstrated in these mice, we found that BDNF(Val/Met) mice exhibited more rapid extinction of cocaine responding compared to wildtype mice. No differences were found between the genotypes in the extinction of food self-administration behavior or the reinstatement of cocaine seeking, indicating that the effect is specific to extinction of cocaine responding. These results suggest that the molecular mechanisms underlying aversive and appetitive extinction are distinct from one another and BDNF may play opposing roles in the two phenomena. © 2012 The Authors. European Journal of Neuroscience © 2012 Federation of European Neuroscience Societies and Blackwell Publishing Ltd.
Laborda, Mario A.; Miller, Ralph R.
2013-01-01
Fear conditioning and experimental extinction have been presented as models of anxiety disorders and exposure therapy, respectively. Moreover, the return of fear serves as a model of relapse after exposure therapy. Here we present two experiments, with rats as subjects in a lick suppression preparation, in which we assessed the additive effects of two different treatments to attenuate the return of fear. First, we evaluated whether two phenomena known to generate return of fear (i.e., spontaneous recovery and renewal) summate to produce a stronger reappearance of extinguished fear. At test, rats evaluated outside the extinction context following a long delay after extinction (i.e., a delayed context shift) exhibited greater return of extinguished fear than rats evaluated outside the extinction context alone, but return of extinguished fear following a delayed context shift did not significantly differ from the return of fear elicited in rats tested following a long delay after extinction alone. Additionally, extinction in multiple contexts and a massive extinction treatment each attenuated the strong return of fear produced by a delayed context shift. Moreover, the conjoint action of these treatments was significantly more successful in preventing the reappearance of extinguished fear, suggesting that extensive cue exposure administered in several different therapeutic settings has the potential to reduce relapse after therapy for anxiety disorders, more than either manipulation alone. PMID:23611075
Increased prefrontal cortex neurogranin enhances plasticity and extinction learning.
Zhong, Ling; Brown, Joshua; Kramer, Audra; Kaleka, Kanwardeep; Petersen, Amber; Krueger, Jamie N; Florence, Matthew; Muelbl, Matthew J; Battle, Michelle; Murphy, Geoffrey G; Olsen, Christopher M; Gerges, Nashaat Z
2015-05-13
Increasing plasticity in neurons of the prefrontal cortex (PFC) has been proposed as a possible therapeutic tool to enhance extinction, a process that is impaired in post-traumatic stress disorder, schizophrenia, and addiction. To test this hypothesis, we generated transgenic mice that overexpress neurogranin (a calmodulin-binding protein that facilitates long-term potentiation) in the PFC. Neurogranin overexpression in the PFC enhanced long-term potentiation and increased the rates of extinction learning of both fear conditioning and sucrose self-administration. Our results indicate that elevated neurogranin function within the PFC can enhance local plasticity and increase the rate of extinction learning across different behavioral tasks. Thus, neurogranin can provide a molecular link between enhanced plasticity and enhanced extinction. Copyright © 2015 the authors 0270-6474/15/357503-06$15.00/0.
Sensory Cortical Population Dynamics Uniquely Track Behavior across Learning and Extinction
Katz, Donald B.
2014-01-01
Neural responses in many cortical regions encode information relevant to behavior: information that necessarily changes as that behavior changes with learning. Although such responses are reasonably theorized to be related to behavior causation, the true nature of that relationship cannot be clarified by simple learning studies, which show primarily that responses change with experience. Neural activity that truly tracks behavior (as opposed to simply changing with experience) will not only change with learning but also change back when that learning is extinguished. Here, we directly probed for this pattern, recording the activity of ensembles of gustatory cortical single neurons as rats that normally consumed sucrose avidly were trained first to reject it (i.e., conditioned taste aversion learning) and then to enjoy it again (i.e., extinction), all within 49 h. Both learning and extinction altered cortical responses, consistent with the suggestion (based on indirect evidence) that extinction is a novel form of learning. But despite the fact that, as expected, postextinction single-neuron responses did not resemble “naive responses,” ensemble response dynamics changed with learning and reverted with extinction: both the speed of stimulus processing and the relationships among ensemble responses to the different stimuli tracked behavioral relevance. These data suggest that population coding is linked to behavior with a fidelity that single-neuron coding is not. PMID:24453316
Extinction of Pavlovian conditioning: The influence of trial number and reinforcement history.
Chan, C K J; Harris, Justin A
2017-08-01
Pavlovian conditioning is sensitive to the temporal relationship between the conditioned stimulus (CS) and the unconditioned stimulus (US). This has motivated models that describe learning as a process that continuously updates associative strength during the trial or specifically encodes the CS-US interval. These models predict that extinction of responding is also continuous, such that response loss is proportional to the cumulative duration of exposure to the CS without the US. We review evidence showing that this prediction is incorrect, and that extinction is trial-based rather than time-based. We also present two experiments that test the importance of trials versus time on the Partial Reinforcement Extinction Effect (PREE), in which responding extinguishes more slowly for a CS that was inconsistently reinforced with the US than for a consistently reinforced one. We show that increasing the number of extinction trials of the partially reinforced CS, relative to the consistently reinforced CS, overcomes the PREE. However, increasing the duration of extinction trials by the same amount does not overcome the PREE. We conclude that animals learn about the likelihood of the US per trial during conditioning, and learn trial-by-trial about the absence of the US during extinction. Moreover, what they learn about the likelihood of the US during conditioning affects how sensitive they are to the absence of the US during extinction. Copyright © 2017 Elsevier B.V. All rights reserved.
The specificity of learned parallelism in dual-memory retrieval.
Strobach, Tilo; Schubert, Torsten; Pashler, Harold; Rickard, Timothy
2014-05-01
Retrieval of two responses from one visually presented cue occurs sequentially at the outset of dual-retrieval practice. Exclusively for subjects who adopt a mode of grouping (i.e., synchronizing) their response execution, however, reaction times after dual-retrieval practice indicate a shift to learned retrieval parallelism (e.g., Nino & Rickard, in Journal of Experimental Psychology: Learning, Memory, and Cognition, 29, 373-388, 2003). In the present study, we investigated how this learned parallelism is achieved and why it appears to occur only for subjects who group their responses. Two main accounts were considered: a task-level versus a cue-level account. The task-level account assumes that learned retrieval parallelism occurs at the level of the task as a whole and is not limited to practiced cues. Grouping response execution may thus promote a general shift to parallel retrieval following practice. The cue-level account states that learned retrieval parallelism is specific to practiced cues. This type of parallelism may result from cue-specific response chunking that occurs uniquely as a consequence of grouped response execution. The results of two experiments favored the second account and were best interpreted in terms of a structural bottleneck model.
3,4-Methylenedioxymethamphetamine facilitates fear extinction learning
Young, M B; Andero, R; Ressler, K J; Howell, L L
2015-01-01
Acutely administered 3,4-methylenedioxymethamphetamine (MDMA, ‘ecstasy') has been proposed to have long-term positive effects on post-traumatic stress disorder (PTSD) symptoms when combined with psychotherapy. No preclinical data support a mechanistic basis for these claims. Given the persistent nature of psychotherapeutic gains facilitated by MDMA, we hypothesized that MDMA improves fear extinction learning, a key process in exposure-based therapies for PTSD. In these experiments, mice were first exposed to cued fear conditioning and treated with drug vehicle or MDMA before extinction training 2 days later. MDMA was administered systemically and also directly targeted to brain structures known to contribute to extinction. In addition to behavioral measures of extinction, changes in mRNA levels of brain-derived neurotrophic factor (Bdnf) and Fos were measured after MDMA treatment and extinction. MDMA (7.8 mg kg−1) persistently and robustly enhanced long-term extinction when administered before extinction training. MDMA increased the expression of Fos in the amygdala and medial prefrontal cortex (mPFC), whereas increases in Bdnf expression were observed only in the amygdala after extinction training. Extinction enhancements were recapitulated when MDMA (1 μg) was infused directly into the basolateral complex of the amygdala (BLA), and enhancement was abolished when BDNF signaling was inhibited before extinction. These findings suggest that MDMA enhances fear memory extinction through a BDNF-dependent mechanism, and that MDMA may be a useful adjunct to exposure-based therapies for PTSD and other anxiety disorders characterized by altered fear learning. PMID:26371762
3,4-Methylenedioxymethamphetamine facilitates fear extinction learning.
Young, M B; Andero, R; Ressler, K J; Howell, L L
2015-09-15
Acutely administered 3,4-methylenedioxymethamphetamine (MDMA, 'ecstasy') has been proposed to have long-term positive effects on post-traumatic stress disorder (PTSD) symptoms when combined with psychotherapy. No preclinical data support a mechanistic basis for these claims. Given the persistent nature of psychotherapeutic gains facilitated by MDMA, we hypothesized that MDMA improves fear extinction learning, a key process in exposure-based therapies for PTSD. In these experiments, mice were first exposed to cued fear conditioning and treated with drug vehicle or MDMA before extinction training 2 days later. MDMA was administered systemically and also directly targeted to brain structures known to contribute to extinction. In addition to behavioral measures of extinction, changes in mRNA levels of brain-derived neurotrophic factor (Bdnf) and Fos were measured after MDMA treatment and extinction. MDMA (7.8 mg kg(-1)) persistently and robustly enhanced long-term extinction when administered before extinction training. MDMA increased the expression of Fos in the amygdala and medial prefrontal cortex (mPFC), whereas increases in Bdnf expression were observed only in the amygdala after extinction training. Extinction enhancements were recapitulated when MDMA (1 μg) was infused directly into the basolateral complex of the amygdala (BLA), and enhancement was abolished when BDNF signaling was inhibited before extinction. These findings suggest that MDMA enhances fear memory extinction through a BDNF-dependent mechanism, and that MDMA may be a useful adjunct to exposure-based therapies for PTSD and other anxiety disorders characterized by altered fear learning.
No Two Cues Are Alike: Depth of Learning during Infancy Is Dependent on What Orients Attention
ERIC Educational Resources Information Center
Wu, Rachel; Kirkham, Natasha Z.
2010-01-01
Human infants develop a variety of attentional mechanisms that allow them to extract relevant information from a cluttered multimodal world. We know that both social and nonsocial cues shift infants' attention, but not how these cues differentially affect learning of multimodal events. Experiment 1 used social cues to direct 8- and 4-month-olds'…
Learning from Instructional Animations: How Does Prior Knowledge Mediate the Effect of Visual Cues?
ERIC Educational Resources Information Center
Arslan-Ari, I.
2018-01-01
The purpose of this study was to investigate the effects of cueing and prior knowledge on learning and mental effort of students studying an animation with narration. This study employed a 2 (no cueing vs. visual cueing) × 2 (low vs. high prior knowledge) between-subjects factorial design. The results revealed a significant interaction effect…
Gluck, Mark A.; Shohamy, Daphna; Myers, Catherine
2002-01-01
Probabilistic category learning is often assumed to be an incrementally learned cognitive skill, dependent on nondeclarative memory systems. One paradigm in particular, the weather prediction task, has been used in over half a dozen neuropsychological and neuroimaging studies to date. Because of the growing interest in using this task and others like it as behavioral tools for studying the cognitive neuroscience of cognitive skill learning, it becomes especially important to understand how subjects solve this kind of task and whether all subjects learn it in the same way. We present here new experimental and theoretical analyses of the weather prediction task that indicate that there are at least three different strategies that describe how subjects learn this task. (1) An optimal multi-cue strategy, in which they respond to each pattern on the basis of associations of all four cues with each outcome; (2) a one-cue strategy, in which they respond on the basis of presence or absence of a single cue, disregarding all other cues; or (3) a singleton strategy, in which they learn only about the four patterns that have only one cue present and all others absent. This variability in how subjects approach this task may have important implications for interpreting how different brain regions are involved in probabilistic category learning. PMID:12464701
Negash, Selam; Kliot, Daria; Howard, Darlene V.; Howard, James H.; Das, Sandhistu R.; Yushkevich, Paul A.; Pluta, John B.; Arnold, Steven E.; Wolk, David A.
2015-01-01
Objective There is currently some debate as to whether hippocampus mediates contextual cueing. In the present study, we examined contextual cueing in patients diagnosed with mild cognitive impairment (MCI) and healthy older adults, with the main goal of investigating the role of hippocampus in this form of learning. Method amnestic MCI (aMCI) patients and healthy controls completed the contextual cueing task, in which they were asked to search for a target (a horizontal T) in an array of distractors (rotated L’s). Unbeknownst to them, the spatial arrangement of elements on some displays was repeated thus making the configuration a contextual cue to the location of the target. In contrast, the configuration for novel displays was generated randomly on each trial. The difference in response times between repeated and novel configurations served as a measure of contextual learning. Results aMCI patients, as a group, were able to learn spatial contextual cues as well as healthy older adults. However, better learning on this task was associated with higher hippocampal volume, particularly in right hemisphere. Further, contextual cueing performance was significantly associated with hippocampal volume, even after controlling for age and MCI status. Conclusions These findings support the role of the hippocampus in learning of spatial contexts, and also suggest that the contextual cueing paradigm can be useful in detecting neuropathological changes associated with the hippocampus. PMID:25991413
Negash, Selam; Kliot, Daria; Howard, Darlene V; Howard, James H; Das, Sandhistu R; Yushkevich, Paul A; Pluta, John B; Arnold, Steven E; Wolk, David A
2015-04-01
There is currently some debate as to whether hippocampus mediates contextual cueing. In the present study, we examined contextual cueing in patients diagnosed with mild cognitive impairment (MCI) and healthy older adults, with the main goal of investigating the role of hippocampus in this form of learning. Amnestic MCI (aMCI) patients and healthy controls completed the contextual cueing task, in which they were asked to search for a target (a horizontal T) in an array of distractors (rotated L's). Unbeknownst to them, the spatial arrangement of elements on some displays was repeated thus making the configuration a contextual cue to the location of the target. In contrast, the configuration for novel displays was generated randomly on each trial. The difference in response times between repeated and novel configurations served as a measure of contextual learning. aMCI patients, as a group, were able to learn spatial contextual cues as well as healthy older adults. However, better learning on this task was associated with higher hippocampal volume, particularly in right hemisphere. Furthermore, contextual cueing performance was significantly associated with hippocampal volume, even after controlling for age and MCI status. These findings support the role of the hippocampus in learning of spatial contexts, and also suggest that the contextual cueing paradigm can be useful in detecting neuropathological changes associated with the hippocampus.
ERIC Educational Resources Information Center
Holtzman-Assif, Orit; Laurent, Vincent; Westbrook, R. Frederick
2010-01-01
Three experiments used rats to investigate the role of dopamine activity in learning to inhibit conditioned fear responses (freezing) in extinction. In Experiment 1, rats systemically injected with the D2 dopamine antagonist, haloperidol, froze more across multiple extinction sessions and on a drug-free retention test than control rats. In…
ERIC Educational Resources Information Center
Baeyens, Frank; Vansteenwegen, Debora; Beckers, Tom; Hermans, Dirk; Kerkhof, Ineke; De Ceulaer, Annick
2005-01-01
Using a conditioned suppression task, we investigated extinction and renewal of Pavlovian modulation in human sequential Feature Positive (FP) discrimination learning. In Experiment 1, in context a participants were first trained on two FP discriminations, X[right arrow]A+/A- and Y[right arrow]B+/B-. Extinction treatment was administered in the…
Distance and direction, but not light cues, support response reversal learning.
Wright, S L; Martin, G M; Thorpe, C M; Haley, K; Skinner, D M
2018-03-05
Across three experiments, we examined the cuing properties of metric (distance and direction) and nonmetric (lighting) cues in different tasks. In Experiment 1, rats were trained on a response problem in a T-maze, followed by four reversals. Rats that experienced a change in maze orientation (Direction group) or a change in the length of the start arm (Distance group) across reversals showed facilitation of reversal learning relative to a group that experienced changes in room lighting across reversals. In Experiment 2, rats learned a discrimination task more readily when distance or direction cues were used than when light cues were used as the discriminative stimuli. In Experiment 3, performance on a go/no-go task was equivalent using both direction and lighting cues. The successful use of both metric and nonmetric cues in the go/no-go task indicates that rats are sensitive to both types of cues and that the usefulness of different cues is dependent on the nature of the task.
Food Avoidance Learning in Squirrel Monkeys and Common Marmosets
Laska, Matthias; Metzker, Karin
1998-01-01
Using a conditioned food avoidance learning paradigm, six squirrel monkeys (Saimiri sciureus) and six common marmosets (Callithrix jacchus) were tested for their ability to (1) reliably form associations between visual or olfactory cues of a potential food and its palatability and (2) remember such associations over prolonged periods of time. We found (1) that at the group level both species showed one-trial learning with the visual cues color and shape, whereas only the marmosets were able to do so with the olfactory cue, (2) that all individuals from both species learned to reliably avoid the unpalatable food items within 10 trials, (3) a tendency in both species for quicker acquisition of the association with the visual cues compared with the olfactory cue, (4) a tendency for quicker acquisition and higher reliability of the aversion by the marmosets compared with the squirrel monkeys, and (5) that all individuals from both species were able to reliably remember the significance of the visual cues, color and shape, even after 4 months, whereas only the marmosets showed retention of the significance of the olfactory cues for up to 4 weeks. Furthermore, the results suggest that in both species tested, illness is not a necessary prerequisite for food avoidance learning but that the presumably innate rejection responses toward highly concentrated but nontoxic bitter and sour tastants are sufficient to induce robust learning and retention. PMID:10454364
Zhao, Yan; Liu, Peng; Chu, Zheng; Liu, Fei; Han, Wei; Xun, Xi; Dang, Yong-Hui
2015-10-22
The memories that are formed between rewarding and drug-associated contextual cues have been suggested to contribute to drug addiction relapse. Recent evidence has indicated that the ventrolateral orbital cortex (VLO) plays important roles in reward-based learning and reversal learning. However, whether the VLO is required for methamphetamine-induced contextual memory formation is not well understood. In the present study, a three-phase methamphetamine-induced conditioned place preference (CPP) model was used to investigate the effects of VLO lesions on the formation of drug-associated contextual memories in rats. We found that the VLO lesions themselves elicited no observable effects on place preferences. However, the VLO lesions delayed the acquisition and extinction phases of CPP without affecting the expression level. Furthermore, the VLO lesions did not have an obvious influence on CPP reinstatement. These results indicate that electrolytic lesions of the bilateral ventrolateral orbital cortex can inhibit the formation of methamphetamine-induced contextual memories in rats. Moreover, VLO may not be critically involved in memory storage and retrieval. Copyright © 2015 Elsevier B.V. All rights reserved.
Segers, Elien; Beckers, Tom; Geurts, Hilde; Claes, Laurence; Danckaerts, Marina; van der Oord, Saskia
2018-01-01
Introduction: Behavioral Parent Training (BPT) is often provided for childhood psychiatric disorders. These disorders have been shown to be associated with working memory impairments. BPT is based on operant learning principles, yet how operant principles shape behavior (through the partial reinforcement (PRF) extinction effect, i.e., greater resistance to extinction that is created when behavior is reinforced partially rather than continuously) and the potential role of working memory therein is scarcely studied in children. This study explored the PRF extinction effect and the role of working memory therein using experimental tasks in typically developing children. Methods: Ninety-seven children (age 6–10) completed a working memory task and an operant learning task, in which children acquired a response-sequence rule under either continuous or PRF (120 trials), followed by an extinction phase (80 trials). Data of 88 children were used for analysis. Results: The PRF extinction effect was confirmed: We observed slower acquisition and extinction in the PRF condition as compared to the continuous reinforcement (CRF) condition. Working memory was negatively related to acquisition but not extinction performance. Conclusion: Both reinforcement contingencies and working memory relate to acquisition performance. Potential implications for BPT are that decreasing working memory load may enhance the chance of optimally learning through reinforcement. PMID:29643822
Disruption of human fear reconsolidation using imaginal and in vivo extinction.
Agren, Thomas; Björkstrand, Johannes; Fredrikson, Mats
2017-02-15
Memories are not set forever, but can be altered following reactivation, which renders memories malleable, before they are again stabilized through reconsolidation. Fear memories can be attenuated by using extinction during the malleable period. The present study adopts a novel form of extinction, using verbal instructions, in order to examine whether fear memory reconsolidation can be affected by an imaginal exposure. The extinction using verbal instructions, called imaginal extinction, consists of a recorded voice encouraging participants to imagine the scene in which fear was acquired, and to envision the stimuli before their inner eye. The voice signals stimuli appearance, and identical to standard (in vivo) extinction, participants discover that the conditioned stimulus no longer is followed by unconditioned stimulus (UCS). In this way, imaginal extinction translates clinically used imaginal exposure into the standard experimental fear conditioning paradigm. Fear was acquired by pairing pictorial stimuli with an electric shock UCS. Then, both standard and imaginal extinction were given following fear memory reactivation, either after 10min, within the reconsolidation interval, or after 6h, outside of the reconsolidation interval. In vivo and imaginal extinction produced comparable reductions in conditioned responses during extinction and importantly, both disrupted reconsolidation of conditioned fear and abolished stimulus discrimination between reinforced and non-reinforced cues. Thus, disrupted reconsolidation of fear conditioning can be achieved without in vivo stimulus presentation, through purely cognitive means, suggesting possible therapeutic applications. Copyright © 2016 Elsevier B.V. All rights reserved.
Expecting yoghurt drinks to taste sweet or pleasant increases liking.
Kuenzel, Johanna; Zandstra, Elizabeth H; El Deredy, Wael; Blanchette, Isabelle; Thomas, Anna
2011-02-01
This experiment studied the effect of cues on liking of yoghurt drinks. We examined how hedonic (degrees of like/dislike) and sensory (level of sweetness/saltiness) cues affected liking ratings. In the learning phase, thirty-nine participants learned to associate cues with yoghurt drinks. Cues were learned for mildly and highly salty and sweet yoghurts. Sweet yoghurts were used as liked, salty yoghurts as disliked stimuli. Half the participants associated the cues with yoghurt liking (i.e. hedonic cues), the other half with the sweetness or saltiness of the yoghurt drink (i.e. sensory cues). In the test phase a cue was presented to participants subliminally (20 ms) or supraliminally (500 ms) before they tasted and rated liking of one of three yoghurt drinks in each category. The three yoghurt drinks consisted of the trained samples and a new third drink situated approximately half-way in between. The cue-drink combination was either congruent (the cued drink was given) or incongruent (two degrees of incongruence). For sweet yoghurt drinks cue-following assimilation effects were found for the supraliminal but not the subliminal cue presentations. For salty yoghurts, no effects of cue were found. This indicates that the nature of the drinks itself plays a critical role in modulating assimilation. Copyright © 2010 Elsevier Ltd. All rights reserved.
Using Retrieval Cues to Attenuate Return of Fear in Individuals With Public Speaking Anxiety.
Shin, Ki Eun; Newman, Michelle G
2018-03-01
Even after successful exposure, relapse is not uncommon. Based on the retrieval model of fear extinction (e.g., Vervliet, Craske, & Hermans, 2013), return of fear can occur after exposure due to an elapse of time (spontaneous recovery) or change in context (contextual renewal). The use of external salient stimuli presented throughout extinction (i.e., retrieval cues [RCs]) has been suggested as a potential solution to this problem (Bouton, 2002). The current study examined whether RCs attenuated return of fear in individuals with public speaking anxiety. Sixty-five participants completed a brief exposure while presented with two RC stimuli aimed at a variety of senses (visual, tactile, olfactory, and auditory). Later, half the participants were tested for return of fear in a context different from the exposure context, and the other half in the same context. Half of each context group were presented with the same cues as in exposure, while the other half were not. Return of fear due to an elapse of time, change in context, and effects of RCs were evaluated on subjective, behavioral, and physiological measures of anxiety. Although contextual renewal was not observed, results supported effects of RCs in reducing spontaneous recovery on behavioral and physiological measures of anxiety. There was also evidence that participants who were reminded of feeling anxious during exposure by the RCs benefited more from using them at follow-up, whereas those who perceived the cues as comforting (safety signals) benefited less. Clinical implications of the findings are discussed. Copyright © 2017. Published by Elsevier Ltd.
Liddie, Shervin; Anderson, Karen L; Paz, Andres; Itzhak, Yossef
2012-10-01
Several phosphodiesterase inhibitors (PDEis) improve cognition, suggesting that an increase in brain cAMP and cGMP facilitates learning and memory. Since extinction of drug-seeking behavior requires associative learning, consolidation and formation of new memory, the present study investigated the efficacy of three different PDEis in the extinction of cocaine-induced conditioned place preference (CPP) in B6129S mice. Mice were conditioned by escalating doses of cocaine which was resistant to extinction by free exploration. Immediately following each extinction session mice received (a) saline/vehicle, (b) rolipram (PDE4 inhibitor), (c) BAY-73-6691 (PDE9 inhibitor) or (d) papaverine (PDE10A inhibitor). Mice that received saline/vehicle during extinction training showed no reduction in CPP for >10 days. BAY-73-6691 (a) dose-dependently increased cGMP in hippocampus and amygdala, (b) significantly facilitated extinction and (c) diminished the reinstatement of cocaine CPP. Rolipram, which selectively increased brain cAMP levels, and papaverine which caused increases in both cAMP and cGMP levels, had no significant effect on the extinction of cocaine CPP. The results suggest that increase in hippocampal and amygdalar cGMP levels via blockade of PDE9 has a prominent role in the consolidation of extinction learning.
Holmes, Thomas H; McCormick, Mark I
2010-03-01
The speed with which individuals can learn to identify and react appropriately to predation threats when transitioning to new life history stages and habitats will influence their survival. This study investigated the role of chemical alarm cues in both anti-predator responses and predator identification during a transitional period in a newly settled coral reef damselfish, Pomacentrus amboinensis. Individuals were tested for changes in seven behavioural traits in response to conspecific and heterospecific skin extracts. Additionally, we tested whether fish could learn to associate a previously novel chemical cue (i.e. simulated predator scent) with danger, after previously being exposed to a paired cue combining the conspecific skin extract with the novel scent. Fish exposed to conspecific skin extracts were found to significantly decreased their feeding rate whilst those exposed to heterospecific and control cues showed no change. Individuals were also able to associate a previously novel scent with danger after only a single previous exposure to the paired conspecific skin extract/novel scent cue. Our results indicate that chemical alarm cues play a large role in both threat detection and learned predator recognition during the early post-settlement period in coral reef fishes. Copyright (c) 2010. Published by Elsevier B.V.
ERIC Educational Resources Information Center
Woods, Amanda M.; Bouton, Mark E.
2008-01-01
Five experiments with rat subjects compared the effects of immediate and delayed extinction on the durability of extinction learning. Three experiments examined extinction of fear conditioning (using the conditioned emotional response method), and two experiments examined extinction of appetitive conditioning (using the food-cup entry method). In…
Moyer-Horner, Lucas; Kirby, Rebecca; Vaughan, Christopher
2010-12-01
Human activity is leading to mass species extinctions worldwide. Conservation biology (CB) courses, taught worldwide at universities, typically focus on the proximal causes of extinction without teaching students how to respond to this crisis. The Extinction of Species 360 course has been taught yearly each fall semester to several hundred students at the University of Wisconsin-Madison for over two decades. In 2007 the instructor and five teaching assistants combined principles driving extinctions, based on traditional lectures and discussion sections, with action-oriented education targeting individual consumer habits, to a group of 285 students. Students learn the science underpinning conservation efforts, as evidenced by highly significant learning (< .001) gains in a 22 question survey in every measured category, and also make direct and immediate changes in their lifestyle and consumption habits. This course succeeded in each of its three primary goals: a) informed students about the value of and threats to biodiversity, similar to traditional CB courses, b) emphasized our personal role (as consumers) in perpetuating the extinction crisis and c) facilitated activities to reduce our impact and help alleviate the crisis. The results suggested students learned CB concepts and understood biodiversity's value, increased their awareness of the connection between personal consumption and extinction, and reduced their collective ecological footprints. Furthermore, students complemented their learning and multiplied the potential for consumption reduction, by participating in action-based activities. Such academic courses can provide a rigorous treatment of the direct and indirect causes of extinction while developing a student's sense of personal empowerment to help slow the extinction crisis.
Morrissey, Mark D; Mathews, Iva Z; McCormick, Cheryl M
2011-01-01
Adolescence is a time of developmental changes and reorganization in the brain and stress systems, thus, adolescents may be more vulnerable than adults to the effects of chronic mild stressors. Most studies, however, have not directly compared stress experienced in adolescence to the same stress experience in adulthood. In the present study, adolescent (n=46) and adult (n=48) male rats underwent 16 days of social instability stress (daily 1h isolation and change of cage partners) or were non-stress controls. Rats were then tested on the strength of acquired contextual and cued fear conditioning, as well as extinction learning, beginning either the day after the stress procedure or 3 weeks later. No difference was found among the groups during the Training Phase of conditioning. Irrespective of the time between the social stress experience and fear conditioning, rats stressed in adolescence had decreased context and cue memory, and cue generalization compared to control rats, as measured by the percentage of time spent freezing in tests. Social instability stress in adulthood had no effect on any measure of fear conditioning. The results support the hypothesis that adolescence is a time of heightened vulnerability to stressors. Copyright © 2010 Elsevier Inc. All rights reserved.
Garland, Eric L.; Froeliger, Brett; Howard, Matthew O.
2014-01-01
Prominent neuroscience models suggest that addictive behavior occurs when environmental stressors and drug-relevant cues activate a cycle of cognitive, affective, and psychophysiological mechanisms, including dysregulated interactions between bottom-up and top-down neural processes, that compel the user to seek out and use drugs. Mindfulness-based interventions (MBIs) target pathogenic mechanisms of the risk chain linking stress and addiction. This review describes how MBIs may target neurocognitive mechanisms of addiction at the attention-appraisal-emotion interface. Empirical evidence is presented suggesting that MBIs ameliorate addiction by enhancing cognitive regulation of a number of key processes, including: clarifying cognitive appraisal and modulating negative emotions to reduce perseverative cognition and emotional arousal; enhancing metacognitive awareness to regulate drug-use action schema and decrease addiction attentional bias; promoting extinction learning to uncouple drug-use triggers from conditioned appetitive responses; reducing cue-reactivity and increasing cognitive control over craving; attenuating physiological stress reactivity through parasympathetic activation; and increasing savoring to restore natural reward processing. Treatment and research implications of our neurocognitive framework are presented. We conclude by offering a temporally sequenced description of neurocognitive processes targeted by MBIs through a hypothetical case study. Our neurocognitive framework has implications for the optimization of addiction treatment with MBIs. PMID:24454293
Contextual control of conditioning is not affected by extinction in a behavioral task with humans.
Nelson, James Byron; Lamoureux, Jeffrey A
2015-06-01
The Attentional Theory of Context Processing (ATCP) states that extinction will arouse attention to contexts resulting in learning becoming contextually controlled. Participants learned to suppress responding to colored sensors in a video-game task where contexts were provided by different gameplay backgrounds. Four experiments assessed the contextual control of simple excitatory learning acquired to a test stimulus (T) after (Exp. 1) or during (Exp. 2-4) extinction of another stimulus (X). Experiment 1 produced no evidence of contextual control of T, though renewal to X was present both at the time T was trained and tested. In Experiment 2 no contextual control of T was evident when X underwent extensive conditioning and extinction. In Experiment 3 no contextual control of T was evident after extensive conditioning and extinction of X, and renewal to X was present. In Experiment 4 contextual control was evident to T, but it neither depended upon nor was enhanced by extinction of X. The results presented here appear to limit the generality of ATCP.
Woods, Amanda M; Bouton, Mark E
2008-12-01
Five experiments with rat subjects compared the effects of immediate and delayed extinction on the durability of extinction learning. Three experiments examined extinction of fear conditioning (using the conditioned emotional response method), and two experiments examined extinction of appetitive conditioning (using the food-cup entry method). In all experiments, conditioning and extinction were accomplished in single sessions, and retention testing took place 24 h after extinction. In both fear and appetitive conditioning, immediate extinction (beginning 10 min after conditioning) caused a faster loss of responding than delayed extinction (beginning 24 h after conditioning). However, immediate extinction was less durable than delayed extinction: There was stronger spontaneous recovery during the final retention test. There was also substantial renewal of responding when the physical context was changed between immediate extinction and testing (Experiment 1). The results suggest that, in these two widely used conditioning preparations, immediate extinction does not erase or depotentiate the original learning, and instead creates a less permanent reduction in conditioned responding. Results did not support the possibility that the strong recovery after immediate extinction was due to a mismatch in the recent "context" provided by the presence or absence of a recent conditioning experience. Several other accounts are considered.
Learned Interval Time Facilitates Associate Memory Retrieval
ERIC Educational Resources Information Center
van de Ven, Vincent; Kochs, Sarah; Smulders, Fren; De Weerd, Peter
2017-01-01
The extent to which time is represented in memory remains underinvestigated. We designed a time paired associate task (TPAT) in which participants implicitly learned cue-time-target associations between cue-target pairs and specific cue-target intervals. During subsequent memory testing, participants showed increased accuracy of identifying…
ERIC Educational Resources Information Center
Kimura, Ryoichi; Silva, Alcino J.; Ohno, Masuo
2008-01-01
Accumulating evidence indicates the key role of [alpha]-calcium/calmodulin-dependent protein kinase II ([alpha]CaMKII) in synaptic plasticity and learning, but it remains unclear how this kinase participates in the processing of memory extinction. Here, we investigated the mechanism by which [alpha]CaMKII may mediate extinction by using…
ERIC Educational Resources Information Center
Laurent, Vincent; Westbrook, R. Frederick
2008-01-01
We studied the roles of the basolateral amygdala (BLA) and the medial prefrontal cortex (mPFC) in learning and relearning to inhibit context conditioned fear (freezing) in extinction. In Experiment 1, pre-extinction BLA infusion of the NMDA receptor (NMDAr) antagonist, ifenprodil, impaired the development and retention of inhibition but…
ERIC Educational Resources Information Center
Myers, Karyn M.; Davis, Michael
2004-01-01
The neural mechanisms of fear suppression most commonly are studied through the use of extinction, a behavioral procedure in which a feared stimulus (i.e., one previously paired with shock) is nonreinforced repeatedly, leading to a reduction or elimination of the fear response. Although extinction is perhaps the most convenient index of fear…
Xie, Heping; Wang, Fuxing; Hao, Yanbin; Chen, Jiaxue; An, Jing; Wang, Yuxin; Liu, Huashan
2017-01-01
Cueing facilitates retention and transfer of multimedia learning. From the perspective of cognitive load theory (CLT), cueing has a positive effect on learning outcomes because of the reduction in total cognitive load and avoidance of cognitive overload. However, this has not been systematically evaluated. Moreover, what remains ambiguous is the direct relationship between the cue-related cognitive load and learning outcomes. A meta-analysis and two subsequent meta-regression analyses were conducted to explore these issues. Subjective total cognitive load (SCL) and scores on a retention test and transfer test were selected as dependent variables. Through a systematic literature search, 32 eligible articles encompassing 3,597 participants were included in the SCL-related meta-analysis. Among them, 25 articles containing 2,910 participants were included in the retention-related meta-analysis and the following retention-related meta-regression, while there were 29 articles containing 3,204 participants included in the transfer-related meta-analysis and the transfer-related meta-regression. The meta-analysis revealed a statistically significant cueing effect on subjective ratings of cognitive load (d = -0.11, 95% CI = [-0.19, -0.02], p < 0.05), retention performance (d = 0.27, 95% CI = [0.08, 0.46], p < 0.01), and transfer performance (d = 0.34, 95% CI = [0.12, 0.56], p < 0.01). The subsequent meta-regression analyses showed that dSCL for cueing significantly predicted dretention for cueing (β = -0.70, 95% CI = [-1.02, -0.38], p < 0.001), as well as dtransfer for cueing (β = -0.60, 95% CI = [-0.92, -0.28], p < 0.001). Thus in line with CLT, adding cues in multimedia materials can indeed reduce SCL and promote learning outcomes, and the more SCL is reduced by cues, the better retention and transfer of multimedia learning.
Hao, Yanbin; Chen, Jiaxue; An, Jing; Wang, Yuxin; Liu, Huashan
2017-01-01
Cueing facilitates retention and transfer of multimedia learning. From the perspective of cognitive load theory (CLT), cueing has a positive effect on learning outcomes because of the reduction in total cognitive load and avoidance of cognitive overload. However, this has not been systematically evaluated. Moreover, what remains ambiguous is the direct relationship between the cue-related cognitive load and learning outcomes. A meta-analysis and two subsequent meta-regression analyses were conducted to explore these issues. Subjective total cognitive load (SCL) and scores on a retention test and transfer test were selected as dependent variables. Through a systematic literature search, 32 eligible articles encompassing 3,597 participants were included in the SCL-related meta-analysis. Among them, 25 articles containing 2,910 participants were included in the retention-related meta-analysis and the following retention-related meta-regression, while there were 29 articles containing 3,204 participants included in the transfer-related meta-analysis and the transfer-related meta-regression. The meta-analysis revealed a statistically significant cueing effect on subjective ratings of cognitive load (d = −0.11, 95% CI = [−0.19, −0.02], p < 0.05), retention performance (d = 0.27, 95% CI = [0.08, 0.46], p < 0.01), and transfer performance (d = 0.34, 95% CI = [0.12, 0.56], p < 0.01). The subsequent meta-regression analyses showed that dSCL for cueing significantly predicted dretention for cueing (β = −0.70, 95% CI = [−1.02, −0.38], p < 0.001), as well as dtransfer for cueing (β = −0.60, 95% CI = [−0.92, −0.28], p < 0.001). Thus in line with CLT, adding cues in multimedia materials can indeed reduce SCL and promote learning outcomes, and the more SCL is reduced by cues, the better retention and transfer of multimedia learning. PMID:28854205
Context, Learning, and Extinction
ERIC Educational Resources Information Center
Gershman, Samuel J.; Blei, David M.; Niv, Yael
2010-01-01
A. Redish et al. (2007) proposed a reinforcement learning model of context-dependent learning and extinction in conditioning experiments, using the idea of "state classification" to categorize new observations into states. In the current article, the authors propose an interpretation of this idea in terms of normative statistical inference. They…
Extinction learning is slower, weaker and less context specific after alcohol
Bisby, James A.; King, John A.; Sulpizio, Valentina; Degeilh, Fanny; Valerie Curran, H.; Burgess, Neil
2015-01-01
Alcohol is frequently involved in psychological trauma and often used by individuals to reduce fear and anxiety. We examined the effects of alcohol on fear acquisition and extinction within a virtual environment. Healthy volunteers were administered alcohol (0.4 g/kg) or placebo and underwent acquisition and extinction from different viewpoints of a virtual courtyard, in which the conditioned stimulus, paired with a mild electric shock, was centrally located. Participants returned the following day to test fear recall from both viewpoints of the courtyard. Skin conductance responses were recorded as an index of conditioned fear. Successful fear acquisition under alcohol contrasted with impaired extinction learning evidenced by persistent conditioned responses (Experiment 1). Participants’ impairments in extinction under alcohol correlated with impairments in remembering object-locations in the courtyard seen from one viewpoint when tested from the other viewpoint. Alcohol-induced extinction impairments were overcome by increasing the number of extinction trials (Experiment 2). However, a test of fear recall the next day showed persistent fear in the alcohol group across both viewpoints. Thus, alcohol impaired extinction rather than acquisition of fear, suggesting that extinction is more dependent than acquisition on alcohol-sensitive representations of spatial context. Overall, extinction learning under alcohol was slower, weaker and less context-specific, resulting in persistent fear at test that generalized to the extinction viewpoint. The selective effect on extinction suggests an effect of alcohol on prefrontal involvement, while the reduced context-specificity implicates the hippocampus. These findings have important implications for the use of alcohol by individuals with clinical anxiety disorders. PMID:26234587
Audiovisual cues and perceptual learning of spectrally distorted speech.
Pilling, Michael; Thomas, Sharon
2011-12-01
Two experiments investigate the effectiveness of audiovisual (AV) speech cues (cues derived from both seeing and hearing a talker speak) in facilitating perceptual learning of spectrally distorted speech. Speech was distorted through an eight channel noise-vocoder which shifted the spectral envelope of the speech signal to simulate the properties of a cochlear implant with a 6 mm place mismatch: Experiment I found that participants showed significantly greater improvement in perceiving noise-vocoded speech when training gave AV cues than when it gave auditory cues alone. Experiment 2 compared training with AV cues with training which gave written feedback. These two methods did not significantly differ in the pattern of training they produced. Suggestions are made about the types of circumstances in which the two training methods might be found to differ in facilitating auditory perceptual learning of speech.
Learning in a Changing Environment
ERIC Educational Resources Information Center
Speekenbrink, Maarten; Shanks, David R.
2010-01-01
Multiple cue probability learning studies have typically focused on stationary environments. We present 3 experiments investigating learning in changing environments. A fine-grained analysis of the learning dynamics shows that participants were responsive to both abrupt and gradual changes in cue-outcome relations. We found no evidence that…
Memory as discrimination: a challenge to the encoding-retrieval match principle.
Poirier, Marie; Nairne, James S; Morin, Caroline; Zimmermann, Friederike G S; Koutmeridou, Kyriaki; Fowler, James
2012-01-01
Four experiments contrasted the predictions of a general encoding-retrieval match hypothesis with those of a view claiming that the distinctiveness of the cue-target relationship is the causal factor in retrieval. In Experiments 1, 2, and 4 participants learned the relationships between 4 targets and trios of cues; in Experiment 3 there were 3 targets, each associated with a pair of cues. A learning phase was followed by a cued-recognition task where the correct target had to be identified based on 1 or more of the cues. The main performance measurement was response time. Learning was designed to lead to high accuracy so effects could be attributed to retrieval efficiency rather than to variations in encoding. The nature of the cues and targets was varied across experiments. The critical factor was whether each cue was uniquely associated with the to-be-recalled target. All experiments orthogonally manipulated (a) how discriminative-or uniquely associated with a target-each cue was and (b) the degree of overlap between the cues present during learning and those present at retrieval. The novel finding reported here is that increasing the encoding-retrieval match can hinder performance if the increase simultaneously reduces how well cues predict a target-that is, a cue's diagnostic value. Encoding-retrieval match was not the factor that determined the effectiveness of retrieval. Our findings suggest that increasing the encoding-retrieval match can lead to no change, an increase, or a decrease in retrieval performance.
Disorientation, confabulation, and extinction capacity: clues on how the brain creates reality.
Nahum, Louis; Ptak, Radek; Leemann, Béatrice; Schnider, Armin
2009-06-01
Disorientation and confabulation often have a common course, independent of amnesia. Behaviorally spontaneous confabulation is the form in which patients act according to a false concept of reality; they fail to abandon action plans (anticipations) that do not pertain to the present situation. This continued enactment of previously valid but meanwhile invalidated anticipations can be conceived as deficient extinction capacity, that is, failure to integrate negative prediction errors into behavior. In this study, we explored whether disorientation and behaviorally spontaneous confabulation are associated with extinction failure. Twenty-five patients hospitalized for neurorehabilitation after first-ever brain injury who either had severe amnesia (n = 17), an orbitofrontal lesion (n = 14), or both (n = 6) were tested regarding disorientation (questionnaire) and performed an experimental task of association learning and extinction. Five patients were also classified as behaviorally spontaneous confabulators. Extinction capacity explained 66% of the variance of orientation in the whole group of patients (amnesics only, 56%; orbitofrontal group only, 90%), whereas association learning explained only 17% of the variance in the whole group (amnesics only, 7%; orbitofrontal group only, 16%). Also, extinction capacity, but not association learning, significantly distinguished between behaviorally spontaneous confabulators and all other subjects. Disorientation and behaviorally spontaneous confabulation are strongly and specifically associated with a failure of extinction, the ability to learn that previously appropriate anticipations no longer apply. Rather than invoking high-level monitoring processes, the human brain seems to make use of an ancient biological faculty-extinction-to keep thought and behavior in phase with reality.
Versaggi, Cassandra L; King, Christopher P; Meyer, Paul J
2016-08-01
Some individuals are particularly responsive to reward-associated stimuli ("cues"), including the effects of these cues on craving and relapse to drug-seeking behavior. In the cases of nicotine and alcohol, cues may acquire these abilities via the incentive-enhancing properties of the drug. To determine the interaction between cue-responsivity and nicotine reinforcement, we studied the patterns of nicotine self-administration in rats categorized based on their tendency to approach a food-predictive cue ("sign-trackers") or a reward-delivery location ("goal-trackers"). In a second experiment, we determined whether nicotine and ethanol altered the incentive value of a food cue. Rats were classified as sign- or goal-trackers during a Pavlovian conditioned approach paradigm. Rats then self-administered intravenous nicotine (0.03 mg/kg infusions) followed by extinction and cue-induced reinstatement tests. We also tested the effects of nicotine (0.4 mg/kg base s.c.) or ethanol (0.7 g/kg i.p.) on the approach to, and reinforcing efficacy of, a food cue. Sign-trackers showed greater reinstatement in response to a nicotine cue. Further, nicotine enhanced sign-tracking but not goal-tracking to a food cue and also enhanced responding for the food cue during the conditioned reinforcement test. Conversely, ethanol reduced sign-tracking and increased goal-tracking, but had no effect on conditioned reinforcement. Our studies demonstrate that the tendency to attribute incentive value to a food cue predicts enhanced cue-induced reinstatement. Additionally, the incentive value of food cues is differentially modulated by nicotine and ethanol, which may be related to the reinforcing effects of these drugs.
Multi-Sensor Information Integration and Automatic Understanding
2008-05-27
distributions for target tracks and class which are utilized by an active learning cueing management framework to optimally task the appropriate sensor...modality to cued regions of interest. Moreover, this active learning approach also facilitates analyst cueing to help resolve track ambiguities in complex...scenes. We intend to leverage SIG’s active learning with analyst cueing under future efforts with ONR and other DoD agencies. Obtaining long- term
Multi-Sensor Information Integration and Automatic Understanding
2008-08-27
distributions for target tracks and class which are utilized by an active learning cueing management framework to optimally task the appropriate sensor modality...to cued regions of interest. Moreover, this active learning approach also facilitates analyst cueing to help resolve track ambiguities in complex...scenes. We intend to leverage SIG’s active learning with analyst cueing under future efforts with ONR and other DoD agencies. Obtaining long- term
Bayindir, Mustafa; Bolger, Fergus; Say, Bilge
2016-07-19
Making decisions using judgements of multiple non-deterministic indicators is an important task, both in everyday and professional life. Learning of such decision making has often been studied as the mapping of stimuli (cues) to an environmental variable (criterion); however, little attention has been paid to the effects of situation-by-person interactions on this learning. Accordingly, we manipulated cue and feedback presentation mode (graphic or numeric) and task difficulty, and measured individual differences in working memory capacity (WMC). We predicted that graphic presentation, fewer cues, and elevated WMC would facilitate learning, and that person and task characteristics would interact such that presentation mode compatible with the decision maker's cognitive capability (enhanced visual or verbal WMC) would assist learning, particularly for more difficult tasks. We found our predicted main effects, but no significant interactions, except that those with greater WMC benefited to a larger extent with graphic than with numeric presentation, regardless of which type of working memory was enhanced or number of cues. Our findings suggest that the conclusions of past research based predominantly on tasks using numeric presentation need to be reevaluated and cast light on how working memory helps us learn multiple cue-criterion relationships, with implications for dual-process theories of cognition.
Central and peripheral vision loss differentially affects contextual cueing in visual search.
Geringswald, Franziska; Pollmann, Stefan
2015-09-01
Visual search for targets in repeated displays is more efficient than search for the same targets in random distractor layouts. Previous work has shown that this contextual cueing is severely impaired under central vision loss. Here, we investigated whether central vision loss, simulated with gaze-contingent displays, prevents the incidental learning of contextual cues or the expression of learning, that is, the guidance of search by learned target-distractor configurations. Visual search with a central scotoma reduced contextual cueing both with respect to search times and gaze parameters. However, when the scotoma was subsequently removed, contextual cueing was observed in a comparable magnitude as for controls who had searched without scotoma simulation throughout the experiment. This indicated that search with a central scotoma did not prevent incidental context learning, but interfered with search guidance by learned contexts. We discuss the role of visuospatial working memory load as source of this interference. In contrast to central vision loss, peripheral vision loss was expected to prevent spatial configuration learning itself, because the restricted search window did not allow the integration of invariant local configurations with the global display layout. This expectation was confirmed in that visual search with a simulated peripheral scotoma eliminated contextual cueing not only in the initial learning phase with scotoma, but also in the subsequent test phase without scotoma. (c) 2015 APA, all rights reserved).
A fundamental role for context in instrumental learning and extinction.
Bouton, Mark E; Todd, Travis P
2014-05-01
The purpose of this article is to review recent research that has investigated the effects of context change on instrumental (operant) learning. The first part of the article discusses instrumental extinction, in which the strength of a reinforced instrumental behavior declines when reinforcers are withdrawn. The results suggest that extinction of either simple or discriminated operant behavior is relatively specific to the context in which it is learned: As in prior studies of Pavlovian extinction, ABA, ABC, and AAB renewal effects can all be observed. Further analysis supports the idea that the organism learns to refrain from making a specific response in a specific context, or in more formal terms, an inhibitory context-response association. The second part of the article then discusses research suggesting that the context also controls instrumental behavior before it is extinguished. Several experiments demonstrate that a context switch after either simple or discriminated operant training causes a decrement in the strength of the response. Over a range of conditions, the animal appears to learn a direct association between the context and the response. Under some conditions, it can also learn a hierarchical representation of context and the response-reinforcer relation. Extinction is still more context-specific than conditioning, as indicated by ABC and AAB renewal. Overall, the results establish that the context can play a significant role in both the acquisition and extinction of operant behavior. Copyright © 2014 Elsevier B.V. All rights reserved.
Open-field exposure facilitates consummatory extinction.
Justel, Nadia; Psyrdellis, Mariana; Pautassi, Ricardo M
2016-12-07
During extinction, the organism learns that a conditioned stimulus or a conditioned response is no longer associated with an unconditioned stimulus, and as a consequence, a decrement in the response is presented. The exposure to novel situations (e.g. exploration of a novel open field) has been used widely to modulate (i.e. either enhance or deteriorate) learning and memory. The aim of the present study was to test whether open-field exposure could modulate consummatory extinction. The results indicated that open-field exposure accelerated the extinction response (i.e. experimental animals provided novelty exposure had lower consummatory behavior than control animals) when applied before - but not after - the first extinction trial, or when applied before the second extinction trial. The results suggest that environmental treatments such as novelty exposure provide a valuable, nonpharmacological alternative to potentially modulate extinction processes.
Audiovisual Cues and Perceptual Learning of Spectrally Distorted Speech
ERIC Educational Resources Information Center
Pilling, Michael; Thomas, Sharon
2011-01-01
Two experiments investigate the effectiveness of audiovisual (AV) speech cues (cues derived from both seeing and hearing a talker speak) in facilitating perceptual learning of spectrally distorted speech. Speech was distorted through an eight channel noise-vocoder which shifted the spectral envelope of the speech signal to simulate the properties…
The impact of signal-to-noise ratio on contextual cueing in children and adults.
Yang, Yingying; Merrill, Edward C
2015-04-01
Contextual cueing refers to a form of implicit spatial learning where participants incidentally learn to associate a target location with its repeated spatial context. Successful contextual learning produces an efficient visual search through familiar environments. Despite the fact that children exhibit the basic ability of implicit spatial learning, their general effectiveness in this form of learning can be compromised by other development-dependent factors. Learning to extract useful information (signal) in the presence of various amounts of irrelevant or distracting information (noise) characterizes one of the most important changes that occur with cognitive development. This research investigated whether signal-to-noise ratio (S/N) affects contextual cueing differently in children and adults. S/N was operationally defined as the ratio of repeated versus new displays encountered over time. Three ratio conditions were created: high (100%), medium (67%), and low (33%) conditions. Results suggested no difference in the acquisition of contextual learning effects in the high and medium conditions across three age groups (6- to 8-year-olds, 10- to 12-year-olds, and young adults). However, a significant developmental difference emerged in the low S/N condition. As predicted, adults exhibited significant contextual cueing effects, whereas older children showed marginally significant contextual cueing and younger children did not show cueing effects. Group differences in the ability to exhibit implicit contextual learning under low S/N conditions and the implications of this difference are discussed. Copyright © 2015 Elsevier Inc. All rights reserved.
Hermann, Andrea; Keck, Tanja; Stark, Rudolf
2014-09-01
Adverse learning experiences play a significant role in the etiology of anxiety disorders. However, not all individuals experiencing negative events develop heightened anxiety. This is possibly due to individual differences in the regulation of negative emotions associated with these negative events. Cognitive reappraisal is defined as reinterpreting an emotion-eliciting situation in a way that changes its emotional impact. A more frequent use of cognitive reappraisal in daily life has been shown to be more adaptive. However, no study to date examined the association of dispositional cognitive reappraisal with emotional learning, in order to elucidate individual differences in negative emotional responses towards aversive events. The goal of this functional magnetic resonance imaging (fMRI) study was to investigate the association of dispositional cognitive reappraisal with subjective, electrodermal and neural correlates of fear acquisition and extinction. Data of 41 healthy individuals, who participated in a socially relevant differential conditioning paradigm (acquisition and extinction learning: day 1, extinction recall: day 2), were acquired. Dispositional cognitive reappraisal was negatively associated with right insula, and hippocampus activation during acquisition. Furthermore, the reduction of self-reported conditioned fear during extinction learning as well as reduced insula and enhanced rostral anterior cingulate cortex activation during extinction learning was related to cognitive reappraisal. In addition, reduced recovery of conditioned arousal, reduced anterior cingulate and dorsomedial prefrontal cortex activation and enhanced ventromedial prefrontal cortex activation during extinction recall was observed in individuals with higher cognitive reappraisal scores. The results indicate that dispositional cognitive reappraisal modulates subjective and neural correlates of fear conditioning, probably leading to reduced acquisition and stronger extinction learning and recall. These results point to the important role of dispositional cognitive reappraisal in the development and modification of conditioned emotional responses and might further improve our understanding of anxiety disorders. Copyright © 2014 Elsevier Inc. All rights reserved.
The role of the medial prefrontal cortex in trace fear extinction
Kwapis, Janine L.; Jarome, Timothy J.
2015-01-01
The extinction of delay fear conditioning relies on a neural circuit that has received much attention and is relatively well defined. Whether this established circuit also supports the extinction of more complex associations, however, is unclear. Trace fear conditioning is a better model of complex relational learning, yet the circuit that supports extinction of this memory has received very little attention. Recent research has indicated that trace fear extinction requires a different neural circuit than delay extinction; trace extinction requires the participation of the retrosplenial cortex, but not the amygdala, as noted in a previous study. Here, we tested the roles of the prelimbic and infralimbic regions of the medial prefrontal cortex in trace and delay fear extinction by blocking NMDA receptors during extinction learning. We found that the prelimbic cortex is necessary for trace, but not for delay fear extinction, whereas the infralimbic cortex is involved in both types of extinction. These results are consistent with the idea that trace fear associations require plasticity in multiple cortical areas for successful extinction. Further, the infralimbic cortex appears to play a role in extinction regardless of whether the animal was initially trained in trace or delay conditioning. Together, our results provide new information about how the neural circuits supporting trace and delay fear extinction differ. PMID:25512576
A Molecular Dissociation between Cued and Contextual Appetitive Learning
ERIC Educational Resources Information Center
Kheirbek, Mazen A.; Beeler, Jeff A.; Chi, Wanhao; Ishikawa, Yoshihiro; Zhuang, Xiaoxi
2010-01-01
In appetitive Pavlovian learning, animals learn to associate discrete cues or environmental contexts with rewarding outcomes, and these cues and/or contexts can potentiate an ongoing instrumental response for reward. Although anatomical substrates underlying cued and contextual learning have been proposed, it remains unknown whether specific…
Sobieraj, Jeffery C.; Kim, Airee; Fannon, McKenzie J.; Mandyam, Chitra D.
2015-01-01
Exercise (physical activity) has been proposed as a treatment for drug addiction. In rodents, voluntary wheel running reduces cocaine and nicotine seeking during extinction, and reinstatement of cocaine seeking triggered by drug cues. The purpose of this study was to examine the effects of chronic wheel running during withdrawal and protracted abstinence on extinction and reinstatement of methamphetamine seeking in methamphetamine dependent rats, and to determine a potential neurobiological correlate underlying the effects. Rats were given extended access to methamphetamine (0.05 mg/kg, 6h/day) for 22 sessions. Rats were withdrawn and were given access to running wheels (wheel runners) or no wheels (sedentary) for three weeks after which they experienced extinction and reinstatement of methamphetamine seeking. Extended access to methamphetamine self-administration produced escalation in methamphetamine intake. Methamphetamine experience reduced running output, and conversely, access to wheel running during withdrawal reduced responding during extinction and, context- and cue-induced reinstatement of methamphetamine seeking. Immunohistochemical analysis of brain tissue demonstrated that wheel running during withdrawal did not regulate markers of methamphetamine neurotoxicity (neurogenesis, neuronal nitric oxide synthase, vesicular monoamine transporter-2) and cellular activation (c-Fos) in brain regions involved in relapse to drug seeking. However, reduced methamphetamine seeking was associated with running-induced reduction (and normalization) of the number of tyrosine hydroxylase (TH) immunoreactive neurons in the periaqueductal gray (PAG). The present study provides evidence that dopamine neurons of the PAG region show adaptive biochemical changes during methamphetamine seeking in methamphetamine dependent rats and wheel running abolishes these effects. Given that the PAG dopamine neurons project onto the structures of the extended amygdala, the present findings also suggest that wheel running may be preventing certain allostatic changes in the brain reward and stress systems contributing to the negative reinforcement and perpetuation of the addiction cycle. PMID:25273280
Sobieraj, Jeffery C; Kim, Airee; Fannon, McKenzie J; Mandyam, Chitra D
2016-01-01
Exercise (physical activity) has been proposed as a treatment for drug addiction. In rodents, voluntary wheel running reduces cocaine and nicotine seeking during extinction, and reinstatement of cocaine seeking triggered by drug-cues. The purpose of this study was to examine the effects of chronic wheel running during withdrawal and protracted abstinence on extinction and reinstatement of methamphetamine seeking in methamphetamine dependent rats, and to determine a potential neurobiological correlate underlying the effects. Rats were given extended access to methamphetamine (0.05 mg/kg, 6 h/day) for 22 sessions. Rats were withdrawn and were given access to running wheels (wheel runners) or no wheels (sedentary) for 3 weeks after which they experienced extinction and reinstatement of methamphetamine seeking. Extended access to methamphetamine self-administration produced escalation in methamphetamine intake. Methamphetamine experience reduced running output, and conversely, access to wheel running during withdrawal reduced responding during extinction and, context- and cue-induced reinstatement of methamphetamine seeking. Immunohistochemical analysis of brain tissue demonstrated that wheel running during withdrawal did not regulate markers of methamphetamine neurotoxicity (neurogenesis, neuronal nitric oxide synthase, vesicular monoamine transporter-2) and cellular activation (c-Fos) in brain regions involved in relapse to drug seeking. However, reduced methamphetamine seeking was associated with running-induced reduction (and normalization) of the number of tyrosine hydroxylase immunoreactive neurons in the periaqueductal gray (PAG). The present study provides evidence that dopamine neurons of the PAG region show adaptive biochemical changes during methamphetamine seeking in methamphetamine dependent rats and wheel running abolishes these effects. Given that the PAG dopamine neurons project onto the structures of the extended amygdala, the present findings also suggest that wheel running may be preventing certain allostatic changes in the brain reward and stress systems contributing to the negative reinforcement and perpetuation of the addiction cycle.
Examining the durability of incidentally learned trust from gaze cues.
Strachan, James W A; Tipper, Steven P
2017-10-01
In everyday interactions we find our attention follows the eye gaze of faces around us. As this cueing is so powerful and difficult to inhibit, gaze can therefore be used to facilitate or disrupt visual processing of the environment, and when we experience this we infer information about the trustworthiness of the cueing face. However, to date no studies have investigated how long these impressions last. To explore this we used a gaze-cueing paradigm where faces consistently demonstrated either valid or invalid cueing behaviours. Previous experiments show that valid faces are subsequently rated as more trustworthy than invalid faces. We replicate this effect (Experiment 1) and then include a brief interference task in Experiment 2 between gaze cueing and trustworthiness rating, which weakens but does not completely eliminate the effect. In Experiment 3, we explore whether greater familiarity with the faces improves the durability of trust learning and find that the effect is more resilient with familiar faces. Finally, in Experiment 4, we push this further and show that evidence of trust learning can be seen up to an hour after cueing has ended. Taken together, our results suggest that incidentally learned trust can be durable, especially for faces that deceive.
Context-dependent extinction of an appetitive operant conditioned response in infant rats.
Orellana Barrera, Estefanía; Arias, Carlos; González, Felisa; Abate, Paula
2017-04-01
The present study evaluated context-dependent learning under an operant conditioning procedure in infant rats. Preweanling rats were trained in context A during postnatal days (PDs) 16 and 17 to learn an appetitive operant conditioning task, employing milk chocolate as appetitive reinforcer. On PD18 the operant response was extinguished in context A, or in an alternative context B. The change from context A to B between acquisition and extinction did not affect the number of responses during extinction, but slightly modified the shape of the extinction curve. On PD19, a renewal test conducted in context A clearly showed ABA-renewal of the extinguished operant response. These results add to the body of evidence indicating that infants are able to acquire and retain contextual information, and support the notion that extinction during this ontogenetic period involves new learning. © 2017 Wiley Periodicals, Inc.
Hammond, Sherri; Wagner, John J
2013-09-01
With respect to the treatment of addiction, the objective of extinction training is to decrease drug-seeking behavior by repeatedly exposing the patient to cues in the absence of unconditioned reinforcement. Such exposure therapy typically takes place in a novel (clinical) environment. This is potentially problematic, as the effects of extinction training include a context dependent component and therefore diminished efficacy is expected upon the patient's return to former drug-seeking/taking environments. We have reported that treatment with the NMDAR coagonist d-serine is effective in facilitating the effects of extinction to reduce cocaine-primed reinstatement. The present study assesses d-serine's effectiveness in reducing drug-primed reinstatement under conditions in which extinction training occurs in a novel environment. After 22 days of cocaine self-administration (0.5 mg/kg) in context "A", animals underwent 5 extinction training sessions in context "B". Immediately after each extinction session in "B", animals received either saline or d-serine (60 mg/kg) treatment. Our results indicate that d-serine treatment following extinction in "B" had no effect on either IV or IP cocaine-primed reinstatement conducted in "A". These results stand in contrast to our previous findings where extinction occurred in "A", indicating that d-serine's effectiveness in facilitating extinction training to reduce drug-primed reinstatement is not transferable to a novel extinction environment. This inability of d-serine treatment to reduce the context specificity of extinction training may explain the inconsistent effects observed in clinical studies published to date in which adjunctive cognitive enhancement treatment has been combined with behavioral therapy without significant benefit. Copyright © 2013 Elsevier B.V. All rights reserved.
ERIC Educational Resources Information Center
Laurent, Vincent; Westbrook, R. Frederick
2009-01-01
Rats were subjected to one or two cycles of context fear conditioning and extinction to study the roles of the prelimbic cortex (PL) and infralimbic cortex (IL) in learning and relearning to inhibit fear responses. Inactivation of the PL depressed fear responses across the first or second extinction but did not impair learning or relearning fear…
Mannewitz, A; Bock, J; Kreitz, S; Hess, A; Goldschmidt, J; Scheich, H; Braun, Katharina
2018-05-01
Learning can be categorized into cue-instructed and spontaneous learning types; however, so far, there is no detailed comparative analysis of specific brain pathways involved in these learning types. The aim of this study was to compare brain activity patterns during these learning tasks using the in vivo imaging technique of single photon-emission computed tomography (SPECT) of regional cerebral blood flow (rCBF). During spontaneous exploratory learning, higher levels of rCBF compared to cue-instructed learning were observed in motor control regions, including specific subregions of the motor cortex and the striatum, as well as in regions of sensory pathways including olfactory, somatosensory, and visual modalities. In addition, elevated activity was found in limbic areas, including specific subregions of the hippocampal formation, the amygdala, and the insula. The main difference between the two learning paradigms analyzed in this study was the higher rCBF observed in prefrontal cortical regions during cue-instructed learning when compared to spontaneous learning. Higher rCBF during cue-instructed learning was also observed in the anterior insular cortex and in limbic areas, including the ectorhinal and entorhinal cortexes, subregions of the hippocampus, subnuclei of the amygdala, and the septum. Many of the rCBF changes showed hemispheric lateralization. Taken together, our study is the first to compare partly lateralized brain activity patterns during two different types of learning.
Active Avoidance: Neural Mechanisms and Attenuation of Pavlovian Conditioned Responding.
Boeke, Emily A; Moscarello, Justin M; LeDoux, Joseph E; Phelps, Elizabeth A; Hartley, Catherine A
2017-05-03
Patients with anxiety disorders often experience a relapse in symptoms after exposure therapy. Similarly, threat responses acquired during Pavlovian threat conditioning often return after extinction learning. Accordingly, there is a need for alternative methods to persistently reduce threat responding. Studies in rodents have suggested that exercising behavioral control over an aversive stimulus can persistently diminish threat responses, and that these effects are mediated by the amygdala, ventromedial prefrontal cortex, and striatum. In this fMRI study, we attempted to translate these findings to humans. Subjects first underwent threat conditioning. We then contrasted two forms of safety learning: active avoidance, in which participants could prevent the shock through an action, and yoked extinction, with shock presentation matched to the active condition, but without instrumental control. The following day, we assessed subjects' threat responses (measured by skin conductance) to the conditioned stimuli without shock. Subjects next underwent threat conditioning with novel stimuli. Yoked extinction subjects showed an increase in conditioned response to stimuli from the previous day, but the active avoidance group did not. Additionally, active avoidance subjects showed reduced conditioned responding during novel threat conditioning, but the extinction group did not. We observed between-group differences in striatal BOLD responses to shock omission in Avoidance/Extinction. These findings suggest a differential role for the striatum in human active avoidance versus extinction learning, and indicate that active avoidance may be more effective than extinction in persistently diminishing threat responses. SIGNIFICANCE STATEMENT Extinguished threat responses often reemerge with time, highlighting the importance of identifying more enduring means of attenuation. We compared the effects of active avoidance learning and yoked extinction on threat responses in humans and contrasted the neural circuitry engaged by these two processes. Subjects who learned to prevent a shock through an action maintained low threat responses after safety learning and showed attenuated threat conditioning with novel stimuli, in contrast to those who underwent yoked extinction. The results suggest that experiences of active control over threat engage the striatum and promote a shift from expression of innate defensive responses toward more adaptive behavioral responses to threatening stimuli. Copyright © 2017 the authors 0270-6474/17/374808-11$15.00/0.
Active Avoidance: Neural Mechanisms and Attenuation of Pavlovian Conditioned Responding
Boeke, Emily A.; Moscarello, Justin M.; Phelps, Elizabeth A.
2017-01-01
Patients with anxiety disorders often experience a relapse in symptoms after exposure therapy. Similarly, threat responses acquired during Pavlovian threat conditioning often return after extinction learning. Accordingly, there is a need for alternative methods to persistently reduce threat responding. Studies in rodents have suggested that exercising behavioral control over an aversive stimulus can persistently diminish threat responses, and that these effects are mediated by the amygdala, ventromedial prefrontal cortex, and striatum. In this fMRI study, we attempted to translate these findings to humans. Subjects first underwent threat conditioning. We then contrasted two forms of safety learning: active avoidance, in which participants could prevent the shock through an action, and yoked extinction, with shock presentation matched to the active condition, but without instrumental control. The following day, we assessed subjects' threat responses (measured by skin conductance) to the conditioned stimuli without shock. Subjects next underwent threat conditioning with novel stimuli. Yoked extinction subjects showed an increase in conditioned response to stimuli from the previous day, but the active avoidance group did not. Additionally, active avoidance subjects showed reduced conditioned responding during novel threat conditioning, but the extinction group did not. We observed between-group differences in striatal BOLD responses to shock omission in Avoidance/Extinction. These findings suggest a differential role for the striatum in human active avoidance versus extinction learning, and indicate that active avoidance may be more effective than extinction in persistently diminishing threat responses. SIGNIFICANCE STATEMENT Extinguished threat responses often reemerge with time, highlighting the importance of identifying more enduring means of attenuation. We compared the effects of active avoidance learning and yoked extinction on threat responses in humans and contrasted the neural circuitry engaged by these two processes. Subjects who learned to prevent a shock through an action maintained low threat responses after safety learning and showed attenuated threat conditioning with novel stimuli, in contrast to those who underwent yoked extinction. The results suggest that experiences of active control over threat engage the striatum and promote a shift from expression of innate defensive responses toward more adaptive behavioral responses to threatening stimuli. PMID:28408411
Abraham, Antony D; Neve, Kim A; Lattal, K Matthew
2016-07-01
Dopamine is critical for many processes that drive learning and memory, including motivation, prediction error, incentive salience, memory consolidation, and response output. Theories of dopamine's function in these processes have, for the most part, been developed from behavioral approaches that examine learning mechanisms in appetitive tasks. A parallel and growing literature indicates that dopamine signaling is involved in consolidation of memories into stable representations in aversive tasks such as fear conditioning. Relatively little is known about how dopamine may modulate memories that form during extinction, when organisms learn that the relation between previously associated events is severed. We investigated whether fear and reward extinction share common mechanisms that could be enhanced with dopamine D1/5 receptor activation. Pharmacological activation of dopamine D1/5 receptors (with SKF 81297) enhanced extinction of both cued and contextual fear. These effects also occurred in the extinction of cocaine-induced conditioned place preference, suggesting that the observed effects on extinction were not specific to a particular type of procedure (aversive or appetitive). A cAMP/PKA biased D1 agonist (SKF 83959) did not affect fear extinction, whereas a broadly efficacious D1 agonist (SKF 83822) promoted fear extinction. Together, these findings show that dopamine D1/5 receptor activation is a target for the enhancement of fear or reward extinction.
Shi, Yan-Wei; Fan, Bu-Fang; Xue, Li; Wen, Jia-Ling; Zhao, Hu
2017-01-01
The amygdala, a critical structure for both Pavlovian fear conditioning and fear extinction, receives sparse but comprehensive dopamine innervation and contains dopamine D1 and D2 receptors. Fear extinction, which involves learning to suppress the expression of a previously learned fear, appears to require the dopaminergic system. The specific roles of D2 receptors in mediating associative learning underlying fear extinction require further study. Intra-basolateral amygdala (BLA) infusions of a D2 receptor agonist, quinpirole, and a D2 receptor antagonist, sulpiride, prior to fear extinction and extinction retention were tested 24 h after fear extinction training for long-term memory (LTM). LTM was facilitated by quinpirole and attenuated by sulpiride. In addition, A-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid receptor glutamate receptor 1 (GluR1) subunit, GluR1 phospho-Ser845, and N -methyl-D-aspartic acid receptor NR2B subunit levels in the BLA were generally increased by quinpirole and down-regulated by sulpiride. The present study suggests that activation of D2 receptors facilitates fear extinction and that blockade of D2 receptors impairs fear extinction, accompanied by changes in GluR1, GluR1-Ser845 and NR2B levels in the amygdala.
Versaggi, Cassandra L.; King, Christopher P.; Meyer, Paul J.
2016-01-01
Rationale Some individuals are particularly responsive to reward-associated stimuli (“cues”), including the effects of these cues on craving and relapse to drug-seeking behavior. In the cases of nicotine and alcohol, cues may acquire these abilities via the incentive-enhancing properties of the drug. Objectives To determine the interaction between cue-responsivity and nicotine reinforcement, we studied the patterns of nicotine self-administration in rats categorized based on their tendency to approach a food predictive cue (“sign-trackers”) or a reward-delivery location (“goal-trackers”). In a second experiment, we determined whether nicotine and ethanol altered the incentive value of a food cue. Methods Rats were classified as sign- or goal-trackers during a Pavlovian conditioned approach paradigm. Rats then self-administered intravenous nicotine (0.03 mg/kg infusions) followed by extinction and cue induced reinstatement tests. We also tested the effects of nicotine (0.4 mg/kg base s.c.) or ethanol (0.7 g/kg i.p.) on the approach to, and reinforcing efficacy of, a food cue. Results Sign-trackers showed greater reinstatement in response to a nicotine cue. Further, nicotine enhanced sign-tracking but not goal-tracking to a food cue, and also enhanced responding for the food cue during the conditioned reinforcement test. Conversely, ethanol reduced sign-tracking and increased goal-tracking, but had no effect on conditioned reinforcement. Conclusions Our studies demonstrate that the tendency to attribute incentive value to a food cue predicts enhanced cue-induced reinstatement. Additionally, the incentive value of food cues is differentially modulated by nicotine and ethanol, which may be related to the reinforcing effects of these drugs. PMID:27282365
Awad, Walaa; Ferreira, Guillaume; Maroun, Mouna
2015-01-01
Medial prefrontal circuits have been reported to undergo a major reorganization over time and gradually take a more important role for remote emotional memories such as contextual fear memory or food aversion memory. The medial prefrontal cortex, and specifically its ventral subregion, the infralimbic cortex (IL), was also reported to be critical for recent memory extinction of contextual fear conditioning and conditioned odor aversion. However, its exact role in the extinction of remotely acquired information is still not clear. Using postretrieval blockade of protein synthesis or inactivation of the IL, we showed that the IL is similarly required for extinction consolidation of recent and remote fear memory. However, in odor aversion memory, the IL was only involved in extinction consolidation of recent, but not remote, memory. In contrast, only remote retrieval of aversion memory induced c-Fos activation in the IL and preretrieval inactivation of the IL with lidocaine impaired subsequent extinction of remote but not recent memory, indicating IL is necessary for extinction learning of remote aversion memory. In contrast to the effects in odor aversion, our data show that the involvement of the IL in the consolidation of fear extinction does not depend on the memory age. More importantly, our data indicate that the IL is implicated in the extinction of fear and nonfear-based associations and suggest dissociation in the engagement of the IL in the learning and consolidation of food aversion extinction over time. PMID:25872918
Evidence for recovery of fear following immediate extinction in rats and humans
Schiller, Daniela; Cain, Christopher K.; Curley, Nina G.; Schwartz, Jennifer S.; Stern, Sarah A.; LeDoux, Joseph E.; Phelps, Elizabeth A.
2008-01-01
Fear responses can be eliminated through extinction, a procedure involving the presentation of fear-eliciting stimuli without aversive outcomes. Extinction is believed to be mediated by new inhibitory learning that acts to suppress fear expression without erasing the original memory trace. This hypothesis is supported mainly by behavioral data demonstrating that fear can recover following extinction. However, a recent report by Myers and coworkers suggests that extinction conducted immediately after fear learning may erase or prevent the consolidation of the fear memory trace. Since extinction is a major component of nearly all behavioral therapies for human fear disorders, this finding supports the notion that therapeutic intervention beginning very soon after a traumatic event will be more efficacious. Given the importance of this issue, and the controversy regarding immediate versus delayed therapeutic interventions, we examined two fear recovery phenomena in both rats and humans: spontaneous recovery (SR) and reinstatement. We found evidence for SR and reinstatement in both rats and humans even when extinction was conducted immediately after fear learning. Thus, our data do not support the hypothesis that immediate extinction erases the original memory trace, nor do they suggest that a close temporal proximity of therapeutic intervention to the traumatic event might be advantageous. PMID:18509113
People, clothing, music, and arousal as contextual retrieval cues in verbal memory.
Standing, Lionel G; Bobbitt, Kristin E; Boisvert, Kathryn L; Dayholos, Kathy N; Gagnon, Anne M
2008-10-01
Four experiments (N = 164) on context-dependent memory were performed to explore the effects on verbal memory of incidental cues during the test session which replicated specific features of the learning session. These features involved (1) bystanders, (2) the clothing of the experimenter, (3) background music, and (4) the arousal level of the subject. Social contextual cues (bystanders or experimenter clothing) improved verbal recall or recognition. However, recall decreased when the contextual cue was a different stimulus taken from the same conceptual category (piano music by Chopin) that was heard during learning. Memory was unaffected by congruent internal cues, produced by the same physiological arousal level (low, moderate, or high heart rate) during the learning and test sessions. However, recall increased with the level of arousal across the three congruent conditions. The results emphasize the effectiveness as retrieval cues of stimuli which are socially salient, concrete, and external.
The conditioning and extinction of fear in youths: What’s sex got to do with it?
Chauret, Mélissa; La Buissonnière-Ariza, Valérie; Tremblay, Vickie Lamoureux; Suffren, Sabrina; Servonnet, Alice; Pine, Daniel S.; Maheu, Françoise S.
2015-01-01
Adult work shows differences in emotional processing influenced by sexes of both the viewer and expresser of facial expressions. We investigated this in 120 healthy youths (57 boys; 10–17 years old) randomly assigned to fear conditioning and extinction tasks using either neutral male or female faces as the conditioned threat and safety cues, and a fearful face paired with a shrieking scream as the unconditioned stimulus. Fear ratings and skin conductance responses (SCRs) were assessed. Male faces triggered increased fear ratings in all participants during conditioning and extinction. Greater differential SCRs were observed in boys viewing male faces and in girls viewing female faces during conditioning. During extinction, differential SCR findings remained significant in boys viewing male faces. Our findings demonstrate how sex of participant and sex of target interact to shape fear responses in youths, and how the type of measure may lead to distinct profiles of fear responses. PMID:24929048
Behavioral and neural bases of extinction learning in Hermissenda
Cavallo, Joel S.; Hamilton, Brittany N.; Farley, Joseph
2014-01-01
Extinction of classical conditioning is thought to produce new learning that masks or interferes with the original memory. However, research in the nudibranch Hermissenda crassicornis (H.c.) has challenged this view, and instead suggested that extinction erased the original associative memory. We have re-examined extinction in H.c. to test whether extinguished associative memories can be detected on the behavioral and cellular levels, and to characterize the temporal variables involved. Associative conditioning using pairings of light (CS) and rotation (US) produced characteristic suppression of H.c. phototactic behavior. A single session of extinction training (repeated light-alone presentations) reversed suppressed behavior back to pre-training levels when administered 15 min after associative conditioning. This effect was abolished if extinction was delayed by 23 h, and yet was recovered using extended extinction training (three consecutive daily extinction sessions). Extinguished phototactic suppression did not spontaneously recover at any retention interval (RI) tested (2-, 24-, 48-, 72-h), or after additional US presentations (no observed reinstatement). Extinction training (single session, 15 min interval) also reversed the pairing-produced increases in light-evoked spike frequencies of Type B photoreceptors, an identified site of associative memory storage that is causally related to phototactic suppression. These results suggest that the behavioral effects of extinction training are not due to temporary suppression of associative memories, but instead represent a reversal of the underlying cellular changes necessary for the expression of learning. In the companion article, we further elucidate mechanisms responsible for extinction-produced reversal of memory-related neural plasticity in Type B photoreceptors. PMID:25191236
Bingham, Brian C; Sheela Rani, C S; Frazer, Alan; Strong, Randy; Morilak, David A
2013-11-01
Exposure to early-life stress is a risk factor for the development of cognitive and emotional disorders later in life. We previously demonstrated that prenatal stress (PNS) in rats results in long-term, stable changes in central stress-response systems and impairs the ability to extinguish conditioned fear responding, a component of post-traumatic stress disorder (PTSD). Maternal corticosterone (CORT), released during prenatal stress, is a possible mediator of these effects. The purpose of the present study was to investigate whether fetal exposure to CORT at levels induced by PNS is sufficient to alter the development of adult stress neurobiology and fear extinction behavior. Pregnant dams were subject to either PNS (60 min immobilization/day from ED 14-21) or a daily injection of CORT (10mg/kg), which approximated both fetal and maternal plasma CORT levels elicited during PNS. Control dams were given injections of oil vehicle. Male offspring were allowed to grow to adulthood undisturbed, at which point they were sacrificed and the medial prefrontal cortex (mPFC), hippocampus, hypothalamus, and a section of the rostral pons containing the locus coeruleus (LC) were dissected. PNS and prenatal CORT treatment decreased glucocorticoid receptor protein levels in the mPFC, hippocampus, and hypothalamus when compared to control offspring. Both treatments also decreased tyrosine hydroxylase levels in the LC. Finally, the effect of prenatal CORT exposure on fear extinction behavior was examined following chronic stress. Prenatal CORT impaired both acquisition and recall of cue-conditioned fear extinction. This effect was additive to the impairment induced by previous chronic stress. Thus, these data suggest that fetal exposure to high levels of maternal CORT is responsible for many of the lasting neurobiological consequences of PNS as they relate to the processes underlying extinction of learned fear. The data further suggest that adverse prenatal environments constitute a risk factor for PTSD-like symptomatology, especially when combined with chronic stressors later in life. Copyright © 2013 Elsevier Ltd. All rights reserved.
LeSage, Mark G; Burroughs, Danielle; Dufek, Matthew; Keyler, Daniel E; Pentel, Paul R
2004-11-01
The objective of the present study was to determine the relative efficacy of nicotine priming and nicotine-paired stimuli in reinstating extinguished NSA in rats. The relative efficacy of different stimulus conditions in reinstating NSA was also determined. Rats were trained to self-administer nicotine (0.03 mg/kg/inf) under an FR 5 schedule. Onset of a light above the active lever was correlated with nicotine availability, while offset of the light was paired with each nicotine infusion. In Experiment 1, saline extinction was arranged in the presence of these light stimuli. After extinction criteria were met, the effects of priming doses of nicotine (0.01, 0.03. and 0.06 mg/kg/inf, i.v.) on active lever pressing were determined. In Experiment 2, extinction of NSA was arranged in the absence of the light stimuli. After extinction criteria were met, reinstatement sessions were arranged involving either (1) a priming infusion of nicotine (0.03 mg/kg), (2) presentation of the same light stimuli as during NSA training, (3) constant illumination of the cue light, or (4) a combination of a nicotine priming infusion with one of the stimulus-light conditions. In Experiment 1, nicotine generally failed to reinstate NSA at any priming dose. In Experiment 2, both stimulus conditions reinstated NSA, with the stimulus condition identical to training producing a greater effect. Nicotine priming alone failed to significantly reinstate NSA. Nicotine priming combined with either stimulus condition was no more effective than each stimulus condition alone in reinstating NSA. These findings suggest that nicotine-paired cues are more effective than nicotine alone in reinstating extinguished NSA and are consistent with other studies showing that nicotine-paired stimuli play an important role in the reacquisition of NSA.
Bossert, Jennifer M; Adhikary, Sweta; St Laurent, Robyn; Marchant, Nathan J; Wang, Hui-Ling; Morales, Marisela; Shaham, Yavin
2016-05-01
In humans, exposure to contexts previously associated with heroin use can provoke relapse. In rats, exposure to heroin-paired contexts after extinction of drug-reinforced responding in different contexts reinstates heroin seeking. We previously demonstrated that the projections from ventral medial prefrontal cortex (vmPFC) to nucleus accumbens (NAc) shell play a role in this reinstatement. The ventral subiculum (vSub) sends glutamate projections to NAc shell and vmPFC. Here, we determined whether these projections contribute to context-induced reinstatement. We trained rats to self-administer heroin (0.05-0.1 mg/kg/infusion) for 3 h per day for 12 days; drug infusions were paired with a discrete tone-light cue. Lever pressing in the presence of the discrete cue was subsequently extinguished in a different context. We then tested the rats for reinstatement in the heroin- and extinction-associated contexts under extinction conditions. We combined Fos with the retrograde tracer Fluoro-Gold (FG) to determine projection-specific activation during the context-induced reinstatement tests. We also used anatomical disconnection procedures to determine whether the vSub → NAc shell and vSub → vmPFC projections are functionally involved in this reinstatement. Exposure to the heroin but not the extinction context reinstated lever pressing. Context-induced reinstatement of heroin seeking was associated with increased Fos expression in vSub neurons, including those projecting to NAc shell and vmPFC. Anatomical disconnection of the vSub → NAc shell projection, but not the vSub → vmPFC projection, decreased this reinstatement. Our data indicate that the vSub → NAc shell glutamatergic projection, but not the vSub → vmPFC projection, contributes to context-induced reinstatement of heroin seeking.
Sanchez, Victoria; Moore, Catherine F; Brunzell, Darlene H; Lynch, Wendy J
2014-04-01
Wheel running attenuates nicotine-seeking in male adolescent rats; however, it is not known if this effect extends to females. To determine if wheel running during abstinence would differentially attenuate subsequent nicotine-seeking in male and female rats that had extended access to nicotine self-administration during adolescence. Male (n = 49) and female (n = 43) adolescent rats self-administered saline or nicotine (5 μg/kg) under an extended access (23-h) paradigm. Following the last self-administration session, rats were moved to polycarbonate cages for an abstinence period where they either had access to a locked or unlocked running wheel for 2 h/day. Subsequently, nicotine-seeking was examined under a within-session extinction/cue-induced reinstatement paradigm. Due to low levels of nicotine-seeking in females in both wheel groups, additional groups were included that were housed without access to a running wheel during abstinence. Females self-administered more nicotine as compared to males; however, within males and females, intake did not differ between groups prior to wheel assignment. Compared to saline controls, males and females that self-administered nicotine showed a significant increase in drug-seeking during extinction. Wheel running during abstinence attenuated nicotine-seeking during extinction in males. In females, access to either locked or unlocked wheels attenuated nicotine-seeking during extinction. While responding was reinstated by cues in both males and females, levels were modest and not significantly affected by exercise in this adolescent-onset model. While wheel running reduced subsequent nicotine-seeking in males, access to a wheel, either locked or unlocked, was sufficient to suppress nicotine-seeking in females.
Sanchez, Victoria; Moore, Catherine F; Brunzell, Darlene H; Lynch, Wendy J
2014-01-01
Rationale Wheel running attenuates nicotine-seeking in male adolescent rats; however it is not known if this effect extends to females. Objective To determine if wheel running during abstinence would differentially attenuate subsequent nicotine-seeking in male and female rats that had extended access to nicotine self-administration during adolescence. Methods Male (N = 49) and female (N = 43) adolescent rats self-administered saline or nicotine (5μg/kg) under an extended access (23-hour) paradigm. Following the last self-administration session, rats were moved to polycarbonate cages for an abstinence period where they either had access to a locked or unlocked running wheel for 2-hours/day. Subsequently, nicotine-seeking was examined under a within-session extinction/cue-induced reinstatement paradigm. Due to low levels of nicotine-seeking in females in both wheel groups, additional groups were included that were housed without access to a running wheel during abstinence. Results Females self-administered more nicotine as compared to males; however, within males and females, intake did not differ between groups prior to wheel assignment. Compared to saline controls, males and females that self-administered nicotine showed a significant increase in drug-seeking during extinction. Wheel running during abstinence attenuated nicotine-seeking during extinction in males. In females, access to either locked or unlocked wheels attenuated nicotine-seeking during extinction. While responding was reinstated by cues in both males and females, levels were modest and not significantly affected by exercise in this adolescent-onset model. Conclusions While wheel running reduced subsequent nicotine-seeking in males, access to a wheel, either locked or unlocked, was sufficient to suppress nicotine-seeking in females. PMID:24271035
Does extinction of responses to cigarette cues occur during smoking cessation?
O'Connell, Kathleen A; Shiffman, Saul; Decarlo, Lawrence T
2011-02-01
This study investigated whether Pavlovian extinction occurs during smoking cessation by determining whether experience abstaining from smoking in the presence of cigarette cues leads to decreased probability of lapsing and whether this effect is mediated by craving. Secondary analyses were carried out with data sets from two studies with correlational/observational designs. Data were collected in smokers' natural environments using ecological momentary assessment techniques. Sixty-one and 207 smokers who were attempting cessation participated. Multi-level path models were used to examine effects of prior experience abstaining in the presence of available cigarettes and while others were smoking on subsequent craving intensity and the probability of lapsing. Control variables included current cigarette availability, current exposure to others smoking, number of prior lapses and time in the study. Both currently available cigarettes [odds ratios (OR) = 36.60, 11.59] and the current presence of other smoking (OR = 5.00, 1.52) were powerful predictors of smoking lapse. Repeated exposure to available cigarettes without smoking was associated with a significantly lower probability of lapse in subsequent episodes (OR = 0.44, 0.52). However, exposure to others smoking was not a reliable predictor, being significant only in the smaller study (OR = 0.30). Craving functioned as a mediator between extinction of available cigarettes and lapsing only in the smaller study and was not a mediator for extinction of others smoking in either study. This study showed that exposure to available cigarettes is a large risk factor for lapsing, but that this risk can also be reduced over time by repeated exposures without smoking. Smoking cessation interventions should attempt to reduce cigarette exposure (by training cigarette avoidance) but recognize the potential advantage of unreinforced exposure to available cigarettes. © 2010 The Authors, Addiction © 2010 Society for the Study of Addiction.
Extinction of Conditioned Responses to Methamphetamine-Associated Stimuli in Healthy Humans.
Cavallo, Joel S; Ruiz, Nicholas A; de Wit, Harriet
2016-07-01
Contextual stimuli present during drug experiences become associated with the drug through Pavlovian conditioning and are thought to sustain drug-seeking behavior. Thus, extinction of conditioned responses is an important target for treatment. To date, acquisition and extinction to drug-paired cues have been studied in animal models or drug-dependent individuals, but rarely in non-drug users. We have recently developed a procedure to study acquisition of conditioned responses after single doses of methamphetamine (MA) in healthy volunteers. Here, we examined extinction of these responses and their persistence after conditioning. Healthy adults (18-35 years; N = 20) received two pairings of audio-visual stimuli with MA (20 mg oral) or placebo. Responses to stimuli were assessed before and after conditioning, using three tasks: behavioral preference, attentional bias, and subjective "liking." Subjects exhibited behavioral preference for the drug-paired stimuli at the first post-conditioning test, but this declined rapidly on subsequent extinction tests. They also exhibited a bias to initially look towards the drug-paired stimuli at the first post-test session, but not thereafter. Subjects who experienced more positive subjective drug effects during conditioning exhibited a smaller decline in preference during the extinction phase. Further, longer inter-session intervals during the extinction phase were associated with less extinction of the behavioral preference measure. Conditioned responses after two pairings with MA extinguish quickly, and are influenced by both subjective drug effects and the extinction interval. Characterizing and refining this conditioning procedure will aid in understanding the acquisition and extinction processes of drug-related conditioned responses in humans.
Extinction of Conditioned Responses to Methamphetamine-Associated Stimuli in Healthy Humans
Cavallo, Joel S.; Ruiz, Nicholas A.; de Wit, Harriet
2016-01-01
Rationale Contextual stimuli present during drug experiences become associated with the drug through Pavlovian conditioning, and are thought to sustain drug-seeking behavior. Thus, extinction of conditioned responses is an important target for treatment. To date, acquisition and extinction to drug-paired cues have been studied in animal models or drug-dependent individuals, but rarely in non drug-users. Objective We have recently developed a procedure to study acquisition of conditioned responses after single doses of methamphetamine (MA) in healthy volunteers. Here we examined extinction of these responses and their persistence after conditioning. Methods Healthy adults (18–35 yrs; N=20) received two pairings of audio-visual stimuli with MA (20 mg oral) or placebo. Responses to stimuli were assessed before and after conditioning, using three tasks: behavioral preference, attentional bias, and subjective ‘liking.’ Results Subjects exhibited behavioral preference for the drug-paired stimuli at the first post-conditioning test, but this declined rapidly on subsequent extinction tests. They also exhibited a bias to initially look towards the drug-paired stimuli at the first post-test session, but not thereafter. Subjects who experienced more positive subjective drug effects during conditioning exhibited a smaller decline in preference during the extinction phase. Further, longer inter-session intervals during the extinction phase were associated with less extinction of the behavioral preference measure. Conclusions Conditioned responses after two pairings with MA extinguish quickly, and are influenced by both subjective drug effects and the extinction interval. Characterizing and refining this conditioning procedure will aid in understanding the acquisition and extinction processes of drug-related conditioned responses in humans. PMID:27113223
Enhanced Extinction of Aversive Memories by High-Frequency Stimulation of the Rat Infralimbic Cortex
Maroun, Mouna; Kavushansky, Alexandra; Holmes, Andrew; Wellman, Cara; Motanis, Helen
2012-01-01
Electrical stimulation of the rodent medial prefrontal cortex (mPFC), including the infralimbic cortex (IL), immediately prior to or during fear extinction training facilitates extinction memory. Here we examined the effects of high-frequency stimulation (HFS) of the rat IL either prior to conditioning or following retrieval of the conditioned memory, on extinction of Pavlovian fear and conditioned taste aversion (CTA). IL-HFS applied immediately after fear memory retrieval, but not three hours after retrieval or prior to conditioning, subsequently reduced freezing during fear extinction. Similarly, IL-HFS given immediately, but not three hours after, retrieval of a CTA memory reduced aversion during extinction. These data indicate that HFS of the IL may be an effective method for reducing both learned fear and learned aversion. PMID:22586453
Conceptual Similarity Promotes Generalization of Higher Order Fear Learning
ERIC Educational Resources Information Center
Dunsmoor, Joseph E.; White, Allison J.; LaBar, Kevin S.
2011-01-01
We tested the hypothesis that conceptual similarity promotes generalization of conditioned fear. Using a sensory preconditioning procedure, three groups of subjects learned an association between two cues that were conceptually similar, unrelated, or mismatched. Next, one of the cues was paired with a shock. The other cue was then reintroduced to…
ERIC Educational Resources Information Center
Altvater-Mackensen, Nicole; Grossmann, Tobias
2015-01-01
Infants' language exposure largely involves face-to-face interactions providing acoustic and visual speech cues but also social cues that might foster language learning. Yet, both audiovisual speech information and social information have so far received little attention in research on infants' early language development. Using a preferential…
Dual Learning Processes in Interactive Skill Acquisition
ERIC Educational Resources Information Center
Fu, Wai-Tat; Anderson, John R.
2008-01-01
Acquisition of interactive skills involves the use of internal and external cues. Experiment 1 showed that when actions were interdependent, learning was effective with and without external cues in the single-task condition but was effective only with the presence of external cues in the dual-task condition. In the dual-task condition, actions…
Dias, C; Wang, Y T; Phillips, A G
2012-08-01
Neuroplasticity including long-term depression (LTD) has been implicated in both learning processes and addiction. LTD can be blocked by intravenous administration of the interference peptide Tat-GluA2(3Y) that prevents regulated endocytosis of the alpha-amino-3-hydroxy-5-methyl-isoxazole-4-propionic acid (AMPA) receptor. In this study, Tat-GluA2(3Y) was used to assess the role of LTD in the induction, expression, extinction and reinstatement of morphine-induced conditioned place preference (CPP). CPP was established in rats by pairing morphine (5 mg/kg, i.p.) or saline with a specific environmental context using a balanced protocol. Tat-GluA2(3Y) (0; 1.5; 2.25 nmol/g; i.v.), scrambled peptide (Tat-GluA2(Sc)), or vehicle was administered during the acquisition phase or prior to the test for CPP. Tat-GluA2(3Y) had no effect on the induction or initial expression of morphine-induced CPP. Rats that received Tat-GluA2(3Y) or Tat-GluA2(Sc) during acquisition were subsequently tested for 11 consecutive days in order to extinguish morphine CPP. CPP was then reinstated by an injection of morphine (5 mg/kg, i.p.). Co-administration of morphine and Tat-GluA2(3Y) during acquisition greatly facilitated extinction of CPP without affecting morphine-induced reinstatement of CPP. Using an intermittent retest schedule with bi-weekly tests to measure the maintenance of CPP, Tat-GluA2(3Y) during the acquisition phase had no effect on the maintenance of CPP. We propose that co-administration of Tat-GluA2(3Y) with morphine during acquisition of CPP weakens the association between morphine and contextual cues leading to rapid extinction of morphine CPP with repeated daily testing. Copyright © 2012 Elsevier B.V. All rights reserved.
The medial prefrontal cortex and memory of cue location in the rat.
Rawson, Tim; O'Kane, Michael; Talk, Andrew
2010-01-01
We developed a single-trial cue-location memory task in which rats experienced an auditory cue while exploring an environment. They then recalled and avoided the sound origination point after the cue was paired with shock in a separate context. Subjects with medial prefrontal cortical (mPFC) lesions made no such avoidance response, but both lesioned and control subjects avoided the cue itself when presented at test. A follow up assessment revealed no spatial learning impairment in either group. These findings suggest that the rodent mPFC is required for incidental learning or recollection of the location at which a discrete cue occurred, but is not required for cue recognition or for allocentric spatial memory. Copyright 2009 Elsevier Inc. All rights reserved.
Probability matching in perceptrons: Effects of conditional dependence and linear nonseparability.
Dawson, Michael R W; Gupta, Maya
2017-01-01
Probability matching occurs when the behavior of an agent matches the likelihood of occurrence of events in the agent's environment. For instance, when artificial neural networks match probability, the activity in their output unit equals the past probability of reward in the presence of a stimulus. Our previous research demonstrated that simple artificial neural networks (perceptrons, which consist of a set of input units directly connected to a single output unit) learn to match probability when presented different cues in isolation. The current paper extends this research by showing that perceptrons can match probabilities when presented simultaneous cues, with each cue signaling different reward likelihoods. In our first simulation, we presented up to four different cues simultaneously; the likelihood of reward signaled by the presence of one cue was independent of the likelihood of reward signaled by other cues. Perceptrons learned to match reward probabilities by treating each cue as an independent source of information about the likelihood of reward. In a second simulation, we violated the independence between cues by making some reward probabilities depend upon cue interactions. We did so by basing reward probabilities on a logical combination (AND or XOR) of two of the four possible cues. We also varied the size of the reward associated with the logical combination. We discovered that this latter manipulation was a much better predictor of perceptron performance than was the logical structure of the interaction between cues. This indicates that when perceptrons learn to match probabilities, they do so by assuming that each signal of a reward is independent of any other; the best predictor of perceptron performance is a quantitative measure of the independence of these input signals, and not the logical structure of the problem being learned.
Probability matching in perceptrons: Effects of conditional dependence and linear nonseparability
2017-01-01
Probability matching occurs when the behavior of an agent matches the likelihood of occurrence of events in the agent’s environment. For instance, when artificial neural networks match probability, the activity in their output unit equals the past probability of reward in the presence of a stimulus. Our previous research demonstrated that simple artificial neural networks (perceptrons, which consist of a set of input units directly connected to a single output unit) learn to match probability when presented different cues in isolation. The current paper extends this research by showing that perceptrons can match probabilities when presented simultaneous cues, with each cue signaling different reward likelihoods. In our first simulation, we presented up to four different cues simultaneously; the likelihood of reward signaled by the presence of one cue was independent of the likelihood of reward signaled by other cues. Perceptrons learned to match reward probabilities by treating each cue as an independent source of information about the likelihood of reward. In a second simulation, we violated the independence between cues by making some reward probabilities depend upon cue interactions. We did so by basing reward probabilities on a logical combination (AND or XOR) of two of the four possible cues. We also varied the size of the reward associated with the logical combination. We discovered that this latter manipulation was a much better predictor of perceptron performance than was the logical structure of the interaction between cues. This indicates that when perceptrons learn to match probabilities, they do so by assuming that each signal of a reward is independent of any other; the best predictor of perceptron performance is a quantitative measure of the independence of these input signals, and not the logical structure of the problem being learned. PMID:28212422
de Carvalho Myskiw, Jociane; Furini, Cristiane Regina Guerino; Schmidt, Bianca; Ferreira, Flávia; Izquierdo, Ivan
2015-01-13
In the present study we test the hypothesis that extinction is not a consequence of retrieval in unreinforced conditioned stimulus (CS) presentation but the mere perception of the CS in the absence of a conditioned response. Animals with cannulae implanted in the CA1 region of hippocampus were subjected to extinction of contextual fear conditioning. Muscimol infused intra-CA1 before an extinction training session of contextual fear conditioning (CFC) blocks retrieval but not consolidation of extinction measured 24 h later. Additionally, this inhibition of retrieval does not affect early persistence of extinction when tested 7 d later or its spontaneous recovery after 2 wk. Furthermore, both anisomycin, an inhibitor of ribosomal protein synthesis, and rapamycin, an inhibitor of extraribosomal protein synthesis, given into the CA1, impair extinction of CFC regardless of whether its retrieval was blocked by muscimol. Therefore, retrieval performance in the first unreinforced session is not necessary for the installation, maintenance, or spontaneous recovery of extinction of CFC.
Differentiating Visual from Response Sequencing during Long-term Skill Learning.
Lynch, Brighid; Beukema, Patrick; Verstynen, Timothy
2017-01-01
The dual-system model of sequence learning posits that during early learning there is an advantage for encoding sequences in sensory frames; however, it remains unclear whether this advantage extends to long-term consolidation. Using the serial RT task, we set out to distinguish the dynamics of learning sequential orders of visual cues from learning sequential responses. On each day, most participants learned a new mapping between a set of symbolic cues and responses made with one of four fingers, after which they were exposed to trial blocks of either randomly ordered cues or deterministic ordered cues (12-item sequence). Participants were randomly assigned to one of four groups (n = 15 per group): Visual sequences (same sequence of visual cues across training days), Response sequences (same order of key presses across training days), Combined (same serial order of cues and responses on all training days), and a Control group (a novel sequence each training day). Across 5 days of training, sequence-specific measures of response speed and accuracy improved faster in the Visual group than any of the other three groups, despite no group differences in explicit awareness of the sequence. The two groups that were exposed to the same visual sequence across days showed a marginal improvement in response binding that was not found in the other groups. These results indicate that there is an advantage, in terms of rate of consolidation across multiple days of training, for learning sequences of actions in a sensory representational space, rather than as motoric representations.
Neural signals of vicarious extinction learning
Haaker, Jan; Selbing, Ida; Olsson, Andreas
2016-01-01
Social transmission of both threat and safety is ubiquitous, but little is known about the neural circuitry underlying vicarious safety learning. This is surprising given that these processes are critical to flexibly adapt to a changeable environment. To address how the expression of previously learned fears can be modified by the transmission of social information, two conditioned stimuli (CS + s) were paired with shock and the third was not. During extinction, we held constant the amount of direct, non-reinforced, exposure to the CSs (i.e. direct extinction), and critically varied whether another individual—acting as a demonstrator—experienced safety (CS + vic safety) or aversive reinforcement (CS + vic reinf). During extinction, ventromedial prefrontal cortex (vmPFC) responses to the CS + vic reinf increased but decreased to the CS + vic safety. This pattern of vmPFC activity was reversed during a subsequent fear reinstatement test, suggesting a temporal shift in the involvement of the vmPFC. Moreover, only the CS + vic reinf association recovered. Our data suggest that vicarious extinction prevents the return of conditioned fear responses, and that this efficacy is reflected by diminished vmPFC involvement during extinction learning. The present findings may have important implications for understanding how social information influences the persistence of fear memories in individuals suffering from emotional disorders. PMID:27278792
Ogden, Kevin K; Khatri, Alpa; Traynelis, Stephen F; Heldt, Scott A
2014-02-01
NMDA receptors are glutamate receptor ion channels that contribute to synaptic plasticity and are important for many forms of learning and memory. In the amygdala, NMDA receptors are critical for the acquisition, retention, and extinction of classically conditioned fear responses. Although the GluN2B subunit has been implicated in both the acquisition and extinction of conditioned fear, GluN2C-knockout mice show reduced conditioned fear responses. Moreover, D-cycloserine (DCS), which facilitates fear extinction, selectively enhances the activity of GluN2C-containing NMDA receptors. To further define the contribution of GluN2C receptors to fear learning, we infused the GluN2C/GluN2D-selective potentiator CIQ bilaterally into the basolateral amygdala (3, 10, or 30 μg/side) following either fear conditioning or fear extinction training. CIQ both increased the expression of conditioned fear 24 h later and enhanced the extinction of the previously conditioned fear response. These results support a critical role for GluN2C receptors in the amygdala in the consolidation of learned fear responses and suggest that increased activity of GluN2C receptors may underlie the therapeutic actions of DCS.
Modeling the Development of Audiovisual Cue Integration in Speech Perception
Getz, Laura M.; Nordeen, Elke R.; Vrabic, Sarah C.; Toscano, Joseph C.
2017-01-01
Adult speech perception is generally enhanced when information is provided from multiple modalities. In contrast, infants do not appear to benefit from combining auditory and visual speech information early in development. This is true despite the fact that both modalities are important to speech comprehension even at early stages of language acquisition. How then do listeners learn how to process auditory and visual information as part of a unified signal? In the auditory domain, statistical learning processes provide an excellent mechanism for acquiring phonological categories. Is this also true for the more complex problem of acquiring audiovisual correspondences, which require the learner to integrate information from multiple modalities? In this paper, we present simulations using Gaussian mixture models (GMMs) that learn cue weights and combine cues on the basis of their distributional statistics. First, we simulate the developmental process of acquiring phonological categories from auditory and visual cues, asking whether simple statistical learning approaches are sufficient for learning multi-modal representations. Second, we use this time course information to explain audiovisual speech perception in adult perceivers, including cases where auditory and visual input are mismatched. Overall, we find that domain-general statistical learning techniques allow us to model the developmental trajectory of audiovisual cue integration in speech, and in turn, allow us to better understand the mechanisms that give rise to unified percepts based on multiple cues. PMID:28335558
Modeling the Development of Audiovisual Cue Integration in Speech Perception.
Getz, Laura M; Nordeen, Elke R; Vrabic, Sarah C; Toscano, Joseph C
2017-03-21
Adult speech perception is generally enhanced when information is provided from multiple modalities. In contrast, infants do not appear to benefit from combining auditory and visual speech information early in development. This is true despite the fact that both modalities are important to speech comprehension even at early stages of language acquisition. How then do listeners learn how to process auditory and visual information as part of a unified signal? In the auditory domain, statistical learning processes provide an excellent mechanism for acquiring phonological categories. Is this also true for the more complex problem of acquiring audiovisual correspondences, which require the learner to integrate information from multiple modalities? In this paper, we present simulations using Gaussian mixture models (GMMs) that learn cue weights and combine cues on the basis of their distributional statistics. First, we simulate the developmental process of acquiring phonological categories from auditory and visual cues, asking whether simple statistical learning approaches are sufficient for learning multi-modal representations. Second, we use this time course information to explain audiovisual speech perception in adult perceivers, including cases where auditory and visual input are mismatched. Overall, we find that domain-general statistical learning techniques allow us to model the developmental trajectory of audiovisual cue integration in speech, and in turn, allow us to better understand the mechanisms that give rise to unified percepts based on multiple cues.
Negrón-Oyarzo, Ignacio; Pérez, Miguel Ángel; Terreros, Gonzalo; Muñoz, Pablo; Dagnino-Subiabre, Alexies
2014-02-01
The prelimbic cortex and amygdala regulate the extinction of conditioned fear and anxiety, respectively. In adult rats, chronic stress affects the dendritic morphology of these brain areas, slowing extinction of learned fear and enhancing anxiety. The aim of this study was to determine whether rats subjected to chronic stress in adolescence show changes in learned fear, anxiety, and synaptic transmission in the prelimbic cortex during adulthood. Male Sprague Dawley rats were subjected to seven days of restraint stress on postnatal day forty-two (PND 42, adolescence). Afterward, the fear-conditioning paradigm was used to study conditioned fear extinction. Anxiety-like behavior was measured one day (PND 50) and twenty-one days (PND 70, adulthood) after stress using the elevated-plus maze and dark-light box tests, respectively. With another set of rats, excitatory synaptic transmission was analyzed with slices of the prelimbic cortex. Rats that had been stressed during adolescence and adulthood had higher anxiety-like behavior levels than did controls, while stress-induced slowing of learned fear extinction in adolescence was reversed during adulthood. As well, the field excitatory postsynaptic potentials of stressed adolescent rats had significantly lower amplitudes than those of controls, although the amplitudes were higher in adulthood. Our results demonstrate that short-term stress in adolescence induces strong effects on excitatory synaptic transmission in the prelimbic cortex and extinction of learned fear, where the effect of stress on anxiety is more persistent than on the extinction of learned fear. These data contribute to the understanding of stress neurobiology. Copyright © 2013 Elsevier B.V. All rights reserved.
ERIC Educational Resources Information Center
Hart, Genevra; Harris, Justin A.; Westbrook, R. Frederick
2010-01-01
A series of experiments used rats to study the effect of a systemic or intra-amygdala infusion of the benzodiazepine, midazolam, on learning and re-learning to inhibit context conditioned fear (freezing) responses. Rats were subjected to two context-conditioning episodes followed by extinction under drug or vehicle, or to two cycles of context…
Callaghan, Bridget L; Graham, Bronwyn M; Li, Stella; Richardson, Rick
2013-01-01
While early experiences are proposed to be important for the emergence of anxiety and other mental health problems, there is little empirical research examining the impact of such experiences on the development of emotional learning. Of the research that has been performed in this area, however, a complex picture has emerged in which the maturation of emotion circuits is influenced by the early experiences of the animal. For example, under typical laboratory rearing conditions infant rats rapidly forget learned fear associations (infantile amnesia) and express a form of extinction learning which is relapse-resistant (i.e., extinction in infant rats may be due to fear erasure). In contrast, adult rats exhibit very long-lasting memories of past learned fear associations, and express a form of extinction learning that is relapse-prone (i.e., the fear returns in a number of situations). However, when rats are reared under stressful conditions then they exhibit adult-like fear retention and extinction behaviors at an earlier stage of development (i.e., good retention of learned fear and relapse-prone extinction learning). In other words, under typical rearing conditions infant rats appear to be protected from exhibiting anxiety whereas after adverse rearing fear learning appears to make those infants more vulnerable to the later development of anxiety. While the effects of different experiences on infant rats' fear retention and extinction are becoming better documented, the mechanisms which mediate the early transition seen following stress remain unclear. Here we suggest that rearing stress may lead to an early maturation of the molecular and cellular signals shown to be involved in the closure of critical period plasticity in sensory modalities (e.g., maturation of GABAergic neurons, development of perineuronal nets), and speculate that these signals could be manipulated in adulthood to reopen infant forms of emotional learning (i.e., those that favor resilience).
Nawata, Yoko; Kitaichi, Kiyoyuki; Yamamoto, Tsuneyuki
2016-03-01
3,4-Methylenedioxymethamphetamine (MDMA), a methamphetamine (METH) derivative, exhibits METH-like actions at monoamine transporters and positive reinforcing effects in rodents and primates. The purposes of the present study were to determine whether cross-reinstatement would be observed between MDMA and METH and if the cannabinoid receptor, a receptor known to play critical roles in the brain reward system, could modulate MDMA craving. Rats were trained to press a lever for intravenous MDMA (0.3mg/infusion) or METH (0.02mg/infusion) infusions under a fixed ratio 1 schedule paired with drug-associated cues (light and tone). Following drug self-administration acquisition training, rats underwent extinction training (an infusion of saline). Reinstatement tests were performed once the extinction criteria were achieved. In MDMA-trained rats, the MDMA-priming injection (3.2mg/kg, i.p.) or re-exposure to MDMA-associated cues reinstated MDMA-seeking behavior. Additionally, a priming injection of METH (1.0mg/kg, i.p.) also reinstated MDMA-seeking behavior. In contrast, none of the MDMA doses reinstated METH-seeking behavior in the METH-trained rats. The CB1 cannabinoid receptor antagonist AM251 markedly attenuated the MDMA-seeking behaviors induced by MDMA-priming injection or re-exposure to MDMA-associated cues in a dose-dependent manner. These findings show that MDMA has obvious addictive potential for reinstating drug-seeking behavior and that METH can be an effective stimulus for reinstating MDMA-seeking behaviors. Furthermore, based on the attenuating effect of AM251 in the reinstatement of MDMA-seeking behaviors, drugs that suppress CB1 receptors may be used in treatment of MDMA dependence. Copyright © 2016. Published by Elsevier Ireland Ltd.
Galaj, Ewa; Manuszak, Monica; Babic, Sandra; Ananthan, Subramaniam; Ranaldi, Robert
2015-11-01
Because the role of dopamine (DA) D3 receptors has been investigated primarily in relation to cocaine-related behaviors little is known of the role of these receptors in heroin seeking. To investigate the effect of the selective DA D3 receptor antagonist, SR 21502, on cue-induced reinstatement of heroin seeking and heroin conditioned place preference (CPP). In experiment 1, rats were trained to self-administer intravenous heroin for 15 days followed by extinction. Following extinction animals were treated with one of several SR 21502 doses (0, 7.5, 10 or 15mg/kg) and a cue-induced reinstatement test was conducted. In experiment 2, animals were conditioned to experience heroin in one compartment of a CPP apparatus and saline in the other. On the test day animals were treated with 0, 3.75, 7.5, 10 or 15mg/kg of SR 21502 and tested for their CPP. The results from experiment 1 showed a significant dose-related reduction in cue-induced reinstatement of active lever pressing in the 7.5 and 10mg groups and an absence of the reinstatement effect in the 15mg group. In experiment 2, animals treated with vehicle or 3.75mg of SR 21502 showed significant heroin place preferences but those treated with the higher doses showed no CPP. Our findings suggest that DA D3 receptors play a significant role in heroin approach behaviors driven by conditioned stimuli. As such, we propose that SR 21502 holds potential as an effective pharmacotherapeutic agent for relapse prevention and should be studied further. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.
Effects of serotonin (5-HT)1B receptor ligands on amphetamine-seeking behavior in rats.
Miszkiel, Joanna; Przegaliński, Edmund
2013-01-01
Numerous studies have indicated that serotonin (5-HT)1B receptor ligands affect the behavioral effects of psychostimulants (cocaine, amphetamine), including the reinforcing activities of these drugs. To substantiate a role for those receptors in incentive motivation for amphetamine, we used the extinction/reinstatement model to examine the effects of the 5-HT1B receptor ligands on the reinstatement of extinguished amphetamine-seeking behavior. Rats trained to self-administer amphetamine (0.06 mg/kg/infusion) subsequently underwent the extinction procedure. These rats were then tested for the amphetamine-primed or amphetamine-associated cue-induced reinstatement of extinguished amphetamine-seeking behavior. The 5-HT1B receptor antagonist SB 216641 (5-7.5 mg/kg) attenuated the amphetamine (1.5 mg/kg)- and the amphetamine-associated cue combined with the threshold dose of amphetamine (0.5 mg/kg)-induced reinstatement of amphetamine-seeking behavior. The 5-HT1B receptor agonist CP 94253 (1.25-5 mg/kg) also inhibited the amphetamine-seeking behavior induced by amphetamine (1.5 mg/kg) but not by the cue combined with the threshold dose of amphetamine. The inhibitory effect of CP94253 on amphetamine-seeking behavior remained unaffected by the 5-HT1B receptor antagonist. Our results indicate that tonic activation of 5-HT1B receptors is involved in amphetamine- and cue-induced reinstatement of amphetamine-seeking behavior and that the inhibitory effects of 5-HT1B receptor antagonists on these phenomena are directly related to the motivational aspects of amphetamine abuse. The inhibitory effect of CP 94253 on amphetamine-seeking behavior seems to be unrelated to 5-HT1B receptor activation and may result from a general reduction of motivation.
Salience in Second Language Acquisition: Physical Form, Learner Attention, and Instructional Focus
Cintrón-Valentín, Myrna C.; Ellis, Nick C.
2016-01-01
We consider the role of physical form, prior experience, and form focused instruction (FFI) in adult language learning. (1) When presented with competing cues to interpretation, learners are more likely to attend to physically more salient cues in the input. (2) Learned attention is an associative learning phenomenon where prior-learned cues block those that are experienced later. (3) The low salience of morphosyntactic cues can be overcome by FFI, which leads learners to attend cues which might otherwise be ignored. Experiment 1 used eye-tracking to investigate how language background influences learners’ attention to morphological cues, as well as the attentional processes whereby different types of FFI overcome low cue salience, learned attention and blocking. Chinese native speakers (no L1 verb-tense morphology) viewed Latin utterances combining lexical and morphological cues to temporality under control conditions (CCs) and three types of explicit FFI: verb grammar instruction (VG), verb salience with textual enhancement (VS), and verb pretraining (VP), and their use of these cues was assessed in a subsequent comprehension test. CC participants were significantly more sensitive to the adverbs than verb morphology. Instructed participants showed greater sensitivity to the verbs. These results reveal attentional processes whereby learners’ prior linguistic experience can shape their attention toward cues in the input, and whereby FFI helps learners overcome the long-term blocking of verb-tense morphology. Experiment 2 examined the role of modality of input presentation – aural or visual – in L1 English learners’ attentional focus on morphological cues and the effectiveness of different FFI manipulations. CC participants showed greater sensitivity toward the adverb cue. FFI was effective in increasing attention to verb-tense morphology, however, the processing of morphological cues was considerably more difficult under aural presentation. From visual exposure, the FFI conditions were broadly equivalent at tuning attention to the morphology, although VP resulted in balanced attention to both cues. The effectiveness of morphological salience-raising varied across modality: VS was effective under visual exposure, but not under aural exposure. From aural exposure, only VG was effective. These results demonstrate how salience in physical form, learner attention, and instructional focus all variously affect the success of L2 acquisition. PMID:27621715
Context modulation of learned attention deployment.
Uengoer, Metin; Pearce, John M; Lachnit, Harald; Koenig, Stephan
2018-03-01
In three experiments, we investigated the contextual control of attention in human discrimination learning. In each experiment, participants initially received discrimination training in which the cues from Dimension A were relevant in Context 1 but irrelevant in Context 2, whereas the cues from Dimension B were irrelevant in Context 1 but relevant in Context 2. In Experiment 1, the same cues from each dimension were used in Contexts 1 and 2, whereas in Experiments 2 and 3, the cues from each dimension were changed across contexts. In each experiment, participants were subsequently shifted to a transfer discrimination involving novel cues from either dimension, to assess the contextual control of attention. In Experiment 1, measures of eye gaze during the transfer discrimination revealed that Dimension A received more attention than Dimension B in Context 1, whereas the reverse occurred in Context 2. Corresponding results indicating the contextual control of attention were found in Experiments 2 and 3, in which we used the speed of learning (associability) as an indirect marker of learned attentional changes. Implications of our results for current theories of learning and attention are discussed.
Lesions of the lateral habenula facilitate active avoidance learning and threat extinction.
Song, Mihee; Jo, Yong Sang; Lee, Yeon-Kyung; Choi, June-Seek
2017-02-01
The lateral habenula (LHb) is an epithalamic brain structure that provides strong projections to midbrain monoaminergic systems that are involved in motivation, emotion, and reinforcement learning. LHb neurons are known to convey information about aversive outcomes and negative prediction errors, suggesting a role in learning from aversive events. To test this idea, we examined the effects of electrolytic lesions of the LHb on signaled two-way active avoidance learning in which rats were trained to avoid an unconditioned stimulus (US) by taking a proactive shuttling response to an auditory conditioned stimulus (CS). The lesioned animals learned the avoidance response significantly faster than the control groups. In a separate experiment, we also investigated whether the LHb contributes to Pavlovian threat (fear) conditioning and extinction. Following paired presentations of the CS and the US, LHb-lesioned animals showed normal acquisition of conditioned response (CR) measured with freezing. However, extinction of the CR in the subsequent CS-only session was significantly faster. The enhanced performance in avoidance learning and in threat extinction jointly suggests that the LHb normally plays an inhibitory role in learning driven by absence of aversive outcomes. Copyright © 2016 Elsevier B.V. All rights reserved.
Chivers, Douglas P; McCormick, Mark I; Allan, Bridie J M; Ferrari, Maud C O
2016-09-09
Habitat degradation is among the top drivers of the loss of global biodiversity. This problem is particularly acute in coral reef system. Here we investigated whether coral degradation influences predator risk assessment and learning for damselfish. When in a live coral environment, Ambon damselfish were able to learn the identity of an unknown predator upon exposure to damselfish alarm cues combined with predator odour and were able to socially transmit this learned recognition to naïve conspecifics. However, in the presence of dead coral water, damselfish failed to learn to recognize the predator through alarm cue conditioning and hence could not transmit the information socially. Unlike alarm cues of Ambon damselfish that appear to be rendered unusable in degraded coral habitats, alarm cues of Nagasaki damselfish remain viable in this same environment. Nagasaki damselfish were able to learn predators through conditioning with alarm cues in degraded habitats and subsequently transmit the information socially to Ambon damselfish. Predator-prey dynamics may be profoundly affected as habitat degradation proceeds; the success of one species that appears to have compromised predation assessment and learning, may find itself reliant on other species that are seemingly unaffected by the same degree of habitat degradation.
Contextual remapping in visual search after predictable target-location changes.
Conci, Markus; Sun, Luning; Müller, Hermann J
2011-07-01
Invariant spatial context can facilitate visual search. For instance, detection of a target is faster if it is presented within a repeatedly encountered, as compared to a novel, layout of nontargets, demonstrating a role of contextual learning for attentional guidance ('contextual cueing'). Here, we investigated how context-based learning adapts to target location (and identity) changes. Three experiments were performed in which, in an initial learning phase, observers learned to associate a given context with a given target location. A subsequent test phase then introduced identity and/or location changes to the target. The results showed that contextual cueing could not compensate for target changes that were not 'predictable' (i.e. learnable). However, for predictable changes, contextual cueing remained effective even immediately after the change. These findings demonstrate that contextual cueing is adaptive to predictable target location changes. Under these conditions, learned contextual associations can be effectively 'remapped' to accommodate new task requirements.
The habenula encodes negative motivational value associated with primary punishment in humans.
Lawson, Rebecca P; Seymour, Ben; Loh, Eleanor; Lutti, Antoine; Dolan, Raymond J; Dayan, Peter; Weiskopf, Nikolaus; Roiser, Jonathan P
2014-08-12
Learning what to approach, and what to avoid, involves assigning value to environmental cues that predict positive and negative events. Studies in animals indicate that the lateral habenula encodes the previously learned negative motivational value of stimuli. However, involvement of the habenula in dynamic trial-by-trial aversive learning has not been assessed, and the functional role of this structure in humans remains poorly characterized, in part, due to its small size. Using high-resolution functional neuroimaging and computational modeling of reinforcement learning, we demonstrate positive habenula responses to the dynamically changing values of cues signaling painful electric shocks, which predict behavioral suppression of responses to those cues across individuals. By contrast, negative habenula responses to monetary reward cue values predict behavioral invigoration. Our findings show that the habenula plays a key role in an online aversive learning system and in generating associated motivated behavior in humans.
The effect of hippocampal NMDA receptor blockade by MK-801 on cued fear extinction.
Zhang, Bo; Li, Chuan-Yu; Wang, Xiu-Song
2017-08-14
Extinction of conditioned fear has been suggested to be a new form of learning instead of erasure of what was originally learned, and the process is NMDA (N-methyl d-aspartate) receptor (NMDAR) dependent. Most of studies have so far revealed the important roles of NMDARs in the amygdala and medial prefrontal cortex (mPFC) in cued fear extinction. Although the ventral hippocampus has intimately reciprocal connections with the amygdala and mPFC, the role of its NMDARs in cued fear extinction remains unclear. The present experiment explored the issue by bilateral pre-extinction microinjection of the noncompetitive NMDAR antagonist MK-801 into the ventral hippocampus. Four groups of rats were given habituation, tone cued fear conditioning, fear extinction training and extinction test. Prior to extinction training, rats received bilateral infusions of either MK-801 (1.5, 3, or 6μg/0.5μl) or saline. Our results showed that MK-801 reduced freezing on the first trial of extinction training with no impact on within-session acquisition of extinction, and that the lower doses of MK-801 resulted in increased freezing on the extinction retrieval test. These findings suggest that ventral hippocampal NMDARs are necessary for the consolidation of tone cued fear extinction. Copyright © 2017 Elsevier B.V. All rights reserved.
Amygdala subsystems and control of feeding behavior by learned cues.
Petrovich, Gorica D; Gallagher, Michela
2003-04-01
A combination of behavioral studies and a neural systems analysis approach has proven fruitful in defining the role of the amygdala complex and associated circuits in fear conditioning. The evidence presented in this chapter suggests that this approach is also informative in the study of other adaptive functions that involve the amygdala. In this chapter we present a novel model to study learning in an appetitive context. Furthermore, we demonstrate that long-recognized connections between the amygdala and the hypothalamus play a crucial role in allowing learning to modulate feeding behavior. In the first part we describe a behavioral model for motivational learning. In this model a cue that acquires motivational properties through pairings with food delivery when an animal is hungry can override satiety and promote eating in sated rats. Next, we present evidence that a specific amygdala subsystem (basolateral area) is responsible for allowing such learned cues to control eating (override satiety and promote eating in sated rats). We also show that basolateral amygdala mediates these actions via connectivity with the lateral hypothalamus. Lastly, we present evidence that the amygdalohypothalamic system is specific for the control of eating by learned motivational cues, as it does not mediate another function that depends on intact basolateral amygdala, namely, the ability of a conditioned cue to support new learning based on its acquired value. Knowledge about neural systems through which food-associated cues specifically control feeding behavior provides a defined model for the study of learning. In addition, this model may be informative for understanding mechanisms of maladaptive aspects of learned control of eating that contribute to eating disorders and more moderate forms of overeating.
Conci, Markus; Müller, Hermann J; von Mühlenen, Adrian
2013-07-09
In visual search, detection of a target is faster when it is presented within a spatial layout of repeatedly encountered nontarget items, indicating that contextual invariances can guide selective attention (contextual cueing; Chun & Jiang, 1998). However, perceptual regularities may interfere with contextual learning; for instance, no contextual facilitation occurs when four nontargets form a square-shaped grouping, even though the square location predicts the target location (Conci & von Mühlenen, 2009). Here, we further investigated potential causes for this interference-effect: We show that contextual cueing can reliably occur for targets located within the region of a segmented object, but not for targets presented outside of the object's boundaries. Four experiments demonstrate an object-based facilitation in contextual cueing, with a modulation of context-based learning by relatively subtle grouping cues including closure, symmetry, and spatial regularity. Moreover, the lack of contextual cueing for targets located outside the segmented region was due to an absence of (latent) learning of contextual layouts, rather than due to an attentional bias towards the grouped region. Taken together, these results indicate that perceptual segmentation provides a basic structure within which contextual scene regularities are acquired. This in turn argues that contextual learning is constrained by object-based selection.
Effects of Attention Cueing on Learning Speech Organ Operation through Mobile Phones
ERIC Educational Resources Information Center
Yang, Hui-Yu
2017-01-01
The studies regarding using a cross sectional view of speech organs enriched with attention cueing and written text to probe learners' learning efficiency and behavior through mobile phones is scant. The purpose of this study was to examine whether the presence of attention cueing can benefit learners with different amounts of prior knowledge in…
Infants' Selective Attention to Reliable Visual Cues in the Presence of Salient Distractors
ERIC Educational Resources Information Center
Tummeltshammer, Kristen Swan; Mareschal, Denis; Kirkham, Natasha Z.
2014-01-01
With many features competing for attention in their visual environment, infants must learn to deploy attention toward informative cues while ignoring distractions. Three eye tracking experiments were conducted to investigate whether 6- and 8-month-olds (total N = 102) would shift attention away from a distractor stimulus to learn a cue-reward…
Enhancing Learning from Dynamic and Static Visualizations by Means of Cueing
ERIC Educational Resources Information Center
Kuhl, Tim; Scheiter, Katharina; Gerjets, Peter
2012-01-01
The current study investigated whether learning from dynamic and two presentation formats for static visualizations can be enhanced by means of cueing. One hundred and fifty university students were randomly assigned to six conditions, resulting from a 2x3-design, with cueing (with/without) and type of visualization (dynamic, static-sequential,…
Environmental enrichment as a potential intervention for heroin seeking.
Galaj, E; Manuszak, M; Ranaldi, R
2016-06-01
Heroin-related cues can trigger craving and relapse in addicts or heroin seeking in rats. In the present study we investigated whether environmental enrichment (EE) implemented after heroin exposure can reduce cue-induced reinstatement of heroin seeking and expression of heroin conditioned place preference. In Experiment 1, male Long Evans rats that already acquired a heroin self-administration habit, were housed in enriched or non-enriched environments, underwent extinction training and later were tested for cue-induced reinstatement of heroin seeking. In Experiment 2, rats were conditioned with heroin in one compartment of a CPP apparatus and saline in the other, exposed to 30days of enrichment or no enrichment and were later tested for heroin CPP. The results showed that exposure to EE significantly reduced responding during the reinstatement test (Experiment 1) and prevented the expression of heroin CPP (Experiment 2). Our findings suggest that EE can be an effective behavioral approach to diminish the effects of conditioned cues on heroin seeking. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.
Keller, Samantha M; Schreiber, William B; Stanfield, Briana R; Knox, Dayan
2015-01-01
Using the single prolonged stress (SPS) animal model of post-traumatic stress disorder (PTSD), previous studies suggest that enhanced glucocorticoid receptor (GR) expression leads to cued fear extinction retention deficits. However, it is unknown how the endogenous ligand of GRs, corticosterone (CORT), may contribute to extinction retention deficits in the SPS model. Given that CORT synthesis during fear learning is critical for fear memory consolidation and SPS enhances GR expression, CORT synthesis during fear memory formation could strengthen fear memory in SPS rats by enhancing GR activation during fear learning. In turn, this could lead to cued fear extinction retention deficits. We tested the hypothesis that CORT synthesis during fear learning leads to cued fear extinction retention deficits in SPS rats by administering the CORT synthesis inhibitor metyrapone to SPS and control rats prior to fear conditioning, and observed the effect this had on extinction memory. Inhibiting CORT synthesis during fear memory formation in control rats tended to decrease cued freezing, though this effect never reached statistical significance. Contrary to our hypothesis, inhibiting CORT synthesis during fear memory formation disrupted extinction retention in SPS rats. This finding suggests that even though SPS exposure leads to cued fear extinction memory deficits, CORT synthesis during fear memory formation enhances extinction retention in SPS rats. This suggests that stress-induced CORT synthesis in previously stressed rats can be beneficial. Copyright © 2015 Elsevier B.V. All rights reserved.
Fiechter, Joshua L; Benjamin, Aaron S
2017-08-28
Retrieval practice has been shown to be a highly effective tool for enhancing memory, a fact that has led to major changes to educational practice and technology. However, when initial learning is poor, initial retrieval practice is unlikely to be successful and long-term benefits of retrieval practice are compromised or nonexistent. Here, we investigate the benefit of a scaffolded retrieval technique called diminishing-cues retrieval practice (Finley, Benjamin, Hays, Bjork, & Kornell, Journal of Memory and Language, 64, 289-298, 2011). Under learning conditions that favored a strong testing effect, diminishing cues and standard retrieval practice both enhanced memory performance relative to restudy. Critically, under learning conditions where standard retrieval practice was not helpful, diminishing cues enhanced memory performance substantially. These experiments demonstrate that diminishing-cues retrieval practice can widen the range of conditions under which testing can benefit memory, and so can serve as a model for the broader application of testing-based techniques for enhancing learning.
Persistent Prelimbic Cortex Activity Contributes to Enhanced Learned Fear Expression in Females
ERIC Educational Resources Information Center
Fenton, Georgina E.; Pollard, Amelia K.; Halliday, David M.; Mason, Rob; Bredy, Timothy W.; Stevenson, Carl W.
2014-01-01
Anxiety disorders, such as post-traumatic stress, are more prevalent in women and are characterized by impaired inhibition of learned fear and medial prefrontal cortex (mPFC) dysfunction. Here we examined sex differences in fear extinction and mPFC activity in rats. Females showed more learned fear expression during extinction and its recall, but…
Learned predictiveness and outcome predictability effects are not simply two sides of the same coin.
Thorwart, Anna; Livesey, Evan J; Wilhelm, Francisco; Liu, Wei; Lachnit, Harald
2017-10-01
The Learned Predictiveness effect refers to the observation that learning about the relationship between a cue and an outcome is influenced by the predictive relevance of the cue for other outcomes. Similarly, the Outcome Predictability effect refers to a recent observation that the previous predictability of an outcome affects learning about this outcome in new situations, too. We hypothesize that both effects may be two manifestations of the same phenomenon and stimuli that have been involved in highly predictive relationships may be learned about faster when they are involved in new relationships regardless of their functional role in predictive learning as cues and outcomes. Four experiments manipulated both the relationships and the function of the stimuli. While we were able to replicate the standard effects, they did not survive a transfer to situations where the functional role of the stimuli changed, that is the outcome of the first phase becomes a cue in the second learning phase or the cue of the first phase becomes the outcome of the second phase. Furthermore, unlike learned predictiveness, there was little indication that the distribution of overt attention in the second phase was influenced by previous predictability. The results suggest that these 2 very similar effects are not manifestations of a more general phenomenon but rather independent from each other. (PsycINFO Database Record (c) 2017 APA, all rights reserved).
Engelhard, Iris M; Leer, Arne; Lange, Emma; Olatunji, Bunmi O
2014-09-01
Learned disgust appears to play an important role in certain anxiety disorders, and can be explained by the process of evaluative conditioning, in which an affective evaluative reaction evoked by an unconditional stimulus (US) is transferred to a conditional stimulus (CS). Much remains unknown about how disgust-related evaluative learning can be effectively eliminated. Study 1 of the present investigation examined the effects of extinction on reducing the negative evaluation of a CS that was acquired during disgust conditioning. Participants completed acquisition trials, with a disgusting picture as US and two neutral pictures as CS (CS+ was paired with the US; CS- was unpaired), followed by extinction trials ("CS only"; experimental condition) or a filler task (control condition). Extinction trials reduced acquired US expectancy to the CS+, but did not extinguish negative evaluations of the CS+. Study 2 examined the effects of counterconditioning on evaluative learned disgust. After disgust acquisition trials, counterconditioning trials followed in which the CS+ was paired with a pleasant US (experimental condition) or a filler task (control condition). Counterconditioning trials reduced acquired US expectancy to the CS+ and reduced evaluative conditioned disgust. Implications of the potential differential effects of extinction and counterconditioning on evaluative learning for exposure-based treatment of specific anxiety disorders are discussed. Copyright © 2014. Published by Elsevier Ltd.