Congruency sequence effect without feature integration and contingency learning.

PubMed

Kim, Sanga; Cho, Yang Seok

2014-06-01

The magnitude of congruency effects, such as the flanker-compatibility effects, has been found to vary as a function of the congruency of the previous trial. Some studies have suggested that this congruency sequence effect is attributable to stimulus and/or response priming, and/or contingency learning, whereas other studies have suggested that the control process triggered by conflict modulates the congruency effect. The present study examined whether sequential modulation can occur without stimulus and response repetitions and contingency learning. Participants were asked to perform two color flanker-compatibility tasks alternately in a trial-by-trial manner, with four fingers of one hand in Experiment 1 and with the index and middle fingers of two hands in Experiment 2, to avoid stimulus and response repetitions and contingency learning. A significant congruency sequence effect was obtained between the congruencies of the two tasks in Experiment 1 but not in Experiment 2. These results provide evidence for the idea that the sequential modulation is, at least in part, an outcome of the top-down control process triggered by conflict, which is specific to response mode. Copyright © 2014 Elsevier B.V. All rights reserved.

Attention, awareness of contingencies, and control in spatial localization: a qualitative difference approach.

PubMed

Vaquero, Joaquín M M; Fiacconi, Chris; Milliken, Bruce

2010-12-01

The qualitative difference method for distinguishing between aware and unaware processes was applied here to a spatial priming task. Participants were asked simply to locate a target stimulus that appeared in one of four locations, and this target stimulus was preceded by a prime in one of the same four locations. The prime location predicted the location of the target with high probability (p = .75), but prime and target mismatched on a task-relevant feature (identity, color). Across 5 experiments, we observed repetition costs in the absence of awareness of the contingency, and repetition benefits in the presence of awareness of the contingency. These results were particularly clear-cut in Experiment 4, in which awareness was defined by reference to self-reported strategy use. Finally, Experiment 5 showed that frequency-based implicit learning effects were present in our experiments but that these implicit learning effects were not strong enough to override repetition costs that pushed performance in the opposite direction. The results of these experiments constitute a novel application of the qualitative difference method to the study of awareness, learning of contingencies, and strategic control.

Incidental Learning of S-R Contingencies in the Masked Prime Task

ERIC Educational Resources Information Center

Schlaghecken, Friederike; Blagrove, Elisabeth; Maylor, Elizabeth A.

2007-01-01

Subliminal motor priming effects in the masked prime paradigm can only be obtained when primes are part of the task set. In 2 experiments, the authors investigated whether the relevant task set feature needs to be explicitly instructed or could be extracted automatically in an incidental learning paradigm. Primes and targets were symmetrical…

Reward-Guided Learning with and without Causal Attribution

PubMed Central

Jocham, Gerhard; Brodersen, Kay H.; Constantinescu, Alexandra O.; Kahn, Martin C.; Ianni, Angela M.; Walton, Mark E.; Rushworth, Matthew F.S.; Behrens, Timothy E.J.

2016-01-01

Summary When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that humans deploy separable learning mechanisms that operate in parallel. While behavior was dominated by precise contingent learning, it also revealed hallmarks of noncontingent learning strategies. These learning mechanisms were separable behaviorally and neurally. Lateral orbitofrontal cortex supported contingent learning and reflected contingencies between outcomes and their causal choices. Amygdala responses around reward times related to statistical patterns of learning. Time-based heuristic mechanisms were related to activity in sensorimotor corticostriatal circuitry. Our data point to the existence of several learning mechanisms in the human brain, of which only one relies on applying known rules about the causal structure of the task. PMID:26971947

Cue competition in evaluative conditioning as a function of the learning process.

PubMed

Kattner, Florian; Green, C Shawn

2015-11-01

Evaluative conditioning (EC) is the change in the valence of a stimulus resulting from pairings with an affective (unconditioned) stimulus (US). With some exceptions, previous work has indicated that this form of conditioning might be insensitive to cue competition effects such as blocking and overshadowing. Here we assessed whether the extent of cue competition in EC depends upon the type of contingency learning during conditioning. Specifically, we contrasted a learning task that biased participants toward cognitive/inferential learning (i.e., predicting the US) with a learning task that prevented prolonged introspection (i.e., a rapid response made to the US). In all cases, standard EC effects were observed, with the subjective liking of stimuli changed in the direction of the valence of the US. More importantly, when inferential learning was likely, larger EC effects occurred for isolated stimuli than for compounds (indicating overshadowing). No blocking effects on explicit evaluations were observed for either learning task. Contingency judgments and implicit evaluations, however, were sensitive to blocking, indicating that the absence of a blocking effect on explicit evaluations might be due to inferences that occur during testing.

Flexibility to contingency changes distinguishes habitual and goal-directed strategies in humans

PubMed Central

Keramati, Mehdi

2017-01-01

Decision-making in the real world presents the challenge of requiring flexible yet prompt behavior, a balance that has been characterized in terms of a trade-off between a slower, prospective goal-directed model-based (MB) strategy and a fast, retrospective habitual model-free (MF) strategy. Theory predicts that flexibility to changes in both reward values and transition contingencies can determine the relative influence of the two systems in reinforcement learning, but few studies have manipulated the latter. Therefore, we developed a novel two-level contingency change task in which transition contingencies between states change every few trials; MB and MF control predict different responses following these contingency changes, allowing their relative influence to be inferred. Additionally, we manipulated the rate of contingency changes in order to determine whether contingency change volatility would play a role in shifting subjects between a MB and MF strategy. We found that human subjects employed a hybrid MB/MF strategy on the task, corroborating the parallel contribution of MB and MF systems in reinforcement learning. Further, subjects did not remain at one level of MB/MF behaviour but rather displayed a shift towards more MB behavior over the first two blocks that was not attributable to the rate of contingency changes but rather to the extent of training. We demonstrate that flexibility to contingency changes can distinguish MB and MF strategies, with human subjects utilizing a hybrid strategy that shifts towards more MB behavior over blocks, consequently corresponding to a higher payoff. PMID:28957319

Flexibility to contingency changes distinguishes habitual and goal-directed strategies in humans.

PubMed

Lee, Julie J; Keramati, Mehdi

2017-09-01

Decision-making in the real world presents the challenge of requiring flexible yet prompt behavior, a balance that has been characterized in terms of a trade-off between a slower, prospective goal-directed model-based (MB) strategy and a fast, retrospective habitual model-free (MF) strategy. Theory predicts that flexibility to changes in both reward values and transition contingencies can determine the relative influence of the two systems in reinforcement learning, but few studies have manipulated the latter. Therefore, we developed a novel two-level contingency change task in which transition contingencies between states change every few trials; MB and MF control predict different responses following these contingency changes, allowing their relative influence to be inferred. Additionally, we manipulated the rate of contingency changes in order to determine whether contingency change volatility would play a role in shifting subjects between a MB and MF strategy. We found that human subjects employed a hybrid MB/MF strategy on the task, corroborating the parallel contribution of MB and MF systems in reinforcement learning. Further, subjects did not remain at one level of MB/MF behaviour but rather displayed a shift towards more MB behavior over the first two blocks that was not attributable to the rate of contingency changes but rather to the extent of training. We demonstrate that flexibility to contingency changes can distinguish MB and MF strategies, with human subjects utilizing a hybrid strategy that shifts towards more MB behavior over blocks, consequently corresponding to a higher payoff.

Reinforcement Learning Deficits in People with Schizophrenia Persist after Extended Trials

PubMed Central

Cicero, David C.; Martin, Elizabeth A.; Becker, Theresa M.; Kerns, John G.

2014-01-01

Previous research suggests that people with schizophrenia have difficulty learning from positive feedback and when learning needs to occur rapidly. However, they seem to have relatively intact learning from negative feedback when learning occurs gradually. Participants are typically given a limited amount of acquisition trials to learn the reward contingencies and then tested about what they learned. The current study examined whether participants with schizophrenia continue to display these deficits when given extra time to learn the contingences. Participants with schizophrenia and matched healthy controls completed the Probabilistic Selection Task, which measures positive and negative feedback learning separately. Participants with schizophrenia showed a deficit in learning from both positive and negative feedback. These reward learning deficits persisted even if people with schizophrenia are given extra time (up to 10 blocks of 60 trials) to learn the reward contingencies. These results suggest that the observed deficits cannot be attributed solely to slower learning and instead reflect a specific deficit in reinforcement learning. PMID:25172610

Reinforcement learning deficits in people with schizophrenia persist after extended trials.

PubMed

Cicero, David C; Martin, Elizabeth A; Becker, Theresa M; Kerns, John G

2014-12-30

Previous research suggests that people with schizophrenia have difficulty learning from positive feedback and when learning needs to occur rapidly. However, they seem to have relatively intact learning from negative feedback when learning occurs gradually. Participants are typically given a limited amount of acquisition trials to learn the reward contingencies and then tested about what they learned. The current study examined whether participants with schizophrenia continue to display these deficits when given extra time to learn the contingences. Participants with schizophrenia and matched healthy controls completed the Probabilistic Selection Task, which measures positive and negative feedback learning separately. Participants with schizophrenia showed a deficit in learning from both positive feedback and negative feedback. These reward learning deficits persisted even if people with schizophrenia are given extra time (up to 10 blocks of 60 trials) to learn the reward contingencies. These results suggest that the observed deficits cannot be attributed solely to slower learning and instead reflect a specific deficit in reinforcement learning. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Confidence and psychosis: a neuro-computational account of contingency learning disruption by NMDA blockade

PubMed Central

Vinckier, F; Gaillard, R; Palminteri, S; Rigoux, L; Salvador, A; Fornito, A; Adapa, R; Krebs, M O; Pessiglione, M; Fletcher, P C

2016-01-01

A state of pathological uncertainty about environmental regularities might represent a key step in the pathway to psychotic illness. Early psychosis can be investigated in healthy volunteers under ketamine, an NMDA receptor antagonist. Here, we explored the effects of ketamine on contingency learning using a placebo-controlled, double-blind, crossover design. During functional magnetic resonance imaging, participants performed an instrumental learning task, in which cue-outcome contingencies were probabilistic and reversed between blocks. Bayesian model comparison indicated that in such an unstable environment, reinforcement learning parameters are downregulated depending on confidence level, an adaptive mechanism that was specifically disrupted by ketamine administration. Drug effects were underpinned by altered neural activity in a fronto-parietal network, which reflected the confidence-based shift to exploitation of learned contingencies. Our findings suggest that an early characteristic of psychosis lies in a persistent doubt that undermines the stabilization of behavioral policy resulting in a failure to exploit regularities in the environment. PMID:26055423

Confidence and psychosis: a neuro-computational account of contingency learning disruption by NMDA blockade.

PubMed

Vinckier, F; Gaillard, R; Palminteri, S; Rigoux, L; Salvador, A; Fornito, A; Adapa, R; Krebs, M O; Pessiglione, M; Fletcher, P C

2016-07-01

A state of pathological uncertainty about environmental regularities might represent a key step in the pathway to psychotic illness. Early psychosis can be investigated in healthy volunteers under ketamine, an NMDA receptor antagonist. Here, we explored the effects of ketamine on contingency learning using a placebo-controlled, double-blind, crossover design. During functional magnetic resonance imaging, participants performed an instrumental learning task, in which cue-outcome contingencies were probabilistic and reversed between blocks. Bayesian model comparison indicated that in such an unstable environment, reinforcement learning parameters are downregulated depending on confidence level, an adaptive mechanism that was specifically disrupted by ketamine administration. Drug effects were underpinned by altered neural activity in a fronto-parietal network, which reflected the confidence-based shift to exploitation of learned contingencies. Our findings suggest that an early characteristic of psychosis lies in a persistent doubt that undermines the stabilization of behavioral policy resulting in a failure to exploit regularities in the environment.

A mouse model of fragile X syndrome exhibits heightened arousal and/or emotion following errors or reversal of contingencies.

PubMed

Moon, J; Ota, K T; Driscoll, L L; Levitsky, D A; Strupp, B J

2008-07-01

This study was designed to further assess cognitive and affective functioning in a mouse model of Fragile X syndrome (FXS), the Fmr1(tm1Cgr) or Fmr1 "knockout" (KO) mouse. Male KO mice and wild-type littermate controls were tested on learning set and reversal learning tasks. The KO mice were not impaired in associative learning, transfer of learning, or reversal learning, based on measures of learning rate. Analyses of videotapes of the reversal learning task revealed that both groups of mice exhibited higher levels of activity and wall-climbing during the initial sessions of the task than during the final sessions, a pattern also seen for trials following an error relative to those following a correct response. Notably, the increase in both behavioral measures seen early in the task was significantly more pronounced for the KO mice than for controls, as was the error-induced increase in activity level. This pattern of effects suggests that the KO mice reacted more strongly than controls to the reversal of contingencies and pronounced drop in reinforcement rate, and to errors in general. This pattern of effects is consistent with the heightened emotional reactivity frequently described for humans with FXS. (c) 2008 Wiley Periodicals, Inc.

Fluid Intelligence and Discriminative Operant Learning of Reinforcement Contingencies in a Fixed Ratio 3 Schedule

ERIC Educational Resources Information Center

Lozano, J. H.; Hernandez, J. M.; Rubio, V. J.; Santacreu, J.

2011-01-01

Although intelligence has traditionally been identified as "the ability to learn" (Peterson, 1925), this relationship has been questioned in simple operant learning tasks (Spielberger, 1962). Nevertheless, recent pieces of research have demonstrated a strong and significant correlation between associative learning measures and intelligence…

Best not to bet on the horserace: A comment on Forrin and MacLeod (2017) and a relevant stimulus-response compatibility view of colour-word contingency learning asymmetries.

PubMed

Schmidt, James R

2018-02-01

One powerfully robust method for the study of human contingency learning is the colour-word contingency learning paradigm. In this task, participants respond to the print colour of neutral words, each of which is presented most often in one colour. The contingencies between words and colours are learned, as indicated by faster and more accurate responses when words are presented in their expected colour relative to an unexpected colour. In a recent report, Forrin and MacLeod (2017b, Memory & Cognition) asked to what extent this performance (i.e., response time) measure of learning might depend on the relative speed of processing of the word and the colour. With keypress responses, learning effects were comparable when responding to the word and to the colour (contrary to predictions). However, an asymmetry appeared in a second experiment with vocal responses, with a contingency effect only present for colour identification. In a third experiment, the colour was preexposed, and contingency effects were again roughly symmetrical. In their report, they suggested that a simple speed-of-processing (or "horserace") model might explain when contingency effects are observed in colour and word identification. In the present report, an alternative view is presented. In particular, it is argued that the results are best explained by appealing to the notion of relevant stimulus-response compatibility, which also resolves discrepancies between horserace model predictions and participant results. The article presents simulations with the Parallel Episodic Processing model to demonstrate this case.

Impaired awareness of action-outcome contingency and causality during healthy ageing and following ventromedial prefrontal cortex lesions.

PubMed

O'Callaghan, Claire; Vaghi, Matilde M; Brummerloh, Berit; Cardinal, Rudolf N; Robbins, Trevor W

2018-02-02

Detecting causal relationships between actions and their outcomes is fundamental to guiding goal-directed behaviour. The ventromedial prefrontal cortex (vmPFC) has been extensively implicated in computing these environmental contingencies, via animal lesion models and human neuroimaging. However, whether the vmPFC is critical for contingency learning, and whether it can occur without subjective awareness of those contingencies, has not been established. To address this, we measured response adaption to contingency and subjective awareness of action-outcome relationships in individuals with vmPFC lesions and healthy elderly subjects. We showed that in both vmPFC damage and ageing, successful behavioural adaptation to variations in action-outcome contingencies was maintained, but subjective awareness of these contingencies was reduced. These results highlight two contexts where performance and awareness have been dissociated, and show that learning response-outcome contingencies to guide behaviour can occur without subjective awareness. Preserved responding in the vmPFC group suggests that this region is not critical for computing action-outcome contingencies to guide behaviour. In contrast, our findings highlight a critical role for the vmPFC in supporting awareness, or metacognitive ability, during learning. We further advance the hypothesis that responding to changing environmental contingencies, whilst simultaneously maintaining conscious awareness of those statistical regularities, is a form of dual-tasking that is impaired in ageing due to reduced prefrontal function. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

Technological Change and HRD. Symposium.

ERIC Educational Resources Information Center

2002

This document contains three papers from a symposium on technological change and human resource development. "New Technologies, Cognitive Demands, and the Implications for Learning Theory" (Richard J. Torraco) identifies four specific characteristics of the tasks involved in using new technologies (contingent versus deterministic tasks,…

Infant Contingency Learning in Different Cultural Contexts

ERIC Educational Resources Information Center

Graf, Frauke; Lamm, Bettina; Goertz, Claudia; Kolling, Thorsten; Freitag, Claudia; Spangler, Sibylle; Fassbender, Ina; Teubert, Manuel; Vierhaus, Marc; Keller, Heidi; Lohaus, Arnold; Schwarzer, Gudrun; Knopf, Monika

2012-01-01

Three-month-old Cameroonian Nso farmer and German middle-class infants were compared regarding learning and retention in a computerized mobile task. Infants achieving a preset learning criterion during reinforcement were tested for immediate and long-term retention measured in terms of an increased response rate after reinforcement and after a…

Is it what you do, or when you do it? The roles of contingency and similarity in pro-social effects of imitation.

PubMed

Catmur, Caroline; Heyes, Cecilia

2013-01-01

Being imitated has a wide range of pro-social effects, but it is not clear how these effects are mediated. Naturalistic studies of the effects of being imitated have not established whether pro-social outcomes are due to the similarity and/or the contingency between the movements performed by the actor and those of the imitator. Similarity is often assumed to be the active ingredient, but we hypothesized that contingency might also be important, as it produces positive affect in infants and can be detected by phylogenetically ancient mechanisms of associative learning. We manipulated similarity and contingency between performed and observed actions in a computerized task. Similarity had no positive effects; however, contingency resulted in greater enjoyment of the task, reported closeness to others, and helping behavior. These results suggest that the pro-social effects of being imitated may rely on associative mechanisms. Copyright © 2013 Cognitive Science Society, Inc.

Psychophysics of associative learning: Quantitative properties of subjective contingency.

PubMed

Maia, Susana; Lefèvre, Françoise; Jozefowiez, Jérémie

2018-01-01

Allan and collaborators (Allan, Hannah, Crump, & Siegel, 2008; Allan, Siegel, & Tangen, 2005; Siegel, Allan, Hannah, & Crump, 2009) recently proposed to apply signal detection theory to the analysis of contingency judgment tasks. When exposed to a flow of stimuli, participants are asked to judge whether there is a contingent relation between a cue and an outcome, that is, whether the subjective cue-outcome contingency exceeds a decision threshold. In this context, we tested the following hypotheses regarding the relation between objective and subjective cue-outcome contingency: (a) The underlying distributions of subjective cue-outcome contingency are Gaussian; (b) The mean distribution of subjective contingency is a linear function of objective cue-outcome contingency; and (c) The variance in the distribution of subjective contingency is constant. The hypotheses were tested by combining a streamed-trial contingency assessment task with a confidence rating procedure. Participants were exposed to rapid flows of stimuli at the end of which they had to judge whether an outcome was more (Experiment 1) or less (Experiment 2) likely to appear following a cue and how sure they were of their judgment. We found that although Hypothesis A seems reasonable, Hypotheses B and C were not. Regarding Hypothesis B, participants were more sensitive to positive than to negative contingencies. Regarding Hypothesis C, the perceived cue-outcome contingency became more variable when the contingency became more positive or negative, but only to a slight extent. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

The congruency sequence effect 3.0: a critical test of conflict adaptation.

PubMed

Duthoo, Wout; Abrahamse, Elger L; Braem, Senne; Boehler, C Nico; Notebaert, Wim

2014-01-01

Over the last two decades, the congruency sequence effect (CSE) -the finding of a reduced congruency effect following incongruent trials in conflict tasks- has played a central role in advancing research on cognitive control. According to the influential conflict-monitoring account, the CSE reflects adjustments in selective attention that enhance task focus when needed, often termed conflict adaptation. However, this dominant interpretation of the CSE has been called into question by several alternative accounts that stress the role of episodic memory processes: feature binding and (stimulus-response) contingency learning. To evaluate the notion of conflict adaptation in accounting for the CSE, we construed versions of three widely used experimental paradigms (the colour-word Stroop, picture-word Stroop and flanker task) that effectively control for feature binding and contingency learning. Results revealed that a CSE can emerge in all three tasks. This strongly suggests a contribution of attentional control to the CSE and highlights the potential of these unprecedentedly clean paradigms for further examining cognitive control.

On the limits of statistical learning: Intertrial contextual cueing is confined to temporally close contingencies.

PubMed

Thomas, Cyril; Didierjean, André; Maquestiaux, François; Goujon, Annabelle

2018-04-12

Since the seminal study by Chun and Jiang (Cognitive Psychology, 36, 28-71, 1998), a large body of research based on the contextual-cueing paradigm has shown that the cognitive system is capable of extracting statistical contingencies from visual environments. Most of these studies have focused on how individuals learn regularities found within an intratrial temporal window: A context predicts the target position within a given trial. However, Ono, Jiang, and Kawahara (Journal of Experimental Psychology, 31, 703-712, 2005) provided evidence of an intertrial implicit-learning effect when a distractor configuration in preceding trials N - 1 predicted the target location in trials N. The aim of the present study was to gain further insight into this effect by examining whether it occurs when predictive relationships are impeded by interfering task-relevant noise (Experiments 2 and 3) or by a long delay (Experiments 1, 4, and 5). Our results replicated the intertrial contextual-cueing effect, which occurred in the condition of temporally close contingencies. However, there was no evidence of integration across long-range spatiotemporal contingencies, suggesting a temporal limitation of statistical learning.

Unaltered radial maze performance and brain acetylcholine of the endothelial nitric oxide synthase knockout mouse.

PubMed

Dere, E; Frisch, C; De Souza Silva, M A; Gödecke, A; Schrader, J; Huston, J P

2001-01-01

Proceeding from previous findings of a beneficial effect of endothelial nitric oxide synthase (eNOS) gene inactivation on negatively reinforced water maze performance, we asked whether this improvement in place learning capacities also holds for a positively reinforced radial maze task. Unlike its beneficial effects on the water maze task, eNOS gene inactivation did not facilitate radial maze performance. The acquisition performance over the days of place learning did not differ between eNOS knockout (eNOS-/-) and wild-type mice (eNOS+/+). eNOS-/- mice displayed a slight and eNOS+/+ mice a more severe working memory deficit in the place learning version of the radial maze compared to the genetic background C57BL/6 strain. Possible differential effects of eNOS inactivation, related to differences in reinforcement contingencies between the Morris water maze and radial maze tasks, behavioral strategy requirements, or to different emotional and physiological concomitants inherent in the two tasks are discussed. These task-unique characteristics might be differentially affected by the reported anxiogenic and hypertensional effects of eNOS gene inactivation. Post-mortem determination of acetylcholine concentrations in diverse brain structures revealed that acetylcholine and choline contents were not different between eNOS-/- and eNOS+/+ mice, but were increased in eNOS+/+ mice compared to C57BL/6 mice in the frontal cortex. Our findings demonstrate that phenotyping of learning and memory capacities should not rely on one learning task only, but should include tasks employing both negative and positive reinforcement contingencies in order to allow valid statements regarding differences in learning capacities between rodent strains.

Examining the Effects of Technology Attributes on Learning: A Contingency Perspective

ERIC Educational Resources Information Center

Nicholson, Jennifer; Nicholson, Darren; Valacich, Joseph S.

2008-01-01

In today's knowledge economy, technology is utilized more than ever to deliver instructional material to the learner. Nonetheless, information may not always be presented in a manner that maximizes the learning experience, resulting in a negative impact on learning outcomes. Drawing on the Task-Technology Fit model, a research framework was…

Probabilistic reversal learning is impaired in Parkinson's disease

PubMed Central

Peterson, David A.; Elliott, Christian; Song, David D.; Makeig, Scott; Sejnowski, Terrence J.; Poizner, Howard

2009-01-01

In many everyday settings, the relationship between our choices and their potentially rewarding outcomes is probabilistic and dynamic. In addition, the difficulty of the choices can vary widely. Although a large body of theoretical and empirical evidence suggests that dopamine mediates rewarded learning, the influence of dopamine in probabilistic and dynamic rewarded learning remains unclear. We adapted a probabilistic rewarded learning task originally used to study firing rates of dopamine cells in primate substantia nigra pars compacta (Morris et al. 2006) for use as a reversal learning task with humans. We sought to investigate how the dopamine depletion in Parkinson's disease (PD) affects probabilistic reward learning and adaptation to a reversal in reward contingencies. Over the course of 256 trials subjects learned to choose the more favorable from among pairs of images with small or large differences in reward probabilities. During a subsequent otherwise identical reversal phase, the reward probability contingencies for the stimuli were reversed. Seventeen Parkinson's disease (PD) patients of mild to moderate severity were studied off of their dopaminergic medications and compared to 15 age-matched controls. Compared to controls, PD patients had distinct pre- and post-reversal deficiencies depending upon the difficulty of the choices they had to learn. The patients also exhibited compromised adaptability to the reversal. A computational model of the subjects’ trial-by-trial choices demonstrated that the adaptability was sensitive to the gain with which patients weighted pre-reversal feedback. Collectively, the results implicate the nigral dopaminergic system in learning to make choices in environments with probabilistic and dynamic reward contingencies. PMID:19628022

Chronic pain impairs cognitive flexibility and engages novel learning strategies in rats.

PubMed

Cowen, Stephen L; Phelps, Caroline E; Navratilova, Edita; McKinzie, David L; Okun, Alec; Husain, Omar; Gleason, Scott D; Witkin, Jeffrey M; Porreca, Frank

2018-03-22

Cognitive flexibility, the ability to adapt behavior to changing outcomes, is critical for survival. The prefrontal cortex is a key site of cognitive control and chronic pain is known to lead to significant morphological changes to this brain region. Nevertheless, the effects of chronic pain on cognitive flexibility and learning remain uncertain. We used an instrumental paradigm to assess adaptive learning in an experimental model of chronic pain induced by tight ligation of the spinal nerves L5/6 (SNL model). Naïve, sham-operated, and SNL rats were trained to perform fixed-ratio, variable-ratio, and contingency-shift behaviors for food reward. Although all groups learned an initial lever-reward contingency, learning was slower in SNL animals in a subsequent choice task that reversed reinforcement contingencies. Temporal analysis of lever-press responses across sessions indicated no apparent deficits in memory consolidation or retrieval. However, analysis of learning within sessions revealed that the lever presses of SNL animals occurred in bursts followed by delays. Unexpectedly, the degree of bursting correlated positively with learning. Under a variable-ratio probabilistic task, SNL rats chose a less profitable behavioral strategy compared to naïve and sham-operated animals. Following extinction of behavior for learned preferences, SNL animals reverted to their initially preferred (i.e., less profitable) behavioral choice. Our data suggest, that in the face of uncertainty, chronic pain drives a preference for familiar associations, consistent with reduced cognitive flexibility. The observed burst-like responding may represent a novel learning strategy in animals with chronic pain.

Causal judgment from contingency information: relation between subjective reports and individual tendencies in judgment.

PubMed

White, P A

2000-04-01

In two experiments, participants made causal judgments from contingency information for problems with different objective contingencies. After the judgment task, the participants reported how their judgments had changed following each type of contingency information. Some reported idiosyncratic tendencies--in other words, tendencies contrary to those expected under associative-learning and normative rule induction models of contingency judgment. These idiosyncratic reports tended to be better predictors of the judgments of those who made them than did the models. The results are consistent with the view that causal judgment from contingency information is made, at least in part, by deliberative use of acquired and sometimes idiosyncratic notions of evidential value, the outcomes of which tend, in aggregate, to be highly correlated with the outcomes of normative procedures.

The influence of the number of relevant causes on the processing of covariation information in causal reasoning.

PubMed

Kim, Kyungil; Markman, Arthur B; Kim, Tae Hoon

2016-11-01

Research on causal reasoning has focused on the influence of covariation between candidate causes and effects on causal judgments. We suggest that the type of covariation information to which people attend is affected by the task being performed. For this, we manipulated the test questions for the evaluation of contingency information and observed its influence on both contingency learning and subsequent causal selections. When people select one cause related to an effect, they focus on conditional contingencies assuming the absence of alternative causes. When people select two causes related to an effect, they focus on conditional contingencies assuming the presence of alternative causes. We demonstrated this use of contingency information in four experiments.

Implicit learning and emotional responses in nine-month-old infants.

PubMed

Angulo-Barroso, Rosa M; Peciña, Susana; Lin, Xu; Li, Mingyan; Sturza, Julia; Shao, Jie; Lozoff, Betsy

2017-08-01

To study the interplay between motor learning and emotional responses of young infants, we developed a contingent learning paradigm that included two related, difficult, operant tasks. We also coded facial expression to characterise emotional response to learning. In a sample of nine-month-old healthy Chinese infants, 44.7% achieved learning threshold during this challenging arm-conditioning test. Some evidence of learning was observed at the beginning of the second task. The lowest period of negative emotions coincided with the period of maximum movement responses after the initiation of the second task, and movement responses negatively correlated with the frequency of negative emotions. Positive emotions, while generally low throughout the task, increased during peak performance especially for learners. Peak frequency of movement responses was positively correlated with the frequency of positive emotions. Despite the weak evidence of learning this difficult task, our results from the learners would suggest that increasing positive emotions, and perhaps down-regulating negative emotional responses, may be important for improving performance and learning a complex operant task in infancy. Further studies are necessary to determine the role of emotions in learning difficult tasks in infancy.

Dynamic Changes in Acetylcholine Output in the Medial Striatum during Place Reversal Learning

ERIC Educational Resources Information Center

Ragozzino, Michael E.; Choi, Daniel

2004-01-01

The present studies explored the role of the medial striatum in learning when task contingencies change. Experiment 1 examined whether the medial striatum is involved in place reversal learning. Testing occurred in a modified cross-maze across two consecutive sessions. Injections of the local anesthetic, bupivacaine, into the medial striatum, did…

The Relevance of the Nature of Learned Associations for the Differentiation of Human Memory Systems

ERIC Educational Resources Information Center

Rose, Michael; Haider, Hilde; Weiller, Cornelius; Buchel, Christian

2004-01-01

In a previous functional magnetic resonance imaging (fMRI) study we demonstrated an involvement of the medial temporal lobe (MTL) during an implicit learning task. We concluded that the MTL was engaged because of the complex contingencies that were implicitly learned. In addition, the basal ganglia demonstrated effects of a paralleled…

Normative and descriptive accounts of the influence of power and contingency on causal judgement.

PubMed

Perales, José C; Shanks, David R

2003-08-01

The power PC theory (Cheng, 1997) is a normative account of causal inference, which predicts that causal judgements are based on the power p of a potential cause, where p is the cause-effect contingency normalized by the base rate of the effect. In three experiments we demonstrate that both cause-effect contingency and effect base-rate independently affect estimates in causal learning tasks. In Experiment 1, causal strength judgements were directly related to power p in a task in which the effect base-rate was manipulated across two positive and two negative contingency conditions. In Experiments 2 and 3 contingency manipulations affected causal estimates in several situations in which power p was held constant, contrary to the power PC theory's predictions. This latter effect cannot be explained by participants' conflation of reliability and causal strength, as Experiment 3 demonstrated independence of causal judgements and confidence. From a descriptive point of view, the data are compatible with Pearce's (1987) model, as well as with several other judgement rules, but not with the Rescorla-Wagner (Rescorla & Wagner, 1972) or power PC models.

Coordinated Acetylcholine Release in Prefrontal Cortex and Hippocampus Is Associated with Arousal and Reward on Distinct Timescales.

PubMed

Teles-Grilo Ruivo, Leonor M; Baker, Keeley L; Conway, Michael W; Kinsley, Peter J; Gilmour, Gary; Phillips, Keith G; Isaac, John T R; Lowry, John P; Mellor, Jack R

2017-01-24

Cholinergic neurotransmission throughout the neocortex and hippocampus regulates arousal, learning, and attention. However, owing to the poorly characterized timing and location of acetylcholine release, its detailed behavioral functions remain unclear. Using electrochemical biosensors chronically implanted in mice, we made continuous measurements of the spatiotemporal dynamics of acetylcholine release across multiple behavioral states. We found that tonic levels of acetylcholine release were coordinated between the prefrontal cortex and hippocampus and maximal during training on a rewarded working memory task. Tonic release also increased during REM sleep but was contingent on subsequent wakefulness. In contrast, coordinated phasic acetylcholine release occurred only during the memory task and was strongly localized to reward delivery areas without being contingent on trial outcome. These results show that coordinated acetylcholine release between the prefrontal cortex and hippocampus is associated with reward and arousal on distinct timescales, providing dual mechanisms to support learned behavior acquisition during cognitive task performance. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

The Congruency Sequence Effect 3.0: A Critical Test of Conflict Adaptation

PubMed Central

Duthoo, Wout; Abrahamse, Elger L.; Braem, Senne; Boehler, C. Nico; Notebaert, Wim

2014-01-01

Over the last two decades, the congruency sequence effect (CSE) –the finding of a reduced congruency effect following incongruent trials in conflict tasks– has played a central role in advancing research on cognitive control. According to the influential conflict-monitoring account, the CSE reflects adjustments in selective attention that enhance task focus when needed, often termed conflict adaptation. However, this dominant interpretation of the CSE has been called into question by several alternative accounts that stress the role of episodic memory processes: feature binding and (stimulus-response) contingency learning. To evaluate the notion of conflict adaptation in accounting for the CSE, we construed versions of three widely used experimental paradigms (the colour-word Stroop, picture-word Stroop and flanker task) that effectively control for feature binding and contingency learning. Results revealed that a CSE can emerge in all three tasks. This strongly suggests a contribution of attentional control to the CSE and highlights the potential of these unprecedentedly clean paradigms for further examining cognitive control. PMID:25340396

Contingency Training Alters Neurobiological Components of Emotional Resilience in Male and Female Rats.

PubMed

Kent, M; Scott, S; Lambert, S; Kirk, E; Terhune-Cotter, B; Thompson, B; Neal, S; Dozier, B; Bardi, M; Lambert, K

2018-06-19

Prior research with a rat model of behavioral therapy [i.e., effort-based reward (EBR) contingency training] suggests that strengthened associations between physical effort and desired outcomes enhance neurobiological indices of resilience. In the current study, male and female Long-Evans rats were exposed to either six weeks of EBR training or noncontingent training prior to 10 days of exposure to chronic unpredictable stress (CUS). Subsequently, all animals were exposed to a problem-solving task and then trained in a spatial learning/foraging task, the Dry Land Maze (DLM). Following habituation training and test trials, rats were assessed in a probe trial that generated a prediction error (cognitive uncertainty). Results indicated that, during CUS exposure, contingency-training enhanced dehydroepiandrosterone/corticosterone ratios (consistent with healthier stress responses), especially in male rats. Additionally, contingency training increased exploratory behaviors in the probe trial as well as differentially influenced on-task problem-solving performance in males and females. Following the probe trial, brains were exposed to histological analyses to determine the effects of sex and contingency training on various neurobiological markers. Contingency training decreased BDNF-immunoreactivity (ir) in the hippocampus CA1 and lateral habenula, implicating differential neuroplasticity responses in the training groups. Further, coordinated fos-ir activation in areas associated with emotional resilience (i.e., motivation-regulation) was observed in contingent-trained animals. In sum, the current findings confirm that behavioral training is associated with neurobiological markers of emotional resilience; however, further assessments are necessary to more accurately determine the therapeutic potential for the EBR contingency training model. Copyright © 2018 IBRO. Published by Elsevier Ltd. All rights reserved.

Contingency learning deficits and generalization in chronic unilateral hand pain patients.

PubMed

Meulders, Ann; Harvie, Daniel S; Bowering, Jane K; Caragianis, Suzanne; Vlaeyen, Johan W S; Moseley, G Lorimer

2014-10-01

Contingency learning, in particular the formation of danger beliefs, underpins conditioned fear and avoidance behavior, yet equally important is the formation of safety beliefs. That is, when threat beliefs and accompanying fear/avoidance spread to technically safe cues, it might cause disability. Indeed, such over generalization has been advanced as a trans-diagnostic pathologic marker, but it has not been investigated in chronic pain. Using a novel hand pain scenario contingency learning task, we tested the hypotheses that chronic hand pain patients demonstrate less differential pain expectancy judgments because of poor safety learning and demonstrate broader generalization gradients than healthy controls. Participants viewed digitized 3-dimensional hands in different postures presented in random order (conditioned stimulus [CS]) and rated the likelihood that a fictive patient would feel pain when moving the hand into that posture. Subsequently, the outcome (pain/no pain) was presented on the screen. One hand posture was followed by pain (CS+), another was not (CS-). Generalization was tested using novel hand postures (generalization stimuli) that varied in how similar they were to the original conditioned stimuli. Patients, but not healthy controls, demonstrated a contingency learning deficit determined by impaired safety learning, but not by exaggerated pain expectancy toward the CS+. Patients showed flatter, asymmetric generalization gradients than the healthy controls did, with higher pain expectancy for novel postures that were more similar to the original CS-. The results clearly uphold our hypotheses and suggest that contingency learning deficits might be important in the development and maintenance of the chronic pain-related disability. Chronic hand pain patients demonstrate 1) reduced differential contingency learning determined by a lack of safety belief formation, but not by exaggerated threat belief formation, and 2) flatter, asymmetric generalization gradients than the healthy controls. Copyright © 2014 American Pain Society. Published by Elsevier Inc. All rights reserved.

Antecedences to Continued Intentions of Adopting E-Learning System in Blended Learning Instruction: A Contingency Framework Based on Models of Information System Success and Task-Technology Fit

ERIC Educational Resources Information Center

Lin, Wen-Shan; Wang, Chun-Hsien

2012-01-01

The objective of this study is to propose a research framework that investigates the relation between perceived fit and system factors that can motivate learners in continuing utilizing an e-learning system in blended learning instruction. As learners have the face-to-face learning opportunity in interacting with lecturers, the study aims at…

Chronic cocaine but not chronic amphetamine use is associated with perseverative responding in humans

PubMed Central

Roiser, Jonathan P.; Robbins, Trevor W.; Sahakian, Barbara J.

2013-01-01

Rationale Chronic drug use has been associated with increased impulsivity and maladaptive behaviour, but the underlying mechanisms of this impairment remain unclear. We investigated the ability to adapt behaviour according to changes in reward contingencies, using a probabilistic reversal-learning task, in chronic drug users and controls. Materials and methods Five groups were compared: chronic amphetamine users (n = 30); chronic cocaine users (n = 27); chronic opiate users (n = 42); former drug users of psychostimulants and opiates (n = 26); and healthy non-drug-taking control volunteers (n = 25). Participants had to make a forced choice between two alternative stimuli on each trial to acquire a stimulus–reward association on the basis of degraded feedback and subsequently to reverse their responses when the reward contingencies changed. Results Chronic cocaine users demonstrated little behavioural change in response to the change in reward contingencies, as reflected by perseverative responding to the previously rewarded stimulus. Perseverative responding was observed in cocaine users regardless of whether they completed the reversal stage successfully. Task performance in chronic users of amphetamines and opiates, as well as in former drug users, was not measurably impaired. Conclusion Our findings provide convincing evidence for response perseveration in cocaine users during probabilistic reversal-learning. Pharmacological differences between amphetamine and cocaine, in particular their respective effects on the 5-HT system, may account for the divergent task performance between the two psychostimulant user groups. The inability to reverse responses according to changes in reinforcement contingencies may underlie the maladaptive behaviour patterns observed in chronic cocaine users but not in chronic users of amphetamines or opiates. PMID:18214445

Diurnal rhythms in psychological reward functioning in healthy young men: 'Wanting', liking, and learning.

PubMed

Byrne, Jamie E M; Murray, Greg

2017-01-01

A range of evidence suggests that human reward functioning is partly driven by the endogenous circadian system, generating 24-hour rhythms in behavioural measures of reward activation. Reward functioning is multifaceted but literature to date is largely limited to measures of self-reported positive mood states. The aim of this study was to advance the field by testing for hypothesised diurnal variation in previously unexplored components of psychological reward: 'wanting', liking, and learning using subjective and behavioural measures. Risky decision making (automatic Balloon Analogue Risk Task), affective responsivity to positive images (International Affective Pictures System), uncued self-reported discrete emotions, and learning-contingent reward (Iowa Gambling Task) were measured at 10.00 hours, 14.00 hours, and 19.00 hours in a counterbalanced repeated measures design with 50 healthy male participants (aged 18-30). As hypothesised, risky decision making (unconscious 'wanting') and ratings of arousal towards positive images (conscious wanting) exhibited a diurnal waveform with indices highest at 14.00 hours. No diurnal rhythm was observed for liking (pleasure ratings to positive images, discrete uncued positive emotions) or in a learning-contingent reward task. Findings reaffirm that diurnal variation in human reward functioning is most pronounced in the motivational 'wanting' components of reward.

Variable Behavior and Repeated Learning in Two Mouse Strains: Developmental and Genetic Contributions.

PubMed

Arnold, Megan A; Newland, M Christopher

2018-06-16

Behavioral inflexibility is often assessed using reversal learning tasks, which require a relatively low degree of response variability. No studies have assessed sensitivity to reinforcement contingencies that specifically select highly variable response patterns in mice, let alone in models of neurodevelopmental disorders involving limited response variation. Operant variability and incremental repeated acquisition (IRA) were used to assess unique aspects of behavioral variability of two mouse strains: BALB/c, a model of some deficits in ASD, and C57Bl/6. On the operant variability task, BALB/c mice responded more repetitively during adolescence than C57Bl/6 mice when reinforcement did not require variability but responded more variably when reinforcement required variability. During IRA testing in adulthood, both strains acquired an unchanging, performance sequence equally well. Strain differences emerged, however, after novel learning sequences began alternating with the performance sequence: BALB/c mice substantially outperformed C57Bl/6 mice. Using litter-mate controls, it was found that adolescent experience with variability did not affect either learning or performance on the IRA task in adulthood. These findings constrain the use of BALB/c mice as a model of ASD, but once again reveal this strain is highly sensitive to reinforcement contingencies and they are fast and robust learners. Copyright © 2018. Published by Elsevier B.V.

An Onboard ISS Virtual Reality Trainer

NASA Technical Reports Server (NTRS)

Miralles, Evelyn

2013-01-01

Prior to the retirement of the Space Shuttle, many exterior repairs on the International Space Station (ISS) were carried out by shuttle astronauts, trained on the ground and flown to the Station to perform these specific repairs. With the retirement of the shuttle, this is no longer an available option. As such, the need for ISS crew members to review scenarios while on flight, either for tasks they already trained for on the ground or for contingency operations has become a very critical issue. NASA astronauts prepare for Extra-Vehicular Activities (EVA) or Spacewalks through numerous training media, such as: self-study, part task training, underwater training in the Neutral Buoyancy Laboratory (NBL), hands-on hardware reviews and training at the Virtual Reality Laboratory (VRLab). In many situations, the time between the last session of a training and an EVA task might be 6 to 8 months. EVA tasks are critical for a mission and as time passes the crew members may lose proficiency on previously trained tasks and their options to refresh or learn a new skill while on flight are limited to reading training materials and watching videos. In addition, there is an increased need for unplanned contingency repairs to fix problems arising as the Station ages. In order to help the ISS crew members maintain EVA proficiency or train for contingency repairs during their mission, the Johnson Space Center's VRLab designed an immersive ISS Virtual Reality Trainer (VRT). The VRT incorporates a unique optical system that makes use of the already successful Dynamic On-board Ubiquitous Graphics (DOUG) software to assist crew members with procedure reviews and contingency EVAs while on board the Station. The need to train and re-train crew members for EVAs and contingency scenarios is crucial and extremely demanding. ISS crew members are now asked to perform EVA tasks for which they have not been trained and potentially have never seen before. The Virtual Reality Trainer (VRT) provides an immersive 3D environment similar to the one experienced at the VRLab crew training facility at the NASA Johnson Space Center. VRT bridges the gap by allowing crew members to experience an interactive, 3D environment to reinforce skills already learned and to explore new work sites and repair procedures outside the Station.

The Parallel Episodic Processing (PEP) model 2.0: A single computational model of stimulus-response binding, contingency learning, power curves, and mixing costs.

PubMed

Schmidt, James R; De Houwer, Jan; Rothermund, Klaus

2016-12-01

The current paper presents an extension of the Parallel Episodic Processing model. The model is developed for simulating behaviour in performance (i.e., speeded response time) tasks and learns to anticipate both how and when to respond based on retrieval of memories of previous trials. With one fixed parameter set, the model is shown to successfully simulate a wide range of different findings. These include: practice curves in the Stroop paradigm, contingency learning effects, learning acquisition curves, stimulus-response binding effects, mixing costs, and various findings from the attentional control domain. The results demonstrate several important points. First, the same retrieval mechanism parsimoniously explains stimulus-response binding, contingency learning, and practice effects. Second, as performance improves with practice, any effects will shrink with it. Third, a model of simple learning processes is sufficient to explain phenomena that are typically (but perhaps incorrectly) interpreted in terms of higher-order control processes. More generally, we argue that computational models with a fixed parameter set and wider breadth should be preferred over those that are restricted to a narrow set of phenomena. Copyright © 2016 Elsevier Inc. All rights reserved.

On the role of attention in generating explicit awareness of contingent relations: evidence from spatial priming.

PubMed

Fiacconi, Chris M; Milliken, Bruce

2011-12-01

In a series of four experiments, we examine the hypothesis that selective attention is crucial for the generation of conscious knowledge of contingency information. We investigated this question using a spatial priming task in which participants were required to localize a target letter in a probe display. In Experiment 1, participants kept track of the frequency with which the predictive letter in the prime appeared in various locations. This manipulation had a negligible impact on contingency awareness. Subsequent experiments requiring participants to attend to features (color, location) of the predictive letter increased contingency awareness somewhat, but there remained a large proportion of individuals who remained unaware of the strong contingency. Together the results of our experiments suggest that the construct of attention does not fully capture the processes that lead to contingency awareness, and suggest a critical role for bottom-up feature integration in explicit contingency learning. Copyright © 2011 Elsevier Inc. All rights reserved.

The Effects of Training Contingency Awareness During Attention Bias Modification on Learning and Stress Reactivity.

PubMed

Lazarov, Amit; Abend, Rany; Seidner, Shiran; Pine, Daniel S; Bar-Haim, Yair

2017-09-01

Current attention bias modification (ABM) procedures are designed to implicitly train attention away from threatening stimuli with the hope of reducing stress reactivity and anxiety symptoms. However, the mechanisms underlying effective ABM delivery are not well understood, with awareness of the training contingency suggested as one possible factor contributing to ABM efficacy. Here, 45 high-anxious participants were trained to divert attention away from threat in two ABM sessions. They were randomly assigned to one of three training protocols: an implicit protocol, comprising two standard implicit ABM training sessions; an explicit protocol, comprising two sessions with explicit instruction as to the attention training contingency; and an implicit-explicit protocol, in which participants were not informed of the training contingency in the first ABM session and informed of it at the start of the second session. We examined learning processes and stress reactivity following a stress-induction task. Results indicate that relative to implicit instructions, explicit instructions led to stronger learning during the first training session. Following rest, the explicit and implicit groups exhibited consolidation-related improvement in performance, whereas no such improvement was noted for the implicit-explicit group. Finally, although stress reactivity was reduced after training, contingency awareness did not yield a differential effect on stress reactivity measured using both self-reports and skin conductance, within and across sessions. These results suggest that explicit ABM administration leads to greater initial learning during the training protocol while not differing from standard implicit administration in terms of off-line learning and stress reactivity. Copyright © 2017. Published by Elsevier Ltd.

ATC contingency operations in the en-route flight regime

NASA Technical Reports Server (NTRS)

Lyman, E. G.

1981-01-01

Air traffic control (ATC) operations were examined to learn what factors of controller performance should be given consideration in the design and development of future automation systems enhancing ATC. Contingencies were of two types: those constraining airspace usage or traffic flow (i.e., weather); and those related to system and equipment usage (i.e., radar/radio status). Examination of controller response to contingencies and workload pressures showed differing effects on controller allocations of effort among the three primary function of planning, monitoring, and informaton transfer. Automation advancements oriented towards aiding the controller in performing monitoring tasks may offer the most substantial safety benefit.

Role Played by the Passage of Time in Reversal Learning.

PubMed

Goarin, Estelle H F; Lingawi, Nura W; Laurent, Vincent

2018-01-01

Reversal learning is thought to involve an extinction-like process that inhibits the expression of the initial learning. However, behavioral evidence for this inhibition remains difficult to interpret as various procedures have been employed to study reversal learning. Here, we used a discrimination task in rats to examine whether the inhibition produced by reversal learning is as sensitive to the passage of time as the inhibition produced by extinction. Experiment 1 showed that when tested immediately after reversal training, rats were able to use the reversed contingencies to solve the discrimination task in an outcome-specific manner. This ability to use outcome-specific information was lost when a delay was inserted between reversal training and test. However, interpretation of these data was made difficult by a potential floor effect. This concern was addressed in Experiment 2 in which it was confirmed that the passage of time impaired the ability of the rats to use the reversed contingencies in an outcome-specific manner to solve the task. Further, it revealed that the delay between initial learning and test was not responsible for this impairment. Additional work demonstrated that solving the discrimination task was unaffected by Pavlovian extinction but that the discriminative stimuli were able to block conditioning to a novel stimulus, suggesting that Pavlovian processes were likely to contribute to solving the discrimination. We therefore concluded that the expression of reversal and extinction learning do share the same sensitivity to the effect of time. However, this sensitivity was most obvious when we assessed outcome-specific information following reversal learning. This suggests that the processes involved in reversal learning are somehow distinct from those underlying extinction learning, as the latter has usually been found to leave outcome-specific information relatively intact. Thus, the present study reveals that a better understanding of the mechanisms supporting reversal training requires assessing the impact that this training exerts on the content of learning rather than performance per se .

Role Played by the Passage of Time in Reversal Learning

PubMed Central

Goarin, Estelle H. F.; Lingawi, Nura W.; Laurent, Vincent

2018-01-01

Reversal learning is thought to involve an extinction-like process that inhibits the expression of the initial learning. However, behavioral evidence for this inhibition remains difficult to interpret as various procedures have been employed to study reversal learning. Here, we used a discrimination task in rats to examine whether the inhibition produced by reversal learning is as sensitive to the passage of time as the inhibition produced by extinction. Experiment 1 showed that when tested immediately after reversal training, rats were able to use the reversed contingencies to solve the discrimination task in an outcome-specific manner. This ability to use outcome-specific information was lost when a delay was inserted between reversal training and test. However, interpretation of these data was made difficult by a potential floor effect. This concern was addressed in Experiment 2 in which it was confirmed that the passage of time impaired the ability of the rats to use the reversed contingencies in an outcome-specific manner to solve the task. Further, it revealed that the delay between initial learning and test was not responsible for this impairment. Additional work demonstrated that solving the discrimination task was unaffected by Pavlovian extinction but that the discriminative stimuli were able to block conditioning to a novel stimulus, suggesting that Pavlovian processes were likely to contribute to solving the discrimination. We therefore concluded that the expression of reversal and extinction learning do share the same sensitivity to the effect of time. However, this sensitivity was most obvious when we assessed outcome-specific information following reversal learning. This suggests that the processes involved in reversal learning are somehow distinct from those underlying extinction learning, as the latter has usually been found to leave outcome-specific information relatively intact. Thus, the present study reveals that a better understanding of the mechanisms supporting reversal training requires assessing the impact that this training exerts on the content of learning rather than performance per se. PMID:29740293

Proprioceptive feedback and brain computer interface (BCI) based neuroprostheses.

PubMed

Ramos-Murguialday, Ander; Schürholz, Markus; Caggiano, Vittorio; Wildgruber, Moritz; Caria, Andrea; Hammer, Eva Maria; Halder, Sebastian; Birbaumer, Niels

2012-01-01

Brain computer interface (BCI) technology has been proposed for motor neurorehabilitation, motor replacement and assistive technologies. It is an open question whether proprioceptive feedback affects the regulation of brain oscillations and therefore BCI control. We developed a BCI coupled on-line with a robotic hand exoskeleton for flexing and extending the fingers. 24 healthy participants performed five different tasks of closing and opening the hand: (1) motor imagery of the hand movement without any overt movement and without feedback, (2) motor imagery with movement as online feedback (participants see and feel their hand, with the exoskeleton moving according to their brain signals, (3) passive (the orthosis passively opens and closes the hand without imagery) and (4) active (overt) movement of the hand and rest. Performance was defined as the difference in power of the sensorimotor rhythm during motor task and rest and calculated offline for different tasks. Participants were divided in three groups depending on the feedback receiving during task 2 (the other tasks were the same for all participants). Group 1 (n = 9) received contingent positive feedback (participants' sensorimotor rhythm (SMR) desynchronization was directly linked to hand orthosis movements), group 2 (n = 8) contingent "negative" feedback (participants' sensorimotor rhythm synchronization was directly linked to hand orthosis movements) and group 3 (n = 7) sham feedback (no link between brain oscillations and orthosis movements). We observed that proprioceptive feedback (feeling and seeing hand movements) improved BCI performance significantly. Furthermore, in the contingent positive group only a significant motor learning effect was observed enhancing SMR desynchronization during motor imagery without feedback in time. Furthermore, we observed a significantly stronger SMR desynchronization in the contingent positive group compared to the other groups during active and passive movements. To summarize, we demonstrated that the use of contingent positive proprioceptive feedback BCI enhanced SMR desynchronization during motor tasks.

Reduced Error-Related Activation in Two Anterior Cingulate Circuits Is Related to Impaired Performance in Schizophrenia

ERIC Educational Resources Information Center

Polli, Frida E.; Barton, Jason J. S.; Thakkar, Katharine N.; Greve, Douglas N.; Goff, Donald C.; Rauch, Scott L.; Manoach, Dara S.

2008-01-01

To perform well on any challenging task, it is necessary to evaluate your performance so that you can learn from errors. Recent theoretical and experimental work suggests that the neural sequellae of error commission in a dorsal anterior cingulate circuit index a type of contingency- or reinforcement-based learning, while activation in a rostral…

Primary Motor Cortex Involvement in Initial Learning during Visuomotor Adaptation

ERIC Educational Resources Information Center

Riek, Stephan; Hinder, Mark R.; Carson, Richard G.

2012-01-01

Human motor behaviour is continually modified on the basis of errors between desired and actual movement outcomes. It is emerging that the role played by the primary motor cortex (M1) in this process is contingent upon a variety of factors, including the nature of the task being performed, and the stage of learning. Here we used repetitive TMS to…

The relationship between mood state and perceived control in contingency learning: effects of individualist and collectivist values.

PubMed

Msetfi, Rachel M; Kornbrot, Diana E; Matute, Helena; Murphy, Robin A

2015-01-01

Perceived control in contingency learning is linked to psychological wellbeing with low levels of perceived control thought to be a cause or consequence of depression and high levels of control considered to be the hallmark of mental healthiness. However, it is not clear whether this is a universal phenomenon or whether the value that people ascribe to control influences these relationships. Here we hypothesize that values affect learning about control contingencies and influence the relationship between perceived control and symptoms of mood disorders. We tested these hypotheses with European university samples who were categorized as endorsing (or not) values relevant to control-individualist and collectivist values. Three online experimental contingency learning studies (N 1 = 127, N 2 = 324, N 3 = 272) were carried out. Evidence suggested that individualist values influenced basic learning processes via an effect on learning about the context in which events took place. Participants who endorsed individualist values made control judgments that were more in line with an elemental associative learning model, whilst those who were ambivalent about individualist values made judgments that were more consistent with a configural process. High levels of perceived control and individualist values were directly associated with increased euphoric symptoms of bipolar disorder, and such values completely mediated the relation between perceived control and symptoms. The effect of low perceived control on depression was moderated by collectivist values. Anxiety created by dissonance between values and task may be a catalyst for developing mood symptoms. Conclusions are that values play a significant intermediary role in the relation between perceived control and symptoms of mood disturbance.

Transfer of absolute and relative predictiveness in human contingency learning.

PubMed

Kattner, Florian

2015-03-01

Previous animal-learning studies have shown that the effect of the predictive history of a cue on its associability depends on whether priority was set to the absolute or relative predictiveness of that cue. The present study tested this assumption in a human contingency-learning task. In both experiments, one group of participants was trained with predictive and nonpredictive cues that were presented according to an absolute-predictiveness principle (either continuously or partially reinforced cue configurations), whereas a second group was trained with co-occurring cues that differed in predictiveness (emphasizing the relative predictive validity of the cues). In both groups, later test discriminations were learned more readily if the discriminative cues had been predictive in the previous learning stage than if they had been nonpredictive. These results imply that both the absolute and relative predictiveness of a cue lead positive transfer with regard to its associability. The data are discussed with respect to attentional models of associative learning.

Histidine-decarboxylase knockout mice show deficient nonreinforced episodic object memory, improved negatively reinforced water-maze performance, and increased neo- and ventro-striatal dopamine turnover.

PubMed

Dere, Ekrem; De Souza-Silva, Maria A; Topic, Bianca; Spieler, Richard E; Haas, Helmut L; Huston, Joseph P

2003-01-01

The brain's histaminergic system has been implicated in hippocampal synaptic plasticity, learning, and memory, as well as brain reward and reinforcement. Our past pharmacological and lesion studies indicated that the brain's histamine system exerts inhibitory effects on the brain's reinforcement respective reward system reciprocal to mesolimbic dopamine systems, thereby modulating learning and memory performance. Given the close functional relationship between brain reinforcement and memory processes, the total disruption of brain histamine synthesis via genetic disruption of its synthesizing enzyme, histidine decarboxylase (HDC), in the mouse might have differential effects on learning dependent on the task-inherent reinforcement contingencies. Here, we investigated the effects of an HDC gene disruption in the mouse in a nonreinforced object exploration task and a negatively reinforced water-maze task as well as on neo- and ventro-striatal dopamine systems known to be involved in brain reward and reinforcement. Histidine decarboxylase knockout (HDC-KO) mice had higher dihydrophenylacetic acid concentrations and a higher dihydrophenylacetic acid/dopamine ratio in the neostriatum. In the ventral striatum, dihydrophenylacetic acid/dopamine and 3-methoxytyramine/dopamine ratios were higher in HDC-KO mice. Furthermore, the HDC-KO mice showed improved water-maze performance during both hidden and cued platform tasks, but deficient object discrimination based on temporal relationships. Our data imply that disruption of brain histamine synthesis can have both memory promoting and suppressive effects via distinct and independent mechanisms and further indicate that these opposed effects are related to the task-inherent reinforcement contingencies.

Contingency bias in probability judgement may arise from ambiguity regarding additional causes.

PubMed

Mitchell, Chris J; Griffiths, Oren; More, Pranjal; Lovibond, Peter F

2013-09-01

In laboratory contingency learning tasks, people usually give accurate estimates of the degree of contingency between a cue and an outcome. However, if they are asked to estimate the probability of the outcome in the presence of the cue, they tend to be biased by the probability of the outcome in the absence of the cue. This bias is often attributed to an automatic contingency detection mechanism, which is said to act via an excitatory associative link to activate the outcome representation at the time of testing. We conducted 3 experiments to test alternative accounts of contingency bias. Participants were exposed to the same outcome probability in the presence of the cue, but different outcome probabilities in the absence of the cue. Phrasing the test question in terms of frequency rather than probability and clarifying the test instructions reduced but did not eliminate contingency bias. However, removal of ambiguity regarding the presence of additional causes during the test phase did eliminate contingency bias. We conclude that contingency bias may be due to ambiguity in the test question, and therefore it does not require postulation of a separate associative link-based mechanism.

The relationship between mood state and perceived control in contingency learning: effects of individualist and collectivist values

PubMed Central

Msetfi, Rachel M.; Kornbrot, Diana E.; Matute, Helena; Murphy, Robin A.

2015-01-01

Perceived control in contingency learning is linked to psychological wellbeing with low levels of perceived control thought to be a cause or consequence of depression and high levels of control considered to be the hallmark of mental healthiness. However, it is not clear whether this is a universal phenomenon or whether the value that people ascribe to control influences these relationships. Here we hypothesize that values affect learning about control contingencies and influence the relationship between perceived control and symptoms of mood disorders. We tested these hypotheses with European university samples who were categorized as endorsing (or not) values relevant to control—individualist and collectivist values. Three online experimental contingency learning studies (N1 = 127, N2 = 324, N3 = 272) were carried out. Evidence suggested that individualist values influenced basic learning processes via an effect on learning about the context in which events took place. Participants who endorsed individualist values made control judgments that were more in line with an elemental associative learning model, whilst those who were ambivalent about individualist values made judgments that were more consistent with a configural process. High levels of perceived control and individualist values were directly associated with increased euphoric symptoms of bipolar disorder, and such values completely mediated the relation between perceived control and symptoms. The effect of low perceived control on depression was moderated by collectivist values. Anxiety created by dissonance between values and task may be a catalyst for developing mood symptoms. Conclusions are that values play a significant intermediary role in the relation between perceived control and symptoms of mood disturbance. PMID:26483707

Impairment of probabilistic reward-based learning in schizophrenia.

PubMed

Weiler, Julia A; Bellebaum, Christian; Brüne, Martin; Juckel, Georg; Daum, Irene

2009-09-01

Recent models assume that some symptoms of schizophrenia originate from defective reward processing mechanisms. Understanding the precise nature of reward-based learning impairments might thus make an important contribution to the understanding of schizophrenia and the development of treatment strategies. The present study investigated several features of probabilistic reward-based stimulus association learning, namely the acquisition of initial contingencies, reversal learning, generalization abilities, and the effects of reward magnitude. Compared to healthy controls, individuals with schizophrenia exhibited attenuated overall performance during acquisition, whereas learning rates across blocks were similar to the rates of controls. On the group level, persons with schizophrenia were, however, unable to learn the reversal of the initial reward contingencies. Exploratory analysis of only the subgroup of individuals with schizophrenia who showed significant learning during acquisition yielded deficits in reversal learning with low reward magnitudes only. There was further evidence of a mild generalization impairment of the persons with schizophrenia in an acquired equivalence task. In summary, although there was evidence of intact basic processing of reward magnitudes, individuals with schizophrenia were impaired at using this feedback for the adaptive guidance of behavior.

Impairments in action-outcome learning in schizophrenia.

PubMed

Morris, Richard W; Cyrzon, Chad; Green, Melissa J; Le Pelley, Mike E; Balleine, Bernard W

2018-03-03

Learning the causal relation between actions and their outcomes (AO learning) is critical for goal-directed behavior when actions are guided by desire for the outcome. This can be contrasted with habits that are acquired by reinforcement and primed by prevailing stimuli, in which causal learning plays no part. Recently, we demonstrated that goal-directed actions are impaired in schizophrenia; however, whether this deficit exists alongside impairments in habit or reinforcement learning is unknown. The present study distinguished deficits in causal learning from reinforcement learning in schizophrenia. We tested people with schizophrenia (SZ, n = 25) and healthy adults (HA, n = 25) in a vending machine task. Participants learned two action-outcome contingencies (e.g., push left to get a chocolate M&M, push right to get a cracker), and they also learned one contingency was degraded by delivery of noncontingent outcomes (e.g., free M&Ms), as well as changes in value by outcome devaluation. Both groups learned the best action to obtain rewards; however, SZ did not distinguish the more causal action when one AO contingency was degraded. Moreover, action selection in SZ was insensitive to changes in outcome value unless feedback was provided, and this was related to the deficit in AO learning. The failure to encode the causal relation between action and outcome in schizophrenia occurred without any apparent deficit in reinforcement learning. This implies that poor goal-directed behavior in schizophrenia cannot be explained by a more primary deficit in reward learning such as insensitivity to reward value or reward prediction errors.

Rodent models of adaptive decision making.

PubMed

Izquierdo, Alicia; Belcher, Annabelle M

2012-01-01

Adaptive decision making affords the animal the ability to respond quickly to changes in a dynamic environment: one in which attentional demands, cost or effort to procure the reward, and reward contingencies change frequently. The more flexible the organism is in adapting choice behavior, the more command and success the organism has in navigating its environment. Maladaptive decision making is at the heart of much neuropsychiatric disease, including addiction. Thus, a better understanding of the mechanisms that underlie normal, adaptive decision making helps achieve a better understanding of certain diseases that incorporate maladaptive decision making as a core feature. This chapter presents three general domains of methods that the experimenter can manipulate in animal decision-making tasks: attention, effort, and reward contingency. Here, we present detailed methods of rodent tasks frequently employed within these domains: the Attentional Set-Shift Task, Effortful T-maze Task, and Visual Discrimination Reversal Learning. These tasks all recruit regions within the frontal cortex and the striatum, and performance is heavily modulated by the neurotransmitter dopamine, making these assays highly valid measures in the study of psychostimulant addiction.

Interactions between Learner Characteristics and Optimal Instruction. Report No. 75-17.

ERIC Educational Resources Information Center

Brophy, Jere E.

Possible implications of individual and group differences for educational research and practice are discussed. Differences include preference for cooperative versus competitive tasks; for working alone versus in a group; for structured versus unstructured learning situations; or for individual versus group reward contingencies; social class and…

Fear of negative evaluation biases social evaluation inference: evidence from a probabilistic learning task.

PubMed

Button, Katherine S; Kounali, Daphne; Stapinski, Lexine; Rapee, Ronald M; Lewis, Glyn; Munafò, Marcus R

2015-01-01

Fear of negative evaluation (FNE) defines social anxiety yet the process of inferring social evaluation, and its potential role in maintaining social anxiety, is poorly understood. We developed an instrumental learning task to model social evaluation learning, predicting that FNE would specifically bias learning about the self but not others. During six test blocks (3 self-referential, 3 other-referential), participants (n = 100) met six personas and selected a word from a positive/negative pair to finish their social evaluation sentences "I think [you are / George is]…". Feedback contingencies corresponded to 3 rules, liked, neutral and disliked, with P[positive word correct] = 0.8, 0.5 and 0.2, respectively. As FNE increased participants selected fewer positive words (β = -0.4, 95% CI -0.7, -0.2, p = 0.001), which was strongest in the self-referential condition (FNE × condition 0.28, 95% CI 0.01, 0.54, p = 0.04), and the neutral and dislike rules (FNE × condition × rule, p = 0.07). At low FNE the proportion of positive words selected for self-neutral and self-disliked greatly exceeded the feedback contingency, indicating poor learning, which improved as FNE increased. FNE is associated with differences in processing social-evaluative information specifically about the self. At low FNE this manifests as insensitivity to learning negative self-referential evaluation. High FNE individuals are equally sensitive to learning positive or negative evaluation, which although objectively more accurate, may have detrimental effects on mental health.

Contingency learning is reduced for high conflict stimuli.

PubMed

Whitehead, Peter S; Brewer, Gene A; Patwary, Nowed; Blais, Chris

2016-09-16

Recent theories have proposed that contingency learning occurs independent of control processes. These parallel processing accounts propose that behavioral effects originally thought to be products of control processes are in fact products solely of contingency learning. This view runs contrary to conflict-mediated Hebbian-learning models that posit control and contingency learning are parts of an interactive system. In this study we replicate the contingency learning effect and modify it to further test the veracity of the parallel processing accounts in comparison to conflict-mediated Hebbian-learning models. This is accomplished by manipulating conflict to test for an interaction, or lack thereof, between conflict and contingency learning. The results are consistent with conflict-mediated Hebbian-learning in that the addition of conflict reduces the magnitude of the contingency learning effect. Copyright © 2016 Elsevier B.V. All rights reserved.

Effects of Mother-Infant Social Interactions on Infants' Subsequent Contingency Task Performance.

ERIC Educational Resources Information Center

Dunham, Philip; Dunham, Frances

1990-01-01

Infants participated in a nonsocial contingency task immediately after a social interaction with their mothers. The amount of time mothers and infants spent in a state of vocal turn-taking predicted individual differences in infants' subsequent performance on the contingency task. (PCB)

Chimpanzees can point to smaller amounts of food to accumulate larger amounts but they still fail the reverse-reward contingency task.

PubMed

Beran, Michael J; James, Brielle T; Whitham, Will; Parrish, Audrey E

2016-10-01

The reverse-reward contingency task presents 2 food sets to an animal, and they are required to choose the smaller of the 2 sets in order to receive the larger food set. Intriguingly, the majority of species tested on the reverse-reward task fail to learn this contingency in the absence of large trial counts, correction trials, and punishment techniques. The unique difficulty of this seemingly simple task likely reflects a failure of inhibitory control which is required to point toward a smaller and less desirable reward rather than a larger and more desirable reward. This failure by chimpanzees and other primates to pass the reverse-reward task is striking given the self-control they exhibit in a variety of other paradigms. For example, chimpanzees have consistently demonstrated a high capacity for delay of gratification in order to maximize accumulating food rewards in which foods are added item-by-item to a growing set until the subject consumes the rewards. To study the mechanisms underlying success in the accumulation task and failure in the reverse-reward task, we presented chimpanzees with several combinations of these 2 tasks to determine when chimpanzees might succeed in pointing to smaller food sets over larger food sets and how the nature of the task might determine the animals' success or failure. Across experiments, 3 chimpanzees repeatedly failed to solve the reverse-reward task, whereas they accumulated nearly all food items across all instances of the accumulation self-control task, even when they had to point to small amounts of food to accumulate larger amounts. These data indicate that constraints of these 2 related but still different tasks of behavioral inhibition are dependent upon the animals' perceptions of the choice set, their sense of control over the contents of choice sets, and the nature of the task constraints. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Increased cognitive load enables unlearning in procedural category learning.

PubMed

Crossley, Matthew J; Maddox, W Todd; Ashby, F Gregory

2018-04-19

Interventions for drug abuse and other maladaptive habitual behaviors may yield temporary success but are often fragile and relapse is common. This implies that current interventions do not erase or substantially modify the representations that support the underlying addictive behavior-that is, they do not cause true unlearning. One example of an intervention that fails to induce true unlearning comes from Crossley, Ashby, and Maddox (2013, Journal of Experimental Psychology: General), who reported that a sudden shift to random feedback did not cause unlearning of category knowledge obtained through procedural systems, and they also reported results suggesting that this failure is because random feedback is noncontingent on behavior. These results imply the existence of a mechanism that (a) estimates feedback contingency and (b) protects procedural learning from modification when feedback contingency is low (i.e., during random feedback). This article reports the results of an experiment in which increasing cognitive load via an explicit dual task during the random feedback period facilitated unlearning. This result is consistent with the hypothesis that the mechanism that protects procedural learning when feedback contingency is low depends on executive function. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Astronaut William S. McArthur in training for contingency EVA in WETF

NASA Image and Video Library

1993-09-10

S93-43840 (6 Sept 1993) --- Astronaut William S. McArthur, mission specialist, participates in training for contingency Extravehicular Activity (EVA) for the STS-58 mission. For simulation purposes, McArthur was about to be submerged to a point of neutral buoyancy in the Johnson Space Center's (JSC) Weightless Environment Training Facility (WET-F). Though the Spacelab Life Sciences (SLS-2) mission does not include a planned EVA, all crews designate members to learn proper procedures to perform outside the spacecraft in the event of failure of remote means to accomplish those tasks.

Learning and inference using complex generative models in a spatial localization task.

PubMed

Bejjanki, Vikranth R; Knill, David C; Aslin, Richard N

2016-01-01

A large body of research has established that, under relatively simple task conditions, human observers integrate uncertain sensory information with learned prior knowledge in an approximately Bayes-optimal manner. However, in many natural tasks, observers must perform this sensory-plus-prior integration when the underlying generative model of the environment consists of multiple causes. Here we ask if the Bayes-optimal integration seen with simple tasks also applies to such natural tasks when the generative model is more complex, or whether observers rely instead on a less efficient set of heuristics that approximate ideal performance. Participants localized a "hidden" target whose position on a touch screen was sampled from a location-contingent bimodal generative model with different variances around each mode. Over repeated exposure to this task, participants learned the a priori locations of the target (i.e., the bimodal generative model), and integrated this learned knowledge with uncertain sensory information on a trial-by-trial basis in a manner consistent with the predictions of Bayes-optimal behavior. In particular, participants rapidly learned the locations of the two modes of the generative model, but the relative variances of the modes were learned much more slowly. Taken together, our results suggest that human performance in a more complex localization task, which requires the integration of sensory information with learned knowledge of a bimodal generative model, is consistent with the predictions of Bayes-optimal behavior, but involves a much longer time-course than in simpler tasks.

Motor contingency learning and infants with Spina Bifida.

PubMed

Taylor, Heather B; Barnes, Marcia A; Landry, Susan H; Swank, Paul; Fletcher, Jack M; Huang, Furong

2013-02-01

Infants with Spina Bifida (SB) were compared to typically developing infants (TD) using a conjugate reinforcement paradigm at 6 months-of-age (n = 98) to evaluate learning, and retention of a sensory-motor contingency. Analyses evaluated infant arm-waving rates at baseline (wrist not tethered to mobile), during acquisition of the sensory-motor contingency (wrist tethered), and immediately after the acquisition phase and then after a delay (wrist not tethered), controlling for arm reaching ability, gestational age, and socioeconomic status. Although both groups responded to the contingency with increased arm-waving from baseline to acquisition, 15% to 29% fewer infants with SB than TD were found to learn the contingency depending on the criterion used to determine contingency learning. In addition, infants with SB who had learned the contingency had more difficulty retaining the contingency over time when sensory feedback was absent. The findings suggest that infants with SB do not learn motor contingencies as easily or at the same rate as TD infants, and are more likely to decrease motor responses when sensory feedback is absent. Results are discussed with reference to research on contingency learning in infants with and without neurodevelopmental disorders, and with reference to motor learning in school-age children with SB.

Task-Contingent Conscientiousness as a Unit of Personality at Work

ERIC Educational Resources Information Center

Minbashian, Amirali; Wood, Robert E.; Beckmann, Nadin

2010-01-01

The present study examined the viability of incorporating task-contingent units into the study of personality at work, using conscientiousness as an illustrative example. We used experience-sampling data from 123 managers to show that (a) momentary conscientiousness at work is contingent on the difficulty and urgency demands of the tasks people…

Learning, awareness, and instruction: subjective contingency awareness does matter in the colour-word contingency learning paradigm.

PubMed

Schmidt, James R; De Houwer, Jan

2012-12-01

In three experiments, each of a set colour-unrelated distracting words was presented most often in a particular target print colour (e.g., "month" most often in red). In Experiment 1, half of the participants were told the word-colour contingencies in advance (instructed) and half were not (control). The instructed group showed a larger learning effect. This instruction effect was fully explained by increases in subjective awareness with instruction. In Experiment 2, contingency instructions were again given, but no contingencies were actually present. Although many participants claimed to be aware of these (non-existent) contingencies, they did not produce an instructed contingency effect. In Experiment 3, half of the participants were given contingency instructions that did not correspond to the correct contingencies. Participants with these false instructions learned the actual contingencies worse than controls. Collectively, our results suggest that conscious contingency knowledge might play a moderating role in the strength of implicit learning. Copyright © 2012 Elsevier Inc. All rights reserved.

Skype me! Socially Contingent Interactions Help Toddlers Learn Language

PubMed Central

Roseberry, Sarah; Hirsh-Pasek, Kathy; Golinkoff, Roberta Michnick

2013-01-01

Language learning takes place in the context of social interactions, yet the mechanisms that render social interactions useful for learning language remain unclear. This paper focuses on whether social contingency might support word learning. Toddlers aged 24- to 30-months (N=36) were exposed to novel verbs in one of three conditions: live interaction training, socially contingent video training over video chat, and non-contingent video training (yoked video). Results suggest that children only learned novel verbs in socially contingent interactions (live interactions and video chat). The current study highlights the importance of social contingency in interactions for language learning and informs the literature on learning through screen media as the first study to examine word learning through video chat technology. PMID:24112079

Contingency learning in human fear conditioning involves the ventral striatum.

PubMed

Klucken, Tim; Tabbert, Katharina; Schweckendiek, Jan; Merz, Christian Josef; Kagerer, Sabine; Vaitl, Dieter; Stark, Rudolf

2009-11-01

The ability to detect and learn contingencies between fearful stimuli and their predictive cues is an important capacity to cope with the environment. Contingency awareness refers to the ability to verbalize the relationships between conditioned and unconditioned stimuli. Although there is a heated debate about the influence of contingency awareness on conditioned fear responses, neural correlates behind the formation process of contingency awareness have gained only little attention in human fear conditioning. Recent animal studies indicate that the ventral striatum (VS) could be involved in this process, but in human studies the VS is mostly associated with positive emotions. To examine this question, we reanalyzed four recently published classical fear conditioning studies (n = 117) with respect to the VS at three distinct levels of contingency awareness: subjects, who did not learn the contingencies (unaware), subjects, who learned the contingencies during the experiment (learned aware) and subjects, who were informed about the contingencies in advance (instructed aware). The results showed significantly increased activations in the left and right VS in learned aware compared to unaware subjects. Interestingly, this activation pattern was only found in learned but not in instructed aware subjects. We assume that the VS is not involved when contingency awareness does not develop during conditioning or when contingency awareness is unambiguously induced already prior to conditioning. VS involvement seems to be important for the transition from a contingency unaware to a contingency aware state. Implications for fear conditioning models as well as for the contingency awareness debate are discussed.

Age-related differences in reaction time task performance in young children.

PubMed

Kiselev, Sergey; Espy, Kimberly Andrews; Sheffield, Tiffany

2009-02-01

Performance of reaction time (RT) tasks was investigated in young children and adults to test the hypothesis that age-related differences in processing speed supersede a "global" mechanism and are a function of specific differences in task demands and processing requirements. The sample consisted of 54 4-year-olds, 53 5-year-olds, 59 6-year-olds, and 35 adults from Russia. Using the regression approach pioneered by Brinley and the transformation method proposed by Madden and colleagues and Ridderinkhoff and van der Molen, age-related differences in processing speed differed among RT tasks with varying demands. In particular, RTs differed between children and adults on tasks that required response suppression, discrimination of color or spatial orientation, reversal of contingencies of previously learned stimulus-response rules, and greater stimulus-response complexity. Relative costs of these RT task differences were larger than predicted by the global difference hypothesis except for response suppression. Among young children, age-related differences larger than predicted by the global difference hypothesis were evident when tasks required color or spatial orientation discrimination and stimulus-response rule complexity, but not for response suppression or reversal of stimulus-response contingencies. Process-specific, age-related differences in processing speed that support heterochronicity of brain development during childhood were revealed.

Relative speed of processing determines color-word contingency learning.

PubMed

Forrin, Noah D; MacLeod, Colin M

2017-10-01

In three experiments, we tested a relative-speed-of-processing account of color-word contingency learning, a phenomenon in which color identification responses to high-contingency stimuli (words that appear most often in particular colors) are faster than those to low-contingency stimuli. Experiment 1 showed equally large contingency-learning effects whether responding was to the colors or to the words, likely due to slow responding to both dimensions because of the unfamiliar mapping required by the key press responses. For Experiment 2, participants switched to vocal responding, in which reading words is considerably faster than naming colors, and we obtained a contingency-learning effect only for color naming, the slower dimension. In Experiment 3, previewing the color information resulted in a reduced contingency-learning effect for color naming, but it enhanced the contingency-learning effect for word reading. These results are all consistent with contingency learning influencing performance only when the nominally irrelevant feature is faster to process than the relevant feature, and therefore are entirely in accord with a relative-speed-of-processing explanation.

Motor Contingency Learning and Infants with Spina Bifida

PubMed Central

Taylor, Heather B.; Barnes, Marcia A.; Landry, Susan H.; Swank, Paul; Fletcher, Jack M.; Huang, Furong

2014-01-01

Infants with Spina Bifida (SB) were compared to typically developing infants (TD) using a conjugate reinforcement paradigm at 6 months-of-age (n = 98) to evaluate learning, and retention of a sensory-motor contingency. Analyses evaluated infant arm-waving rates at baseline (wrist not tethered to mobile), during acquisition of the sensory-motor contingency (wrist tethered), and immediately after the acquisition phase and then after a delay (wrist not tethered), controlling for arm reaching ability, gestational age, and socioeconomic status. Although both groups responded to the contingency with increased arm-waving from baseline to acquisition, 15% to 29% fewer infants with SB than TD were found to learn the contingency depending on the criterion used to determine contingency learning. In addition, infants with SB who had learned the contingency had more difficulty retaining the contingency over time when sensory feedback was absent. The findings suggest that infants with SB do not learn motor contingencies as easily or at the same rate as TD infants, and are more likely to decrease motor responses when sensory feedback is absent. Results are discussed with reference to research on contingency learning in infants with and without neurodevelopmental disorders, and with reference to motor learning in school-age children with SB. PMID:23298791

Perceptual learning in a non-human primate model of artificial vision

PubMed Central

Killian, Nathaniel J.; Vurro, Milena; Keith, Sarah B.; Kyada, Margee J.; Pezaris, John S.

2016-01-01

Visual perceptual grouping, the process of forming global percepts from discrete elements, is experience-dependent. Here we show that the learning time course in an animal model of artificial vision is predicted primarily from the density of visual elements. Three naïve adult non-human primates were tasked with recognizing the letters of the Roman alphabet presented at variable size and visualized through patterns of discrete visual elements, specifically, simulated phosphenes mimicking a thalamic visual prosthesis. The animals viewed a spatially static letter using a gaze-contingent pattern and then chose, by gaze fixation, between a matching letter and a non-matching distractor. Months of learning were required for the animals to recognize letters using simulated phosphene vision. Learning rates increased in proportion to the mean density of the phosphenes in each pattern. Furthermore, skill acquisition transferred from trained to untrained patterns, not depending on the precise retinal layout of the simulated phosphenes. Taken together, the findings suggest that learning of perceptual grouping in a gaze-contingent visual prosthesis can be described simply by the density of visual activation. PMID:27874058

Fear of Negative Evaluation Biases Social Evaluation Inference: Evidence from a Probabilistic Learning Task

PubMed Central

Button, Katherine S.; Kounali, Daphne; Stapinski, Lexine; Rapee, Ronald M.; Lewis, Glyn; Munafò, Marcus R.

2015-01-01

Background Fear of negative evaluation (FNE) defines social anxiety yet the process of inferring social evaluation, and its potential role in maintaining social anxiety, is poorly understood. We developed an instrumental learning task to model social evaluation learning, predicting that FNE would specifically bias learning about the self but not others. Methods During six test blocks (3 self-referential, 3 other-referential), participants (n = 100) met six personas and selected a word from a positive/negative pair to finish their social evaluation sentences “I think [you are / George is]…”. Feedback contingencies corresponded to 3 rules, liked, neutral and disliked, with P[positive word correct] = 0.8, 0.5 and 0.2, respectively. Results As FNE increased participants selected fewer positive words (β = −0.4, 95% CI −0.7, −0.2, p = 0.001), which was strongest in the self-referential condition (FNE × condition 0.28, 95% CI 0.01, 0.54, p = 0.04), and the neutral and dislike rules (FNE × condition × rule, p = 0.07). At low FNE the proportion of positive words selected for self-neutral and self-disliked greatly exceeded the feedback contingency, indicating poor learning, which improved as FNE increased. Conclusions FNE is associated with differences in processing social-evaluative information specifically about the self. At low FNE this manifests as insensitivity to learning negative self-referential evaluation. High FNE individuals are equally sensitive to learning positive or negative evaluation, which although objectively more accurate, may have detrimental effects on mental health. PMID:25853835

Learning to use working memory: a reinforcement learning gating model of rule acquisition in rats

PubMed Central

Lloyd, Kevin; Becker, Nadine; Jones, Matthew W.; Bogacz, Rafal

2012-01-01

Learning to form appropriate, task-relevant working memory representations is a complex process central to cognition. Gating models frame working memory as a collection of past observations and use reinforcement learning (RL) to solve the problem of when to update these observations. Investigation of how gating models relate to brain and behavior remains, however, at an early stage. The current study sought to explore the ability of simple RL gating models to replicate rule learning behavior in rats. Rats were trained in a maze-based spatial learning task that required animals to make trial-by-trial choices contingent upon their previous experience. Using an abstract version of this task, we tested the ability of two gating algorithms, one based on the Actor-Critic and the other on the State-Action-Reward-State-Action (SARSA) algorithm, to generate behavior consistent with the rats'. Both models produced rule-acquisition behavior consistent with the experimental data, though only the SARSA gating model mirrored faster learning following rule reversal. We also found that both gating models learned multiple strategies in solving the initial task, a property which highlights the multi-agent nature of such models and which is of importance in considering the neural basis of individual differences in behavior. PMID:23115551

Temperament and self-based correlates of cooperative, competitive and individualistic learning preferences.

PubMed

Gocłowska, Małgorzata A; Aldhobaiban, Nawal; Elliot, Andrew J; Murayama, Kou; Kobeisy, Ahmed; Abdelaziz, Ashraf

2017-06-01

People vary in the extent to which they prefer cooperative, competitive or individualistic achievement tasks. In this research, we conducted two studies designed to investigate correlates and possible roots of these social interdependence orientations, namely approach and avoidance temperament, general self-efficacy, implicit theories of intelligence, and contingencies of self-worth based in others' approval, competition and academic competence. The results indicated that approach temperament, general self-efficacy and incremental theory were positively related, and entity theory was negatively related to cooperative preferences (|r| range from .11 to .41); approach temperament, general self-efficacy, competition contingencies and academic competence contingencies were positively related to competitive preferences (|r| range from .16 to .46); and avoidance temperament, entity theory, competitive contingencies and academic competence contingencies were positively related, and incremental theory was negatively related to individualistic preferences (|r| range from .09 to .15). The findings are discussed with regard to the meaning of each of the three social interdependence orientations, cultural differences among the observed relations and implications for practitioners. © 2015 International Union of Psychological Science.

Interest, Enjoyment and Pride after Failure Experiences? Predictors of Students' State-Emotions after Success and Failure during Learning in Mathematics

ERIC Educational Resources Information Center

Tulis, Maria; Ainley, Mary

2011-01-01

The current investigation was designed to identify emotion states students experience during mathematics activities, and in particular to distinguish emotions contingent on experiences of success and experiences of failure. Students' task-related emotional responses were recorded following experiences of success and failure while working with an…

Pure perceptual-based learning of second-, third-, and fourth-order sequential probabilities.

PubMed

Remillard, Gilbert

2011-07-01

There is evidence that sequence learning in the traditional serial reaction time task (SRTT), where target location is the response dimension, and sequence learning in the perceptual SRTT, where target location is not the response dimension, are handled by different mechanisms. The ability of the latter mechanism to learn sequential contingencies that can be learned by the former mechanism was examined. Prior research has established that people can learn second-, third-, and fourth-order probabilities in the traditional SRTT. The present study reveals that people can learn such probabilities in the perceptual SRTT. This suggests that the two mechanisms may have similar architectures. A possible neural basis of the two mechanisms is discussed.

Contingency-based emotional resilience: effort-based reward training and flexible coping lead to adaptive responses to uncertainty in male rats

PubMed Central

Lambert, Kelly G.; Hyer, Molly M.; Rzucidlo, Amanda A.; Bergeron, Timothy; Landis, Timothy; Bardi, Massimo

2014-01-01

Emotional resilience enhances an animal's ability to maintain physiological allostasis and adaptive responses in the midst of challenges ranging from cognitive uncertainty to chronic stress. In the current study, neurobiological factors related to strategic responses to uncertainty produced by prediction errors were investigated by initially profiling male rats as passive, active or flexible copers (n = 12 each group) and assigning to either a contingency-trained or non-contingency trained group. Animals were subsequently trained in a spatial learning task so that problem solving strategies in the final probe task, as well-various biomarkers of brain activation and plasticity in brain areas associated with cognition and emotional regulation, could be assessed. Additionally, fecal samples were collected to further determine markers of stress responsivity and emotional resilience. Results indicated that contingency-trained rats exhibited more adaptive responses in the probe trial (e.g., fewer interrupted grooming sequences and more targeted search strategies) than the noncontingent-trained rats; additionally, increased DHEA/CORT ratios were observed in the contingent-trained animals. Diminished activation of the habenula (i.e., fos-immunoreactivity) was correlated with resilience factors such as increased levels of DHEA metabolites during cognitive training. Of the three coping profiles, flexible copers exhibited enhanced neuroplasticity (i.e., increased dentate gyrus doublecortin-immunoreactivity) compared to the more consistently responding active and passive copers. Thus, in the current study, contingency training via effort-based reward (EBR) training, enhanced by a flexible coping style, provided neurobiological resilience and adaptive responses to prediction errors in the final probe trial. These findings have implications for psychiatric illnesses that are influenced by altered stress responses and decision-making abilities (e.g., depression). PMID:24808837

Contingency-based emotional resilience: effort-based reward training and flexible coping lead to adaptive responses to uncertainty in male rats.

PubMed

Lambert, Kelly G; Hyer, Molly M; Rzucidlo, Amanda A; Bergeron, Timothy; Landis, Timothy; Bardi, Massimo

2014-01-01

Emotional resilience enhances an animal's ability to maintain physiological allostasis and adaptive responses in the midst of challenges ranging from cognitive uncertainty to chronic stress. In the current study, neurobiological factors related to strategic responses to uncertainty produced by prediction errors were investigated by initially profiling male rats as passive, active or flexible copers (n = 12 each group) and assigning to either a contingency-trained or non-contingency trained group. Animals were subsequently trained in a spatial learning task so that problem solving strategies in the final probe task, as well-various biomarkers of brain activation and plasticity in brain areas associated with cognition and emotional regulation, could be assessed. Additionally, fecal samples were collected to further determine markers of stress responsivity and emotional resilience. Results indicated that contingency-trained rats exhibited more adaptive responses in the probe trial (e.g., fewer interrupted grooming sequences and more targeted search strategies) than the noncontingent-trained rats; additionally, increased DHEA/CORT ratios were observed in the contingent-trained animals. Diminished activation of the habenula (i.e., fos-immunoreactivity) was correlated with resilience factors such as increased levels of DHEA metabolites during cognitive training. Of the three coping profiles, flexible copers exhibited enhanced neuroplasticity (i.e., increased dentate gyrus doublecortin-immunoreactivity) compared to the more consistently responding active and passive copers. Thus, in the current study, contingency training via effort-based reward (EBR) training, enhanced by a flexible coping style, provided neurobiological resilience and adaptive responses to prediction errors in the final probe trial. These findings have implications for psychiatric illnesses that are influenced by altered stress responses and decision-making abilities (e.g., depression).

Impaired cognitive plasticity and goal-directed control in adolescent obsessive-compulsive disorder.

PubMed

Gottwald, Julia; de Wit, Sanne; Apergis-Schoute, Annemieke M; Morein-Zamir, Sharon; Kaser, Muzaffer; Cormack, Francesca; Sule, Akeem; Limmer, Winifred; Morris, Anna Conway; Robbins, Trevor W; Sahakian, Barbara J

2018-01-22

Youths with obsessive-compulsive disorder (OCD) experience severe distress and impaired functioning at school and at home. Critical cognitive domains for daily functioning and academic success are learning, memory, cognitive flexibility and goal-directed behavioural control. Performance in these important domains among teenagers with OCD was therefore investigated in this study. A total of 36 youths with OCD and 36 healthy comparison subjects completed two memory tasks: Pattern Recognition Memory (PRM) and Paired Associates Learning (PAL); as well as the Intra-Extra Dimensional Set Shift (IED) task to quantitatively gauge learning as well as cognitive flexibility. A subset of 30 participants of each group also completed a Differential-Outcome Effect (DOE) task followed by a Slips-of-Action Task, designed to assess the balance of goal-directed and habitual behavioural control. Adolescent OCD patients showed a significant learning and memory impairment. Compared with healthy comparison subjects, they made more errors on PRM and PAL and in the first stages of IED involving discrimination and reversal learning. Patients were also slower to learn about contingencies in the DOE task and were less sensitive to outcome devaluation, suggesting an impairment in goal-directed control. This study advances the characterization of juvenile OCD. Patients demonstrated impairments in all learning and memory tasks. We also provide the first experimental evidence of impaired goal-directed control and lack of cognitive plasticity early in the development of OCD. The extent to which the impairments in these cognitive domains impact academic performance and symptom development warrants further investigation.

A Cognitive Modeling Approach to Strategy Formation in Dynamic Decision Making.

PubMed

Prezenski, Sabine; Brechmann, André; Wolff, Susann; Russwinkel, Nele

2017-01-01

Decision-making is a high-level cognitive process based on cognitive processes like perception, attention, and memory. Real-life situations require series of decisions to be made, with each decision depending on previous feedback from a potentially changing environment. To gain a better understanding of the underlying processes of dynamic decision-making, we applied the method of cognitive modeling on a complex rule-based category learning task. Here, participants first needed to identify the conjunction of two rules that defined a target category and later adapt to a reversal of feedback contingencies. We developed an ACT-R model for the core aspects of this dynamic decision-making task. An important aim of our model was that it provides a general account of how such tasks are solved and, with minor changes, is applicable to other stimulus materials. The model was implemented as a mixture of an exemplar-based and a rule-based approach which incorporates perceptual-motor and metacognitive aspects as well. The model solves the categorization task by first trying out one-feature strategies and then, as a result of repeated negative feedback, switching to two-feature strategies. Overall, this model solves the task in a similar way as participants do, including generally successful initial learning as well as reversal learning after the change of feedback contingencies. Moreover, the fact that not all participants were successful in the two learning phases is also reflected in the modeling data. However, we found a larger variance and a lower overall performance of the modeling data as compared to the human data which may relate to perceptual preferences or additional knowledge and rules applied by the participants. In a next step, these aspects could be implemented in the model for a better overall fit. In view of the large interindividual differences in decision performance between participants, additional information about the underlying cognitive processes from behavioral, psychobiological and neurophysiological data may help to optimize future applications of this model such that it can be transferred to other domains of comparable dynamic decision tasks.

A Cognitive Modeling Approach to Strategy Formation in Dynamic Decision Making

PubMed Central

Prezenski, Sabine; Brechmann, André; Wolff, Susann; Russwinkel, Nele

2017-01-01

Decision-making is a high-level cognitive process based on cognitive processes like perception, attention, and memory. Real-life situations require series of decisions to be made, with each decision depending on previous feedback from a potentially changing environment. To gain a better understanding of the underlying processes of dynamic decision-making, we applied the method of cognitive modeling on a complex rule-based category learning task. Here, participants first needed to identify the conjunction of two rules that defined a target category and later adapt to a reversal of feedback contingencies. We developed an ACT-R model for the core aspects of this dynamic decision-making task. An important aim of our model was that it provides a general account of how such tasks are solved and, with minor changes, is applicable to other stimulus materials. The model was implemented as a mixture of an exemplar-based and a rule-based approach which incorporates perceptual-motor and metacognitive aspects as well. The model solves the categorization task by first trying out one-feature strategies and then, as a result of repeated negative feedback, switching to two-feature strategies. Overall, this model solves the task in a similar way as participants do, including generally successful initial learning as well as reversal learning after the change of feedback contingencies. Moreover, the fact that not all participants were successful in the two learning phases is also reflected in the modeling data. However, we found a larger variance and a lower overall performance of the modeling data as compared to the human data which may relate to perceptual preferences or additional knowledge and rules applied by the participants. In a next step, these aspects could be implemented in the model for a better overall fit. In view of the large interindividual differences in decision performance between participants, additional information about the underlying cognitive processes from behavioral, psychobiological and neurophysiological data may help to optimize future applications of this model such that it can be transferred to other domains of comparable dynamic decision tasks. PMID:28824512

Empathy and feedback processing in active and observational learning.

PubMed

Rak, Natalia; Bellebaum, Christian; Thoma, Patrizia

2013-12-01

The feedback-related negativity (FRN) and the P300 have been related to the processing of one's own and other individuals' feedback during both active and observational learning. The aim of the present study was to elucidate the role of trait-empathic responding with regard to the modulation of the neural correlates of observational learning in particular. Thirty-four healthy participants completed an active and an observational learning task. On both tasks, the participants' aim was to maximize their monetary gain by choosing from two stimuli the one that showed the higher probability of reward. Participants gained insight into the stimulus-reward contingencies according to monetary feedback presented after they had made an active choice or by observing the choices of a virtual partner. Participants showed a general improvement in learning performance on both learning tasks. P200, FRN, and P300 amplitudes were larger during active, as compared with observational, learning. Furthermore, nonreward elicited a significantly more negative FRN than did reward in the active learning task, while only a trend was observed for observational learning. Distinct subcomponents of trait cognitive empathy were related to poorer performance and smaller P300 amplitudes for observational learning only. Taken together, both the learning performance and event-related potentials during observational learning are affected by different aspects of trait cognitive empathy, and certain types of observational learning may actually be disrupted by a higher tendency to understand and adopt other people's perspectives.

Skype me! Socially contingent interactions help toddlers learn language.

PubMed

Roseberry, Sarah; Hirsh-Pasek, Kathy; Golinkoff, Roberta M

2014-01-01

Language learning takes place in the context of social interactions, yet the mechanisms that render social interactions useful for learning language remain unclear. This study focuses on whether social contingency might support word learning. Toddlers aged 24-30 months (N = 36) were exposed to novel verbs in one of three conditions: live interaction training, socially contingent video training over video chat, and noncontingent video training (yoked video). Results suggest that children only learned novel verbs in socially contingent interactions (live interactions and video chat). This study highlights the importance of social contingency in interactions for language learning and informs the literature on learning through screen media as the first study to examine word learning through video chat technology. © 2013 The Authors. Child Development © 2013 Society for Research in Child Development, Inc.

Implementation and Assessment of an Intervention to Debias Adolescents against Causal Illusions

PubMed Central

Barberia, Itxaso; Blanco, Fernando; Cubillas, Carmelo P.; Matute, Helena

2013-01-01

Researchers have warned that causal illusions are at the root of many superstitious beliefs and fuel many people’s faith in pseudoscience, thus generating significant suffering in modern society. Therefore, it is critical that we understand the mechanisms by which these illusions develop and persist. A vast amount of research in psychology has investigated these mechanisms, but little work has been done on the extent to which it is possible to debias individuals against causal illusions. We present an intervention in which a sample of adolescents was introduced to the concept of experimental control, focusing on the need to consider the base rate of the outcome variable in order to determine if a causal relationship exists. The effectiveness of the intervention was measured using a standard contingency learning task that involved fake medicines that typically produce causal illusions. Half of the participants performed the contingency learning task before participating in the educational intervention (the control group), and the other half performed the task after they had completed the intervention (the experimental group). The participants in the experimental group made more realistic causal judgments than did those in the control group, which served as a baseline. To the best of our knowledge, this is the first evidence-based educational intervention that could be easily implemented to reduce causal illusions and the many problems associated with them, such as superstitions and belief in pseudoscience. PMID:23967189

Further evidence for unconscious learning: preliminary support for the conditioning of facial EMG to subliminal stimuli.

PubMed

Bunce, S C; Bernat, E; Wong, P S; Shevrin, H

1999-01-01

This study investigated the predictive validity of facial electromyograms (EMGs) in a subliminal conditioning paradigm. Two schematic faces (pleasant; CS- and unpleasant; CS+), were presented to eight right-handed males during supraliminal pre- and postconditioning phases. Subliminal conditioning consisted of 36 energy-masked presentations of each face pairing the CS+ with an aversive shock 800 ms poststimulus. A forced-choice recognition task established that the energy mask effectively precluded conscious recognition of stimuli. For the obicularis oculi and corrugator EMGs, significant face x condition interactions were found at 20-100 ms and 400-792 ms poststimulus. The results demonstrate the existence of an expressive motoric response related to affect operating in response to a learned but unconscious event. Subjects were not aware of a contingency between the CS+ and the US, suggesting emotional contingencies can be unconsciously acquired.

Automated Visual Cognitive Tasks for Recording Neural Activity Using a Floor Projection Maze

PubMed Central

Kent, Brendon W.; Yang, Fang-Chi; Burwell, Rebecca D.

2014-01-01

Neuropsychological tasks used in primates to investigate mechanisms of learning and memory are typically visually guided cognitive tasks. We have developed visual cognitive tasks for rats using the Floor Projection Maze1,2 that are optimized for visual abilities of rats permitting stronger comparisons of experimental findings with other species. In order to investigate neural correlates of learning and memory, we have integrated electrophysiological recordings into fully automated cognitive tasks on the Floor Projection Maze1,2. Behavioral software interfaced with an animal tracking system allows monitoring of the animal's behavior with precise control of image presentation and reward contingencies for better trained animals. Integration with an in vivo electrophysiological recording system enables examination of behavioral correlates of neural activity at selected epochs of a given cognitive task. We describe protocols for a model system that combines automated visual presentation of information to rodents and intracranial reward with electrophysiological approaches. Our model system offers a sophisticated set of tools as a framework for other cognitive tasks to better isolate and identify specific mechanisms contributing to particular cognitive processes. PMID:24638057

Contingent Attentional Capture by Conceptually Relevant Images

ERIC Educational Resources Information Center

Wyble, Brad; Folk, Charles; Potter, Mary C.

2013-01-01

Attentional capture is an unintentional shift of visuospatial attention to the location of a distractor that is either highly salient, or relevant to the current task set. The latter situation is referred to as contingent capture, in that the effect is contingent on a match between characteristics of the stimuli and the task-defined…

The role of emotion in learning trustworthiness from eye-gaze: Evidence from facial electromyography

PubMed Central

Manssuer, Luis R.; Pawling, Ralph; Hayes, Amy E.; Tipper, Steven P.

2016-01-01

Gaze direction can be used to rapidly and reflexively lead or mislead others’ attention as to the location of important stimuli. When perception of gaze direction is congruent with the location of a target, responses are faster compared to when incongruent. Faces that consistently gaze congruently are also judged more trustworthy than faces that consistently gaze incongruently. However, it’s unclear how gaze-cues elicit changes in trust. We measured facial electromyography (EMG) during an identity-contingent gaze-cueing task to examine whether embodied emotional reactions to gaze-cues mediate trust learning. Gaze-cueing effects were found to be equivalent regardless of whether participants showed learning of trust in the expected direction or did not. In contrast, we found distinctly different patterns of EMG activity in these two populations. In a further experiment we showed the learning effects were specific to viewing faces, as no changes in liking were detected when viewing arrows that evoked similar attentional orienting responses. These findings implicate embodied emotion in learning trust from identity-contingent gaze-cueing, possibly due to the social value of shared attention or deception rather than domain-general attentional orienting. PMID:27153239

Affective Modulation of Cognitive Control is Determined by Performance-Contingency and Mediated by Ventromedial Prefrontal and Cingulate Cortex

PubMed Central

King, Joseph A.; Korb, Franziska M.; Krebs, Ruth M.; Notebaert, Wim; Egner, Tobias

2013-01-01

Cognitive control requires a fine balance between stability, the protection of an on-going task-set, and flexibility, the ability to update a task-set in line with changing contingencies. It is thought that emotional processing modulates this balance, but results have been equivocal regarding the direction of this modulation. Here, we tested the hypothesis that a crucial determinant of this modulation is whether affective stimuli represent performance-contingent or task-irrelevant signals. Combining functional magnetic resonance imaging with a conflict task-switching paradigm, we contrasted the effects of presenting negative- and positive-valence pictures on the stability/flexibility trade-off in humans, depending on whether picture presentation was contingent on behavioral performance. Both the behavioral and neural expressions of cognitive control were modulated by stimulus valence and performance contingency: in the performance-contingent condition, cognitive flexibility was enhanced following positive pictures, whereas in the nonperformance-contingent condition, positive stimuli promoted cognitive stability. The imaging data showed that, as anticipated, the stability/flexibility trade-off per se was reflected in differential recruitment of dorsolateral frontoparietal and striatal regions. In contrast, the affective modulation of stability/flexibility shifts was mirrored, unexpectedly, by neural responses in ventromedial prefrontal and posterior cingulate cortices, core nodes of the “default mode” network. Our results demonstrate that the affective modulation of cognitive control depends on the performance contingency of the affect-inducing stimuli, and they document medial default mode regions to mediate the flexibility-promoting effects of performance-contingent positive affect, thus extending recent work that recasts these regions as serving a key role in on-task control processes. PMID:24155301

Stuttering Thoughts: Negative Self-Referent Thinking Is Less Sensitive to Aversive Outcomes in People with Higher Levels of Depressive Symptoms

PubMed Central

Iijima, Yudai; Takano, Keisuke; Boddez, Yannick; Raes, Filip; Tanno, Yoshihiko

2017-01-01

Learning theories of depression have proposed that depressive cognitions, such as negative thoughts with reference to oneself, can develop through a reinforcement learning mechanism. This negative self-reference is considered to be positively reinforced by rewarding experiences such as genuine support from others after negative self-disclosure, and negatively reinforced by avoidance of potential aversive situations. The learning account additionally predicts that negative self-reference would be maintained by an inability to adjust one’s behavior when negative self-reference no longer leads to such reward. To test this prediction, we designed an adapted version of the reversal-learning task. In this task, participants were reinforced to choose and engage in either negative or positive self-reference by probabilistic economic reward and punishment. Although participants were initially trained to choose negative self-reference, the stimulus-reward contingencies were reversed to prompt a shift toward positive self-reference (Study 1) and a further shift toward negative self-reference (Study 2). Model-based computational analyses showed that depressive symptoms were associated with a low learning rate of negative self-reference, indicating a high level of reward expectancy for negative self-reference even after the contingency reversal. Furthermore, the difficulty in updating outcome predictions of negative self-reference was significantly associated with the extent to which one possesses negative self-images. These results suggest that difficulty in adjusting action-outcome estimates for negative self-reference increases the chance to be faced with negative aspects of self, which may result in depressive symptoms. PMID:28824511

Mediodorsal thalamus hypofunction impairs flexible goal-directed behavior.

PubMed

Parnaudeau, Sébastien; Taylor, Kathleen; Bolkan, Scott S; Ward, Ryan D; Balsam, Peter D; Kellendonk, Christoph

2015-03-01

Cognitive inflexibility is a core symptom of several mental disorders including schizophrenia. Brain imaging studies in schizophrenia patients performing cognitive tasks have reported decreased activation of the mediodorsal thalamus (MD). Using a pharmacogenetic approach to model MD hypofunction, we recently showed that decreasing MD activity impairs reversal learning in mice. While this demonstrates causality between MD hypofunction and cognitive inflexibility, questions remain about the elementary cognitive processes that account for the deficit. Using the Designer Receptors Exclusively Activated by Designer Drugs system, we reversibly decreased MD activity during behavioral tasks assessing elementary cognitive processes inherent to flexible goal-directed behaviors, including extinction, contingency degradation, outcome devaluation, and Pavlovian-to-instrumental transfer (n = 134 mice). While MD hypofunction impaired reversal learning, it did not affect the ability to learn about nonrewarded cues or the ability to modulate action selection based on the outcome value. In contrast, decreasing MD activity delayed the ability to adapt to changes in the contingency between actions and their outcomes. In addition, while Pavlovian learning was not affected by MD hypofunction, decreasing MD activity during Pavlovian learning impaired the ability of conditioned stimuli to modulate instrumental behavior. Mediodorsal thalamus hypofunction causes cognitive inflexibility reflected by an impaired ability to adapt actions when their consequences change. Furthermore, it alters the encoding of environmental stimuli so that they cannot be properly utilized to guide behavior. Modulating MD activity could be a potential therapeutic strategy for promoting adaptive behavior in human subjects with cognitive inflexibility. Copyright © 2015 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Stuttering Thoughts: Negative Self-Referent Thinking Is Less Sensitive to Aversive Outcomes in People with Higher Levels of Depressive Symptoms.

PubMed

Iijima, Yudai; Takano, Keisuke; Boddez, Yannick; Raes, Filip; Tanno, Yoshihiko

2017-01-01

Learning theories of depression have proposed that depressive cognitions, such as negative thoughts with reference to oneself, can develop through a reinforcement learning mechanism. This negative self-reference is considered to be positively reinforced by rewarding experiences such as genuine support from others after negative self-disclosure, and negatively reinforced by avoidance of potential aversive situations. The learning account additionally predicts that negative self-reference would be maintained by an inability to adjust one's behavior when negative self-reference no longer leads to such reward. To test this prediction, we designed an adapted version of the reversal-learning task. In this task, participants were reinforced to choose and engage in either negative or positive self-reference by probabilistic economic reward and punishment. Although participants were initially trained to choose negative self-reference, the stimulus-reward contingencies were reversed to prompt a shift toward positive self-reference (Study 1) and a further shift toward negative self-reference (Study 2). Model-based computational analyses showed that depressive symptoms were associated with a low learning rate of negative self-reference, indicating a high level of reward expectancy for negative self-reference even after the contingency reversal. Furthermore, the difficulty in updating outcome predictions of negative self-reference was significantly associated with the extent to which one possesses negative self-images. These results suggest that difficulty in adjusting action-outcome estimates for negative self-reference increases the chance to be faced with negative aspects of self, which may result in depressive symptoms.

Gaze-contingent reinforcement learning reveals incentive value of social signals in young children and adults

PubMed Central

Smith, Tim J.; Senju, Atsushi

2017-01-01

While numerous studies have demonstrated that infants and adults preferentially orient to social stimuli, it remains unclear as to what drives such preferential orienting. It has been suggested that the learned association between social cues and subsequent reward delivery might shape such social orienting. Using a novel, spontaneous indication of reinforcement learning (with the use of a gaze contingent reward-learning task), we investigated whether children and adults' orienting towards social and non-social visual cues can be elicited by the association between participants' visual attention and a rewarding outcome. Critically, we assessed whether the engaging nature of the social cues influences the process of reinforcement learning. Both children and adults learned to orient more often to the visual cues associated with reward delivery, demonstrating that cue–reward association reinforced visual orienting. More importantly, when the reward-predictive cue was social and engaging, both children and adults learned the cue–reward association faster and more efficiently than when the reward-predictive cue was social but non-engaging. These new findings indicate that social engaging cues have a positive incentive value. This could possibly be because they usually coincide with positive outcomes in real life, which could partly drive the development of social orienting. PMID:28250186

Gaze-contingent reinforcement learning reveals incentive value of social signals in young children and adults.

PubMed

Vernetti, Angélina; Smith, Tim J; Senju, Atsushi

2017-03-15

While numerous studies have demonstrated that infants and adults preferentially orient to social stimuli, it remains unclear as to what drives such preferential orienting. It has been suggested that the learned association between social cues and subsequent reward delivery might shape such social orienting. Using a novel, spontaneous indication of reinforcement learning (with the use of a gaze contingent reward-learning task), we investigated whether children and adults' orienting towards social and non-social visual cues can be elicited by the association between participants' visual attention and a rewarding outcome. Critically, we assessed whether the engaging nature of the social cues influences the process of reinforcement learning. Both children and adults learned to orient more often to the visual cues associated with reward delivery, demonstrating that cue-reward association reinforced visual orienting. More importantly, when the reward-predictive cue was social and engaging, both children and adults learned the cue-reward association faster and more efficiently than when the reward-predictive cue was social but non-engaging. These new findings indicate that social engaging cues have a positive incentive value. This could possibly be because they usually coincide with positive outcomes in real life, which could partly drive the development of social orienting. © 2017 The Authors.

Measuring reinforcement learning and motivation constructs in experimental animals: relevance to the negative symptoms of schizophrenia.

PubMed

Markou, Athina; Salamone, John D; Bussey, Timothy J; Mar, Adam C; Brunner, Daniela; Gilmour, Gary; Balsam, Peter

2013-11-01

The present review article summarizes and expands upon the discussions that were initiated during a meeting of the Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS; http://cntrics.ucdavis.edu) meeting. A major goal of the CNTRICS meeting was to identify experimental procedures and measures that can be used in laboratory animals to assess psychological constructs that are related to the psychopathology of schizophrenia. The issues discussed in this review reflect the deliberations of the Motivation Working Group of the CNTRICS meeting, which included most of the authors of this article as well as additional participants. After receiving task nominations from the general research community, this working group was asked to identify experimental procedures in laboratory animals that can assess aspects of reinforcement learning and motivation that may be relevant for research on the negative symptoms of schizophrenia, as well as other disorders characterized by deficits in reinforcement learning and motivation. The tasks described here that assess reinforcement learning are the Autoshaping Task, Probabilistic Reward Learning Tasks, and the Response Bias Probabilistic Reward Task. The tasks described here that assess motivation are Outcome Devaluation and Contingency Degradation Tasks and Effort-Based Tasks. In addition to describing such methods and procedures, the present article provides a working vocabulary for research and theory in this field, as well as an industry perspective about how such tasks may be used in drug discovery. It is hoped that this review can aid investigators who are conducting research in this complex area, promote translational studies by highlighting shared research goals and fostering a common vocabulary across basic and clinical fields, and facilitate the development of medications for the treatment of symptoms mediated by reinforcement learning and motivational deficits. Copyright © 2013 Elsevier Ltd. All rights reserved.

Measuring reinforcement learning and motivation constructs in experimental animals: relevance to the negative symptoms of schizophrenia

PubMed Central

Markou, Athina; Salamone, John D.; Bussey, Timothy; Mar, Adam; Brunner, Daniela; Gilmour, Gary; Balsam, Peter

2013-01-01

The present review article summarizes and expands upon the discussions that were initiated during a meeting of the Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS; http://cntrics.ucdavis.edu). A major goal of the CNTRICS meeting was to identify experimental procedures and measures that can be used in laboratory animals to assess psychological constructs that are related to the psychopathology of schizophrenia. The issues discussed in this review reflect the deliberations of the Motivation Working Group of the CNTRICS meeting, which included most of the authors of this article as well as additional participants. After receiving task nominations from the general research community, this working group was asked to identify experimental procedures in laboratory animals that can assess aspects of reinforcement learning and motivation that may be relevant for research on the negative symptoms of schizophrenia, as well as other disorders characterized by deficits in reinforcement learning and motivation. The tasks described here that assess reinforcement learning are the Autoshaping Task, Probabilistic Reward Learning Tasks, and the Response Bias Probabilistic Reward Task. The tasks described here that assess motivation are Outcome Devaluation and Contingency Degradation Tasks and Effort-Based Tasks. In addition to describing such methods and procedures, the present article provides a working vocabulary for research and theory in this field, as well as an industry perspective about how such tasks may be used in drug discovery. It is hoped that this review can aid investigators who are conducting research in this complex area, promote translational studies by highlighting shared research goals and fostering a common vocabulary across basic and clinical fields, and facilitate the development of medications for the treatment of symptoms mediated by reinforcement learning and motivational deficits. PMID:23994273

Astronaut David Wolf participates in training for contingency EVA in WETF

NASA Image and Video Library

1993-04-03

S93-31706 (3 April 1993) --- With the aid of technicians and training staffers astronaut David A. Wolf prepares to participate in training for contingency Extravehicular Activity (EVA) for the STS-58 mission. Sharing a moveable platform with Wolf was astronaut Shannon W. Lucid (out of frame). For simulation purposes, the two mission specialists were about to be submerged to a point of neutral buoyancy in the Johnson Space Center's (JSC) Weightless Environment Training Facility (WET-F). Though the Spacelab Life Sciences (SLS-2) mission does not include a planned EVA, all crews designate members to learn proper procedures to perform outside the spacecraft in the event of failure of remote means to accomplish those tasks.

Astronaut Shannon Lucid in training for contingency EVA for STS-58 in WETF

NASA Image and Video Library

1993-04-03

S93-31697 (3 April 1993) --- Astronaut Shannon W. Lucid participates in training for contingency Extravehicular Activity (EVA) for the STS-58 mission. Behind Lucid, sharing a moveable platform with her, is astronaut David A. Wolf (out of frame). For simulation purposes, the two mission specialists were about to be submerged to a point of neutral buoyancy in the Johnson Space Center's (JSC) Weightless Environment Training Facility (WET-F). Though the Spacelab Life Sciences (SLS-2) mission does not include a planned EVA, all crews designate members to learn proper procedures to perform outside the spacecraft in the event of failure of remote means to accomplish those tasks.

Solving the Credit Assignment Problem With the Prefrontal Cortex

PubMed Central

Stolyarova, Alexandra

2018-01-01

In naturalistic multi-cue and multi-step learning tasks, where outcomes of behavior are delayed in time, discovering which choices are responsible for rewards can present a challenge, known as the credit assignment problem. In this review, I summarize recent work that highlighted a critical role for the prefrontal cortex (PFC) in assigning credit where it is due in tasks where only a few of the multitude of cues or choices are relevant to the final outcome of behavior. Collectively, these investigations have provided compelling support for specialized roles of the orbitofrontal (OFC), anterior cingulate (ACC), and dorsolateral prefrontal (dlPFC) cortices in contingent learning. However, recent work has similarly revealed shared contributions and emphasized rich and heterogeneous response properties of neurons in these brain regions. Such functional overlap is not surprising given the complexity of reciprocal projections spanning the PFC. In the concluding section, I overview the evidence suggesting that the OFC, ACC and dlPFC communicate extensively, sharing the information about presented options, executed decisions and received rewards, which enables them to assign credit for outcomes to choices on which they are contingent. This account suggests that lesion or inactivation/inhibition experiments targeting a localized PFC subregion will be insufficient to gain a fine-grained understanding of credit assignment during learning and instead poses refined questions for future research, shifting the focus from focal manipulations to experimental techniques targeting cortico-cortical projections. PMID:29636659

Enhanced performance of aged rats in contingency degradation and instrumental extinction tasks.

PubMed

Samson, Rachel D; Venkatesh, Anu; Patel, Dhara H; Lipa, Peter; Barnes, Carol A

2014-04-01

Normal aging in rats affects behavioral performance on a variety of associative learning tasks under Pavlovian conditions. There is little information, however, on whether aging also impacts performance of instrumental tasks. Young (9-12 months) and aged (24-27 months) Fisher 344 rats were trained to press distinct levers associated with either maltodextrin or sucrose. The rats in both age groups increased their lever press frequency at a similar rate, suggesting that the initial acquisition of this instrumental task is not affected by aging. Using a contingency degradation procedure, we then addressed whether aged rats could adapt their behavior to changes in action-outcome contingencies. We found that young and aged rats do adapt, but that a different schedule of reinforcement is necessary to optimize performance in each age group. Finally, we also addressed whether aged rats can extinguish a lever press action as well as young rats, using 2 40-min extinction sessions on consecutive days. While extinction profiles were similar in young and aged rats on the first day of training, aged rats were faster to extinguish their lever presses on the second day, in spite of their performance levels being similar at the beginning of the session. Together these data support the finding that acquisition of instrumental lever press behaviors is preserved in aged rats and suggest that they have a different threshold for switching strategies in response to changes in action-outcome associations. This pattern of result implies that age-related changes in the brain are heterogeneous and widespread across structures.

Enhanced performance of aged rats in contingency degradation and instrumental extinction tasks

PubMed Central

Samson, Rachel D.; Venkatesh, Anu; Patel, Dhara H.; Lipa, Peter; Barnes, Carol A.

2014-01-01

Normal aging in rats affects behavioral performance on a variety of associative learning tasks under Pavlovian conditions. There is little information, however, on whether aging also impacts performance of instrumental tasks. Young (9–12 mo) and aged (24–27 mo) Fisher 344 rats were trained to press distinct levers associated with either maltodextrin or sucrose. The rats in both age groups increased their lever press frequency at a similar rate, suggesting that the initial acquisition of this instrumental task is not affected by aging. Using a contingency degradation procedure, we then addressed whether aged rats could adapt their behavior to changes in action-outcome contingencies. We found that young and aged rats do adapt, but that a different schedule of reinforcement is necessary to optimize performance in each age group. Finally, we also addressed whether aged rats can extinguish a lever press action as well as young rats, using two forty minute extinction sessions on consecutive days. While extinction profiles were similar in young and aged rats on the first day of training, aged rats were faster to extinguish their lever presses on the second day, in spite of their performance levels being similar at the beginning of the session. Together these data support the finding that acquisition of instrumental lever press behaviors is preserved in aged rats, and suggest that they have a different threshold for switching strategies in response to changes in action-outcome associations. This pattern of result implies that age-related changes in the brain are heterogeneous and widespread across structures. PMID:24773433

Probabilistic Reversal Learning in Schizophrenia: Stability of Deficits and Potential Causal Mechanisms.

PubMed

Reddy, Lena Felice; Waltz, James A; Green, Michael F; Wynn, Jonathan K; Horan, William P

2016-07-01

Although individuals with schizophrenia show impaired feedback-driven learning on probabilistic reversal learning (PRL) tasks, the specific factors that contribute to these deficits remain unknown. Recent work has suggested several potential causes including neurocognitive impairments, clinical symptoms, and specific types of feedback-related errors. To examine this issue, we administered a PRL task to 126 stable schizophrenia outpatients and 72 matched controls, and patients were retested 4 weeks later. The task involved an initial probabilistic discrimination learning phase and subsequent reversal phases in which subjects had to adjust their responses to sudden shifts in the reinforcement contingencies. Patients showed poorer performance than controls for both the initial discrimination and reversal learning phases of the task, and performance overall showed good test-retest reliability among patients. A subgroup analysis of patients (n = 64) and controls (n = 49) with good initial discrimination learning revealed no between-group differences in reversal learning, indicating that the patients who were able to achieve all of the initial probabilistic discriminations were not impaired in reversal learning. Regarding potential contributors to impaired discrimination learning, several factors were associated with poor PRL, including higher levels of neurocognitive impairment, poor learning from both positive and negative feedback, and higher levels of indiscriminate response shifting. The results suggest that poor PRL performance in schizophrenia can be the product of multiple mechanisms. © The Author 2016. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For permissions, please email: journals.permissions@oup.com.

Crayfish Self-Administer Amphetamine in a Spatially Contingent Task.

PubMed

Datta, Udita; van Staaden, Moira; Huber, Robert

2018-01-01

Natural reward is an essential element of any organism's ability to adapt to environmental variation. Its underlying circuits and mechanisms guide the learning process as they help associate an event, or cue, with the perception of an outcome's value. More generally, natural reward serves as the fundamental generator of all motivated behavior. Addictive plant alkaloids are able to activate this circuitry in taxa ranging from planaria to humans. With modularly organized nervous systems and confirmed vulnerabilities to human drugs of abuse, crayfish have recently emerged as a compelling model for the study of the addiction cycle, including psychostimulant effects, sensitization, withdrawal, reinstatement, and drug reward in conditioned place preference paradigms. Here we extend this work with the demonstration of a spatially contingent, operant drug self-administration paradigm for amphetamine. When the animal enters a quadrant of the arena with a particular textured substrate, a computer-based control system delivers amphetamine through an indwelling fine-bore cannula. Resulting reward strength, dose-response, and the time course of operant conditioning were assessed. Individuals experiencing the drug contingent on their behavior, displayed enhanced rates of operant responses compared to that of their yoked (non-contingent) counterparts. Application of amphetamine near the supra-esophageal ganglion elicited stronger and more robust increases in operant responding than did systemic infusions. This work demonstrates automated implementation of a spatially contingent self-administration paradigm in crayfish, which provides a powerful tool to explore comparative perspectives in drug-sensitive reward, the mechanisms of learning underlying the addictive cycle, and phylogenetically conserved vulnerabilities to psychostimulant compounds.

Crayfish Self-Administer Amphetamine in a Spatially Contingent Task

PubMed Central

Datta, Udita; van Staaden, Moira; Huber, Robert

2018-01-01

Natural reward is an essential element of any organism’s ability to adapt to environmental variation. Its underlying circuits and mechanisms guide the learning process as they help associate an event, or cue, with the perception of an outcome’s value. More generally, natural reward serves as the fundamental generator of all motivated behavior. Addictive plant alkaloids are able to activate this circuitry in taxa ranging from planaria to humans. With modularly organized nervous systems and confirmed vulnerabilities to human drugs of abuse, crayfish have recently emerged as a compelling model for the study of the addiction cycle, including psychostimulant effects, sensitization, withdrawal, reinstatement, and drug reward in conditioned place preference paradigms. Here we extend this work with the demonstration of a spatially contingent, operant drug self-administration paradigm for amphetamine. When the animal enters a quadrant of the arena with a particular textured substrate, a computer-based control system delivers amphetamine through an indwelling fine-bore cannula. Resulting reward strength, dose-response, and the time course of operant conditioning were assessed. Individuals experiencing the drug contingent on their behavior, displayed enhanced rates of operant responses compared to that of their yoked (non-contingent) counterparts. Application of amphetamine near the supra-esophageal ganglion elicited stronger and more robust increases in operant responding than did systemic infusions. This work demonstrates automated implementation of a spatially contingent self-administration paradigm in crayfish, which provides a powerful tool to explore comparative perspectives in drug-sensitive reward, the mechanisms of learning underlying the addictive cycle, and phylogenetically conserved vulnerabilities to psychostimulant compounds.

Preserved complex emotion-based learning in amnesia.

PubMed

Turnbull, Oliver H; Evans, Cathryn E Y

2006-01-01

An important role for emotion in decision-making has recently been highlighted by disruptions in problem solving abilities after lesion to the frontal lobes. Such complex decision-making skills appear to be based on a class of memory ability (emotion-based learning) that may be anatomically independent of hippocampally mediated episodic memory systems. There have long been reports of intact emotion-based learning in amnesia, arguably dating back to the classic report of Claparede. However, all such accounts relate to relatively simple patterns of emotional valence learning, rather than the more complex contingency patterns of emotional experience, which characterise everyday life. A patient, SL, who had a profound anterograde amnesia following posterior cerebral artery infarction, performed a measure of complex emotion-based learning (the Iowa Gambling Task) on three separate occasions. Despite his severe episodic memory impairment, he showed normal levels of performance on the Gambling Task, at levels comparable or better than controls-including learning that persisted across substantial periods of time (weeks). Thus, emotion-based learning systems appear able to encode, and sustain, more sophisticated patterns of valence learning than have previously been reported.

Comparing the neural basis of monetary reward and cognitive feedback during information-integration category learning.

PubMed

Daniel, Reka; Pollmann, Stefan

2010-01-06

The dopaminergic system is known to play a central role in reward-based learning (Schultz, 2006), yet it was also observed to be involved when only cognitive feedback is given (Aron et al., 2004). Within the domain of information-integration category learning, in which information from several stimulus dimensions has to be integrated predecisionally (Ashby and Maddox, 2005), the importance of contingent feedback is well established (Maddox et al., 2003). We examined the common neural correlates of reward anticipation and prediction error in this task. Sixteen subjects performed two parallel information-integration tasks within a single event-related functional magnetic resonance imaging session but received a monetary reward only for one of them. Similar functional areas including basal ganglia structures were activated in both task versions. In contrast, a single structure, the nucleus accumbens, showed higher activation during monetary reward anticipation compared with the anticipation of cognitive feedback in information-integration learning. Additionally, this activation was predicted by measures of intrinsic motivation in the cognitive feedback task and by measures of extrinsic motivation in the rewarded task. Our results indicate that, although all other structures implicated in category learning are not significantly affected by altering the type of reward, the nucleus accumbens responds to the positive incentive properties of an expected reward depending on the specific type of the reward.

Performance on the Hamilton search task, and the influence of lateralization, in captive orange-winged Amazon parrots (Amazona amazonica).

PubMed

Cussen, Victoria A; Mench, Joy A

2014-07-01

Psittacines are generally considered to possess cognitive abilities comparable to those of primates. Most psittacine research has evaluated performance on standardized complex cognition tasks, but studies of basic cognitive processes are limited. We tested orange-winged Amazon parrots (Amazona amazonica) on a spatial foraging assessment, the Hamilton search task. This task is a standardized test used in human and non-human primate studies. It has multiple phases, which require trial and error learning, learning set breaking, and spatial memory. We investigated search strategies used to complete the task, cognitive flexibility, and long-term memory for the task. We also assessed the effects of individual strength of motor lateralization (foot preference) and sex on task performance. Almost all (92%) of the parrots acquired the task. All had significant foot preferences, with 69% preferring their left foot, and showed side preferences contralateral to their preferred limb during location selection. The parrots were able to alter their search strategies when reward contingencies changed, demonstrating cognitive flexibility. They were also able to remember the task over a 6-month period. Lateralization had a significant influence on learning set acquisition but no effect on cognitive flexibility. There were no sex differences. To our knowledge, this is the first cognitive study using this particular species and one of the few studies of cognitive abilities in any Neotropical parrot species.

Using a Random Dependent Group Contingency to Increase On-Task Behaviors of High School Students with High Incidence Disabilities

ERIC Educational Resources Information Center

Williamson, Brenda D.; Campbell-Whatley, Gloria D.; Lo, Ya-yu

2009-01-01

Group contingencies have the advantages of encouraging individual students to collectively feel responsible for appropriate and inappropriate classroom behaviors and have shown effectiveness in improving students' behavior. The purpose of this study was to investigate the effects of a random dependent group contingency on the on-task behaviors of…

Category learning in the color-word contingency learning paradigm.

PubMed

Schmidt, James R; Augustinova, Maria; De Houwer, Jan

2018-04-01

In the typical color-word contingency learning paradigm, participants respond to the print color of words where each word is presented most often in one color. Learning is indicated by faster and more accurate responses when a word is presented in its usual color, relative to another color. To eliminate the possibility that this effect is driven exclusively by the familiarity of item-specific word-color pairings, we examine whether contingency learning effects can be observed also when colors are related to categories of words rather than to individual words. To this end, the reported experiments used three categories of words (animals, verbs, and professions) that were each predictive of one color. Importantly, each individual word was presented only once, thus eliminating individual color-word contingencies. Nevertheless, for the first time, a category-based contingency effect was observed, with faster and more accurate responses when a category item was presented in the color in which most of the other items of that category were presented. This finding helps to constrain episodic learning models and sets the stage for new research on category-based contingency learning.

Contingent capture of visual-spatial attention depends on capacity-limited central mechanisms: evidence from human electrophysiology and the psychological refractory period.

PubMed

Brisson, Benoit; Leblanc, Emilie; Jolicoeur, Pierre

2009-02-01

It has recently been demonstrated that a lateralized distractor that matches the individual's top-down control settings elicits an N2pc wave, an electrophysiological index of the focus of visual-spatial attention, indicating that contingent capture has a visual-spatial locus. Here, we investigated whether contingent capture required capacity-limited central resources by incorporating a contingent capture task as the second task of a psychological refractory period (PRP) dual-task paradigm. The N2pc was used to monitor where observers were attending while they performed concurrent central processing known to cause the PRP effect. The N2pc elicited by the lateralized distractor that matched the top-down control settings was attenuated in high concurrent central load conditions, indicating that although involuntary, the deployment of visual-spatial attention occurring during contingent capture depends on capacity-limited central resources.

Just tell me what to do: bringing back experimenter control in active contingency tasks with the command-performance procedure and finding cue density effects along the way.

PubMed

Hannah, Samuel D; Beneteau, Jennifer L

2009-03-01

Active contingency tasks, such as those used to explore judgments of control, suffer from variability in the actual values of critical variables. The authors debut a new, easily implemented procedure that restores control over these variables to the experimenter simply by telling participants when to respond, and when to withhold responding. This command-performance procedure not only restores control over critical variables such as actual contingency, it also allows response frequency to be manipulated independently of contingency or outcome frequency. This yields the first demonstration, to our knowledge, of the equivalent of a cue density effect in an active contingency task. Judgments of control are biased by response frequency outcome frequency, just as they are also biased by outcome frequency. (c) 2009 APA, all rights reserved

Extended child and caregiver benefits of behavior-based child contingency learning games.

PubMed

Dunst, Carl J; Raab, Melinda; Trivette, Carol M; Wilson, Linda L; Hamby, Deborah W; Parkey, Cindy

2010-08-01

Findings from 2 studies of the relationship between response-contingent child behavior and child, caregiver-child, and caregiver behavior not directly associated with child contingency learning are described. The participants were 19 children with significant developmental delays and their mothers in 1 study and 22 children with significant developmental delays and their teachers in the second study. Caregivers engaged the children in learning games characterized by behavior-based contingencies for 15 weeks. Research staff observed the children and their caregivers in everyday routines and activities and rated child and caregiver behavior while the children and caregivers were not playing the games. Results from both studies showed that the degree of response-contingent responding during the games was related to child and caregiver behavior, not the focus of the contingency learning opportunities afforded the children. Implications for practice are described.

Orbitofrontal Cortex Signals Expected Outcomes with Predictive Codes When Stable Contingencies Promote the Integration of Reward History

PubMed Central

Shapiro, Matthew L.

2017-01-01

Memory can inform goal-directed behavior by linking current opportunities to past outcomes. The orbitofrontal cortex (OFC) may guide value-based responses by integrating the history of stimulus–reward associations into expected outcomes, representations of predicted hedonic value and quality. Alternatively, the OFC may rapidly compute flexible “online” reward predictions by associating stimuli with the latest outcome. OFC neurons develop predictive codes when rats learn to associate arbitrary stimuli with outcomes, but the extent to which predictive coding depends on most recent events and the integrated history of rewards is unclear. To investigate how reward history modulates OFC activity, we recorded OFC ensembles as rats performed spatial discriminations that differed only in the number of rewarded trials between goal reversals. The firing rate of single OFC neurons distinguished identical behaviors guided by different goals. When >20 rewarded trials separated goal switches, OFC ensembles developed stable and anticorrelated population vectors that predicted overall choice accuracy and the goal selected in single trials. When <10 rewarded trials separated goal switches, OFC population vectors decorrelated rapidly after each switch, but did not develop anticorrelated firing patterns or predict choice accuracy. The results show that, whereas OFC signals respond rapidly to contingency changes, they predict choices only when reward history is relatively stable, suggesting that consecutive rewarded episodes are needed for OFC computations that integrate reward history into expected outcomes. SIGNIFICANCE STATEMENT Adapting to changing contingencies and making decisions engages the orbitofrontal cortex (OFC). Previous work shows that OFC function can either improve or impair learning depending on reward stability, suggesting that OFC guides behavior optimally when contingencies apply consistently. The mechanisms that link reward history to OFC computations remain obscure. Here, we examined OFC unit activity as rodents performed tasks controlled by contingencies that varied reward history. When contingencies were stable, OFC neurons signaled past, present, and pending events; when contingencies were unstable, past and present coding persisted, but predictive coding diminished. The results suggest that OFC mechanisms require stable contingencies across consecutive episodes to integrate reward history, represent predicted outcomes, and inform goal-directed choices. PMID:28115481

Astronaut David Wolf participates in training for contingency EVA in WETF

NASA Image and Video Library

1993-04-03

S93-31701 (3 April 1993) --- Displaying the flexibility of his training version of the Shuttle Extravehicular Mobility Unit (EMU) space suit, astronaut David A. Wolf participates in training for contingency Extravehicular Activity (EVA) for the STS-58 mission. Behind Wolf, sharing the platform with him was astronaut Shannon W. Lucid. For simulation purposes, the two mission specialists were about to be submerged to a point of neutral buoyancy in the Johnson Space Center's (JSC) Weightless Environment Training Facility (WET-F). Though the Spacelab Life Sciences (SLS-2) mission does not include a planned EVA, all crews designate members to learn proper procedures to perform outside the spacecraft in the event of failure of remote means to accomplish those tasks.

Individual Differences, Intelligence, and Behavior Analysis

PubMed Central

Williams, Ben; Myerson, Joel; Hale, Sandra

2008-01-01

Despite its avowed goal of understanding individual behavior, the field of behavior analysis has largely ignored the determinants of consistent differences in level of performance among individuals. The present article discusses major findings in the study of individual differences in intelligence from the conceptual framework of a functional analysis of behavior. In addition to general intelligence, we discuss three other major aspects of behavior in which individuals differ: speed of processing, working memory, and the learning of three-term contingencies. Despite recent progress in our understanding of the relations among these aspects of behavior, numerous issues remain unresolved. Researchers need to determine which learning tasks predict individual differences in intelligence and which do not, and then identify the specific characteristics of these tasks that make such prediction possible. PMID:18831127

The Role of Feedback Contingency in Perceptual Category Learning

ERIC Educational Resources Information Center

Ashby, F. Gregory; Vucovich, Lauren E.

2016-01-01

Feedback is highly contingent on behavior if it eventually becomes easy to predict, and weakly contingent on behavior if it remains difficult or impossible to predict even after learning is complete. Many studies have demonstrated that humans and nonhuman animals are highly sensitive to feedback contingency, but no known studies have examined how…

Early Child Contingency Learning and Detection: Research Evidence and Implications for Practice

ERIC Educational Resources Information Center

Dunst, Carl J.; Trivette, Carol M.; Raab, Melinda; Masiello, Tracy L.

2008-01-01

The types of contingency experiences infants and young children are typically exposed to are examined with a focus on the implications for early childhood intervention with young children who have developmental disabilities and delays. Studies of response-contingent child learning, the manner in which contingencies are not under direct child…

Disentangling Genuine Semantic Stroop Effects in Reading from Contingency Effects: On the Need for Two Neutral Baselines

PubMed Central

Lorentz, Eric; McKibben, Tessa; Ekstrand, Chelsea; Gould, Layla; Anton, Kathryn; Borowsky, Ron

2016-01-01

The automaticity of reading is often explored through the Stroop effect, whereby color-naming is affected by color words. Color associates (e.g., “sky”) also produce a Stroop effect, suggesting that automatic reading occurs through to the level of semantics, even when reading sub-lexically (e.g., the pseudohomophone “skigh”). However, several previous experiments have confounded congruency with contingency learning, whereby faster responding occurs for more frequent stimuli. Contingency effects reflect a higher frequency-pairing of the word with a font color in the congruent condition than in the incongruent condition due to the limited set of congruent pairings. To determine the extent to which the Stroop effect can be attributed to contingency learning of font colors paired with lexical (word-level) and sub-lexical (phonetically decoded) letter strings, as well as assess facilitation and interference relative to contingency effects, we developed two neutral baselines: each one matched on pair-frequency for congruent and incongruent color words. In Experiments 1 and 3, color words (e.g., “blue”) and their pseudohomophones (e.g., “bloo”) produced significant facilitation and interference relative to neutral baselines, regardless of whether the onset (i.e., first phoneme) was matched to the color words. Color associates (e.g., “ocean”) and their pseudohomophones (e.g., “oshin”), however, showed no significant facilitation or interference relative to onset matched neutral baselines (Experiment 2). When onsets were unmatched, color associate words produced consistent facilitation on RT (e.g., “ocean” vs. “dozen”), but pseudohomophones (e.g., “oshin” vs. “duhzen”) failed to produce facilitation or interference. Our findings suggest that the Stroop effects for color and associated stimuli are sensitive to the type of neutral baseline used, as well as stimulus type (word vs. pseudohomophone). In general, contingency learning plays a large role when repeating congruent items more than incongruent items, but appropriate pair-frequency matched neutral baselines allow for the assessment of genuine facilitation and interference. Using such baselines, we found reading processes proceed to a semantic level for familiar words, but not pseudohomophones (i.e., phonetic decoding). Such assessment is critical for separating the effects of genuine congruency from contingency during automatic word reading in the Stroop task, and when used with color associates, isolates the semantic contribution. PMID:27014177

Disentangling Genuine Semantic Stroop Effects in Reading from Contingency Effects: On the Need for Two Neutral Baselines.

PubMed

Lorentz, Eric; McKibben, Tessa; Ekstrand, Chelsea; Gould, Layla; Anton, Kathryn; Borowsky, Ron

2016-01-01

The automaticity of reading is often explored through the Stroop effect, whereby color-naming is affected by color words. Color associates (e.g., "sky") also produce a Stroop effect, suggesting that automatic reading occurs through to the level of semantics, even when reading sub-lexically (e.g., the pseudohomophone "skigh"). However, several previous experiments have confounded congruency with contingency learning, whereby faster responding occurs for more frequent stimuli. Contingency effects reflect a higher frequency-pairing of the word with a font color in the congruent condition than in the incongruent condition due to the limited set of congruent pairings. To determine the extent to which the Stroop effect can be attributed to contingency learning of font colors paired with lexical (word-level) and sub-lexical (phonetically decoded) letter strings, as well as assess facilitation and interference relative to contingency effects, we developed two neutral baselines: each one matched on pair-frequency for congruent and incongruent color words. In Experiments 1 and 3, color words (e.g., "blue") and their pseudohomophones (e.g., "bloo") produced significant facilitation and interference relative to neutral baselines, regardless of whether the onset (i.e., first phoneme) was matched to the color words. Color associates (e.g., "ocean") and their pseudohomophones (e.g., "oshin"), however, showed no significant facilitation or interference relative to onset matched neutral baselines (Experiment 2). When onsets were unmatched, color associate words produced consistent facilitation on RT (e.g., "ocean" vs. "dozen"), but pseudohomophones (e.g., "oshin" vs. "duhzen") failed to produce facilitation or interference. Our findings suggest that the Stroop effects for color and associated stimuli are sensitive to the type of neutral baseline used, as well as stimulus type (word vs. pseudohomophone). In general, contingency learning plays a large role when repeating congruent items more than incongruent items, but appropriate pair-frequency matched neutral baselines allow for the assessment of genuine facilitation and interference. Using such baselines, we found reading processes proceed to a semantic level for familiar words, but not pseudohomophones (i.e., phonetic decoding). Such assessment is critical for separating the effects of genuine congruency from contingency during automatic word reading in the Stroop task, and when used with color associates, isolates the semantic contribution.

Microstimulation of the Human Substantia Nigra Alters Reinforcement Learning

PubMed Central

Ramayya, Ashwin G.; Misra, Amrit

2014-01-01

Animal studies have shown that substantia nigra (SN) dopaminergic (DA) neurons strengthen action–reward associations during reinforcement learning, but their role in human learning is not known. Here, we applied microstimulation in the SN of 11 patients undergoing deep brain stimulation surgery for the treatment of Parkinson's disease as they performed a two-alternative probability learning task in which rewards were contingent on stimuli, rather than actions. Subjects demonstrated decreased learning from reward trials that were accompanied by phasic SN microstimulation compared with reward trials without stimulation. Subjects who showed large decreases in learning also showed an increased bias toward repeating actions after stimulation trials; therefore, stimulation may have decreased learning by strengthening action–reward associations rather than stimulus–reward associations. Our findings build on previous studies implicating SN DA neurons in preferentially strengthening action–reward associations during reinforcement learning. PMID:24828643

Statistical learning as an individual ability: Theoretical perspectives and empirical evidence

PubMed Central

Siegelman, Noam; Frost, Ram

2015-01-01

Although the power of statistical learning (SL) in explaining a wide range of linguistic functions is gaining increasing support, relatively little research has focused on this theoretical construct from the perspective of individual differences. However, to be able to reliably link individual differences in a given ability such as language learning to individual differences in SL, three critical theoretical questions should be posed: Is SL a componential or unified ability? Is it nested within other general cognitive abilities? Is it a stable capacity of an individual? Following an initial mapping sentence outlining the possible dimensions of SL, we employed a battery of SL tasks in the visual and auditory modalities, using verbal and non-verbal stimuli, with adjacent and non-adjacent contingencies. SL tasks were administered along with general cognitive tasks in a within-subject design at two time points to explore our theoretical questions. We found that SL, as measured by some tasks, is a stable and reliable capacity of an individual. Moreover, we found SL to be independent of general cognitive abilities such as intelligence or working memory. However, SL is not a unified capacity, so that individual sensitivity to conditional probabilities is not uniform across modalities and stimuli. PMID:25821343

Acquisition of automatic imitation is sensitive to sensorimotor contingency.

PubMed

Cook, Richard; Press, Clare; Dickinson, Anthony; Heyes, Cecilia

2010-08-01

The associative sequence learning model proposes that the development of the mirror system depends on the same mechanisms of associative learning that mediate Pavlovian and instrumental conditioning. To test this model, two experiments used the reduction of automatic imitation through incompatible sensorimotor training to assess whether mirror system plasticity is sensitive to contingency (i.e., the extent to which activation of one representation predicts activation of another). In Experiment 1, residual automatic imitation was measured following incompatible training in which the action stimulus was a perfect predictor of the response (contingent) or not at all predictive of the response (noncontingent). A contingency effect was observed: There was less automatic imitation indicative of more learning in the contingent group. Experiment 2 replicated this contingency effect and showed that, as predicted by associative learning theory, it can be abolished by signaling trials in which the response occurs in the absence of an action stimulus. These findings support the view that mirror system development depends on associative learning and indicate that this learning is not purely Hebbian. If this is correct, associative learning theory could be used to explain, predict, and intervene in mirror system development.

Dual learning processes underlying human decision-making in reversal learning tasks: functional significance and evidence from the model fit to human behavior

PubMed Central

Bai, Yu; Katahira, Kentaro; Ohira, Hideki

2014-01-01

Humans are capable of correcting their actions based on actions performed in the past, and this ability enables them to adapt to a changing environment. The computational field of reinforcement learning (RL) has provided a powerful explanation for understanding such processes. Recently, the dual learning system, modeled as a hybrid model that incorporates value update based on reward-prediction error and learning rate modulation based on the surprise signal, has gained attention as a model for explaining various neural signals. However, the functional significance of the hybrid model has not been established. In the present study, we used computer simulation in a reversal learning task to address functional significance in a probabilistic reversal learning task. The hybrid model was found to perform better than the standard RL model in a large parameter setting. These results suggest that the hybrid model is more robust against the mistuning of parameters compared with the standard RL model when decision-makers continue to learn stimulus-reward contingencies, which can create abrupt changes. The parameter fitting results also indicated that the hybrid model fit better than the standard RL model for more than 50% of the participants, which suggests that the hybrid model has more explanatory power for the behavioral data than the standard RL model. PMID:25161635

Impaired Value Learning for Faces in Preschoolers With Autism Spectrum Disorder.

PubMed

Wang, Quan; DiNicola, Lauren; Heymann, Perrine; Hampson, Michelle; Chawarska, Katarzyna

2018-01-01

One of the common findings in autism spectrum disorder (ASD) is limited selective attention toward social objects, such as faces. Evidence from both human and nonhuman primate studies suggests that selection of objects for processing is guided by the appraisal of object values. We hypothesized that impairments in selective attention in ASD may reflect a disruption of a system supporting learning about object values in the social domain. We examined value learning in social (faces) and nonsocial (fractals) domains in preschoolers with ASD (n = 25) and typically developing (TD) controls (n = 28), using a novel value learning task implemented on a gaze-contingent eye-tracking platform consisting of value learning and a selective attention choice test. Children with ASD performed more poorly than TD controls on the social value learning task, but both groups performed similarly on the nonsocial task. Within-group comparisons indicated that value learning in TD children was enhanced on the social compared to the nonsocial task, but no such enhancement was seen in children with ASD. Performance in the social and nonsocial conditions was correlated in the ASD but not in the TD group. The study provides support for a domain-specific impairment in value learning for faces in ASD, and suggests that, in ASD, value learning in social and nonsocial domains may rely on a shared mechanism. These findings have implications both for models of selective social attention deficits in autism and for identification of novel treatment targets. Copyright © 2017 American Academy of Child and Adolescent Psychiatry. Published by Elsevier Inc. All rights reserved.

Influence of contingency awareness on neural, electrodermal and evaluative responses during fear conditioning

PubMed Central

Merz, Christian J.; Klucken, Tim; Schweckendiek, Jan; Vaitl, Dieter; Wolf, Oliver T.; Stark, Rudolf

2011-01-01

In an fMRI study, effects of contingency awareness on conditioned responses were assessed in three groups comprising 118 subjects. A differential fear-conditioning paradigm with visual conditioned stimuli, an electrical unconditioned stimulus and two distractors was applied. The instructed aware group was informed about the contingencies, whereas the distractors prevented contingency detection in the unaware group. The third group (learned aware) was not informed about the contingencies, but learned them despite the distractors. Main effects of contingency awareness on conditioned responses emerged in several brain structures. Post hoc tests revealed differential dorsal anterior cingulate, insula and ventral striatum responses in aware conditioning only, whereas the amygdala was activated independent of contingency awareness. Differential responses of the hippocampus were specifically observed in learned aware subjects, indicating a role in the development of contingency awareness. The orbitofrontal cortex showed varying response patterns: lateral structures showed higher responses in instructed aware than unaware subjects, the opposite was true for medial parts. Conditioned subjective and electrodermal responses emerged only in the two aware groups. These results confirm the independence of conditioned amygdala responses from contingency awareness and indicate specific neural circuits for different aspects of fear acquisition in unaware, learned aware and instructed aware subjects. PMID:20693389

Addiction History Associates with the Propensity to Form Habits.

PubMed

McKim, Theresa H; Bauer, Daniel J; Boettiger, Charlotte A

2016-07-01

Learned habitual responses to environmental stimuli allow efficient interaction with the environment, freeing cognitive resources for more demanding tasks. However, when the outcome of such actions is no longer a desired goal, established stimulus-response (S-R) associations or habits must be overcome. Among people with substance use disorders (SUDs), difficulty in overcoming habitual responses to stimuli associated with their addiction in favor of new, goal-directed behaviors contributes to relapse. Animal models of habit learning demonstrate that chronic self-administration of drugs of abuse promotes habitual responding beyond the domain of compulsive drug seeking. However, whether a similar propensity toward domain-general habitual responding occurs in humans with SUDs has remained unclear. To address this question, we used a visuomotor S-R learning and relearning task, the Hidden Association between Images Task, which employs abstract visual stimuli and manual responses. This task allows us to measure new S-R association learning and well-learned S-R association execution and includes a response contingency change manipulation to quantify the degree to which responding is habit-based, rather than goal-directed. We find that people with SUDs learn new S-R associations as well as healthy control participants do. Moreover, people with an SUD history slightly outperform controls in S-R execution. In contrast, people with SUDs are specifically impaired in overcoming well-learned S-R associations; those with SUDs make a significantly greater proportion of perseverative errors during well-learned S-R replacement, indicating the more habitual nature of their responses. Thus, with equivalent training and practice, people with SUDs appear to show enhanced domain-general habit formation.

Contingency and similarity in response selection.

PubMed

Prinz, Wolfgang

2018-05-09

This paper explores issues of task representation in choice reaction time tasks. How is it possible, and what does it take, to represent such a task in a way that enables a performer to do the task in line with the prescriptions entailed in the instructions? First, a framework for task representation is outlined which combines the implementation of task sets and their use for performance with different kinds of representational operations (pertaining to feature compounds for event codes and code assemblies for task sets, respectively). Then, in a second step, the framework is itself embedded in the bigger picture of the classical debate on the roles of contingency and similarity for the formation of associations. The final conclusion is that both principles are needed and that the operation of similarity at the level of task sets requires and presupposes the operation of contingency at the level of event codes. Copyright © 2018 The Author. Published by Elsevier Inc. All rights reserved.

Contingency Awareness Shapes Acquisition and Extinction of Emotional Responses in a Conditioning Model of Pain-Related Fear

PubMed Central

Labrenz, Franziska; Icenhour, Adriane; Benson, Sven; Elsenbruch, Sigrid

2015-01-01

As a fundamental learning process, fear conditioning promotes the formation of associations between predictive cues and biologically significant signals. In its application to pain, conditioning may provide important insight into mechanisms underlying pain-related fear, although knowledge especially in interoceptive pain paradigms remains scarce. Furthermore, while the influence of contingency awareness on excitatory learning is subject of ongoing debate, its role in pain-related acquisition is poorly understood and essentially unknown regarding extinction as inhibitory learning. Therefore, we addressed the impact of contingency awareness on learned emotional responses to pain- and safety-predictive cues in a combined dataset of two pain-related conditioning studies. In total, 75 healthy participants underwent differential fear acquisition, during which rectal distensions as interoceptive unconditioned stimuli (US) were repeatedly paired with a predictive visual cue (conditioned stimulus; CS+) while another cue (CS−) was presented unpaired. During extinction, both CS were presented without US. CS valence, indicating learned emotional responses, and CS-US contingencies were assessed on visual analog scales (VAS). Based on an integrative measure of contingency accuracy, a median-split was performed to compare groups with low vs. high contingency accuracy regarding learned emotional responses. To investigate predictive value of contingency accuracy, regression analyses were conducted. Highly accurate individuals revealed more pronounced negative emotional responses to CS+ and increased positive responses to CS− when compared to participants with low contingency accuracy. Following extinction, highly accurate individuals had fully extinguished pain-predictive cue properties, while exhibiting persistent positive emotional responses to safety signals. In contrast, individuals with low accuracy revealed equally positive emotional responses to both, CS+ and CS−. Contingency accuracy predicted variance in the formation of positive responses to safety cues while no predictive value was found for danger cues following acquisition and for neither cue following extinction. Our findings underscore specific roles of learned danger and safety in pain-related acquisition and extinction. Contingency accuracy appears to distinctly impact learned emotional responses to safety and danger cues, supporting aversive learning to occur independently from CS-US awareness. The interplay of cognitive and emotional factors in shaping excitatory and inhibitory pain-related learning may contribute to altered pain processing, underscoring its clinical relevance in chronic pain. PMID:26640433

Contingency Awareness Shapes Acquisition and Extinction of Emotional Responses in a Conditioning Model of Pain-Related Fear.

PubMed

Labrenz, Franziska; Icenhour, Adriane; Benson, Sven; Elsenbruch, Sigrid

2015-01-01

As a fundamental learning process, fear conditioning promotes the formation of associations between predictive cues and biologically significant signals. In its application to pain, conditioning may provide important insight into mechanisms underlying pain-related fear, although knowledge especially in interoceptive pain paradigms remains scarce. Furthermore, while the influence of contingency awareness on excitatory learning is subject of ongoing debate, its role in pain-related acquisition is poorly understood and essentially unknown regarding extinction as inhibitory learning. Therefore, we addressed the impact of contingency awareness on learned emotional responses to pain- and safety-predictive cues in a combined dataset of two pain-related conditioning studies. In total, 75 healthy participants underwent differential fear acquisition, during which rectal distensions as interoceptive unconditioned stimuli (US) were repeatedly paired with a predictive visual cue (conditioned stimulus; CS(+)) while another cue (CS(-)) was presented unpaired. During extinction, both CS were presented without US. CS valence, indicating learned emotional responses, and CS-US contingencies were assessed on visual analog scales (VAS). Based on an integrative measure of contingency accuracy, a median-split was performed to compare groups with low vs. high contingency accuracy regarding learned emotional responses. To investigate predictive value of contingency accuracy, regression analyses were conducted. Highly accurate individuals revealed more pronounced negative emotional responses to CS(+) and increased positive responses to CS(-) when compared to participants with low contingency accuracy. Following extinction, highly accurate individuals had fully extinguished pain-predictive cue properties, while exhibiting persistent positive emotional responses to safety signals. In contrast, individuals with low accuracy revealed equally positive emotional responses to both, CS(+) and CS(-). Contingency accuracy predicted variance in the formation of positive responses to safety cues while no predictive value was found for danger cues following acquisition and for neither cue following extinction. Our findings underscore specific roles of learned danger and safety in pain-related acquisition and extinction. Contingency accuracy appears to distinctly impact learned emotional responses to safety and danger cues, supporting aversive learning to occur independently from CS-US awareness. The interplay of cognitive and emotional factors in shaping excitatory and inhibitory pain-related learning may contribute to altered pain processing, underscoring its clinical relevance in chronic pain.

Role of the Perigenual Anterior Cingulate and Orbitofrontal Cortex in Contingency Learning in the Marmoset

PubMed Central

Jackson, Stacey A. W.; Horst, Nicole K.; Pears, Andrew; Robbins, Trevor W.; Roberts, Angela C.

2016-01-01

Two learning mechanisms contribute to decision-making: goal-directed actions and the “habit” system, by which action-outcome and stimulus-response associations are formed, respectively. Rodent lesion studies and human neuroimaging have implicated both the medial prefrontal cortex (mPFC) and the orbitofrontal cortex (OFC) in the neural basis of contingency learning, a critical component of goal-directed actions, though some published findings are conflicting. We sought to reconcile the existing literature by comparing the effects of excitotoxic lesions of the perigenual anterior cingulate cortex (pgACC), a region of the mPFC, and OFC on contingency learning in the marmoset monkey using a touchscreen-based paradigm, in which the contingent relationship between one of a pair of actions and its outcome was degraded selectively. Both the pgACC and OFC lesion groups were insensitive to the contingency degradation, whereas the control group demonstrated selectively higher performance of the nondegraded action when compared with the degraded action. These findings suggest the pgACC and OFC are both necessary for normal contingency learning and therefore goal-directed behavior. PMID:27130662

The Impact of Individual Differences on E-Learning System Behavioral Intention

NASA Astrophysics Data System (ADS)

Liao, Peiwen; Yu, Chien; Yi, Chincheh

This study investigated the impact of contingent variables on the relationship between four predictors and employees' behavioral intention with e-learning. Seven hundred and twenty-two employees in online training and education were asked to answer questionnaires about their learning styles, perceptions of the quality of the proposed predictors and behavioral intention with e-learning systems. The results of analysis showed that three contingent variables, gender, job title and industry, significantly influenced the perceptions of predictors and employees' behavioral intention with the e-learning system. This study also found a statistically significant moderating effect of two contingent variables, gender, job title and industry, on the relationship between predictors and e-learning system behavioral intention. The results suggest that a serious consideration of contingent variables is crucial for improving e-learning system behavioral intention. The implications of these results for the management of e-learning systems are discussed.

Instructed fear learning, extinction, and recall: additive effects of cognitive information on emotional learning of fear.

PubMed

Javanbakht, Arash; Duval, Elizabeth R; Cisneros, Maria E; Taylor, Stephan F; Kessler, Daniel; Liberzon, Israel

2017-08-01

The effects of instruction on learning of fear and safety are rarely studied. We aimed to examine the effects of cognitive information and experience on fear learning. Fourty healthy participants, randomly assigned to three groups, went through fear conditioning, extinction learning, and extinction recall with two conditioned stimuli (CS+). Information was presented about the presence or absence of conditioned stimulus-unconditioned stimulus (CS-US) contingency at different stages of the experiment. Information about the CS-US contingency prior to fear conditioning enhanced fear response and reduced extinction recall. Information about the absence of CS-US contingency promoted extinction learning and recall, while omission of this information prior to recall resulted in fear renewal. These findings indicate that contingency information can facilitate fear expression during fear learning, and can facilitate extinction learning and recall. Information seems to function as an element of the larger context in which conditioning occurs.

Vagal tone during infant contingency learning and its disruption.

PubMed

Sullivan, Margaret Wolan

2016-04-01

This study used contingency learning to examine changes in infants' vagal tone during learning and its disruption. The heart rate of 160 five-month-old infants was recorded continuously during the first of two training sessions as they experienced an audiovisual event contingent on their pulling. Maternal reports of infant temperament were also collected. Baseline vagal tone, a measure of parasympathetic regulation of the heart, was related to vagal levels during the infants' contingency learning session, but not to their learner status. Vagal tone levels did not vary significantly over session minutes. Instead, vagal tone levels were a function of both individual differences in learner status and infant soothability. Vagal levels of infants who learned in the initial session were similar regardless of their soothability; however, vagal levels of infants who learned in a subsequent session differed as a function of soothability. Additionally, vagal levels during contingency disruption were significantly higher among infants in this group who were more soothable as opposed to those who were less soothable. The results suggest that contingency learning and disruption is associated with stable vagal tone in the majority of infants, but that individual differences in attention processes and state associated with vagal tone may be most readily observed during the disruption phase. © 2015 Wiley Periodicals, Inc.

Vagal Tone During Infant Contingency Learning and Its Disruption

PubMed Central

Sullivan, Margaret Wolan

2015-01-01

This study used contingency learning to examine changes in infants’ vagal tone during learning and its disruption. The heart rate of 160 five-month-old infants was recorded continuously during the first of two training sessions as they experienced an audiovisual event contingent on their pulling. Maternal reports of infant temperament were also collected. Baseline vagal tone, a measure of parasympathetic regulation of the heart, was related to vagal levels during the infants’ contingency learning session, but not to their learner status. Vagal tone levels did not vary significantly over session minutes. Instead, vagal tone levels were a function of both individual differences in learner status and infant soothability. Vagal levels of infants who learned in the initial session were similar regardless of their soothability; however, vagal levels of infants who learned in a subsequent session differed as a function of soothability. Additionally, vagal levels during contingency disruption were significantly higher among infants in this group who were more soothable as opposed to those who were less soothable. The results suggest that contingency learning and disruption is associated with stable vagal tone in the majority of infants, but that individual differences in attention processes and state associated with vagal tone may be most readily observed during the disruption phase. PMID:26517573

Microstimulation of the human substantia nigra alters reinforcement learning.

PubMed

Ramayya, Ashwin G; Misra, Amrit; Baltuch, Gordon H; Kahana, Michael J

2014-05-14

Animal studies have shown that substantia nigra (SN) dopaminergic (DA) neurons strengthen action-reward associations during reinforcement learning, but their role in human learning is not known. Here, we applied microstimulation in the SN of 11 patients undergoing deep brain stimulation surgery for the treatment of Parkinson's disease as they performed a two-alternative probability learning task in which rewards were contingent on stimuli, rather than actions. Subjects demonstrated decreased learning from reward trials that were accompanied by phasic SN microstimulation compared with reward trials without stimulation. Subjects who showed large decreases in learning also showed an increased bias toward repeating actions after stimulation trials; therefore, stimulation may have decreased learning by strengthening action-reward associations rather than stimulus-reward associations. Our findings build on previous studies implicating SN DA neurons in preferentially strengthening action-reward associations during reinforcement learning. Copyright © 2014 the authors 0270-6474/14/346887-09$15.00/0.

A possible structural correlate of learning performance on a colour discrimination task in the brain of the bumblebee

PubMed Central

Li, Li; MaBouDi, HaDi; Egertová, Michaela; Elphick, Maurice R.

2017-01-01

Synaptic plasticity is considered to be a basis for learning and memory. However, the relationship between synaptic arrangements and individual differences in learning and memory is poorly understood. Here, we explored how the density of microglomeruli (synaptic complexes) within specific regions of the bumblebee (Bombus terrestris) brain relates to both visual learning and inter-individual differences in learning and memory performance on a visual discrimination task. Using whole-brain immunolabelling, we measured the density of microglomeruli in the collar region (visual association areas) of the mushroom bodies of the bumblebee brain. We found that bumblebees which made fewer errors during training in a visual discrimination task had higher microglomerular density. Similarly, bumblebees that had better retention of the learned colour-reward associations two days after training had higher microglomerular density. Further experiments indicated experience-dependent changes in neural circuitry: learning a colour-reward contingency with 10 colours (but not two colours) does result, and exposure to many different colours may result, in changes to microglomerular density in the collar region of the mushroom bodies. These results reveal the varying roles that visual experience, visual learning and foraging activity have on neural structure. Although our study does not provide a causal link between microglomerular density and performance, the observed positive correlations provide new insights for future studies into how neural structure may relate to inter-individual differences in learning and memory. PMID:28978727

A possible structural correlate of learning performance on a colour discrimination task in the brain of the bumblebee.

PubMed

Li, Li; MaBouDi, HaDi; Egertová, Michaela; Elphick, Maurice R; Chittka, Lars; Perry, Clint J

2017-10-11

Synaptic plasticity is considered to be a basis for learning and memory. However, the relationship between synaptic arrangements and individual differences in learning and memory is poorly understood. Here, we explored how the density of microglomeruli (synaptic complexes) within specific regions of the bumblebee ( Bombus terrestris ) brain relates to both visual learning and inter-individual differences in learning and memory performance on a visual discrimination task. Using whole-brain immunolabelling, we measured the density of microglomeruli in the collar region (visual association areas) of the mushroom bodies of the bumblebee brain. We found that bumblebees which made fewer errors during training in a visual discrimination task had higher microglomerular density. Similarly, bumblebees that had better retention of the learned colour-reward associations two days after training had higher microglomerular density. Further experiments indicated experience-dependent changes in neural circuitry: learning a colour-reward contingency with 10 colours (but not two colours) does result, and exposure to many different colours may result, in changes to microglomerular density in the collar region of the mushroom bodies. These results reveal the varying roles that visual experience, visual learning and foraging activity have on neural structure. Although our study does not provide a causal link between microglomerular density and performance, the observed positive correlations provide new insights for future studies into how neural structure may relate to inter-individual differences in learning and memory. © 2017 The Authors.

A Flexible Mechanism of Rule Selection Enables Rapid Feature-Based Reinforcement Learning

PubMed Central

Balcarras, Matthew; Womelsdorf, Thilo

2016-01-01

Learning in a new environment is influenced by prior learning and experience. Correctly applying a rule that maps a context to stimuli, actions, and outcomes enables faster learning and better outcomes compared to relying on strategies for learning that are ignorant of task structure. However, it is often difficult to know when and how to apply learned rules in new contexts. In our study we explored how subjects employ different strategies for learning the relationship between stimulus features and positive outcomes in a probabilistic task context. We test the hypothesis that task naive subjects will show enhanced learning of feature specific reward associations by switching to the use of an abstract rule that associates stimuli by feature type and restricts selections to that dimension. To test this hypothesis we designed a decision making task where subjects receive probabilistic feedback following choices between pairs of stimuli. In the task, trials are grouped in two contexts by blocks, where in one type of block there is no unique relationship between a specific feature dimension (stimulus shape or color) and positive outcomes, and following an un-cued transition, alternating blocks have outcomes that are linked to either stimulus shape or color. Two-thirds of subjects (n = 22/32) exhibited behavior that was best fit by a hierarchical feature-rule model. Supporting the prediction of the model mechanism these subjects showed significantly enhanced performance in feature-reward blocks, and rapidly switched their choice strategy to using abstract feature rules when reward contingencies changed. Choice behavior of other subjects (n = 10/32) was fit by a range of alternative reinforcement learning models representing strategies that do not benefit from applying previously learned rules. In summary, these results show that untrained subjects are capable of flexibly shifting between behavioral rules by leveraging simple model-free reinforcement learning and context-specific selections to drive responses. PMID:27064794

Young Adults at Risk for Stimulant Dependence show Reward Dysfunction during Reinforcement-Based Decision Making

PubMed Central

Stewart, Jennifer L.; Flagan, Taru M.; May, April C.; Reske, Martina; Simmons, Alan N.; Paulus, Martin P.

2012-01-01

Background While stimulant dependent individuals continue to make risky decisions in spite of poor outcomes, much less is known about decision-making characteristics of occasional stimulant users (OSU) at risk for developing stimulant dependence. This study examines whether OSU exhibit inefficient learning and execution of reinforced decision-outcome contingencies. Methods OSU (n=161) and stimulant-naïve comparison subjects (CTL; n=48) performed a Paper Scissors Rock task during functional magnetic resonance imaging. Selecting a particular option was associated with a pre-determined probability of winning, which was altered repeatedly to examine neural and behavioral characteristics of reinforced contingencies. Results OSU displayed greater anterior insula, inferior frontal gyrus (IFG), and dorsal striatum activation than CTL during late trials when contingencies were familiar (as opposed to being learned) in the presence of comparable behavioral performance in both groups. Follow-up analyses demonstrated that during late trials: (1) OSU with high cannabis use displayed greater activation in these brain regions than CTL, whereas OSU with low cannabis use did not differ from the other two groups; and (2) OSU preferring cocaine exhibited greater anterior insula, IFG, and dorsal striatum activation than CTL and also displayed higher activation in the former two regions than OSU who preferred prescription stimulants. Conclusions OSU exhibit inefficient resource allocation during the execution of reinforced contingencies that may be a result of additive effects of cocaine and cannabis use. A critical next step is to establish whether this inefficiency predicts transition to stimulant dependence. PMID:23021534

Individuals Who Believe in the Paranormal Expose Themselves to Biased Information and Develop More Causal Illusions than Nonbelievers in the Laboratory.

PubMed

Blanco, Fernando; Barberia, Itxaso; Matute, Helena

2015-01-01

In the reasoning literature, paranormal beliefs have been proposed to be linked to two related phenomena: a biased perception of causality and a biased information-sampling strategy (believers tend to test fewer hypotheses and prefer confirmatory information). In parallel, recent contingency learning studies showed that, when two unrelated events coincide frequently, individuals interpret this ambiguous pattern as evidence of a causal relationship. Moreover, the latter studies indicate that sampling more cause-present cases than cause-absent cases strengthens the illusion. If paranormal believers actually exhibit a biased exposure to the available information, they should also show this bias in the contingency learning task: they would in fact expose themselves to more cause-present cases than cause-absent trials. Thus, by combining the two traditions, we predicted that believers in the paranormal would be more vulnerable to developing causal illusions in the laboratory than nonbelievers because there is a bias in the information they experience. In this study, we found that paranormal beliefs (measured using a questionnaire) correlated with causal illusions (assessed by using contingency judgments). As expected, this correlation was mediated entirely by the believers' tendency to expose themselves to more cause-present cases. The association between paranormal beliefs, biased exposure to information, and causal illusions was only observed for ambiguous materials (i.e., the noncontingent condition). In contrast, the participants' ability to detect causal relationships which did exist (i.e., the contingent condition) was unaffected by their susceptibility to believe in paranormal phenomena.

Individuals Who Believe in the Paranormal Expose Themselves to Biased Information and Develop More Causal Illusions than Nonbelievers in the Laboratory

PubMed Central

Blanco, Fernando; Barberia, Itxaso; Matute, Helena

2015-01-01

In the reasoning literature, paranormal beliefs have been proposed to be linked to two related phenomena: a biased perception of causality and a biased information-sampling strategy (believers tend to test fewer hypotheses and prefer confirmatory information). In parallel, recent contingency learning studies showed that, when two unrelated events coincide frequently, individuals interpret this ambiguous pattern as evidence of a causal relationship. Moreover, the latter studies indicate that sampling more cause-present cases than cause-absent cases strengthens the illusion. If paranormal believers actually exhibit a biased exposure to the available information, they should also show this bias in the contingency learning task: they would in fact expose themselves to more cause-present cases than cause-absent trials. Thus, by combining the two traditions, we predicted that believers in the paranormal would be more vulnerable to developing causal illusions in the laboratory than nonbelievers because there is a bias in the information they experience. In this study, we found that paranormal beliefs (measured using a questionnaire) correlated with causal illusions (assessed by using contingency judgments). As expected, this correlation was mediated entirely by the believers' tendency to expose themselves to more cause-present cases. The association between paranormal beliefs, biased exposure to information, and causal illusions was only observed for ambiguous materials (i.e., the noncontingent condition). In contrast, the participants' ability to detect causal relationships which did exist (i.e., the contingent condition) was unaffected by their susceptibility to believe in paranormal phenomena. PMID:26177025

Addiction history associates with the propensity to form habits

PubMed Central

McKim, Theresa H.; Bauer, Daniel J.; Boettiger, Charlotte A.

2016-01-01

Learned habitual responses to environmental stimuli allow efficient interaction with the environment, freeing cognitive resources for more demanding tasks. However, when the outcome of such actions is no longer a desired goal, established stimulus-response (S-R) associations, or habits, must be overcome. Among people with substance use disorders (SUDs), difficulty in overcoming habitual responses to stimuli associated with their addiction in favor of new, goal-directed behaviors, contributes to relapse. Animal models of habit learning demonstrate that chronic self-administration of drugs of abuse promotes habitual responding beyond the domain of compulsive drug seeking. However, whether a similar propensity toward domain-general habitual responding occurs in humans with SUDs has remained unclear. To address this question, we used a visuomotor S-R learning and re-learning task, the Hidden Association Between Images Task (HABIT), which employs abstract visual stimuli and manual responses. This task allows us to measure new S-R association learning, well-learned S-R association execution, and includes a response contingency change manipulation to quantify the degree to which responding is habit-based, rather than goal-directed. We find that people with SUDs learn new S-R associations as well as healthy control subjects do. Moreover, people with an SUD history slightly outperform controls in S-R execution. In contrast, people with SUDs are specifically impaired in overcoming well-learned S-R associations; those with SUDs make a significantly greater proportion of perseverative errors during well-learned S-R replacement, indicating the more habitual nature of their responses. Thus, with equivalent training and practice, people with SUDs appear to show enhanced domain-general habit formation. PMID:26967944

Simple Plans or Sophisticated Habits? State, Transition and Learning Interactions in the Two-Step Task.

PubMed

Akam, Thomas; Costa, Rui; Dayan, Peter

2015-12-01

The recently developed 'two-step' behavioural task promises to differentiate model-based from model-free reinforcement learning, while generating neurophysiologically-friendly decision datasets with parametric variation of decision variables. These desirable features have prompted its widespread adoption. Here, we analyse the interactions between a range of different strategies and the structure of transitions and outcomes in order to examine constraints on what can be learned from behavioural performance. The task involves a trade-off between the need for stochasticity, to allow strategies to be discriminated, and a need for determinism, so that it is worth subjects' investment of effort to exploit the contingencies optimally. We show through simulation that under certain conditions model-free strategies can masquerade as being model-based. We first show that seemingly innocuous modifications to the task structure can induce correlations between action values at the start of the trial and the subsequent trial events in such a way that analysis based on comparing successive trials can lead to erroneous conclusions. We confirm the power of a suggested correction to the analysis that can alleviate this problem. We then consider model-free reinforcement learning strategies that exploit correlations between where rewards are obtained and which actions have high expected value. These generate behaviour that appears model-based under these, and also more sophisticated, analyses. Exploiting the full potential of the two-step task as a tool for behavioural neuroscience requires an understanding of these issues.

Simple Plans or Sophisticated Habits? State, Transition and Learning Interactions in the Two-Step Task

PubMed Central

Akam, Thomas; Costa, Rui; Dayan, Peter

2015-01-01

The recently developed ‘two-step’ behavioural task promises to differentiate model-based from model-free reinforcement learning, while generating neurophysiologically-friendly decision datasets with parametric variation of decision variables. These desirable features have prompted its widespread adoption. Here, we analyse the interactions between a range of different strategies and the structure of transitions and outcomes in order to examine constraints on what can be learned from behavioural performance. The task involves a trade-off between the need for stochasticity, to allow strategies to be discriminated, and a need for determinism, so that it is worth subjects’ investment of effort to exploit the contingencies optimally. We show through simulation that under certain conditions model-free strategies can masquerade as being model-based. We first show that seemingly innocuous modifications to the task structure can induce correlations between action values at the start of the trial and the subsequent trial events in such a way that analysis based on comparing successive trials can lead to erroneous conclusions. We confirm the power of a suggested correction to the analysis that can alleviate this problem. We then consider model-free reinforcement learning strategies that exploit correlations between where rewards are obtained and which actions have high expected value. These generate behaviour that appears model-based under these, and also more sophisticated, analyses. Exploiting the full potential of the two-step task as a tool for behavioural neuroscience requires an understanding of these issues. PMID:26657806

Conditions for Contingent Instructors Engaged in the Scholarship of Teaching and Learning

ERIC Educational Resources Information Center

Vander Kloet, Marie; Frake-Mistak, Mandy; McGinn, Michelle K.; Caldecott, Marion; Aspenlieder, Erin D.; Beres, Jacqueline L.; Fukuzawa, Sherry; Cassidy, Alice; Gill, Apryl

2017-01-01

An increasingly large number of courses in Canadian postsecondary institutions are taught by contingent instructors who hold full- or part-time positions for contractually limited time periods. Despite strong commitments to advancing teaching and learning, the labour and employment conditions for contingent instructors affect the incentives and…

Equilibria of perceptrons for simple contingency problems.

PubMed

Dawson, Michael R W; Dupuis, Brian

2012-08-01

The contingency between cues and outcomes is fundamentally important to theories of causal reasoning and to theories of associative learning. Researchers have computed the equilibria of Rescorla-Wagner models for a variety of contingency problems, and have used these equilibria to identify situations in which the Rescorla-Wagner model is consistent, or inconsistent, with normative models of contingency. Mathematical analyses that directly compare artificial neural networks to contingency theory have not been performed, because of the assumed equivalence between the Rescorla-Wagner learning rule and the delta rule training of artificial neural networks. However, recent results indicate that this equivalence is not as straightforward as typically assumed, suggesting a strong need for mathematical accounts of how networks deal with contingency problems. One such analysis is presented here, where it is proven that the structure of the equilibrium for a simple network trained on a basic contingency problem is quite different from the structure of the equilibrium for a Rescorla-Wagner model faced with the same problem. However, these structural differences lead to functionally equivalent behavior. The implications of this result for the relationships between associative learning, contingency theory, and connectionism are discussed.

Building a responsive teacher: how temporal contingency of gaze interaction influences word learning with virtual tutors

PubMed Central

Lee, Hanju; Kanakogi, Yasuhiro; Hiraki, Kazuo

2015-01-01

Animated pedagogical agents are lifelike virtual characters designed to augment learning. A review of developmental psychology literature led to the hypothesis that the temporal contingency of such agents would promote human learning. We developed a Pedagogical Agent with Gaze Interaction (PAGI), an experimental animated pedagogical agent that engages in gaze interaction with students. In this study, university students learned words of a foreign language, with temporally contingent PAGI (live group) or recorded version of PAGI (recorded group), which played pre-recorded sequences from live sessions. The result revealed that students in the live group scored considerably better than those in the recorded group. The finding indicates that incorporating temporal contingency of gaze interaction from a pedagogical agent has positive effect on learning. PMID:26064584

Temporal contingency

PubMed Central

Gallistel, C.R.; Craig, Andrew R.; Shahan, Timothy A.

2015-01-01

Contingency, and more particularly temporal contingency, has often figured in thinking about the nature of learning. However, it has never been formally defined in such a way as to make it a measure that can be applied to most animal learning protocols. We use elementary information theory to define contingency in such a way as to make it a measurable property of almost any conditioning protocol. We discuss how making it a measurable construct enables the exploration of the role of different contingencies in the acquisition and performance of classically and operantly conditioned behavior. PMID:23994260

Dissociation between judgments and outcome-expectancy measures in covariation learning: a signal detection theory approach.

PubMed

Perales, José C; Catena, Andrés; Shanks, David R; González, José A

2005-09-01

A number of studies using trial-by-trial learning tasks have shown that judgments of covariation between a cue c and an outcome o deviate from normative metrics. Parameters based on trial-by-trial predictions were estimated from signal detection theory (SDT) in a standard causal learning task. Results showed that manipulations of P(c) when contingency (deltaP) was held constant did not affect participants' ability to predict the appearance of the outcome (d') but had a significant effect on response criterion (c) and numerical causal judgments. The association between criterion c and judgment was further demonstrated in 2 experiments in which the criterion was directly manipulated by linking payoffs to the predictive responses made by learners. In all cases, the more liberal the criterion c was, the higher judgments were. The results imply that the mechanisms underlying the elaboration of judgments and those involved in the elaboration of predictive responses are partially dissociable.

Learned helplessness: effects of response requirement and interval between treatment and testing.

PubMed

Hunziker, M H L; Dos Santos, C V

2007-11-01

Three experiments investigated learned helplessness in rats manipulating response requirements, shock duration, and intervals between treatment and testing. In Experiment 1, rats previously exposed to uncontrollable or no shocks were tested under one of four different contingencies of negative reinforcement: FR 1 or FR 2 escape contingency for running, and FR1 escape contingency for jumping (differing for the maximum shock duration of 10s or 30s). The results showed that the uncontrollable shocks produced a clear operant learning deficit (learned helplessness effect) only when the animals were tested under the jumping FR 1 escape contingency with 10-s max shock duration. Experiment 2 isolated of the effects of uncontrollability from shock exposure per se and showed that the escape deficit observed using the FR 1 escape jumping response (10-s shock duration) was produced by the uncontrollability of shock. Experiment 3 showed that using the FR 1 jumping escape contingency in the test, the learned helplessness effect was observed one, 14 or 28 days after treatment. These results suggest that running may not be an appropriate test for learned helplessness, and that many diverging results found in the literature might be accounted for by the confounding effects of respondent and operant contingencies present when running is required of rats.

Flight Dynamics Operations: Methods and Lessons Learned from Space Shuttle Orbit Operations

NASA Technical Reports Server (NTRS)

Cutri-Kohart, Rebecca M.

2011-01-01

The Flight Dynamics Officer is responsible for trajectory maintenance of the Space Shuttle. This paper will cover high level operational considerations, methodology, procedures, and lessons learned involved in performing the functions of orbit and rendezvous Flight Dynamics Officer and leading the team of flight dynamics specialists during different phases of flight. The primary functions that will be address are: onboard state vector maintenance, ground ephemeris maintenance, calculation of ground and spacecraft acquisitions, collision avoidance, burn targeting for the primary mission, rendezvous, deorbit and contingencies, separation sequences, emergency deorbit preparation, mass properties coordination, payload deployment planning, coordination with the International Space Station, and coordination with worldwide trajectory customers. Each of these tasks require the Flight Dynamics Officer to have cognizance of the current trajectory state as well as the impact of future events on the trajectory plan in order to properly analyze and react to real-time changes. Additionally, considerations are made to prepare flexible alternative trajectory plans in the case timeline changes or a systems failure impact the primary plan. The evolution of the methodology, procedures, and techniques used by the Flight Dynamics Officer to perform these tasks will be discussed. Particular attention will be given to how specific Space Shuttle mission and training simulation experiences, particularly off-nominal or unexpected events such as shortened mission durations, tank failures, contingency deorbit, navigation errors, conjunctions, and unexpected payload deployments, have influenced the operational procedures and training for performing Space Shuttle flight dynamics operations over the history of the program. These lessons learned can then be extended to future vehicle trajectory operations.

Learning stochastic reward distributions in a speeded pointing task.

PubMed

Seydell, Anna; McCann, Brian C; Trommershäuser, Julia; Knill, David C

2008-04-23

Recent studies have shown that humans effectively take into account task variance caused by intrinsic motor noise when planning fast hand movements. However, previous evidence suggests that humans have greater difficulty accounting for arbitrary forms of stochasticity in their environment, both in economic decision making and sensorimotor tasks. We hypothesized that humans can learn to optimize movement strategies when environmental randomness can be experienced and thus implicitly learned over several trials, especially if it mimics the kinds of randomness for which subjects might have generative models. We tested the hypothesis using a task in which subjects had to rapidly point at a target region partly covered by three stochastic penalty regions introduced as "defenders." At movement completion, each defender jumped to a new position drawn randomly from fixed probability distributions. Subjects earned points when they hit the target, unblocked by a defender, and lost points otherwise. Results indicate that after approximately 600 trials, subjects approached optimal behavior. We further tested whether subjects simply learned a set of stimulus-contingent motor plans or the statistics of defenders' movements by training subjects with one penalty distribution and then testing them on a new penalty distribution. Subjects immediately changed their strategy to achieve the same average reward as subjects who had trained with the second penalty distribution. These results indicate that subjects learned the parameters of the defenders' jump distributions and used this knowledge to optimally plan their hand movements under conditions involving stochastic rewards and penalties.

Role of the Perigenual Anterior Cingulate and Orbitofrontal Cortex in Contingency Learning in the Marmoset.

PubMed

Jackson, Stacey A W; Horst, Nicole K; Pears, Andrew; Robbins, Trevor W; Roberts, Angela C

2016-07-01

Two learning mechanisms contribute to decision-making: goal-directed actions and the "habit" system, by which action-outcome and stimulus-response associations are formed, respectively. Rodent lesion studies and human neuroimaging have implicated both the medial prefrontal cortex (mPFC) and the orbitofrontal cortex (OFC) in the neural basis of contingency learning, a critical component of goal-directed actions, though some published findings are conflicting. We sought to reconcile the existing literature by comparing the effects of excitotoxic lesions of the perigenual anterior cingulate cortex (pgACC), a region of the mPFC, and OFC on contingency learning in the marmoset monkey using a touchscreen-based paradigm, in which the contingent relationship between one of a pair of actions and its outcome was degraded selectively. Both the pgACC and OFC lesion groups were insensitive to the contingency degradation, whereas the control group demonstrated selectively higher performance of the nondegraded action when compared with the degraded action. These findings suggest the pgACC and OFC are both necessary for normal contingency learning and therefore goal-directed behavior. © The Author 2016. Published by Oxford University Press.

Pavlovian reward learning underlies value driven attentional capture.

PubMed

Bucker, Berno; Theeuwes, Jan

2017-02-01

Recent evidence shows that distractors that signal high compared to low reward availability elicit stronger attentional capture, even when this is detrimental for task-performance. This suggests that simply correlating stimuli with reward administration, rather than their instrumental relationship with obtaining reward, produces value-driven attentional capture. However, in previous studies, reward delivery was never response independent, as only correct responses were rewarded, nor was it completely task-irrelevant, as the distractor signaled the magnitude of reward that could be earned on that trial. In two experiments, we ensured that associative reward learning was completely response independent by letting participants perform a task at fixation, while high and low rewards were automatically administered following the presentation of task-irrelevant colored stimuli in the periphery (Experiment 1) or at fixation (Experiment 2). In a following non-reward test phase, using the additional singleton paradigm, the previously reward signaling stimuli were presented as distractors to assess truly task-irrelevant value driven attentional capture. The results showed that high compared to low reward-value associated distractors impaired performance, and thus captured attention more strongly. This suggests that genuine Pavlovian conditioning of stimulus-reward contingencies is sufficient to obtain value-driven attentional capture. Furthermore, value-driven attentional capture can occur following associative reward learning of temporally and spatially task-irrelevant distractors that signal the magnitude of available reward (Experiment 1), and is independent of training spatial shifts of attention towards the reward signaling stimuli (Experiment 2). This confirms and strengthens the idea that Pavlovian reward learning underlies value driven attentional capture.

Perceived facial expressions of emotion as motivational incentives: evidence from a differential implicit learning paradigm.

PubMed

Schultheiss, Oliver C; Pang, Joyce S; Torges, Cynthia M; Wirth, Michelle M; Treynor, Wendy; Derryberry, Douglas

2005-03-01

Participants (N = 216) were administered a differential implicit learning task during which they were trained and tested on 3 maximally distinct 2nd-order visuomotor sequences, with sequence color serving as discriminative stimulus. During training, 1 sequence each was followed by an emotional face, a neutral face, and no face, using backward masking. Emotion (joy, surprise, anger), face gender, and exposure duration (12 ms, 209 ms) were varied between participants; implicit motives were assessed with a picture-story exercise. For power-motivated individuals, low-dominance facial expressions enhanced and high-dominance expressions impaired learning. For affiliation-motivated individuals, learning was impaired in the context of hostile faces. These findings did not depend on explicit learning of fixed sequences or on awareness of sequence-face contingencies. Copyright 2005 APA, all rights reserved.

Isolation Rearing Effects on Probabilistic Learning and Cognitive Flexibility in Rats

PubMed Central

AMITAI, Nurith; YOUNG, Jared W.; HIGA, Kerin; SHARP, Richard F.; GEYER, Mark A.; POWELL, Susan B.

2013-01-01

Isolation rearing is a neurodevelopmental manipulation that produces neurochemical, structural, and behavioral alterations in rodents that have consistencies with schizophrenia. Symptoms induced by isolation rearing that mirror clinically relevant aspects of schizophrenia, such as cognitive deficits, open up the possibility of testing putative therapeutics in isolation-reared animals prior to clinical development. We investigated what effect isolation rearing would have on cognitive flexibility, a cognitive function characteristically disrupted in schizophrenia. For this purpose, we assessed cognitive flexibility using between- and within-session probabilistic reversal-learning tasks based on clinical tests. Isolation-reared rats required more sessions, though not more task trials, to acquire criterion performance in the reversal phase of the task and were slower to adjust their task strategy after reward contingencies were switched. Isolation-reared rats also completed fewer trials and exhibited lower levels of overall activity in the probabilistic reversal-learning task compared to socially reared rats. This finding contrasted with the elevated levels of unconditioned investigatory activity and reduced levels of locomotor habituation that isolation-reared rats displayed in the behavioral pattern monitor. Finally, isolation-reared rats also exhibited sensorimotor gating deficits, reflected by decreased prepulse inhibition of the startle response, consistent with previous studies. We conclude that isolation rearing constitutes a valuable, noninvasive manipulation for modeling schizophrenia-like cognitive deficits and assessing putative therapeutics. PMID:23943516

Altered brain activation in a reversal learning task unmasks adaptive changes in cognitive control in writer's cramp.

PubMed

Zeuner, Kirsten E; Knutzen, Arne; Granert, Oliver; Sablowsky, Simone; Götz, Julia; Wolff, Stephan; Jansen, Olav; Dressler, Dirk; Schneider, Susanne A; Klein, Christine; Deuschl, Günther; van Eimeren, Thilo; Witt, Karsten

2016-01-01

Previous receptor binding studies suggest dopamine function is altered in the basal ganglia circuitry in task-specific dystonia, a condition characterized by contraction of agonist and antagonist muscles while performing specific tasks. Dopamine plays a role in reward-based learning. Using fMRI, this study compared 31 right-handed writer's cramp patients to 35 controls in reward-based learning of a probabilistic reversal-learning task. All subjects chose between two stimuli and indicated their response with their left or right index finger. One stimulus response was rewarded 80%, the other 20%. After contingencies reversal, the second stimulus response was rewarded in 80%. We further linked the DRD2/ANKK1-TaqIa polymorphism, which is associated with 30% reduction of the striatal dopamine receptor density with reward-based learning and assumed impaired reversal learning in A + subjects. Feedback learning in patients was normal. Blood-oxygen level dependent (BOLD) signal in controls increased with negative feedback in the insula, rostral cingulate cortex, middle frontal gyrus and parietal cortex (pFWE < 0.05). In comparison to controls, patients showed greater increase in BOLD activity following negative feedback in the dorsal anterior cingulate cortex (BA32). The genetic status was not correlated with the BOLD activity. The Brodmann area 32 (BA32) is part of the dorsal anterior cingulate cortex (dACC) that plays an important role in coordinating and integrating information to guide behavior and in reward-based learning. The dACC is connected with the basal ganglia-thalamo-loop modulated by dopaminergic signaling. This finding suggests disturbed integration of reinforcement history in decision making and implicate that the reward system might contribute to the pathogenesis in writer's cramp.

An Analysis of Response-Contingent Learning Experiences for Young Children.

ERIC Educational Resources Information Center

Hanson, Marci J.; Hanline, Mary Frances

1985-01-01

Three children with severe and multiple disabilities (8-25 months old) were provided contingent learning experiences via electromechanical apparatus. Results indicated that all three children increased the frequency of the target behavior. The data are equivocal as to whether or not children showed an awareness of the response-contingent feedback.…

Investigation of Contingency Patterns of Teachers' Scaffolding in Teaching and Learning Mathematics

ERIC Educational Resources Information Center

Anwar; Yuwono, Ipung; Irawan, Edy Bambang; As'ari, Abdur Rahman

2017-01-01

The purpose of this study is to investigate the patterns of scaffolding contingency in teaching and learning mathematics carried out by three teachers. Contingency patterns are obtained by examining the transcription from video recording of conversation fragments between teachers and students during the provision of scaffolding. The contingency…

Baseline Response Levels Are a Nuisance in Infant Contingency Learning

ERIC Educational Resources Information Center

Millar, W. S.; Weir, Catherine

2015-01-01

The impact of differences in level of baseline responding on contingency learning in the first year was examined by considering the response acquisition of infants classified into baseline response quartiles. Whereas the three lower baseline groups showed the predicted increment in responding to a contingency, the highest baseline responders did…

Working Memory and Reinforcement Schedule Jointly Determine Reinforcement Learning in Children: Potential Implications for Behavioral Parent Training

PubMed Central

Segers, Elien; Beckers, Tom; Geurts, Hilde; Claes, Laurence; Danckaerts, Marina; van der Oord, Saskia

2018-01-01

Introduction: Behavioral Parent Training (BPT) is often provided for childhood psychiatric disorders. These disorders have been shown to be associated with working memory impairments. BPT is based on operant learning principles, yet how operant principles shape behavior (through the partial reinforcement (PRF) extinction effect, i.e., greater resistance to extinction that is created when behavior is reinforced partially rather than continuously) and the potential role of working memory therein is scarcely studied in children. This study explored the PRF extinction effect and the role of working memory therein using experimental tasks in typically developing children. Methods: Ninety-seven children (age 6–10) completed a working memory task and an operant learning task, in which children acquired a response-sequence rule under either continuous or PRF (120 trials), followed by an extinction phase (80 trials). Data of 88 children were used for analysis. Results: The PRF extinction effect was confirmed: We observed slower acquisition and extinction in the PRF condition as compared to the continuous reinforcement (CRF) condition. Working memory was negatively related to acquisition but not extinction performance. Conclusion: Both reinforcement contingencies and working memory relate to acquisition performance. Potential implications for BPT are that decreasing working memory load may enhance the chance of optimally learning through reinforcement. PMID:29643822

Contingent Needs Analysis for Task Implementation: An Activity Systems Analysis of Group Writing Conferences

ERIC Educational Resources Information Center

Mochizuki, Naoko

2017-01-01

Needs analysis (NA) plays a significant role in developing tasks that create opportunities for natural language use in classrooms. Preemptive NA, however, does not necessarily predict the contingently emerging interpersonal and social variables which influence learners and teachers' behaviours. These unpredictable variables often lead to a gap…

The Effects of Goal-Contingent Payment on the Performance of a Complex Task.

ERIC Educational Resources Information Center

Campbell, Donald J.

1984-01-01

Using a complex, computerized decision-making task, 56 university students participated in a six-week, repeated measures, goal-setting project, involving different payment systems. Results indicated that goal-contingent payment is superior to hourly payment in influencing performance, even though the perceived valence of payment and the actual…

Student Achievement and Differential Reinforcement of Incompatible Behavior: Hand Raising.

ERIC Educational Resources Information Center

Kelly, Michael Bryan; Bushell, Donald, Jr.

1987-01-01

Assessed reading achievement of five second-grade girls under two contingencies: (1) teacher contacts were made during on-task behavior; and (2) differential reinforcement of an incompatible behavior (DRI) with teacher contacts contingent on students' hand-raising behavior. Reading achievement and time on task were greater under the on-task…

Increasing and Decreasing Intrinsic Interest with Contingent Rewards: A Test of Cognitive Evaluation Theory.

ERIC Educational Resources Information Center

Enzle, Michael E.; Ross, June M.

1978-01-01

University students worked puzzles and were given a high or low value cash award, contingent on simple task completion or on attainment of a performance level, or noncontingent and unexpected. Interest in the task after reward was analyzed. Results provided substantial support for Deci's cognitive evaluation theory. (Author/SJL)

Behavior Bingo: The Effects of a Culturally Relevant Group Contingency Intervention for Students with EBD

ERIC Educational Resources Information Center

Collins, Tai A.; Hawkins, Renee O.; Flowers, Emily M.; Kalra, Hilary D.; Richard, Jessie; Haas, Lauren E.

2018-01-01

Students with emotional and behavioral disorders (EBD) have difficulty with academic engagement during independent seatwork tasks. The goal of the current study was to evaluate the effectiveness of Behavior Bingo, a novel interdependent group contingency intervention, on the academic engagement, off-task, and disruptive behavior of students with…

Chickadees discriminate contingency reversals presented consistently, but not frequently.

PubMed

McMillan, Neil; Hahn, Allison H; Congdon, Jenna V; Campbell, Kimberley A; Hoang, John; Scully, Erin N; Spetch, Marcia L; Sturdy, Christopher B

2017-07-01

Chickadees are high-metabolism, non-migratory birds, and thus an especially interesting model for studying how animals follow patterns of food availability over time. Here, we studied whether black-capped chickadees (Poecile atricapillus) could learn to reverse their behavior and/or to anticipate changes in reinforcement when the reinforcer contingencies for each stimulus were not stably fixed in time. In Experiment 1, we examined the responses of chickadees on an auditory go/no-go task, with constant reversals in reinforcement contingencies every 120 trials across daily testing intervals. Chickadees did not produce above-chance discrimination; however, when trained with a procedure that only reversed after successful discrimination, chickadees were able to discriminate and reverse their behavior successfully. In Experiment 2, we examined the responses of chickadees when reversals were structured to occur at the same time once per day, and chickadees were again able to discriminate and reverse their behavior over time, though they showed no reliable evidence of reversal anticipation. The frequency of reversals throughout the day thus appears to be an important determinant for these animals' performance in reversal procedures.

The effects of non-contingent extrinsic and intrinsic rewards on memory consolidation.

PubMed

Nielson, Kristy A; Bryant, Ted

2005-07-01

Emotional and arousing treatments given shortly after learning enhance delayed memory retrieval in animal and human studies. Positive affect and reward induced prior to a variety of cognitive tasks enhance performance, but their ability to affect memory consolidation has not been investigated before. Therefore, we investigated the effects of a small, non-contingent, intrinsic or extrinsic reward on delayed memory retrieval. Participants (n=108) studied and recalled a list of 30 affectively neutral, imageable nouns. Experimental groups were then given either an intrinsic reward (e.g., praise) or an extrinsic reward (e.g., US 1 dollar). After a one-week delay, participants' retrieval performance for the word list was significantly better in the extrinsic reward groups, whether the reward was expected or not, than in controls. Those who received the intrinsic reward performed somewhat better than controls, but the difference was not significant. Thus, at least some forms of arousal and reward, even when semantically unrelated to the learned material, can effectively modulate memory consolidation. These types of treatments might be useful for the development of new memory intervention strategies.

Temporal contingency.

PubMed

Gallistel, C R; Craig, Andrew R; Shahan, Timothy A

2014-01-01

Contingency, and more particularly temporal contingency, has often figured in thinking about the nature of learning. However, it has never been formally defined in such a way as to make it a measure that can be applied to most animal learning protocols. We use elementary information theory to define contingency in such a way as to make it a measurable property of almost any conditioning protocol. We discuss how making it a measurable construct enables the exploration of the role of different contingencies in the acquisition and performance of classically and operantly conditioned behavior. Copyright © 2013 Elsevier B.V. All rights reserved.

A History of Air Force Civil Engineering Wartime and Contingency Problems from 1941 to the Present

DTIC Science & Technology

1985-09-01

economical limitations, political restric- tions, and because AFCE has failed to properly learn and use lessons of the past to prepare for the future. vii I...a demanding managerial task. AFCE managers should, therefore, know what 8 " . .. .......’ .’ ’~t, " " ", .... .. ""...."...." ..... .. -i...problems with employing civilian labor. In France, the available civilians were either very young or very old as the prime- aged civilians were either

Behavioral semantics of learning and crossmodal processing in auditory cortex: the semantic processor concept.

PubMed

Scheich, Henning; Brechmann, André; Brosch, Michael; Budinger, Eike; Ohl, Frank W; Selezneva, Elena; Stark, Holger; Tischmeyer, Wolfgang; Wetzel, Wolfram

2011-01-01

Two phenomena of auditory cortex activity have recently attracted attention, namely that the primary field can show different types of learning-related changes of sound representation and that during learning even this early auditory cortex is under strong multimodal influence. Based on neuronal recordings in animal auditory cortex during instrumental tasks, in this review we put forward the hypothesis that these two phenomena serve to derive the task-specific meaning of sounds by associative learning. To understand the implications of this tenet, it is helpful to realize how a behavioral meaning is usually derived for novel environmental sounds. For this purpose, associations with other sensory, e.g. visual, information are mandatory to develop a connection between a sound and its behaviorally relevant cause and/or the context of sound occurrence. This makes it plausible that in instrumental tasks various non-auditory sensory and procedural contingencies of sound generation become co-represented by neuronal firing in auditory cortex. Information related to reward or to avoidance of discomfort during task learning, that is essentially non-auditory, is also co-represented. The reinforcement influence points to the dopaminergic internal reward system, the local role of which for memory consolidation in auditory cortex is well-established. Thus, during a trial of task performance, the neuronal responses to the sounds are embedded in a sequence of representations of such non-auditory information. The embedded auditory responses show task-related modulations of auditory responses falling into types that correspond to three basic logical classifications that may be performed with a perceptual item, i.e. from simple detection to discrimination, and categorization. This hierarchy of classifications determine the semantic "same-different" relationships among sounds. Different cognitive classifications appear to be a consequence of learning task and lead to a recruitment of different excitatory and inhibitory mechanisms and to distinct spatiotemporal metrics of map activation to represent a sound. The described non-auditory firing and modulations of auditory responses suggest that auditory cortex, by collecting all necessary information, functions as a "semantic processor" deducing the task-specific meaning of sounds by learning. © 2010. Published by Elsevier B.V.

NMDA and D2-like receptors modulate cognitive flexibility in a color discrimination reversal task in pigeons.

PubMed

Herold, Christina

2010-06-01

Reversal and extinction learning represent forms of cognitive flexibility that refer to the ability of an animal to alter behavior in response to unanticipated changes on environmental demands. A role for dopamine and glutamate in modulating this behavior has been implicated. Here, we determined the effects of intracerebroventricular injections in pigeons' forebrain of the D2-like receptor agonist quinpirole, the D2-like receptor antagonist sulpiride and the N-methyl-d-aspartate receptor antagonist AP-5 on initial acquisition and reversal of a color discrimination task. On day one, pigeons had to learn to discriminate two color keys. On day two, pigeons first performed a retention test, which was followed by a reversal of the reward contingencies of the two color keys. None of the drugs altered performance in the initial acquisition of color discrimination or affected the retention of the learned color key. In contrast, all drugs impaired reversal learning by increasing trials and incorrect responses in the reversal session. Our data support the hypothesis that D2-like receptor mechanisms, like N-methyl-d-aspartate receptor modulations, are involved in cognitive flexibility and relearning processes, but not in initial learning of stimulus-reward association.

Learning and altering behaviours by reinforcement: neurocognitive differences between children and adults.

PubMed

Shephard, E; Jackson, G M; Groom, M J

2014-01-01

This study examined neurocognitive differences between children and adults in the ability to learn and adapt simple stimulus-response associations through feedback. Fourteen typically developing children (mean age=10.2) and 15 healthy adults (mean age=25.5) completed a simple task in which they learned to associate visually presented stimuli with manual responses based on performance feedback (acquisition phase), and then reversed and re-learned those associations following an unexpected change in reinforcement contingencies (reversal phase). Electrophysiological activity was recorded throughout task performance. We found no group differences in learning-related changes in performance (reaction time, accuracy) or in the amplitude of event-related potentials (ERPs) associated with stimulus processing (P3 ERP) or feedback processing (feedback-related negativity; FRN) during the acquisition phase. However, children's performance was significantly more disrupted by the reversal than adults and FRN amplitudes were significantly modulated by the reversal phase in children but not adults. These findings indicate that children have specific difficulties with reinforcement learning when acquired behaviours must be altered. This may be caused by the added demands on immature executive functioning, specifically response monitoring, created by the requirement to reverse the associations, or a developmental difference in the way in which children and adults approach reinforcement learning. Copyright © 2013 The Authors. Published by Elsevier Ltd.. All rights reserved.

Causal Learning in Gambling Disorder: Beyond the Illusion of Control.

PubMed

Perales, José C; Navas, Juan F; Ruiz de Lara, Cristian M; Maldonado, Antonio; Catena, Andrés

2017-06-01

Causal learning is the ability to progressively incorporate raw information about dependencies between events, or between one's behavior and its outcomes, into beliefs of the causal structure of the world. In spite of the fact that some cognitive biases in gambling disorder can be described as alterations of causal learning involving gambling-relevant cues, behaviors, and outcomes, general causal learning mechanisms in gamblers have not been systematically investigated. In the present study, we compared gambling disorder patients against controls in an instrumental causal learning task. Evidence of illusion of control, namely, overestimation of the relationship between one's behavior and an uncorrelated outcome, showed up only in gamblers with strong current symptoms. Interestingly, this effect was part of a more complex pattern, in which gambling disorder patients manifested a poorer ability to discriminate between null and positive contingencies. Additionally, anomalies were related to gambling severity and current gambling disorder symptoms. Gambling-related biases, as measured by a standard psychometric tool, correlated with performance in the causal learning task, but not in the expected direction. Indeed, performance of gamblers with stronger biases tended to resemble the one of controls, which could imply that anomalies of causal learning processes play a role in gambling disorder, but do not seem to underlie gambling-specific biases, at least in a simple, direct way.

Procedures for Establishing a Contingency Managed Classroom.

ERIC Educational Resources Information Center

Westinghouse Learning Corp., Albuquerque, NM. Behavior Systems Div.

This manual for classroom teachers is designed to teach the application of contingency contracting procedures in the typical instructional setting. A "contingency contract" is an agreement between teacher and student whereby the student, upon demonstration of specific task achievement, receives a reward: permission to participate in a "reinforcing…

Organizational and Structural Reform: Transforming the United States Government for 21st Century Contingencies

DTIC Science & Technology

2009-04-03

the concept calls for interagency task forces ( IATF ) co-led by a Special Representative of the President and the Commander of a military Joint Task...functional lines, civilian and military members comprise the IATF staff. Furthermore, when possible, the concept establishes the IATF early outside the...prepare and plan for the complex contingency. When deployed, the IATF relies on the military joint task force for most of its support including

Rapid extraction of auditory feature contingencies.

PubMed

Bendixen, Alexandra; Prinz, Wolfgang; Horváth, János; Trujillo-Barreto, Nelson J; Schröger, Erich

2008-07-01

Contingent relations between sensory events render the environment predictable and thus facilitate adaptive behavior. The human capacity to detect such relations has been comprehensively demonstrated in paradigms in which contingency rules were task-relevant or in which they applied to motor behavior. The extent to which contingencies can also be extracted from events that are unrelated to the current goals of the organism has remained largely unclear. The present study addressed the emergence of contingency-related effects for behaviorally irrelevant auditory stimuli and the cortical areas involved in the processing of such contingency rules. Contingent relations between different features of temporally separate events were embedded in a new dynamic protocol. Participants were presented with the auditory stimulus sequences while their attention was captured by a video. The mismatch negativity (MMN) component of the event-related brain potential (ERP) was employed as an electrophysiological correlate of contingency detection. MMN generators were localized by means of scalp current density (SCD) and primary current density (PCD) analyses with variable resolution electromagnetic tomography (VARETA). Results show that task-irrelevant contingencies can be extracted from about fifteen to twenty successive events conforming to the contingent relation. Topographic and tomographic analyses reveal the involvement of the auditory cortex in the processing of contingency violations. The present data provide evidence for the rapid encoding of complex extrapolative relations in sensory areas. This capacity is of fundamental importance for the organism in its attempt to model the sensory environment outside the focus of attention.

Skype Me! Socially Contingent Interactions Help Toddlers Learn Language

ERIC Educational Resources Information Center

Roseberry, Sarah; Hirsh-Pasek, Kathy; Golinkoff, Roberta M.

2014-01-01

Language learning takes place in the context of social interactions, yet the mechanisms that render social interactions useful for learning language remain unclear. This study focuses on whether social contingency might support word learning. Toddlers aged 24-30 months (N = 36) were exposed to novel verbs in one of three conditions: live…

Erasing the engram: the unlearning of procedural skills.

PubMed

Crossley, Matthew J; Ashby, F Gregory; Maddox, W Todd

2013-08-01

Huge amounts of money are spent every year on unlearning programs--in drug-treatment facilities, prisons, psychotherapy clinics, and schools. Yet almost all of these programs fail, since recidivism rates are high in each of these fields. Progress on this problem requires a better understanding of the mechanisms that make unlearning so difficult. Much cognitive neuroscience evidence suggests that an important component of these mechanisms also dictates success on categorization tasks that recruit procedural learning and depend on synaptic plasticity within the striatum. A biologically detailed computational model of this striatal-dependent learning is described (based on Ashby & Crossley, 2011). The model assumes that a key component of striatal-dependent learning is provided by interneurons in the striatum called the tonically active neurons (TANs), which act as a gate for the learning and expression of striatal-dependent behaviors. In their tonically active state, the TANs prevent the expression of any striatal-dependent behavior. However, they learn to pause in rewarding environments and thereby permit the learning and expression of striatal-dependent behaviors. The model predicts that when rewards are no longer contingent on behavior, the TANs cease to pause, which protects striatal learning from decay and prevents unlearning. In addition, the model predicts that when rewards are partially contingent on behavior, the TANs remain partially paused, leaving the striatum available for unlearning. The results from 3 human behavioral studies support the model predictions and suggest a novel unlearning protocol that shows promising initial signs of success. PsycINFO Database Record (c) 2013 APA, all rights reserved.

The effect of postnatal depression on mother-infant interaction, infant response to the Still-face perturbation, and performance on an Instrumental Learning task.

PubMed

Stanley, Charles; Murray, Lynne; Stein, Alan

2004-01-01

A representative community sample of primiparous depressed women and a nondepressed control group were assessed while in interaction with their infants at 2 months postpartum. At 3 months, infants were assessed on the Still-face perturbation of face to face interaction, and a subsample completed an Instrumental Learning paradigm. Compared to nondepressed women, depressed mothers' interactions were both less contingent and less affectively attuned to infant behavior. Postnatal depression did not adversely affect the infant's performance in either the Still-face perturbation or the Instrumental Learning assessment. Maternal responsiveness in interactions at 2 months predicted the infant's performance in the Instrumental Learning assessment but not in the Still-face perturbation. The implications of these findings for theories of infant cognitive and emotional development are discussed.

Evaluation of ambiguous associations in the amygdala by learning the structure of the environment

PubMed Central

Madarasz, Tamas J.; Diaz-Mataix, Lorenzo; Akhand, Omar; Ycu, Edgar A.; LeDoux, Joseph E.; Johansen, Joshua P.

2017-01-01

Recognizing predictive relationships is critical for survival, but an understanding of the underlying neural mechanisms remains elusive. In particular it is unclear how the brain distinguishes predictive relationships from spurious ones when evidence about a relationship is ambiguous, or how it computes predictions given such uncertainty. To better understand this process we introduced ambiguity into an associative learning task by presenting aversive outcomes both in the presence and absence of a predictive cue. Electrophysiological and optogenetic approaches revealed that amygdala neurons directly regulate and track the effects of ambiguity on learning. Contrary to established accounts of associative learning however, interference from competing associations was not required to assess an ambiguous cue-outcome contingency. Instead, animals’ behavior was explained by a normative account that evaluates different models of the environment’s statistical structure. These findings suggest an alternative view on the role of amygdala circuits in resolving ambiguity during aversive learning. PMID:27214568

Evaluation of ambiguous associations in the amygdala by learning the structure of the environment.

PubMed

Madarasz, Tamas J; Diaz-Mataix, Lorenzo; Akhand, Omar; Ycu, Edgar A; LeDoux, Joseph E; Johansen, Joshua P

2016-07-01

Recognizing predictive relationships is critical for survival, but an understanding of the underlying neural mechanisms remains elusive. In particular, it is unclear how the brain distinguishes predictive relationships from spurious ones when evidence about a relationship is ambiguous, or how it computes predictions given such uncertainty. To better understand this process, we introduced ambiguity into an associative learning task by presenting aversive outcomes both in the presence and in the absence of a predictive cue. Electrophysiological and optogenetic approaches revealed that amygdala neurons directly regulated and tracked the effects of ambiguity on learning. Contrary to established accounts of associative learning, however, interference from competing associations was not required to assess an ambiguous cue-outcome contingency. Instead, animals' behavior was explained by a normative account that evaluates different models of the environment's statistical structure. These findings suggest an alternative view of amygdala circuits in resolving ambiguity during aversive learning.

Longitudinal investigation on learned helplessness tested under negative and positive reinforcement involving stimulus control.

PubMed

Oliveira, Emileane C; Hunziker, Maria Helena

2014-07-01

In this study, we investigated whether (a) animals demonstrating the learned helplessness effect during an escape contingency also show learning deficits under positive reinforcement contingencies involving stimulus control and (b) the exposure to positive reinforcement contingencies eliminates the learned helplessness effect under an escape contingency. Rats were initially exposed to controllable (C), uncontrollable (U) or no (N) shocks. After 24h, they were exposed to 60 escapable shocks delivered in a shuttlebox. In the following phase, we selected from each group the four subjects that presented the most typical group pattern: no escape learning (learned helplessness effect) in Group U and escape learning in Groups C and N. All subjects were then exposed to two phases, the (1) positive reinforcement for lever pressing under a multiple FR/Extinction schedule and (2) a re-test under negative reinforcement (escape). A fourth group (n=4) was exposed only to the positive reinforcement sessions. All subjects showed discrimination learning under multiple schedule. In the escape re-test, the learned helplessness effect was maintained for three of the animals in Group U. These results suggest that the learned helplessness effect did not extend to discriminative behavior that is positively reinforced and that the learned helplessness effect did not revert for most subjects after exposure to positive reinforcement. We discuss some theoretical implications as related to learned helplessness as an effect restricted to aversive contingencies and to the absence of reversion after positive reinforcement. This article is part of a Special Issue entitled: insert SI title. Copyright © 2014. Published by Elsevier B.V.

The globus pallidus pars interna in goal-oriented and routine behaviors: Resolving a long-standing paradox.

PubMed

Piron, Camille; Kase, Daisuke; Topalidou, Meropi; Goillandeau, Michel; Orignac, Hugues; N'Guyen, Tho-Haï; Rougier, Nicolas; Boraud, Thomas

2016-08-01

There is an apparent contradiction between experimental data showing that the basal ganglia are involved in goal-oriented and routine behaviors and clinical observations. Lesion or disruption by deep brain stimulation of the globus pallidus interna has been used for various therapeutic purposes ranging from the improvement of dystonia to the treatment of Tourette's syndrome. None of these approaches has reported any severe impairment in goal-oriented or automatic movement. To solve this conundrum, we trained 2 monkeys to perform a variant of a 2-armed bandit-task (with different reward contingencies). In the latter we alternated blocks of trials with choices between familiar rewarded targets that elicit routine behavior and blocks with novel pairs of targets that require an intentional learning process. Bilateral inactivation of the globus pallidus interna, by injection of muscimol, prevents animals from learning new contingencies while performance remains intact, although slower for the familiar stimuli. We replicate in silico these data by adding lateral competition and Hebbian learning in the cortical layer of the theoretical model of the cortex-basal ganglia loop that provided the framework of our experimental approach. The basal ganglia play a critical role in the deliberative process that underlies learning but are not necessary for the expression of routine movements. Our approach predicts that after pallidotomy or during stimulation, patients should have difficulty with complex decision-making processes or learning new goal-oriented behaviors. © 2016 Movement Disorder Society. © 2016 International Parkinson and Movement Disorder Society.

Instructional control of reinforcement learning: A behavioral and neurocomputational investigation

PubMed Central

Doll, Bradley B.; Jacobs, W. Jake; Sanfey, Alan G.; Frank, Michael J.

2011-01-01

Humans learn how to behave directly through environmental experience and indirectly through rules and instructions. Behavior analytic research has shown that instructions can control behavior, even when such behavior leads to sub-optimal outcomes (Hayes, S. (Ed.). 1989. Rule-governed behavior: cognition, contingencies, and instructional control. Plenum Press.). Here we examine the control of behavior through instructions in a reinforcement learning task known to depend on striatal dopaminergic function. Participants selected between probabilistically reinforced stimuli, and were (incorrectly) told that a specific stimulus had the highest (or lowest) reinforcement probability. Despite experience to the contrary, instructions drove choice behavior. We present neural network simulations that capture the interactions between instruction-driven and reinforcement-driven behavior via two potential neural circuits: one in which the striatum is inaccurately trained by instruction representations coming from prefrontal cortex/hippocampus (PFC/HC), and another in which the striatum learns the environmentally based reinforcement contingencies, but is “overridden” at decision output. Both models capture the core behavioral phenomena but, because they differ fundamentally on what is learned, make distinct predictions for subsequent behavioral and neuroimaging experiments. Finally, we attempt to distinguish between the proposed computational mechanisms governing instructed behavior by fitting a series of abstract “Q-learning” and Bayesian models to subject data. The best-fitting model supports one of the neural models, suggesting the existence of a “confirmation bias” in which the PFC/HC system trains the reinforcement system by amplifying outcomes that are consistent with instructions while diminishing inconsistent outcomes. PMID:19595993

Executive functions, information sampling, and decision making in narcolepsy with cataplexy.

PubMed

Delazer, Margarete; Högl, Birgit; Zamarian, Laura; Wenter, Johanna; Gschliesser, Viola; Ehrmann, Laura; Brandauer, Elisabeth; Cevikkol, Zehra; Frauscher, Birgit

2011-07-01

Narcolepsy with cataplexy (NC) affects neurotransmitter systems regulating emotions and cognitive functions. This study aimed to assess executive functions, information sampling, reward processing, and decision making in NC. Twenty-one NC patients and 58 healthy participants performed an extensive neuropsychological test battery. NC patients scored as controls in executive function tasks assessing set shifting, reversal learning, working memory, and planning. Group differences appeared in a task measuring information sampling and reward sensitivity. NC patients gathered less information, tolerated a higher level of uncertainty, and were less influenced by reward contingencies than controls. NC patients also showed reduced learning in decision making and had significantly lower scores than controls in the fifth block of the IOWA gambling task. No correlations were found with measures of sleepiness. NC patients may achieve high performance in several neuropsychological domains, including executive functions. Specific differences between NC patients and controls highlight the importance of the hypocretin system in reward processing and decision making and are in line with previous neuroimaging and neurophysiological studies. PsycINFO Database Record (c) 2011 APA, all rights reserved.

From vulnerability to resilience: learning orientations buffer contingent self-esteem from failure.

PubMed

Niiya, Yu; Crocker, Jennifer; Bartmess, Elizabeth N

2004-12-01

An experiment examined the buffering effects of a learning orientation following failure in a domain of contingent self-worth. Participants' academic contingencies of self-worth (CSW) and priming with theories of intelligence interacted to affect vulnerability of self-esteem to failure. Participants who had high academic CSW and were primed with an entity theory of intelligence experienced lower self-esteem and higher negative affect following failure than following success on an academic test, but these effects were eliminated when participants with high academic CSW were primed with an incremental theory of intelligence. This study shows that endorsing a learning orientation is an effective way to minimize threat to self-esteem among students whose self-worth is highly contingent on academics and may allow them to persist in the face of challenges and to learn from failure.

U.S. Army Medical Contingent to Task Force Forager Pacific Partnership 2015: Lessons and Best Practices

DTIC Science & Technology

2016-07-01

CONTINGENT-PACIFIC PARTNERSHIP 2015 Foreword Global health engagements conducted in...medical task force of health -care experts with medical equipment and supplies to conduct health engagements in four host nations, including the...at Pearl Harbor, HI, 15 medical personnel from the Australian and New Zealand defense forces; a civilian medical planner from Project HOPE ( Health

The Relation between Contingency Preference and Imitation in 6-8-Month-Old Infants

ERIC Educational Resources Information Center

Klein-Radukic, Sarah; Zmyj, Norbert

2016-01-01

Detecting self-generated actions and imitating other-generated actions are important abilities in order to interact with others. The relationship between these domains was investigated in 6-8-month-old infants. In a contingency-preference task, infants observed their own legs on a real-time and a delayed video display. In an imitation task, the…

Combining Self-Monitoring and an Interdependent Group Contingency to Improve the Behavior of Sixth Graders with EBD

ERIC Educational Resources Information Center

Denune, Hilary; Hawkins, Renee; Donovan, Lauren; Mccoy, Dacia; Hall, Lyndsie; Moeder, Anthony

2015-01-01

A withdrawal design was used to examine the influence of a self-monitoring procedure on the overall effectiveness of an interdependent group contingency intervention implemented in a sixth-grade classroom in an alternative school serving students with emotional and behavioral disorders (EBD). Dependent variables included student on-task, off-task,…

Hebbian Learning is about contingency, not contiguity, and explains the emergence of predictive mirror neurons.

PubMed

Keysers, Christian; Perrett, David I; Gazzola, Valeria

2014-04-01

Hebbian Learning should not be reduced to contiguity, as it detects contingency and causality. Hebbian Learning accounts of mirror neurons make predictions that differ from associative learning: Through Hebbian Learning, mirror neurons become dynamic networks that calculate predictions and prediction errors and relate to ideomotor theories. The social force of imitation is important for mirror neuron emergence and suggests canalization.

Scaffolding--How Can Contingency Lead to Successful Learning When Dealing with Errors?

ERIC Educational Resources Information Center

Wischgoll, Anke; Pauli, Christine; Reusser, Kurt

2015-01-01

Errors indicate learners' misunderstanding and can provide learning opportunities. Providing learning support which is contingent on learners' needs when errors occur is considered effective for developing learners' understanding. The current investigation examines how tutors and tutees interact productively with errors when working on a…

An Experimental Test of the Contingency Model of Leadership Effectiveness.

ERIC Educational Resources Information Center

Chemers, Martin M.; Skrzypek, George J.

The present experiment provided a test of Fiedler's (1967) Contingency Model of Leadership Effectiveness, i.e., the relationship of leader style to group effectiveness is mediated by situational demands. Thirty-two 4 man task groups composed of military academy cadets were run in the experiment. In accordance with the Contingency Model, leaders…

Multilevel linear modelling of the response-contingent learning of young children with significant developmental delays.

PubMed

Raab, Melinda; Dunst, Carl J; Hamby, Deborah W

2018-02-27

The purpose of the study was to isolate the sources of variations in the rates of response-contingent learning among young children with multiple disabilities and significant developmental delays randomly assigned to contrasting types of early childhood intervention. Multilevel, hierarchical linear growth curve modelling was used to analyze four different measures of child response-contingent learning where repeated child learning measures were nested within individual children (Level-1), children were nested within practitioners (Level-2), and practitioners were nested within the contrasting types of intervention (Level-3). Findings showed that sources of variations in rates of child response-contingent learning were associated almost entirely with type of intervention after the variance associated with differences in practitioners nested within groups were accounted for. Rates of child learning were greater among children whose existing behaviour were used as the building blocks for promoting child competence (asset-based practices) compared to children for whom the focus of intervention was promoting child acquisition of missing skills (needs-based practices). The methods of analysis illustrate a practical approach to clustered data analysis and the presentation of results in ways that highlight sources of variations in the rates of response-contingent learning among young children with multiple developmental disabilities and significant developmental delays. Copyright © 2018 The Author(s). Published by Elsevier Ltd.. All rights reserved.

Adaptive Encoding of Outcome Prediction by Prefrontal Cortex Ensembles Supports Behavioral Flexibility.

PubMed

Del Arco, Alberto; Park, Junchol; Wood, Jesse; Kim, Yunbok; Moghaddam, Bita

2017-08-30

The prefrontal cortex (PFC) is thought to play a critical role in behavioral flexibility by monitoring action-outcome contingencies. How PFC ensembles represent shifts in behavior in response to changes in these contingencies remains unclear. We recorded single-unit activity and local field potentials in the dorsomedial PFC (dmPFC) of male rats during a set-shifting task that required them to update their behavior, among competing options, in response to changes in action-outcome contingencies. As behavior was updated, a subset of PFC ensembles encoded the current trial outcome before the outcome was presented. This novel outcome-prediction encoding was absent in a control task, in which actions were rewarded pseudorandomly, indicating that PFC neurons are not merely providing an expectancy signal. In both control and set-shifting tasks, dmPFC neurons displayed postoutcome discrimination activity, indicating that these neurons also monitor whether a behavior is successful in generating rewards. Gamma-power oscillatory activity increased before the outcome in both tasks but did not differentiate between expected outcomes, suggesting that this measure is not related to set-shifting behavior but reflects expectation of an outcome after action execution. These results demonstrate that PFC neurons support flexible rule-based action selection by predicting outcomes that follow a particular action. SIGNIFICANCE STATEMENT Tracking action-outcome contingencies and modifying behavior when those contingencies change is critical to behavioral flexibility. We find that ensembles of dorsomedial prefrontal cortex neurons differentiate between expected outcomes when action-outcome contingencies change. This predictive mode of signaling may be used to promote a new response strategy at the service of behavioral flexibility. Copyright © 2017 the authors 0270-6474/17/378363-11$15.00/0.

The chemotherapeutic agent paclitaxel selectively impairs learning while sparing source memory and spatial memory.

PubMed

Smith, Alexandra E; Slivicki, Richard A; Hohmann, Andrea G; Crystal, Jonathon D

2017-03-01

Chemotherapeutic agents are widely used to treat patients with systemic cancer. The efficacy of these therapies is undermined by their adverse side-effect profiles such as cognitive deficits that have a negative impact on the quality of life of cancer survivors. Cognitive side effects occur across a variety of domains, including memory, executive function, and processing speed. Such impairments are exacerbated under cognitive challenges and a subgroup of patients experience long-term impairments. Episodic memory in rats can be examined using a source memory task. In the current study, rats received paclitaxel, a taxane-derived chemotherapeutic agent, and learning and memory functioning was examined using the source memory task. Treatment with paclitaxel did not impair spatial and episodic memory, and paclitaxel treated rats were not more susceptible to cognitive challenges. Under conditions in which memory was not impaired, paclitaxel treatment impaired learning of new rules, documenting a decreased sensitivity to changes in experimental contingencies. These findings provide new information on the nature of cancer chemotherapy-induced cognitive impairments, particularly regarding the incongruent vulnerability of episodic memory and new learning following treatment with paclitaxel. Copyright © 2016 Elsevier B.V. All rights reserved.

Comparing associative, statistical, and inferential reasoning accounts of human contingency learning.

PubMed

Pineño, Oskar; Miller, Ralph R

2007-03-01

For more than two decades, researchers have contrasted the relative merits of associative and statistical theories as accounts of human contingency learning. This debate, still far from resolution, has led to further refinement of models within each family of theories. More recently, a third theoretical view has joined the debate: the inferential reasoning account. The explanations of these three accounts differ critically in many aspects, such as level of analysis and their emphasis on different steps within the information-processing sequence. Also, each account has important advantages (as well as critical flaws) and emphasizes experimental evidence that poses problems to the others. Some hybrid models of human contingency learning have attempted to reconcile certain features of these accounts, thereby benefiting from some of the unique advantages of different families of accounts. A comparison of these families of accounts will help us appreciate the challenges that research on human contingency learning will face over the coming years.

Hebbian Learning is about contingency not contiguity and explains the emergence of predictive mirror neurons

PubMed Central

Keysers, Christian; Perrett, David I.; Gazzola, Valeria

2015-01-01

Hebbian Learning should not be reduced to contiguity since it detects contingency and causality. Hebbian Learning accounts of mirror neurons make predictions that differ from associative learning: through Hebbian Learning mirror neurons become dynamic networks that calculate predictions and prediction errors and relate to ideomotor theories. The social force of imitation is important for mirror neuron emergence and suggests canalization. PMID:24775162

Transgressive vs Conformative: Immigrant Women Learning at Contingent Work

ERIC Educational Resources Information Center

Maitra, Srabani; Shan, Hongxia

2007-01-01

Purpose--The paper seeks to explore workers' learning in relation to the racialized and gendered organization of contingent work. Design/methodology/approach--This paper is informed by Marxist theorization of labour power and learning. It draws on the interview data of 24 highly educated immigrant women from the research project "Skilled In…

Contingency Learning and Reactivity in Preterm and Full-Term Infants at 3 Months

ERIC Educational Resources Information Center

Haley, David W.; Grunau, Ruth E.; Oberlander, Tim F.; Weinberg, Joanne

2008-01-01

Learning difficulties in preterm infants are thought to reflect impairment in arousal regulation. We examined relationships among gestational age, learning speed, and behavioral and physiological reactivity in 55 preterm and 49 full-term infants during baseline, contingency, and nonreinforcement phases of a conjugate mobile paradigm at 3 months…

The Impact of Individual Differences on E-Learning System Satisfaction: A Contingency Approach

ERIC Educational Resources Information Center

Lu, Hsi-Peng; Chiou, Ming-Jen

2010-01-01

This study investigated the impact of contingent variables on the relationship between four predictors and students' satisfaction with e-learning. Five hundred and twenty-two university students from 10 intact classes engaging in online instruction were asked to answer questionnaires about their learning styles, perceptions of the quality of the…

Feedback Blunting: Total Sleep Deprivation Impairs Decision Making that Requires Updating Based on Feedback.

PubMed

Whitney, Paul; Hinson, John M; Jackson, Melinda L; Van Dongen, Hans P A

2015-05-01

To better understand the sometimes catastrophic effects of sleep loss on naturalistic decision making, we investigated effects of sleep deprivation on decision making in a reversal learning paradigm requiring acquisition and updating of information based on outcome feedback. Subjects were randomized to a sleep deprivation or control condition, with performance testing at baseline, after 2 nights of total sleep deprivation (or rested control), and following 2 nights of recovery sleep. Subjects performed a decision task involving initial learning of go and no go response sets followed by unannounced reversal of contingencies, requiring use of outcome feedback for decisions. A working memory scanning task and psychomotor vigilance test were also administered. Six consecutive days and nights in a controlled laboratory environment with continuous behavioral monitoring. Twenty-six subjects (22-40 y of age; 10 women). Thirteen subjects were randomized to a 62-h total sleep deprivation condition; the others were controls. Unlike controls, sleep deprived subjects had difficulty with initial learning of go and no go stimuli sets and had profound impairment adapting to reversal. Skin conductance responses to outcome feedback were diminished, indicating blunted affective reactions to feedback accompanying sleep deprivation. Working memory scanning performance was not significantly affected by sleep deprivation. And although sleep deprived subjects showed expected attentional lapses, these could not account for impairments in reversal learning decision making. Sleep deprivation is particularly problematic for decision making involving uncertainty and unexpected change. Blunted reactions to feedback while sleep deprived underlie failures to adapt to uncertainty and changing contingencies. Thus, an error may register, but with diminished effect because of reduced affective valence of the feedback or because the feedback is not cognitively bound with the choice. This has important implications for understanding and managing sleep loss-induced cognitive impairment in emergency response, disaster management, military operations, and other dynamic real-world settings with uncertain outcomes and imperfect information. © 2015 Associated Professional Sleep Societies, LLC.

Contingent capture and inhibition of return: a comparison of mechanisms.

PubMed

Prinzmetal, William; Taylor, Jordan A; Myers, Loretta Barry; Nguyen-Espino, Jacqueline

2011-09-01

We investigated the cause(s) of two effects associated with involuntary attention in the spatial cueing task: contingent capture and inhibition of return (IOR). Previously, we found that there were two mechanisms of involuntary attention in this task: (1) a (serial) search mechanism that predicts a larger cueing effect in reaction time with more display locations and (2) a decision (threshold) mechanism that predicts a smaller cueing effect with more display locations (Prinzmetal et al. 2010). In the present study, contingent capture and IOR had completely different patterns of results when we manipulated the number of display locations and the presence of distractors. Contingent capture was best described by a search model, whereas the inhibition of return was best described by a decision model. Furthermore, we fit a linear ballistic accumulator model to the results and IOR was accounted for by a change of threshold, whereas the results from contingent capture experiments could not be fit with a change of threshold and were better fit by a search model.

An Onboard ISS Virtual Reality Trainer

NASA Technical Reports Server (NTRS)

Miralles, Evelyn

2013-01-01

Prior to the retirement of the Space Shuttle, many exterior repairs on the International Space Station (ISS) were carried out by shuttle astronauts, trained on the ground and flown to the station to perform these repairs. After the retirement of the shuttle, this is no longer an available option. As such, the need for the ISS crew members to review scenarios while on flight, either for tasks they already trained or for contingency operations has become a very critical subject. In many situations, the time between the last session of Neutral Buoyancy Laboratory (NBL) training and an Extravehicular Activity (EVA) task might be 6 to 8 months. In order to help with training for contingency repairs and to maintain EVA proficiency while on flight, the Johnson Space Center Virtual Reality Lab (VRLab) designed an onboard immersive ISS Virtual Reality Trainer (VRT), incorporating a unique optical system and making use of the already successful Dynamic Onboard Ubiquitous Graphical (DOUG) graphics software, to assist crew members with current procedures and contingency EVAs while on flight. The VRT provides an immersive environment similar to the one experienced at the VRLab crew training facility at NASA Johnson Space Center. EVA tasks are critical for a mission since as time passes the crew members may lose proficiency on previously trained tasks. In addition, there is an increased need for unplanned contingency repairs to fix problems arising as the ISS ages. The need to train and re-train crew members for EVAs and contingency scenarios is crucial and extremely demanding. ISS crew members are now asked to perform EVA tasks for which they have not been trained and potentially have never seen before.

Rewards and creative performance: a meta-analytic test of theoretically derived hypotheses.

PubMed

Byron, Kris; Khazanchi, Shalini

2012-07-01

Although many scholars and practitioners are interested in understanding how to motivate individuals to be more creative, whether and how rewards affect creativity remain unclear. We argue that the conflicting evidence may be due to differences between studies in terms of reward conditions and the context in which rewards are offered. Specifically, we examine 5 potential moderators of the rewards-creative performance relationship: (a) the reward contingency, (b) the extent to which participants are provided information about their past or current creative performance, (c) the extent to which the reward and context offer choice or impose control, (d) the extent to which the context serves to enhance task engagement, and (e) the extent to which the performance tasks are complex. Using random-effects models, we meta-analyzed 60 experimental and nonexperimental studies (including 69 independent samples) that examined the rewards-creativity relationship with children or adults. Our results suggest that creativity-contingent rewards tend to increase creative performance-and are more positively related to creative performance when individuals are given more positive, contingent, and task-focused performance feedback and are provided more choice (and are less controlled). In contrast, performance-contingent or completion-contingent rewards tend to have a slight negative effect on creative performance.

Sea Slugs, Subliminal Pictures, and Vegetative State Patients: Boundaries of Consciousness in Classical Conditioning

PubMed Central

Bekinschtein, Tristan A.; Peeters, Moos; Shalom, Diego; Sigman, Mariano

2011-01-01

Classical (trace) conditioning is a specific variant of associative learning in which a neutral stimulus leads to the subsequent prediction of an emotionally charged or noxious stimulus after a temporal gap. When conditioning is concurrent with a distraction task, only participants who can report the relationship (the contingency) between stimuli explicitly show associative learning. This suggests that consciousness is a prerequisite for trace conditioning. We review and question three main controversies concerning this view. Firstly, virtually all animals, even invertebrate sea slugs, show this type of learning; secondly, unconsciously perceived stimuli may elicit trace conditioning; and thirdly, some vegetative state patients show trace learning. We discuss and analyze these seemingly contradictory arguments to find the theoretical boundaries of consciousness in classical conditioning. We conclude that trace conditioning remains one of the best measures to test conscious processing in the absence of explicit reports. PMID:22164148

Proactivity and Reinforcement: The Contingency of Social Behavior

ERIC Educational Resources Information Center

Williams, J. Sherwood; And Others

1976-01-01

This paper analyzes development of group structure in terms of the stimulus-sampling perspective. Learning is the continual sampling of possibilities, with those reinforced possibilities increasing in probability of occurance. This contingency learning approach is tested experimentally. (NG)

Multiple memory systems as substrates for multiple decision systems

PubMed Central

Doll, Bradley B.; Shohamy, Daphna; Daw, Nathaniel D.

2014-01-01

It has recently become widely appreciated that value-based decision making is supported by multiple computational strategies. In particular, animal and human behavior in learning tasks appears to include habitual responses described by prominent model-free reinforcement learning (RL) theories, but also more deliberative or goal-directed actions that can be characterized by a different class of theories, model-based RL. The latter theories evaluate actions by using a representation of the contingencies of the task (as with a learned map of a spatial maze), called an “internal model.” Given the evidence of behavioral and neural dissociations between these approaches, they are often characterized as dissociable learning systems, though they likely interact and share common mechanisms. In many respects, this division parallels a longstanding dissociation in cognitive neuroscience between multiple memory systems, describing, at the broadest level, separate systems for declarative and procedural learning. Procedural learning has notable parallels with model-free RL: both involve learning of habits and both are known to depend on parts of the striatum. Declarative memory, by contrast, supports memory for single events or episodes and depends on the hippocampus. The hippocampus is thought to support declarative memory by encoding temporal and spatial relations among stimuli and thus is often referred to as a relational memory system. Such relational encoding is likely to play an important role in learning an internal model, the representation that is central to model-based RL. Thus, insofar as the memory systems represent more general-purpose cognitive mechanisms that might subserve performance on many sorts of tasks including decision making, these parallels raise the question whether the multiple decision systems are served by multiple memory systems, such that one dissociation is grounded in the other. Here we investigated the relationship between model-based RL and relational memory by comparing individual differences across behavioral tasks designed to measure either capacity. Human subjects performed two tasks, a learning and generalization task (acquired equivalence) which involves relational encoding and depends on the hippocampus; and a sequential RL task that could be solved by either a model-based or model-free strategy. We assessed the correlation between subjects’ use of flexible, relational memory, as measured by generalization in the acquired equivalence task, and their differential reliance on either RL strategy in the decision task. We observed a significant positive relationship between generalization and model-based, but not model-free, choice strategies. These results are consistent with the hypothesis that model-based RL, like acquired equivalence, relies on a more general-purpose relational memory system. PMID:24846190

Factors influencing the role of cardiac autonomic regulation in the service of cognitive control.

PubMed

Capuana, Lesley J; Dywan, Jane; Tays, William J; Elmers, Jamie L; Witherspoon, Richelle; Segalowitz, Sidney J

2014-10-01

Working from a model of neurovisceral integration, we examined whether adding response contingencies and motivational involvement would increase the need for cardiac autonomic regulation in maintaining effective cognitive control. Respiratory sinus arrhythmia (RSA) was recorded during variants of the Stroop color-word task. The Basic task involved "accepting" congruent items and "rejecting" words printed in incongruent colors (BLUE in red font); an added contingency involved rejecting a particular congruent word (e.g., RED in red font), or a congruent word repeated on an immediately subsequent trial. Motivation was increased by adding a financial incentive phase. Results indicate that pre-task RSA predicted accuracy best when response contingencies required the maintenance of a specific item in memory or on the Basic Stroop task when errors resulted in financial loss. Overall, RSA appeared to be most relevant to performance when the task encouraged a more proactive style of cognitive control, a control strategy thought to be more metabolically costly, and hence, more reliant on flexible cardiac autonomic regulation. Copyright © 2014 Elsevier B.V. All rights reserved.

Pattern Analyses Reveal Separate Experience-Based Fear Memories in the Human Right Amygdala.

PubMed

Braem, Senne; De Houwer, Jan; Demanet, Jelle; Yuen, Kenneth S L; Kalisch, Raffael; Brass, Marcel

2017-08-23

Learning fear via the experience of contingencies between a conditioned stimulus (CS) and an aversive unconditioned stimulus (US) is often assumed to be fundamentally different from learning fear via instructions. An open question is whether fear-related brain areas respond differently to experienced CS-US contingencies than to merely instructed CS-US contingencies. Here, we contrasted two experimental conditions where subjects were instructed to expect the same CS-US contingencies while only one condition was characterized by prior experience with the CS-US contingency. Using multivoxel pattern analysis of fMRI data, we found CS-related neural activation patterns in the right amygdala (but not in other fear-related regions) that dissociated between whether a CS-US contingency had been instructed and experienced versus merely instructed. A second experiment further corroborated this finding by showing a category-independent neural response to instructed and experienced, but not merely instructed, CS presentations in the human right amygdala. Together, these findings are in line with previous studies showing that verbal fear instructions have a strong impact on both brain and behavior. However, even in the face of fear instructions, the human right amygdala still shows a separable neural pattern response to experience-based fear contingencies. SIGNIFICANCE STATEMENT In our study, we addressed a fundamental problem of the science of human fear learning and memory, namely whether fear learning via experience in humans relies on a neural pathway that can be separated from fear learning via verbal information. Using two new procedures and recent advances in the analysis of brain imaging data, we localized purely experience-based fear processing and memory in the right amygdala, thereby making a direct link between human and animal research. Copyright © 2017 the authors 0270-6474/17/378116-15$15.00/0.

Generalizing attentional control across dimensions and tasks: evidence from transfer of proportion-congruent effects.

PubMed

Wühr, Peter; Duthoo, Wout; Notebaert, Wim

2015-01-01

Three experiments investigated transfer of list-wide proportion congruent (LWPC) effects from a set of congruent and incongruent items with different frequency (inducer task) to a set of congruent and incongruent items with equal frequency (diagnostic task). Experiments 1 and 2 mixed items from horizontal and vertical Simon tasks. Tasks always involved different stimuli that varied on the same dimension (colour) in Experiment 1 and on different dimensions (colour, shape) in Experiment 2. Experiment 3 mixed trials from a manual Simon task with trials from a vocal Stroop task, with colour being the relevant stimulus in both tasks. There were two major results. First, we observed transfer of LWPC effects in Experiments 1 and 3, when tasks shared the relevant dimension, but not in Experiment 2. Second, sequential modulations of congruency effects transferred in Experiment 1 only. Hence, the different transfer patterns suggest that LWPC effects and sequential modulations arise from different mechanisms. Moreover, the observation of transfer supports an account of LWPC effects in terms of list-wide cognitive control, while being at odds with accounts in terms of stimulus-response (contingency) learning and item-specific control.

The Effects of the CW-FIT Group Contingency on Class-Wide and Individual Behavior in an Urban First Grade Classroom

ERIC Educational Resources Information Center

Naylor, Anna Schmidt; Kamps, Debra; Wills, Howard

2018-01-01

The current study examined the effects of the Class-wide Function-related Intervention Teams (CW-FIT), a class-wide group contingency, on the on-task behavior of all students in a first grade class and the on-task and disruptive behavior of three target students within that class who were nominated by their teacher through a behavioral screening.…

Contingent attentional capture across multiple feature dimensions in a temporal search task.

PubMed

Ito, Motohiro; Kawahara, Jun I

2016-01-01

The present study examined whether attention can be flexibly controlled to monitor two different feature dimensions (shape and color) in a temporal search task. Specifically, we investigated the occurrence of contingent attentional capture (i.e., interference from task-relevant distractors) and resulting set reconfiguration (i.e., enhancement of single task-relevant set). If observers can restrict searches to a specific value for each relevant feature dimension independently, the capture and reconfiguration effect should only occur when the single relevant distractor in each dimension appears. Participants identified a target letter surrounded by a non-green square or a non-square green frame. The results revealed contingent attentional capture, as target identification accuracy was lower when the distractor contained a target-defining feature than when it contained a nontarget feature. Resulting set reconfiguration was also obtained in that accuracy was superior when the current target's feature (e.g., shape) corresponded to the defining feature of the present distractor (shape) than when the current target's feature did not match the distractor's feature (color). This enhancement was not due to perceptual priming. The present study demonstrated that the principles of contingent attentional capture and resulting set reconfiguration held even when multiple target feature dimensions were monitored. Copyright © 2015 Elsevier B.V. All rights reserved.

Punishment promotes response control deficits in obsessive-compulsive disorder: evidence from a motivational go/no-go task.

PubMed

Morein-Zamir, S; Papmeyer, M; Gillan, C M; Crockett, M J; Fineberg, N A; Sahakian, B J; Robbins, T W

2013-02-01

Obsessive-compulsive disorder (OCD) has been associated with response inhibition deficits under motivationally neutral contingencies. We examined response inhibition performance in the presence of reward and punishment. We further investigated whether the hypothesized difficulties in flexibly updating behaviour based on external feedback in OCD would also lead to a reduced ability to adjust to changes in the reward and punishment contingencies. Participants completed a go/no-go task that used punishments or rewards to promote response activation or suppression. The task was administered to OCD patients free of current Axis-I co-morbidities including major depression (n = 20) and a group of healthy controls (n = 32). Compared with controls, patients with OCD had increased commission errors in punishment conditions, and failed to slow down immediately after receiving punishment. The punishment-induced increase in commission errors correlated with self-report measures of OCD symptom severity. Additionally, patients did not differ from controls in adapting their overall response style to the changes in task contingencies. Individuals with OCD showed reduced response control selectively under punishment conditions, manifesting in an impulsive response style that was related to their current symptom severity. This stresses failures of cognitive control in OCD, particularly under negative motivational contingencies.

Context and Time in Causal Learning: Contingency and Mood Dependent Effects

PubMed Central

Msetfi, Rachel M.; Wade, Caroline; Murphy, Robin A.

2013-01-01

Defining cues for instrumental causality are the temporal, spatial and contingency relationships between actions and their effects. In this study, we carried out a series of causal learning experiments that systematically manipulated time and context in positive and negative contingency conditions. In addition, we tested participants categorized as non-dysphoric and mildly dysphoric because depressed mood has been shown to affect the processing of all these causal cues. Findings showed that causal judgements made by non-dysphoric participants were contextualized at baseline and were affected by the temporal spacing of actions and effects only with generative, but not preventative, contingency relationships. Participants categorized as dysphoric made less contextualized causal ratings at baseline but were more sensitive than others to temporal manipulations across the contingencies. These effects were consistent with depression affecting causal learning through the effects of slowed time experience on accrued exposure to the context in which causal events took place. Taken together, these findings are consistent with associative approaches to causal judgement. PMID:23691147

The Parallel Episodic Processing (PEP) model: dissociating contingency and conflict adaptation in the item-specific proportion congruent paradigm.

PubMed

Schmidt, James R

2013-01-01

The present work introduces a computational model, the Parallel Episodic Processing (PEP) model, which demonstrates that contingency learning achieved via simple storage and retrieval of episodic memories can explain the item-specific proportion congruency effect in the colour-word Stroop paradigm. The current work also presents a new experimental procedure to more directly dissociate contingency biases from conflict adaptation (i.e., proportion congruency). This was done with three different types of incongruent words that allow a comparison of: (a) high versus low contingency while keeping proportion congruency constant, and (b) high versus low proportion congruency while keeping contingency constant. Results demonstrated a significant contingency effect, but no effect of proportion congruence. It was further shown that the proportion congruency associated with the colour does not matter, either. Thus, the results quite directly demonstrate that ISPC effects are not due to conflict adaptation, but instead to contingency learning biases. Copyright © 2012 Elsevier B.V. All rights reserved.

Place and contingency differential responses of monkey septal neurons during conditional place-object discrimination.

PubMed

Kita, T; Nishijo, H; Eifuku, S; Terasawa, K; Ono, T

1995-03-01

To elucidate spatial and cognitive function of the septal nuclei, neural activity was recorded from alert monkeys during performance of a place-dependent go/no-go (PGN) task. Response/reinforcement contingencies of given objects were conditional upon the location of a motorized, movable device (cab) containing a monkey in one of four places. The task was initiated by presentation of the outside view (place phase) followed by presentation of an object (object phase) selected from a total of four. A lever press was reinforced only if the correct object was seen in its corresponding place, and the same object was never reinforced in any of the other three places. Of 430 septal neurons recorded, the responses during the place phase in the four places were significantly different in 58 neurons. Responses of eight of these neurons were also place-differential during the object phase as well as the place phase. Furthermore, when the outside view was not presented before the object phase, differential responses in the object phase disappeared. Responses of 91 neurons in the object phase were differential in terms of go/no-go responses and reward availability. Of these 91 neurons, 72 were further tested on a place-independent asymmetrical go/no-go (AGN) task, which required no conditional discrimination. Forty-three neurons responded differentially only in the PGN task. It is thus concluded that this PGN-specific activity reflected conditional place-object relations. Of the remaining 29 neurons that responded differentially in both tasks, 21 were further tested by a place-independent symmetrical go/no-go task (no-go responses were also rewarded). Responses of 19 of these 21 neurons were related to the reward/nonreward contingency but not to the response contingency. The results suggest that septal nuclei are involved in integrating spatial information, conditional place-object relations, and reward/nonreward contingency.

Evaluating psychological markers for human nicotine dependence: tobacco choice, extinction, and Pavlovian-to-instrumental transfer.

PubMed

Hogarth, Lee; Chase, Henry W

2012-06-01

Individual differences in drug dependence may be mediated by several abnormalities in associative learning, including perseveration of drug-seeking following contingency change, greater control over drug-seeking by Pavlovian stimuli, or greater sensitivity to drug reinforcement establishing higher rates of drug-seeking. To evaluate these three candidate markers for nicotine dependence, Experiment 1 contrasted daily (N = 22) and nondaily smoker groups (N = 22) on a novel instrumental learning task, where one S+ was first trained as a predictor of tobacco reward before being extinguished. Experiment 2 compared daily (N = 18) and nondaily smoker groups (N = 18) on a concurrent-choice task for tobacco and chocolate reward before an extinction test in which the tobacco response was extinguished, followed by a Pavlovian-to-instrumental transfer test, wherein the impact of tobacco and chocolate cues on concurrent choice was measured (gender was balanced within each smoker group). The results showed no group difference in sensitivity to extinction of either the stimulus-drug or response-drug contingency in Experiments 1 and 2, respectively, nor did groups show a difference in Pavlovian-to-instrumental transfer of control over tobacco choice. By contrast, nicotine-dependence status was marked by a higher frequency of tobacco choice in the concurrent-choice procedure, and this choice preference was associated with subjective craving (gender did not affect any behavioral measure). These results favor the view that nicotine dependence in this sample is not determined by individual predilection for perseveration or stimulus-control over drug-seeking, but by greater sensitivity to reinforcement of instrumental drug choice. Value-based decision theories of dependence are discussed.

New Horizons Launch Contingency Effort

NASA Astrophysics Data System (ADS)

Chang, Yale; Lear, Matthew H.; McGrath, Brian E.; Heyler, Gene A.; Takashima, Naruhisa; Owings, W. Donald

2007-01-01

On 19 January 2006 at 2:00 PM EST, the NASA New Horizons spacecraft (SC) was launched from the Cape Canaveral Air Force Station (CCAFS), FL, onboard an Atlas V 551/Centaur/STAR™ 48B launch vehicle (LV) on a mission to explore the Pluto Charon planetary system and possibly other Kuiper Belt Objects. It carried a single Radioisotope Thermoelectric Generator (RTG). As part of the joint NASA/US Department of Energy (DOE) safety effort, contingency plans were prepared to address the unlikely events of launch accidents leading to a near-pad impact, a suborbital reentry, an orbital reentry, or a heliocentric orbit. As the implementing organization. The Johns Hopkins University Applied Physics Laboratory (JHU/APL) had expanded roles in the New Horizons launch contingency effort over those for the Cassini mission and Mars Exploration Rovers missions. The expanded tasks included participation in the Radiological Control Center (RADCC) at the Kennedy Space Center (KSC), preparation of contingency plans, coordination of space tracking assets, improved aerodynamics characterization of the RTG's 18 General Purpose Heat Source (GPHS) modules, and development of spacecraft and RTG reentry breakup analysis tools. Other JHU/APL tasks were prediction of the Earth impact footprints (ElFs) for the GPHS modules released during the atmospheric reentry (for purposes of notification and recovery), prediction of the time of SC reentry from a potential orbital decay, pre-launch dissemination of ballistic coefficients of various possible reentry configurations, and launch support of an Emergency Operations Center (EOC) on the JHU/APL campus. For the New Horizons launch, JHU/APL personnel at the RADCC and at the EOC were ready to implement any real-time launch contingency activities. A successful New Horizons launch and interplanetary injection precluded any further contingency actions. The New Horizons launch contingency was an interagency effort by several organizations. This paper describes JHU/APL's roles and responsibilities in the launch contingency effort, and the specific tasks to fulfill those responsibilities. The overall effort contributed to mission safety and demonstrated successful cooperation between several agencies.

Contingency Learning and Reactivity in Preterm and Full-Term Infants at 3 Months

PubMed Central

Haley, David W.; Grunau, Ruth E.; Oberlander, Tim F.; Weinberg, Joanne

2010-01-01

Learning difficulties in preterm infants are thought to reflect impairment in arousal regulation. We examined relationships among gestational age, learning speed, and behavioral and physiological reactivity in 55 preterm and 49 full-term infants during baseline, contingency, and nonreinforcement phases of a conjugate mobile paradigm at 3 months corrected age. For all infants, negative affect, looking duration, and heart rate levels increased during contingency and nonreinforcement phases, whereas respiratory sinus arrhythmia (RSA, an index of parasympathetic activity) decreased and cortisol did not change. Learners showed greater RSA suppression and less negative affect than nonlearners. This pattern was particularly evident in the preterm group. Overall, preterm infants showed less learning, spent less time looking at the mobile, and had lower cortisol levels than full-term infants. Preterm infants also showed greater heart rate responses to contingency and dampened heart rate responses to nonreinforcement compared to full-term infants. Findings underscore differences in basal and reactivity measures in preterm compared to full-term infants and suggest that the capacity to regulate parasympathetic activity during a challenge enhances learning in preterm infants. PMID:20717491

Spatiotemporal neurodynamics of automatic temporal expectancy in 9-month old infants.

PubMed

Mento, Giovanni; Valenza, Eloisa

2016-11-04

Anticipating events occurrence (Temporal Expectancy) is a crucial capacity for survival. Yet, there is little evidence about the presence of cortical anticipatory activity from infancy. In this study we recorded the High-density electrophysiological activity in 9 month-old infants and adults undergoing an audio-visual S1-S2 paradigm simulating a lifelike "Peekaboo" game inducing automatic temporal expectancy of smiling faces. The results indicate in the S2-preceding Contingent Negative Variation (CNV) an early electrophysiological signature of expectancy-based anticipatory cortical activity. Moreover, the progressive CNV amplitude increasing across the task suggested that implicit temporal rule learning is at the basis of expectancy building-up over time. Cortical source reconstruction suggested a common CNV generator between adults and infants in the right prefrontal cortex. The decrease in the activity of this area across the task (time-on-task effect) further implied an early, core role of this region in implicit temporal rule learning. By contrast, a time-on-task activity boost was found in the supplementary motor area (SMA) in adults and in the temporoparietal regions in infants. Altogether, our findings suggest that the capacity of the human brain to translate temporal predictions into anticipatory neural activity emerges ontogenetically early, although the underlying spatiotemporal cortical dynamics change across development.

Language Acquisition as Rational Contingency Learning

ERIC Educational Resources Information Center

Ellis, Nick C.

2006-01-01

This paper considers how fluent language users are rational in their language processing, their unconscious language representation systems optimally prepared for comprehension and production, how language learners are intuitive statisticians, and how acquisition can be understood as contingency learning. But there are important aspects of second…

Comparing associative, statistical, and inferential reasoning accounts of human contingency learning

PubMed Central

Pineño, Oskar; Miller, Ralph R.

2007-01-01

For more than two decades, researchers have contrasted the relative merits of associative and statistical theories as accounts of human contingency learning. This debate, still far from resolution, has led to further refinement of models within each family of theories. More recently, a third theoretical view has joined the debate: the inferential reasoning account. The explanations of these three accounts differ critically in many aspects, such as level of analysis and their emphasis on different steps within the information-processing sequence. Also, each account has important advantages (as well as critical flaws) and emphasizes experimental evidence that poses problems to the others. Some hybrid models of human contingency learning have attempted to reconcile certain features of these accounts, thereby benefiting from some of the unique advantages of different families of accounts. A comparison of these families of accounts will help us appreciate the challenges that research on human contingency learning will face over the coming years. PMID:17366303

Role of contingency in striatal response to incentive in adolescents with anxiety.

PubMed

Benson, Brenda E; Guyer, Amanda E; Nelson, Eric E; Pine, Daniel S; Ernst, Monique

2015-03-01

This study examines the effect of contingency on reward function in anxiety. We define contingency as the aspect of a situation in which the outcome is determined by one's action-that is, when there is a direct link between one's action and the outcome of the action. Past findings in adolescents with anxiety or at risk for anxiety have revealed hypersensitive behavioral and neural responses to higher value rewards with correct performance. This hypersensitivity to highly valued (salient) actions suggests that the value of actions is determined not only by outcome magnitude, but also by the degree to which the outcome is contingent on correct performance. Thus, contingency and incentive value might each modulate reward responses in unique ways in anxiety. Using fMRI with a monetary reward task, striatal response to cue anticipation is compared in 18 clinically anxious and 20 healthy adolescents. This task manipulates orthogonally reward contingency and incentive value. Findings suggest that contingency modulates the neural response to incentive magnitude differently in the two groups. Specifically, during the contingent condition, right-striatal response tracks incentive value in anxious, but not healthy, adolescents. During the noncontingent condition, striatal response is bilaterally stronger to low than to high incentive in anxious adolescents, while healthy adolescents exhibit the expected opposite pattern. Both contingency and reward magnitude differentiate striatal activation in anxious versus healthy adolescents. These findings may reflect exaggerated concern about performance and/or alterations of striatal coding of reward value in anxious adolescents. Abnormalities in reward function in anxiety may have treatment implications.

The prefrontal cortex: categories, concepts and cognition.

PubMed Central

Miller, Earl K; Freedman, David J; Wallis, Jonathan D

2002-01-01

The ability to generalize behaviour-guiding principles and concepts from experience is key to intelligent, goal-directed behaviour. It allows us to deal efficiently with a complex world and to adapt readily to novel situations. We review evidence that the prefrontal cortex-the cortical area that reaches its greatest elaboration in primates-plays a central part in acquiring and representing this information. The prefrontal cortex receives highly processed information from all major forebrain systems, and neurophysiological studies suggest that it synthesizes this into representations of learned task contingencies, concepts and task rules. In short, the prefrontal cortex seems to underlie our internal representations of the 'rules of the game'. This may provide the necessary foundation for the complex behaviour of primates, in whom this structure is most elaborate. PMID:12217179

An Analytical Evaluation of Contingency Contracting Operations in Iraq and Afghanistan: Capturing Critical Corporate Knowledge for the Future

DTIC Science & Technology

2013-01-07

Contingency Operations Task Force, 2011, p. 4)...........................68  Figure 25.  Original Organizational Makeup for the CASO (After Deputy...Workforce CAP Civilian Augmentation Program CAP Crisis Action Planning CASO Contingency Acquisition Support Office CBP Capability-Based...its inclusion in joint exercises;  Identify and assign responsibilities to institutionalize OCS lesson development, analysis, documentation and use

Task Force On Contractor Logistics in Support of Contingency Operations

DTIC Science & Technology

2014-06-01

existing industrial base providing support services to deployed military forces should be integrated into all contingency war games and exercises...implementation of OCS in active operations has been a constant game of catch up for more than a decade. Poor contract administration, inconsistent...military forces should be integrated into all contingency war games and exercises. Equally important is including representatives from the agencies

Impaired flexible decision-making in Major Depressive Disorder.

PubMed

Cella, Matteo; Dymond, Simon; Cooper, Andy

2010-07-01

Depression is associated with dysfunctional affective states, neuropsychological impairment and altered sensitivity to reward and punishment. These impairments can influence complex decision-making in changing environments. The contingency shifting variant Iowa Gambling Task (IGT) was used to assess flexible decision-making performance in a group of medicated unipolar Major Depressive Disorder (MDD) patients (n=19) and a group of healthy control volunteers (n=20). The task comprised the standard IGT followed by a contingency-shift phase where decks progressively changed reward and punishment schedule. Patients with MDD showed impaired performance compared to controls during both the standard and the contingency-shift phases of the IGT. Analysis of the contingency-shift phase demonstrated that individuals with depression had difficulties perceiving when a previously bad contingency became good. The present findings have several limitations including small sample size, the possible confounding role of medication and absence of other neuropsychological tests (i.e., executive function). Depressed patients show impaired decision-making behaviour in static and dynamic environments. Altered sensitivity to reward and punishment is proposed as the mechanism responsible for the lack of advantageous choices and poor adjustment to a changing environment.

Development of Medical Technology for Contingency Response to Marrow Toxic Agents

DTIC Science & Technology

2013-01-31

REPORT NUMBER N/A collaboration and data Standard Form 298 (Rev. 8-98) Prescribed by ANSI-Std Z39-l8 1 of 20 Grant Award N00014-12-1-0142...Closed 4 IIA.2 Objective 2 – Coordination of Care of Casualties Task 1 – Contingency Response Network Open 4 Task 2 – Standard Operating...manuscript Biosecurity and Bioterrorism: Biodefense Strategy, Practice, and Science entitled,” Medical planning and response for a nuclear detonation: a

Sleep-Dependent Consolidation of Rewarded Behavior Is Diminished in Children with Attention Deficit Hyperactivity Disorder and a Comorbid Disorder of Social Behavior

PubMed Central

Wiesner, Christian D.; Molzow, Ina; Prehn-Kristensen, Alexander; Baving, Lioba

2017-01-01

Children suffering from attention-deficit hyperactivity disorder (ADHD) often also display impaired learning and memory. Previous research has documented aberrant reward processing in ADHD as well as impaired sleep-dependent consolidation of declarative memory. We investigated whether sleep also fosters the consolidation of behavior learned by probabilistic reward and whether ADHD patients with a comorbid disorder of social behavior show deficits in this memory domain, too. A group of 17 ADHD patients with comorbid disorders of social behavior aged 8–12 years and healthy controls matched for age, IQ, and handedness took part in the experiment. During the encoding task, children worked on a probabilistic learning task acquiring behavioral preferences for stimuli rewarded most often. After a 12-hr retention interval of either sleep at night or wakefulness during the day, a reversal task was presented where the contingencies were reversed. Consolidation of rewarded behavior is indicated by greater resistance to reversal learning. We found that healthy children consolidate rewarded behavior better during a night of sleep than during a day awake and that the sleep-dependent consolidation of rewarded behavior by trend correlates with non-REM sleep but not with REM sleep. In contrast, children with ADHD and comorbid disorders of social behavior do not show sleep-dependent consolidation of rewarded behavior. Moreover, their consolidation of rewarded behavior does not correlate with sleep. The results indicate that dysfunctional sleep in children suffering from ADHD and disorders of social behavior might be a crucial factor in the consolidation of behavior learned by reward. PMID:28228742

Changes in behavior and salivary cortisol after targeted cognitive training in typical 12-month-old infants.

PubMed

Wass, Sam V; Cook, Clare; Clackson, Kaili

2017-05-01

Previous research has suggested that early development may be an optimal period to implement cognitive training interventions, particularly those relating to attention control, a basic ability that is essential for the development of other cognitive skills. In the present study, we administered gaze-contingent training (95 min across 2 weeks) targeted at voluntary attention control to a cohort of typical 12-month-old children (N = 24) and sham training to a control group (N = 24). We assessed training effects on (a) tasks involving nontrained aspects of attention control: visual sustained attention, habituation speed, visual recognition memory, sequence learning, and reversal learning; (b) general attentiveness (on-task behaviors during testing); and (c) salivary cortisol levels. Assessments were administered immediately after the cessation of training and at a 6-week follow-up. On the immediate posttest infants showed significantly more sustained visual attention, faster habituation, and improved sequence learning. Significant effects were also found for increased general attentiveness and decreased salivary cortisol. Some of these effects were still evident at the 6-week follow-up (significantly improved sequence learning and marginally improved sustained attention). These findings extend the emerging literature showing that attention training is possible in infancy. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

A Primer on Improving Contingent Faculty Conditions

ERIC Educational Resources Information Center

McGrew, Heidi; Untener, Joe

2010-01-01

Challenges associated with the increasing use of contingent faculty appointments in American higher education are mounting. The AAUP and other professional groups have identified several major problems: (1) unacceptable conditions and compensation for contingent faculty members; (2) poor learning outcomes for students; and (3) the potential…

Inhibiting PKMζ reveals dorsal lateral and dorsal medial striatum store the different memories needed to support adaptive behavior.

PubMed

Pauli, Wolfgang M; Clark, Alexandra D; Guenther, Heidi J; O'Reilly, Randall C; Rudy, Jerry W

2012-06-20

Evidence suggests that two regions of the striatum contribute differential support to instrumental response selection. The dorsomedial striatum (DMS) is thought to support expectancy-mediated actions, and the dorsolateral striatum (DLS) is thought to support habits. Currently it is unclear whether these regions store task-relevant information or just coordinate the learning and retention of these solutions by other brain regions. To address this issue, we developed a two-lever concurrent variable-interval reinforcement operant conditioning task and used it to assess the trained rat's sensitivity to contingency shifts. Consistent with the view that these two regions make different contributions to actions and habits, injecting the NMDA antagonist DL-AP5 into the DMS just prior to the shift impaired the rat's performance but enhanced performance when injected into the DLS. To determine if these regions support memory content, we first trained rats on a biased concurrent schedule (Lever 1: VI 40" and Lever 2: VI 10"). With the intent of "erasing" the memory content stored in striatum, after this training we inhibited the putative memory-maintenance protein kinase C isozyme protein kinase Mζ (PKMζ). Infusing zeta inhibitory peptide (ZIP) into the DLS enhanced the rat's ability to adapt to the contingency shift 2 d later, whereas injecting it into the DMS had the opposite effect. Infusing GluR2(3Y) into the DMS 1 h before ZIP infusions prevented ZIP from impairing the rat's sensitivity to the contingency shift. These results support the hypothesis that the DMS stores information needed to support actions and the DLS stores information needed to support habits.

Single- and Dual-Process Models of Biased Contingency Detection.

PubMed

Vadillo, Miguel A; Blanco, Fernando; Yarritu, Ion; Matute, Helena

2016-01-01

Decades of research in causal and contingency learning show that people's estimations of the degree of contingency between two events are easily biased by the relative probabilities of those two events. If two events co-occur frequently, then people tend to overestimate the strength of the contingency between them. Traditionally, these biases have been explained in terms of relatively simple single-process models of learning and reasoning. However, more recently some authors have found that these biases do not appear in all dependent variables and have proposed dual-process models to explain these dissociations between variables. In the present paper we review the evidence for dissociations supporting dual-process models and we point out important shortcomings of this literature. Some dissociations seem to be difficult to replicate or poorly generalizable and others can be attributed to methodological artifacts. Overall, we conclude that support for dual-process models of biased contingency detection is scarce and inconclusive.

Team structure and regulatory focus: the impact of regulatory fit on team dynamic.

PubMed

Dimotakis, Nikolaos; Davison, Robert B; Hollenbeck, John R

2012-03-01

We report a within-teams experiment testing the effects of fit between team structure and regulatory task demands on task performance and satisfaction through average team member positive affect and helping behaviors. We used a completely crossed repeated-observations design in which 21 teams enacted 2 tasks with different regulatory focus characteristics (prevention and promotion) in 2 organizational structures (functional and divisional), resulting in 84 observations. Results suggested that salient regulatory demands inherent in the task interacted with structure to determine objective and subjective team-level outcomes, such that functional structures were best suited to (i.e., had best fit with) tasks with a prevention regulatory focus and divisional structures were best suited to tasks with a promotion regulatory focus. This contingency finding integrates regulatory focus and structural contingency theories, and extends them to the team level with implications for models of performance, satisfaction, and team dynamics.

Operant conditioning of enhanced pain sensitivity by heat-pain titration.

PubMed

Becker, Susanne; Kleinböhl, Dieter; Klossika, Iris; Hölzl, Rupert

2008-11-15

Operant conditioning mechanisms have been demonstrated to be important in the development of chronic pain. Most experimental studies have investigated the operant modulation of verbal pain reports with extrinsic reinforcement, such as verbal reinforcement. Whether this reflects actual changes in the subjective experience of the nociceptive stimulus remained unclear. This study replicates and extends our previous demonstration that enhanced pain sensitivity to prolonged heat-pain stimulation could be learned in healthy participants through intrinsic reinforcement (contingent changes in nociceptive input) independent of verbal pain reports. In addition, we examine whether different magnitudes of reinforcement differentially enhance pain sensitivity using an operant heat-pain titration paradigm. It is based on the previously developed non-verbal behavioral discrimination task for the assessment of sensitization, which uses discriminative down- or up-regulation of stimulus temperatures in response to changes in subjective intensity. In operant heat-pain titration, this discriminative behavior and not verbal pain report was contingently reinforced or punished by acute decreases or increases in heat-pain intensity. The magnitude of reinforcement was varied between three groups: low (N1=13), medium (N2=11) and high reinforcement (N3=12). Continuous reinforcement was applied to acquire and train the operant behavior, followed by partial reinforcement to analyze the underlying learning mechanisms. Results demonstrated that sensitization to prolonged heat-pain stimulation was enhanced by operant learning within 1h. The extent of sensitization was directly dependent on the received magnitude of reinforcement. Thus, operant learning mechanisms based on intrinsic reinforcement may provide an explanation for the gradual development of sustained hypersensitivity during pain that is becoming chronic.

Contrasting approaches to the response-contingent learning of young children with significant delays and their social-emotional consequences.

PubMed

Dunst, Carl J; Raab, Melinda; Hamby, Deborah W

2017-04-01

The purpose of the analyses described in this paper was to evaluate the direct and indirect effects of two different approaches to child response-contingent learning on rates of child learning and both concomitant and collateral child social-emotional behaviour. The participants were 71 children with significant developmental delays or multiple disabilities randomly assigned to either of the two contrasting approaches to interventions. Findings showed that an intervention which employed practices that built on existing child behaviour (asset-based practices) was more effective than an intervention focusing on teaching children missing skills (needs-based practices) for influencing changes in the rates of child learning as well as rates of child social-emotional behaviour mediated by differences in rates of child learning. Both the theoretical and practical importance of the results are described in terms of the extended social-emotional benefits of asset-based response-contingent learning games. Copyright © 2017 The Author(s). Published by Elsevier Ltd.. All rights reserved.

The Neural Correlates of Hierarchical Predictions for Perceptual Decisions.

PubMed

Weilnhammer, Veith A; Stuke, Heiner; Sterzer, Philipp; Schmack, Katharina

2018-05-23

Sensory information is inherently noisy, sparse, and ambiguous. In contrast, visual experience is usually clear, detailed, and stable. Bayesian theories of perception resolve this discrepancy by assuming that prior knowledge about the causes underlying sensory stimulation actively shapes perceptual decisions. The CNS is believed to entertain a generative model aligned to dynamic changes in the hierarchical states of our volatile sensory environment. Here, we used model-based fMRI to study the neural correlates of the dynamic updating of hierarchically structured predictions in male and female human observers. We devised a crossmodal associative learning task with covertly interspersed ambiguous trials in which participants engaged in hierarchical learning based on changing contingencies between auditory cues and visual targets. By inverting a Bayesian model of perceptual inference, we estimated individual hierarchical predictions, which significantly biased perceptual decisions under ambiguity. Although "high-level" predictions about the cue-target contingency correlated with activity in supramodal regions such as orbitofrontal cortex and hippocampus, dynamic "low-level" predictions about the conditional target probabilities were associated with activity in retinotopic visual cortex. Our results suggest that our CNS updates distinct representations of hierarchical predictions that continuously affect perceptual decisions in a dynamically changing environment. SIGNIFICANCE STATEMENT Bayesian theories posit that our brain entertains a generative model to provide hierarchical predictions regarding the causes of sensory information. Here, we use behavioral modeling and fMRI to study the neural underpinnings of such hierarchical predictions. We show that "high-level" predictions about the strength of dynamic cue-target contingencies during crossmodal associative learning correlate with activity in orbitofrontal cortex and the hippocampus, whereas "low-level" conditional target probabilities were reflected in retinotopic visual cortex. Our findings empirically corroborate theorizations on the role of hierarchical predictions in visual perception and contribute substantially to a longstanding debate on the link between sensory predictions and orbitofrontal or hippocampal activity. Our work fundamentally advances the mechanistic understanding of perceptual inference in the human brain. Copyright © 2018 the authors 0270-6474/18/385008-14$15.00/0.

The role of risk aversion in non-conscious decision making.

PubMed

Wang, Shuo; Krajbich, Ian; Adolphs, Ralph; Tsuchiya, Naotsugu

2012-01-01

To what extent can people choose advantageously without knowing why they are making those choices? This hotly debated question has capitalized on the Iowa Gambling Task (IGT), in which people often learn to choose advantageously without appearing to know why. However, because the IGT is unconstrained in many respects, this finding remains debated and other interpretations are possible (e.g., risk aversion, ambiguity aversion, limits of working memory, or insensitivity to reward/punishment can explain the finding of the IGT). Here we devised an improved variant of the IGT in which the deck-payoff contingency switches after subjects repeatedly choose from a good deck, offering the statistical power of repeated within-subject measures based on learning the reward contingencies associated with each deck. We found that participants exhibited low confidence in their choices, as probed with post-decision wagering, despite high accuracy in selecting advantageous decks in the task, which is putative evidence for non-conscious decision making. However, such a behavioral dissociation could also be explained by risk aversion, a tendency to avoid risky decisions under uncertainty. By explicitly measuring risk aversion for each individual, we predicted subjects' post-decision wagering using Bayesian modeling. We found that risk aversion indeed does play a role, but that it did not explain the entire effect. Moreover, independently measured risk aversion was uncorrelated with risk aversion exhibited during our version of the IGT, raising the possibility that the latter risk aversion may be non-conscious. Our findings support the idea that people can make optimal choices without being fully aware of the basis of their decision. We suggest that non-conscious decision making may be mediated by emotional feelings of risk that are based on mechanisms distinct from those that support cognitive assessment of risk.

The Role of Risk Aversion in Non-Conscious Decision Making

PubMed Central

Wang, Shuo; Krajbich, Ian; Adolphs, Ralph; Tsuchiya, Naotsugu

2012-01-01

To what extent can people choose advantageously without knowing why they are making those choices? This hotly debated question has capitalized on the Iowa Gambling Task (IGT), in which people often learn to choose advantageously without appearing to know why. However, because the IGT is unconstrained in many respects, this finding remains debated and other interpretations are possible (e.g., risk aversion, ambiguity aversion, limits of working memory, or insensitivity to reward/punishment can explain the finding of the IGT). Here we devised an improved variant of the IGT in which the deck-payoff contingency switches after subjects repeatedly choose from a good deck, offering the statistical power of repeated within-subject measures based on learning the reward contingencies associated with each deck. We found that participants exhibited low confidence in their choices, as probed with post-decision wagering, despite high accuracy in selecting advantageous decks in the task, which is putative evidence for non-conscious decision making. However, such a behavioral dissociation could also be explained by risk aversion, a tendency to avoid risky decisions under uncertainty. By explicitly measuring risk aversion for each individual, we predicted subjects’ post-decision wagering using Bayesian modeling. We found that risk aversion indeed does play a role, but that it did not explain the entire effect. Moreover, independently measured risk aversion was uncorrelated with risk aversion exhibited during our version of the IGT, raising the possibility that the latter risk aversion may be non-conscious. Our findings support the idea that people can make optimal choices without being fully aware of the basis of their decision. We suggest that non-conscious decision making may be mediated by emotional feelings of risk that are based on mechanisms distinct from those that support cognitive assessment of risk. PMID:22375133

Instructional influences on analogue functional analysis outcomes.

PubMed Central

Northup, John; Kodak, Tiffany; Grow, Laura; Lee, Jennifer; Coyne, Amanda

2004-01-01

Analogue assessments were conducted with a common contingency (escape from tasks) that varied only by three different instructions describing the contingency. In one condition, the contingency was described as "taking a break," in another condition it was described as "time-out," and no description of the contingency was provided in a third condition. The participant was a typically developing 5-year-old child with a diagnosis of attention deficit hyperactivity disorder. Rates of inappropriate behavior varied substantially across the three conditions as an apparent effect of the prior instructions. Some implications for conducting functional analyses with verbal children are discussed. PMID:15669409

Two Approaches to Measuring Task Interdependence in Elementary Schools.

ERIC Educational Resources Information Center

Charters, W. W., Jr.

This report compares two approaches to measuring task interdependence, a theoretically fruitful concept for analyzing an organization's technical system. Task interdependence exists among operating personnel in the degree that task performance of one operative constrains, augments, or otherwise poses contingencies for the performance of another.…

From self-assessment to frustration, a small step toward autonomy in robotic navigation

PubMed Central

Jauffret, Adrien; Cuperlier, Nicolas; Tarroux, Philippe; Gaussier, Philippe

2013-01-01

Autonomy and self-improvement capabilities are still challenging in the fields of robotics and machine learning. Allowing a robot to autonomously navigate in wide and unknown environments not only requires a repertoire of robust strategies to cope with miscellaneous situations, but also needs mechanisms of self-assessment for guiding learning and for monitoring strategies. Monitoring strategies requires feedbacks on the behavior's quality, from a given fitness system in order to take correct decisions. In this work, we focus on how a second-order controller can be used to (1) manage behaviors according to the situation and (2) seek for human interactions to improve skills. Following an incremental and constructivist approach, we present a generic neural architecture, based on an on-line novelty detection algorithm that may be able to self-evaluate any sensory-motor strategies. This architecture learns contingencies between sensations and actions, giving the expected sensation from the previous perception. Prediction error, coming from surprising events, provides a measure of the quality of the underlying sensory-motor contingencies. We show how a simple second-order controller (emotional system) based on the prediction progress allows the system to regulate its behavior to solve complex navigation tasks and also succeeds in asking for help if it detects dead-lock situations. We propose that this model could be a key structure toward self-assessment and autonomy. We made several experiments that can account for such properties for two different strategies (road following and place cells based navigation) in different situations. PMID:24115931

Toddlers' Word Learning from Contingent and Noncontingent Video on Touch Screens

ERIC Educational Resources Information Center

Kirkorian, Heather L.; Choi, Koeun; Pempek, Tiffany A.

2016-01-01

Researchers examined whether contingent experience using a touch screen increased toddlers' ability to learn a word from video. One hundred and sixteen children (24-36 months) watched an on-screen actress label an object: (a) without interacting, (b) with instructions to touch "anywhere" on the screen, or (c) with instructions to touch a…

Feedback Blunting: Total Sleep Deprivation Impairs Decision Making that Requires Updating Based on Feedback

PubMed Central

Whitney, Paul; Hinson, John M.; Jackson, Melinda L.; Van Dongen, Hans P.A.

2015-01-01

Study Objectives: To better understand the sometimes catastrophic effects of sleep loss on naturalistic decision making, we investigated effects of sleep deprivation on decision making in a reversal learning paradigm requiring acquisition and updating of information based on outcome feedback. Design: Subjects were randomized to a sleep deprivation or control condition, with performance testing at baseline, after 2 nights of total sleep deprivation (or rested control), and following 2 nights of recovery sleep. Subjects performed a decision task involving initial learning of go and no go response sets followed by unannounced reversal of contingencies, requiring use of outcome feedback for decisions. A working memory scanning task and psychomotor vigilance test were also administered. Setting: Six consecutive days and nights in a controlled laboratory environment with continuous behavioral monitoring. Subjects: Twenty-six subjects (22–40 y of age; 10 women). Interventions: Thirteen subjects were randomized to a 62-h total sleep deprivation condition; the others were controls. Results: Unlike controls, sleep deprived subjects had difficulty with initial learning of go and no go stimuli sets and had profound impairment adapting to reversal. Skin conductance responses to outcome feedback were diminished, indicating blunted affective reactions to feedback accompanying sleep deprivation. Working memory scanning performance was not significantly affected by sleep deprivation. And although sleep deprived subjects showed expected attentional lapses, these could not account for impairments in reversal learning decision making. Conclusions: Sleep deprivation is particularly problematic for decision making involving uncertainty and unexpected change. Blunted reactions to feedback while sleep deprived underlie failures to adapt to uncertainty and changing contingencies. Thus, an error may register, but with diminished effect because of reduced affective valence of the feedback or because the feedback is not cognitively bound with the choice. This has important implications for understanding and managing sleep loss-induced cognitive impairment in emergency response, disaster management, military operations, and other dynamic real-world settings with uncertain outcomes and imperfect information. Citation: Whitney P, Hinson JM, Jackson ML, Van Dongen HPA. Feedback blunting: total sleep deprivation impairs decision making that requires updating based on feedback. SLEEP 2015;38(5):745–754. PMID:25515105

Stress attenuates the flexible updating of aversive value

PubMed Central

Raio, Candace M.; Hartley, Catherine A.; Orederu, Temidayo A.; Li, Jian; Phelps, Elizabeth A.

2017-01-01

In a dynamic environment, sources of threat or safety can unexpectedly change, requiring the flexible updating of stimulus−outcome associations that promote adaptive behavior. However, aversive contexts in which we are required to update predictions of threat are often marked by stress. Acute stress is thought to reduce behavioral flexibility, yet its influence on the modulation of aversive value has not been well characterized. Given that stress exposure is a prominent risk factor for anxiety and trauma-related disorders marked by persistent, inflexible responses to threat, here we examined how acute stress affects the flexible updating of threat responses. Participants completed an aversive learning task, in which one stimulus was probabilistically associated with an electric shock, while the other stimulus signaled safety. A day later, participants underwent an acute stress or control manipulation before completing a reversal learning task during which the original stimulus−outcome contingencies switched. Skin conductance and neuroendocrine responses provided indices of sympathetic arousal and stress responses, respectively. Despite equivalent initial learning, stressed participants showed marked impairments in reversal learning relative to controls. Additionally, reversal learning deficits across participants were related to heightened levels of alpha-amylase, a marker of noradrenergic activity. Finally, fitting arousal data to a computational reinforcement learning model revealed that stress-induced reversal learning deficits emerged from stress-specific changes in the weight assigned to prediction error signals, disrupting the adaptive adjustment of learning rates. Our findings provide insight into how stress renders individuals less sensitive to changes in aversive reinforcement and have implications for understanding clinical conditions marked by stress-related psychopathology. PMID:28973957

The Contingent Use of Trading Stamps in Reducing Truancy: A Case Report.

ERIC Educational Resources Information Center

Zweig, John T.; And Others

1979-01-01

A 13-year-old learning-disabled subject received a daily amount of trading stamps contingent on school attendance. Results showed a significant decrease in truancy from three to four days per week to less than one. A reversal design indicated that truancy could be controlled by the contingency procedure. (Author/GDC)

Associative (not Hebbian) learning and the mirror neuron system.

PubMed

Cooper, Richard P; Cook, Richard; Dickinson, Anthony; Heyes, Cecilia M

2013-04-12

The associative sequence learning (ASL) hypothesis suggests that sensorimotor experience plays an inductive role in the development of the mirror neuron system, and that it can play this crucial role because its effects are mediated by learning that is sensitive to both contingency and contiguity. The Hebbian hypothesis proposes that sensorimotor experience plays a facilitative role, and that its effects are mediated by learning that is sensitive only to contiguity. We tested the associative and Hebbian accounts by computational modelling of automatic imitation data indicating that MNS responsivity is reduced more by contingent and signalled than by non-contingent sensorimotor training (Cook et al. [7]). Supporting the associative account, we found that the reduction in automatic imitation could be reproduced by an existing interactive activation model of imitative compatibility when augmented with Rescorla-Wagner learning, but not with Hebbian or quasi-Hebbian learning. The work argues for an associative, but against a Hebbian, account of the effect of sensorimotor training on automatic imitation. We argue, by extension, that associative learning is potentially sufficient for MNS development. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Co-viewing supports toddlers' word learning from contingent and noncontingent video.

PubMed

Strouse, Gabrielle A; Troseth, Georgene L; O'Doherty, Katherine D; Saylor, Megan M

2018-02-01

Social cues are one way young children determine that a situation is pedagogical in nature-containing information to be learned and generalized. However, some social cues (e.g., contingent gaze and responsiveness) are missing from prerecorded video, a potential reason why toddlers' language learning from video can be inefficient compared with their learning directly from a person. This study explored two methods for supporting children's word learning from video by adding social-communicative cues. A sample of 88 30-month-olds began their participation with a video training phase. In one manipulation, an on-screen actress responded contingently to children through a live video feed (similar to Skype or FaceTime "video chat") or appeared in a prerecorded demonstration. In the other manipulation, parents either modeled responsiveness to the actress's on-screen bids for participation or sat out of their children's view. Children then viewed a labeling demonstration on video, and their knowledge of the label was tested with three-dimensional objects. Results indicated that both on-screen contingency and parent modeling increased children's engagement with the actress during training. However, only parent modeling increased children's subsequent word learning, perhaps by revealing the symbolic (representational) intentions underlying this video. This study highlights the importance of adult co-viewing in helping toddlers to interpret communicative cues from video. Copyright © 2017 Elsevier Inc. All rights reserved.

Management Styles Associated with Organizational, Task, Personal, and Interpersonal Contingencies

ERIC Educational Resources Information Center

Bass, Bernard M.; And Others

1975-01-01

Analyzes data from lengthy profile questionnaires completed by 78 managers and 407 of their subordinates and examines how five different management styles are related to various aspects of the contingent situation. (Available from Subscription Section, American Psychological Association, 1200 Seventeenth Street, N.W., Washington, D.C.; $30.00…

What is the optimal task difficulty for reinforcement learning of brain self-regulation?

PubMed

Bauer, Robert; Vukelić, Mathias; Gharabaghi, Alireza

2016-09-01

The balance between action and reward during neurofeedback may influence reinforcement learning of brain self-regulation. Eleven healthy volunteers participated in three runs of motor imagery-based brain-machine interface feedback where a robot passively opened the hand contingent to β-band modulation. For each run, the β-desynchronization threshold to initiate the hand robot movement increased in difficulty (low, moderate, and demanding). In this context, the incentive to learn was estimated by the change of reward per action, operationalized as the change in reward duration per movement onset. Variance analysis revealed a significant interaction between threshold difficulty and the relationship between reward duration and number of movement onsets (p<0.001), indicating a negative learning incentive for low difficulty, but a positive learning incentive for moderate and demanding runs. Exploration of different thresholds in the same data set indicated that the learning incentive peaked at higher thresholds than the threshold which resulted in maximum classification accuracy. Specificity is more important than sensitivity of neurofeedback for reinforcement learning of brain self-regulation. Learning efficiency requires adequate challenge by neurofeedback interventions. Copyright © 2016 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.

Learning New Sensorimotor Contingencies: Effects of Long-Term Use of Sensory Augmentation on the Brain and Conscious Perception.

PubMed

König, Sabine U; Schumann, Frank; Keyser, Johannes; Goeke, Caspar; Krause, Carina; Wache, Susan; Lytochkin, Aleksey; Ebert, Manuel; Brunsch, Vincent; Wahn, Basil; Kaspar, Kai; Nagel, Saskia K; Meilinger, Tobias; Bülthoff, Heinrich; Wolbers, Thomas; Büchel, Christian; König, Peter

2016-01-01

Theories of embodied cognition propose that perception is shaped by sensory stimuli and by the actions of the organism. Following sensorimotor contingency theory, the mastery of lawful relations between own behavior and resulting changes in sensory signals, called sensorimotor contingencies, is constitutive of conscious perception. Sensorimotor contingency theory predicts that, after training, knowledge relating to new sensorimotor contingencies develops, leading to changes in the activation of sensorimotor systems, and concomitant changes in perception. In the present study, we spell out this hypothesis in detail and investigate whether it is possible to learn new sensorimotor contingencies by sensory augmentation. Specifically, we designed an fMRI compatible sensory augmentation device, the feelSpace belt, which gives orientation information about the direction of magnetic north via vibrotactile stimulation on the waist of participants. In a longitudinal study, participants trained with this belt for seven weeks in natural environment. Our EEG results indicate that training with the belt leads to changes in sleep architecture early in the training phase, compatible with the consolidation of procedural learning as well as increased sensorimotor processing and motor programming. The fMRI results suggest that training entails activity in sensory as well as higher motor centers and brain areas known to be involved in navigation. These neural changes are accompanied with changes in how space and the belt signal are perceived, as well as with increased trust in navigational ability. Thus, our data on physiological processes and subjective experiences are compatible with the hypothesis that new sensorimotor contingencies can be acquired using sensory augmentation.

Learning New Sensorimotor Contingencies: Effects of Long-Term Use of Sensory Augmentation on the Brain and Conscious Perception

PubMed Central

Schumann, Frank; Keyser, Johannes; Goeke, Caspar; Krause, Carina; Wache, Susan; Lytochkin, Aleksey; Ebert, Manuel; Brunsch, Vincent; Wahn, Basil; Kaspar, Kai; Nagel, Saskia K.; Meilinger, Tobias; Bülthoff, Heinrich; Wolbers, Thomas; Büchel, Christian; König, Peter

2016-01-01

Theories of embodied cognition propose that perception is shaped by sensory stimuli and by the actions of the organism. Following sensorimotor contingency theory, the mastery of lawful relations between own behavior and resulting changes in sensory signals, called sensorimotor contingencies, is constitutive of conscious perception. Sensorimotor contingency theory predicts that, after training, knowledge relating to new sensorimotor contingencies develops, leading to changes in the activation of sensorimotor systems, and concomitant changes in perception. In the present study, we spell out this hypothesis in detail and investigate whether it is possible to learn new sensorimotor contingencies by sensory augmentation. Specifically, we designed an fMRI compatible sensory augmentation device, the feelSpace belt, which gives orientation information about the direction of magnetic north via vibrotactile stimulation on the waist of participants. In a longitudinal study, participants trained with this belt for seven weeks in natural environment. Our EEG results indicate that training with the belt leads to changes in sleep architecture early in the training phase, compatible with the consolidation of procedural learning as well as increased sensorimotor processing and motor programming. The fMRI results suggest that training entails activity in sensory as well as higher motor centers and brain areas known to be involved in navigation. These neural changes are accompanied with changes in how space and the belt signal are perceived, as well as with increased trust in navigational ability. Thus, our data on physiological processes and subjective experiences are compatible with the hypothesis that new sensorimotor contingencies can be acquired using sensory augmentation. PMID:27959914

Investigating the Impact of Cognitive Load and Motivation on Response Control in Relation to Delay Discounting in Children with ADHD.

PubMed

Martinelli, Mary K; Mostofsky, Stewart H; Rosch, Keri S

2017-10-01

Attention-deficit/hyperactivity disorder (ADHD) is characterized by deficits in impulse control across a range of behaviors, from simple actions to those involving complex decision-making (e.g., preference for smaller-sooner versus larger later rewards). This study investigated whether changes in motor response control with increased cognitive load and motivational contingencies are associated with decision-making in the form of delay discounting among 8-12 year old children with and without ADHD. Children with ADHD (n = 26; 8 girls) and typically developing controls (n = 40; 11 girls) completed a standard go/no-go (GNG) task, a GNG task with motivational contingencies, a GNG task with increased cognitive load, and two measures of delay discounting: a real-time task in which the delays and immediately consumable rewards are experienced in real-time, and a classic task involving choices about money at longer delays. Children with ADHD, particularly girls, exhibited greater delay discounting than controls during the real-time discounting task, whereas diagnostic groups did not significantly differ on the classic discounting task. The effect of cognitive load on response control was uniquely associated with greater discounting on the real-time task for children with ADHD, but not for control children. The effect of motivational contingencies on response control was not significantly associated with delay discounting for either diagnostic group. The findings from this study help to inform our understanding of the factors that influence deficient self-control in ADHD, suggesting that impairments in cognitive control may contribute to greater delay discounting in ADHD.

Revisiting the relation between contingency awareness and attention: evaluative conditioning relies on a contingency focus.

PubMed

Kattner, Florian

2012-01-01

Although evaluative conditioning has occasionally been demonstrated in the absence of contingency awareness, many recent studies imply that its acquisition depends on the availability of attentional resources during conditioning. In previous experiments attention has typically been manipulated in a general way rather than looking at the particular focus of attention. The present study investigated the role of a focus on the CS-US contingency. Two separate distraction tasks were designed that either diverted attention from the stimuli or directed it to the stimuli while drawing attention away from the contingency between the stimuli. Both types of distraction were shown to eliminate evaluative conditioning. Significant evaluative conditioning was observed in a third group of participants who were required to attend the contingencies. A mediation analysis showed that the observed discrepancy in evaluative conditioning effects between groups was mediated by contingency awareness. The results imply that attention in terms of a stimulus focus is not sufficient for evaluative conditioning to occur. Rather, attention to the contingencies between stimuli appears to be crucial in evaluative conditioning, because it is supposed to foster the acquisition of contingency awareness.

Converging evidence for control of color-word Stroop interference at the item level.

PubMed

Bugg, Julie M; Hutchison, Keith A

2013-04-01

Prior studies have shown that cognitive control is implemented at the list and context levels in the color-word Stroop task. At first blush, the finding that Stroop interference is reduced for mostly incongruent items as compared with mostly congruent items (i.e., the item-specific proportion congruence [ISPC] effect) appears to provide evidence for yet a third level of control, which modulates word reading at the item level. However, evidence to date favors the view that ISPC effects reflect the rapid prediction of high-contingency responses and not item-specific control. In Experiment 1, we first show that an ISPC effect is obtained when the relevant dimension (i.e., color) signals proportion congruency, a problematic pattern for theories based on differential response contingencies. In Experiment 2, we replicate and extend this pattern by showing that item-specific control settings transfer to new stimuli, ruling out alternative frequency-based accounts. In Experiment 3, we revert to the traditional design in which the irrelevant dimension (i.e., word) signals proportion congruency. Evidence for item-specific control, including transfer of the ISPC effect to new stimuli, is apparent when 4-item sets are employed but not when 2-item sets are employed. We attribute this pattern to the absence of high-contingency responses on incongruent trials in the 4-item set. These novel findings provide converging evidence for reactive control of color-word Stroop interference at the item level, reveal theoretically important factors that modulate reliance on item-specific control versus contingency learning, and suggest an update to the item-specific control account (Bugg, Jacoby, & Chanani, 2011).

Global bias reliability in dogs (Canis familiaris).

PubMed

Mongillo, Paolo; Pitteri, Elisa; Sambugaro, Pamela; Carnier, Paolo; Marinelli, Lieta

2017-03-01

Dogs enrolled in a previous study were assessed two years later for reliability of their local/global preference in a discrimination test with the same hierarchical stimuli used in the previous study (Experiment 1) and with a novel stimulus (Experiment 2). In Experiment 1, dogs easily re-learned to discriminate the positive stimulus; their individual global/local choices were stable compared to the previous study; and an overall clear global bias was found. In Experiment 2, dogs were slower in acquiring the initial discrimination task; the overall global bias disappeared; and, individually, dogs tended to make inverse choices compared to the original study. Spontaneous attention toward the test stimulus resembling the global features of the probe stimulus was the main factor affecting the likeliness of a global choice of our dogs, regardless of the type of experiment. However, attention to task-irrelevant elements increased at the expense of attention to the stimuli in the test phase of Experiment 2. Overall, the results suggest that the stability of global bias in dogs depends on the characteristics of the assessment contingencies, likely including the learning requirements of the tasks. Our results also clearly indicate that attention processes have a prominent role on dogs' global bias, in agreement with previous findings in humans and other species.

Dissociable contributions of the orbitofrontal and infralimbic cortex to pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex.

PubMed

Chudasama, Y; Robbins, Trevor W

2003-09-24

To examine possible heterogeneity of function within the ventral regions of the rodent frontal cortex, the present study compared the effects of excitotoxic lesions of the orbitofrontal cortex (OFC) and the infralimbic cortex (ILC) on pavlovian autoshaping and discrimination reversal learning. During the pavlovian autoshaping task, in which rats learn to approach a stimulus predictive of reward [conditional stimulus (CS+)], only the OFC group failed to acquire discriminated approach but was unimpaired when preoperatively trained. In the visual discrimination learning and reversal task, rats were initially required to discriminate a stimulus positively associated with reward. There was no effect of either OFC or ILC lesions on discrimination learning. When the stimulus-reward contingencies were reversed, both groups of animals committed more errors, but only the OFC-lesioned animals were unable to suppress the previously rewarded stimulus-reward association, committing more "stimulus perseverative" errors. In contrast, the ILC group showed a pattern of errors that was more attributable to "learning" than perseveration. These findings suggest two types of dissociation between the effects of OFC and ILC lesions: (1) OFC lesions impaired the learning processes implicated in pavlovian autoshaping but not instrumental simultaneous discrimination learning, whereas ILC lesions were unimpaired at autoshaping and their reversal learning deficit did not reflect perseveration, and (2) OFC lesions induced perseverative responding in reversal learning but did not disinhibit responses to pavlovian CS-. In contrast, the ILC lesion had no effect on response inhibitory control in either of these settings. The findings are discussed in the context of dissociable executive functions in ventral sectors of the rat prefrontal cortex.

Behavioral Impulsivity Does Not Predict Naturalistic Alcohol Consumption or Treatment Outcomes

PubMed Central

Mullen, Jillian; Mathias, Charles W.; Karns, Tara E.; Liang, Yuanyuan; Hill-Kapturczak, Nathalie; Roache, John D.; Lamb, Richard J.; Dougherty, Donald M.

2016-01-01

Objective The purpose of this study was to determine if behavioral impulsivity under multiple conditions (baseline, after alcohol consumption or after serotonin depletion) predicted naturalistic alcohol use or treatment outcomes from a moderation-based contingency management intervention. Method The current data analysis pulls information from three phases of a large study: 1) Phase 1 examined baseline and the effects of alcohol use and serotonin depletion on three types of behavioral impulsivity: response initiation (IMT task), response inhibition (GoStop task), and delay discounting (SKIP task); 2) Phase 2 involved 28 days of naturalistic drinking; and 3) Phase 3 involved 3 months of contingency management. During phases 2 and 3 alcohol use was measured objectively using transdermal alcohol monitors. The results of each individual phase has been previously published showing that at a group level the effects of alcohol consumption on impulsivity were dependent on the component of impulsivity being measured and the dose of alcohol consumed but serotonin depletion had no effect on impulsivity, and that a moderation-based contingency management intervention reduced heavy drinking. Results The current analysis combining data from those who completed all three phases (n = 67) showed that impulsivity measured at baseline, after alcohol consumption, or after serotonin depletion did not predict naturalistic drinking or treatment outcomes from a moderation-based CM treatment. Conclusions Contingency management interventions may prove to be an effective intervention for impulsive individuals, however, normal variations in measured impulsivity do not seem to relate to normal variations in drinking pattern or response to moderation-based contingency management. PMID:27746702

CORBEH CLASS [Contingencies for Learning Academic and Social Skills] Program for Acting-Out Children. Manual for Teachers. First Edition.

ERIC Educational Resources Information Center

Hops, Hyman; And Others

A program which describes contingencies for learning academic and social skills (CLASS) is explained to involve an educational consultant training teachers of acting-out first and second graders to reinforce desired academic and social behaviors. Examined are the pre-intervention procedures of initial identification of acting-out students,…

Methodological Considerations in On-Line Contingent Research and Implications for Learning. Technical Report.

ERIC Educational Resources Information Center

Whittington, Marna C.

Methods for the implementation of on-line contingent research are described in this study. In a contingent experimentation procedure, the content of successive experimental trials is a function of a subject's responses to a previous trial or trials (in contrast to traditional experimentation in which the subject is presented a previously…

The Efficacy of Contingency Models of Reinforcement on Group Expectations and Reading Achievement

ERIC Educational Resources Information Center

Wilder, Valerie Kristine

2011-01-01

Social learning theory contends that group contingent reinforcement can be used as a means of shaping problematic behavior in both academic and nonacademic settings. Prior research has focused on contingent management of academic behaviors with older populations at the college level and younger students both with and without disabilities in the…

Are we puppets on a string? Comparing the impact of contingency and validity on implicit and explicit evaluations.

PubMed

Peters, Kurt R; Gawronski, Bertram

2011-04-01

Research has demonstrated that implicit and explicit evaluations of the same object can diverge. Explanations of such dissociations frequently appeal to dual-process theories, such that implicit evaluations are assumed to reflect object-valence contingencies independent of their perceived validity, whereas explicit evaluations reflect the perceived validity of object-valence contingencies. Although there is evidence supporting these assumptions, it remains unclear if dissociations can arise in situations in which object-valence contingencies are judged to be true or false during the learning of these contingencies. Challenging dual-process accounts that propose a simultaneous operation of two parallel learning mechanisms, results from three experiments showed that the perceived validity of evaluative information about social targets qualified both explicit and implicit evaluations when validity information was available immediately after the encoding of the valence information; however, delaying the presentation of validity information reduced its qualifying impact for implicit, but not explicit, evaluations.

Single- and Dual-Process Models of Biased Contingency Detection

PubMed Central

2016-01-01

Abstract. Decades of research in causal and contingency learning show that people’s estimations of the degree of contingency between two events are easily biased by the relative probabilities of those two events. If two events co-occur frequently, then people tend to overestimate the strength of the contingency between them. Traditionally, these biases have been explained in terms of relatively simple single-process models of learning and reasoning. However, more recently some authors have found that these biases do not appear in all dependent variables and have proposed dual-process models to explain these dissociations between variables. In the present paper we review the evidence for dissociations supporting dual-process models and we point out important shortcomings of this literature. Some dissociations seem to be difficult to replicate or poorly generalizable and others can be attributed to methodological artifacts. Overall, we conclude that support for dual-process models of biased contingency detection is scarce and inconclusive. PMID:27025532

The role of outcome inhibition in interference between outcomes: a contingency-learning analogue of retrieval-induced forgetting.

PubMed

Vadillo, Miguel A; Orgaz, Cristina; Luque, David; Cobos, Pedro L; López, Francisco J; Matute, Helena

2013-05-01

Current associative theories of contingency learning assume that inhibitory learning plays a part in the interference between outcomes. However, it is unclear whether this inhibitory learning results in the inhibition of the outcome representation or whether it simply counteracts previous excitatory learning so that the outcome representation is neither activated nor inhibited. Additionally, these models tend to conceptualize inhibition as a relatively transient and cue-dependent state. However, research on retrieval-induced forgetting suggests that the inhibition of representations is a real process that can be relatively independent of the retrieval cue used to access the inhibited information. Consistent with this alternative view, we found that interference between outcomes reduces the retrievability of the target outcome even when the outcome is associated with a novel (non-inhibitory) cue. This result has important theoretical implications for associative models of interference and shows that the empirical facts and theories developed in studies of retrieval-induced forgetting might be relevant in contingency learning and vice versa. © 2012 The British Psychological Society.

The Contingency Model of Leadership Effectiveness: Motivational Implications of the Teacher's Role as Leader in the Classroom.

ERIC Educational Resources Information Center

Hardy, Robert C.

Fiedler's Contingency Model postulates that the effectiveness of leaders results from a relationship between leadership style and situational favorability. Leadership style is measured with Fiedler's Least Preferred Coworker Scale, which assesses whether the person rating the coworker is task-oriented or oriented towards interpersonal relations.…

Obsessive–compulsive disorder patients have a reduced sense of control on the illusion of control task

PubMed Central

Gillan, Claire M.; Morein-Zamir, Sharon; Durieux, Alice M. S.; Fineberg, Naomi A.; Sahakian, Barbara J.; Robbins, Trevor W.

2014-01-01

There is disagreement regarding the role of perceived control in obsessive–compulsive disorder (OCD). The present study used a traditional illusion of control paradigm (Alloy and Abramson, 1979) to empirically test control estimation in OCD. Twenty-six OCD patients and 26 matched comparison subjects completed an illusion of control task wherein their goal was to attempt to exert control over a light bulb. The density of reinforcement (high, low) and the valence of trials (gain, loss) were experimentally manipulated within subjects. Unbeknownst to participants, the illumination of the light bulb was predetermined and irrespective of their behavior. OCD patients exhibited lower estimates of control compared with healthy comparison subjects. There were no interactions between group and outcome density or group and valence. We found that OCD patients endorse lower estimates of control than comparison subjects. This finding highlights a potential role for contingency learning in the disorder. PMID:24659974

Anticipatory stress influences decision making under explicit risk conditions.

PubMed

Starcke, Katrin; Wolf, Oliver T; Markowitsch, Hans J; Brand, Matthias

2008-12-01

Recent research has suggested that stress may affect memory, executive functioning, and decision making on the basis of emotional feedback processing. The current study examined whether anticipatory stress affects decision making measured with the Game of Dice Task (GDT), a decision-making task with explicit and stable rules that taps both executive functioning and feedback learning. The authors induced stress in 20 participants by having them anticipate giving a public speech and also examined 20 comparison subjects. The authors assessed the level of stress with questionnaires and endocrine markers (salivary cortisol and alpha-amylase), both revealing that speech anticipation led to increased stress. Results of the GDT showed that participants under stress scored significantly lower than the comparison group and that GDT performance was negatively correlated with the increase of cortisol. Our results indicate that stress can lead to disadvantageous decision making even when explicit and stable information about outcome contingencies is provided.

The limits and motivating potential of sensory stimuli as reinforcers for autistic children.

PubMed

Ferrari, M; Harris, S L

1981-01-01

This study investigated the reinforcing properties, limits, and motivating potentials of sensory stimuli with autistic children. In the first phase of the study, four intellectually retarded autistic children were exposed to three different types of sensory stimulation (vibration, music, and strobe light) as well as edible and social reinforcers for ten-second intervals contingent upon six simple bar pressing responses. In the second phase, the same events were used as reinforcers for correct responses in learning object labels. The results indicated that: (a) sensory stimuli can be used effectively as reinforcers to maintain high, durable rates of responding in a simple pressing task; (b) ranked preferences for sensory stimuli revealed a unique configuration of responding for each child; and (c) sensory stimuli have motivating potentials comparable to those of the traditional food and social reinforcers even when training receptive language tasks.

Contingency learning without awareness: evidence for implicit control.

PubMed

Schmidt, James R; Crump, Matthew J C; Cheesman, Jim; Besner, Derek

2007-06-01

The results of four experiments provide evidence for controlled processing in the absence of awareness. Participants identified the colour of a neutral distracter word. Each of four words (e.g., MOVE) was presented in one of the four colours 75% of the time (Experiments 1 and 4) or 50% of the time (Experiments 2 and 3). Colour identification was faster when the words appeared in the colour they were most often presented in relative to when they appeared in another colour, even for participants who were subjectively unaware of any contingencies between the words and the colours. An analysis of sequence effects showed that participants who were unaware of the relation between distracter words and colours nonetheless controlled the impact of the word on performance depending on the nature of the previous trial. A block analysis of contingency-unaware participants revealed that contingencies were learned rapidly in the first block of trials. Experiment 3 showed that the contingency effect does not depend on the level of awareness, thus ruling out explicit strategy accounts. Finally, Experiment 4 showed that the contingency effect results from behavioural control and not from semantic association or stimulus familiarity. These results thus provide evidence for implicit control.

The Role of the Right Dorsolateral Prefrontal Cortex in Phasic Alertness: Evidence from a Contingent Negative Variation and Repetitive Transcranial Magnetic Stimulation Study

PubMed Central

Mannarelli, Daniela; Pauletti, Caterina; Grippo, Antonello; Amantini, Aldo; Augugliaro, Vito; Currà, Antonio; Missori, Paolo; Locuratolo, Nicoletta; De Lucia, Maria C.; Rinalduzzi, Steno; Fattapposta, Francesco

2015-01-01

Phasic alertness represents the ability to increase response readiness to a target following an external warning stimulus. Specific networks in the frontal and parietal regions appear to be involved in the alert state. In this study, we examined the role of the right dorsolateral prefrontal cortex (DLPFC) during the attentional processing of a stimulus using a cued double-choice reaction time task. The evaluation of these processes was conducted by means of Event-Related Potentials (ERPs), in particular by using the Contingent Negative Variation (CNV), and repetitive 1-Hz Transcranial Magnetic Stimulation (rTMS). Transient virtual inhibition of the right DLPFC induced by real 1-Hz rTMS stimulation led to a significant decrease in total CNV and W1-CNV areas if compared with the basal and post-sham rTMS conditions. Reaction times (RTs) did not decrease after inhibitory rTMS, but they did improve after sham stimulation. These results suggest that the right DLPFC plays a crucial role in the genesis and maintenance of the alerting state and learning processes. PMID:26090234

Contrasting cue-density effects in causal and prediction judgments.

PubMed

Vadillo, Miguel A; Musca, Serban C; Blanco, Fernando; Matute, Helena

2011-02-01

Many theories of contingency learning assume (either explicitly or implicitly) that predicting whether an outcome will occur should be easier than making a causal judgment. Previous research suggests that outcome predictions would depart from normative standards less often than causal judgments, which is consistent with the idea that the latter are based on more numerous and complex processes. However, only indirect evidence exists for this view. The experiment presented here specifically addresses this issue by allowing for a fair comparison of causal judgments and outcome predictions, both collected at the same stage with identical rating scales. Cue density, a parameter known to affect judgments, is manipulated in a contingency learning paradigm. The results show that, if anything, the cue-density bias is stronger in outcome predictions than in causal judgments. These results contradict key assumptions of many influential theories of contingency learning.

Perceptual training methods compared: the relative efficacy of different approaches to enhancing sport-specific anticipation.

PubMed

Abernethy, Bruce; Schorer, Jörg; Jackson, Robin C; Hagemann, Norbert

2012-06-01

The comparative efficacy of different perceptual training approaches for the improvement of anticipation was examined using a goalkeeping task from European handball that required the rapid prediction of shot direction. Novice participants (N = 60) were assigned equally to four different training groups and two different control groups (a placebo group and a group who undertook no training). The training groups received either (i) explicit rules to guide anticipation; (ii) direction as to the location of the key anticipatory cues provided either just verbally (verbal cueing) or supplemented with color highlighting (color cueing); or (iii) undertook a matching judgment task to encourage implicit learning. Performance of the groups was compared on an anticipation test administered before training, after the training intervention, under a condition involving evaluative stress, and after a 5-month retention period. The explicit learning, verbal cueing, and implicit learning conditions provided the greatest sustained improvements in performance whereas the group given color cueing performed no better than the control groups. Only the implicit learning group showed performance superior to the control groups under the stress situation. The verbal cueing, color cueing, and implicit learning groups formulated the lowest number of explicit rules related to the critical shoulder cue although the reported use of general cues and rules based on all cues did not differ between any of the groups. Anticipation can be improved through a variety of different perceptual training approaches with the relative efficacy of the different approaches being contingent upon both the time scale and conditions under which learning is assessed.

Improving Closing Task Completion in a Drugstore

ERIC Educational Resources Information Center

Fante, Rhiannon; Davis, Ora L.; Kempt, Vivian

2013-01-01

A within-subject ABAB reversal design was utilized to investigate the effects of graphic feedback and goal setting on employee closing task completion. Goal setting was contingent upon baseline performance and graphic feedback was posted weekly. It was found that goal setting and graphic feedback improved employee closing task completion.…

The Interactive Effects of Listwide Control, Item-Based Control, and Working Memory Capacity on Stroop Performance

ERIC Educational Resources Information Center

Hutchison, Keith A.

2011-01-01

Hypothesized top-down and bottom-up mechanisms of control within conflict-rich environments were examined by presenting participants with a Stroop task in which specific words were usually presented in either congruent or incongruent colors. Incongruent colors were either frequently (high contingency) or infrequently (low contingency) paired with…

Development of Preparatory Activity Indexed by the Contingent Negative Variation in Children

ERIC Educational Resources Information Center

Flores, Angelica B.; Digiacomo, Marcia R.; Meneres, Susana; Trigo, Eva; Gomez, Carlos M.

2009-01-01

Objectives: The present study investigated the effect of age on task-specific preparatory activation induced by a spatial cue using the central cue Posner's paradigm. The behavioral responses and the contingent negative variation (CNV) generated between S1 (the warning stimulus) and S2 (the imperative stimulus) were compared between 16 healthy…

Person Versus Process Praise and Criticism: Implications for Contingent Self-Worth and Coping.

ERIC Educational Resources Information Center

Dweck, Carol S.; Kamins, Melissa L.

1999-01-01

Two studies had children role-play successful and unsuccessful tasks to test the hypothesis that both criticism and praise that conveyed person or trait judgments could send a message of contingent worth and undermine subsequent coping. Found that 5- to 6-year olds displayed significantly more "helpless" responses after person criticism or praise…

Treatment of Escape-Maintained Behavior with Positive Reinforcement: The Role of Reinforcement Contingency and Density

ERIC Educational Resources Information Center

Ingvarsson, Einar T.; Hanley, Gregory P.; Welter, Katherine M.

2009-01-01

Functional analyses suggested that the disruptive behavior of three preschool children was maintained by escape from demands. While keeping the escape contingency intact, we conducted (a) a density analysis in which the children earned preferred items for task completion according to two schedules that varied in reinforcement density, and (b) a…

Depressive Realism and Outcome Density Bias in Contingency Judgments: The Effect of the Context and Intertrial Interval

ERIC Educational Resources Information Center

Msetfi, Rachel M.; Murphy, Robin A.; Simpson, Jane; Kornbrot, Diana E.

2005-01-01

The perception of the effectiveness of instrumental actions is influenced by depressed mood. Depressive realism (DR) is the claim that depressed people are particularly accurate in evaluating instrumentality. In two experiments, the authors tested the DR hypothesis using an action-outcome contingency judgment task. DR effects were a function of…

The Role of Caregiver Contingent Responsiveness in Promoting Compliance in Young Children

ERIC Educational Resources Information Center

Schueler, Christie M.; Prinz, Ronald J.

2013-01-01

The purpose of this study was to examine relations between parents' contingent responding and the behavior of their young children, in the context of other relevant parenting behaviors. Parents were observed interacting with their 3-6 year-old children during two laboratory tasks. Parent responses to child bids were classified into four mutually…

Electrophysiological brain indices of risk behavior modification induced by contingent feedback.

PubMed

Megías, Alberto; Torres, Miguel Angel; Catena, Andrés; Cándido, Antonio; Maldonado, Antonio

2018-02-01

The main aim of this research was to study the effects of response feedback on risk behavior and the neural and cognitive mechanisms involved, as a function of the feedback contingency. Sixty drivers were randomly assigned to one of three feedback groups: contingent, non-contingent and no feedback. The participants' task consisted of braking or not when confronted with a set of risky driving situations, while their electroencephalographic activity was continuously recorded. We observed that contingent feedback, as opposed to non-contingent feedback, promoted changes in the response bias towards safer decisions. This behavioral modification implied a higher demand on cognitive control, reflected in a larger amplitude of the N400 component. Moreover, the contingent feedback, being predictable and entailing more informative value, gave rise to smaller SPN and larger FRN scores when compared with non-contingent feedback. Taken together, these findings provide a new and complex insight into the neurophysiological basis of the influence of feedback contingency on the processing of decision-making under risk. We suggest that response feedback, when contingent upon the risky behavior, appears to improve the functionality of the brain mechanisms involved in decision-making and can be a powerful tool for reducing the tendency to choose risky options in risk-prone individuals. Copyright © 2018 Elsevier B.V. All rights reserved.

Reward sensitivity modulates brain activity in the prefrontal cortex, ACC and striatum during task switching.

PubMed

Fuentes-Claramonte, Paola; Ávila, César; Rodríguez-Pujadas, Aina; Ventura-Campos, Noelia; Bustamante, Juan C; Costumero, Víctor; Rosell-Negre, Patricia; Barrós-Loscertales, Alfonso

2015-01-01

Current perspectives on cognitive control acknowledge that individual differences in motivational dispositions may modulate cognitive processes in the absence of reward contingencies. This work aimed to study the relationship between individual differences in Behavioral Activation System (BAS) sensitivity and the neural underpinnings involved in processing a switching cue in a task-switching paradigm. BAS sensitivity was hypothesized to modulate brain activity in frontal regions, ACC and the striatum. Twenty-eight healthy participants underwent fMRI while performing a switching task, which elicited activity in fronto-striatal regions during the processing of the switch cue. BAS sensitivity was negatively associated with activity in the lateral prefrontal cortex, anterior cingulate cortex and the ventral striatum. Combined with previous results, our data indicate that BAS sensitivity modulates the neurocognitive processes involved in task switching in a complex manner depending on task demands. Therefore, individual differences in motivational dispositions may influence cognitive processing in the absence of reward contingencies.

Reward Sensitivity Modulates Brain Activity in the Prefrontal Cortex, ACC and Striatum during Task Switching

PubMed Central

Fuentes-Claramonte, Paola; Ávila, César; Rodríguez-Pujadas, Aina; Ventura-Campos, Noelia; Bustamante, Juan C.; Costumero, Víctor; Rosell-Negre, Patricia; Barrós-Loscertales, Alfonso

2015-01-01

Current perspectives on cognitive control acknowledge that individual differences in motivational dispositions may modulate cognitive processes in the absence of reward contingencies. This work aimed to study the relationship between individual differences in Behavioral Activation System (BAS) sensitivity and the neural underpinnings involved in processing a switching cue in a task-switching paradigm. BAS sensitivity was hypothesized to modulate brain activity in frontal regions, ACC and the striatum. Twenty-eight healthy participants underwent fMRI while performing a switching task, which elicited activity in fronto-striatal regions during the processing of the switch cue. BAS sensitivity was negatively associated with activity in the lateral prefrontal cortex, anterior cingulate cortex and the ventral striatum. Combined with previous results, our data indicate that BAS sensitivity modulates the neurocognitive processes involved in task switching in a complex manner depending on task demands. Therefore, individual differences in motivational dispositions may influence cognitive processing in the absence of reward contingencies. PMID:25875640

Evidence for an alternation strategy in time-place learning.

PubMed

Pizzo, Matthew J; Crystal, Jonathon D

2004-11-30

Many different conclusions concerning what type of mechanism rats use to solve a daily time-place task have emerged in the literature. The purpose of this study was to test three competing explanations of time-place discrimination. Rats (n = 10) were tested twice daily in a T-maze, separated by approximately 7 h. Food was available at one location in the morning and another location in the afternoon. After the rats learned to visit each location at the appropriate time, tests were omitted to evaluate whether the rats were utilizing time-of-day (i.e., a circadian oscillator) or an alternation strategy (i.e., visiting a correct location is a cue to visit the next location). Performance on this test was significantly lower than chance, ruling out the use of time-of-day. A phase advance of the light cycle was conducted to test the alternation strategy and timing with respect to the light cycle (i.e., an interval timer). There was no difference between probe and baseline performance. These results suggest that the rats used an alternation strategy to meet the temporal and spatial contingencies in the time-place task.

Time-limited effects of emotional arousal on item and source memory.

PubMed

Wang, Bo; Sun, Bukuan

2015-01-01

Two experiments investigated the time-limited effects of emotional arousal on consolidation of item and source memory. In Experiment 1, participants memorized words (items) and the corresponding speakers (sources) and then took an immediate free recall test. Then they watched a neutral, positive, or negative video 5, 35, or 50 min after learning, and 24 hours later they took surprise memory tests. Experiment 2 was similar to Experiment 1 except that (a) a reality monitoring task was used; (b) elicitation delays of 5, 30, and 45 min were used; and (c) delayed memory tests were given 60 min after learning. Both experiments showed that, regardless of elicitation delay, emotional arousal did not enhance item recall memory. Second, both experiments showed that negative arousal enhanced delayed item recognition memory only at the medium elicitation delay, but not in the shorter or longer delays. Positive arousal enhanced performance only in Experiment 1. Third, regardless of elicitation delay, emotional arousal had little effect on source memory. These findings have implications for theories of emotion and memory, suggesting that emotion effects are contingent upon the nature of the memory task and elicitation delay.

Long-lasting effects of performance-contingent unconscious and conscious reward incentives during cued task-switching.

PubMed

Capa, Rémi L; Bouquet, Cédric A; Dreher, Jean-Claude; Dufour, André

2013-01-01

Motivation is often thought to interact consciously with executive control, although recent studies have indicated that motivation can also be unconscious. To date, however, the effects of unconscious motivation on high-order executive control functions have not been explored. Only a few studies using subliminal stimuli (i.e., those not related to motivation, such as an arrow to prime a response) have reported short-lived effects on high-order executive control functions. Here, building on research on unconscious motivation, in which a behavior of perseverance is induced to attain a goal, we hypothesized that subliminal motivation can have long-lasting effects on executive control processes. We investigated the impact of unconscious/conscious monetary reward incentives on evoked potentials and neural activity dynamics during cued task-switching performance. Participants performed long runs of task-switching. At the beginning of each run, a reward (50 cents or 1 cent) was displayed, either subliminally or supraliminally. Participants earned the reward contingent upon their correct responses to each trial of the run. A higher percentage of runs was achieved with higher (conscious and unconscious) than lower rewards, indicating that unconscious high rewards have long-lasting behavioral effects. Event-related potential (ERP) results indicated that unconscious and conscious rewards influenced preparatory effort in task preparation, as suggested by a greater fronto-central contingent negative variation (CNV) starting at cue-onset. However, a greater parietal P3 associated with better reaction times (RTs) was observed only under conditions of conscious high reward, suggesting a larger amount of working memory invested during task performance. Together, these results indicate that unconscious and conscious motivations are similar at early stages of task-switching preparation but differ during task performance. Copyright © 2012 Elsevier Ltd. All rights reserved.

Attentional bias to threat in the general population is contingent on target competition, not on attentional control settings.

PubMed

Wirth, Benedikt Emanuel; Wentura, Dirk

2018-04-01

Dot-probe studies usually find an attentional bias towards threatening stimuli only in anxious participants. Here, we investigated under what conditions such a bias occurs in unselected samples. According to contingent-capture theory, an irrelevant cue only captures attention if it matches an attentional control setting. Therefore, we first tested the hypothesis that an attentional control setting tuned to threat must be activated in (non-anxious) individuals. In Experiment 1, we used a dot-probe task with a manipulation of attentional control settings ('threat' - set vs. control set). Surprisingly, we found an (anxiety-independent) attentional bias to angry faces that was not moderated by attentional control settings. Since we presented two stimuli (i.e., a target and a distractor) on the target screen in Experiment 1 (a necessity to realise the test of contingent capture), but most dot-probe studies only employ a single target, we conducted Experiment 2 to test the hypothesis that attentional bias in the general population is contingent on target competition. Participants performed a dot-probe task, involving presentation of a stand-alone target or a target competing with a distractor. We found an (anxiety-independent) attentional bias towards angry faces in the latter but not the former condition. This suggests that attentional bias towards angry faces in unselected samples is not contingent on attentional control settings but on target competition.

Contingent Attentional Capture by Top-Down Control Settings: Converging Evidence from Event-Related Potentials

ERIC Educational Resources Information Center

Lien, Mei-Ching; Ruthruff, Eric; Goodin, Zachary; Remington, Roger W.

2008-01-01

Theories of attentional control are divided over whether the capture of spatial attention depends primarily on stimulus salience or is contingent on attentional control settings induced by task demands. The authors addressed this issue using the N2-posterior-contralateral (N2pc) effect, a component of the event-related brain potential thought to…

The effect of REM sleep deprivation on motivation for food reward.

PubMed

Hanlon, Erin C; Andrzejewski, Matthew E; Harder, Bridgette K; Kelley, Ann E; Benca, Ruth M

2005-08-30

Prolonged sleep deprivation in rats produces a characteristic syndrome consisting of an increase in food intake yet a decrease in weight. Moreover, the increase in food intake generally precedes the weight loss, suggesting that sleep deprivation may affect appetitive behaviors. Using the multiple platform method to produce rapid eye movement (REM) sleep deprivation, we investigated the effect of REM sleep deprivation (REMSD) on motivation for food reward utilizing food-reinforced operant tasks. In acquisition or maintenance of an operant task, REM sleep-deprived rats, with or without simultaneous food restriction, decreased responding for sucrose pellet reward in comparison to controls, despite the fact that all REM sleep-deprived rats lost weight. Furthermore, the overall response deficit of the REM sleep-deprived rats was due to a within-session decline in responding. REM sleep-deprived rats showed evidence of understanding the contingency of the task comparable to controls throughout deprivation period, suggesting that the decrements in responding were not primarily related to deficits in learning or memory. Rather, REM sleep deprivation appears to alter systems involved in motivational processes, reward, and/or attention.

The Effectiveness of Gaze-Contingent Control in Computer Games.

PubMed

Orlov, Paul A; Apraksin, Nikolay

2015-01-01

Eye-tracking technology and gaze-contingent control in human-computer interaction have become an objective reality. This article reports on a series of eye-tracking experiments, in which we concentrated on one aspect of gaze-contingent interaction: Its effectiveness compared with mouse-based control in a computer strategy game. We propose a measure for evaluating the effectiveness of interaction based on "the time of recognition" the game unit. In this article, we use this measure to compare gaze- and mouse-contingent systems, and we present the analysis of the differences as a function of the number of game units. Our results indicate that performance of gaze-contingent interaction is typically higher than mouse manipulation in a visual searching task. When tested on 60 subjects, the results showed that the effectiveness of gaze-contingent systems over 1.5 times higher. In addition, we obtained that eye behavior stays quite stabile with or without mouse interaction. © The Author(s) 2015.

Influences of Source - Item Contingency and Schematic Knowledge on Source Monitoring: Tests of the Probability-Matching Account

PubMed Central

Bayen, Ute J.; Kuhlmann, Beatrice G.

2010-01-01

The authors investigated conditions under which judgments in source-monitoring tasks are influenced by prior schematic knowledge. According to a probability-matching account of source guessing (Spaniol & Bayen, 2002), when people do not remember the source of information, they match source guessing probabilities to the perceived contingency between sources and item types. When they do not have a representation of a contingency, they base their guesses on prior schematic knowledge. The authors provide support for this account in two experiments with sources presenting information that was expected for one source and somewhat unexpected for another. Schema-relevant information about the sources was provided at the time of encoding. When contingency perception was impeded by dividing attention, participants showed schema-based guessing (Experiment 1). Manipulating source - item contingency also affected guessing (Experiment 2). When this contingency was schema-inconsistent, it superseded schema-based expectations and led to schema-inconsistent guessing. PMID:21603251

Ecological Momentary Assessment of Negative Symptoms in Schizophrenia: Relationships to Effort Based Decision Making and Reinforcement Learning

PubMed Central

Moran, Erin K.; Culbreth, Adam J.; Barch, Deanna M.

2017-01-01

Negative symptoms are a core clinical feature of schizophrenia, but conceptual and methodological problems with current instruments can make their assessment challenging. One hypothesis is that current symptom assessments may be influenced by impairments in memory and may not be fully reflective of actual functioning outside of the laboratory. The present study sought to investigate the validity of assessing negative symptoms using ecological momentary assessment (EMA). Participants with schizophrenia (N=31) completed electronic questionnaires on smartphones four times a day for one week. Participants also completed Effort-Based Decision Making and Reinforcement Learning (RL) tasks to assess the relationship between EMA and laboratory measures, which tap into negative symptom relevant domains. Hierarchical linear modeling analyses revealed that clinician-rated and self-report measures of negative symptoms were significantly related to negative symptoms assessed via EMA. However, working memory moderated the relationship between EMA and retrospective measures of negative symptoms, such that there was a stronger relationship between EMA and retrospective negative symptom measures among individuals with better working memory. We also found that negative symptoms assessed via EMA were related to poor performance on the Effort task, while clinician-rated symptoms and self-reports were not. Further, we found that negative symptoms were related to poorer performance on learning reward contingencies. Our findings suggest that negative symptoms can be assessed through EMA and that working memory impairments frequently seen in schizophrenia may affect recall of symptoms. Moreover, these findings suggest the importance of examining the relationship between laboratory tasks and symptoms assessed during daily life. PMID:27893230

Striatal dopamine depletion in rats produces variable effects on contingency detection: task-related influences.

PubMed

Braun, Stephanie; Hauber, Wolfgang

2012-02-01

Dopamine (DA) depletion of the posterior dorsomedial striatum (pDMS) can impair the capability of rats to detect changes in the causal efficacy of actions. Here we sought to characterize in more detail the effects of pDMS DA depletions on contingency detection as a function of different contingency degradation training protocols. In experiment 1, sham controls and rats with pDMS DA depletions received limited contingency degradation training (4 days) that involved an invariable and high degree of degradation to one of two contingencies controlling instrumental choice behaviour. The results demonstrated that lesioned rats were insensitive to contingency manipulations both during contingency degradation training and in the subsequent extinction test. Experiment 2 further indicated that rats with pDMS DA depletion subjected to extended contingency degradation training (12 days) became sensitive to contingency manipulations during the training phase but not in the subsequent extinction test. In experiment 3, an extended but more complex contingency degradation training protocol (12 days) was used that involved a gradual shift from a low to an intermediate and a high degree of contingency degradation rather than a high and invariable degree of contingency degradation as in experiments 1 and 2. Notably, lesioned rats were sensitive to contingency manipulations both during the contingency degradation training phase and in the subsequent extinction test. Thus, pDMS DA depletions can impair the capability to detect changes in the causal efficacy of actions; however, the occurrence and pattern of impairments depend on the contingency degradation training protocol being used. © 2012 The Authors. European Journal of Neuroscience © 2012 Federation of European Neuroscience Societies and Blackwell Publishing Ltd.

Prescription opioid misusing chronic pain patients exhibit dysregulated context-dependent associations: Investigating associative learning in addiction with the cue-primed reactivity task.

PubMed

Garland, Eric L; Bryan, Craig J; Kreighbaum, Lydia; Nakamura, Yoshio; Howard, Matthew O; Froeliger, Brett

2018-06-01

Associative learning undergirds the development of addiction, such that drug-related cues serve as conditioned stimuli to elicit drug-seeking responses. Plausibly, among opioid misusing chronic pain patients, pain-related information may serve as a conditioned stimulus to magnify opioid cue-elicited autonomic and craving responses through a process of second-order conditioning. We utilized a novel psychophysiological probe of pain-opioid conditioned associations, the Cue-Primed Reactivity (CPR) task. In this task, participants were presented with images as primes (200 ms) and cues (6000 ms) in pairs organized in four task blocks: "control-opioid," "pain-opioid," "control-pain," and "opioid-pain." Opioid-treated chronic pain patients (N = 30) recruited from an Army base in the Western United States were classified as opioid misusers (n = 17) or non-misusers (n = 13) via a validated cutpoint on the Prescription Drug Use Questionnaire (PDUQ; Compton et al., 2008). Opioid misuse status was examined as a predictor of HRV, craving, and mood responses on the CPR task. HRV increased to a greater extent during the pain-opioid block compared to the control-opioid block for non-misusers compared to misusers (p = .003, η 2 partial  = 0.27). In contrast, craving increased to a greater extent from baseline to the pain-opioid block for misusers than for non-misusers (p = .03, η 2 partial  = .16). Findings suggest that opioid-treated chronic pain patients exhibit Pavlovian conditioned responses to opioid cues strengthened by an associative learning process of second-order conditioning when primed by pain-related images. This pain-opioid contingency appears to become disrupted among individuals who engage in opioid misuse, such that opioid-related stimuli elicit motivational responses irrespective of pain-related contextual stimuli. Copyright © 2018 Elsevier B.V. All rights reserved.

Contributions of dorsal striatal subregions to spatial alternation behavior.

PubMed

Moussa, Roula; Poucet, Bruno; Amalric, Marianne; Sargolini, Francesca

2011-07-01

Considerable evidence has shown a clear dissociation between the dorsomedial (DMS) and the dorsolateral (DLS) striatum in instrumental conditioning. In particular, DMS activity is necessary to form action-outcome associations, whereas the DLS is required for developing habitual behavior. However, few studies have investigated whether a similar dissociation exists in more complex goal-directed learning processes. The present study examined the role of the two structures in such complex learning by analyzing the effects of excitotoxic DMS and DLS lesions during the acquisition and extinction of spatial alternation behavior, in a continuous alternation T-maze task. We demonstrate that DMS and DLS lesions have opposite effects, the former impairing and the latter improving animal performance during learning and extinction. DMS lesions may impair the acquisition of spatial alternation behavior by disrupting the signal necessary to link a goal with a specific spatial sequence. In contrast, DLS lesions may accelerate goal-driven strategies by minimizing the influence of external stimuli on the response, thus increasing the impact of action-reward contingencies. Taken together, these results suggest that DMS- and DLS-mediated learning strategies develop in parallel and compete for the control of the behavioral response early in learning.

Impairments in learning by monetary rewards and alcohol-associated rewards in detoxified alcoholic patients.

PubMed

Jokisch, Daniel; Roser, Patrik; Juckel, Georg; Daum, Irene; Bellebaum, Christian

2014-07-01

Excessive alcohol consumption has been linked to structural and functional brain changes associated with cognitive, emotional, and behavioral impairments. It has been suggested that neural processing in the reward system is also affected by alcoholism. The present study aimed at further investigating reward-based associative learning and reversal learning in detoxified alcohol-dependent patients. Twenty-one detoxified alcohol-dependent patients and 26 healthy control subjects participated in a probabilistic learning task using monetary and alcohol-associated rewards as feedback stimuli indicating correct responses. Performance during acquisition and reversal learning in the different feedback conditions was analyzed. Alcohol-dependent patients and healthy control subjects showed an increase in learning performance over learning blocks during acquisition, with learning performance being significantly lower in alcohol-dependent patients. After changing the contingencies, alcohol-dependent patients exhibited impaired reversal learning and showed, in contrast to healthy controls, different learning curves for different types of rewards with no increase in performance for high monetary and alcohol-associated feedback. The present findings provide evidence that dysfunctional processing in the reward system in alcohol-dependent patients leads to alterations in reward-based learning resulting in a generally reduced performance. In addition, the results suggest that alcohol-dependent patients are, in particular, more impaired in changing an established behavior originally reinforced by high rewards. Copyright © 2014 by the Research Society on Alcoholism.

Dissociating contingency awareness and conditioned attitudes: evidence of contingency-unaware evaluative conditioning.

PubMed

Hütter, Mandy; Sweldens, Steven; Stahl, Christoph; Unkelbach, Christian; Klauer, Karl Christoph

2012-08-01

Whether human evaluative conditioning can occur without contingency awareness has been the subject of an intense and ongoing debate for decades, troubled by a wide array of methodological difficulties. Following recent methodological innovations, the available evidence currently points to the conclusion that evaluative conditioning effects do not occur without contingency awareness. In a simulation, we demonstrate, however, that these innovations are strongly biased toward the conclusion that evaluative conditioning requires contingency awareness, confounding the measurement of contingency memory with conditioned attitudes. We adopt a process-dissociation procedure to separate the memory and attitude components. In 4 studies, the attitude parameter is validated using existing attitudes and applied to probe for contingency-unaware evaluative conditioning. A fifth experiment incorporates a time-delay manipulation confirming the dissociability of the attitude and memory components. The results indicate that evaluative conditioning can produce attitudes without conscious awareness of the contingencies. Implications for theories of evaluative conditioning and associative learning are discussed. (PsycINFO Database Record (c) 2012 APA, all rights reserved).

Changes of Attention during Value-Based Reversal Learning Are Tracked by N2pc and Feedback-Related Negativity

PubMed Central

Oemisch, Mariann; Watson, Marcus R.; Womelsdorf, Thilo; Schubö, Anna

2017-01-01

Previously learned reward values can have a pronounced impact, behaviorally and neurophysiologically, on the allocation of selective attention. All else constant, stimuli previously associated with a high value gain stronger attentional prioritization than stimuli previously associated with a low value. The N2pc, an ERP component indicative of attentional target selection, has been shown to reflect aspects of this prioritization, by changes of mean amplitudes closely corresponding to selective enhancement of high value target processing and suppression of high value distractor processing. What has remained unclear so far is whether the N2pc also reflects the flexible and repeated behavioral adjustments needed in a volatile task environment, in which the values of stimuli are reversed often and unannounced. Using a value-based reversal learning task, we found evidence that the N2pc amplitude flexibly and reversibly tracks value-based choices during the learning of reward associated stimulus colors. Specifically, successful learning of current value-contingencies was associated with reduced N2pc amplitudes, and this effect was more apparent for distractor processing, compared with target processing. In addition, following a value reversal the feedback related negativity(FRN), an ERP component that reflects feedback processing, was amplified and co-occurred with increased N2pc amplitudes in trials following low-value feedback. Importantly, participants that showed the greatest adjustment in N2pc amplitudes based on feedback were also the most efficient learners. These results allow further insight into how changes in attentional prioritization in an uncertain and volatile environment support flexible adjustments of behavior. PMID:29163113

Changes of Attention during Value-Based Reversal Learning Are Tracked by N2pc and Feedback-Related Negativity.

PubMed

Oemisch, Mariann; Watson, Marcus R; Womelsdorf, Thilo; Schubö, Anna

2017-01-01

Previously learned reward values can have a pronounced impact, behaviorally and neurophysiologically, on the allocation of selective attention. All else constant, stimuli previously associated with a high value gain stronger attentional prioritization than stimuli previously associated with a low value. The N2pc, an ERP component indicative of attentional target selection, has been shown to reflect aspects of this prioritization, by changes of mean amplitudes closely corresponding to selective enhancement of high value target processing and suppression of high value distractor processing. What has remained unclear so far is whether the N2pc also reflects the flexible and repeated behavioral adjustments needed in a volatile task environment, in which the values of stimuli are reversed often and unannounced. Using a value-based reversal learning task, we found evidence that the N2pc amplitude flexibly and reversibly tracks value-based choices during the learning of reward associated stimulus colors. Specifically, successful learning of current value-contingencies was associated with reduced N2pc amplitudes, and this effect was more apparent for distractor processing, compared with target processing. In addition, following a value reversal the feedback related negativity(FRN), an ERP component that reflects feedback processing, was amplified and co-occurred with increased N2pc amplitudes in trials following low-value feedback. Importantly, participants that showed the greatest adjustment in N2pc amplitudes based on feedback were also the most efficient learners. These results allow further insight into how changes in attentional prioritization in an uncertain and volatile environment support flexible adjustments of behavior.

STS-65 Mission Specialist Walz poolside at JSC's WETF during contingency exer

NASA Technical Reports Server (NTRS)

1994-01-01

STS-65 Mission Specialist Carl E. Walz, holding a NIKON camera, stands on the poolside of the Johnson Space Center's (JSC's) Weightless Environment Training Facility (WETF) during extravehicular activity (EVA) contingency exercise preparations. Walz stands by to photograph two of his crewmates about to be lowered into the WETF's 25-feet deep pool. Astronauts Donald A. Thomas and Leroy Chiao were about to be submerged and made to be neutrally buoyant in order to rehearse several contingency tasks that would require a spacewalk. No spacewalks are scheduled for the STS-65 International Microgravity Laboratory 2 (IML-2) mission.

Prespeech motor learning in a neural network using reinforcement☆

PubMed Central

Warlaumont, Anne S.; Westermann, Gert; Buder, Eugene H.; Oller, D. Kimbrough

2012-01-01

Vocal motor development in infancy provides a crucial foundation for language development. Some significant early accomplishments include learning to control the process of phonation (the production of sound at the larynx) and learning to produce the sounds of one’s language. Previous work has shown that social reinforcement shapes the kinds of vocalizations infants produce. We present a neural network model that provides an account of how vocal learning may be guided by reinforcement. The model consists of a self-organizing map that outputs to muscles of a realistic vocalization synthesizer. Vocalizations are spontaneously produced by the network. If a vocalization meets certain acoustic criteria, it is reinforced, and the weights are updated to make similar muscle activations increasingly likely to recur. We ran simulations of the model under various reinforcement criteria and tested the types of vocalizations it produced after learning in the differ-ent conditions. When reinforcement was contingent on the production of phonated (i.e. voiced) sounds, the network’s post learning productions were almost always phonated, whereas when reinforcement was not contingent on phonation, the network’s post-learning productions were almost always not phonated. When reinforcement was contingent on both phonation and proximity to English vowels as opposed to Korean vowels, the model’s post-learning productions were more likely to resemble the English vowels and vice versa. PMID:23275137

Prespeech motor learning in a neural network using reinforcement.

PubMed

Warlaumont, Anne S; Westermann, Gert; Buder, Eugene H; Oller, D Kimbrough

2013-02-01

Vocal motor development in infancy provides a crucial foundation for language development. Some significant early accomplishments include learning to control the process of phonation (the production of sound at the larynx) and learning to produce the sounds of one's language. Previous work has shown that social reinforcement shapes the kinds of vocalizations infants produce. We present a neural network model that provides an account of how vocal learning may be guided by reinforcement. The model consists of a self-organizing map that outputs to muscles of a realistic vocalization synthesizer. Vocalizations are spontaneously produced by the network. If a vocalization meets certain acoustic criteria, it is reinforced, and the weights are updated to make similar muscle activations increasingly likely to recur. We ran simulations of the model under various reinforcement criteria and tested the types of vocalizations it produced after learning in the different conditions. When reinforcement was contingent on the production of phonated (i.e. voiced) sounds, the network's post-learning productions were almost always phonated, whereas when reinforcement was not contingent on phonation, the network's post-learning productions were almost always not phonated. When reinforcement was contingent on both phonation and proximity to English vowels as opposed to Korean vowels, the model's post-learning productions were more likely to resemble the English vowels and vice versa. Copyright © 2012 Elsevier Ltd. All rights reserved.

The role of consolidation in learning context-dependent phonotactic patterns in speech and digital sequence production.

PubMed

Anderson, Nathaniel D; Dell, Gary S

2018-04-03

Speakers implicitly learn novel phonotactic patterns by producing strings of syllables. The learning is revealed in their speech errors. First-order patterns, such as "/f/ must be a syllable onset," can be distinguished from contingent, or second-order, patterns, such as "/f/ must be an onset if the vowel is /a/, but a coda if the vowel is /o/." A metaanalysis of 19 experiments clearly demonstrated that first-order patterns affect speech errors to a very great extent in a single experimental session, but second-order vowel-contingent patterns only affect errors on the second day of testing, suggesting the need for a consolidation period. Two experiments tested an analogue to these studies involving sequences of button pushes, with fingers as "consonants" and thumbs as "vowels." The button-push errors revealed two of the key speech-error findings: first-order patterns are learned quickly, but second-order thumb-contingent patterns are only strongly revealed in the errors on the second day of testing. The influence of computational complexity on the implicit learning of phonotactic patterns in speech production may be a general feature of sequence production.

A Validation of Cognitive Evaluation Theory.

ERIC Educational Resources Information Center

McDonald, Charles H.

The role of money and other types of feedback on motivation to do a task or job has long been of interest to managers in business. To examine Deci's hypothesis concerning the effects of contingent rewards on intrinsic task interest, 42 high school students worked puzzles involving the solution of mazes and anagrams. Competence in task was made…

Appearance-related social comparisons: the role of contingent self-esteem and self-perceptions of attractiveness.

PubMed

Patrick, Heather; Neighbors, Clayton; Knee, C Raymond

2004-04-01

Two studies examined contingent self-esteem (CSE) and responses to appearance-related social comparisons. Study 1 was an experimental study in which women rated a series of advertisements from popular women's magazines. Study 2 employed an event-contingent diary recording procedure. In Study 1, women who were higher in CSE and lower in self-perceptions of attractiveness (SPA) experienced greater decreases in positive affect and greater increases in negative affect following the ad-rating task. Study 2 results supported a mediation model in which women who were higher in CSE felt worse after social comparisons because they made primarily upward comparisons. Overall, results suggest that appearance-related comparisons are more distressing for those who base their self-worth on contingencies and have lower self-perceived attractiveness.

Projection specificity in heterogeneous locus coeruleus cell populations: implications for learning and memory

PubMed Central

Uematsu, Akira; Tan, Bao Zhen

2015-01-01

Noradrenergic neurons in the locus coeruleus (LC) play a critical role in many functions including learning and memory. This relatively small population of cells sends widespread projections throughout the brain including to a number of regions such as the amygdala which is involved in emotional associative learning and the medial prefrontal cortex which is important for facilitating flexibility when learning rules change. LC noradrenergic cells participate in both of these functions, but it is not clear how this small population of neurons modulates these partially distinct processes. Here we review anatomical, behavioral, and electrophysiological studies to assess how LC noradrenergic neurons regulate these different aspects of learning and memory. Previous work has demonstrated that subpopulations of LC noradrenergic cells innervate specific brain regions suggesting heterogeneity of function in LC neurons. Furthermore, noradrenaline in mPFC and amygdala has distinct effects on emotional learning and cognitive flexibility. Finally, neural recording data show that LC neurons respond during associative learning and when previously learned task contingencies change. Together, these studies suggest a working model in which distinct and potentially opposing subsets of LC neurons modulate particular learning functions through restricted efferent connectivity with amygdala or mPFC. This type of model may provide a general framework for understanding other neuromodulatory systems, which also exhibit cell type heterogeneity and projection specificity. PMID:26330494

78 FR 4133 - Procurement List; Proposed Additions and Deletion

Federal Register 2010, 2011, 2012, 2013, 2014

2013-01-18

... specific tasks including preparation of menu boards, table bussing service, guest flow rate, service of food, replenishing of food, unloading, storing, and shelving of supplies, food preparation, cashier... the event of contingency, perform all required tasks to include cooking to ensure continued service...

Leadership Effectiveness in Teacher Probation Committees

ERIC Educational Resources Information Center

Martin, Yvonne M.; And Others

1976-01-01

This study tested the prediction of Fiedler's Contingency Theory of Leadership Effectiveness, namely, that a relationship-oriented leadership style would lead to task-group effectiveness in a moderately favorable situation, while a task-oriented leadership style would lead to effectiveness in an unfavorable situation. (Author/IRT)

Common Neural Mechanisms Underlying Reversal Learning by Reward and Punishment

PubMed Central

Xue, Gui; Xue, Feng; Droutman, Vita; Lu, Zhong-Lin; Bechara, Antoine; Read, Stephen

2013-01-01

Impairments in flexible goal-directed decisions, often examined by reversal learning, are associated with behavioral abnormalities characterized by impulsiveness and disinhibition. Although the lateral orbital frontal cortex (OFC) has been consistently implicated in reversal learning, it is still unclear whether this region is involved in negative feedback processing, behavioral control, or both, and whether reward and punishment might have different effects on lateral OFC involvement. Using a relatively large sample (N = 47), and a categorical learning task with either monetary reward or moderate electric shock as feedback, we found overlapping activations in the right lateral OFC (and adjacent insula) for reward and punishment reversal learning when comparing correct reversal trials with correct acquisition trials, whereas we found overlapping activations in the right dorsolateral prefrontal cortex (DLPFC) when negative feedback signaled contingency change. The right lateral OFC and DLPFC also showed greater sensitivity to punishment than did their left homologues, indicating an asymmetry in how punishment is processed. We propose that the right lateral OFC and anterior insula are important for transforming affective feedback to behavioral adjustment, whereas the right DLPFC is involved in higher level attention control. These results provide insight into the neural mechanisms of reversal learning and behavioral flexibility, which can be leveraged to understand risky behaviors among vulnerable populations. PMID:24349211

Common neural mechanisms underlying reversal learning by reward and punishment.

PubMed

Xue, Gui; Xue, Feng; Droutman, Vita; Lu, Zhong-Lin; Bechara, Antoine; Read, Stephen

2013-01-01

Impairments in flexible goal-directed decisions, often examined by reversal learning, are associated with behavioral abnormalities characterized by impulsiveness and disinhibition. Although the lateral orbital frontal cortex (OFC) has been consistently implicated in reversal learning, it is still unclear whether this region is involved in negative feedback processing, behavioral control, or both, and whether reward and punishment might have different effects on lateral OFC involvement. Using a relatively large sample (N = 47), and a categorical learning task with either monetary reward or moderate electric shock as feedback, we found overlapping activations in the right lateral OFC (and adjacent insula) for reward and punishment reversal learning when comparing correct reversal trials with correct acquisition trials, whereas we found overlapping activations in the right dorsolateral prefrontal cortex (DLPFC) when negative feedback signaled contingency change. The right lateral OFC and DLPFC also showed greater sensitivity to punishment than did their left homologues, indicating an asymmetry in how punishment is processed. We propose that the right lateral OFC and anterior insula are important for transforming affective feedback to behavioral adjustment, whereas the right DLPFC is involved in higher level attention control. These results provide insight into the neural mechanisms of reversal learning and behavioral flexibility, which can be leveraged to understand risky behaviors among vulnerable populations.

Multisensory Emplaced Learning: Resituating Situated Learning in a Moving World

ERIC Educational Resources Information Center

Fors, Vaike; Backstrom, Asa; Pink, Sarah

2013-01-01

This article outlines the implications of a theory of "sensory-emplaced learning" for understanding the interrelationships between the embodied and environmental in learning processes. Understanding learning as multisensory and contingent within everyday place-events, this framework analytically describes how people establish themselves as…

Multisensory Emplaced Learning: Resituating Situated Learning in a Moving World

ERIC Educational Resources Information Center

Fors, Vaike; Backstrom, Asa; Pink, Sarah

2013-01-01

This article outlines the implications of a theory of "sensory-emplaced learning" for understanding the interrelationships between the embodied and environmental in learning processes. Understanding learning as multisensory and contingent within everyday place-events, this framework analytically describes how people establish themselves…

Exogenous attention can be counter-selective: onset cues disrupt sensitivity to color changes.

PubMed

Müller-Plath, Gisela; Klöckner, Nils

2014-03-01

In peripheral spatial cueing paradigms, exogenous attentional capture is commonly observed after salient onset cues or with cues contingent on target characteristics. We proposed that exogenously captured attention disrupts the selectivity to target features. We tested this by experimentally emulating the everyday observation that in a viewing situation in which the observer is monitoring a stationary display fort change to occur, the onset of a salient stimulus (onset cue) or a change in a stationary stimulus similar to the expected one (contingent cue) has a distracting effect. As predicted, we found that both types of cues reduced the target detection sensitivity but enhanced the bias to respond in a go-nogo-paradigm. With the onset cue, the sensitivity loss was more pronounced at the side of the cue, whereas the contingent cue affected both sides likewise. Moreover, the effects of the onset cue interacted with the task difficulty: the more selectivity a task required the more immune it was against disruption, but the more likely was a response. We concluded that onset capture disrupts selective attention by adding noise to the processing of the target location. The effects of contingent capture could be explained with cue-target confounding. Finally, we suggest a new model of attentional capture in which exogenous and endogenous components interact in a dynamic way.

Eye Movements Index Implicit Memory Expression in Fear Conditioning

PubMed Central

Hopkins, Lauren S.; Schultz, Douglas H.; Hannula, Deborah E.; Helmstetter, Fred J.

2015-01-01

The role of contingency awareness in simple associative learning experiments with human participants is currently debated. Since prior work suggests that eye movements can index mnemonic processes that occur without awareness, we used eye tracking to better understand the role of awareness in learning aversive Pavlovian conditioning. A complex real-world scene containing four embedded household items was presented to participants while skin conductance, eye movements, and pupil size were recorded. One item embedded in the scene served as the conditional stimulus (CS). One exemplar of that item (e.g. a white pot) was paired with shock 100 percent of the time (CS+) while a second exemplar (e.g. a gray pot) was never paired with shock (CS-). The remaining items were paired with shock on half of the trials. Participants rated their expectation of receiving a shock during each trial, and these expectancy ratings were used to identify when (i.e. on what trial) each participant became aware of the programmed contingencies. Disproportionate viewing of the CS was found both before and after explicit contingency awareness, and patterns of viewing distinguished the CS+ from the CS-. These observations are consistent with “dual process” models of fear conditioning, as they indicate that learning can be expressed in patterns of viewing prior to explicit contingency awareness. PMID:26562298

Sex Differences in Risk Preference and c-Fos Expression in Paraventricular Thalamic Nucleus of Rats During Gambling Task

PubMed Central

Ishii, Hironori; Onodera, Mariko; Ohara, Shinya; Tsutsui, Ken-Ichiro; Iijima, Toshio

2018-01-01

Different biological requirements between males and females may cause sex differences in decision preference when choosing between taking a risk to get a higher gain or taking a lower but sure gain. Several studies have tested this assumption in rats, however the conclusion remains controversial because the previous real-world like gambling tasks contained a learning component to track a global payoff of probabilistic outcome in addition to risk preference. Therefore, we modified a simple gambling task allowing us to exclude such learning effect, and investigated the sex difference in risk preference of rats and its neural basis. The task required water deprived rats to choose between a risky option which provided four drops of water or no reward at a 50% random chance vs. a sure option which provided predictable amount x (x = 1, 2, 3, 4). The amount and the risk were explicitly instructed so that different choice conditions could be tested trial by trial without re-learning of reward contingency. Although both sexes correctly chose the sure option with the same level of accuracy when the sure option provided the best offer (x = 4), they exhibited different choice performances when two options had the same expected value (x = 2). Males and females both preferred to take risky choices than sure choices (risk seeking), but males were more risk seeking than females. Outcome-history analysis of their choice pattern revealed that females reduced their risk preference after losing risky choices, whereas males did not. Rather, as losses continued, reaction time for subsequent risky choices got shorter in males. Given that significant sex difference features mainly emerged after negative experiences, male and female rats may evaluate an unsuccessful outcome of their decision in different manners. Furthermore, c-Fos expression in the paraventricular nucleus of the thalamus (PV) was higher in the gambling task than for the control task in males while c-fos levels did not differ in females. The present study provides a clear evidence of sex differences in risk preference in rats and suggests that the PV is a candidate region contributing to sex differences in risky decision making. PMID:29692713

"Our Mystery Hero!" A Group Contingency Intervention for Reducing Verbally Disrespectful Behaviors

ERIC Educational Resources Information Center

Jones, Melissa; Boon, Richard T.; Fore, Cecil, III; Bender, William N.

2008-01-01

A reversal (ABAB) design was used to evaluate the effectiveness of a group contingency intervention on the verbally disrespectful behaviors of seven middle school students with specific learning disabilities and attention deficit disorders (ADHD) in a special education resource classroom setting for reading instruction. During the intervention…

Case 1; An Initial Study of Contingencies Applicable to Special Education.

ERIC Educational Resources Information Center

Cohen, Harold C.; And Others

The first CASE (Contingencies Applicable to Special Education) project, conducted from February to October 1965 with student inmates at the National Training School for Boys (NTSB), used environmental planning concepts and behavioral learning principles to restructure a basic education curriculum in terms of individual performance requirements,…

A New KE-Free Online ICALL System Featuring Error Contingent Feedback

ERIC Educational Resources Information Center

Tokuda, Naoyuki; Chen, Liang

2004-01-01

As a first step towards implementing a human language teacher, we have developed a new template-based on-line ICALL (intelligent computer assisted language learning) system capable of automatically diagnosing learners' free-format translated inputs and returning error contingent feedback. The system architecture we have adopted allows language…

Neuromodulation of reward-based learning and decision making in human aging

PubMed Central

Eppinger, Ben; Hämmerer, Dorothea; Li, Shu-Chen

2013-01-01

In this paper, we review the current literature to highlight relations between age-associated declines in dopaminergic and serotonergic neuromodulation and adult age differences in adaptive goal-directed behavior. Specifically, we focus on evidence suggesting that deficits in neuromodulation contribute to older adults’ behavioral disadvantages in learning and decision making. These deficits are particularly pronounced when reward information is uncertain or the task context requires flexible adaptations to changing stimulus–reward contingencies. Moreover, emerging evidence points to age-related differences in the sensitivity to rewarding and aversive outcomes during learning and decision making if the acquisition of behavior critically depends on outcome processing. These age-related asymmetries in outcome valuation may be explained by age differences in the interplay of dopaminergic and serotonergic neuromodulation. This hypothesis is based on recent neurocomputational and psychopharmacological approaches, which suggest that dopamine and serotonin serve opponent roles in regulating the balance between approach behavior and inhibitory control. Studying adaptive regulation of behavior across the adult life span may shed new light on how the aging brain changes functionally in response to its diminishing resources. PMID:22023564

A Contingency Model of Conflict and Team Effectiveness

ERIC Educational Resources Information Center

Shaw, Jason D.; Zhu, Jing; Duffy, Michelle K.; Scott, Kristin L.; Shih, Hsi-An; Susanto, Ely

2011-01-01

The authors develop and test theoretical extensions of the relationships of task conflict, relationship conflict, and 2 dimensions of team effectiveness (performance and team-member satisfaction) among 2 samples of work teams in Taiwan and Indonesia. Findings show that relationship conflict moderates the task conflict-team performance…

STS-65 Mission Specialist Chiao in EMU prepares for WETF contingency EVA

NASA Technical Reports Server (NTRS)

1994-01-01

STS-65 Mission Specialist Leroy Chiao, fully suited in an extravehicular mobility unit (EMU) and helmet, prepares to be lowered into a 25-feet deep pool at the Johnson Space Center's (JSC's) Weightless Environment Training Facility (WETF) Bldg 29. Chiao will practice door and latch contingency extravehicular activity (EVA) procedures once underwater. Mission Specialist Donald A. Thomas will join Chiao in the simulation. The two crewmates will be submerged and made to be neutrally buoyant in order to rehearse the contingency tasks that would require a spacewalk. No spacewalks are scheduled for the STS-65 International Microgravity Laboratory 2 (IML-2) mission.

STS-65 Mission Specialist Chiao in EMU prepares for WETF contingency EVA

NASA Technical Reports Server (NTRS)

1994-01-01

STS-65 Mission Specialist Leroy Chiao, fully suited in an extravehicular mobility unit (EMU) and helmet, stands on a platform and prepares to be lowered into a 25-feet deep pool at the Johnson Space Center's (JSC's) Weightless Environment Training Facility (WETF) Bldg 29. Chiao will practice door and latch contingency extravehicular activity (EVA) procedures once underwater. Mission Specialist Donald A. Thomas will join Chiao in the simulation. The two crewmates will be submerged and made to be neutrally buoyant in order to rehearse the contingency tasks that would require a spacewalk. No spacewalks are scheduled for the STS-65 International Microgravity Laboratory 2 (IML-2) mission.

The impact of reinforcement contingencies on AD/HD: a review and theoretical appraisal.

PubMed

Luman, Marjolein; Oosterlaan, Jaap; Sergeant, Joseph A

2005-02-01

One of the core deficits in attention deficit/hyperactivity disorder (AD/HD) is thought to be an aberrant sensitivity to reinforcement, such as reward and response cost. Twenty-two studies (N=1181 children) employing AD/HD and reinforcement contingencies are reviewed from vantage points: task performance, motivation, and psychophysiology. Results indicate that reinforcement contingencies have a positive impact on task performance and levels of motivation for both children with AD/HD and normal controls. There is evidence that the effect related to task performance is somewhat more prominent in AD/HD. There is some evidence that a high intensity of reinforcement is highly effective in AD/HD. Children with AD/HD prefer immediate over delayed reward. From a psychophysiological point of view, children with AD/HD seem less sensitive to reinforcement compared to controls. While comorbid disorders are suggested to be confounders of the dependent variables, many studies do not examine the effect of oppositional defiant disorder (ODD) and conduct disorder (CD). We discuss the implications of the findings for five theoretical frameworks, including the model by, the cognitive-energetic model (CEM), the dual-pathway model and the BIS/BAS model. Results show a discrepancy between the theoretical models and the behavioural findings.

Dissociating hippocampal and striatal contributions to sequential prediction learning

PubMed Central

Bornstein, Aaron M.; Daw, Nathaniel D.

2011-01-01

Behavior may be generated on the basis of many different kinds of learned contingencies. For instance, responses could be guided by the direct association between a stimulus and response, or by sequential stimulus-stimulus relationships (as in model-based reinforcement learning or goal-directed actions). However, the neural architecture underlying sequential predictive learning is not well-understood, in part because it is difficult to isolate its effect on choice behavior. To track such learning more directly, we examined reaction times (RTs) in a probabilistic sequential picture identification task. We used computational learning models to isolate trial-by-trial effects of two distinct learning processes in behavior, and used these as signatures to analyze the separate neural substrates of each process. RTs were best explained via the combination of two delta rule learning processes with different learning rates. To examine neural manifestations of these learning processes, we used functional magnetic resonance imaging to seek correlates of timeseries related to expectancy or surprise. We observed such correlates in two regions, hippocampus and striatum. By estimating the learning rates best explaining each signal, we verified that they were uniquely associated with one of the two distinct processes identified behaviorally. These differential correlates suggest that complementary anticipatory functions drive each region's effect on behavior. Our results provide novel insights as to the quantitative computational distinctions between medial temporal and basal ganglia learning networks and enable experiments that exploit trial-by-trial measurement of the unique contributions of both hippocampus and striatum to response behavior. PMID:22487032

Causal uncertainty, claimed and behavioural self-handicapping.

PubMed

Thompson, Ted; Hepburn, Jonathan

2003-06-01

Causal uncertainty beliefs involve doubts about the causes of events, and arise as a consequence of non-contingent evaluative feedback: feedback that leaves the individual uncertain about the causes of his or her achievement outcomes. Individuals high in causal uncertainty are frequently unable to confidently attribute their achievement outcomes, experience anxiety in achievement situations and as a consequence are likely to engage in self-handicapping behaviour. Accordingly, we sought to establish links between trait causal uncertainty, claimed and behavioural self-handicapping. Participants were N=72 undergraduate students divided equally between high and low causally uncertain groups. We used a 2 (causal uncertainty status: high, low) x 3 (performance feedback condition: success, non-contingent success, non-contingent failure) between-subjects factorial design to examine the effects of causal uncertainty on achievement behaviour. Following performance feedback, participants completed 20 single-solution anagrams and 12 remote associate tasks serving as performance measures, and 16 unicursal tasks to assess practice effort. Participants also completed measures of claimed handicaps, state anxiety and attributions. Relative to low causally uncertain participants, high causally uncertain participants claimed more handicaps prior to performance on the anagrams and remote associates, reported higher anxiety, attributed their failure to internal, stable factors, and reduced practice effort on the unicursal tasks, evident in fewer unicursal tasks solved. These findings confirm links between trait causal uncertainty and claimed and behavioural self-handicapping, highlighting the need for educators to facilitate means by which students can achieve surety in the manner in which they attribute the causes of their achievement outcomes.

Effects of reward and punishment on learning from errors in smokers.

PubMed

Duehlmeyer, Leonie; Levis, Bianca; Hester, Robert

2018-04-30

Punishing errors facilitates adaptation in healthy individuals, while aberrant reward and punishment sensitivity in drug-dependent individuals may change this impact. Many societies have institutions that use the concept of punishing drug use behavior, making it important to understand how drug dependency mediates the effects of negative feedback for influencing adaptive behavior. Using an associative learning task, we investigated differences in error correction rates of dependent smokers, compared with controls. Two versions of the task were administered to different participant samples: One assessed the effect of varying monetary contingencies to task performance, the other, the presence of reward as compared to avoidance of punishment for correct performance. While smokers recalled associations that were rewarded with a higher value 11% more often than lower rewarded locations, they did not correct higher punished locations more often. Controls exhibited the opposite pattern. The three-way interaction between magnitude, feedback type and group was significant, F(1,48) = 5.288, p =0.026, ɳ 2 p =0.099. Neither participant group corrected locations offering reward more often than those offering avoidances of punishment. The interaction between group and feedback condition was not significant, F(1,58) = 0.0, p =0.99, ɳ 2 p =0.001. The present results suggest that smokers have poorer learning from errors when receiving negative feedback. Moreover, larger rewards reinforce smokers' behavior stronger than smaller rewards, whereas controls made no distinction. These findings support the hypothesis that dependent smokers may respond to positively framed and rewarded anti-smoking programs when compared to those relying on negative feedback or punishment. Copyright © 2018 Elsevier B.V. All rights reserved.

Contingency Planning for Planetary Rovers

NASA Technical Reports Server (NTRS)

Dearden, Richard; Meuleau, Nicolas; Ramakrishnan, Sailesh; Smith, David; Washington, Rich; Clancy, Daniel (Technical Monitor)

2002-01-01

There has been considerable work in AI on planning under uncertainty. But this work generally assumes an extremely simple model of action that does not consider continuous time and resources. These assumptions are not reasonable for a Mars rover, which must cope with uncertainty about the duration of tasks, the power required, the data storage necessary, along with its position and orientation. In this paper, we outline an approach to generating contingency plans when the sources of uncertainty involve continuous quantities such as time and resources. The approach involves first constructing a "seed" plan, and then incrementally adding contingent branches to this plan in order to improve utility. The challenge is to figure out the best places to insert contingency branches. This requires an estimate of how much utility could be gained by building a contingent branch at any given place in the seed plan. Computing this utility exactly is intractable, but we outline an approximation method that back propagates utility distributions through a graph structure similar to that of a plan graph.

Incremental Contingency Planning

NASA Technical Reports Server (NTRS)

Dearden, Richard; Meuleau, Nicolas; Ramakrishnan, Sailesh; Smith, David E.; Washington, Rich

2003-01-01

There has been considerable work in AI on planning under uncertainty. However, this work generally assumes an extremely simple model of action that does not consider continuous time and resources. These assumptions are not reasonable for a Mars rover, which must cope with uncertainty about the duration of tasks, the energy required, the data storage necessary, and its current position and orientation. In this paper, we outline an approach to generating contingency plans when the sources of uncertainty involve continuous quantities such as time and resources. The approach involves first constructing a "seed" plan, and then incrementally adding contingent branches to this plan in order to improve utility. The challenge is to figure out the best places to insert contingency branches. This requires an estimate of how much utility could be gained by building a contingent branch at any given place in the seed plan. Computing this utility exactly is intractable, but we outline an approximation method that back propagates utility distributions through a graph structure similar to that of a plan graph.

Application of Energy Function as a Measure of Error in the Numerical Solution for Online Transient Stability Assessment

NASA Astrophysics Data System (ADS)

Sarojkumar, K.; Krishna, S.

2016-08-01

Online dynamic security assessment (DSA) is a computationally intensive task. In order to reduce the amount of computation, screening of contingencies is performed. Screening involves analyzing the contingencies with the system described by a simpler model so that computation requirement is reduced. Screening identifies those contingencies which are sure to not cause instability and hence can be eliminated from further scrutiny. The numerical method and the step size used for screening should be chosen with a compromise between speed and accuracy. This paper proposes use of energy function as a measure of error in the numerical solution used for screening contingencies. The proposed measure of error can be used to determine the most accurate numerical method satisfying the time constraint of online DSA. Case studies on 17 generator system are reported.

Increased anterior cingulate cortex response precedes behavioural adaptation in anorexia nervosa

PubMed Central

Geisler, Daniel; Ritschel, Franziska; King, Joseph A.; Bernardoni, Fabio; Seidel, Maria; Boehm, Ilka; Runge, Franziska; Goschke, Thomas; Roessner, Veit; Smolka, Michael N.; Ehrlich, Stefan

2017-01-01

Patients with anorexia nervosa (AN) are characterised by increased self-control, cognitive rigidity and impairments in set-shifting, but the underlying neural mechanisms are poorly understood. Here we used functional magnetic resonance imaging (fMRI) to elucidate the neural correlates of behavioural adaptation to changes in reward contingencies in young acutely ill AN patients. Thirty-six adolescent/young adult, non-chronic female AN patients and 36 age-matched healthy females completed a well-established probabilistic reversal learning task during fMRI. We analysed hemodynamic responses in empirically-defined regions of interest during positive feedback and negative feedback not followed/followed by behavioural adaptation and conducted functional connectivity analyses. Although overall task performance was comparable between groups, AN showed increased shifting after receiving negative feedback (lose-shift behaviour) and altered dorsal anterior cingulate cortex (dACC) responses as a function of feedback. Specifically, patients had increased dACC responses (which correlated with perfectionism) and task-related coupling with amygdala preceding behavioural adaption. Given the generally preserved task performance in young AN, elevated dACC responses specifically during behavioural adaption is suggestive of increased monitoring for the need to adjust performance strategies. Higher dACC-amygdala coupling and increased adaptation after negative feedback underlines this interpretation and could be related to intolerance of uncertainty which has been suggested for AN. PMID:28198813

Feedback-related negativity codes outcome valence, but not outcome expectancy, during reversal learning.

PubMed

von Borries, A K L; Verkes, R J; Bulten, B H; Cools, R; de Bruijn, E R A

2013-12-01

Optimal behavior depends on the ability to assess the predictive value of events and to adjust behavior accordingly. Outcome processing can be studied by using its electrophysiological signatures--that is, the feedback-related negativity (FRN) and the P300. A prominent reinforcement-learning model predicts an FRN on negative prediction errors, as well as implying a role for the FRN in learning and the adaptation of behavior. However, these predictions have recently been challenged. Notably, studies so far have used tasks in which the outcomes have been contingent on the response. In these paradigms, the need to adapt behavioral responses is present only for negative, not for positive feedback. The goal of the present study was to investigate the effects of positive as well as negative violations of expectancy on FRN amplitudes, without the usual confound of behavioral adjustments. A reversal-learning task was employed in which outcome value and outcome expectancy were orthogonalized; that is, both positive and negative outcomes were equally unexpected. The results revealed a double dissociation, with effects of valence but not expectancy on the FRN and, conversely, effects of expectancy but not valence on the P300. While FRN amplitudes were largest for negative-outcome trials, irrespective of outcome expectancy, P300 amplitudes were largest for unexpected-outcome trials, irrespective of outcome valence. These FRN effects were interpreted to reflect an evaluation along a good-bad dimension, rather than reflecting a negative prediction error or a role in behavioral adaptation. By contrast, the P300 reflects the updating of information relevant for behavior in a changing context.

Implicit reward associations impact face processing: Time-resolved evidence from event-related brain potentials and pupil dilations.

PubMed

Hammerschmidt, Wiebke; Kagan, Igor; Kulke, Louisa; Schacht, Annekathrin

2018-06-22

The present study aimed at investigating whether associated motivational salience causes preferential processing of inherently neutral faces similar to emotional expressions by means of event-related brain potentials (ERPs) and changes of the pupil size. To this aim, neutral faces were implicitly associated with monetary outcome, while participants (N = 44) performed a masked prime face-matching task that ensured performance around chance level and thus an equal proportion of gain, loss, and zero outcomes. Motivational context strongly impacted the processing of the fixation, prime and mask stimuli prior to the target face, indicated by enhanced amplitudes of subsequent ERP components and increased pupil size. In a separate test session, previously associated faces as well as novel faces with emotional expressions were presented within the same task but without motivational context and performance feedback. Most importantly, previously gain-associated faces amplified the LPC, although the individually contingent face-outcome assignments were not made explicit during the learning session. Emotional expressions impacted the N170 and EPN components. Modulations of the pupil size were absent in both motivationally-associated and emotional conditions. Our findings demonstrate that neural representations of neutral stimuli can acquire increased salience via implicit learning, with an advantage for gain over loss associations. Copyright © 2018. Published by Elsevier Inc.

Completable scheduling: An integrated approach to planning and scheduling

NASA Technical Reports Server (NTRS)

Gervasio, Melinda T.; Dejong, Gerald F.

1992-01-01

The planning problem has traditionally been treated separately from the scheduling problem. However, as more realistic domains are tackled, it becomes evident that the problem of deciding on an ordered set of tasks to achieve a set of goals cannot be treated independently of the problem of actually allocating resources to the tasks. Doing so would result in losing the robustness and flexibility needed to deal with imperfectly modeled domains. Completable scheduling is an approach which integrates the two problems by allowing an a priori planning module to defer particular planning decisions, and consequently the associated scheduling decisions, until execution time. This allows a completable scheduling system to maximize plan flexibility by allowing runtime information to be taken into consideration when making planning and scheduling decision. Furthermore, through the criteria of achievability placed on deferred decision, a completable scheduling system is able to retain much of the goal-directedness and guarantees of achievement afforded by a priori planning. The completable scheduling approach is further enhanced by the use of contingent explanation-based learning, which enables a completable scheduling system to learn general completable plans from example and improve its performance through experience. Initial experimental results show that completable scheduling outperforms classical scheduling as well as pure reactive scheduling in a simple scheduling domain.

Anterior prefrontal cortex contributes to action selection through tracking of recent reward trends

PubMed Central

Kovach, Christopher K.; Daw, Nathaniel; Rudrauf, David; Tranel, Daniel; O’Doherty, John P.; Adolphs, Ralph

2012-01-01

The functions of prefrontal cortex remain enigmatic, especially so for its anterior sectors, putatively ranging from planning to self-initiated behavior, social cognition, task-switching and memory. A predominant current theory regarding the most anterior sector, frontopolar cortex (FPC), is that it is involved in exploring alternate courses of action, but the detailed causal mechanisms remain unknown. Here we investigated this issue using the lesion method together with a novel model-based analysis. Eight patients with anterior prefrontal brain lesions including the FPC performed a 4-armed bandit task known from neuroimaging studies to activate FPC. Model-based analyses of learning demonstrated a selective deficit in the ability to extrapolate the most recent trend, despite an intact general ability to learn from past rewards. Whereas both brain-damaged and healthy controls used comparisons between the two most recent choice outcomes to infer trends that influenced their decision about the next choice, the group with anterior prefrontal lesions showed a complete absence of this component and instead based their choice entirely on the cumulative reward history. Given that the FPC is thought to be the most evolutionarily recent expansion of primate prefrontal cortex, we suggest that its function may reflect uniquely human adaptations to select and update models of reward contingency in dynamic environments. PMID:22723683

"Learned Helplessness" or "Learned Incompetence"?

ERIC Educational Resources Information Center

Sergent, Justine; Lambert, Wallace E.

Studies in the past have shown that reinforcements independent of the subjects actions may induce a feeling of helplessness. Most experiments on learned helplessness have led researchers to believe that uncontrollability (non-contingency of feedback upon response) was the determining feature of learned helplessness, although in most studies…

Hippocampal theta activity is selectively associated with contingency detection but not discrimination in rabbit discrimination-reversal eyeblink conditioning.

PubMed

Nokia, Miriam S; Wikgren, Jan

2010-04-01

The relative power of the hippocampal theta-band ( approximately 6 Hz) activity (theta ratio) is thought to reflect a distinct neural state and has been shown to affect learning rate in classical eyeblink conditioning in rabbits. We sought to determine if the theta ratio is mostly related to the detection of the contingency between the stimuli used in conditioning or also to the learning of more complex inhibitory associations when a highly demanding delay discrimination-reversal eyeblink conditioning paradigm is used. A high hippocampal theta ratio was not only associated with a fast increase in conditioned responding in general but also correlated with slow emergence of discriminative responding due to sustained responding to the conditioned stimulus not paired with an unconditioned stimulus. The results indicate that the neural state reflected by the hippocampal theta ratio is specifically linked to forming associations between stimuli rather than to the learning of inhibitory associations needed for successful discrimination. This is in line with the view that the hippocampus is responsible for contingency detection in the early phase of learning in eyeblink conditioning. (c) 2009 Wiley-Liss, Inc.

The Role of Contingency Awareness in Single-Cue Human Eyeblink Conditioning

ERIC Educational Resources Information Center

Weidemann, Gabrielle; Best, Erin; Lee, Jessica C; Lovibond, Peter F.

2013-01-01

Single-cue delay eyeblink conditioning is presented as a prototypical example of automatic, nonsymbolic learning that is carried out by subcortical circuits. However, it has been difficult to assess the role of cognition in single-cue conditioning because participants become aware of the simple stimulus contingency so quickly. In this experiment…

Implementing a Group Contingency Behavior-Management System in Physical Education

ERIC Educational Resources Information Center

Healy, Sean; Hirsch, Shanna E.; Lloyd, John W.

2017-01-01

Behavior management issues may impede learning in physical education (PE), yet there is a paucity of evidence-based behavior-management programs studied in the PE environment to assist PE teachers to be better prepared to handle these issues. Classwide-function intervention teams (CW-FIT) is a group contingency procedure for managing student…

Contingent capture of involuntary visual attention interferes with detection of auditory stimuli

PubMed Central

Kamke, Marc R.; Harris, Jill

2014-01-01

The involuntary capture of attention by salient visual stimuli can be influenced by the behavioral goals of an observer. For example, when searching for a target item, irrelevant items that possess the target-defining characteristic capture attention more strongly than items not possessing that feature. Such contingent capture involves a shift of spatial attention toward the item with the target-defining characteristic. It is not clear, however, if the associated decrements in performance for detecting the target item are entirely due to involuntary orienting of spatial attention. To investigate whether contingent capture also involves a non-spatial interference, adult observers were presented with streams of visual and auditory stimuli and were tasked with simultaneously monitoring for targets in each modality. Visual and auditory targets could be preceded by a lateralized visual distractor that either did, or did not, possess the target-defining feature (a specific color). In agreement with the contingent capture hypothesis, target-colored distractors interfered with visual detection performance (response time and accuracy) more than distractors that did not possess the target color. Importantly, the same pattern of results was obtained for the auditory task: visual target-colored distractors interfered with sound detection. The decrement in auditory performance following a target-colored distractor suggests that contingent capture involves a source of processing interference in addition to that caused by a spatial shift of attention. Specifically, we argue that distractors possessing the target-defining characteristic enter a capacity-limited, serial stage of neural processing, which delays detection of subsequently presented stimuli regardless of the sensory modality. PMID:24920945

Contingent capture of involuntary visual attention interferes with detection of auditory stimuli.

PubMed

Kamke, Marc R; Harris, Jill

2014-01-01

The involuntary capture of attention by salient visual stimuli can be influenced by the behavioral goals of an observer. For example, when searching for a target item, irrelevant items that possess the target-defining characteristic capture attention more strongly than items not possessing that feature. Such contingent capture involves a shift of spatial attention toward the item with the target-defining characteristic. It is not clear, however, if the associated decrements in performance for detecting the target item are entirely due to involuntary orienting of spatial attention. To investigate whether contingent capture also involves a non-spatial interference, adult observers were presented with streams of visual and auditory stimuli and were tasked with simultaneously monitoring for targets in each modality. Visual and auditory targets could be preceded by a lateralized visual distractor that either did, or did not, possess the target-defining feature (a specific color). In agreement with the contingent capture hypothesis, target-colored distractors interfered with visual detection performance (response time and accuracy) more than distractors that did not possess the target color. Importantly, the same pattern of results was obtained for the auditory task: visual target-colored distractors interfered with sound detection. The decrement in auditory performance following a target-colored distractor suggests that contingent capture involves a source of processing interference in addition to that caused by a spatial shift of attention. Specifically, we argue that distractors possessing the target-defining characteristic enter a capacity-limited, serial stage of neural processing, which delays detection of subsequently presented stimuli regardless of the sensory modality.

The effects of reinforcement and response-cost on a delayed response task in children with attention deficit hyperactivity disorder: a research note.

PubMed

Solanto, M V

1990-07-01

Children with attention deficit hyperactivity disorder are more inattentive, active, and impulsive than normal children. Some researchers have postulated that these symptoms can all be explained as a result of reduced sensitivity to reinforcement. In order to evaluate this hypothesis, we tested 20 ADD-H children and 18 matched normal controls, 4 1/2-11 years of age, on a delayed response task, a measure of impulsiveness, under conditions of positive reinforcement, and punishment in the form of response-cost. The contingencies each improved performance compared to baseline but did not differ significantly from each other. Neither contingency affected the groups differentially, thus failing to provide support for the reinforcement hypothesis.

Touchscreen assays of learning, response inhibition, and motivation in the marmoset (Callithrix jacchus).

PubMed

Kangas, Brian D; Bergman, Jack; Coyle, Joseph T

2016-05-01

Recent developments in precision gene editing have led to the emergence of the marmoset as an experimental subject of considerable interest and translational value. A better understanding of behavioral phenotypes of the common marmoset will inform the extent to which forthcoming transgenic mutants are cognitively intact. Therefore, additional information regarding their learning, inhibitory control, and motivational abilities is needed. The present studies used touchscreen-based repeated acquisition and discrimination reversal tasks to examine basic dimensions of learning and response inhibition. Marmosets were trained daily to respond to one of the two simultaneously presented novel stimuli. Subjects learned to discriminate the two stimuli (acquisition) and, subsequently, with the contingencies switched (reversal). In addition, progressive ratio performance was used to measure the effort expended to obtain a highly palatable reinforcer varying in magnitude and, thereby, provide an index of relative motivational value. Results indicate that rates of both acquisition and reversal of novel discriminations increased across successive sessions, but that rate of reversal learning remained slower than acquisition learning, i.e., more trials were needed for mastery. A positive correlation was observed between progressive ratio break point and reinforcement magnitude. These results closely replicate previous findings with squirrel monkeys, thus providing evidence of similarity in learning processes across nonhuman primate species. Moreover, these data provide key information about the normative phenotype of wild-type marmosets using three relevant behavioral endpoints.

Dissociations among judgments do not reflect cognitive priority: an associative explanation of memory for frequency information in contingency learning.

PubMed

Vadillo, Miguel A; Luque, David

2013-03-01

Previous research on causal learning has usually made strong claims about the relative complexity and temporal priority of some processes over others based on evidence about dissociations between several types of judgments. In particular, it has been argued that the dissociation between causal judgments and trial-type frequency information is incompatible with the general cognitive architecture proposed by associative models. In contrast with this view, we conduct an associative analysis of this process showing that this need not be the case. We conclude that any attempt to gain a better insight on the cognitive architecture involved in contingency learning cannot rely solely on data about these dissociations.

Instrumental learning and cognitive flexibility processes are impaired in children exposed to early life stress.

PubMed

Harms, Madeline B; Shannon Bowen, Katherine E; Hanson, Jamie L; Pollak, Seth D

2017-10-19

Children who experience severe early life stress show persistent deficits in many aspects of cognitive and social adaptation. Early stress might be associated with these broad changes in functioning because it impairs general learning mechanisms. To explore this possibility, we examined whether individuals who experienced abusive caregiving in childhood had difficulties with instrumental learning and/or cognitive flexibility as adolescents. Fifty-three 14-17-year-old adolescents (31 exposed to high levels of childhood stress, 22 control) completed an fMRI task that required them to first learn associations in the environment and then update those pairings. Adolescents with histories of early life stress eventually learned to pair stimuli with both positive and negative outcomes, but did so more slowly than their peers. Furthermore, these stress-exposed adolescents showed markedly impaired cognitive flexibility; they were less able than their peers to update those pairings when the contingencies changed. These learning problems were reflected in abnormal activity in learning- and attention-related brain circuitry. Both altered patterns of learning and neural activation were associated with the severity of lifetime stress that the adolescents had experienced. Taken together, the results of this experiment suggest that basic learning processes are impaired in adolescents exposed to early life stress. These general learning mechanisms may help explain the emergence of social problems observed in these individuals. © 2017 The Authors. Developmental Science Published by John Wiley & Sons Ltd.

Do endogenous and exogenous action control compete for perception?

PubMed

Pfister, Roland; Heinemann, Alexander; Kiesel, Andrea; Thomaschke, Roland; Janczyk, Markus

2012-04-01

Human actions are guided either by endogenous action plans or by external stimuli in the environment. These two types of action control seem to be mediated by neurophysiologically and functionally distinct systems that interfere if an endogenously planned action suddenly has to be performed in response to an exogenous stimulus. In this case, the endogenous representation has to be deactivated first to give way to the exogenous system. Here we show that interference of endogenous and exogenous action control is not limited to motor-related aspects but also affects the perception of action-related stimuli. Participants associated two actions with contingent sensory effects in learning blocks. In subsequent test blocks, preparing one of these actions specifically impaired responding to the associated effect in an exogenous speeded detection task, yielding a blindness-like effect for arbitrary, learned action effects. In accordance with the theory of event coding, this finding suggests that action planning influences perception even in the absence of any physical similarities between action and to-be-perceived stimuli.

On the generality of the displaywide contingent orienting hypothesis: can a visual onset capture attention without top-down control settings for displaywide onset?

PubMed

Yeh, Su-Ling; Liao, Hsin-I

2010-10-01

The contingent orienting hypothesis (Folk, Remington, & Johnston, 1992) states that attentional capture is contingent on top-down control settings induced by task demands. Past studies supporting this hypothesis have identified three kinds of top-down control settings: for target-specific features, for the strategy to search for a singleton, and for visual features in the target display as a whole. Previously, we have found stimulus-driven capture by onset that was not contingent on the first two kinds of settings (Yeh & Liao, 2008). The current study aims to test the third kind: the displaywide contingent orienting hypothesis (Gibson & Kelsey, 1998). Specifically, we ask whether an onset stimulus can still capture attention in the spatial cueing paradigm when attentional control settings for the displaywide onset of the target are excluded by making all letters in the target display emerge from placeholders. Results show that a preceding uninformative onset cue still captured attention to its location in a stimulus-driven fashion, whereas a color cue captured attention only when it was contingent on the setting for displaywide color. These results raise doubts as to the generality of the displaywide contingent orienting hypothesis and help delineate the boundary conditions on this hypothesis. Copyright © 2010 Elsevier B.V. All rights reserved.

Dynamics of task sets: evidence from dense-array event-related potentials.

PubMed

Poulsen, Catherine; Luu, Phan; Davey, Colin; Tucker, Don M

2005-06-01

Prior research suggests that task sets facilitate coherent, goal-directed behavior by providing an internal, contextual frame that biases selection toward context-relevant stimulus attributes and responses. Questions about how task sets are engaged, maintained, and shifted have recently become a major focus of research on executive control processes. We employed dense-array (128-channel) event-related potential (ERP) methodology to examine the dynamics of brain systems engaged during the preparation and implementation of task switching. The EEG was recorded while participants performed letter and digit judgments to pseudorandomly-ordered, univalent (#3, A%) and bivalent (G5) stimulus trials, with the appropriate task cued by a colored rectangle presented 450 ms before target onset. Results revealed spatial and temporal variations in brain activity that could be related to preparatory processes common to both switch and repeat trials, switch-specific control processes engaged to reconfigure and maintain task set under conflict, and visual priming benefits of task repetition. Despite extensive practice and improvement, both behavioral and ERP results indicated that subjects maintained high levels of executive control processing with extended task engagement. The patterns of ERP activity obtained in the present study fit well with functional neuroanatomical models of self-regulation of action. The frontopolar and right-lateralized frontal switch effects obtained in the present study are consistent with the role of these regions in adapting to changing contextual contingencies. In contrast, the centroparietal P3b and N384 effects related to the contextual ambiguity of bivalent trials are consistent with the context monitoring and updating functions associated with the posterior cingulate learning circuit.

Progressing from programmatic to discovery research: a case example with the overjustification effect.

PubMed

Roane, Henry S; Fisher, Wayne W; McDonough, Erin M

2003-01-01

Scientific research progresses along planned (programmatic research) and unplanned (discovery research) paths. In the current investigation, we attempted to conduct a single-case evaluation of the overjustification effect (i.e., programmatic research). Results of the initial analysis were contrary to the overjustification hypothesis in that removal of the reward contingency produced an increase in responding. Based on this unexpected finding, we conducted subsequent analyses to further evaluate the mechanisms underlying these results (i.e., discovery research). Results of the additional analyses suggested that the reward contingency functioned as punishment (because the participant preferred the task to the rewards) and that withdrawal of the contingency produced punishment contrast.

Progressing from programmatic to discovery research: a case example with the overjustification effect.

PubMed Central

Roane, Henry S; Fisher, Wayne W; McDonough, Erin M

2003-01-01

Scientific research progresses along planned (programmatic research) and unplanned (discovery research) paths. In the current investigation, we attempted to conduct a single-case evaluation of the overjustification effect (i.e., programmatic research). Results of the initial analysis were contrary to the overjustification hypothesis in that removal of the reward contingency produced an increase in responding. Based on this unexpected finding, we conducted subsequent analyses to further evaluate the mechanisms underlying these results (i.e., discovery research). Results of the additional analyses suggested that the reward contingency functioned as punishment (because the participant preferred the task to the rewards) and that withdrawal of the contingency produced punishment contrast. PMID:12723865

Capturing Safety Requirements to Enable Effective Task Allocation Between Humans and Automaton in Increasingly Autonomous Systems

NASA Technical Reports Server (NTRS)

Neogi, Natasha A.

2016-01-01

There is a current drive towards enabling the deployment of increasingly autonomous systems in the National Airspace System (NAS). However, shifting the traditional roles and responsibilities between humans and automation for safety critical tasks must be managed carefully, otherwise the current emergent safety properties of the NAS may be disrupted. In this paper, a verification activity to assess the emergent safety properties of a clearly defined, safety critical, operational scenario that possesses tasks that can be fluidly allocated between human and automated agents is conducted. Task allocation role sets were proposed for a human-automation team performing a contingency maneuver in a reduced crew context. A safety critical contingency procedure (engine out on takeoff) was modeled in the Soar cognitive architecture, then translated into the Hybrid Input Output formalism. Verification activities were then performed to determine whether or not the safety properties held over the increasingly autonomous system. The verification activities lead to the development of several key insights regarding the implicit assumptions on agent capability. It subsequently illustrated the usefulness of task annotations associated with specialized requirements (e.g., communication, timing etc.), and demonstrated the feasibility of this approach.

Organisational Learning as an Emerging Process: The Generative Role of Digital Tools in Informal Learning Practices

ERIC Educational Resources Information Center

Za, Stefano; Spagnoletti, Paolo; North-Samardzic, Andrea

2014-01-01

Increasing attention is paid to organisational learning, with the success of contemporary organisations strongly contingent on their ability to learn and grow. Importantly, informal learning is argued to be even more significant than formal learning initiatives. Given the widespread use of digital technologies in the workplace, what requires…

Task Characteristics, Structural Characteristics, Organizational Relationships, and Communication Processes: A Contingency Approach to Job Performance. Phase III.

ERIC Educational Resources Information Center

Petelle, John L.; Garthright-Petelle, Kathleen

A study examined the relationships between (1) employee job performance and organizational relationships, (2) employee job performance and communication processes, (3) organizational relationships and communication processes, and (4) task characteristics and structural characteristics. Data were gathered from approximately 200 employees of a state…

Valuing the Implementation of Financial Literacy Education

ERIC Educational Resources Information Center

Davis, Kimberlee; Durband, Dorothy Bagwell

2008-01-01

Placing a monetary value on education is a complex task. A more difficult task is to determine at what monetary level individuals will support educational improvements. The contingent valuation method was used to estimate the value of the implementation of financial literacy education in Texas public schools. A Web-based survey was administered to…

Evaluating the Separate and Combined Effects of Positive and Negative Reinforcement on Task Compliance

ERIC Educational Resources Information Center

Bouxsein, Kelly J.; Roane, Henry S.; Harper, Tara

2011-01-01

Positive and negative reinforcement are effective for treating escape-maintained destructive behavior. The current study evaluated the separate and combined effects of these contingencies to increase task compliance. Results showed that a combination of positive and negative reinforcement was most effective for increasing compliance. (Contains 1…

Simple gaze-contingent cues guide eye movements in a realistic driving simulator

NASA Astrophysics Data System (ADS)

Pomarjanschi, Laura; Dorr, Michael; Bex, Peter J.; Barth, Erhardt

2013-03-01

Looking at the right place at the right time is a critical component of driving skill. Therefore, gaze guidance has the potential to become a valuable driving assistance system. In previous work, we have already shown that complex gaze-contingent stimuli can guide attention and reduce the number of accidents in a simple driving simulator. We here set out to investigate whether cues that are simple enough to be implemented in a real car can also capture gaze during a more realistic driving task in a high-fidelity driving simulator. We used a state-of-the-art, wide-field-of-view driving simulator with an integrated eye tracker. Gaze-contingent warnings were implemented using two arrays of light-emitting diodes horizontally fitted below and above the simulated windshield. Thirteen volunteering subjects drove along predetermined routes in a simulated environment popu­ lated with autonomous traffic. Warnings were triggered during the approach to half of the intersections, cueing either towards the right or to the left. The remaining intersections were not cued, and served as controls. The analysis of the recorded gaze data revealed that the gaze-contingent cues did indeed have a gaze guiding effect, triggering a significant shift in gaze position towards the highlighted direction. This gaze shift was not accompanied by changes in driving behaviour, suggesting that the cues do not interfere with the driving task itself.

Contingencies in Mother-Child Teaching Interactions and Behavioral Regulation and Dysregulation in Early Childhood

ERIC Educational Resources Information Center

Lunkenheimer, Erika S.; Kemp, Christine J.; Albrecht, Erin C.

2013-01-01

Predictable patterns in early parent-child interactions may help lay the foundation for how children learn to self-regulate. The present study examined contingencies between maternal teaching and directives and child compliance in mother-child problem-solving interactions at age 3.5 and whether they predicted children's behavioral regulation and…

Interoceptive fear conditioning and panic disorder: the role of conditioned stimulus-unconditioned stimulus predictability.

PubMed

Acheson, Dean T; Forsyth, John P; Moses, Erica

2012-03-01

Interoceptive fear conditioning is at the core of contemporary behavioral accounts of panic disorder. Yet, to date only one study has attempted to evaluate interoceptive fear conditioning in humans (see Acheson, Forsyth, Prenoveau, & Bouton, 2007). That study used brief (physiologically inert) and longer-duration (panicogenic) inhalations of 20% CO(2)-enriched air as an interoceptive conditioned (CS) and unconditioned (US) stimulus and evaluated fear learning in three conditions: CS only, CS-US paired, and CS-US unpaired. Results showed fear conditioning in the paired condition, and fearful responding and resistance to extinction in an unpaired condition. The authors speculated that such effects may be due to difficulty discriminating between the CS and the US. The aims of the present study are to (a) replicate and expand this line of work using an improved methodology, and (b) clarify the role of CS-US discrimination difficulties in either potentiating or depotentiating fear learning. Healthy participants (N=104) were randomly assigned to one of four conditions: (a) CS only, (b) contingent CS-US pairings, (c) unpaired CS and US presentations, or (d) an unpaired "discrimination" contingency, which included an exteroceptive discrimination cue concurrently with CS onset. Electrodermal and self-report ratings served as indices of conditioned responding. Consistent with expectation, the paired contingency and unpaired contingencies yielded elevated fearful responding to the CS alone. Moreover, adding a discrimination cue to the unpaired contingency effectively attenuated fearful responding. Overall, findings are consistent with modern learning theory accounts of panic and highlight the role of interoceptive conditioning and unpredictability in the etiology of panic disorder. Copyright © 2011. Published by Elsevier Ltd.

Modeling the Transition from a Phenotypic to Genotypic Conceptualization of Genetics in a University-Level Introductory Biology Context

NASA Astrophysics Data System (ADS)

Todd, Amber; Romine, William L.; Correa-Menendez, Josefina

2017-07-01

Identifying contingencies between constructs in a multi-faceted learning progression (LP) is a challenging task. Often, there is not enough evidence in the literature to support connections, and once identified, they are difficult to empirically test. Here, we use causal model search to evaluate how connections between ideas in a genetics LP change over time in the context of an introductory biology course. We identify primary and secondary hub ideas and connections between concepts before and after instruction to illustrate how students moved from a phenotypic grounding of genetics knowledge to a more genotypic grounding of their genetics knowledge after instruction. We discuss our results in light of conceptual change and illustrate the importance of understanding students' idea structures within a domain.

Blur Detection is Unaffected by Cognitive Load.

PubMed

Loschky, Lester C; Ringer, Ryan V; Johnson, Aaron P; Larson, Adam M; Neider, Mark; Kramer, Arthur F

2014-03-01

Blur detection is affected by retinal eccentricity, but is it also affected by attentional resources? Research showing effects of selective attention on acuity and contrast sensitivity suggests that allocating attention should increase blur detection. However, research showing that blur affects selection of saccade targets suggests that blur detection may be pre-attentive. To investigate this question, we carried out experiments in which viewers detected blur in real-world scenes under varying levels of cognitive load manipulated by the N -back task. We used adaptive threshold estimation to measure blur detection thresholds at 0°, 3°, 6°, and 9° eccentricity. Participants carried out blur detection as a single task, a single task with to-be-ignored letters, or an N-back task with four levels of cognitive load (0, 1, 2, or 3-back). In Experiment 1, blur was presented gaze-contingently for occasional single eye fixations while participants viewed scenes in preparation for an easy picture recognition memory task, and the N -back stimuli were presented auditorily. The results for three participants showed a large effect of retinal eccentricity on blur thresholds, significant effects of N -back level on N -back performance, scene recognition memory, and gaze dispersion, but no effect of N -back level on blur thresholds. In Experiment 2, we replicated Experiment 1 but presented the images tachistoscopically for 200 ms (half with, half without blur), to determine whether gaze-contingent blur presentation in Experiment 1 had produced attentional capture by blur onset during a fixation, thus eliminating any effect of cognitive load on blur detection. The results with three new participants replicated those of Experiment 1, indicating that the use of gaze-contingent blur presentation could not explain the lack of effect of cognitive load on blur detection. Thus, apparently blur detection in real-world scene images is unaffected by attentional resources, as manipulated by the cognitive load produced by the N -back task.

Differences in Sustained Attention Capacity as a Function of Aerobic Fitness.

PubMed

Luque-Casado, Antonio; Perakakis, Pandelis; Hillman, Charles H; Kao, Shih-Chun; Llorens, Francesc; Guerra, Pedro; Sanabria, Daniel

2016-05-01

We investigated the relationship between aerobic fitness and sustained attention capacity by comparing task performance and brain function, by means of event-related potentials (ERP), in high- and low-fit young adults. Two groups of participants (22 higher-fit and 20 lower-fit) completed a 60-min version of the Psychomotor Vigilance Task (PVT). Behavioral (i.e., reaction time) and electrophysiological (ERP) (i.e., contingent negative variation and P3) were obtained and analyzed as a function of time-on-task. A submaximal cardiorespiratory fitness test confirmed the between-groups difference in terms of aerobic fitness. The results revealed shorter reaction time in higher-fit than in lower-fit participants in the first 36 min of the task. This was accompanied by larger contingent negative variation amplitude in the same period of the task in higher-fit than in lower-fit group. Crucially, higher-fit participants maintained larger P3 amplitude throughout the task compared to lower-fit, who showed a reduction in the P3 magnitude over time. Higher fitness was related to neuroelectric activity suggestive of better overall sustained attention demonstrating a better ability to allocate attentional resources over time. Moreover, higher fitness was related to enhanced response preparation in the first part of the task. Taken together, the current data set demonstrated a positive association between aerobic fitness, sustained attention, and response preparation.

Perception of Contingency and Mental Retardation.

ERIC Educational Resources Information Center

DeVellis, Robert F.; McCauley, Charley

1979-01-01

It is argued that the general learning difficulties exhibited by mentally retarded persons are similar in many respects to the learning difficulties of nonretarded persons who are in a state of learned helplessness (M. Seligman, 1975) or who are external in locus of control orientation. (Author)

Contingent Learning for Creative Music Technologists

ERIC Educational Resources Information Center

King, Andrew

2009-01-01

This article will review educational literature relevant to the design and implementation of a learning technology interface (LTI) into an undergraduate music technology curriculum. It also explores through empirical enquiry some of the advantages and disadvantages of using learning technology. This case study adopted a social-constructivist…

Astronaut Catherine G. Coleman during WETF training

NASA Image and Video Library

1994-01-12

S94-25956 (April 1994) --- Astronaut Catherine G. Coleman, mission specialist, wearing a high-fidelity training version of an Extravehicular Mobility Unit (EMU), trains for a contingency space walk at the Johnson Space Center?s (JSC) Weightless Environment Training Facility (WET-F). Coleman has recently been named as one of seven crew members for the U.S. Microgravity Laboratory (USML-2) mission. The 25-feet deep pool is used to train astronauts for mission specific space walk chores as well as for contingency Extravehicular Activity (EVA) tasks.

Conflict-driven adaptive control is enhanced by integral negative emotion on a short time scale.

PubMed

Yang, Qian; Pourtois, Gilles

2018-02-05

Negative emotion influences cognitive control, and more specifically conflict adaptation. However, discrepant results have often been reported in the literature. In this study, we broke down negative emotion into integral and incidental components using a modern motivation-based framework, and assessed whether the former could change conflict adaptation. In the first experiment, we manipulated the duration of the inter-trial-interval (ITI) to assess the actual time-scale of this effect. Integral negative emotion was induced by using loss-related feedback contingent on task performance, and measured at the subjective and physiological levels. Results showed that conflict-driven adaptive control was enhanced when integral negative emotion was elicited, compared to a control condition without changes in defensive motivation. Importantly, this effect was only found when a short, as opposed to long ITI was used, suggesting that it had a short time scale. In the second experiment, we controlled for effects of feature repetition and contingency learning, and replicated an enhanced conflict adaptation effect when integral negative emotion was elicited and a short ITI was used. We interpret these new results against a standard cognitive control framework assuming that integral negative emotion amplifies specific control signals transiently, and in turn enhances conflict adaptation.

Semantic memory for contextual regularities within and across scene categories: evidence from eye movements.

PubMed

Brockmole, James R; Le-Hoa Võ, Melissa

2010-10-01

When encountering familiar scenes, observers can use item-specific memory to facilitate the guidance of attention to objects appearing in known locations or configurations. Here, we investigated how memory for relational contingencies that emerge across different scenes can be exploited to guide attention. Participants searched for letter targets embedded in pictures of bedrooms. In a between-subjects manipulation, targets were either always on a bed pillow or randomly positioned. When targets were systematically located within scenes, search for targets became more efficient. Importantly, this learning transferred to bedrooms without pillows, ruling out learning that is based on perceptual contingencies. Learning also transferred to living room scenes, but it did not transfer to kitchen scenes, even though both scene types contained pillows. These results suggest that statistical regularities abstracted across a range of stimuli are governed by semantic expectations regarding the presence of target-predicting local landmarks. Moreover, explicit awareness of these contingencies led to a central tendency bias in recall memory for precise target positions that is similar to the spatial category effects observed in landmark memory. These results broaden the scope of conditions under which contextual cuing operates and demonstrate how semantic memory plays a causal and independent role in the learning of associations between objects in real-world scenes.

'Too-much-of-a-good-thing'? The role of advanced eco-learning and contingency factors on the relationship between corporate environmental and financial performance.

PubMed

Latan, Hengky; Chiappetta Jabbour, Charbel Jose; Lopes de Sousa Jabbour, Ana Beatriz; Renwick, Douglas William Scott; Wamba, Samuel Fosso; Shahbaz, Muhammad

2018-08-15

Inspired by the natural-resource-based view (NRBV) theory, we attempt to shed light on a controversy which has been persistent over the last decade, concerning the relationship between corporate environmental performance (CEP) and corporate financial performance (CFP). Using the 'too-much-of-a-good-thing' (TMGT) concept, which suggests that "too much can be worse than too little," we link mixed results and consider the roles of advanced eco-learning and contingency factors in influencing the CEP-CFP relationship. Based on a sample composed of ISO 14001 certified companies in Indonesia, and analyzing the data using consistent Partial Least Squares (PLSc), we found that: the CEP-CFP relationship follows an inverted U-shape; advanced eco-learning is a significant predictor of the CEP-CFP relationship, meaning that organizations able to develop higher eco-learning capability will be better able to identify the ideal boundaries of investment in environmental performance without reducing their financial performance; and that contingency factors such as environmental strategy and firm size have a significant role in influencing the CEP-CFP relationship. The study's limitations, implications for practitioners and a future research agenda are also detailed. Copyright © 2018 Elsevier Ltd. All rights reserved.

Stimulus Competition in Pre/Post and Online Ratings in an Evaluative Learning Design

ERIC Educational Resources Information Center

Purkis, Helena M.; Lipp, Ottmar V.

2010-01-01

Evaluative learning is said to differ from Pavlovian associative learning in that it reflects stimulus contiguity, not contingency. Thus, evaluative learning should not be subject to stimulus competition, a proposal tested in the current experiments. Participants were presented in elemental and compound training phases with pictures of shapes as…

An Investigation of the Role of Contingent Metacognitive Behavior in Self-Regulated Learning

ERIC Educational Resources Information Center

Binbasaran Tuysuzoglu, Banu; Greene, Jeffrey Alan

2015-01-01

Studies have shown that, to achieve a conceptual understanding of complex science topics, learners need to use self-regulated learning (SRL) skills, particularly when learning with Hypermedia Learning Environments (HLEs). Winne and Hadwin (2008) claimed that metacognition is a key aspect of SRL, particularly metacognitive monitoring and control.…

Implications for the Self Determine Benevolence and Self-Protection in Intergroup Relations

PubMed Central

Malloy, Thomas E.; Kinney, Lorin

2017-01-01

People often favor groups they belong to over those beyond the in-group boundary. Yet, in-group favoritism does not always occur, and people will sometimes favor an out-group over the in-group. We delineate theoretically when in-group favoritism (i.e., self-protection) and out-group favoritism (i.e., benevolence) should occur. In two experiments, groups’ relative status and competence stereotypes were manipulated; groups’ outcomes were non-contingent in Experiment 1 and contingent in Experiment 2. When allocating reward, members of a low status group were self-protective, favoring the in-group over the out-group under both non-contingent and contingent outcomes. Those with high status benevolently favored the out-group when outcomes were non-contingent, but were self-protective with contingent outcomes. People were willing to engage in social activities with an out-group member regardless of competence. However, when task collaboration had implications for the self, those with low status preferred competent over less competent out-group members. Traits of high status targets were differentiated by those with low status in both experiments, whereas those with high status differentiated low status members’ traits only when outcomes were contingent. A general principle fits the data: the implications of intergroup responses for the self determine benevolence and self-protection. Implications for the Self Determine Benevolence and Self Protection in Intergroup Relations PMID:29225518

Implications for the Self Determine Benevolence and Self-Protection in Intergroup Relations.

PubMed

Malloy, Thomas E; Kinney, Lorin

2017-01-01

People often favor groups they belong to over those beyond the in-group boundary. Yet, in-group favoritism does not always occur, and people will sometimes favor an out-group over the in-group. We delineate theoretically when in-group favoritism (i.e., self-protection) and out-group favoritism (i.e., benevolence) should occur. In two experiments, groups' relative status and competence stereotypes were manipulated; groups' outcomes were non-contingent in Experiment 1 and contingent in Experiment 2. When allocating reward, members of a low status group were self-protective, favoring the in-group over the out-group under both non-contingent and contingent outcomes. Those with high status benevolently favored the out-group when outcomes were non-contingent, but were self-protective with contingent outcomes. People were willing to engage in social activities with an out-group member regardless of competence. However, when task collaboration had implications for the self, those with low status preferred competent over less competent out-group members. Traits of high status targets were differentiated by those with low status in both experiments, whereas those with high status differentiated low status members' traits only when outcomes were contingent. A general principle fits the data: the implications of intergroup responses for the self determine benevolence and self-protection. Implications for the Self Determine Benevolence and Self Protection in Intergroup Relations.

Sex Differences in Learned Helplessness: II. The Contingencies of Evaluative Feedback in the Classroom and III. An Experimental Analysis.

ERIC Educational Resources Information Center

Dweck, Carol S.; And Others

1978-01-01

In Study I, teachers' work-related feedback to boys and girls was observed in a classroom situation. In Study II, the different contingencies of work-related criticism observed for boys and girls in the first study were programed in an experimental situation and the children's attributions for failure feedback were assessed. (JMB)

The Effect of Contingent Reinforcement on the Acquisition of Sight Vocabulary. Technical Report No. 49.

ERIC Educational Resources Information Center

Brandt, Mary E.; And Others

The present study is a replication of a Lahey and Drabman study (1974) which investigated the effects of contingent versus noncontingent reinforcement on the learning of sight words. The subjects in this study were 14 Kamehameha Early Education Program (KEEP) students who composed the lowest reading group in a combined first-second grade…

The Effect of Various Reinforcement Contingencies on the Accuracy of Children's Self-Reports. Technical Report #46.

ERIC Educational Resources Information Center

Speidel, Gisela E.

This study, part of the Kamehameha Early Education Program (KEEP), investigated the accuracy of children's self reports under various contingencies. Sixteen first grade arithmetic students were randomly assigned to two groups, A and B. It was found that both groups learned to check their own work and report it fairly accurately when no…

Contingent Commitments: Bringing Part-Time Faculty into Focus. A Special Report from the Center for Community College Student Engagement

ERIC Educational Resources Information Center

Center for Community College Student Engagement, 2014

2014-01-01

Part-time faculty teach approximately 58% of U.S. community college classes and thus manage learning experiences for more than half (53%) of students enrolled in community colleges (JBL Associates, 2008). Often referred to as "contingent faculty," their work is conditional; the college typically has no obligation to them beyond the…

Proportion congruency and practice: A contingency learning account of asymmetric list shifting effects.

PubMed

Schmidt, James R

2016-09-01

Performance is impaired when a distracting stimulus is incongruent with the target stimulus (e.g., "green" printed in red). This congruency effect is decreased when the proportion of incongruent trials is increased, termed the proportion congruent effect. This effect is typically interpreted in terms of the adaptation of attention in response to conflict. In contrast, the contingency account argues that the effect is driven by the learning of predictive relationships between words and responses. In a recent report, Abrahamse, Duthoo, Notebaert, and Risko (2013) demonstrated larger changes in the magnitude of the proportion congruent effect when switching from a mostly congruent list to a mostly incongruent list, relative to the reverse order. They argued that this asymmetric list shifting effect fits only with the conflict adaptation perspective. However, the current paper presents reanalyses of this data and an adaptation of the Parallel Episodic Processing model that together demonstrate how the contingency account can explain these findings equally well when considering the generally accepted notion that performance improves with practice. The contingency account may still be the most parsimonious view. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Random motor generation in a finger tapping task: influence of spatial contingency and of cortical and subcortical hemispheric brain lesions

PubMed Central

Annoni, J.; Pegna, A.

1997-01-01

OBJECTIVE—To test the hypothesis that, during random motor generation, the spatial contingencies inherent to the task would induce additional preferences in normal subjects, shifting their performances farther from randomness. By contrast, perceptual or executive dysfunction could alter these task related biases in patients with brain damage.
METHODS—Two groups of patients, with right and left focal brain lesions, as well as 25 right handed subjects matched for age and handedness were asked to execute a random choice motor task—namely, to generate a random series of 180 button presses from a set of 10 keys placed vertically in front of them.
RESULTS—In the control group, as in the left brain lesion group, motor generation was subject to deviations from theoretical expected randomness, similar to those when numbers are generated mentally, as immediate repetitions (successive presses on the same key) are avoided. However, the distribution of button presses was also contingent on the topographic disposition of the keys: the central keys were chosen more often than those placed at extreme positions. Small distances were favoured, particularly with the left hand. These patterns were influenced by implicit strategies and task related contingencies.
 By contrast, right brain lesion patients with frontal involvement tended to show a more square distribution of key presses—that is, the number of key presses tended to be more equally distributed. The strategies were also altered by brain lesions: the number of immediate repetitions was more frequent when the lesion involved the right frontal areas yielding a random generation nearer to expected theoretical randomness. The frequency of adjacent key presses was increased by right anterior and left posterior cortical as well as by right subcortical lesions, but decreased by left subcortical lesions.
CONCLUSIONS—Depending on the side of the lesion and the degree of cortical-subcortical involvement, the deficits take on a different aspect and direct repetions and adjacent key presses have different patterns of alterations. Motor random generation is therefore a complex task which seems to necessitate the participation of numerous cerebral structures, among which those situated in the right frontal, left posterior, and subcortical regions have a predominant role.

 PMID:9408109

Posture Affects How Robots and Infants Map Words to Objects

PubMed Central

Morse, Anthony F.; Benitez, Viridian L.; Belpaeme, Tony; Cangelosi, Angelo; Smith, Linda B.

2015-01-01

For infants, the first problem in learning a word is to map the word to its referent; a second problem is to remember that mapping when the word and/or referent are again encountered. Recent infant studies suggest that spatial location plays a key role in how infants solve both problems. Here we provide a new theoretical model and new empirical evidence on how the body – and its momentary posture – may be central to these processes. The present study uses a name-object mapping task in which names are either encountered in the absence of their target (experiments 1–3, 6 & 7), or when their target is present but in a location previously associated with a foil (experiments 4, 5, 8 & 9). A humanoid robot model (experiments 1–5) is used to instantiate and test the hypothesis that body-centric spatial location, and thus the bodies’ momentary posture, is used to centrally bind the multimodal features of heard names and visual objects. The robot model is shown to replicate existing infant data and then to generate novel predictions, which are tested in new infant studies (experiments 6–9). Despite spatial location being task-irrelevant in this second set of experiments, infants use body-centric spatial contingency over temporal contingency to map the name to object. Both infants and the robot remember the name-object mapping even in new spatial locations. However, the robot model shows how this memory can emerge –not from separating bodily information from the word-object mapping as proposed in previous models of the role of space in word-object mapping – but through the body’s momentary disposition in space. PMID:25785834

Sensorimotor Learning Biases Choice Behavior: A Learning Neural Field Model for Decision Making

PubMed Central

Schöner, Gregor; Gail, Alexander

2012-01-01

According to a prominent view of sensorimotor processing in primates, selection and specification of possible actions are not sequential operations. Rather, a decision for an action emerges from competition between different movement plans, which are specified and selected in parallel. For action choices which are based on ambiguous sensory input, the frontoparietal sensorimotor areas are considered part of the common underlying neural substrate for selection and specification of action. These areas have been shown capable of encoding alternative spatial motor goals in parallel during movement planning, and show signatures of competitive value-based selection among these goals. Since the same network is also involved in learning sensorimotor associations, competitive action selection (decision making) should not only be driven by the sensory evidence and expected reward in favor of either action, but also by the subject's learning history of different sensorimotor associations. Previous computational models of competitive neural decision making used predefined associations between sensory input and corresponding motor output. Such hard-wiring does not allow modeling of how decisions are influenced by sensorimotor learning or by changing reward contingencies. We present a dynamic neural field model which learns arbitrary sensorimotor associations with a reward-driven Hebbian learning algorithm. We show that the model accurately simulates the dynamics of action selection with different reward contingencies, as observed in monkey cortical recordings, and that it correctly predicted the pattern of choice errors in a control experiment. With our adaptive model we demonstrate how network plasticity, which is required for association learning and adaptation to new reward contingencies, can influence choice behavior. The field model provides an integrated and dynamic account for the operations of sensorimotor integration, working memory and action selection required for decision making in ambiguous choice situations. PMID:23166483

Physiological and Emotional Reactivity to Learning and Frustration

ERIC Educational Resources Information Center

Lewis, Michael; Hitchcock, Daniel F. A.; Sullivan, Margaret Wolan

2004-01-01

This study examined the behavioral (arm, facial) and autonomic (heart rate, respiratory sinus arrhythmia [RSA], and adrenocortical axis) reactivity of 56 4-month-old infants in response to contingency learning and extinction-induced frustration. During learning, infants displayed increases in operant arm response and positive emotional…

Approach-Avoidance Training Effects Are Moderated by Awareness of Stimulus-Action Contingencies.

PubMed

Van Dessel, Pieter; De Houwer, Jan; Gast, Anne

2016-01-01

Prior research suggests that repeatedly approaching or avoiding a stimulus changes the liking of that stimulus. In two experiments, we investigated the relationship between, on one hand, effects of approach-avoidance (AA) training on implicit and explicit evaluations of novel faces and, on the other hand, contingency awareness as indexed by participants' memory for the relation between stimulus and action. We observed stronger effects for faces that were classified as contingency aware and found no evidence that AA training caused changes in stimulus evaluations in the absence of contingency awareness. These findings challenge the standard view that AA training effects are (exclusively) the product of implicit learning processes, such as the automatic formation of associations in memory. © 2015 by the Society for Personality and Social Psychology, Inc.

Geometric reasoning

NASA Technical Reports Server (NTRS)

Woodbury, R. F.; Oppenheim, I. J.

1987-01-01

Cognitive robot systems are ones in which sensing and representation occur, from which task plans and tactics are determined. Such a robot system accomplishes a task after being told what to do, but determines for itself how to do it. Cognition is required when the work environment is uncontrolled, when contingencies are prevalent, or when task complexity is large; it is useful in any robotic mission. A number of distinguishing features can be associated with cognitive robotics, and one emphasized here is the role of artificial intelligence in knowledge representation and in planning. While space telerobotics may elude some of the problems driving cognitive robotics, it shares many of the same demands, and it can be assumed that capabilities developed for cognitive robotics can be employed advantageously for telerobotics in general. The top level problem is task planning, and it is appropriate to introduce a hierarchical view of control. Presented with certain mission objectives, the system must generate plans (typically) at the strategic, tactical, and reflexive levels. The structure by which knowledge is used to construct and update these plans endows the system with its cognitive attributes, and with the ability to deal with contingencies, changes, unknowns, and so on. Issues of representation and reasoning which are absolutely fundamental to robot manipulation, decisions based upon geometry, are discussed here, not AI task planning per se.

Failures to change stimulus evaluations by means of subliminal approach and avoidance training.

PubMed

Van Dessel, Pieter; De Houwer, Jan; Roets, Arne; Gast, Anne

2016-01-01

Previous research suggests that the repeated performance of approach and avoidance (AA) actions in response to a stimulus causes changes in stimulus evaluations. Kawakami, Phills, Steele, and Dovidio (2007) and Jones, Vilensky, Vasey, and Fazio (2013) provided evidence that these AA training effects occur even when stimuli are presented only subliminally. We also examined whether reliable AA training effects can be observed with subliminal stimulus presentations but added more sensitive checks of perceptual stimulus discriminability. Three experiments, including a direct replication of the study by Kawakami et al. (2007), failed to provide any evidence for effects of subliminal AA training on implicit or explicit evaluations. Bayesian analyses indicated that our data provide robust evidence that subliminal AA training does not cause changes in evaluations. In contrast, we observed changes in evaluations when participants were provided with (either correct or incorrect) information about the stimulus-action contingencies in the subliminal AA training task and when participants performed a supraliminal AA training task that allowed participants to detect these contingencies. These findings support the idea that contingency awareness is necessary for the occurrence of AA training effects. (c) 2016 APA, all rights reserved).

Culture-specific links between maternal executive function, parenting, and preschool children's executive function in South Korea.

PubMed

Lee, Min Kyung; Baker, Sara; Whitebread, David

2018-06-01

Research on the relationships between parental factors and children's executive function (EF) has been conducted mainly in Western cultures. This study provides the first empirical test, in a non-Western context, of how maternal EF and parenting behaviours relate to child EF. South Korean mothers and their preschool children (N = 95 dyads) completed EF tasks. Two aspects of parental scaffolding were observed during a puzzle task: contingency (i.e., adjusting among levels of scaffolding according to the child's ongoing evidence of understanding) and intrusiveness (i.e., directive, mother-centred interactions). Maternal EF and maternal contingency each accounted for unique variance in child EF, above and beyond child age, child language and maternal education. Maternal intrusiveness, however, was not significantly related to child EF. Additionally, no mediating role of parenting was found in the maternal and child EF link. However, child language was found to partially mediate the link between maternal contingency and child EF. These results complement prior findings by revealing distinctive patterns in the link between maternal EF, parenting behaviours, and child EF in the Korean context. © 2018 The British Psychological Society.

Skill Acquisition in Physical Education: A Speculative Perspective

ERIC Educational Resources Information Center

Smith, Wayne W.

2011-01-01

How we learn motor skills has always been of interest to physical educators. Contemporary conceptual frameworks about motor skill learning draw from earlier behavioral and cognitive psychology learning theories. As a point of departure this paper foregrounds complexity theorizing, arguing that skill is contingent upon the performer's physical and…

Development and Initial Validation of the Activity Patterns Scale in Patients With Chronic Pain.

PubMed

Esteve, Rosa; Ramírez-Maestre, Carmen; Peters, Madelon L; Serrano-Ibáñez, Elena R; Ruíz-Párraga, Gema T; López-Martínez, Alicia E

2016-04-01

Several self-report measures were used to identify 6 activity patterns in chronic pain patients: pain avoidance, activity avoidance, task-contingent persistence, excessive persistence, pain-contingent persistence, and pacing. Instruments for assessing pacing should include 3 pacing behaviors (breaking tasks into smaller tasks, taking frequent short rests, slowing down), each of which relate to a single goal (increasing activity levels, conserving energy for valued activities, and reducing pain). This article presents the Activity Patterns Scale (APS), which assesses these 6 activity patterns. Study 1 included 291 participants with chronic pain, and tested 3 structures using confirmatory factor analyses. The structure with the best fit had 8 factors corresponding to the hypothesized scales. High correlations in the expected direction were found between the APS subscales and the "Patterns of Activity Measure-Pain." Study 2 included 111 patients with chronic pain, and aimed at examining the association between the APS subscales and adjustment to pain. It was found that that activity avoidance was associated with daily functioning and impairment. Negative affect was positively associated with activity avoidance and excessive persistence, and negatively associated with task-contingent persistence, which was also positively associated with positive affect. This study showed that the APS is a valid and reliable instrument for clinical practice and research. This article presents a valid and reliable instrument to assess activity patterns in patients with chronic pain. The findings suggest that avoidance, persistence, and pacing are multidimensional constructs. Distinguishing between these dimensions sheds light on previous contradictory results and has direct clinical implications regarding recommending the most advisable activity patterns. Copyright © 2016 American Pain Society. Published by Elsevier Inc. All rights reserved.

Task uncertainty and communication during nursing shift handovers.

PubMed

Mayor, Eric; Bangerter, Adrian; Aribot, Myriam

2012-09-01

We explore variations in handover duration and communication in nursing units. We hypothesize that duration per patient is higher in units facing high task uncertainty. We expect both topics and functions of communication to vary depending on task uncertainty. Handovers are changing in modern healthcare organizations, where standardized procedures are increasingly advocated for efficiency and reliability reasons. However, redesign of handover should take environmental contingencies of different clinical unit types into account. An important contingency in institutions is task uncertainty, which may affect how communicative routines like handover are accomplished. Nurse unit managers of 80 care units in 18 hospitals were interviewed in 2008 about topics and functions of handover communication and duration in their unit. Interviews were content-analysed. Clinical units were classified into a theory-based typology (unit type) that gradually increases on task uncertainty. Quantitative analyses were performed. Unit type affected resource allocation. Unit types facing higher uncertainty had higher handover duration per patient. As expected, unit type also affected communication content. Clinical units facing higher uncertainty discussed fewer topics, discussing treatment and care and organization of work less frequently. Finally, unit type affected functions of handover: sharing emotions was less often mentioned in unit types facing higher uncertainty. Task uncertainty and its relationship with functions and topics of handover should be taken into account during the design of handover procedures. © 2011 Blackwell Publishing Ltd.

Explicit knowledge of stimulus-outcome contingencies and stimulus control of selective attention and instrumental action in human smoking behaviour.

PubMed

Hogarth, Lee; Dickinson, Anthony; Duka, Theodora

2005-02-01

External stimuli (S+) that reliably signal that addictive drugs are available command the focus of selective attention and control instrumental action that procures the drug. According to incentive salience theory, as the contingency between the S+ and the drug is learned the magnitude of attentional orienting towards the S+ increases. By contrast, alternative theories propose that processing of the S+ becomes more efficient with training such that the measured attentional orienting response elicited by the S+ decreases. The aim of the present study was to prompt half of participants to acquire explicit knowledge of the stimulus-reinforcer contingencies arranged in training, to examine the impact of this manipulation on the magnitude of attentional orienting towards the S+. Smokers (n=32) completed an instrumental discrimination training procedure in which a set of stimuli were established as differential predictors that an instrumental response would yield tobacco-smoke reinforcement. During training, attention for the stimuli and performance of the instrumental tobacco-seeking response were measured in parallel. One group (n=16) was prompted to develop explicit knowledge of the discriminative contingencies in training whereas another group (n=16) underwent discrimination training without prompting. The prompted group reported accurate knowledge of the contingencies and showed no attentional orienting response towards the S+. By contrast, the unprompted group reported inaccurate knowledge of the contingencies and showed an attentional orienting response towards the S+. The S+ appeared to control the instrumental tobacco-seeking response in both groups equally. The results suggest that attention for drug paired S+ is associated with the process of learning about the relationship between those cues and the drug.

Infant Approach and Withdrawal in Response to a Goal Blockage: Its Antecedent Causes and Its Effect on Toddler Persistence

ERIC Educational Resources Information Center

Lewis, Michael; Sullivan, Margaret W.; Kim, Hillary Mi-Sung

2015-01-01

In 2 separate longitudinal studies, infants and their mothers were seen in 3 longitudinal visits. At 2 months, they were observed in free play where mothers' contingency toward their infants was obtained. At 5 months, a goal blockage response was produced when a previously learned contingent response became ineffective in producing an interesting…

A comparison of general and specific instructions to promote task engagement and completion by a young man with Asperger syndrome.

PubMed

Bouxsein, Kelly J; Tiger, Jeffrey H; Fisher, Wayne W

2008-01-01

Previous research has suggested that the topography of instructions (general vs. specific) may influence the likelihood that young children comply with instructions. The purpose of the current study was to compare the rates of task completion of a young man diagnosed with Asperger syndrome when provided with general and specific instructions pertaining to the task. The results showed that specific instructions occasioned higher levels of task completion, even when no differential reinforcement contingencies were in place.

A Parametric Analysis of Specific Praise Rates on the On-Task Behavior of Elementary Students with Autism

ERIC Educational Resources Information Center

Kranak, Michael P.; Alber-Morgan, Shiela R.; Sawyer, Mary R.

2017-01-01

Using contingent praise is a proactive strategy for increasing on-task behaviors in special education classrooms. Although there is large body of literature supporting the use of praise to decrease challenging behaviors and increase desirable behaviors, a consensus on how much praise is needed has yet to be reached. In an effort to identify…

Familiarity and Personal Experience as Mediators of Recall when Planning for Future Contingencies

ERIC Educational Resources Information Center

Klein, Stanley B.; Robertson, Theresa E.; Delton, Andrew W.; Lax, Moshe L.

2012-01-01

In this article, we demonstrate that planning tasks enhance recall when the context of planning (a) is self-referential and (b) draws on familiar scenarios represented in episodic memory. Specifically, we show that when planning tasks are sorted according to the degree to which they evoke memories of personally familiar scenarios (e.g., planning a…

Age Changes in Attention Control: Assessing the Role of Stimulus Contingencies

ERIC Educational Resources Information Center

Brodeur, Darlene A.

2004-01-01

Children (ages 5, 7, and 9 years) and young adults completed two visual attention tasks that required them to make a forced choice identification response to a target shape presented in the center of a computer screen. In the first task (high correlation condition) each target was flanked with the same distracters on 80% of the trials (valid…

Differential Classical Conditioning of the Nocebo Effect: Increasing Heat-Pain Perception without Verbal Suggestions

PubMed Central

Bräscher, Anne-Kathrin; Kleinböhl, Dieter; Hölzl, Rupert; Becker, Susanne

2017-01-01

Background: Nocebo effects, including nocebo hyperalgesia, are a common phenomenon in clinical routine with manifold negative consequences. Both explicit expectations and learning by conditioning are known to induce nocebo effects, but the specific role of conditioning remains unclear, because conditioning is rarely implemented independent of verbal suggestions. Further, although pain is a multidimensional phenomenon, nocebo effects are usually assessed in subjective ratings only, neglecting, e.g., behavioral aspects. The aim of this study was to test whether nocebo hyperalgesia can be learned by conditioning without explicit expectations, to assess nocebo effects in different response channels, and to exploratively assess, whether contingency awareness is a necessary condition for conditioned nocebo hyperalgesia. Methods: Twenty-one healthy volunteers were classically conditioned using painful and non-painful heat stimuli that followed two different cues. The conditioned nocebo effect was assessed by subjective ratings of perceived stimulation intensity on a visual analog scale and a behavioral discrimination task, assessing sensitization and habituation in response to the same stimulation following the two cues. Results: Results show a conditioned nocebo effect indicated by the subjective intensity ratings. Conditioned effects were also seen in the behavioral responses, but paradoxically, behavioral responses indicated decreased perception after conditioning, but only for subjects successfully conditioned as indicated by the subjective ratings. Explorative analyses suggested that awareness of the contingencies and the different cues was not necessary for successful conditioning. Conclusion: Nocebo effects can be learned without inducing additional explicit expectations. The dissociation between the two response channels, possibly representing the conditioned and a compensatory response, highlights the importance of considering different outcomes in nocebo responses to fully understand underlying mechanisms. The present results challenge the role of explicit expectations in conditioned nocebo effects and are relevant with implications in clinical contexts, e.g., when transient adverse effects become conditioned. PMID:29321752

Neuropsychological function and suicidal behavior: attention control, memory and executive dysfunction in suicide attempt.

PubMed

Keilp, J G; Gorlyn, M; Russell, M; Oquendo, M A; Burke, A K; Harkavy-Friedman, J; Mann, J J

2013-03-01

Executive dysfunction, distinct from other cognitive deficits in depression, has been associated with suicidal behavior. However, this dysfunction is not found consistently across samples. Medication-free subjects with DSM-IV major depressive episode (major depressive disorder and bipolar type I disorder) and a past history of suicidal behavior (n = 72) were compared to medication-free depressed subjects with no history of suicidal behavior (n = 80) and healthy volunteers (n = 56) on a battery of tests assessing neuropsychological functions typically affected by depression (motor and psychomotor speed, attention, memory) and executive functions reportedly impaired in suicide attempters (abstract/contingent learning, working memory, language fluency, impulse control). All of the depressed subjects performed worse than healthy volunteers on motor, psychomotor and language fluency tasks. Past suicide attempters, in turn, performed worse than depressed non-attempters on attention and memory/working memory tasks [a computerized Stroop task, the Buschke Selective Reminding Task (SRT), the Benton Visual Retention Test (VRT) and an N-back task] but not on other executive function measures, including a task associated with ventral prefrontal function (Object Alternation). Deficits were not accounted for by current suicidal ideation or the lethality of past attempts. A small subsample of those using a violent method in their most lethal attempt showed a pattern of poor executive performance. Deficits in specific components of attention control, memory and working memory were associated with suicidal behavior in a sample where non-violent attempt predominated. Broader executive dysfunction in depression may be associated with specific forms of suicidal behavior, rather than suicidal behavior per se.

Win-stay and win-shift lever-press strategies in an appetitively reinforced task for rats.

PubMed

Reed, Phil

2016-12-01

Two experiments examined acquisition of win-stay, win-shift, lose-stay, and lose-shift rules by which hungry rats could earn food reinforcement. In Experiment 1, two groups of rats were trained in a two-lever operant task that required them to follow either a win-stay/lose-shift or a win-shift/lose-stay contingency. The rates of acquisition of the individual rules within each contingency differed: lose-shift and lose-stay rules were acquired faster than win-stay and win-shift rules. Contrary to a number of previous reports, the win-shift rule was acquired less rapidly than any of the other rules. In Experiment 2, the four rules were taught separately, but subjects still acquired the win-shift rule more slowly than any of the other rules.

Behavioral sensitivity of Japanese children with and without ADHD to changing reinforcer availability: an experimental study using signal detection methodology.

PubMed

Furukawa, Emi; Shimabukuro, Shizuka; Alsop, Brent; Tripp, Gail

2017-09-25

Most research on motivational processes in attention deficit hyperactivity disorder (ADHD) has been undertaken in Western Europe and North America. The extent to which these findings apply to other cultural groups is unclear. The current study evaluated the behavioral sensitivity of Japanese children with and without ADHD to changing reward availability. Forty-one school-aged children, 19 diagnosed with DSM-IV ADHD, completed a signal-detection task in which correct discriminations between two stimuli were associated with different reinforcement frequencies. The response alternative associated with the higher rate of reinforcement switched twice during the task without warning. Both groups of children developed an initial bias toward the more frequently reinforced response alternative. When the reward contingencies switched the response allocation (bias) of the control group children followed suit. The response bias scores of the children with ADHD did not, suggesting impaired tracking of reward availability over time. Japanese children with ADHD adjust their behavioral responses to changing reinforcer availability less than their typically developing peers. This is not explained by poor attention to task or a lack of sensitivity to reward. The current results are consistent with altered sensitivity to changing reward contingencies identified in non-Japanese samples of children with ADHD. Irrespective of their country of origin, children with ADHD will likely benefit from behavioral expectations and reinforcement contingencies being made explicit together with high rates of reinforcement for appropriate behaviors.

Change in the relative contributions of habit and working memory facilitates serial reversal learning expertise in rhesus monkeys.

PubMed

Hassett, Thomas C; Hampton, Robert R

2017-05-01

Functionally distinct memory systems likely evolved in response to incompatible demands placed on learning by distinct environmental conditions. Working memory appears adapted, in part, for conditions that change frequently, making rapid acquisition and brief retention of information appropriate. In contrast, habits form gradually over many experiences, adapting organisms to contingencies of reinforcement that are stable over relatively long intervals. Serial reversal learning provides an opportunity to simultaneously examine the processes involved in adapting to rapidly changing and relatively stable contingencies. In serial reversal learning, selecting one of the two simultaneously presented stimuli is positively reinforced, while selection of the other is not. After a preference for the positive stimulus develops, the contingencies of reinforcement reverse. Naïve subjects adapt to such reversals gradually, perseverating in selection of the previously rewarded stimulus. Experts reverse rapidly according to a win-stay, lose-shift response pattern. We assessed whether a change in the relative control of choice by habit and working memory accounts for the development of serial reversal learning expertise. Across three experiments, we applied manipulations intended to attenuate the contribution of working memory but leave the contribution of habit intact. We contrasted performance following long and short intervals in Experiments 1 and 2, and we interposed a competing cognitive load between trials in Experiment 3. These manipulations slowed the acquisition of reversals in expert subjects, but not naïve subjects, indicating that serial reversal learning expertise is facilitated by a shift in the control of choice from passively acquired habit to actively maintained working memory.

Capturing attention is not that simple: different mechanisms for stimulus-driven and contingent capture.

PubMed

Liao, Hsin-I; Yeh, Su-Ling

2013-11-01

Attentional orienting can be involuntarily directed to task-irrelevant stimuli, but it remains unsolved whether such attentional capture is contingent on top-down settings or could be purely stimulus-driven. We propose that attentional capture depends on the stimulus property because transient and static features are processed differently; thus, they might be modulated differently by top-down controls. To test this hybrid account, we adopted a spatial cuing paradigm in which a noninformative onset or color cue preceded an onset or color target with various stimulus onset asynchronies (SOAs). Results showed that the onset cue captured attention regardless of target type at short-but not long-SOAs. In contrast, the color cue captured attention at short and long SOAs, but only with a color target. The overall pattern of results corroborates our hypothesis, suggesting that different mechanisms are at work for stimulus-driven capture (by onset) and contingent capture (by color). Stimulus-driven capture elicits reflexive involuntary orienting, and contingent capture elicits voluntary feature-based enhancement.

Studying primate learning in group contexts: Tests of social foraging, response to novelty, and cooperative problem solving.

PubMed

Drea, Christine M

2006-03-01

Learning commonly refers to the modification of behavior through experience, whereby an animal gains information about stimulus-response contingencies from interacting with its physical environment. Social learning, on the other hand, occurs when the same information originates, not from the animal's personal experience, but from the actions of others. Socially biased learning is the 'collective outcome of interacting physical, social, and individual factors' [D. Fragaszy, E. Visalberghi, Learn. Behav. 32 (2004) 24-35.] (see p. 24). Mounting interest in animal social learning has brought with it certain innovations in animal testing procedures. Variants of the observer-demonstrator and cooperation paradigms, for instance, have been used widely in captive settings to examine the transmission or coordination of behavior, respectively, between two animals. Relatively few studies, however, have examined social learning in more complex group settings and even fewer have manipulated the social environment to empirically test the effect of group dynamics on problem solving. The present paper outlines procedures for group testing captive non-human primates, in spacious arenas, to evaluate the social modulation of learning and performance. These methods are illustrated in the context of (1) naturalistic social foraging problems, modeled after traditional visual discrimination paradigms, (2) response to novel objects and novel extractive foraging tasks, and (3) cooperative problem solving. Each example showcases the benefits of experimentally manipulating social context to compare an animal's performance in intact groups (or even pairs) against its performance under different social circumstances. Broader application of group testing procedures and manipulation of group composition promise to provide meaningful insight into socially biased learning.

Inferential reasoning by exclusion in children (Homo sapiens).

PubMed

Hill, Andrew; Collier-Baker, Emma; Suddendorf, Thomas

2012-08-01

The cups task is the most widely adopted forced-choice paradigm for comparative studies of inferential reasoning by exclusion. In this task, subjects are presented with two cups, one of which has been surreptitiously baited. When the empty cup is shaken or its interior shown, it is possible to infer by exclusion that the alternative cup contains the reward. The present study extends the existing body of comparative work to include human children (Homo sapiens). Like chimpanzees (Pan troglodytes) that were tested with the same equipment and near-identical procedures, children aged three to five made apparent inferences using both visual and auditory information, although the youngest children showed the least-developed ability in the auditory modality. However, unlike chimpanzees, children of all ages used causally irrelevant information in a control test designed to examine the possibility that their apparent auditory inferences were the product of contingency learning (the duplicate cups test). Nevertheless, the children's ability to reason by exclusion was corroborated by their performance on a novel verbal disjunctive syllogism test, and we found preliminary evidence consistent with the suggestion that children used their causal-logical understanding to reason by exclusion in the cups task, but subsequently treated the duplicate cups information as symbolic or communicative, rather than causal. Implications for future comparative research are discussed. 2012 APA, all rights reserved

Expanding the Intertrial Interval During Extinction: Response Cessation and Recovery

PubMed Central

Orinstein, Alyssa J.; Urcelay, Gonzalo P.; Miller, Ralph R.

2010-01-01

We examined trial spacing during extinction following a human contingency learning task. Specifically, we assessed if an expanding retrieval practice schedule (Bjork & Bjork, 1992, 2006), in which the spacing between extinction trials was progressively increased, would result in faster immediate extinction and less recovery from extinction than uniformly spaced extinction trials. We used an ABB vs. ABA renewal design and observed that, whereas the expanding group extinguished faster during extinction treatment, the expanding and constant groups showed the same level of extinction with an immediate test in the extinction context (ABB) and the two groups showed equivalent ABA renewal at test in the training context. We conclude that the faster extinction observed in the expanding groups could be misleading in clinical treatment, if the therapist used the absence of fear during extinction as the basis for terminating treatment. PMID:20171324

A short educational intervention diminishes causal illusions and specific paranormal beliefs in undergraduates.

PubMed

Barberia, Itxaso; Tubau, Elisabet; Matute, Helena; Rodríguez-Ferreiro, Javier

2018-01-01

Cognitive biases such as causal illusions have been related to paranormal and pseudoscientific beliefs and, thus, pose a real threat to the development of adequate critical thinking abilities. We aimed to reduce causal illusions in undergraduates by means of an educational intervention combining training-in-bias and training-in-rules techniques. First, participants directly experienced situations that tend to induce the Barnum effect and the confirmation bias. Thereafter, these effects were explained and examples of their influence over everyday life were provided. Compared to a control group, participants who received the intervention showed diminished causal illusions in a contingency learning task and a decrease in the precognition dimension of a paranormal belief scale. Overall, results suggest that evidence-based educational interventions like the one presented here could be used to significantly improve critical thinking skills in our students.

Causal involvement of visual area MT in global feature-based enhancement but not contingent attentional capture.

PubMed

Painter, David R; Dux, Paul E; Mattingley, Jason B

2015-09-01

When visual attention is set for a particular target feature, such as color or shape, neural responses to that feature are enhanced across the visual field. This global feature-based enhancement is hypothesized to underlie the contingent attentional capture effect, in which task-irrelevant items with the target feature capture spatial attention. In humans, however, different cortical regions have been implicated in global feature-based enhancement and contingent capture. Here, we applied intermittent theta-burst stimulation (iTBS) to assess the causal roles of two regions of extrastriate cortex - right area MT and the right temporoparietal junction (TPJ) - in both global feature-based enhancement and contingent capture. We recorded cortical activity using EEG while participants monitored centrally for targets defined by color and ignored peripheral checkerboards that matched the distractor or target color. In central vision, targets were preceded by colored cues designed to capture attention. Stimuli flickered at unique frequencies, evoking distinct cortical oscillations. Analyses of these oscillations and behavioral performance revealed contingent capture in central vision and global feature-based enhancement in the periphery. Stimulation of right area MT selectively increased global feature-based enhancement, but did not influence contingent attentional capture. By contrast, stimulation of the right TPJ left both processes unaffected. Our results reveal a causal role for the right area MT in feature-based attention, and suggest that global feature-based enhancement does not underlie the contingent capture effect. Copyright © 2015 Elsevier Inc. All rights reserved.

Exploiting Redundancy for Flexible Behavior: Unsupervised Learning in a Modular Sensorimotor Control Architecture

ERIC Educational Resources Information Center

Butz, Martin V.; Herbort, Oliver; Hoffmann, Joachim

2007-01-01

Autonomously developing organisms face several challenges when learning reaching movements. First, motor control is learned unsupervised or self-supervised. Second, knowledge of sensorimotor contingencies is acquired in contexts in which action consequences unfold in time. Third, motor redundancies must be resolved. To solve all 3 of these…

Integration of Technology Enhanced Learning within Business Organizations: Which Strategy to Choose?

ERIC Educational Resources Information Center

Kaminskiene, Lina; Rutkiene, Aušra; Trepule, Elena

2015-01-01

The article discusses a responsible and a responsive strategic organizational approach for a smooth integration of technology enhanced learning (TEL). A response to external and internal contingencies and an involvement of different stakeholders into the development and implementation of the so-called eLearning strategies is one of the approaches…

Optimistic Biases in Observational Learning of Value

ERIC Educational Resources Information Center

Nicolle, A.; Symmonds, M.; Dolan, R. J.

2011-01-01

Action-outcome contingencies can be learnt either by active trial-and-error, or vicariously, by observing the outcomes of actions performed by others. The extant literature is ambiguous as to which of these modes of learning is more effective, as controlled comparisons of operant and observational learning are rare. Here, we contrasted human…

Common Elements Enhance or Retard Negative Patterning Discrimination Learning Depending on Modality of Stimuli

ERIC Educational Resources Information Center

Redhead, Edward S.; Curtis, Cheryl

2013-01-01

Human contingency learning studies were used to compare the predictions of configural and elemental theories. In two experiments, participants were required to learn which stimuli were associated with an increase in core temperature of a fictitious nuclear plant. Experiments investigated the rate at which a simple negative patterning…

Baby FaceTime: can toddlers learn from online video chat?

PubMed

Myers, Lauren J; LeWitt, Rachel B; Gallo, Renee E; Maselli, Nicole M

2017-07-01

There is abundant evidence for the 'video deficit': children under 2 years old learn better in person than from video. We evaluated whether these findings applied to video chat by testing whether children aged 12-25 months could form relationships with and learn from on-screen partners. We manipulated social contingency: children experienced either real-time FaceTime conversations or pre-recorded Videos as the partner taught novel words, actions and patterns. Children were attentive and responsive in both conditions, but only children in the FaceTime group responded to the partner in a temporally synced manner. After one week, children in the FaceTime condition (but not the Video condition) preferred and recognized their Partner, learned more novel patterns, and the oldest children learned more novel words. Results extend previous studies to demonstrate that children under 2 years show social and cognitive learning from video chat because it retains social contingency. A video abstract of this article can be viewed at: https://youtu.be/rTXaAYd5adA. © 2016 John Wiley & Sons Ltd.

Regulating task-monitoring systems in response to variable reward contingencies and outcomes in cocaine addicts.

PubMed

Morie, Kristen P; De Sanctis, Pierfilippo; Garavan, Hugh; Foxe, John J

2016-03-01

We investigated anticipatory and consummatory reward processing in cocaine addiction. In addition, we set out to assess whether task-monitoring systems were appropriately recalibrated in light of variable reward schedules. We also examined neural measures of task-monitoring and reward processing as a function of hedonic tone, since anhedonia is a vulnerability marker for addiction that is obviously germane in the context of reward processing. High-density event-related potentials were recorded while participants performed a speeded response task that systematically varied anticipated probabilities of reward receipt. The paradigm dissociated feedback regarding task success (or failure) from feedback regarding the value of reward (or loss), so that task-monitoring and reward processing could be examined in partial isolation. Twenty-three active cocaine abusers and 23 age-matched healthy controls participated. Cocaine abusers showed amplified anticipatory responses to reward predictive cues, but crucially, these responses were not as strongly modulated by reward probability as in controls. Cocaine users also showed blunted responses to feedback about task success or failure and did not use this information to update predictions about reward. In turn, they showed clearly blunted responses to reward feedback. In controls and users, measures of anhedonia were associated with reward motivation. In cocaine users, anhedonia was also associated with diminished monitoring and reward feedback responses. Findings imply that reward anticipation and monitoring deficiencies in addiction are associated with increased responsiveness to reward cues but impaired ability to predict reward in light of task contingencies, compounded by deficits in responding to actual reward outcomes.

[Do mastery goals buffer self-esteem from the threat of failure?].

PubMed

Niiya, Yu; Crocker, Jennifer

2007-12-01

Self-esteem is vulnerable when failure occurs in the domain where people base their self-worth (Crocker & Wolfe, 2001). We tested whether learning orientations can reduce the vulnerability of self-esteem associated with contingent self-worth and encourage persistence following failure. Our past research (Niiya, Crocker, & Bartmess, 2004) indicated that people who base their self-worth on academics maintain their self-esteem following failure when they are primed with an incremental theory of intelligence. Our present study extends these findings by (a) examining whether mastery goals (Elliot & Church, 1997) can also buffer self-esteem from failure, (b) using a different manipulation of success and failure, (c) using a different task, and (d) including a measure of persistence. We found that college students who based their self-esteem on academic competence reported lower self-esteem following failure than following success when they had low mastery goals, but the effect of success and failure was eliminated when students had high mastery goals. Moreover, high mastery students showed greater persistence following failure than low mastery students. The study provided converging evidence that learning orientations buffer self-esteem from failure.

Ethical sensitivity in obsessive-compulsive disorder and generalized anxiety disorder: the role of reversal learning.

PubMed

Szabó, Csilla; Németh, Attila; Kéri, Szabolcs

2013-12-01

In obsessive-compulsive disorder (OCD), amplified moral sensitivity may be related to the orbitofrontal-striatal circuit, which is also critical in reversal learning. This study examined three questions: (1) What aspects of ethical sensitivity is altered in OCD?; (2) What is the relationship between ethical sensitivity and reversal learning?; (3) Are potential alterations in ethical sensitivity and reversal learning present in generalized anxiety disorder (GAD)? Participants were 28 outpatients with OCD, 21 individuals with GAD, and 30 matched healthy controls. Participants received the ethical sensitivity scale questionnaire (ESSQ), rating scales for clinical symptoms, a reversal learning task, and the Wisconsin Card Sorting Test (WCST). We found higher ethical sensitivity scores in OCD compared with healthy controls in the case of generating interpretations and options and identifying the consequences of actions. Individuals with OCD displayed prolonged reaction times on probabilistic errors without shift and final reversal errors. Participants with GAD did not differ from healthy controls on the ESSQ, but they were slower on reversal learning relative to nonpatients. In OCD, reaction time on final reversal errors mediated the relationship between ethical sensitivity and compulsions. WCST performance was intact in OCD and GAD. Small sample size, limited neuropsychological assessment, self-rating scale for ethical sensitivity. Prolonged reaction time at switching reinforcement contingencies is related to increased ethical sensitivity in OCD. Slow affective switching may link ethical sensitivity and compulsions. Copyright © 2013 Elsevier Ltd. All rights reserved.

Fronto-temporal white matter connectivity predicts reversal learning errors

PubMed Central

Alm, Kylie H.; Rolheiser, Tyler; Mohamed, Feroze B.; Olson, Ingrid R.

2015-01-01

Each day, we make hundreds of decisions. In some instances, these decisions are guided by our innate needs; in other instances they are guided by memory. Probabilistic reversal learning tasks exemplify the close relationship between decision making and memory, as subjects are exposed to repeated pairings of a stimulus choice with a reward or punishment outcome. After stimulus–outcome associations have been learned, the associated reward contingencies are reversed, and participants are not immediately aware of this reversal. Individual differences in the tendency to choose the previously rewarded stimulus reveal differences in the tendency to make poorly considered, inflexible choices. Lesion studies have strongly linked reversal learning performance to the functioning of the orbitofrontal cortex, the hippocampus, and in some instances, the amygdala. Here, we asked whether individual differences in the microstructure of the uncinate fasciculus, a white matter tract that connects anterior and medial temporal lobe regions to the orbitofrontal cortex, predict reversal learning performance. Diffusion tensor imaging and behavioral paradigms were used to examine this relationship in 33 healthy young adults. The results of tractography revealed a significant negative relationship between reversal learning performance and uncinate axial diffusivity, but no such relationship was demonstrated in a control tract, the inferior longitudinal fasciculus. Our findings suggest that the uncinate might serve to integrate associations stored in the anterior and medial temporal lobes with expectations about expected value based on feedback history, computed in the orbitofrontal cortex. PMID:26150776

Differentiating Motivational from Affective Influence of Performance-contingent Reward on Cognitive Control: The Wanting Component Enhances Both Proactive and Reactive Control.

PubMed

Chaillou, Anne-Clémence; Giersch, Anne; Hoonakker, Marc; Capa, Rémi L; Bonnefond, Anne

2017-04-01

Positive affect strongly modulates goal-directed behaviors and cognitive control mechanisms. It often results from the presence of a pleasant stimulus in the environment, whether that stimulus appears unpredictably or as a consequence of a particular behavior. The influence of positive affect linked to a random pleasant stimulus differs from the influence of positive affect resulting from performance-contingent pleasant stimuli. However, the mechanisms by which the performance contingency of pleasant stimuli modulates the influence of positive affect on cognitive control mechanisms have not been elucidated. Here, we tested the hypothesis that these differentiated effects are the consequence of the activation of the motivational "wanting" component specifically under performance contingency conditions. To that end, we directly compared the effects on cognitive control of pleasant stimuli (a monetary reward) attributed in a performance contingent manner, and of random pleasant stimuli (positive picture) not related to performance, during an AX-CPT task. Both proactive and reactive modes of control were increased specifically by performance contingency, as reflected by faster reaction times and larger amplitude of the CNV and P3a components. Our findings advance our understanding of the respective effects of affect and motivation, which is of special interest regarding alterations of emotion-motivation interaction found in several psychopathological disorders. Copyright © 2017 Elsevier B.V. All rights reserved.

Study of space shuttle EVA/IVA support requirements. Volume 2: EVA/IVA tasks, guidelines, and constraints definition

NASA Technical Reports Server (NTRS)

Webbon, B. W.; Copeland, R. J.; Wood, P. W., Jr.; Cox, R. L.

1973-01-01

The guidelines for EVA and IVA tasks to be performed on the space shuttle are defined. In deriving tasks, guidelines, and constraints, payloads were first identified from the mission model. Payload requirements, together with man and manipulator capabilities, vehicle characteristics and operation, and safety considerations led to a definition of candidate tasks. Guidelines and constraints were also established from these considerations. Scenarios were established, and screening criteria, such as commonality of EVA and IVA activities, were applied to derive representative planned and unplanned tasks. The whole spectrum of credible contingency situations with a potential requirement for EVA/IVA was analyzed.

On Pedagogy

ERIC Educational Resources Information Center

Gergely, Gyorgy; Egyed, Katalin; Kiraly, Ildiko

2007-01-01

Humans are adapted to spontaneously transfer relevant cultural knowledge to conspecifics and to fast-learn the contents of such teaching through a human-specific social learning system called "pedagogy" ( Csibra & Gergely, 2006). Pedagogical knowledge transfer is triggered by specific communicative cues (such as eye-contact, contingent reactivity,…

Improving the Science Excursion: An Educational Technologist's View

ERIC Educational Resources Information Center

Balson, M.

1973-01-01

Analyzes the nature of the learning process and attempts to show how the three components of a reinforcement contingency, the stimulus, the response and the reinforcement can be utilized to increase the efficiency of a typical science learning experience, the excursion. (JR)

Learning Individual Talkers' Structural Preferences

ERIC Educational Resources Information Center

Kamide, Yuki

2012-01-01

Listeners are often capable of adjusting to the variability contained in individual talkers' (speakers') speech. The vast majority of findings on talker adaptation are concerned with learning the contingency between "phonological" characteristics and talker identity. In contrast, the present study investigates representations at a more abstract…

Neurological Correlates of Reward Responding in Adolescents With and Without Externalizing Behavior Disorders

PubMed Central

Gatzke-Kopp, Lisa M.; Beauchaine, Theodore P.; Shannon, Katherine E.; Chipman, Jane; Fleming, Andrew P.; Crowell, Sheila E.; Liang, Olivia; Aylward, Elizabeth; Johnson, L. Clark

2009-01-01

Opposing theories of striatal hyper- and hypodopaminergic functioning have been suggested in the pathophysiology of externalizing behavior disorders. To test these competing theories, the authors used functional MRI to evaluate neural activity during a simple reward task in 12- to 16-year-old boys with attention-deficit/hyperactivity disorder and/or conduct disorder (n = 19) and in controls with no psychiatric condition (n = 11). The task proceeded in blocks during which participants received either (a) monetary incentives for correct responses or (b) no rewards for correct responses. Controls exhibited striatal activation only during reward, shifting to anterior cingulate activation during nonreward. In contrast, externalizing adolescents exhibited striatal activation during both reward and nonreward. Externalizing psychopathology appears to be characterized by deficits in processing the omission of predicted reward, which may render behaviors that are acquired through environmental contingencies difficult to extinguish when those contingencies change. PMID:19222326

Meta-analysis of the effects of academic interventions and modifications on student behavior outcomes.

PubMed

Warmbold-Brann, Kristy; Burns, Matthew K; Preast, June L; Taylor, Crystal N; Aguilar, Lisa N

2017-09-01

The current study examined the effect of academic interventions and modifications on behavioral outcomes in a meta-analysis of 32 single-case design studies. Academic interventions included modifying task difficulty, providing instruction in reading, mathematics, or writing, and contingent reinforcement for academic performance. There was an overall small to moderate effect (ϕ = .56) on behavioral outcomes, with a stronger effect on increasing time on task (ϕ = .64) than on decreasing disruptive behavior (ϕ = .42). There was a small effect for using a performance-based contingent reinforcer (ϕ = .48). Interventions completed in an individual setting resulted in a moderate to large effects on behavior outcomes. Results of the current meta-analysis suggest that academic interventions can offer both positive academic and behavioral outcomes. Practical implications and suggestions for future research are included. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Resurgence of instrumental behavior after an abstinence contingency.

PubMed

Bouton, Mark E; Schepers, Scott T

2014-06-01

In resurgence, an extinguished instrumental behavior (R1) recovers when a behavior that has replaced it (R2) is also extinguished. The phenomenon may be relevant to understanding relapse that can occur after the termination of "contingency management" treatments, in which an unwanted behavior (e.g., substance abuse) is reduced by reinforcing an alternative behavior. When reinforcement is discontinued, the unwanted behavior might resurge. However, unlike most resurgence experiments, contingency management treatments also introduce a negative contingency, in which reinforcers are not delivered unless the client has abstained from the unwanted behavior. In two experiments with rats, we therefore examined the effects of adding a negative "abstinence" contingency to the resurgence design. During response elimination, R2 was not reinforced unless R1 had not been emitted for a minimum period of time (45, 90, or 135 s). In both experiments, adding such a contingency to simple R1 extinction reduced, but did not eliminate, resurgence. In Experiment 2, we found the same effect in a yoked group that could earn reinforcers for R2 at the same points in time as the negative-contingency group, but without the requirement to abstain from R1. Thus, the negative contingency per se did not contribute to the reduction in resurgence. These results suggest that the contingency reduced resurgence by making reinforcers more difficult to earn and more widely spaced in time. This could have allowed the animal to learn that R1 was extinguished in the "context" of infrequent reinforcement-a context more like that of resurgence testing. The results are thus consistent with a contextual (renewal) account of resurgence. The method might provide a better model of relapse after termination of a contingency management treatment.

Reward and attentional control in visual search.

PubMed

Yantis, Steven; Anderson, Brian A; Wampler, Emma K; Laurent, Patryk A

2012-01-01

It has long been known that the control of attention in visual search depends both on voluntary, top-down deployment according to context-specific goals, and on involuntary, stimulus-driven capture based on the physical conspicuity of perceptual objects. Recent evidence suggests that pairing target stimuli with reward can modulate the voluntary deployment of attention, but there is little evidence that reward modulates the involuntary deployment of attention to task-irrelevant distractors. We report several experiments that investigate the role of reward learning on attentional control. Each experiment involved a training phase and a test phase. In the training phase, different colors were associated with different amounts of monetary reward. In the test phase, color was not task-relevant and participants searched for a shape singleton; in most experiments no reward was delivered in the test phase. We first show that attentional capture by physically salient distractors is magnified by a previous association with reward. In subsequent experiments we demonstrate that physically inconspicuous stimuli previously associated with reward capture attention persistently during extinction--even several days after training. Furthermore, vulnerability to attentional capture by high-value stimuli is negatively correlated across individuals with working memory capacity and positively correlated with trait impulsivity. An analysis of intertrial effects reveals that value-driven attentional capture is spatially specific. Finally, when reward is delivered at test contingent on the task-relevant shape feature, recent reward history modulates value-driven attentional capture by the irrelevant color feature. The influence of learned value on attention may provide a useful model of clinical syndromes characterized by similar failures of cognitive control, including addiction, attention-deficit/hyperactivity disorder, and obesity.

Reward and Attentional Control in Visual Search

PubMed Central

Anderson, Brian A.; Wampler, Emma K.; Laurent, Patryk A.

2015-01-01

It has long been known that the control of attention in visual search depends both on voluntary, top-down deployment according to context-specific goals, and on involuntary, stimulus-driven capture based on the physical conspicuity of perceptual objects. Recent evidence suggests that pairing target stimuli with reward can modulate the voluntary deployment of attention, but there is little evidence that reward modulates the involuntary deployment of attention to task-irrelevant distractors. We report several experiments that investigate the role of reward learning on attentional control. Each experiment involved a training phase and a test phase. In the training phase, different colors were associated with different amounts of monetary reward. In the test phase, color was not task-relevant and participants searched for a shape singleton; in most experiments no reward was delivered in the test phase. We first show that attentional capture by physically salient distractors is magnified by a previous association with reward. In subsequent experiments we demonstrate that physically inconspicuous stimuli previously associated with reward capture attention persistently during extinction—even several days after training. Furthermore, vulnerability to attentional capture by high-value stimuli is negatively correlated across individuals with working memory capacity and positively correlated with trait impulsivity. An analysis of intertrial effects reveals that value-driven attentional capture is spatially specific. Finally, when reward is delivered at test contingent on the task-relevant shape feature, recent reward history modulates value-driven attentional capture by the irrelevant color feature. The influence of learned value on attention may provide a useful model of clinical syndromes characterized by similar failures of cognitive control, including addiction, attention-deficit/hyperactivity disorder, and obesity. PMID:23437631

Region-specific impairments in striatal synaptic transmission and impaired instrumental learning in a mouse model of Angelman syndrome

PubMed Central

Hayrapetyan, Volodya; Castro, Stephen; Sukharnikova, Tatyana; Yu, Chunxiu; Cao, Xinyu; Jiang, Yong-Hui; Yin, Henry H.

2018-01-01

Angelman syndrome (AS) is a neurodevelopmental disorder characterized by mental retardation and impaired speech. Because patients with this disorder often exhibit motor tremor and stereotypical behaviors, which are associated with basal ganglia pathology, we hypothesized that AS is accompanied by abnormal functioning of the striatum, the input nucleus of the basal ganglia. Using mutant mice with maternal deficiency of AS E6-AP ubiquitin protein ligase Ube3a (Ube3am−/p+), we assessed the effects of Ube3a deficiency on instrumental conditioning, a striatum-dependent task. We used whole-cell patch-clamp recording to measure glutamatergic transmission in the dorsomedial striatum (DMS) and dorsolateral striatum (DLS). Ube3am−/p+ mice were severely impaired in initial acquisition of lever pressing. Whereas the lever pressing of wild-type controls was reduced by outcome devaluation and instrumental contingency reversal, the performance of Ube3am−/p+ mice were more habitual, impervious to changes in outcome value and action–outcome contingency. In the DMS, but not the DLS, Ube3am−/p+ mice showed reduced amplitude and frequency of miniature excitatory postsynaptic currents. These results show for the first time a selective deficit in instrumental conditioning in the Ube3a deficient mouse model, and suggest a specific impairment in glutmatergic transmission in the associative corticostriatal circuit in AS. PMID:24329862

Locus coeruleus activation accelerates perceptual learning.

PubMed

Glennon, Erin; Carcea, Ioana; Martins, Ana Raquel O; Multani, Jasmin; Shehu, Ina; Svirsky, Mario A; Froemke, Robert C

2018-05-31

Neural representations of the external world are constructed and updated in a manner that depends on behavioral context. For neocortical networks, this contextual information is relayed by a diverse range of neuromodulatory systems, which govern attention and signal the value of internal state variables such as arousal, motivation, and stress. Neuromodulators enable cortical circuits to differentially process specific stimuli and modify synaptic strengths in order to maintain short- or long-term memory traces of significant perceptual events and behavioral episodes. One of the most important subcortical neuromodulatory systems for attention and arousal is the noradrenergic locus coeruleus. Here we report that the noradrenergic system can enhance behavior in rats performing a self-initiated auditory recognition task, and optogenetic stimulation of noradrenergic locus coeruleus neurons accelerated the rate at which trained rats began correctly responding to a change in reward contingency. Animals successively progressed through distinct behavioral epochs, including periods of perseverance and exploration that occurred much more rapidly when animals received locus coeruleus stimulation. In parallel, we made recordings from primary auditory cortex and found that pairing tones with locus coeruleus stimulation led to a similar set of changes to cortical tuning profiles. Thus both behavioral and neural responses go through phases of adjustment for exploring and exploiting environmental reward contingencies. Furthermore, behavioral engagement does not necessarily recruit optimal locus coeruleus activity. Copyright © 2018. Published by Elsevier B.V.

Baby FaceTime: Can Toddlers Learn from Online Video Chat?

ERIC Educational Resources Information Center

Myers, Lauren J.; LeWitt, Rachel B.; Gallo, Renee E.; Maselli, Nicole M.

2017-01-01

There is abundant evidence for the "video deficit": children under 2 years old learn better in person than from video. We evaluated whether these findings applied to video chat by testing whether children aged 12-25 months could form relationships with and learn from on-screen partners. We manipulated social contingency: children…

The Other Half: Non-Tenure Track Faculty Thoughts on Student Learning Outcomes Assessment

ERIC Educational Resources Information Center

Danley-Scott, Jennifer; Scott, Gray

2014-01-01

Articles on student learning outcomes assessment often treat faculty as one homogenous body. Yet the exponential growth of contingent faculty in universities and colleges has created two distinct faculty groups with varied concerns and thoughts on everything from the future of higher education to shared governance to student learning outcomes.…

Luck and Learning: Feedback Contingencies and Initial Success in Verbal Discrimination Learning.

ERIC Educational Resources Information Center

Schneider, H. G.; Ferrante, A. P.

1983-01-01

A total of 90 undergraduate volunteers learned a 12-pair, low-frequency verbal discrimination list. Independent variables were feedback (positive only, negative only, or both) and initial success (17, 50, or 83 percent correct on the first trial). While the main effect of feedback was not significant, that of initial success was. (Author/RH)

Online Learning in Management Education: An Empirical Study of the Role of Personality Traits

ERIC Educational Resources Information Center

Varela, Otmar E.; Cater, John James, III; Michel, Norbert

2012-01-01

In this study we seek to better understand the outcomes of online education by observing the role of learners' personality traits. Under the premise that the behaviors that maximize learning are contingent on the delivery method, we compared learning outcomes of students participating in four sections of an undergraduate principles of management…

Modification of Comprehension Deficits in Learning Disabled Children.

ERIC Educational Resources Information Center

Swanson, Lee

1981-01-01

Three experiments investigated the effects of self recording, tokens and contingent free time on learning disabled children's reading comprehension performance. Results of these three experiments supported recent findings that only minimal changes occur on comprehension performance when left as an untargeted dependent behavior. (Author)

The Role of the Rat Medial Prefrontal Cortex in Adapting to Changes in Instrumental Contingency

PubMed Central

Coutureau, Etienne; Esclassan, Frederic; Di Scala, Georges; Marchand, Alain R.

2012-01-01

In order to select actions appropriate to current needs, a subject must identify relationships between actions and events. Control over the environment is determined by the degree to which action consequences can be predicted, as described by action-outcome contingencies – i.e. performing an action should affect the probability of the outcome. We evaluated in a first experiment adaptation to contingency changes in rats with neurotoxic lesions of the medial prefrontal cortex. Results indicate that this brain region is not critical to adjust instrumental responding to a negative contingency where the rats must refrain from pressing a lever, as this action prevents reward delivery. By contrast, this brain region is required to reduce responding in a non-contingent situation where the same number of rewards is freely delivered and actions do not affect the outcome any more. In a second experiment, we determined that this effect does not result from a different perception of temporal relationships between actions and outcomes since lesioned rats adapted normally to gradually increasing delays in reward delivery. These data indicate that the medial prefrontal cortex is not directly involved in evaluating the correlation between action-and reward-rates or in the perception of reward delays. The deficit in lesioned rats appears to consist of an abnormal response to the balance between contingent and non-contingent rewards. By highlighting the role of prefrontal regions in adapting to the causal status of actions, these data contribute to our understanding of the neural basis of choice tasks. PMID:22496747

Causal learning and inference as a rational process: the new synthesis.

PubMed

Holyoak, Keith J; Cheng, Patricia W

2011-01-01

Over the past decade, an active line of research within the field of human causal learning and inference has converged on a general representational framework: causal models integrated with bayesian probabilistic inference. We describe this new synthesis, which views causal learning and inference as a fundamentally rational process, and review a sample of the empirical findings that support the causal framework over associative alternatives. Causal events, like all events in the distal world as opposed to our proximal perceptual input, are inherently unobservable. A central assumption of the causal approach is that humans (and potentially nonhuman animals) have been designed in such a way as to infer the most invariant causal relations for achieving their goals based on observed events. In contrast, the associative approach assumes that learners only acquire associations among important observed events, omitting the representation of the distal relations. By incorporating bayesian inference over distributions of causal strength and causal structures, along with noisy-logical (i.e., causal) functions for integrating the influences of multiple causes on a single effect, human judgments about causal strength and structure can be predicted accurately for relatively simple causal structures. Dynamic models of learning based on the causal framework can explain patterns of acquisition observed with serial presentation of contingency data and are consistent with available neuroimaging data. The approach has been extended to a diverse range of inductive tasks, including category-based and analogical inferences.

The Funding Of Boko Haram And Nigerias Actions To Stop It

DTIC Science & Technology

2016-12-01

Group against Money Laundering in West Africa GSCF Global Security Contingency Fund ISIS Islamic State of Iraq and Syria JTF joint task force...78. 5 Inter-Governmental Action Group against Money Laundering in West Africa (GIABA) and the Financial Action Task Force (FATF) believed that...has failed to address deficiencies such as money laundering and terrorist financing within its banks.96 Having a financial intelligence unit within a

Testosterone shifts the balance between sensitivity for punishment and reward in healthy young women.

PubMed

van Honk, Jack; Schutter, Dennis J L G; Hermans, Erno J; Putman, Peter; Tuiten, Adriaan; Koppeschaar, Hans

2004-08-01

Animal research has demonstrated reductions in punishment sensitivity and enhanced reward dependency after testosterone administration. In humans, elevated levels of testosterone have been associated with violent and antisocial behavior. Interestingly, extreme forms of violent and antisocial behavior can be observed in the psychopath. Moreover, it has been argued that reduced punishment sensitivity and heightened reward dependency are crucially involved in the etiology and maintenance of psychopathy. A task that has been proven to be capable of simulating punishment-reward contingencies is the IOWA gambling task. Decisions to choose from decks of cards become motivated by punishment and reward schedules inherent in the task. Importantly, clinical and subclinical psychopaths demonstrate a risky, disadvantageous pattern of decision-making in the task, indicating motivational imbalance (insensitivity for punishment and enhanced reward dependency). Here, in a double-blind placebo-controlled crossover design (n = 12), whether a single administration of testosterone would shift the motivational balance between the sensitivity for punishment and reward towards this tendency to choose disadvantageously was investigated. As hypothesized, subjects showed a more disadvantageous pattern of decision-making after testosterone compared to placebo administration. These findings not only provide the first direct evidence for the effects of testosterone on punishment-reward contingencies in humans, but they also give further insights into the hypothetical link between testosterone and psychopathy.

Let me take the wheel: Illusory control and sense of agency

PubMed Central

Tobias-Webb, Juliette; Limbrick-Oldfield, Eve H.; Gillan, Claire M.; Moore, James W.; Aitken, Michael R. F.; Clark, Luke

2017-01-01

ABSTRACT Illusory control refers to an effect in games of chance where features associated with skilful situations increase expectancies of success. Past work has operationalized illusory control in terms of subjective ratings or behaviour, with limited consideration of the relationship between these definitions, or the broader construct of agency. This study used a novel card-guessing task in 78 participants to investigate the relationship between subjective and behavioural illusory control. We compared trials in which participants (a) had no opportunity to exercise illusory control, (b) could exercise illusory control for free, or (c) could pay to exercise illusory control. Contingency Judgment and Intentional Binding tasks assessed explicit and implicit sense of agency, respectively. On the card-guessing task, confidence was higher when participants exerted control than in the baseline condition. In a complementary model, participants were more likely to exercise control when their confidence was high, and this effect was accentuated in the pay condition relative to the free condition. Decisions to pay were positively correlated with control ratings on the Contingency Judgment task, but were not significantly related to Intentional Binding. These results establish an association between subjective and behavioural illusory control and locate the construct within the cognitive literature on agency. PMID:27376771

Magnifying Smartphone Screen Using Google Glass for Low-Vision Users.

PubMed

Pundlik, Shrinivas; HuaQi Yi; Rui Liu; Peli, Eli; Gang Luo

2017-01-01

Magnification is a key accessibility feature used by low-vision smartphone users. However, small screen size can lead to loss of context and make interaction with magnified displays challenging. We hypothesize that controlling the viewport with head motion can be natural and help in gaining access to magnified displays. We implement this idea using a Google Glass that displays the magnified smartphone screenshots received in real time via Bluetooth. Instead of navigating with touch gestures on the magnified smartphone display, the users can view different screen locations by rotating their head, and remotely interacting with the smartphone. It is equivalent to looking at a large virtual image through a head contingent viewing port, in this case, the Glass display with ~ 15 ° field of view. The system can transfer seven screenshots per second at 8 × magnification, sufficient for tasks where the display content does not change rapidly. A pilot evaluation of this approach was conducted with eight normally sighted and four visually impaired subjects performing assigned tasks using calculator and music player apps. Results showed that performance in the calculation task was faster with the Glass than with the phone's built-in screen zoom. We conclude that head contingent scanning control can be beneficial in navigating magnified small smartphone displays, at least for tasks involving familiar content layout.

Biases in probabilistic category learning in relation to social anxiety

PubMed Central

Abraham, Anna; Hermann, Christiane

2015-01-01

Instrumental learning paradigms are rarely employed to investigate the mechanisms underlying acquired fear responses in social anxiety. Here, we adapted a probabilistic category learning paradigm to assess information processing biases as a function of the degree of social anxiety traits in a sample of healthy individuals without a diagnosis of social phobia. Participants were presented with three pairs of neutral faces with differing probabilistic accuracy contingencies (A/B: 80/20, C/D: 70/30, E/F: 60/40). Upon making their choice, negative and positive feedback was conveyed using angry and happy faces, respectively. The highly socially anxious group showed a strong tendency to be more accurate at learning the probability contingency associated with the most ambiguous stimulus pair (E/F: 60/40). Moreover, when pairing the most positively reinforced stimulus or the most negatively reinforced stimulus with all the other stimuli in a test phase, the highly socially anxious group avoided the most negatively reinforced stimulus significantly more than the control group. The results are discussed with reference to avoidance learning and hypersensitivity to negative socially evaluative information associated with social anxiety. PMID:26347685

A Pattern of Perseveration in Cocaine Addiction May Reveal Neurocognitive Processes Implicit in the Wisconsin Card Sorting Test

PubMed Central

Woicik, Patricia A.; Urban, Catherine; Alia-Klein, Nelly; Henry, Ashley; Maloney, Thomas; Telang, Frank; Wang, Gene-Jack; Volkow, Nora D.; Goldstein, Rita Z.

2011-01-01

The ability to adapt behavior in a changing environment is necessary for humans to achieve their goals and can be measured in the lab with tests of rule-based switching. Disease models, such as cocaine addiction, have revealed that alterations in dopamine interfere with adaptive set switching, culminating in perseveration. We explore perseverative behavior in individuals with cocaine use disorders (CUD) and healthy controls (CON) during performance of the Wisconsin Card Sorting Test (WCST) (N = 107 in each group). By examining perseverative errors within each of the 6 blocks of the WCST, we uniquely test two forms of set switching that are differentiated by either the presence (extradimensional set shifting (EDS) – first 3 blocks) or absence (task-set switching – last 3 blocks) of contingency learning. We also explore relationships between perseveration and select cognitive and drug use factors including verbal learning and memory, trait inhibitory control, motivational state, and urine status for cocaine (in CUD). Results indicate greater impairment for CUD than CON on the WCST, even in higher performing CUD who completed all 6 blocks of the WCST. Block by block analysis conducted on completers’ scores indicate a tendency for greater perseveration in CUD than CON but only during the first task-set switch; no such deficits were observed during EDS. This task-set switching impairment was modestly associated with two indices of immediate recall (r = −.32, −.29) and urine status for cocaine [t (134) = 2.3, p <.03]. By distinguishing these two forms of switching on the WCST, the current study reveals a neurocognitive context (i.e. initial stage of task-set switching) implicit in the WCST that possibly relies upon intact dopaminergic function, but that is impaired in CUD, as associated with worse recall and possibly withdrawal from cocaine. Future studies should investigate whether dopaminergically innervated pathways alone, or in combination with other monoamines, underlie this implicit neurocognitive processes in the WCST. PMID:21392517

Slower reacquisition after partial extinction in human contingency learning.

PubMed

Morís, Joaquín; Barberia, Itxaso; Vadillo, Miguel A; Andrades, Ainhoa; López, Francisco J

2017-01-01

Extinction is a very relevant learning phenomenon from a theoretical and applied point of view. One of its most relevant features is that relapse phenomena often take place once the extinction training has been completed. Accordingly, as extinction-based therapies constitute the most widespread empirically validated treatment of anxiety disorders, one of their most important limitations is this potential relapse. We provide the first demonstration of relapse reduction in human contingency learning using mild aversive stimuli. This effect was found after partial extinction (i.e., reinforced trials were occasionally experienced during extinction, Experiment 1) and progressive extinction treatments (Experiment 3), and it was not only because of differences in uncertainty levels between the partial and a standard extinction group (Experiment 2). The theoretical explanation of these results, the potential uses of this strategy in applied situations, and its current limitations are discussed. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Indirect measures as a signal for evaluative change.

PubMed

Perugini, Marco; Richetin, Juliette; Zogmaister, Cristina

2014-01-01

Implicit and explicit attitudes can be changed by using evaluative learning procedures. In this contribution we investigated an asymmetric effect of order of administration of indirect and direct measures on the detection of evaluative change: A change in explicit attitudes is more likely detected if they are measured after implicit attitudes, whereas these latter change regardless of the order. This effect was demonstrated in two studies (n=270; n=138) using the self-referencing task whereas it was not found in a third study (n=151) that used a supraliminal sequential evaluative conditioning paradigm. In all studies evaluative change was present only for contingency aware participants. We discuss a potential explanation underlying the order of measure effect entailing that, in some circumstances, an indirect measure is not only a measure but also a signal that can be detected through self-perception processes and further elaborated at the propositional level.

A short educational intervention diminishes causal illusions and specific paranormal beliefs in undergraduates

PubMed Central

Tubau, Elisabet; Matute, Helena

2018-01-01

Cognitive biases such as causal illusions have been related to paranormal and pseudoscientific beliefs and, thus, pose a real threat to the development of adequate critical thinking abilities. We aimed to reduce causal illusions in undergraduates by means of an educational intervention combining training-in-bias and training-in-rules techniques. First, participants directly experienced situations that tend to induce the Barnum effect and the confirmation bias. Thereafter, these effects were explained and examples of their influence over everyday life were provided. Compared to a control group, participants who received the intervention showed diminished causal illusions in a contingency learning task and a decrease in the precognition dimension of a paranormal belief scale. Overall, results suggest that evidence-based educational interventions like the one presented here could be used to significantly improve critical thinking skills in our students. PMID:29385184

Aging and Integration of Contingency Evidence in Causal Judgment

PubMed Central

Mutter, Sharon A.; Plumlee, Leslie F.

2009-01-01

Age differences in causal judgment are consistently greater for preventative/negative relationships than for generative/positive relationships. We used a feature analytic procedure (Mandel & Lehman, 1998) to determine whether this effect might be due to differences in young and older adults’ integration of contingency evidence during causal induction. To reduce the impact of age-related changes in learning/memory we presented contingency evidence for preventative, non-contingent, and generative relationships in summary form and to induce participants to integrate greater or lesser amounts of this evidence, we varied the meaningfulness of the causal context. Young adults showed greater flexibility in their integration processes than older adults. In an abstract causal context, there were no age differences in causal judgment or integration, but in meaningful contexts, young adults’ judgments for preventative relationships were more accurate than older adults’ and they assigned more weight to the contingency evidence confirming these relationships. These differences were mediated by age-related changes in processing speed. The decline in this basic cognitive resource may place boundaries on the amount or the type of evidence that older adults can integrate for causal judgment. PMID:20025406

Voluntary modulation of anterior cingulate response to negative feedback.

PubMed

Shane, Matthew S; Weywadt, Christina R

2014-01-01

Anterior cingulate and medial frontal cortex (dACC/mFC) response to negative feedback represents the actions of a generalized error-monitoring system critical for the management of goal-directed behavior. Magnitude of dACC/mFC response to negative feedback correlates with levels of post-feedback behavioral change, and with proficiency of operant learning processes. With this in mind, it follows that an ability to alter dACC/mFC response to negative feedback may lead to representative changes in operant learning proficiency. To this end, the present study investigated the extent to which healthy individuals would show modulation of their dACC/mFC response when instructed to try to either maximize or minimize their neural response to the presentation of contingent negative feedback. Participants performed multiple runs of a standard time-estimation task, during which they received feedback regarding their ability to accurately estimate a one-second duration. On Watch runs, participants were simply instructed to try to estimate as closely as possible the one second duration. On Increase and Decrease runs, participants performed the same task, but were instructed to "try to increase [decrease] their brain's response every time they received negative feedback". Results indicated that participants showed changes in dACC/mFC response under these differing instructional conditions: dACC/mFC activity following negative feedback was higher in the Increase condition, and dACC activity trended lower in the Decrease condition, compared to the Watch condition. Moreover, dACC activity correlated with post-feedback performance adjustments, and these adjustments were highest in the Increase condition. Potential implications for neuromodulation and facilitated learning are discussed.

Lesions of the Medial Striatum in Monkeys Produce Perseverative Impairments during Reversal Learning Similar to Those Produced by Lesions of the Orbitofrontal Cortex

PubMed Central

Clarke, Hannah F.; Robbins, Trevor W.; Roberts, Angela C.

2014-01-01

The ability to switch responding between two visual stimuli based on their changing relationship with reward is dependent on the orbitofrontal cortex (OFC). OFC lesions in humans, monkeys, and rats disrupt performance on a common test of this ability, the visual serial discrimination reversal task. This finding is of particular significance to our understanding of psychiatric disorders such as obsessive–compulsive disorder (OCD) and schizophrenia, in which behavioral inflexibility is a prominent symptom. Although OFC dysfunction can occur in these disorders, there is considerable evidence for more widespread dysfunction within frontostriatal and frontoamygdalar circuitry. Because the contribution of these subcortical structures to behavioral flexibility is poorly understood, the present study compared the effects of excitotoxic lesions of the medial striatum (MS), amygdala, and OFC in the marmoset monkey on performance of the serial reversal task. All monkeys were able to learn a novel stimulus–reward association but, compared with both control and amygdala-lesioned monkeys, those with MS or OFC lesions showed a perseverative impairment in their ability to reverse this association. However, whereas both MS and OFC groups showed insensitivity to negative feedback, only OFC-lesioned monkeys showed insensitivity to positive feedback. These findings suggest that, for different reasons, both the MS and OFC support behavioral flexibility after changes in reward contingencies, and are consistent with the hypothesis that striatal and OFC dysfunction can contribute to pathological perseveration. PMID:18945905

Scaling Up, "Writ Small": Using an Assessment for Learning Audit Instrument to Stimulate Site-Based Professional Development, One School at a Time

ERIC Educational Resources Information Center

Lysaght, Zita; O'Leary, Michael

2017-01-01

Exploiting the potential that Assessment for Learning (AfL) offers to optimise student learning is contingent on both teachers' knowledge and use of AfL and the fidelity with which this translates into their daily classroom practices. Quantitative data derived from the use of an Assessment for Learning Audit Instrument (AfLAI) with a large sample…

The New Normalcy: Sea Power and Contingency Operations in the Twenty-First Century

DTIC Science & Technology

2012-07-01

applied to them effectively. But recent lessons in how this may be accomplished have not been readily learned. Sea-power theory remains largely focused on...range of conspiracy theories concerning government actions, all of which had to be addressed in a frenzy of government briefings and presentations...hurricane, or environmental event should be as diverse as the contingencies themselves—and it is, in theory . But theory can fall short when butting against

NASA Headquarters Space Operations Center: Providing Situational Awareness for Spaceflight Contingency Response

NASA Technical Reports Server (NTRS)

Maxwell, Theresa G.; Bihner, William J.

2010-01-01

This paper discusses the NASA Headquarters mishap response process for the Space Shuttle and International Space Station programs, and how the process has evolved based on lessons learned from the Space Shuttle Challenger and Columbia accidents. It also describes the NASA Headquarters Space Operations Center (SOC) and its special role in facilitating senior management's overall situational awareness of critical spaceflight operations, before, during, and after a mishap, to ensure a timely and effective contingency response.

Neural correlates of instrumental contingency learning: Differential effects of action-reward conjunction and disjunction

PubMed Central

Liljeholm, Mimi; Tricomi, Elizabeth; O’Doherty, John P.; Balleine, Bernard W.

2011-01-01

Contingency theories of goal-directed action propose that experienced disjunctions between an action and its specific consequences, as well as conjunctions between these events, contribute to encoding the action-outcome association. Although considerable behavioral research in rats and humans has provided evidence for this proposal, relatively little is known about the neural processes that contribute to the two components of the contingency calculation. Specifically, while recent findings suggest that the influence of action-outcome conjunctions on goal-directed learning is mediated by a circuit involving ventromedial prefrontal, medial orbitofrontal cortex and dorsomedial striatum, the neural processes that mediate the influence of experienced disjunctions between these events are unknown. Here we show differential responses to probabilities of conjunctive and disjunctive reward deliveries in the ventromedial prefrontal cortex, the dorsomedial striatum, and the inferior frontal gyrus. Importantly, activity in the inferior parietal lobule and the left middle frontal gyrus varied with a formal integration of the two reward probabilities, ΔP, as did response rates and explicit judgments of the causal efficacy of the action. PMID:21325514

Vocal Learning via Social Reinforcement by Infant Marmoset Monkeys.

PubMed

Takahashi, Daniel Y; Liao, Diana A; Ghazanfar, Asif A

2017-06-19

For over half a century now, primate vocalizations have been thought to undergo little or no experience-dependent acoustic changes during development [1]. If any changes are apparent, then they are routinely (and quite reasonably) attributed to the passive consequences of growth. Indeed, previous experiments on squirrel monkeys and macaque monkeys showed that social isolation [2, 3], deafness [2], cross-fostering [4] and parental absence [5] have little or no effect on vocal development. Here, we explicitly test in marmoset monkeys-a very vocal and cooperatively breeding species [6]-whether the transformation of immature into mature contact calls by infants is influenced by contingent parental vocal feedback. Using a closed-loop design, we experimentally provided more versus less contingent vocal feedback to twin infant marmoset monkeys over their first 2 months of life, the interval during which their contact calls transform from noisy, immature calls to tonal adult-like "phee" calls [7, 8]. Infants who received more contingent feedback had a faster rate of vocal development, producing mature-sounding contact calls earlier than the other twin. The differential rate of vocal development was not linked to genetics, perinatal experience, or body growth; nor did the amount of contingency influence the overall rate of spontaneous vocal production. Thus, we provide the first experimental evidence for production-related vocal learning during the development of a nonhuman primate. Copyright © 2017 Elsevier Ltd. All rights reserved.

Repeated Activation of a CS-US-Contingency Memory Results in Sustained Conditioned Responding

PubMed Central

Joos, Els; Vansteenwegen, Debora; Vervliet, Bram; Hermans, Dirk

2013-01-01

Individuals seem to differ in conditionability, i.e., the ease by which the contingent presentation of two stimuli will lead to a conditioned response. In contemporary learning theory, individual differences in the etiology and maintenance of anxiety disorders are, among others, explained by individual differences in temperamental variables (Mineka and Zinbarg, 2006). One such individual difference variable is how people process a learning experience when the conditioning stimuli are no longer present. Repeatedly thinking about the conditioning experience, as in worry or rumination, might prolong the initial (fear) reactions and as such, might leave certain individuals more vulnerable to developing an anxiety disorder. However, in human conditioning research, relatively little attention has been devoted to the processing of a memory trace after its initial acquisition, despite its potential influences on subsequent performance. Post-acquisition processing can be induced by mental reiteration of a conditioned stimulus-unconditioned stimulus (CS-US)-contingency. Using a human conditioned suppression paradigm, we investigated the effect of repeated activations of a CS-US-contingency memory on the level of conditioned responding at a later test. Results of three experiments showed more sustained responding to a “rehearsed” CS+ as compared to a “non-rehearsed” CS+. Moreover, the second experiment showed no effect of rehearsal when only the CS was rehearsed instead of the CS-US-contingency. The third experiment demonstrated that mental CS-US-rehearsal has the same effect regardless of whether it was cued by the CS and a verbal reference to the US or by a neutral signal, making the rehearsal “purely mental.” In sum, it was demonstrated that post-acquisition activation of a CS-US-contingency memory can impact conditioned responding, underlining the importance of post-acquisition processes in conditioning. This might indicate that individuals who are more prone to mentally rehearse information condition more easily. PMID:23755034

Repeated Activation of a CS-US-Contingency Memory Results in Sustained Conditioned Responding.

PubMed

Joos, Els; Vansteenwegen, Debora; Vervliet, Bram; Hermans, Dirk

2013-01-01

Individuals seem to differ in conditionability, i.e., the ease by which the contingent presentation of two stimuli will lead to a conditioned response. In contemporary learning theory, individual differences in the etiology and maintenance of anxiety disorders are, among others, explained by individual differences in temperamental variables (Mineka and Zinbarg, 2006). One such individual difference variable is how people process a learning experience when the conditioning stimuli are no longer present. Repeatedly thinking about the conditioning experience, as in worry or rumination, might prolong the initial (fear) reactions and as such, might leave certain individuals more vulnerable to developing an anxiety disorder. However, in human conditioning research, relatively little attention has been devoted to the processing of a memory trace after its initial acquisition, despite its potential influences on subsequent performance. Post-acquisition processing can be induced by mental reiteration of a conditioned stimulus-unconditioned stimulus (CS-US)-contingency. Using a human conditioned suppression paradigm, we investigated the effect of repeated activations of a CS-US-contingency memory on the level of conditioned responding at a later test. Results of three experiments showed more sustained responding to a "rehearsed" CS+ as compared to a "non-rehearsed" CS+. Moreover, the second experiment showed no effect of rehearsal when only the CS was rehearsed instead of the CS-US-contingency. The third experiment demonstrated that mental CS-US-rehearsal has the same effect regardless of whether it was cued by the CS and a verbal reference to the US or by a neutral signal, making the rehearsal "purely mental." In sum, it was demonstrated that post-acquisition activation of a CS-US-contingency memory can impact conditioned responding, underlining the importance of post-acquisition processes in conditioning. This might indicate that individuals who are more prone to mentally rehearse information condition more easily.

Changes in Organizational Leadership and the Behavior of Relationship- and Task-Motivated Leaders

ERIC Educational Resources Information Center

Bons, Paul M.; Fiedler, Fred E.

1976-01-01

This study, based on Fiedler's Contingency Model of Leadership Effectiveness, examines the effect of job rotation, succession, and reassignment of superiors on the behavior and performance of a sample of 115 infantry squad leaders. (Author)

Administrator Training and Development: Conceptual Model.

ERIC Educational Resources Information Center

Boardman, Gerald R.

A conceptual model for an individualized training program for school administrators integrates processes, characteristics, and tasks through theory training and application. Based on an application of contingency theory, it provides a system matching up administrative candidates' needs in three areas (administrative process, administrative…

Motor-visual neurons and action recognition in social interactions.

PubMed

de la Rosa, Stephan; Bülthoff, Heinrich H

2014-04-01

Cook et al. suggest that motor-visual neurons originate from associative learning. This suggestion has interesting implications for the processing of socially relevant visual information in social interactions. Here, we discuss two aspects of the associative learning account that seem to have particular relevance for visual recognition of social information in social interactions - namely, context-specific and contingency based learning.

The Identification and Establishment of Reinforcement for Collaboration in Elementary Students

ERIC Educational Resources Information Center

Darcy, Laura

2017-01-01

In Experiment 1, I conducted a functional analysis of student rate of learning with and without a peer-yoked contingency for 12 students in Kindergarten through 2nd grade in order to determine if they had conditioned reinforcement for collaboration. Using an ABAB reversal design, I compared rate of learning as measured by learn units to criterion…

Resurgence of instrumental behavior after an abstinence contingency

PubMed Central

Bouton, Mark E.; Schepers, Scott T.

2014-01-01

In resurgence, an extinguished instrumental behavior (R1) recovers when a behavior that replaced it (R2) is also extinguished. The phenomenon may be relevant to understanding relapse that can occur after the termination of “contingency management” treatments, in which unwanted behavior (e.g., substance abuse) is reduced by reinforcing alternative behavior. When reinforcement is discontinued, the unwanted behavior might resurge. However, unlike most resurgence experiments, contingency management treatments also introduce a negative contingency in which reinforcers are not delivered unless the client has abstained from the unwanted behavior. Two experiments with rats therefore examined the effects of adding a negative “abstinence” contingency to the resurgence design. During response elimination, R2 was not reinforced unless R1 had not been emitted for a minimum period of time (45, 90, or 135 s). In both experiments, adding such a contingency to simple R1 extinction reduced, but did not eliminate, resurgence. Experiment 2 found the same effect in a yoked group that could earn reinforcers for R2 at the same points in time, but without the requirement to abstain from R1. Thus, the negative contingency per se did not contribute. Results suggest that the contingency reduced resurgence by making reinforcers more difficult to earn and more widely spaced in time. This could have allowed the animal to learn that R1 was extinguished in the “context” of infrequent reinforcement—a context more like that of resurgence testing. The results are thus consistent with a contextual (renewal) account of resurgence. The method might provide a better model of relapse after termination of a contingency management treatment. PMID:24366673

From feedback- to response-based performance monitoring in active and observational learning.

PubMed

Bellebaum, Christian; Colosio, Marco

2014-09-01

Humans can adapt their behavior by learning from the consequences of their own actions or by observing others. Gradual active learning of action-outcome contingencies is accompanied by a shift from feedback- to response-based performance monitoring. This shift is reflected by complementary learning-related changes of two ACC-driven ERP components, the feedback-related negativity (FRN) and the error-related negativity (ERN), which have both been suggested to signal events "worse than expected," that is, a negative prediction error. Although recent research has identified comparable components for observed behavior and outcomes (observational ERN and FRN), it is as yet unknown, whether these components are similarly modulated by prediction errors and thus also reflect behavioral adaptation. In this study, two groups of 15 participants learned action-outcome contingencies either actively or by observation. In active learners, FRN amplitude for negative feedback decreased and ERN amplitude in response to erroneous actions increased with learning, whereas observational ERN and FRN in observational learners did not exhibit learning-related changes. Learning performance, assessed in test trials without feedback, was comparable between groups, as was the ERN following actively performed errors during test trials. In summary, the results show that action-outcome associations can be learned similarly well actively and by observation. The mechanisms involved appear to differ, with the FRN in active learning reflecting the integration of information about own actions and the accompanying outcomes.

Redundancy Matters: Flexible Learning of Multiple Contingencies in Infants

ERIC Educational Resources Information Center

Sloutsky, Vladimir M.; Robinson, Christopher W.

2013-01-01

Many objects and events can be categorized in different ways, and learning multiple categories in parallel often requires flexibly attending to different stimulus dimensions in different contexts. Although infants and young children often exhibit poor attentional control, several theoretical proposals argue that such flexibility can be achieved…

Making Judgments on the Basis for Workplace Learning: Towards an Epistemology of Practice.

ERIC Educational Resources Information Center

Beckett, David; Hager, Paul

2000-01-01

Interviews illustrating professional judgment support characteristics of informal workplace learning: contingent, practical, process, particular, and affective-social. Growth in the capacity to make judgments occurs in three ways (1) ability to separate initial need from actualization of judgment; (2) ability to interpret conative-emotive and…

Learning Analytics as Assemblage: Criticality and Contingency in Online Education

ERIC Educational Resources Information Center

Scott, John; Nichols, T. Philip

2017-01-01

Recently, the possibilities for leveraging "big data" in research and pedagogy have given rise to the growing field of "learning analytics" in online education. While much of this work has focused on quantitative metrics, some have called for critical perspectives that interrogate such data as an interplay between technical…

Learning with Sound Recordings: A History of Suzuki's Mediated Pedagogy

ERIC Educational Resources Information Center

Thibeault, Matthew D.

2018-01-01

This article presents a history of mediated pedagogy in the Suzuki Method, the first widespread approach to learning an instrument in which sound recordings were central. Media are conceptualized as socially constituted: philosophical ideas, pedagogic practices, and cultural values that together form a contingent and changing technological…

Influence of Contextual Challenges and Constraints on Learning-Centered Leadership

ERIC Educational Resources Information Center

Tan, Cheng Yong

2014-01-01

The present study examines from the contingency opportunities perspective the influence of contextual factors on principals' learning-centered leadership using HLM. Participants were 18,641 school principals from 73 jurisdictions who participated in the Programme for International Student Assessment (PISA) 2009. Results showed that principals were…

Effects of Reinforcement on Peer Imitation in a Small Group Play Context

ERIC Educational Resources Information Center

Barton, Erin E.; Ledford, Jennifer R.

2018-01-01

Children with disabilities often have deficits in imitation skills, particularly in imitating peers. Imitation is considered a behavioral cusp--which, once learned, allows a child to access additional and previously unavailable learning opportunities. In the current study, researchers examined the efficacy of contingent reinforcement delivered…

Acquisition of Automatic Imitation Is Sensitive to Sensorimotor Contingency

ERIC Educational Resources Information Center

Cook, Richard; Press, Clare; Dickinson, Anthony; Heyes, Cecilia

2010-01-01

The associative sequence learning model proposes that the development of the mirror system depends on the same mechanisms of associative learning that mediate Pavlovian and instrumental conditioning. To test this model, two experiments used the reduction of automatic imitation through incompatible sensorimotor training to assess whether mirror…

Somalia ... From the Sea

DTIC Science & Technology

2009-07-01

Arthur tasked LaPlante with planning the NEO and proposing a contingency task force to execute the mission. LaPlante sum- moned Moser to a meeting on...evacuations, although the shortage of staff to operate the ECC severely hindered the process. Security remained marginal , despite arrival of the Navy and...augmentation of the evacuation force had been denied, Oates utilized not only some of McAleer’s Marines but members of the embassy staff to provide

The role of top-down spatial attention in contingent attentional capture.

PubMed

Huang, Wanyi; Su, Yuling; Zhen, Yanfen; Qu, Zhe

2016-05-01

It is well known that attentional capture by an irrelevant salient item is contingent on top-down feature selection, but whether attentional capture may be modulated by top-down spatial attention remains unclear. Here, we combined behavioral and ERP measurements to investigate the contribution of top-down spatial attention to attentional capture under modified spatial cueing paradigms. Each target stimulus was preceded by a peripheral circular cue array containing a spatially uninformative color singleton cue. We varied target sets but kept the cue array unchanged among different experimental conditions. When participants' task was to search for a colored letter in the target array that shared the same peripheral locations with the cue array, attentional capture by the peripheral color cue was reflected by both a behavioral spatial cueing effect and a cue-elicited N2pc component. When target arrays were presented more centrally, both the behavioral and N2pc effects were attenuated but still significant. The attenuated cue-elicited N2pc was found even when participants focused their attention on the fixed central location to identify a colored letter among an RSVP letter stream. By contrast, when participants were asked to identify an outlined or larger target, neither the behavioral spatial cueing effect nor the cue-elicited N2pc was observed, regardless of whether the target and cue arrays shared same locations or not. These results add to the evidence that attentional capture by salient stimuli is contingent upon feature-based task sets, and further indicate that top-down spatial attention is important but may not be necessary for contingent attentional capture. © 2016 Society for Psychophysiological Research.

Older Adult Multitasking Performance Using a Gaze-Contingent Useful Field of View.

PubMed

Ward, Nathan; Gaspar, John G; Neider, Mark B; Crowell, James; Carbonari, Ronald; Kaczmarski, Hank; Ringer, Ryan V; Johnson, Aaron P; Loschky, Lester C; Kramer, Arthur F

2018-03-01

Objective We implemented a gaze-contingent useful field of view paradigm to examine older adult multitasking performance in a simulated driving environment. Background Multitasking refers to the ability to manage multiple simultaneous streams of information. Recent work suggests that multitasking declines with age, yet the mechanisms supporting these declines are still debated. One possible framework to better understand this phenomenon is the useful field of view, or the area in the visual field where information can be attended and processed. In particular, the useful field of view allows for the discrimination of two competing theories of real-time multitasking, a general interference account and a tunneling account. Methods Twenty-five older adult subjects completed a useful field of view task that involved discriminating the orientation of lines in gaze-contingent Gabor patches appearing at varying eccentricities (based on distance from the fovea) as they operated a vehicle in a driving simulator. In half of the driving scenarios, subjects also completed an auditory two-back task to manipulate cognitive workload, and during some trials, wind was introduced as a means to alter general driving difficulty. Results Consistent with prior work, indices of driving performance were sensitive to both wind and workload. Interestingly, we also observed a decline in Gabor patch discrimination accuracy under high cognitive workload regardless of eccentricity, which provides support for a general interference account of multitasking. Conclusion The results showed that our gaze-contingent useful field of view paradigm was able to successfully examine older adult multitasking performance in a simulated driving environment. Application This study represents the first attempt to successfully measure dynamic changes in the useful field of view for older adults completing a multitasking scenario involving driving.

Strain commonalities and differences in response-outcome decision making in mice

PubMed Central

Zimmermann, Kelsey S.; Hsu, Chia-Chun; Gourley, Shannon L.

2016-01-01

The ability to select between actions that are more vs. less likely to be reinforced is necessary for survival and navigation of a changing environment. A task termed “response-outcome contingency degradation” can be used in the laboratory to determine whether rodents behave according to such goal-directed response strategies. In one iteration of this task, rodents are trained to perform two food-reinforced behaviors, then the predictive relationship between one instrumental response and the associated outcome is modified by providing the reinforcer associated with that response non-contingently. During a subsequent probe test, animals can select between the two trained responses. Preferential engagement of the behavior most likely to be reinforced is considered goal-directed, while non-selective responding is considered a failure in response-outcome conditioning, or “habitual.” This test has largely been used with rats, and less so with mice. Here we compiled data collected from several cohorts of mice tested in our lab between 2012-2015. Mice were bred on either a C57BL/6 or predominantly BALB/c strain background. We report that both strains of mice can use information acquired as a result of instrumental contingency degradation training to select amongst multiple response options the response most likely to be reinforced. Mice differ, however, during the training sessions when the familiar response-outcome contingency is being violated. BALB/c mice readily generate perseverative or habit-like response strategies when the only available response is unlikely to be reinforced, while C57BL/6 mice more readily inhibit responding. These findings provide evidence of strain differences in response strategies when an anticipated reinforcer is unlikely to be delivered. PMID:27003118

Harnessing the power of theta: natural manipulations of cognitive performance during hippocampal theta-contingent eyeblink conditioning

PubMed Central

Hoffmann, Loren C.; Cicchese, Joseph J.; Berry, Stephen D.

2015-01-01

Neurobiological oscillations are regarded as essential to normal information processing, including coordination and timing of cells and assemblies within structures as well as in long feedback loops of distributed neural systems. The hippocampal theta rhythm is a 3–12 Hz oscillatory potential observed during cognitive processes ranging from spatial navigation to associative learning. The lower range, 3–7 Hz, can occur during immobility and depends upon the integrity of cholinergic forebrain systems. Several studies have shown that the amount of pre-training theta in the rabbit strongly predicts the acquisition rate of classical eyeblink conditioning and that impairment of this system substantially slows the rate of learning. Our lab has used a brain-computer interface (BCI) that delivers eyeblink conditioning trials contingent upon the explicit presence or absence of hippocampal theta. A behavioral benefit of theta-contingent training has been demonstrated in both delay and trace forms of the paradigm with a two- to four-fold increase in learning speed. This behavioral effect is accompanied by enhanced amplitude and synchrony of hippocampal local field potential (LFP)s, multi-unit excitation, and single-unit response patterns that depend on theta state. Additionally, training in the presence of hippocampal theta has led to increases in the salience of tone-induced unit firing patterns in the medial prefrontal cortex, followed by persistent multi-unit activity during the trace interval. In cerebellum, rhythmicity and precise synchrony of stimulus time-locked LFPs with those of hippocampus occur preferentially under the theta condition. Here we review these findings, integrate them into current models of hippocampal-dependent learning and suggest how improvement in our understanding of neurobiological oscillations is critical for theories of medial temporal lobe processes underlying intact and pathological learning. PMID:25918501

Harnessing the power of theta: natural manipulations of cognitive performance during hippocampal theta-contingent eyeblink conditioning.

PubMed

Hoffmann, Loren C; Cicchese, Joseph J; Berry, Stephen D

2015-01-01

Neurobiological oscillations are regarded as essential to normal information processing, including coordination and timing of cells and assemblies within structures as well as in long feedback loops of distributed neural systems. The hippocampal theta rhythm is a 3-12 Hz oscillatory potential observed during cognitive processes ranging from spatial navigation to associative learning. The lower range, 3-7 Hz, can occur during immobility and depends upon the integrity of cholinergic forebrain systems. Several studies have shown that the amount of pre-training theta in the rabbit strongly predicts the acquisition rate of classical eyeblink conditioning and that impairment of this system substantially slows the rate of learning. Our lab has used a brain-computer interface (BCI) that delivers eyeblink conditioning trials contingent upon the explicit presence or absence of hippocampal theta. A behavioral benefit of theta-contingent training has been demonstrated in both delay and trace forms of the paradigm with a two- to four-fold increase in learning speed. This behavioral effect is accompanied by enhanced amplitude and synchrony of hippocampal local field potential (LFP)s, multi-unit excitation, and single-unit response patterns that depend on theta state. Additionally, training in the presence of hippocampal theta has led to increases in the salience of tone-induced unit firing patterns in the medial prefrontal cortex, followed by persistent multi-unit activity during the trace interval. In cerebellum, rhythmicity and precise synchrony of stimulus time-locked LFPs with those of hippocampus occur preferentially under the theta condition. Here we review these findings, integrate them into current models of hippocampal-dependent learning and suggest how improvement in our understanding of neurobiological oscillations is critical for theories of medial temporal lobe processes underlying intact and pathological learning.

Flexible emotion-based decision-making behavior varies in current and former smokers.

PubMed

Briggs, Zoe; O'Connor, Martin; Jollans, Emily K; O'Halloran, Laura; Dymond, Simon; Whelan, Robert

2015-06-01

Suboptimal decision-making is a feature in the initiation and maintenance of substance use, often manifested in choosing for short-term benefits rather than long-term gain, and the failure to display cognitive flexibility, respectively. Studies of nicotine users typically focus on characterizing those who are already addicted; less is known about decision-making in former smokers. Non- (n=21), former daily- (n=23) and current daily smokers (n=24), completed the contingency-shifting variant Iowa Gambling Task (csIGT), in which the reward and punishment contingencies of the decks are systematically varied after 100 trials of the 'standard' IGT. Scores on the standard blocks of the csIGT provided an index of emotion-based decision-making, while the contingency-shifting blocks assessed flexible decision-making. Subjective ratings were also recorded at 20-trial intervals. Both current and former smokers showed significantly impaired performance relative to non-smokers when making decisions during the standard blocks of the csIGT. Both former and non-smokers' awareness of the reward/punishment contingencies was significantly higher than those of current smokers at the end of the standard IGT. Both former and non-smokers had significantly better performance on the contingency shifting blocks, relative to current smokers. The findings indicate that both current and former smokers display a suboptimal pattern of decision-making than non-smokers during the standard IGT. However, with respect to the ability to change behavior following reversed contingencies, former smokers are more similar to non-smokers than to current smokers. Former smokers were also more aware of the contingencies than current smokers. Copyright © 2015 Elsevier Ltd. All rights reserved.

Attention training through gaze-contingent feedback: Effects on reappraisal and negative emotions.

PubMed

Sanchez, Alvaro; Everaert, Jonas; Koster, Ernst H W

2016-10-01

Reappraisal is central to emotion regulation but its mechanisms are unclear. This study tested the theoretical prediction that emotional attention bias is linked to reappraisal of negative emotion-eliciting stimuli and subsequent emotional responding using a novel attentional control training. Thirty-six undergraduates were randomly assigned to either the control or the attention training condition and were provided with different task instructions while they performed an interpretation task. Whereas control participants freely created interpretations, participants in the training condition were instructed to allocate attention toward positive words to efficiently create positive interpretations (i.e., recruiting attentional control) while they were provided with gaze-contingent feedback on their viewing behavior. Transfer to attention bias and reappraisal success was evaluated using a dot-probe task and an emotion regulation task which were administered before and after the training. The training condition was effective at increasing attentional control and resulted in beneficial effects on the transfer tasks. Analyses supported a serial indirect effect with larger attentional control acquisition in the training condition leading to negative attention bias reduction, in turn predicting greater reappraisal success which reduced negative emotions. Our results indicate that attentional mechanisms influence the use of reappraisal strategies and its impact on negative emotions. The novel attention training highlights the importance of tailored feedback to train attentional control. The findings provide an important step toward personalized delivery of attention training. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Translational studies of goal-directed action as a framework for classifying deficits across psychiatric disorders

PubMed Central

Griffiths, Kristi R.; Morris, Richard W.; Balleine, Bernard W.

2014-01-01

The ability to learn contingencies between actions and outcomes in a dynamic environment is critical for flexible, adaptive behavior. Goal-directed actions adapt to changes in action-outcome contingencies as well as to changes in the reward-value of the outcome. When networks involved in reward processing and contingency learning are maladaptive, this fundamental ability can be lost, with detrimental consequences for decision-making. Impaired decision-making is a core feature in a number of psychiatric disorders, ranging from depression to schizophrenia. The argument can be developed, therefore, that seemingly disparate symptoms across psychiatric disorders can be explained by dysfunction within common decision-making circuitry. From this perspective, gaining a better understanding of the neural processes involved in goal-directed action, will allow a comparison of deficits observed across traditional diagnostic boundaries within a unified theoretical framework. This review describes the key processes and neural circuits involved in goal-directed decision-making using evidence from animal studies and human neuroimaging. Select studies are discussed to outline what we currently know about causal judgments regarding actions and their consequences, action-related reward evaluation, and, most importantly, how these processes are integrated in goal-directed learning and performance. Finally, we look at how adaptive decision-making is impaired across a range of psychiatric disorders and how deepening our understanding of this circuitry may offer insights into phenotypes and more targeted interventions. PMID:24904322

Does attention bias modification improve attentional control? A double-blind randomized experiment with individuals with social anxiety disorder.

PubMed

Heeren, Alexandre; Mogoaşe, Cristina; McNally, Richard J; Schmitz, Anne; Philippot, Pierre

2015-01-01

People with anxiety disorders often exhibit an attentional bias for threat. Attention bias modification (ABM) procedure may reduce this bias, thereby diminishing anxiety symptoms. In ABM, participants respond to probes that reliably follow non-threatening stimuli (e.g., neutral faces) such that their attention is directed away from concurrently presented threatening stimuli (e.g., disgust faces). Early studies showed that ABM reduced anxiety more than control procedures lacking any contingency between valenced stimuli and probes. However, recent work suggests that no-contingency training and training toward threat cues can be as effective as ABM in reducing anxiety, implying that any training may increase executive control over attention, thereby helping people inhibit their anxious thoughts. Extending this work, we randomly assigned participants with DSM-IV diagnosed social anxiety disorder to either training toward non-threat (ABM), training toward threat, or no-contingency condition, and we used the attention network task (ANT) to assess all three components of attention. After two training sessions, subjects in all three conditions exhibited indistinguishably significant declines from baseline to post-training in self-report and behavioral measures of anxiety on an impromptu speech task. Moreover, all groups exhibited similarly significant improvements on the alerting and executive (but not orienting) components of attention. Implications for ABM research are discussed. Copyright © 2014 Elsevier Ltd. All rights reserved.

Reduced intrasubject variability with reinforcement in boys, but not girls, with ADHD: Associations with prefrontal anatomy

PubMed Central

Rosch, Keri S.; Dirlikov, Benjamin; Mostofsky, Stewart H.

2015-01-01

This study examined the impact of motivational contingencies (reinforcement and punishment) on Go/No-Go (GNG) task performance in girls and boys with ADHD relative to typically developing (TD) children and associations with prefrontal anatomy. Children ages 8–12 with ADHD (n=107, 36 girls) and TD controls (n=95, 34 girls) completed a standard and a motivational GNG task and associations with prefrontal cortex (PFC) surface area were examined. Intrasubject variability (ISV) was lower during the motivational compared to the standard GNG among TD girls and boys, and boys with ADHD, but not among girls with ADHD. A greater reduction in ISV was associated with greater PFC surface area among children with ADHD. This novel demonstration of improvement in ISV with motivational contingencies for boys, but not girls, with ADHD and associations with PFC anatomy informs our understanding of sex differences and motivational factors contributing to ISV in children with ADHD. PMID:26141238

Usability Evaluation of a Web-Based Learning System

ERIC Educational Resources Information Center

Nguyen, Thao

2012-01-01

The paper proposes a contingent, learner-centred usability evaluation method and a prototype tool of such systems. This is a new usability evaluation method for web-based learning systems using a set of empirically-supported usability factors and can be done effectively with limited resources. During the evaluation process, the method allows for…

Conditioning 1-6 Month Old Infants by Means of Myoelectrically Controlled Reinforcement.

ERIC Educational Resources Information Center

Stack, Dale M.; McDonnell, Paul M.

1995-01-01

In order to evaluate possibilities of fitting myoelectrically controlled prosthetic arms on infants, this study examined whether 32 infants (1-6 months) could learn to control environmental contingencies by means of contracting the forearm flexor muscle group. Results indicated that older subjects (age greater than 104 days) demonstrated learning,…

Supporting Teachers to Develop Substantive Discourse in Primary Science Classrooms

ERIC Educational Resources Information Center

Smith, Prudence M.; Hackling, Mark W.

2016-01-01

Students' thinking and learning in inquiry-based science is contingent on them being able to participate in substantive conversations so they explore their ideas and develop reasons and explanations for the outcomes of their investigations. While teachers understand the importance of talk for student learning, they are often unaware of the impact…