Mechanisms of impulsive choice: II. Time-based interventions to improve self-control

PubMed Central

Smith, Aaron P.; Marshall, Andrew T.; Kirkpatrick, Kimberly

2014-01-01

Impulsive choice behavior has been proposed as a primary risk factor for other maladaptive behaviors (e.g., gambling, substance abuse). Recent research has suggested that timing processes may play a key role in impulsive choice behavior, and could provide an avenue for altering impulsive choice. Accordingly, the current experiments assessed a set of time-based behavioral interventions to increase self-control while simultaneously assessing effects on timing processes within the impulsive choice task. Three experiments assessed temporal interventions using a differential reinforcement of low rates task (Experiment 1) and exposure to either a variable or fixed interval schedule (Experiments 2–3). The efficacy of the interventions was assessed in Sprague-Dawley (Experiments 1–2) and Lewis (Experiment 3) rat strains. Impulsive choice behavior was assessed by measuring preferences of a smaller-sooner (SS) versus a larger-later (LL) reward, while timing of the SS and LL durations was measured during peak trials within the impulsive choice procedure. The rats showed an increased preference for the LL following all three time-based interventions and also displayed increased temporal precision. These results add to the increasing evidence that supports a possible role for temporal processing in impulsive choice behavior and supply novel behavioral interventions to decrease impulsive behavior. PMID:25444771

Loss restlessness and gain calmness: durable effects of losses and gains on choice switching.

PubMed

Yechiam, Eldad; Zahavi, Gal; Arditi, Eli

2015-08-01

While the traditional conceptualization of the effect of losses focuses on bias in the subjective weight of losses compared with respective gains, some accounts suggest more global task-related effects of losses. Based on a recent attentional theory, we predicted a positive after-effect of losses on choice switching in later tasks. In two experimental studies, we found increased choice switching rates in tasks with losses compared to tasks with no losses. Additionally, this heightened shifting behavior was maintained in subsequent tasks that do not include losses, a phenomenon we refer to as "loss restlessness." Conversely, gains were found to have an opposite "calming" effect on choice switching. Surprisingly, the loss restlessness phenomenon was observed following an all-losses payoff regime but not after a task with symmetric mixed gains and losses. This suggests that the unresolved mental account following an all-losses regime increases search behavior. Potential implications to macro level phenomena, such as the leverage effect, are discussed.

Career Development in the College Years.

ERIC Educational Resources Information Center

Myers, Roger A.

This paper concerns itself with two relatively central issues in career development, life stages and choice behavior and focuses on the tasks of the college counselor in regards to them. Life stages refer to sequential series of tasks to be accomplished within time periods that can be specified. Choice behavior is the on-going process of making a…

Impulsive social influence increases impulsive choices on a temporal discounting task in young adults.

PubMed

Gilman, Jodi M; Curran, Max T; Calderon, Vanessa; Stoeckel, Luke E; Evins, A Eden

2014-01-01

Adolescents and young adults who affiliate with friends who engage in impulsive behavior are more likely to engage in impulsive behaviors themselves, and those who associate with prosocial (i.e. more prudent, future oriented) peers are more likely to engage in prosocial behavior. However, it is difficult to disentangle the contribution of peer influence vs. peer selection (i.e., whether individuals choose friends with similar traits) when interpreting social behaviors. In this study, we combined a novel social manipulation with a well-validated delay discounting task assessing impulsive behavior to create a social influence delay discounting task, in which participants were exposed to both impulsive (smaller, sooner or SS payment) and non-impulsive (larger, later or LL payment) choices from their peers. Young adults in this sample, n = 51, aged 18-25 had a higher rate of SS choices after exposure to impulsive peer influence than after exposure to non-impulsive peer influence. Interestingly, in highly susceptible individuals, the rate of non-impulsive choices did not increase after exposure to non-impulsive influence. There was a positive correlation between self-reported suggestibility and degree of peer influence on SS choices. These results suggest that, in young adults, SS choices appear to be influenced by the choices of same-aged peers, especially for individuals who are highly susceptible to influence.

Impulsive Social Influence Increases Impulsive Choices on a Temporal Discounting Task in Young Adults

PubMed Central

Gilman, Jodi M.; Curran, Max T.; Calderon, Vanessa; Stoeckel, Luke E.; Evins, A. Eden

2014-01-01

Adolescents and young adults who affiliate with friends who engage in impulsive behavior are more likely to engage in impulsive behaviors themselves, and those who associate with prosocial (i.e. more prudent, future oriented) peers are more likely to engage in prosocial behavior. However, it is difficult to disentangle the contribution of peer influence vs. peer selection (i.e., whether individuals choose friends with similar traits) when interpreting social behaviors. In this study, we combined a novel social manipulation with a well-validated delay discounting task assessing impulsive behavior to create a social influence delay discounting task, in which participants were exposed to both impulsive (smaller, sooner or SS payment) and non-impulsive (larger, later or LL payment) choices from their peers. Young adults in this sample, n = 51, aged 18–25 had a higher rate of SS choices after exposure to impulsive peer influence than after exposure to non-impulsive peer influence. Interestingly, in highly susceptible individuals, the rate of non-impulsive choices did not increase after exposure to non-impulsive influence. There was a positive correlation between self-reported suggestibility and degree of peer influence on SS choices. These results suggest that, in young adults, SS choices appear to be influenced by the choices of same-aged peers, especially for individuals who are highly susceptible to influence. PMID:24988440

The Relationship between Instructional Variables and Problem Behavior: A Review.

ERIC Educational Resources Information Center

Munk, Dennis D.; Repp, Alan C.

1994-01-01

This paper reviews studies that have used instructional variables as nonaversive interventions for problem behaviors of individuals with severe disabilities. These include student choice of task, task variation, pace of instruction, interspersal of high probability tasks, partial versus whole task training, decreasing task difficulty, and a…

Choose, rate or squeeze: Comparison of economic value functions elicited by different behavioral tasks

PubMed Central

Pessiglione, Mathias

2017-01-01

A standard view in neuroeconomics is that to make a choice, an agent first assigns subjective values to available options, and then compares them to select the best. In choice tasks, these cardinal values are typically inferred from the preference expressed by subjects between options presented in pairs. Alternatively, cardinal values can be directly elicited by asking subjects to place a cursor on an analog scale (rating task) or to exert a force on a power grip (effort task). These tasks can vary in many respects: they can notably be more or less costly and consequential. Here, we compared the value functions elicited by choice, rating and effort tasks on options composed of two monetary amounts: one for the subject (gain) and one for a charity (donation). Bayesian model selection showed that despite important differences between the three tasks, they all elicited a same value function, with similar weighting of gain and donation, but variable concavity. Moreover, value functions elicited by the different tasks could predict choices with equivalent accuracy. Our finding therefore suggests that comparable value functions can account for various motivated behaviors, beyond economic choice. Nevertheless, we report slight differences in the computational efficiency of parameter estimation that may guide the design of future studies. PMID:29161252

Role of dopamine D2 receptors in optimizing choice strategy in a dynamic and uncertain environment

PubMed Central

Kwak, Shinae; Huh, Namjung; Seo, Ji-Seon; Lee, Jung-Eun; Han, Pyung-Lim; Jung, Min W.

2014-01-01

In order to investigate roles of dopamine receptor subtypes in reward-based learning, we examined choice behavior of dopamine D1 and D2 receptor-knockout (D1R-KO and D2R-KO, respectively) mice in an instrumental learning task with progressively increasing reversal frequency and a dynamic two-armed bandit task. Performance of D2R-KO mice was progressively impaired in the former as the frequency of reversal increased and profoundly impaired in the latter even with prolonged training, whereas D1R-KO mice showed relatively minor performance deficits. Choice behavior in the dynamic two-armed bandit task was well explained by a hybrid model including win-stay-lose-switch and reinforcement learning terms. A model-based analysis revealed increased win-stay, but impaired value updating and decreased value-dependent action selection in D2R-KO mice, which were detrimental to maximizing rewards in the dynamic two-armed bandit task. These results suggest an important role of dopamine D2 receptors in learning from past choice outcomes for rapid adjustment of choice behavior in a dynamic and uncertain environment. PMID:25389395

Decision-Making under Ambiguity Is Modulated by Visual Framing, but Not by Motor vs. Non-Motor Context. Experiments and an Information-Theoretic Ambiguity Model

PubMed Central

Grau-Moya, Jordi; Ortega, Pedro A.; Braun, Daniel A.

2016-01-01

A number of recent studies have investigated differences in human choice behavior depending on task framing, especially comparing economic decision-making to choice behavior in equivalent sensorimotor tasks. Here we test whether decision-making under ambiguity exhibits effects of task framing in motor vs. non-motor context. In a first experiment, we designed an experience-based urn task with varying degrees of ambiguity and an equivalent motor task where subjects chose between hitting partially occluded targets. In a second experiment, we controlled for the different stimulus design in the two tasks by introducing an urn task with bar stimuli matching those in the motor task. We found ambiguity attitudes to be mainly influenced by stimulus design. In particular, we found that the same subjects tended to be ambiguity-preferring when choosing between ambiguous bar stimuli, but ambiguity-avoiding when choosing between ambiguous urn sample stimuli. In contrast, subjects’ choice pattern was not affected by changing from a target hitting task to a non-motor context when keeping the stimulus design unchanged. In both tasks subjects’ choice behavior was continuously modulated by the degree of ambiguity. We show that this modulation of behavior can be explained by an information-theoretic model of ambiguity that generalizes Bayes-optimal decision-making by combining Bayesian inference with robust decision-making under model uncertainty. Our results demonstrate the benefits of information-theoretic models of decision-making under varying degrees of ambiguity for a given context, but also demonstrate the sensitivity of ambiguity attitudes across contexts that theoretical models struggle to explain. PMID:27124723

Decision-Making under Ambiguity Is Modulated by Visual Framing, but Not by Motor vs. Non-Motor Context. Experiments and an Information-Theoretic Ambiguity Model.

PubMed

Grau-Moya, Jordi; Ortega, Pedro A; Braun, Daniel A

2016-01-01

A number of recent studies have investigated differences in human choice behavior depending on task framing, especially comparing economic decision-making to choice behavior in equivalent sensorimotor tasks. Here we test whether decision-making under ambiguity exhibits effects of task framing in motor vs. non-motor context. In a first experiment, we designed an experience-based urn task with varying degrees of ambiguity and an equivalent motor task where subjects chose between hitting partially occluded targets. In a second experiment, we controlled for the different stimulus design in the two tasks by introducing an urn task with bar stimuli matching those in the motor task. We found ambiguity attitudes to be mainly influenced by stimulus design. In particular, we found that the same subjects tended to be ambiguity-preferring when choosing between ambiguous bar stimuli, but ambiguity-avoiding when choosing between ambiguous urn sample stimuli. In contrast, subjects' choice pattern was not affected by changing from a target hitting task to a non-motor context when keeping the stimulus design unchanged. In both tasks subjects' choice behavior was continuously modulated by the degree of ambiguity. We show that this modulation of behavior can be explained by an information-theoretic model of ambiguity that generalizes Bayes-optimal decision-making by combining Bayesian inference with robust decision-making under model uncertainty. Our results demonstrate the benefits of information-theoretic models of decision-making under varying degrees of ambiguity for a given context, but also demonstrate the sensitivity of ambiguity attitudes across contexts that theoretical models struggle to explain.

Dynamic Response-by-Response Models of Matching Behavior in Rhesus Monkeys

PubMed Central

Lau, Brian; Glimcher, Paul W

2005-01-01

We studied the choice behavior of 2 monkeys in a discrete-trial task with reinforcement contingencies similar to those Herrnstein (1961) used when he described the matching law. In each session, the monkeys experienced blocks of discrete trials at different relative-reinforcer frequencies or magnitudes with unsignalled transitions between the blocks. Steady-state data following adjustment to each transition were well characterized by the generalized matching law; response ratios undermatched reinforcer frequency ratios but matched reinforcer magnitude ratios. We modelled response-by-response behavior with linear models that used past reinforcers as well as past choices to predict the monkeys' choices on each trial. We found that more recently obtained reinforcers more strongly influenced choice behavior. Perhaps surprisingly, we also found that the monkeys' actions were influenced by the pattern of their own past choices. It was necessary to incorporate both past reinforcers and past choices in order to accurately capture steady-state behavior as well as the fluctuations during block transitions and the response-by-response patterns of behavior. Our results suggest that simple reinforcement learning models must account for the effects of past choices to accurately characterize behavior in this task, and that models with these properties provide a conceptual tool for studying how both past reinforcers and past choices are integrated by the neural systems that generate behavior. PMID:16596980

Dopamine, Effort-Based Choice, and Behavioral Economics: Basic and Translational Research

PubMed Central

Salamone, John D.; Correa, Merce; Yang, Jen-Hau; Rotolo, Renee; Presby, Rose

2018-01-01

Operant behavior is not only regulated by factors related to the quality or quantity of reinforcement, but also by the work requirements inherent in performing instrumental actions. Moreover, organisms often make effort-related decisions involving economic choices such as cost/benefit analyses. Effort-based decision making is studied using behavioral procedures that offer choices between high-effort options leading to relatively preferred reinforcers vs. low effort/low reward choices. Several neural systems, including the mesolimbic dopamine (DA) system and other brain circuits, are involved in regulating effort-related aspects of motivation. Considerable evidence indicates that mesolimbic DA transmission exerts a bi-directional control over exertion of effort on instrumental behavior tasks. Interference with DA transmission produces a low-effort bias in animals tested on effort-based choice tasks, while increasing DA transmission with drugs such as DA transport blockers tends to enhance selection of high-effort options. The results from these pharmacology studies are corroborated by the findings from recent articles using optogenetic, chemogenetic and physiological techniques. In addition to providing important information about the neural regulation of motivated behavior, effort-based choice tasks are useful for developing animal models of some of the motivational symptoms that are seen in people with various psychiatric and neurological disorders (e.g., depression, schizophrenia, Parkinson’s disease). Studies of effort-based decision making may ultimately contribute to the development of novel drug treatments for motivational dysfunction. PMID:29628879

Dopamine, Effort-Based Choice, and Behavioral Economics: Basic and Translational Research.

PubMed

Salamone, John D; Correa, Merce; Yang, Jen-Hau; Rotolo, Renee; Presby, Rose

2018-01-01

Operant behavior is not only regulated by factors related to the quality or quantity of reinforcement, but also by the work requirements inherent in performing instrumental actions. Moreover, organisms often make effort-related decisions involving economic choices such as cost/benefit analyses. Effort-based decision making is studied using behavioral procedures that offer choices between high-effort options leading to relatively preferred reinforcers vs. low effort/low reward choices. Several neural systems, including the mesolimbic dopamine (DA) system and other brain circuits, are involved in regulating effort-related aspects of motivation. Considerable evidence indicates that mesolimbic DA transmission exerts a bi-directional control over exertion of effort on instrumental behavior tasks. Interference with DA transmission produces a low-effort bias in animals tested on effort-based choice tasks, while increasing DA transmission with drugs such as DA transport blockers tends to enhance selection of high-effort options. The results from these pharmacology studies are corroborated by the findings from recent articles using optogenetic, chemogenetic and physiological techniques. In addition to providing important information about the neural regulation of motivated behavior, effort-based choice tasks are useful for developing animal models of some of the motivational symptoms that are seen in people with various psychiatric and neurological disorders (e.g., depression, schizophrenia, Parkinson's disease). Studies of effort-based decision making may ultimately contribute to the development of novel drug treatments for motivational dysfunction.

There Are at Least Two Kinds of Probability Matching: Evidence from a Secondary Task

ERIC Educational Resources Information Center

Otto, A. Ross; Taylor, Eric G.; Markman, Arthur B.

2011-01-01

Probability matching is a suboptimal behavior that often plagues human decision-making in simple repeated choice tasks. Despite decades of research, recent studies cannot find agreement on what choice strategies lead to probability matching. We propose a solution, showing that two distinct local choice strategies--which make different demands on…

Motor heuristics and embodied choices: how to choose and act.

PubMed

Raab, Markus

2017-08-01

Human performance requires choosing what to do and how to do it. The goal of this theoretical contribution is to advance understanding of how the motor and cognitive components of choices are intertwined. From a holistic perspective I extend simple heuristics that have been tested in cognitive tasks to motor tasks, coining the term motor heuristics. Similarly I extend the concept of embodied cognition, that has been tested in simple sensorimotor processes changing decisions, to complex sport behavior coining the term embodied choices. Thus both motor heuristics and embodied choices explain complex behavior such as studied in sport and exercise psychology. Copyright © 2017 Elsevier Ltd. All rights reserved.

Spontaneous prosocial choice by captive bottlenose dolphins, Tursiops truncatus.

PubMed

Nakahara, Fumio; Komaba, Masayuki; Sato, Ryoichi; Ikeda, Hisako; Komaba, Kumiko; Kawakubo, Akihiro

2017-02-01

Dolphins exhibit prosocial behavior across several different contexts. However, only a few experimental studies have investigated the psychological mechanisms underlying this behavior. In this study, we investigated the mechanisms underlying prosociality in bottlenose dolphins (Tursiops truncatus). In the experiments, water shower devices, developed as environmental enrichment items, were used. Two paradigms were used to measure prosociality. The first was the prosocial choice task, involving the subject typically being offered one choice between two options. The first option provided a reward (take a shower) to both the subject and partner (prosocial choice). The second option provided a reward only to the subject (selfish choice). The second paradigm was the giving assistance task, involving the subject being provided a choice between providing instrumental help to the partner (prosocial choice) or doing nothing. It was observed that the subjects chose the prosocial choices in both paradigms. In these experiments, prosocial choices were spontaneously taken without requests from the partners. These results indicated that the dolphins show preference for other-regarding behavior. Copyright © 2016 Elsevier B.V. All rights reserved.

Noradrenergic modulation of vicarious trial-and-error behavior during a spatial decision-making task in rats.

PubMed

Amemiya, S; Noji, T; Kubota, N; Nishijima, T; Kita, I

2014-04-18

Deliberation between possible options before making a decision is crucial to responding with an optimal choice. However, the neural mechanisms regulating this deliberative decision-making process are still unclear. Recent studies have proposed that the locus coeruleus-noradrenaline (LC-NA) system plays a role in attention, behavioral flexibility, and exploration, which contribute to the search for an optimal choice under uncertain situations. In the present study, we examined whether the LC-NA system relates to the deliberative process in a T-maze spatial decision-making task in rats. To quantify deliberation in rats, we recorded vicarious trial-and-error behavior (VTE), which is considered to reflect a deliberative process exploring optimal choices. In experiment 1, we manipulated the difficulty of choice by varying the amount of reward pellets between the two maze arms (0 vs. 4, 1 vs. 3, 2 vs. 2). A difficulty-dependent increase in VTE was accompanied by a reduction of choice bias toward the high reward arm and an increase in time required to select one of the two arms in the more difficult manipulation. In addition, the increase of c-Fos-positive NA neurons in the LC depended on the task difficulty and the amount of c-Fos expression in LC-NA neurons positively correlated with the occurrence of VTE. In experiment 2, we inhibited LC-NA activity by injection of clonidine, an agonist of the alpha2 autoreceptor, during a decision-making task (1 vs. 3). The clonidine injection suppressed occurrence of VTE in the early phase of the task and subsequently impaired a valuable choice later in the task. These results suggest that the LC-NA system regulates the deliberative process during decision-making. Copyright © 2014 IBRO. Published by Elsevier Ltd. All rights reserved.

On Adaptation, Maximization, and Reinforcement Learning among Cognitive Strategies

ERIC Educational Resources Information Center

Erev, Ido; Barron, Greg

2005-01-01

Analysis of binary choice behavior in iterated tasks with immediate feedback reveals robust deviations from maximization that can be described as indications of 3 effects: (a) a payoff variability effect, in which high payoff variability seems to move choice behavior toward random choice; (b) underweighting of rare events, in which alternatives…

Aniracetam restores motivation reduced by satiation in a choice reaction task in aged rats.

PubMed

Nakamura, K; Kurasawa, M

2001-01-01

This study aims to examine the effects of aniracetam on satiation-induced poor performance in a choice reaction task. Aged rats that mastered the task under food restriction stably maintained the task performance for a long period. Satiation by successive free feeding greatly diminished the performance. Satiation resulted in a decreased % correct, increased % omission and prolonged choice reaction time, indicating a reduction in lever response with low choice accuracy and slow responding speed. Repeated administration of aniracetam (30 mg/kg, po, for 14 days) partially recovered the choice accuracy and lever response, but not the responding speed, task-associated motor activity or impulsivity. In addition, aniracetam did not affect the animals' weights. These results indicate that satiation reduces motivation to perform and attain the task. Aniracetam may restore motivation, probably by improving poor behavioral states (daily attentional and vigilance failures), thereby creating the driving force.

The pharmacology of effort-related choice behavior: Dopamine, depression, and individual differences.

PubMed

Salamone, John D; Correa, Merce; Yohn, Samantha; Lopez Cruz, Laura; San Miguel, Noemi; Alatorre, Luisa

2016-06-01

This review paper is focused upon the involvement of mesolimbic dopamine (DA) and related brain systems in effort-based processes. Interference with DA transmission affects instrumental behavior in a manner that interacts with the response requirements of the task, such that rats with impaired DA transmission show a heightened sensitivity to ratio requirements. Impaired DA transmission also affects effort-related choice behavior, which is assessed by tasks that offer a choice between a preferred reinforcer that has a high work requirement vs. less preferred reinforcer that can be obtained with minimal effort. Rats and mice with impaired DA transmission reallocate instrumental behavior away from food-reinforced tasks with high response costs, and show increased selection of low reinforcement/low cost options. Tests of effort-related choice have been developed into models of pathological symptoms of motivation that are seen in disorders such as depression and schizophrenia. These models are being employed to explore the effects of conditions associated with various psychopathologies, and to assess drugs for their potential utility as treatments for effort-related symptoms. Studies of the pharmacology of effort-based choice may contribute to the development of treatments for symptoms such as psychomotor slowing, fatigue or anergia, which are seen in depression and other disorders. Copyright © 2016 Elsevier B.V. All rights reserved.

Rapid target foraging with reach or gaze: The hand looks further ahead than the eye

PubMed Central

2017-01-01

Real-world tasks typically consist of a series of target-directed actions and often require choices about which targets to act on and in what order. Such choice behavior can be assessed from an optimal foraging perspective whereby target selection is shaped by a balance between rewards and costs. Here we evaluated such decision-making in a rapid movement foraging task. On a given trial, participants were presented with 15 targets of varying size and value and were instructed to harvest as much reward as possible by either moving a handle to the targets (hand task) or by briefly fixating them (eye task). The short trial duration enabled participants to harvest about half the targets, ensuring that total reward was due to choice behavior. We developed a probabilistic model to predict target-by-target harvesting choices that considered the rewards and movement-related costs (i.e., target distance and size) associated with the current target as well as future targets. In the hand task, in comparison to the eye task, target choice was more strongly influenced by movement-related costs and took into account a greater number of future targets, consistent with the greater costs associated with arm movement. In both tasks, participants exhibited near-optimal behaviour and in a constrained version of the hand task in which choices could only be based on target positions, participants consistently chose among the shortest movement paths. Our results demonstrate that people can rapidly and effectively integrate values and movement-related costs associated with current and future targets when sequentially harvesting targets. PMID:28683138

The neural substrates of social influence on decision making.

PubMed

Tomlin, Damon; Nedic, Andrea; Prentice, Deborah A; Holmes, Philip; Cohen, Jonathan D

2013-01-01

The mechanisms that govern human learning and decision making under uncertainty have been the focus of intense behavioral and, more recently, neuroscientific investigation. Substantial progress has been made in building models of the processes involved, and identifying underlying neural mechanisms using simple, two-alternative forced choice decision tasks. However, less attention has been given to how social information influences these processes, and the neural systems that mediate this influence. Here we sought to address these questions by using tasks similar to ones that have been used to study individual decision making behavior, and adding conditions in which participants were given trial-by-trial information about the performance of other individuals (their choices and/or their rewards) simultaneously playing the same tasks. We asked two questions: How does such information about the behavior of others influence performance in otherwise simple decision tasks, and what neural systems mediate this influence? We found that bilateral insula exhibited a parametric relationship to the degree of misalignment of the individual's performance with those of others in the group. Furthermore, activity in the bilateral insula significantly predicted participants' subsequent choices to align their behavior with others in the group when they were misaligned either in their choices (independent of success) or their degree of success (independent of specific choices). These findings add to the growing body of empirical data suggesting that the insula participates in an important way in social information processing and decision making.

A Preliminary Analysis of Self-Control with Aversive Events: the Effects of Task Magnitude and Delay on the Choices of Children with Autism

PubMed Central

Lerman, Dorothea C; Addison, Laura R; Kodak, Tiffany

2006-01-01

When faced with a choice between two aversive events, a person exhibits self-control by choosing a smaller, more immediate aversive event over a larger, delayed aversive event. Task demands are often aversive to children with autism and other developmental disabilities. The purpose of this study was to evaluate behavioral sensitivity to differences in the amount and delay of tasks as part of a preliminary study on self-control. Participants were 2 children with autism who engaged in problem behavior maintained by escape. Results indicated a lack of self-control with respect to choosing between two aversive tasks and suggested potential strategies for increasing self-control (i.e., choosing a small immediate task over a large delayed task). PMID:16813043

A preliminary analysis of self-control with aversive events: the effects of task magnitude and delay on the choices of children with autism.

PubMed

Lerman, Dorothea C; Addison, Laura R; Kodak, Tiffany

2006-01-01

When faced with a choice between two aversive events, a person exhibits self-control by choosing a smaller, more immediate aversive event over a larger, delayed aversive event. Task demands are often aversive to children with autism and other developmental disabilities. The purpose of this study was to evaluate behavioral sensitivity to differences in the amount and delay of tasks as part of a preliminary study on self-control. Participants were 2 children with autism who engaged in problem behavior maintained by escape. Results indicated a lack of self-control with respect to choosing between two aversive tasks and suggested potential strategies for increasing self-control (i.e., choosing a small immediate task over a large delayed task).

Probabilistic learning and inference in schizophrenia

PubMed Central

Averbeck, Bruno B.; Evans, Simon; Chouhan, Viraj; Bristow, Eleanor; Shergill, Sukhwinder S.

2010-01-01

Patients with schizophrenia make decisions on the basis of less evidence when required to collect information to make an inference, a behavior often called jumping to conclusions. The underlying basis for this behaviour remains controversial. We examined the cognitive processes underpinning this finding by testing subjects on the beads task, which has been used previously to elicit jumping to conclusions behaviour, and a stochastic sequence learning task, with a similar decision theoretic structure. During the sequence learning task, subjects had to learn a sequence of button presses, while receiving noisy feedback on their choices. We fit a Bayesian decision making model to the sequence task and compared model parameters to the choice behavior in the beads task in both patients and healthy subjects. We found that patients did show a jumping to conclusions style; and those who picked early in the beads task tended to learn less from positive feedback in the sequence task. This favours the likelihood of patients selecting early because they have a low threshold for making decisions, and that they make choices on the basis of relatively little evidence. PMID:20810252

The neural substrates of deliberative decision making: contrasting effects of hippocampus lesions on performance and vicarious trial-and-error behavior in a spatial memory task and a visual discrimination task

PubMed Central

Bett, David; Allison, Elizabeth; Murdoch, Lauren H.; Kaefer, Karola; Wood, Emma R.; Dudchenko, Paul A.

2012-01-01

Vicarious trial-and-errors (VTEs) are back-and-forth movements of the head exhibited by rodents and other animals when faced with a decision. These behaviors have recently been associated with prospective sweeps of hippocampal place cell firing, and thus may reflect a rodent model of deliberative decision-making. The aim of the current study was to test whether the hippocampus is essential for VTEs in a spatial memory task and in a simple visual discrimination (VD) task. We found that lesions of the hippocampus with ibotenic acid produced a significant impairment in the accuracy of choices in a serial spatial reversal (SR) task. In terms of VTEs, whereas sham-lesioned animals engaged in more VTE behavior prior to identifying the location of the reward as opposed to repeated trials after it had been located, the lesioned animals failed to show this difference. In contrast, damage to the hippocampus had no effect on acquisition of a VD or on the VTEs seen in this task. For both lesion and sham-lesion animals, adding an additional choice to the VD increased the number of VTEs and decreased the accuracy of choices. Together, these results suggest that the hippocampus may be specifically involved in VTE behavior during spatial decision making. PMID:23115549

The effects of response cost and species-typical behaviors on a daily time-place learning task.

PubMed

Deibel, Scott H; Thorpe, Christina M

2013-03-01

Two theories that have been hypothesized to mediate acquisition in daily time-place learning (TPL) tasks were investigated in a free operant daily TPL task: the response cost hypothesis and the species-typical behavior hypothesis. One lever at the end of one of the choice arms of a T-maze provided food in the morning, and 6 h later, a lever in the other choice arm provided food. Four groups were used to assess the effect of two possible sources of response cost: physical effort of the task and costs associated with foraging ecology. One group was used to assess the effect of explicitly allowing for species-typical behaviors. If only first arm choice data were considered, there was little evidence of learning. However, both first press and percentage of presses on the correct lever prior to the first reinforcement revealed evidence of TPL in most rats tested. Unexpectedly, the high response cost groups for both of the proposed sources did not perform better than the low response cost groups. The groups that allowed animals to display species-typical behaviors performed the worst. Skip session probe trials confirmed that the majority of the rats that acquired the task were using a circadian timing strategy. The results from the present study suggest that learning in free operant daily TPL tasks might not be dependent on response cost.

Modeling the Value of Strategic Actions in the Superior Colliculus

PubMed Central

Thevarajah, Dhushan; Webb, Ryan; Ferrall, Christopher; Dorris, Michael C.

2009-01-01

In learning models of strategic game play, an agent constructs a valuation (action value) over possible future choices as a function of past actions and rewards. Choices are then stochastic functions of these action values. Our goal is to uncover a neural signal that correlates with the action value posited by behavioral learning models. We measured activity from neurons in the superior colliculus (SC), a midbrain region involved in planning saccadic eye movements, while monkeys performed two saccade tasks. In the strategic task, monkeys competed against a computer in a saccade version of the mixed-strategy game ”matching-pennies”. In the instructed task, saccades were elicited through explicit instruction rather than free choices. In both tasks neuronal activity and behavior were shaped by past actions and rewards with more recent events exerting a larger influence. Further, SC activity predicted upcoming choices during the strategic task and upcoming reaction times during the instructed task. Finally, we found that neuronal activity in both tasks correlated with an established learning model, the Experience Weighted Attraction model of action valuation (Camerer and Ho, 1999). Collectively, our results provide evidence that action values hypothesized by learning models are represented in the motor planning regions of the brain in a manner that could be used to select strategic actions. PMID:20161807

Factors Predicting Smoking in a Laboratory-Based Smoking-Choice Task

PubMed Central

Bold, Krysten W.; Yoon, Haewon; Chapman, Gretchen B.; McCarthy, Danielle E.

2013-01-01

This study aimed to expand the current understanding of smoking maintenance mechanisms by examining how putative relapse risk factors relate to a single behavioral smoking choice using a novel laboratory smoking-choice task. After 12 hours of nicotine deprivation, participants were exposed to smoking cues and given the choice between smoking up to two cigarettes in a 15-minute window or waiting and receiving four cigarettes after a delay of 45 minutes. Greater nicotine dependence, higher impulsivity, and lower distress tolerance were hypothesized to predict earlier and more intensive smoking. Out of 35 participants (n=9 female), 26 chose to smoke with a median time to a first puff of 1.22 minutes (standard deviation=2.62 min, range=0.03–10.62 min). Survival analyses examined latency to first puff, and results indicated that greater pre-task craving and smoking more cigarettes per day were significantly related to smoking sooner in the task. Greater behavioral disinhibition predicted shorter smoking latency in the first two minutes of the task, but not at a delay of more than two minutes. Lower distress tolerance (reporting greater regulation efforts to alleviate distress) was related to more puffs smoked and greater nicotine dependence was related to more time spent smoking in the task. This novel laboratory smoking-choice paradigm may be a useful laboratory analog for the choices smokers make during cessation attempts and may help identify factors that influence smoking lapses. PMID:23421357

No Effect of Commercial Cognitive Training on Brain Activity, Choice Behavior, or Cognitive Performance.

PubMed

Kable, Joseph W; Caulfield, M Kathleen; Falcone, Mary; McConnell, Mairead; Bernardo, Leah; Parthasarathi, Trishala; Cooper, Nicole; Ashare, Rebecca; Audrain-McGovern, Janet; Hornik, Robert; Diefenbach, Paul; Lee, Frank J; Lerman, Caryn

2017-08-02

Increased preference for immediate over delayed rewards and for risky over certain rewards has been associated with unhealthy behavioral choices. Motivated by evidence that enhanced cognitive control can shift choice behavior away from immediate and risky rewards, we tested whether training executive cognitive function could influence choice behavior and brain responses. In this randomized controlled trial, 128 young adults (71 male, 57 female) participated in 10 weeks of training with either a commercial web-based cognitive training program or web-based video games that do not specifically target executive function or adapt the level of difficulty throughout training. Pretraining and post-training, participants completed cognitive assessments and functional magnetic resonance imaging during performance of the following validated decision-making tasks: delay discounting (choices between smaller rewards now vs larger rewards in the future) and risk sensitivity (choices between larger riskier rewards vs smaller certain rewards). Contrary to our hypothesis, we found no evidence that cognitive training influences neural activity during decision-making; nor did we find effects of cognitive training on measures of delay discounting or risk sensitivity. Participants in the commercial training condition improved with practice on the specific tasks they performed during training, but participants in both conditions showed similar improvement on standardized cognitive measures over time. Moreover, the degree of improvement was comparable to that observed in individuals who were reassessed without any training whatsoever. Commercial adaptive cognitive training appears to have no benefits in healthy young adults above those of standard video games for measures of brain activity, choice behavior, or cognitive performance. SIGNIFICANCE STATEMENT Engagement of neural regions and circuits important in executive cognitive function can bias behavioral choices away from immediate rewards. Activity in these regions may be enhanced through adaptive cognitive training. Commercial brain training programs claim to improve a broad range of mental processes; however, evidence for transfer beyond trained tasks is mixed. We undertook the first randomized controlled trial of the effects of commercial adaptive cognitive training (Lumosity) on neural activity and decision-making in young adults ( N = 128) compared with an active control (playing on-line video games). We found no evidence for relative benefits of cognitive training with respect to changes in decision-making behavior or brain response, or for cognitive task performance beyond those specifically trained. Copyright © 2017 the authors 0270-6474/17/377390-13$15.00/0.

No Effect of Commercial Cognitive Training on Brain Activity, Choice Behavior, or Cognitive Performance

PubMed Central

Caulfield, M. Kathleen; McConnell, Mairead; Bernardo, Leah; Parthasarathi, Trishala; Cooper, Nicole; Ashare, Rebecca; Audrain-McGovern, Janet; Lee, Frank J.; Lerman, Caryn

2017-01-01

Increased preference for immediate over delayed rewards and for risky over certain rewards has been associated with unhealthy behavioral choices. Motivated by evidence that enhanced cognitive control can shift choice behavior away from immediate and risky rewards, we tested whether training executive cognitive function could influence choice behavior and brain responses. In this randomized controlled trial, 128 young adults (71 male, 57 female) participated in 10 weeks of training with either a commercial web-based cognitive training program or web-based video games that do not specifically target executive function or adapt the level of difficulty throughout training. Pretraining and post-training, participants completed cognitive assessments and functional magnetic resonance imaging during performance of the following validated decision-making tasks: delay discounting (choices between smaller rewards now vs larger rewards in the future) and risk sensitivity (choices between larger riskier rewards vs smaller certain rewards). Contrary to our hypothesis, we found no evidence that cognitive training influences neural activity during decision-making; nor did we find effects of cognitive training on measures of delay discounting or risk sensitivity. Participants in the commercial training condition improved with practice on the specific tasks they performed during training, but participants in both conditions showed similar improvement on standardized cognitive measures over time. Moreover, the degree of improvement was comparable to that observed in individuals who were reassessed without any training whatsoever. Commercial adaptive cognitive training appears to have no benefits in healthy young adults above those of standard video games for measures of brain activity, choice behavior, or cognitive performance. SIGNIFICANCE STATEMENT Engagement of neural regions and circuits important in executive cognitive function can bias behavioral choices away from immediate rewards. Activity in these regions may be enhanced through adaptive cognitive training. Commercial brain training programs claim to improve a broad range of mental processes; however, evidence for transfer beyond trained tasks is mixed. We undertook the first randomized controlled trial of the effects of commercial adaptive cognitive training (Lumosity) on neural activity and decision-making in young adults (N = 128) compared with an active control (playing on-line video games). We found no evidence for relative benefits of cognitive training with respect to changes in decision-making behavior or brain response, or for cognitive task performance beyond those specifically trained. PMID:28694338

Choice-specific sequences in parietal cortex during a virtual-navigation decision task

PubMed Central

Harvey, Christopher D.; Coen, Philip; Tank, David W.

2012-01-01

The posterior parietal cortex (PPC) plays an important role in many cognitive behaviors; however, the neural circuit dynamics underlying PPC function are not well understood. Here we optically imaged the spatial and temporal activity patterns of neuronal populations in mice performing a PPC-dependent task that combined a perceptual decision and memory-guided navigation in a virtual environment. Individual neurons had transient activation staggered relative to one another in time, forming a sequence of neuronal activation spanning the entire length of a task trial. Distinct sequences of neurons were triggered on trials with opposite behavioral choices and defined divergent, choice-specific trajectories through a state space of neuronal population activity. Cells participating in the different sequences and at distinct time points in the task were anatomically intermixed over microcircuit length scales (< 100 micrometers). During working memory decision tasks the PPC may therefore perform computations through sequence-based circuit dynamics, rather than long-lived stable states, implemented using anatomically intermingled microcircuits. PMID:22419153

Quantitative prediction of perceptual decisions during near-threshold fear detection

NASA Astrophysics Data System (ADS)

Pessoa, Luiz; Padmala, Srikanth

2005-04-01

A fundamental goal of cognitive neuroscience is to explain how mental decisions originate from basic neural mechanisms. The goal of the present study was to investigate the neural correlates of perceptual decisions in the context of emotional perception. To probe this question, we investigated how fluctuations in functional MRI (fMRI) signals were correlated with behavioral choice during a near-threshold fear detection task. fMRI signals predicted behavioral choice independently of stimulus properties and task accuracy in a network of brain regions linked to emotional processing: posterior cingulate cortex, medial prefrontal cortex, right inferior frontal gyrus, and left insula. We quantified the link between fMRI signals and behavioral choice in a whole-brain analysis by determining choice probabilities by means of signal-detection theory methods. Our results demonstrate that voxel-wise fMRI signals can reliably predict behavioral choice in a quantitative fashion (choice probabilities ranged from 0.63 to 0.78) at levels comparable to neuronal data. We suggest that the conscious decision that a fearful face has been seen is represented across a network of interconnected brain regions that prepare the organism to appropriately handle emotionally challenging stimuli and that regulate the associated emotional response. decision making | emotion | functional MRI

Mechanisms of impulsive choice: III. The role of reward processes

PubMed Central

Marshall, Andrew T.

2015-01-01

Two experiments examined the relationship between reward processing and impulsive choice. In Experiment 1, rats chose between a smaller-sooner (SS) reward (1 pellet, 10 s) and a larger-later (LL) reward (1, 2, and 4 pellets, 30 s). The rats then experienced concurrent variable-interval 30-s schedules with variations in reward magnitude to evaluate reward magnitude discrimination. LL choice behavior positively correlated with reward magnitude discrimination. In Experiment 2, rats chose between an SS reward (1 pellet, 10 s) and an LL reward (2 and 4 pellets, 30 s). The rats then received either a reward intervention which consisted of concurrent fixed-ratio schedules associated with different magnitudes to improve their reward magnitude discrimination, or a control task. All rats then experienced a post-intervention impulsive choice task followed by a reward magnitude discrimination task to assess intervention efficacy. The rats that received the intervention exhibited increases in post-intervention LL choice behavior, and made more responses for larger-reward magnitudes in the reward magnitude discrimination task, suggesting that the intervention heightened sensitivities to reward magnitude. The results suggest that reward magnitude discrimination plays a key role in individual differences in impulsive choice, and could be a potential target for further intervention developments. PMID:26506254

Rats prefer mutual rewards in a prosocial choice task.

PubMed

Hernandez-Lallement, Julen; van Wingerden, Marijn; Marx, Christine; Srejic, Milan; Kalenscher, Tobias

2014-01-01

Pro-sociality, i.e., the preference for outcomes that produce benefits for other individuals, is ubiquitous in humans. Recently, cross-species comparisons of social behavior have offered important new insights into the evolution of pro-sociality. Here, we present a rodent analog of the Pro-social Choice Task that controls strategic components, de-confounds other-regarding choice motives from the animals' natural tendencies to maximize own food access and directly tests the effect of social context on choice allocation. We trained pairs of rats-an actor and a partner rat-in a double T-maze task where actors decided between two alternatives only differing in the reward delivered to the partner. The "own reward" choice yielded a reward only accessible to the actor whereas the "both reward" choice produced an additional reward for a partner (partner condition) or an inanimate toy (toy Condition), located in an adjacent compartment. We found that actors chose "both reward" at levels above chance and more often in the partner than in the toy condition. Moreover, we show that this choice pattern adapts to the current social context and that the observed behavior is stable over time.

Rats prefer mutual rewards in a prosocial choice task

PubMed Central

Hernandez-Lallement, Julen; van Wingerden, Marijn; Marx, Christine; Srejic, Milan; Kalenscher, Tobias

2015-01-01

Pro-sociality, i.e., the preference for outcomes that produce benefits for other individuals, is ubiquitous in humans. Recently, cross-species comparisons of social behavior have offered important new insights into the evolution of pro-sociality. Here, we present a rodent analog of the Pro-social Choice Task that controls strategic components, de-confounds other-regarding choice motives from the animals' natural tendencies to maximize own food access and directly tests the effect of social context on choice allocation. We trained pairs of rats—an actor and a partner rat—in a double T-maze task where actors decided between two alternatives only differing in the reward delivered to the partner. The “own reward” choice yielded a reward only accessible to the actor whereas the “both reward” choice produced an additional reward for a partner (partner condition) or an inanimate toy (toy Condition), located in an adjacent compartment. We found that actors chose “both reward” at levels above chance and more often in the partner than in the toy condition. Moreover, we show that this choice pattern adapts to the current social context and that the observed behavior is stable over time. PMID:25642162

The downside of choice: Having a choice benefits enjoyment, but at a cost to efficiency and time in visual search.

PubMed

Kunar, Melina A; Ariyabandu, Surani; Jami, Zaffran

2016-04-01

The efficiency of how people search for an item in visual search has, traditionally, been thought to depend on bottom-up or top-down guidance cues. However, recent research has shown that the rate at which people visually search through a display is also affected by cognitive strategies. In this study, we investigated the role of choice in visual search, by asking whether giving people a choice alters both preference for a cognitively neutral task and search behavior. Two visual search conditions were examined: one in which participants were given a choice of visual search task (the choice condition), and one in which participants did not have a choice (the no-choice condition). The results showed that the participants in the choice condition rated the task as both more enjoyable and likeable than did the participants in the no-choice condition. However, despite their preferences, actual search performance was slower and less efficient in the choice condition than in the no-choice condition (Exp. 1). Experiment 2 showed that the difference in search performance between the choice and no-choice conditions disappeared when central executive processes became occupied with a task-switching task. These data concur with a choice-impaired hypothesis of search, in which having a choice leads to more motivated, active search involving executive processes.

Systemic administration of guanfacine improves food-motivated impulsive choice behavior primarily via direct stimulation of postsynaptic α2A-adrenergic receptors in rats.

PubMed

Nishitomi, Kouhei; Yano, Koji; Kobayashi, Mika; Jino, Kohei; Kano, Takuya; Horiguchi, Naotaka; Shinohara, Shunji; Hasegawa, Minoru

2018-06-01

Impulsive choice behavior, which can be assessed using the delay discounting task, is a characteristic of various psychiatric disorders, including attention-deficit/hyperactivity disorder (ADHD). Guanfacine is a selective α 2A -adrenergic receptor agonist that is clinically effective in treating ADHD. However, there is no clear evidence that systemic guanfacine administration reduces impulsive choice behavior in the delay discounting task in rats. In the present study, we examined the effect of systemic guanfacine administration on food-motivated impulsive choice behavior in rats and the neuronal mechanism underlying this effect. Repeated administration of either guanfacine, methylphenidate, or atomoxetine significantly enhanced impulse control, increasing the number of times the rats chose a large but delayed reward in a dose-dependent manner. The effect of guanfacine was significantly blocked by pretreatment with an α 2A -adrenergic receptor antagonist. Furthermore, the effect of guanfacine remained unaffected in rats pretreated with a selective noradrenergic neurotoxin, consistent with a post-synaptic action. In contrast, the effect of atomoxetine on impulsive choice behavior was attenuated by pretreatment with the noradrenergic neurotoxin. These results provide the first evidence that systemically administered guanfacine reduces impulsive choice behavior in rats and that direct stimulation of postsynaptic, rather than presynaptic, α 2A -adrenergic receptors is involved in this effect. Copyright © 2018 Elsevier B.V. All rights reserved.

The Environment Makes a Difference: The Impact of Explicit and Implicit Attitudes as Precursors in Different Food Choice Tasks

PubMed Central

König, Laura M.; Giese, Helge; Schupp, Harald T.; Renner, Britta

2016-01-01

Studies show that implicit and explicit attitudes influence food choice. However, precursors of food choice often are investigated using tasks offering a very limited number of options despite the comparably complex environment surrounding real life food choice. In the present study, we investigated how the assortment impacts the relationship between implicit and explicit attitudes and food choice (confectionery and fruit), assuming that a more complex choice architecture is more taxing on cognitive resources. Specifically, a binary and a multiple option choice task based on the same stimulus set (fake food items) were presented to ninety-seven participants. Path modeling revealed that both explicit and implicit attitudes were associated with relative food choice (confectionery vs. fruit) in both tasks. In the binary option choice task, both explicit and implicit attitudes were significant precursors of food choice, with explicit attitudes having a greater impact. Conversely, in the multiple option choice task, the additive impact of explicit and implicit attitudes was qualified by an interaction indicating that, even if explicit and implicit attitudes toward confectionery were inconsistent, more confectionery was chosen than fruit if either was positive. This compensatory ‘one is sufficient’-effect indicates that the structure of the choice environment modulates the relationship between attitudes and choice. The study highlights that environmental constraints, such as the number of choice options, are an important boundary condition that need to be included when investigating the relationship between psychological precursors and behavior. PMID:27621719

The Environment Makes a Difference: The Impact of Explicit and Implicit Attitudes as Precursors in Different Food Choice Tasks.

PubMed

König, Laura M; Giese, Helge; Schupp, Harald T; Renner, Britta

2016-01-01

Studies show that implicit and explicit attitudes influence food choice. However, precursors of food choice often are investigated using tasks offering a very limited number of options despite the comparably complex environment surrounding real life food choice. In the present study, we investigated how the assortment impacts the relationship between implicit and explicit attitudes and food choice (confectionery and fruit), assuming that a more complex choice architecture is more taxing on cognitive resources. Specifically, a binary and a multiple option choice task based on the same stimulus set (fake food items) were presented to ninety-seven participants. Path modeling revealed that both explicit and implicit attitudes were associated with relative food choice (confectionery vs. fruit) in both tasks. In the binary option choice task, both explicit and implicit attitudes were significant precursors of food choice, with explicit attitudes having a greater impact. Conversely, in the multiple option choice task, the additive impact of explicit and implicit attitudes was qualified by an interaction indicating that, even if explicit and implicit attitudes toward confectionery were inconsistent, more confectionery was chosen than fruit if either was positive. This compensatory 'one is sufficient'-effect indicates that the structure of the choice environment modulates the relationship between attitudes and choice. The study highlights that environmental constraints, such as the number of choice options, are an important boundary condition that need to be included when investigating the relationship between psychological precursors and behavior.

When pain meets … pain-related choice behavior and pain perception in different goal conflict situations.

PubMed

Schrooten, Martien G S; Wiech, Katja; Vlaeyen, Johan W S

2014-11-01

Individuals in pain often face the choice between avoiding pain and pursuing other equally valued goals. However, little is known about pain-related choice behavior and pain perception in goal conflict situations. Seventy-eight healthy volunteers performed a computerized task requiring repeated choices between incompatible options, differing in their effect on probability to receive painful stimulation and money. Depending on group assignment, participants chose between increased pain probability versus decreased money probability (avoidance-avoidance conflict situation); decreased pain probability versus increased money probability (approach-approach conflict situation); or decrease versus increase in both probabilities (double approach/avoidance conflict situation). During the choice task, participants rated painfulness, unpleasantness, threat, and fearfulness associated with the painful stimulation and how they felt. Longer choice latency and more choice switching were associated with higher retrospective ratings of conflict and of decision difficulty, and more equal importance placed on pain avoidance and earning money. Groups did not differ in choice behavior, pain stimulus ratings, or affect. Across groups, longer choice latencies were nonsignificantly associated with higher pain, unpleasantness, threat, and fearfulness. In the avoidance-avoidance group, more choice switching was associated with higher pain-related threat and fearfulness, and with more negative affect. These results of this study suggest that associations between choice behaviors, pain perception, and affect depend on conflict situation. We present a first experimental demonstration of the relationship between pain-related choice behaviors, pain, and affect in different goal conflict situations. This experimental approach allows us to examine these relationships in a controlled fashion. Better understanding of pain-related goal conflicts and their resolution may lead to more effective pain treatment. Copyright © 2014 American Pain Society. Published by Elsevier Inc. All rights reserved.

Nucleus accumbens neurotransmission and effort-related choice behavior in food motivation: effects of drugs acting on dopamine, adenosine, and muscarinic acetylcholine receptors.

PubMed

Nunes, Eric J; Randall, Patrick A; Podurgiel, Samantha; Correa, Mercè; Salamone, John D

2013-11-01

Mesolimbic dopamine (DA) is a critical component of the brain circuitry regulating behavioral activation and effort-related processes. Although nucleus accumbens (NAc) DA depletions or antagonism leave aspects of appetite and primary food motivation intact, rats with impaired DA transmission reallocate their instrumental behavior away from food-reinforced tasks with high response requirements, and instead select less effortful food-seeking behaviors. Previous work showed that adenosine A2A antagonists can reverse the effects of DA D2 antagonists on effort-related choice, and that stimulation of adenosine A2A receptors produces behavioral effects that are similar to those induced by DA antagonism. The present review summarizes the literature on the role of NAc DA and adenosine in effort-related processes, and also presents original data on the effects of local stimulation of muscarinic acetylcholine receptors in NAc core. Local injections of the muscarinic agonist pilocarpine directly into NAc core produces shifts in effort-related choice behavior similar to those induced by DA antagonism or A2A receptor stimulation, decreasing lever pressing but increasing chow intake in rats responding on a concurrent fixed ratio/chow feeding choice task. In contrast, injections into a neostriatal control site dorsal to the NAc were ineffective. The actions of pilocarpine on this task were attenuated by co-administration of the muscarinic antagonist scopolamine. Thus, drugs that act on DA, adenosine A2A, and muscarinic receptors regulate effort-related choice behavior, which may have implications for the treatment of psychiatric symptoms such as psychomotor slowing, fatigue or anergia that can be observed in depression and other disorders. Copyright © 2013 Elsevier Ltd. All rights reserved.

Glucocorticoid Regulation of Food-Choice Behavior in Humans: Evidence from Cushing's Syndrome

PubMed Central

Moeller, Scott J.; Couto, Lizette; Cohen, Vanessa; Lalazar, Yelena; Makotkine, Iouri; Williams, Nia; Yehuda, Rachel; Goldstein, Rita Z.; Geer, Eliza B.

2016-01-01

The mechanisms by which glucocorticoids regulate food intake and resulting body mass in humans are not well-understood. One potential mechanism could involve modulation of reward processing, but human stress models examining effects of glucocorticoids on behavior contain important confounds. Here, we studied individuals with Cushing's syndrome, a rare endocrine disorder characterized by chronic excess endogenous glucocorticoids. Twenty-three patients with Cushing's syndrome (13 with active disease; 10 with disease in remission) and 15 controls with a comparably high body mass index (BMI) completed two simulated food-choice tasks (one with “explicit” task contingencies and one with “probabilistic” task contingencies), during which they indicated their objective preference for viewing high calorie food images vs. standardized pleasant, unpleasant, and neutral images. All participants also completed measures of food craving, and approximately half of the participants provided 24-h urine samples for assessment of cortisol and cortisone concentrations. Results showed that on the explicit task (but not the probabilistic task), participants with active Cushing's syndrome made fewer food-related choices than participants with Cushing's syndrome in remission, who in turn made fewer food-related choices than overweight controls. Corroborating this group effect, higher urine cortisone was negatively correlated with food-related choice in the subsample of all participants for whom these data were available. On the probabilistic task, despite a lack of group differences, higher food-related choice correlated with higher state and trait food craving in active Cushing's patients. Taken together, relative to overweight controls, Cushing's patients, particularly those with active disease, displayed a reduced vigor of responding for food rewards that was presumably attributable to glucocorticoid abnormalities. Beyond Cushing's, these results may have relevance for elucidating glucocorticoid contributions to food-seeking behavior, enhancing mechanistic understanding of weight fluctuations associated with oral glucocorticoid therapy and/or chronic stress, and informing the neurobiology of neuropsychiatric conditions marked by abnormal cortisol dynamics (e.g., major depression, Alzheimer's disease). PMID:26903790

Glucocorticoid Regulation of Food-Choice Behavior in Humans: Evidence from Cushing's Syndrome.

PubMed

Moeller, Scott J; Couto, Lizette; Cohen, Vanessa; Lalazar, Yelena; Makotkine, Iouri; Williams, Nia; Yehuda, Rachel; Goldstein, Rita Z; Geer, Eliza B

2016-01-01

The mechanisms by which glucocorticoids regulate food intake and resulting body mass in humans are not well-understood. One potential mechanism could involve modulation of reward processing, but human stress models examining effects of glucocorticoids on behavior contain important confounds. Here, we studied individuals with Cushing's syndrome, a rare endocrine disorder characterized by chronic excess endogenous glucocorticoids. Twenty-three patients with Cushing's syndrome (13 with active disease; 10 with disease in remission) and 15 controls with a comparably high body mass index (BMI) completed two simulated food-choice tasks (one with "explicit" task contingencies and one with "probabilistic" task contingencies), during which they indicated their objective preference for viewing high calorie food images vs. standardized pleasant, unpleasant, and neutral images. All participants also completed measures of food craving, and approximately half of the participants provided 24-h urine samples for assessment of cortisol and cortisone concentrations. Results showed that on the explicit task (but not the probabilistic task), participants with active Cushing's syndrome made fewer food-related choices than participants with Cushing's syndrome in remission, who in turn made fewer food-related choices than overweight controls. Corroborating this group effect, higher urine cortisone was negatively correlated with food-related choice in the subsample of all participants for whom these data were available. On the probabilistic task, despite a lack of group differences, higher food-related choice correlated with higher state and trait food craving in active Cushing's patients. Taken together, relative to overweight controls, Cushing's patients, particularly those with active disease, displayed a reduced vigor of responding for food rewards that was presumably attributable to glucocorticoid abnormalities. Beyond Cushing's, these results may have relevance for elucidating glucocorticoid contributions to food-seeking behavior, enhancing mechanistic understanding of weight fluctuations associated with oral glucocorticoid therapy and/or chronic stress, and informing the neurobiology of neuropsychiatric conditions marked by abnormal cortisol dynamics (e.g., major depression, Alzheimer's disease).

Development of using experimenter-given cues in infant chimpanzees: longitudinal changes in behavior and cognitive development.

PubMed

Okamoto-Barth, Sanae; Tomonaga, Masaki; Tanaka, Masayuki; Matsuzawa, Tetsuro

2008-01-01

The use of gaze shifts as social cues has various evolutionary advantages. To investigate the developmental processes of this ability, we conducted an object-choice task by using longitudinal methods with infant chimpanzees tested from 8 months old until 3 years old. The experimenter used one of six gestures towards a cup concealing food; tapping, touching, whole-hand pointing, gazing plus close-pointing, distant-pointing, close-gazing, and distant-gazing. Unlike any other previous study, we analyzed the behavioral changes that occurred before and after choosing the cup. We assumed that pre-choice behavior indicates the development of an attentional and spatial connection between a pointing cue and an object (e.g. Woodward, 2005); and post-choice behavior indicates the emergence of object permanence (e.g. Piaget, 1954). Our study demonstrated that infant chimpanzees begin to use experimenter-given cues with age (after 11 months of age). Moreover, the results from the behavioral analysis showed that the infants gradually developed the spatial link between the pointing as an object-directed action and the object. Moreover, when they were 11 months old, the infants began to inspect the inside of the cup, suggesting the onset of object permanence. Overall, our results imply that the ability to use the cues is developing and mutually related with other cognitive developments. The present study also suggests what the standard object-choice task actually measures by breaking the task down into the developmental trajectories of its component parts, and describes for the first time the social-physical cognitive development during the task with a longitudinal method.

INDIVIDUAL DIFFERENCES IN IMPULSIVE CHOICE AND TIMING IN RATS

PubMed Central

Galtress, Tiffany; Garcia, Ana; Kirkpatrick, Kimberly

2012-01-01

Individual differences in impulsive choice behavior have been linked to a variety of behavioral problems including substance abuse, smoking, gambling, and poor financial decision-making. Given the potential importance of individual differences in impulsive choice as a predictor of behavioral problems, the present study sought to measure the extent of individual differences in a normal sample of hooded Lister rats. Three experiments utilized variations of a delay discounting task to measure the degree of variation in impulsive choice behavior across individual rats. The individual differences accounted for 22–55% of the variance in choice behavior across the three experiments. In Experiments 2 and 3, the individual differences were still apparent when behavior was measured across multiple choice points. Large individual differences in the rate of responding, and modest individual differences in timing of responding were also observed during occasional peak trials. The individual differences in timing and rate, however, did not correlate consistently with individual differences in choice behavior. This suggests that a variety of factors may affect choice behavior, response rate, and response timing. PMID:22851792

Age differences in risky choice: a meta-analysis

PubMed Central

Mata, Rui; Josef, Anika K.; Samanez-Larkin, Gregory R.; Hertwig, Ralph

2012-01-01

Does risk taking change as a function of age? We conducted a systematic literature search and found 29 comparisons between younger and older adults on behavioral tasks thought to measure risk taking (N =4,093). The reports relied on various tasks differing in several respects, such as the amount of learning required or the choice framing (gains vs. losses). The results suggest that age-related differences vary considerably as a function of task characteristics, in particular the learning requirements of the task. In decisions from experience, age-related differences in risk taking were a function of decreased learning performance: older adults were more risk seeking compared to younger adults when learning led to risk-avoidant behavior, but were more risk averse when learning led to risk-seeking behavior. In decisions from description, younger adults and older adults showed similar risk-taking behavior for the majority of the tasks, and there were no clear age-related differences as a function of gain/loss framing. We discuss limitations and strengths of past research and provide suggestions for future work on age-related differences in risk taking. PMID:22023565

Memory modulates journey-dependent coding in the rat hippocampus

PubMed Central

Ferbinteanu, J.; Shirvalkar, P.; Shapiro, M. L.

2011-01-01

Neurons in the rat hippocampus signal current location by firing in restricted areas called place fields. During goal-directed tasks in mazes, place fields can also encode past and future positions through journey-dependent activity, which could guide hippocampus-dependent behavior and underlie other temporally extended memories, such as autobiographical recollections. The relevance of journey-dependent activity for hippocampal-dependent memory, however, is not well understood. To further investigate the relationship between hippocampal journey-dependent activity and memory we compared neural firing in rats performing two mnemonically distinct but behaviorally identical tasks in the plus maze: a hippocampus-dependent spatial navigation task, and a hippocampus-independent cue response task. While place, prospective, and retrospective coding reflected temporally extended behavioral episodes in both tasks, memory strategy altered coding differently before and after the choice point. Before the choice point, when discriminative selection of memory strategy was critical, a switch between the tasks elicited a change in a field’s coding category, so that a field that signaled current location in one task coded pending journeys in the other task. After the choice point, however, when memory strategy became irrelevant, the fields preserved coding categories across tasks, so that the same field consistently signaled either current location or the recent journeys. Additionally, on the start arm firing rates were affected at comparable levels by task and journey, while on the goal arm firing rates predominantly encoded journey. The data demonstrate a direct link between journey-dependent coding and memory, and suggest that episodes are encoded by both population and firing rate coding. PMID:21697365

Asymmetrically dominated choice problems, the isolation hypothesis and random incentive mechanisms.

PubMed

Cox, James C; Sadiraj, Vjollca; Schmidt, Ulrich

2014-01-01

This paper presents an experimental study of the random incentive mechanisms which are a standard procedure in economic and psychological experiments. Random incentive mechanisms have several advantages but are incentive-compatible only if responses to the single tasks are independent. This is true if either the independence axiom of expected utility theory or the isolation hypothesis of prospect theory holds. We present a simple test of this in the context of choice under risk. In the baseline (one task) treatment we observe risk behavior in a given choice problem. We show that by integrating a second, asymmetrically dominated choice problem in a random incentive mechanism risk behavior can be manipulated systematically. This implies that the isolation hypothesis is violated and the random incentive mechanism does not elicit true preferences in our example.

Context influences decision-making in boys with attention-deficit/hyperactivity disorder: A comparison of traditional and novel choice-impulsivity paradigms.

PubMed

Patros, Connor H G; Alderson, R Matt; Lea, Sarah E; Tarle, Stephanie J

2017-02-01

Attention-deficit/hyperactivity disorder (ADHD) is characterized by an impaired ability to maintain attention and/or hyperactivity/impulsivity. Impulsivity is frequently defined as the preference for small, immediate rewards over larger, delayed rewards, and has been associated with a variety of negative outcomes such as risky behavior and academic difficulty. Extant studies have uniformly utilized the traditional paradigm of presenting two response choices, which limits the generalization of findings to scenarios in which children/adolescents are faced with dichotomous decisions. The current study is the first to examine the effect of manipulating the number of available response options on impulsive decision-making in boys with and without ADHD. A total of 39 boys (ADHD = 16, typically developing [TD] = 23) aged 8-12 years completed a traditional two-choice impulsivity task and a novel five-choice impulsivity task to examine the effect of manipulating the number of choice responses (two vs five) on impulsive decision-making. A five-choice task was utilized as it presents a more continuous array of choice options when compared to the typical two-choice task, and is comparable given its methodological similarity to the two-choice task. Results suggested that boys with ADHD were significantly more impulsive than TD boys during the two-choice task, but not during the five-choice task. Collectively, these findings suggest that ADHD-related impulsivity is not ubiquitous, but rather dependent on variation in demands and/or context. Further, these findings highlight the importance of examining ADHD-related decision-making within the context of alternative paradigms, as the exclusive utilization of two-choice tasks may promote inaccurate conceptualizations of the disorder.

Search, Memory, and Choice Error: An Experiment

PubMed Central

Sanjurjo, Adam

2015-01-01

Multiple attribute search is a central feature of economic life: we consider much more than price when purchasing a home, and more than wage when choosing a job. An experiment is conducted in order to explore the effects of cognitive limitations on choice in these rich settings, in accordance with the predictions of a new model of search memory load. In each task, subjects are made to search the same information in one of two orders, which differ in predicted memory load. Despite standard models of choice treating such variations in order of acquisition as irrelevant, lower predicted memory load search orders are found to lead to substantially fewer choice errors. An implication of the result for search behavior, more generally, is that in order to reduce memory load (thus choice error) a limited memory searcher ought to deviate from the search path of an unlimited memory searcher in predictable ways-a mechanism that can explain the systematic deviations from optimal sequential search that have recently been discovered in peoples' behavior. Further, as cognitive load is induced endogenously (within the task), and found to affect choice behavior, this result contributes to the cognitive load literature (in which load is induced exogenously), as well as the cognitive ability literature (in which cognitive ability is measured in a separate task). In addition, while the information overload literature has focused on the detrimental effects of the quantity of information on choice, this result suggests that, holding quantity constant, the order that information is observed in is an essential determinant of choice failure. PMID:26121356

Behavioral and neural correlates of loss aversion and risk avoidance in adolescents and adults.

PubMed

Barkley-Levenson, Emily E; Van Leijenhorst, Linda; Galván, Adriana

2013-01-01

Individuals are frequently faced with risky decisions involving the potential for both gain and loss. Exploring the role of both potential gains and potential losses in predicting risk taking is critical to understanding how adolescents and adults make the choice to engage in or avoid a real-life risk. This study aimed to examine the impact of potential losses as well as gains on adolescent decisions during risky choice in a laboratory task. Adolescent (n=18) and adult (n=16) participants underwent functional magnetic resonance imaging (fMRI) during a mixed gambles task, and completed questionnaires measuring real-world risk-taking behaviors. While potential loss had a significantly greater effect on choice than potential gain in both adolescents and adults and there were no behavioral group differences on the task, adolescents recruited significantly more frontostriatal circuitry than adults when choosing to reject a gamble. During risk-seeking behavior, adolescent activation in medial prefrontal cortex (mPFC) was negatively correlated with self-reported likelihood of risk taking. During risk-avoidant behavior, mPFC activation of in adults was negatively correlated with self-reported benefits of risk-taking. Taken together, these findings reflect different neural patterns during risk-taking and risk-avoidant behaviors in adolescents and adults. Copyright © 2012 Elsevier Ltd. All rights reserved.

Choice Behavior Guided by Learned, But Not Innate, Taste Aversion Recruits the Orbitofrontal Cortex.

PubMed

Ramírez-Lugo, Leticia; Peñas-Rincón, Ana; Ángeles-Durán, Sandybel; Sotres-Bayon, Francisco

2016-10-12

The ability to select an appropriate behavioral response guided by previous emotional experiences is critical for survival. Although much is known about brain mechanisms underlying emotional associations, little is known about how these associations guide behavior when several choices are available. To address this, we performed local pharmacological inactivations of several cortical regions before retrieval of an aversive memory in choice-based versus no-choice-based conditioned taste aversion (CTA) tasks in rats. Interestingly, we found that inactivation of the orbitofrontal cortex (OFC), but not the dorsal or ventral medial prefrontal cortices, blocked retrieval of choice CTA. However, OFC inactivation left retrieval of no-choice CTA intact, suggesting its role in guiding choice, but not in retrieval of CTA memory. Consistently, OFC activity increased in the choice condition compared with no-choice, as measured with c-Fos immunolabeling. Notably, OFC inactivation did not affect choice behavior when it was guided by innate taste aversion. Consistent with an anterior insular cortex (AIC) involvement in storing taste memories, we found that AIC inactivation impaired retrieval of both choice and no-choice CTA. Therefore, this study provides evidence for OFC's role in guiding choice behavior and shows that this is dissociable from AIC-dependent taste aversion memory. Together, our results suggest that OFC is required and recruited to guide choice selection between options of taste associations relayed from AIC. Survival and mental health depend on being able to choose stimuli not associated with danger. This is particularly important when danger is associated with stimuli that we ingest. Although much is known about the brain mechanisms that underlie associations with dangerous taste stimuli, very little is known about how these stored emotional associations guide behavior when it involves choice. By combining pharmacological and immunohistochemistry tools with taste-guided tasks, our study provides evidence for the key role of orbitofrontal cortex activity in choice behavior and shows that this is dissociable from the adjacent insular cortex-dependent taste aversion memory. Understanding the brain mechanisms that underlie the impact that emotional associations have on survival choice behaviors may lead to better treatments for mental disorders characterized by emotional decision-making deficits. Copyright © 2016 the authors 0270-6474/16/3610574-10$15.00/0.

Moral license in video games: when being right can mean doing wrong.

PubMed

Ellithorpe, Morgan E; Cruz, Carlos; Velez, John A; Ewoldsen, David R; Bogert, Adam K

2015-04-01

Research on video game violence has found largely consistent evidence that violence in video games tends to be associated with an increase in antisocial behavior. However, this body of work has mostly ignored one prominent feature of many violent games: moral decision making. It is possible that the influence of video game violence could change when moral decisions are brought into the context. One way video games change behavior is through changes in players' self-perceptions, a process called identity simulation. In addition, a perspective called moral license predicts that these effects should not necessarily be consistent across behaviors, in that people should try to balance selfishness with keeping the moral high ground across many behaviors. Therefore, moral choices (or immoral choices) in a video game may predict less moral (or more moral) behaviors right after the game. However, later behavior may revert yet again, creating a cycle of pro- and antisocial behaviors. The present experiment asks participants to make moral choices in a video game, and then measures their behavior on two subsequent tasks. Results indicate that taking what participants perceive to be the more moral mind-set in the video game predicts more antisocial behavior on the first task, but more pro-social behavior on the next task. These results support identity simulation and moral license processes in a video game and moral behavior context, and indicate that there may be greater complexity in video game violence effects than previously understood.

Smoking and the bandit: a preliminary study of smoker and nonsmoker differences in exploratory behavior measured with a multiarmed bandit task.

PubMed

Addicott, Merideth A; Pearson, John M; Wilson, Jessica; Platt, Michael L; McClernon, F Joseph

2013-02-01

Advantageous decision-making is an adaptive trade-off between exploring alternatives and exploiting the most rewarding option. This trade-off may be related to maladaptive decision-making associated with nicotine dependence; however, explore/exploit behavior has not been previously investigated in the context of addiction. The explore/exploit trade-off is captured by the multiarmed bandit task, in which different arms of a slot machine are chosen to discover the relative payoffs. The goal of this study was to preliminarily investigate whether smokers differ from nonsmokers in their degree of exploratory behavior. Smokers (n = 18) and nonsmokers (n = 17) completed a 6-armed bandit task as well as self-report measures of behavior and personality traits. Smokers were found to exhibit less exploratory behavior (i.e., made fewer switches between slot machine arms) than nonsmokers within the first 300 trials of the bandit task. The overall proportion of exploratory choices negatively correlated with self-reported measures of delay aversion and nonplanning impulsivity. These preliminary results suggest that smokers make fewer initial exploratory choices on the bandit task. The bandit task is a promising measure that could provide valuable insights into how nicotine use and dependence is associated with explore/exploit decision-making. (c) 2013 APA, all rights reserved.

Smoking and the bandit: A preliminary study of smoker and non-smoker differences in exploratory behavior measured with a multi-armed bandit task

PubMed Central

Addicott, Merideth A.; Pearson, John M.; Wilson, Jessica; Platt, Michael L.; McClernon, F. Joseph

2014-01-01

Advantageous decision-making is an adaptive trade-off between exploring alternatives and exploiting the most rewarding option. This trade-off may be related to maladaptive decision-making associated with nicotine dependence; however, explore/exploit behavior has not been previously investigated in the context of addiction. The explore/exploit trade-off is captured by the multi-armed bandit task, in which different arms of a slot machine are chosen to discover the relative payoffs. The goal of this study was to preliminarily investigate whether smokers differ from non-smokers in their degree of exploratory behavior. Smokers (n = 18) and non-smokers (n = 17) completed a six-armed bandit task as well as self-report measures of behavior and personality traits. Smokers were found to exhibit less exploratory behavior (i.e. made fewer switches between slot machine arms) than non-smokers within the first 300 trials of the bandit task. The overall proportion of exploratory choices negatively correlated with self-reported measures of delay aversion and nonplanning impulsivity. These preliminary results suggest that smokers make fewer initial exploratory choices on the bandit task. The bandit task is a promising measure that could provide valuable insights into how nicotine use and dependence is associated with explore/exploit decision-making. PMID:23245198

Successful choice behavior is associated with distinct and coherent network states in anterior cingulate cortex

PubMed Central

Lapish, Christopher C.; Durstewitz, Daniel; Chandler, L. Judson; Seamans, Jeremy K.

2008-01-01

Successful decision making requires an ability to monitor contexts, actions, and outcomes. The anterior cingulate cortex (ACC) is thought to be critical for these functions, monitoring and guiding decisions especially in challenging situations involving conflict and errors. A number of different single-unit correlates have been observed in the ACC that reflect the diverse cognitive components involved. Yet how ACC neurons function as an integrated network is poorly understood. Here we show, using advanced population analysis of multiple single-unit recordings from the rat ACC during performance of an ecologically valid decision-making task, that ensembles of neurons move through different coherent and dissociable states as the cognitive requirements of the task change. This organization into distinct network patterns with respect to both firing-rate changes and correlations among units broke down during trials with numerous behavioral errors, especially at choice points of the task. These results point to an underlying functional organization into cell assemblies in the ACC that may monitor choices, outcomes, and task contexts, thus tracking the animal's progression through “task space.” PMID:18708525

Choice in multitasking: how delays in the primary task turn a rational into an irrational multitasker.

PubMed

Katidioti, Ioanna; Taatgen, Niels A

2014-06-01

The objective was to establish the nature of choice in cognitive multitasking. Laboratory studies of multitasking suggest people are rational in their switch choices regarding multitasking, whereas observational studies suggest they are not. Threaded cognition theory predicts that switching is opportunistic and depends on availability of cognitive resources. A total of 21 participants answered e-mails by looking up information (similar to customer service employees) while being interrupted by chat messages. They were free to choose when to switch to the chat message. We analyzed the switching behavior and the time they needed to complete the primary mail task. When participants are faced with a delay in the e-mail task, they switch more often to the chat task at high-workload points. Choosing to switch to the secondary task instead of waiting makes them slower. It also makes them forget the information in the e-mail task half of the time, which slows them down even more. When many cognitive resources are available, the probability of switching from one task to another is high. This does not necessarily lead to optimal switching behavior. Potential applications of this research include the minimization of delays in task design and the inability or discouragement of switching in high-workload moments.

Dopaminergic lesions of the dorsolateral striatum in rats increase delay discounting in an impulsive choice task.

PubMed

Tedford, Stephanie E; Persons, Amanda L; Napier, T Celeste

2015-01-01

Dysregulated dopamine transmission in striatal circuitry is associated with impulsivity. The current study evaluated the influence of dopaminergic inputs to the dorsolateral striatum on impulsive choice, one aspect of impulsive behavior. We implemented an operant task that measures impulsive choice in rats via delay discounting wherein intracranial self-stimulation (ICSS) was used as the positive reinforcer. To do so, rats were anesthetized to allow implanting of a stimulating electrode within the lateral hypothalamus of one hemisphere and bilateral dorsal striatal injections of the dopaminergic toxin, 6-OHDA (lesioned) or its vehicle (sham). Following recovery, rats were trained in a delay discounting task wherein they selected between a small ICSS current presented immediately after lever pressing, and a large ICSS current presented following a 0 to 15 s delay upon pressing the alternate lever. Task acquisition and reinforcer discrimination were similar for lesioned and sham rats. All rats exhibited an initial preference for the large reinforcer, and as the delay was increased, preference for the large reinforcer was decreased indicating that the subjective value of the large reinforcer was discounted as a function of delay time. However, this discounting effect was significantly enhanced in lesioned rats for the longer delays. These data reveal a contribution of dopaminergic inputs to the dorsolateral striatum on impulsive choice behavior, and provide new insights into neural substrates underlying discounting behaviors.

Dopaminergic Lesions of the Dorsolateral Striatum in Rats Increase Delay Discounting in an Impulsive Choice Task

PubMed Central

Tedford, Stephanie E.; Persons, Amanda L.; Napier, T. Celeste

2015-01-01

Dysregulated dopamine transmission in striatal circuitry is associated with impulsivity. The current study evaluated the influence of dopaminergic inputs to the dorsolateral striatum on impulsive choice, one aspect of impulsive behavior. We implemented an operant task that measures impulsive choice in rats via delay discounting wherein intracranial self-stimulation (ICSS) was used as the positive reinforcer. To do so, rats were anesthetized to allow implanting of a stimulating electrode within the lateral hypothalamus of one hemisphere and bilateral dorsal striatal injections of the dopaminergic toxin, 6-OHDA (lesioned) or its vehicle (sham). Following recovery, rats were trained in a delay discounting task wherein they selected between a small ICSS current presented immediately after lever pressing, and a large ICSS current presented following a 0 to 15s delay upon pressing the alternate lever. Task acquisition and reinforcer discrimination were similar for lesioned and sham rats. All rats exhibited an initial preference for the large reinforcer, and as the delay was increased, preference for the large reinforcer was decreased indicating that the subjective value of the large reinforcer was discounted as a function of delay time. However, this discounting effect was significantly enhanced in lesioned rats for the longer delays. These data reveal a contribution of dopaminergic inputs to the dorsolateral striatum on impulsive choice behavior, and provide new insights into neural substrates underlying discounting behaviors. PMID:25927685

Functionally-Indicated Choice-Making Interventions to Address Academic and Social Behaviors of Adolescent Students with Emotional/Behavioral Disorders (E/BD) in a Residential Facility

ERIC Educational Resources Information Center

Ramsey, Michelle L.; Jolivette, Kristine; Kennedy, Christina; Fredrick, Laura D.; Williams, Camille D.

2017-01-01

Two functionally-indicated choice-making interventions were implemented by a classroom teacher to determine the effects on the percentage of task completion, accuracy, and classroom disruption for 9 sixth through eighth grade participants with emotional and behavioral disorders in a residential math classroom using a reversal design. Results…

Distinct roles of visual, parietal, and frontal motor cortices in memory-guided sensorimotor decisions.

PubMed

Goard, Michael J; Pho, Gerald N; Woodson, Jonathan; Sur, Mriganka

2016-08-04

Mapping specific sensory features to future motor actions is a crucial capability of mammalian nervous systems. We investigated the role of visual (V1), posterior parietal (PPC), and frontal motor (fMC) cortices for sensorimotor mapping in mice during performance of a memory-guided visual discrimination task. Large-scale calcium imaging revealed that V1, PPC, and fMC neurons exhibited heterogeneous responses spanning all task epochs (stimulus, delay, response). Population analyses demonstrated unique encoding of stimulus identity and behavioral choice information across regions, with V1 encoding stimulus, fMC encoding choice even early in the trial, and PPC multiplexing the two variables. Optogenetic inhibition during behavior revealed that all regions were necessary during the stimulus epoch, but only fMC was required during the delay and response epochs. Stimulus identity can thus be rapidly transformed into behavioral choice, requiring V1, PPC, and fMC during the transformation period, but only fMC for maintaining the choice in memory prior to execution.

Preference on cash-choice task predicts externalizing outcomes in 17-year-olds.

PubMed

Sparks, Jordan C; Isen, Joshua D; Iacono, William G

2014-03-01

Delay-discounting, the tendency to prefer a smaller-sooner reward to a larger-later reward, has been associated with a range of externalizing behaviors. Laboratory delay-discounting tasks have emerged as a useful measure to index impulsivity and a proclivity towards externalizing pyschopathology. While many studies demonstrate the existence of a latent externalizing factor that is heritable, there have been few genetic studies of delay-discounting. Further, the increased vulnerability for risky behavior in adolescence makes adolescent samples an attractive target for future research, and expeditious, ecologically-valid delay-discounting measures are helpful in this regard. The primary goal of this study was to help validate the utility of a "cash-choice" measure for use in a sample of older adolescents. We used a sample of 17-year-old twins (n = 791) from the Minnesota Twin Family Enrichment study. Individuals who chose the smaller-sooner reward were more likely to have used a range of addictive substances, engaged in sexual intercourse, and earned lower GPAs. Best fitting biometric models from univariate analyses supported the heritability of cash-choice and externalizing, but bivariate modeling results indicated that the correlation between cash-choice and externalizing was determined largely by shared environmental influences, thus failing to support cash-choice as a possible endophenotype for externalizing in this age group. Our findings lend further support to the utility of cash-choice as a measure of individual differences in decision making and suggest that, by late adolescence, this task indexes shared environmental risk for externalizing behavior.

Predicting social and communicative ability in school-age children with autism spectrum disorder: A pilot study of the Social Attribution Task, Multiple Choice.

PubMed

Burger-Caplan, Rebecca; Saulnier, Celine; Jones, Warren; Klin, Ami

2016-11-01

The Social Attribution Task, Multiple Choice is introduced as a measure of implicit social cognitive ability in children, addressing a key challenge in quantification of social cognitive function in autism spectrum disorder, whereby individuals can often be successful in explicit social scenarios, despite marked social adaptive deficits. The 19-question Social Attribution Task, Multiple Choice, which presents ambiguous stimuli meant to elicit social attribution, was administered to children with autism spectrum disorder (N = 23) and to age-matched and verbal IQ-matched typically developing children (N = 57). The Social Attribution Task, Multiple Choice performance differed between autism spectrum disorder and typically developing groups, with typically developing children performing significantly better than children with autism spectrum disorder. The Social Attribution Task, Multiple Choice scores were positively correlated with age (r = 0.474) while being independent from verbal IQ (r = 0.236). The Social Attribution Task, Multiple Choice was strongly correlated with Vineland Adaptive Behavior Scales Communication (r = 0.464) and Socialization (r = 0.482) scores, but not with Daily Living Skills scores (r = 0.116), suggesting that the implicit social cognitive ability underlying performance on the Social Attribution Task, Multiple Choice is associated with real-life social adaptive function. © The Author(s) 2016.

Differences in Behavior and Brain Activity during Hypothetical and Real Choices.

PubMed

Camerer, Colin; Mobbs, Dean

2017-01-01

Real behaviors are binding consequential commitments to a course of action, such as harming another person, buying an Apple watch, or fleeing from danger. Cognitive scientists are generally interested in the psychological and neural processes that cause such real behavior. However, for practical reasons, many scientific studies measure behavior using only hypothetical or imagined stimuli. Generalizing from such studies to real behavior implicitly assumes that the processes underlying the two types of behavior are similar. We review evidence of similarity and differences in hypothetical and real mental processes. In many cases, hypothetical choice tasks give an incomplete picture of brain circuitry that is active during real choice. Copyright © 2016. Published by Elsevier Ltd.

I Plan Therefore I Choose: Free-Choice Bias Due to Prior Action-Probability but Not Action-Value

PubMed Central

Suriya-Arunroj, Lalitta; Gail, Alexander

2015-01-01

According to an emerging view, decision-making, and motor planning are tightly entangled at the level of neural processing. Choice is influenced not only by the values associated with different options, but also biased by other factors. Here we test the hypothesis that preliminary action planning can induce choice biases gradually and independently of objective value when planning overlaps with one of the potential action alternatives. Subjects performed center-out reaches obeying either a clockwise or counterclockwise cue-response rule in two tasks. In the probabilistic task, a pre-cue indicated the probability of each of the two potential rules to become valid. When the subsequent rule-cue unambiguously indicated which of the pre-cued rules was actually valid (instructed trials), subjects responded faster to rules pre-cued with higher probability. When subjects were allowed to choose freely between two equally rewarded rules (choice trials) they chose the originally more likely rule more often and faster, despite the lack of an objective advantage in selecting this target. In the amount task, the pre-cue indicated the amount of potential reward associated with each rule. Subjects responded faster to rules pre-cued with higher reward amount in instructed trials of the amount task, equivalent to the more likely rule in the probabilistic task. Yet, in contrast, subjects showed hardly any choice bias and no increase in response speed in favor of the original high-reward target in the choice trials of the amount task. We conclude that free-choice behavior is robustly biased when predictability encourages the planning of one of the potential responses, while prior reward expectations without action planning do not induce such strong bias. Our results provide behavioral evidence for distinct contributions of expected value and action planning in decision-making and a tight interdependence of motor planning and action selection, supporting the idea that the underlying neural mechanisms overlap. PMID:26635565

Prosocial Choice in Rats Depends on Food-Seeking Behavior Displayed by Recipients.

PubMed

Márquez, Cristina; Rennie, Scott M; Costa, Diana F; Moita, Marta A

2015-06-29

Animals often are prosocial, displaying behaviors that result in a benefit to one another [1-15] even in the absence of self-benefit [16-21] (but see [22-25]). Several factors have been proposed to modulate these behaviors, namely familiarity [6, 13, 18, 20] or display of seeking behavior [16, 21]. Rats have been recently shown to be prosocial under distress [17, 18] (but see [26-29]); however, what drives prosociality in these animals remains unclear. To address this issue, we developed a two-choice task in which prosocial behavior did not yield a benefit or a cost to the focal rat. We used a double T-maze in which only the focal rat controlled access to the food-baited arms of its own and the recipient rat's maze. In this task, the focal rat could choose between one side of the maze, which yielded food only to itself (selfish choice), and the opposite side, which yielded food to itself and the recipient rat (prosocial choice). Rats showed a high proportion of prosocial choices. By manipulating reward delivery to the recipient and its ability to display a preference for the baited arm, we found that the display of food-seeking behavior leading to reward was necessary to drive prosocial choices. In addition, we found that there was more social investigation between rats in selfish trials than in prosocial trials, which may have influenced the focals' choices. This study shows that rats provide access to food to others in the absence of added direct self-benefit, bringing new insights into the factors that drive prosociality. Copyright © 2015 Elsevier Ltd. All rights reserved.

Effects of disulfiram on choice behavior in a rodent gambling task: association with catecholamine levels.

PubMed

Di Ciano, Patricia; Manvich, Daniel F; Pushparaj, Abhiram; Gappasov, Andrew; Hess, Ellen J; Weinshenker, David; Le Foll, Bernard

2018-01-01

Gambling disorder is a growing societal concern, as recognized by its recent classification as an addictive disorder in the DSM-5. Case reports have shown that disulfiram reduces gambling-related behavior in humans. The purpose of the present study was to determine whether disulfiram affects performance on a rat gambling task, a rodent version of the Iowa gambling task in humans, and whether any changes were associated with alterations in dopamine and/or norepinephrine levels. Rats were administered disulfiram prior to testing on the rat gambling task or prior to analysis of dopamine or norepinephrine levels in brain homogenates. Rats in the behavioral task were divided into two subgroups (optimal vs suboptimal) based on their baseline levels of performance in the rat gambling task. Rats in the optimal group chose the advantageous strategy more, and rats in the suboptimal group (a parallel to problem gambling) chose the disadvantageous strategy more. Rats were not divided into optimal or suboptimal groups prior to neurochemical analysis. Disulfiram administered 2 h, but not 30 min, before the task dose-dependently improved choice behavior in the rats with an initial disadvantageous "gambling-like" strategy, while having no effect on the rats employing an advantageous strategy. The behavioral effects of disulfiram were associated with increased striatal dopamine and decreased striatal norepinephrine. These findings suggest that combined actions on dopamine and norepinephrine may be a useful treatment for gambling disorders.

Piéron’s Law and Optimal Behavior in Perceptual Decision-Making

PubMed Central

van Maanen, Leendert; Grasman, Raoul P. P. P.; Forstmann, Birte U.; Wagenmakers, Eric-Jan

2012-01-01

Piéron’s Law is a psychophysical regularity in signal detection tasks that states that mean response times decrease as a power function of stimulus intensity. In this article, we extend Piéron’s Law to perceptual two-choice decision-making tasks, and demonstrate that the law holds as the discriminability between two competing choices is manipulated, even though the stimulus intensity remains constant. This result is consistent with predictions from a Bayesian ideal observer model. The model assumes that in order to respond optimally in a two-choice decision-making task, participants continually update the posterior probability of each response alternative, until the probability of one alternative crosses a criterion value. In addition to predictions for two-choice decision-making tasks, we extend the ideal observer model to predict Piéron’s Law in signal detection tasks. We conclude that Piéron’s Law is a general phenomenon that may be caused by optimality constraints. PMID:22232572

Choice Impulsivity: Definitions, Measurement Issues, and Clinical Implications

PubMed Central

Hamilton, Kristen R.; Mitchell, Marci R.; Wing, Victoria C.; Balodis, Iris M.; Bickel, Warren K.; Fillmore, Mark; Lane, Scott D.; Lejuez, C. W.; Littlefield, Andrew K.; Luijten, Maartje; Mathias, Charles W.; Mitchell, Suzanne H.; Napier, T. Celeste; Reynolds, Brady; Schütz, Christian G.; Setlow, Barry; Sher, Kenneth J.; Swann, Alan C.; Tedford, Stephanie E.; White, Melanie J.; Winstanley, Catharine A.; Yi, Richard; Potenza, Marc N.; Moeller, F. Gerard

2015-01-01

Background Impulsivity critically relates to many psychiatric disorders. Given the multi-faceted construct that impulsivity represents, defining core aspects of impulsivity is vital for the assessment and understanding of clinical conditions. Choice impulsivity (CI), involving the preferential selection of smaller sooner rewards over larger later rewards, represents one important type of impulsivity. Method The International Society for Research on Impulsivity (InSRI) convened to discuss the definition and assessment of CI and provide recommendations regarding measurement across species. Results Commonly used preclinical and clinical CI behavioral tasks are described, and considerations for each task are provided to guide CI task selection. Differences in assessment of CI (self-report, behavioral) and calculating CI indices (e.g., area-under-the-curve, indifference point, steepness of discounting curve) are discussed along with properties of specific behavioral tasks used in preclinical and clinical settings. Conclusions The InSRI group recommends inclusion of measures of CI in human studies examining impulsivity. Animal studies examining impulsivity should also include assessments of CI and these measures should be harmonized in accordance with human studies of the disorders being modeled in the preclinical investigations. The choice of specific CI measures to be included should be based on the goals of the study and existing preclinical and clinical literature using established CI measures. PMID:25867841

The Role of Frontal Cortical and Medial-Temporal Lobe Brain Areas in Learning a Bayesian Prior Belief on Reversals

PubMed Central

Jang, Anthony I.; Costa, Vincent D.; Rudebeck, Peter H.; Chudasama, Yogita; Murray, Elisabeth A.

2015-01-01

Reversal learning has been extensively studied across species as a task that indexes the ability to flexibly make and reverse deterministic stimulus–reward associations. Although various brain lesions have been found to affect performance on this task, the behavioral processes affected by these lesions have not yet been determined. This task includes at least two kinds of learning. First, subjects have to learn and reverse stimulus–reward associations in each block of trials. Second, subjects become more proficient at reversing choice preferences as they experience more reversals. We have developed a Bayesian approach to separately characterize these two learning processes. Reversal of choice behavior within each block is driven by a combination of evidence that a reversal has occurred, and a prior belief in reversals that evolves with experience across blocks. We applied the approach to behavior obtained from 89 macaques, comprising 12 lesion groups and a control group. We found that animals from all of the groups reversed more quickly as they experienced more reversals, and correspondingly they updated their prior beliefs about reversals at the same rate. However, the initial values of the priors that the various groups of animals brought to the task differed significantly, and it was these initial priors that led to the differences in behavior. Thus, by taking a Bayesian approach we find that variability in reversal-learning performance attributable to different neural systems is primarily driven by different prior beliefs about reversals that each group brings to the task. SIGNIFICANCE STATEMENT The ability to use prior knowledge to adapt choice behavior is critical for flexible decision making. Reversal learning is often studied as a form of flexible decision making. However, prior studies have not identified which brain regions are important for the formation and use of prior beliefs to guide choice behavior. Here we develop a Bayesian approach that formally characterizes learning set as a concept, and we show that, in macaque monkeys, the amygdala and medial prefrontal cortex have a role in establishing an initial belief about the stability of the reward environment. PMID:26290251

Modeling Confidence Judgments, Response Times, and Multiple Choices in Decision Making: Recognition Memory and Motion Discrimination

PubMed Central

Ratcliff, Roger; Starns, Jeffrey J.

2014-01-01

Confidence in judgments is a fundamental aspect of decision making, and tasks that collect confidence judgments are an instantiation of multiple-choice decision making. We present a model for confidence judgments in recognition memory tasks that uses a multiple-choice diffusion decision process with separate accumulators of evidence for the different confidence choices. The accumulator that first reaches its decision boundary determines which choice is made. Five algorithms for accumulating evidence were compared, and one of them produced proportions of responses for each of the choices and full response time distributions for each choice that closely matched empirical data. With this algorithm, an increase in the evidence in one accumulator is accompanied by a decrease in the others so that the total amount of evidence in the system is constant. Application of the model to the data from an earlier experiment (Ratcliff, McKoon, & Tindall, 1994) uncovered a relationship between the shapes of z-transformed receiver operating characteristics and the behavior of response time distributions. Both are explained in the model by the behavior of the decision boundaries. For generality, we also applied the decision model to a 3-choice motion discrimination task and found it accounted for data better than a competing class of models. The confidence model presents a coherent account of confidence judgments and response time that cannot be explained with currently popular signal detection theory analyses or dual-process models of recognition. PMID:23915088

Using the Expectancy-Value Theory of Motivation to Predict Behavioral and Emotional Risk among High School Students

ERIC Educational Resources Information Center

Dever, Bridget V.

2016-01-01

Within the expectancy-value framework, much work has been done linking expectancies and task values to academic outcomes such as performance, persistence, and choice. Research on the associations between student motivation (including efficacy and task values) and behavioral and emotional problems, however, is nascent. The present study examined a…

No costly prosociality among related long-tailed macaques (Macaca fascicularis).

PubMed

Sterck, Elisabeth H M; Olesen, Caroline U; Massen, Jorg J M

2015-08-01

Altruism, benefiting another at a cost to the donor, may be achieved through prosocial behavior. Studies of nonhuman animals typically investigate prosocial behavior with paradigms in which the donor can choose to give a recipient a food item, and the choice does not affect the donor's reward (which is either present or absent). In such tasks, long-tailed macaques (Macaca fascicularis) show prosocial behavior, especially toward kin. Here, we tested captive long-tailed macaques with related recipients in an alternative task, in which the donor had to give up a preferred reward to benefit the recipient; that is, they had to choose a lower valued reward for themselves to provide food to their kin. Overall, the macaques did not provide their kin with food. The task forced the donor to balance its prosocial behavior with its selfish choice for a higher value reward, a balance that turned out to favor selfish motives. Consequently, our study shows that a prosocial tendency is not sufficient to elicit costly prosocial behavior in long-tailed macaques. Subsequently, we feel that tasks in which the donor must choose a lower value reward to benefit another individual may allow the titration of the strength of prosocial behavior, and thus provides interesting possibilities for future comparative studies. (c) 2015 APA, all rights reserved).

Reduced mental capacity and behavior of a rider of a bicycle simulator under alcohol stress or under dual task load

NASA Technical Reports Server (NTRS)

Soede, M.

1977-01-01

Experiments were carried out on a bicycle simulator with alcohol administration and a binary choice task in separate sessions, intending to reduce the subject's mental capacity. Before and after such sessions a visual evoked response measurement was done. The subject's performance was analyzed with describing function techniques. The results indicate that the alcohol affects the course-following task as well as the balancing task. The binary choice task is more specifically influencing the course-following task. The dual task shows a more pronounced effect on the recovery of the evoked response. The alcohol is delaying the recovery curve of the evoked response. A tentative explanation can be given which agrees with the performance data.

Caudate Microstimulation Increases Value of Specific Choices.

PubMed

Santacruz, Samantha R; Rich, Erin L; Wallis, Joni D; Carmena, Jose M

2017-11-06

Value-based decision-making involves an assessment of the value of items available and the actions required to obtain them. The basal ganglia are highly implicated in action selection and goal-directed behavior [1-4], and the striatum in particular plays a critical role in arbitrating between competing choices [5-9]. Previous work has demonstrated that neural activity in the caudate nucleus is modulated by task-relevant action values [6, 8]. Nonetheless, how value is represented and maintained in the striatum remains unclear since decision-making in these tasks relied on spatially lateralized responses, confounding the ability to generalize to a more abstract choice task [6, 8, 9]. Here, we investigate striatal value representations by applying caudate electrical stimulation in macaque monkeys (n = 3) to bias decision-making in a task that divorces the value of a stimulus from motor action. Electrical microstimulation is known to induce neural plasticity [10, 11], and caudate microstimulation in primates has been shown to accelerate associative learning [12, 13]. Our results indicate that stimulation paired with a particular stimulus increases selection of that stimulus, and this effect was stimulus dependent and action independent. The modulation of choice behavior using microstimulation was best modeled as resulting from changes in stimulus value. Caudate neural recordings (n = 1) show that changes in value-coding neuron activity are stimulus value dependent. We argue that caudate microstimulation can differentially increase stimulus values independent of action, and unilateral manipulations of value are sufficient to mediate choice behavior. These results support potential future applications of microstimulation to correct maladaptive plasticity underlying dysfunctional decision-making related to neuropsychiatric conditions. Copyright © 2017 Elsevier Ltd. All rights reserved.

Dopamine D1 and D3 Receptors Modulate Heroin-Induced Cognitive Impairment through Opponent Actions in Mice

PubMed Central

Zhu, Yongsheng; Wang, Yunpeng; Wei, Shuguang; Zhang, Hongbo; Yan, Peng; Li, Yunxiao; Qiao, Xiaomeng; Yin, Fangyuan

2017-01-01

Abstract Background: Chronic abuse of heroin leads to long-lasting and complicated cognitive impairment. Dopamine receptors are critically involved in the impulsive drug-driven behavior and the altered attention, processing speed, and mental flexibility that are associated with higher relapse rates. However, the effects of the different dopamine receptors and their possible involvement in heroin-induced cognitive impairment remain unclear. Methods: The 5-choice serial reaction time task was used to investigate the profiles of heroin-induced cognitive impairment in mice. The expression levels of dopamine D1- and D2-like receptors in the prefrontal cortex, nucleus accumbens, and caudate-putamen were determined. The effects of dopamine receptors on heroin-induced impulsivity in the 5-choice serial reaction time task were examined by agonist/antagonist treatment on D1 or D3 receptor mutant mice. Results: Systemic heroin administration influences several variables in the 5-choice serial reaction time task, most notably premature responses, a measure of motor impulsivity. These behavioral impairments are associated with increased D1 receptor and decreased D3 receptor mRNA and protein levels in 3 observed brain areas. The heroin-evoked increase in premature responses is mimicked by a D1 agonist and prevented by a D1 antagonist or genetic ablation of the D1 receptor gene. In contrast, a D3 agonist decreases both basal and heroin-evoked premature responses, while genetic ablation of the D3 receptor gene results in increased basal and heroin-evoked premature responses. Conclusions: Heroin-induced impulsive behavior in the 5-choice serial reaction time task is oppositely modulated by D1 and D3 receptor activation. The D1 receptors in the cortical-mesolimbic region play an indispensable role in modulating such behaviors. PMID:27815417

Distinct roles of visual, parietal, and frontal motor cortices in memory-guided sensorimotor decisions

PubMed Central

Goard, Michael J; Pho, Gerald N; Woodson, Jonathan; Sur, Mriganka

2016-01-01

Mapping specific sensory features to future motor actions is a crucial capability of mammalian nervous systems. We investigated the role of visual (V1), posterior parietal (PPC), and frontal motor (fMC) cortices for sensorimotor mapping in mice during performance of a memory-guided visual discrimination task. Large-scale calcium imaging revealed that V1, PPC, and fMC neurons exhibited heterogeneous responses spanning all task epochs (stimulus, delay, response). Population analyses demonstrated unique encoding of stimulus identity and behavioral choice information across regions, with V1 encoding stimulus, fMC encoding choice even early in the trial, and PPC multiplexing the two variables. Optogenetic inhibition during behavior revealed that all regions were necessary during the stimulus epoch, but only fMC was required during the delay and response epochs. Stimulus identity can thus be rapidly transformed into behavioral choice, requiring V1, PPC, and fMC during the transformation period, but only fMC for maintaining the choice in memory prior to execution. DOI: http://dx.doi.org/10.7554/eLife.13764.001 PMID:27490481

Lateral Orbitofrontal Inactivation Dissociates Devaluation-Sensitive Behavior and Economic Choice.

PubMed

Gardner, Matthew P H; Conroy, Jessica S; Shaham, Michael H; Styer, Clay V; Schoenbaum, Geoffrey

2017-12-06

How do we choose between goods that have different subjective values, like apples and oranges? Neuroeconomics proposes that this is done by reducing complex goods to a single unitary value to allow comparison. This value is computed "on the fly" from the underlying model of the goods space, allowing decisions to meet current needs. This is termed "model-based" behavior to distinguish it from pre-determined, habitual, or "model-free" behavior. The lateral orbitofrontal cortex (OFC) supports model-based behavior in rats and primates, but whether the OFC is necessary for economic choice is less clear. Here we tested this question by optogenetically inactivating the lateral OFC in rats in a classic model-based task and during economic choice. Contrary to predictions, inactivation disrupted model-based behavior without affecting economic choice. Published by Elsevier Inc.

Measuring pilot workload in a moving-base simulator. I Asynchronous secondary choice-reaction task

NASA Technical Reports Server (NTRS)

Kantowitz, B. H.; Hart, S. G.; Bortolussi, M. R.

1983-01-01

The de facto method for measuring airplane pilot workload is based upon subjective ratings. While researchers agree that such subjective data should be bolstered by using objective behavioral measures, results to date have been mixed. No clear objective technique has surfaced as the metric of choice. It is believed that this difficulty is in part due to neglect of theoretical work in psychology that predicts some of the difficulties that are inherent in a futile search for 'the one and only' best secondary task to measure workload. An initial study that used both subjective ratings and an asynchronous choice-reaction secondary task was conducted to determine if such a secondary task could indeed meet the methodological constraints imposed by current theories of attention. Two variants of a flight scenario were combined with two levels of the secondary task. Appropriate single-task control conditions were also included. Results give grounds for cautious optimism but indicate that future research should use synchronous secondary tasks where possible.

On the differentiation of N2 components in an appetitive choice task: evidence for the revised Reinforcement Sensitivity Theory.

PubMed

Leue, Anja; Chavanon, Mira-Lynn; Wacker, Jan; Stemmler, Gerhard

2009-11-01

Task- and personality-related modulations of the N2 were probed within the framework of the revised Reinforcement Sensitivity Theory (RST). Using an appetitive choice task, we investigated 58 students with extreme scores on the behavioral inhibition system and behavioral approach system (BIS/BAS) scales. The baseline-to-peak N2 amplitude was sensitive to the strength of decision conflict and demonstrated RST-related personality differences. In addition to the baseline N2 amplitude, temporal PCA results suggested two N2 components accounting for a laterality effect and capturing different N2 patterns for BIS/BAS groups with increasing conflict level. Evidence for RST-related personality differences was obtained for baseline-to-peak N2 and tPCA components in the present task. The results support the RST prediction that BAS sensitivity modulates conflict processing and confirm the cognitive-motivational conflict concept of RST.

Disparate cocaine-induced locomotion as a predictor of choice behavior in rats trained in a delay-discounting task

PubMed Central

Stanis, Jessica J.; Burns, Randi M.; Sherrill, Luke K.; Gulley, Joshua M.

2008-01-01

Heightened impulsivity and differential sensitivity to a drug's behavioral effects are traits that, individually, have been associated with chronic drug use and dependence. Here, we used an animal model to test whether individual differences in cocaine-induced activity are predictive of impulsive choice behavior. Adult, male Sprague-Dawley rats were given cocaine (10 mg/kg, i.p.) and classified into low or high cocaine responders (LCRs and HCRs, respectively) based on their locomotor response in an open-field arena. Rats were then trained in a delay-discounting task that offers a choice between immediately delivered, but smaller reinforcements, or larger reinforcements that are delivered after a delay. We also examined the effects of amphetamine (AMPH; 0.3-1.0 mg/kg) and the 5-HT1A agonist 8-OH-DPAT (0.3-1.0 mg/kg) on delay discounting. Lastly, all rats were retested in the open-field to determine if phenotypes were stable. We observed baseline differences in choice behavior between the groups, with HCRs behaving more impulsively (i.e., choosing the small reinforcement) compared to LCRs. AMPH decreased choice of the large reinforcement in LCRs, but did not alter choice in HCRs. Impulsive choice was increased in both phenotypes following 8-OH-DPAT, with LCRs exhibiting changes across a wider range of delays. When cocaine-induced open-field behavior was retested, responses in LCRs were similar whereas HCRs showed evidence of tolerance. Our results suggest that differential sensitivity to cocaine-induced locomotion is predictive of impulsivity and the potential neurobiological differences in LCRs and HCRs may provide insight into mechanisms contributing to vulnerability for chronic drug use and/or dependence. PMID:18539407

Reduced risk-taking behavior as a trait feature of anxiety.

PubMed

Giorgetta, Cinzia; Grecucci, Alessandro; Zuanon, Sophia; Perini, Laura; Balestrieri, Matteo; Bonini, Nicolao; Sanfey, Alan G; Brambilla, Paolo

2012-12-01

Affect can have a significant influence on decision-making processes and subsequent choice. One particularly relevant type of negative affect is anxiety, which serves to enhance responses to threatening stimuli or situations. In its exaggerated form, it can lead to psychiatric disorders, with detrimental consequences for quality of life, including the ability to make choices. This study investigated, for the first time, how pathological anxiety affects risk-taking behavior. In this study, 20 anxious participants meeting Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, criteria for either generalized anxiety disorder (n = 10) and for panic attack disorder (n = 10), as well as 20 matched nonanxious controls, performed a gambling task. To investigate the tendency toward either a risk-seeking or a risk-averse behavior, we employed a task that did not allow for learning from outcomes. Anxious participants made significantly fewer risky choices than matched nonanxious participants. Specifically, they become risk-avoidant after gains. Moreover, anxious participants not only were less happy after gains but were also less sad after losses, and they also evinced less desire to change their choices after losses than did nonanxious participants. Importantly, whereas the desire to switch choice was followed by actual choice switch for all participants, happiness directly predicted subsequent risky choices, particularly in the nonanxious participants. Further analyses revealed that the anxious participants' risk-avoidance behavior was independent of different types of anxiety disorder (panic attack disorder and generalized anxiety disorder) as well as of the effects of psychotropic drugs treatment. This study demonstrates a specific role for anxiety in individual decision making. In particular, hypersensitivity to potential threats and pessimistic evaluation of future events reduced risk-taking behavior. PsycINFO Database Record (c) 2012 APA, all rights reserved.

GluN2B in corticostriatal circuits governs choice learning and choice shifting

PubMed Central

Brigman, Jonathan L.; Daut, Rachel; Wright, Tara; Gunduz-Cinar, Ozge; Graybeal, Carolyn; Davis, Margaret I.; Jiang, Zhihong; Saksida, Lisa; Jinde, Seiichiro; Pease, Matthew; Bussey, Timothy J.; Lovinger, David M.; Nakazawa, Kazu; Holmes, Andrew

2013-01-01

A choice that reliably produces a preferred outcome can be automated to liberate cognitive resources for other tasks. Should an outcome become less desirable, behavior must adapt in parallel or become perseverative. Corticostriatal systems are known to mediate choice learning and flexibility, but the molecular mechanisms subserving the instantiation of these processes are not well understood. We integrated mouse behavioral, immunocytochemical, in vivo electrophysiological, genetic, and pharmacological approaches to study choice. We found that the dorsal striatum (DS) was increasingly activated with choice learning, whereas reversal of learned choice engaged prefrontal regions. In vivo, DS neurons showed activity associated with reward anticipation and receipt that emerged with learning and relearning. Corticostriatal or striatal GluN2B gene deletion, or DS-restricted GluN2B antagonism, impaired choice learning, whereas cortical GluN2B deletion or OFC GluN2B antagonism impaired shifting. Our convergent data demonstrate how corticostriatal GluN2B circuits govern the ability to learn and shift choice behavior. PMID:23831965

Strong genetic influences on measures of behavioral-regulation among inbred rat strains

PubMed Central

Richards, Jerry B.; Lloyd, David R.; Kuehlewind, Brandon; Militello, Leah; Paredez, Marita; Solberg -Woods, Leah; Palmer, Abraham A.

2013-01-01

A fundamental challenge for any complex nervous system is to regulate behavior in response to environmental challenges. Three measures of behavioral regulation were tested in a panel of 8 inbred rat strains. These measures were; 1) sensation seeking as assessed by locomotor response to novelty and the sensory reinforcing effects of light onset, 2) attention and impulsivity, as measured by a choice reaction time task, and 3) impulsivity as measured by a delay discounting task. Deficient behavioral regulation has been linked to a number of psychopathologies, including ADHD, Schizophrenia, Autism, drug abuse and eating disorders. Eight inbred rat strains (August Copenhagen Irish, Brown Norway, Buffalo, Fischer 344, Wistar Kyoto, Spontaneous Hypertensive Rat, Lewis, Dahl Salt Sensitive) were tested. With n=9 for each strain, we observed robust strain differences for all tasks; heritability was estimated between 0.43 and 0.66. Performance of the 8 inbred rat strains on the choice reaction time task was compared to the performance of out bred Sprague Dawley (n=28) and Heterogeneous strain rats (n=48). The results indicate a strong genetic influence on complex tasks related to behavioral regulation and indicate that some of measures tap common genetically-driven processes. Furthermore, our results establish the potential for future studies aimed at identifying specific alleles that influence variability for these traits. Identification of such alleles could contribute to our understanding of the molecular genetic basis of behavioral regulation, which is of fundamental importance and likely contributes to multiple psychiatric disorders. PMID:23710681

Evidence for surprise minimization over value maximization in choice behavior

PubMed Central

Schwartenbeck, Philipp; FitzGerald, Thomas H. B.; Mathys, Christoph; Dolan, Ray; Kronbichler, Martin; Friston, Karl

2015-01-01

Classical economic models are predicated on the idea that the ultimate aim of choice is to maximize utility or reward. In contrast, an alternative perspective highlights the fact that adaptive behavior requires agents’ to model their environment and minimize surprise about the states they frequent. We propose that choice behavior can be more accurately accounted for by surprise minimization compared to reward or utility maximization alone. Minimizing surprise makes a prediction at variance with expected utility models; namely, that in addition to attaining valuable states, agents attempt to maximize the entropy over outcomes and thus ‘keep their options open’. We tested this prediction using a simple binary choice paradigm and show that human decision-making is better explained by surprise minimization compared to utility maximization. Furthermore, we replicated this entropy-seeking behavior in a control task with no explicit utilities. These findings highlight a limitation of purely economic motivations in explaining choice behavior and instead emphasize the importance of belief-based motivations. PMID:26564686

‘Put Your Money Where Your Mouth Is!’: Effects of Streaks on Confidence and Betting in a Binary Choice Task

PubMed Central

Studer, Bettina; Limbrick-Oldfield, Eve H; Clark, Luke

2015-01-01

Human choice under uncertainty is influenced by erroneous beliefs about randomness. In simple binary choice tasks, such as red/black predictions in roulette, long outcome runs (e.g. red, red, red) typically increase the tendency to predict the other outcome (i.e. black), an effect labeled the “gambler's fallacy.” In these settings, participants may also attend to streaks in their predictive performance. Winning and losing streaks are thought to affect decision confidence, although prior work indicates conflicting directions. Over three laboratory experiments involving red/black predictions in a sequential roulette task, we sought to identify the effects of outcome runs and winning/losing streaks upon color predictions, decision confidence and betting behavior. Experiments 1 (n = 40) and 3 (n = 40) obtained trial-by-trial confidence ratings, with a win/no win payoff and a no loss/loss payoff, respectively. Experiment 2 (n = 39) obtained a trial-by-trial bet amount on an equivalent scale. In each experiment, the gambler's fallacy was observed on choice behavior after color runs and, in experiment 2, on betting behavior after color runs. Feedback streaks exerted no reliable influence on confidence ratings, in either payoff condition. Betting behavior, on the other hand, increased as a function of losing streaks. The increase in betting on losing streaks is interpreted as a manifestation of loss chasing; these data help clarify the psychological mechanisms underlying loss chasing and caution against the use of betting measures (“post-decision wagering”) as a straightforward index of decision confidence. © 2014 The Authors. Journal of Behavioral Decision Making published by John Wiley & Sons Ltd. PMID:26236092

'Put Your Money Where Your Mouth Is!': Effects of Streaks on Confidence and Betting in a Binary Choice Task.

PubMed

Studer, Bettina; Limbrick-Oldfield, Eve H; Clark, Luke

2015-07-01

Human choice under uncertainty is influenced by erroneous beliefs about randomness. In simple binary choice tasks, such as red/black predictions in roulette, long outcome runs (e.g. red, red, red) typically increase the tendency to predict the other outcome (i.e. black), an effect labeled the "gambler's fallacy." In these settings, participants may also attend to streaks in their predictive performance. Winning and losing streaks are thought to affect decision confidence, although prior work indicates conflicting directions. Over three laboratory experiments involving red/black predictions in a sequential roulette task, we sought to identify the effects of outcome runs and winning/losing streaks upon color predictions, decision confidence and betting behavior. Experiments 1 ( n  = 40) and 3 ( n  = 40) obtained trial-by-trial confidence ratings, with a win/no win payoff and a no loss/loss payoff, respectively. Experiment 2 ( n  = 39) obtained a trial-by-trial bet amount on an equivalent scale. In each experiment, the gambler's fallacy was observed on choice behavior after color runs and, in experiment 2, on betting behavior after color runs. Feedback streaks exerted no reliable influence on confidence ratings, in either payoff condition. Betting behavior, on the other hand, increased as a function of losing streaks. The increase in betting on losing streaks is interpreted as a manifestation of loss chasing; these data help clarify the psychological mechanisms underlying loss chasing and caution against the use of betting measures ("post-decision wagering") as a straightforward index of decision confidence. © 2014 The Authors. Journal of Behavioral Decision Making published by John Wiley & Sons Ltd.

An adaptive, individualized fMRI delay discounting procedure to increase flexibility and optimize scanner time.

PubMed

Koffarnus, Mikhail N; Deshpande, Harshawardhan U; Lisinski, Jonathan M; Eklund, Anders; Bickel, Warren K; LaConte, Stephen M

2017-11-01

Research on the rate at which people discount the value of future rewards has become increasingly prevalent as discount rate has been shown to be associated with many unhealthy patterns of behavior such as drug abuse, gambling, and overeating. fMRI research points to a fronto-parietal-limbic pathway that is active during decisions between smaller amounts of money now and larger amounts available after a delay. Researchers in this area have used different variants of delay discounting tasks and reported various contrasts between choice trials of different types from these tasks. For instance, researchers have compared 1) choices of delayed monetary amounts to choices of the immediate monetary amounts, 2) 'hard' choices made near one's point of indifference to 'easy' choices that require little thought, and 3) trials where an immediate choice is available versus trials where one is unavailable, regardless of actual eventual choice. These differences in procedure and analysis make comparison of results across studies difficult. In the present experiment, we designed a delay discounting task with the intended capability of being able to construct contrasts of all three comparisons listed above while optimizing scanning time to reduce costs and avoid participant fatigue. This was accomplished with an algorithm that customized the choice trials presented to each participant with the goal of equalizing choice trials of each type. We compared this task, which we refer to here as the individualized discounting task (IDT), to two other delay discounting tasks previously reported in the literature (McClure et al., 2004; Amlung et al., 2014) in 18 participants. Results show that the IDT can examine each of the three contrasts mentioned above, while yielding a similar degree of activation as the reference tasks. This suggests that this new task could be used in delay discounting fMRI studies to allow researchers to more easily compare their results to a majority of previous research while minimizing scanning duration. Copyright © 2017 Elsevier Inc. All rights reserved.

Differences between racing and non-racing drivers: A simulator study using eye-tracking

PubMed Central

de Groot, Stefan; Happee, Riender; de Winter, Joost C. F.

2017-01-01

Motorsport has developed into a professional international competition. However, limited research is available on the perceptual and cognitive skills of racing drivers. By means of a racing simulator, we compared the driving performance of seven racing drivers with ten non-racing drivers. Participants were tasked to drive the fastest possible lap time. Additionally, both groups completed a choice reaction time task and a tracking task. Results from the simulator showed faster lap times, higher steering activity, and a more optimal racing line for the racing drivers than for the non-racing drivers. The non-racing drivers’ gaze behavior corresponded to the tangent point model, whereas racing drivers showed a more variable gaze behavior combined with larger head rotations while cornering. Results from the choice reaction time task and tracking task showed no statistically significant difference between the two groups. Our results are consistent with the current consensus in sports sciences in that task-specific differences exist between experts and novices while there are no major differences in general cognitive and motor abilities. PMID:29121090

Mindset switching increases the use of 'want-based' over 'should-based' behaviors

PubMed Central

Zhang, Nan-Nan; Xu, Dai-Xuan

2018-01-01

This study examines the consequences of mindset switching on behavioral choices in want/should conflicts. Building on the insights of the ego depletion literature, we propose that mindset switching depletes individuals’ self-control resources and therefore prompts the choice of want behavior, which provides immediate pleasure, over should behavior, which provides long-term utility. Four laboratory experiments with university students that stimulated individuals to switch mindsets were conducted to test our hypotheses. Experiment 1 demonstrated that switching between individualist and collectivist mindsets increased the subjects’ tendency to prefer popular magazines over scientific journals. Experiment 2 replicated the results by testing the relationship between an abstract/concrete mindset-switching task and want/should online behavioral choices. The mediating effect of ego depletion was also supported. Experiment 3 retested the main effect of language-switching on reading choices, and the mediating effect of ego-depletion. Experiment 3 also tested the moderating effect of the Need for Cognition, and eliminated the alternative explanation of cognitive fatigue. In Experiment 4, actual food choices were used as the direct measure of want/should behaviors to test the robustness of our findings. The results consistently supported our hypotheses that mindset switching has significant effects on behavioral choices in terms of overindulgence, such as increasing want behavior and thus foregoing should behavior. PMID:29709003

Impaired flexibility in decision making in rats after administration of the pharmacological stressor yohimbine.

PubMed

Schwager, Andrea L; Haack, Andrew K; Taha, Sharif A

2014-10-01

Stress-induced disruption of decision making has been hypothesized to contribute to drug-seeking behaviors and addiction. Noradrenergic signaling plays a central role in mediating stress responses. However, the effects of acute stress on decision making, and the role of noradrenergic signaling in regulating these effects, have not been well characterized. To characterize changes in decision making caused by acute pharmacological stress, the effects of yohimbine (an α2-adrenergic antagonist) were examined in a delay discounting task. Noradrenergic contributions to decision making were further characterized by examining the effects of propranolol (a β antagonist), prazosin (an α1 antagonist), and guanfacine (an α2 agonist). Sprague-Dawley rats were administered drugs prior to performance on a delay discounting task, in which the delay preceding the large reward increased within each session (ascending delays). To dissociate drug-induced changes in delay sensitivity from behavioral inflexibility, drug effects were subsequently tested in a modified version of the discounting task, in which the delay preceding the large reward decreased within each session (descending delays). Yohimbine increased choice of the large reward when tested with ascending delays but decreased choice of the same large reward when tested with descending delays, suggesting that drug effects could be attributed to perseverative choice of the lever preferred at the beginning of the session. Propranolol increased choice of the large reward when tested with ascending delays. Prazosin and guanfacine had no effect on reward choice. The stress-like effects of yohimbine administration may impair decision making by causing inflexible, perseverative behavior.

Helping and hurting others: Person and situation effects on aggressive and prosocial behavior as assessed by the Tangram task.

PubMed

Saleem, Muniba; Barlett, Christopher P; Anderson, Craig A; Hawkins, Ian

2017-04-01

The Tangram Help/Hurt Task is a laboratory-based measure designed to simultaneously assess helpful and hurtful behavior. Across five studies we provide evidence that further establishes the convergent and discriminant validity of the Tangram Help/Hurt Task. Cross-sectional and meta-analytic evidence finds consistently significant associations between helpful and hurtful scores on the Tangram Task and prosocial and aggressive personality traits. Experimental evidence reveals that situational primes known to induce aggressive and prosocial behavior significantly influence helpful and hurtful scores on the Tangram Help/Hurt Task. Additionally, motivation items in all studies indicate that tangram choices are indeed associated with intent of helping and hurting. We discuss the advantages and limitations of the Tangram Help/Hurt Task relative to established measures of helpful and hurtful behavior. Aggr. Behav. 43:133-146, 2017. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

Red Color and Risk-Taking Behavior in Online Environments.

PubMed

Gnambs, Timo; Appel, Markus; Oeberst, Aileen

2015-01-01

In many situations red is associated with hazard and danger. As a consequence, it was expected that task-irrelevant color cues in online environments would affect risk-taking behaviors. This assumption was tested in two web-based experiments. The first study (N = 383) demonstrated that in risky choice dilemmas respondents preferred the less risky option when the displayed university logo was in red (versus gray); but only when both choice alternatives were at least moderately risky. The second study (N = 144) replicated these results with a behavioral outcome: Respondents showed more cautious behavior in a web-based game when the focal stimuli were colored red (versus blue). Together, these findings demonstrate that variations in the color design of a computerized environment affect risk taking: Red color leads to more conservative choices and behaviors.

Effort-Related Motivational Effects of the VMAT-2 Inhibitor Tetrabenazine: Implications for Animal Models of the Motivational Symptoms of Depression

PubMed Central

Nunes, Eric J.; Randall, Patrick A.; Hart, Evan E.; Freeland, Charlotte; Yohn, Samantha E.; Baqi, Younis; Müller, Christa E.; López-Cruz, Laura; Correa, Mercè

2013-01-01

Motivated behaviors are often characterized by a high degree of behavioral activation, and work output and organisms frequently make effort-related decisions based upon cost/benefit analyses. Moreover, people with major depression and other disorders often show effort-related motivational symptoms such as anergia, psychomotor retardation, and fatigue. It has been suggested that tasks measuring effort-related choice behavior could be used as animal models of the motivational symptoms of depression, and the present studies characterized the effort-related effects of the vesicular monoamine transport (VMAT) inhibitor tetrabenazine. Tetrabenazine produces depressive symptoms in humans and, because of its selective inhibition of VMAT-2, it preferentially depletes dopamine (DA). Rats were assessed using a concurrent fixed-ratio 5/chow feeding choice task that is known to be sensitive to dopaminergic manipulations. Tetrabenazine shifted response choice in rats, producing a dose-related decrease in lever pressing and a concomitant increase in chow intake. However, it did not alter food intake or preference in parallel free-feeding choice studies. The effects of tetrabenazine on effort-related choice were reversed by the adenosine A2A antagonist MSX-3 and the antidepressant bupropion. A behaviorally active dose of tetrabenazine decreased extracellular DA in nucleus accumbens and increased expression of DARPP-32 in accumbens medium spiny neurons in a pattern indicative of reduced transmission at both D1 and D2 DA receptors. These experiments demonstrate that tetrabenazine, which is used in animal models to produce depression-like effects, can alter effort-related choice behavior. These studies have implications for the development of animal models of the motivational symptoms of depression and related disorders. PMID:24305809

Probability matching in risky choice: the interplay of feedback and strategy availability.

PubMed

Newell, Ben R; Koehler, Derek J; James, Greta; Rakow, Tim; van Ravenzwaaij, Don

2013-04-01

Probability matching in sequential decision making is a striking violation of rational choice that has been observed in hundreds of experiments. Recent studies have demonstrated that matching persists even in described tasks in which all the information required for identifying a superior alternative strategy-maximizing-is present before the first choice is made. These studies have also indicated that maximizing increases when (1) the asymmetry in the availability of matching and maximizing strategies is reduced and (2) normatively irrelevant outcome feedback is provided. In the two experiments reported here, we examined the joint influences of these factors, revealing that strategy availability and outcome feedback operate on different time courses. Both behavioral and modeling results showed that while availability of the maximizing strategy increases the choice of maximizing early during the task, feedback appears to act more slowly to erode misconceptions about the task and to reinforce optimal responding. The results illuminate the interplay between "top-down" identification of choice strategies and "bottom-up" discovery of those strategies via feedback.

Augmented Go/No-Go Task: Mouse Cursor Motion Measures Improve ADHD Symptom Assessment in Healthy College Students

PubMed Central

Leontyev, Anton; Sun, Stanley; Wolfe, Mary; Yamauchi, Takashi

2018-01-01

Attention deficit/hyperactivity disorder (ADHD) is frequently characterized as a disorder of executive function (EF). However, behavioral tests of EF, such as go/No-go tasks, often fail to grasp the deficiency in EF revealed by questionnaire-based measures. This inability is usually attributed to questionnaires and behavioral tasks assessing different constructs of EFs. We propose an additional explanation for this discrepancy. We hypothesize that this problem stems from the lack of dynamic assessment of decision-making (e.g., continuous monitoring of motor behavior such as velocity and acceleration in choice reaching) in classical versions of behavioral tasks. We test this hypothesis by introducing dynamic assessment in the form of mouse motion in a go/No-go task. Our results indicate that, among healthy college students, self-report measures of ADHD symptoms become strongly associated with performance in behavioral tasks when continuous assessment (e.g., acceleration in the mouse-cursor motion) is introduced. PMID:29695985

Augmented Go/No-Go Task: Mouse Cursor Motion Measures Improve ADHD Symptom Assessment in Healthy College Students.

PubMed

Leontyev, Anton; Sun, Stanley; Wolfe, Mary; Yamauchi, Takashi

2018-01-01

Attention deficit/hyperactivity disorder (ADHD) is frequently characterized as a disorder of executive function (EF). However, behavioral tests of EF, such as go/No-go tasks, often fail to grasp the deficiency in EF revealed by questionnaire-based measures. This inability is usually attributed to questionnaires and behavioral tasks assessing different constructs of EFs. We propose an additional explanation for this discrepancy. We hypothesize that this problem stems from the lack of dynamic assessment of decision-making (e.g., continuous monitoring of motor behavior such as velocity and acceleration in choice reaching) in classical versions of behavioral tasks. We test this hypothesis by introducing dynamic assessment in the form of mouse motion in a go/No-go task. Our results indicate that, among healthy college students, self-report measures of ADHD symptoms become strongly associated with performance in behavioral tasks when continuous assessment (e.g., acceleration in the mouse-cursor motion) is introduced.

Electrical Microstimulation of the Pulvinar Biases Saccade Choices and Reaction Times in a Time-Dependent Manner

PubMed Central

2017-01-01

The pulvinar complex is interconnected extensively with brain regions involved in spatial processing and eye movement control. Recent inactivation studies have shown that the dorsal pulvinar (dPul) plays a role in saccade target selection; however, it remains unknown whether it exerts effects on visual processing or at planning/execution stages. We used electrical microstimulation of the dPul while monkeys performed saccade tasks toward instructed and freely chosen targets. Timing of stimulation was varied, starting before, at, or after onset of target(s). Stimulation affected saccade properties and target selection in a time-dependent manner. Stimulation starting before but overlapping with target onset shortened saccadic reaction times (RTs) for ipsiversive (to the stimulation site) target locations, whereas stimulation starting at and after target onset caused systematic delays for both ipsiversive and contraversive locations. Similarly, stimulation starting before the onset of bilateral targets increased ipsiversive target choices, whereas stimulation after target onset increased contraversive choices. Properties of dPul neurons and stimulation effects were consistent with an overall contraversive drive, with varying outcomes contingent upon behavioral demands. RT and choice effects were largely congruent in the visually-guided task, but stimulation during memory-guided saccades, while influencing RTs and errors, did not affect choice behavior. Together, these results show that the dPul plays a primary role in action planning as opposed to visual processing, that it exerts its strongest influence on spatial choices when decision and action are temporally close, and that this choice effect can be dissociated from motor effects on saccade initiation and execution. SIGNIFICANCE STATEMENT Despite a recent surge of interest, the core function of the pulvinar, the largest thalamic complex in primates, remains elusive. This understanding is crucial given the central role of the pulvinar in current theories of integrative brain functions supporting cognition and goal-directed behaviors, but electrophysiological and causal interference studies of dorsal pulvinar (dPul) are rare. Building on our previous studies that pharmacologically suppressed dPul activity for several hours, here we used transient electrical microstimulation at different periods while monkeys performed instructed and choice eye movement tasks, to determine time-specific contributions of pulvinar to saccade generation and decision making. We show that stimulation effects depend on timing and behavioral state and that effects on choices can be dissociated from motor effects. PMID:28119401

Individual Differences in Risk Preference Predict Neural Responses during Financial Decision-Making

PubMed Central

Engelmann, Jan B.; Tamir, Diana

2009-01-01

We investigated the neural correlates of subjective valuations during a task involving risky choices about lotteries. Because expected value was held constant across all lotteries, decisions were influenced by subjective preferences, which manifest behaviorally as risk-seeking or risk-averse attitudes. To isolate structures encoding risk preference during choice, we probed for areas showing increased activation as a function of selected risk-level. Such response patterns were obtained in anterior (ACC) and posterior cingulate cortex (PCC), superior frontal gyrus, caudate nucleus, and substantia nigra. Behavioral results revealed the presence of risk-averse and risk-neutral individuals. In parallel, brain signals revealed modulation of activity by risk-attitude during choice. Correlations between risk-seeking attitudes and neural activity during risky choice were obtained in superior and inferior frontal gyri, medial and lateral orbitofrontal cortex, and parahippocampal gyrus, while correlations with risk-averse attitudes were found in the caudate. The dynamics of neural responses relevant to each stage of the task (decision, anticipation, outcome) were investigated via timeseries and conjunction analyses. Though the networks engaged in each of the task stages were mostly distinct, regions of ACC, PCC and caudate were consistently activated during each decision-making phase. These results demonstrate (1) that subjective assessments of risk, as well as individual attitudes toward risk, play a significant role in modulating activity within brain regions recruited during decision-making, and (2) that ACC, PCC and caudate are relevant during each phase of a decision-making task requiring subjective valuations, strengthening the role of these regions in self-referential subjective valuations during choice. PMID:19576868

Psychophysiological arousal and inter‐ and intraindividual differences in risk‐sensitive decision making

PubMed Central

Scheibehenne, Benjamin; Clark, Luke

2016-01-01

Abstract The current study assessed peripheral responses during decision making under explicit risk, and tested whether intraindividual variability in choice behavior can be explained by fluctuations in peripheral arousal. Electrodermal activity (EDA) and heart rate (HR) were monitored in healthy volunteers (N = 68) during the Roulette Betting Task. In this task, participants were presented with risky gambles to bet on, with the chances of winning varying across trials. Hierarchical Bayesian analyses demonstrated that EDA and HR acceleration responses during the decision phase were sensitive to the chances of winning. Interindividual differences in this peripheral reactivity during risky decision making were related to trait sensitivity to punishment and trait sensitivity to reward. Moreover, trial‐by‐trial variation in EDA and HR acceleration responses predicted a small portion of intraindividual variability in betting choices. Our results show that psychophysiological responses are sensitive to explicit risk and can help explain intraindividual heterogeneity in choice behavior. PMID:26927730

The Effects of a Concurrent Task on Human Optimization and Self Control

ERIC Educational Resources Information Center

Reed, Phil; Thompson, Caitlin; Osborne, Lisa A.; McHugh, Louise

2011-01-01

Memory deficits have been shown to hamper decision making in a number of populations. In two experiments, participants were required to select one of three alternatives that varied in reinforcer amount and delay, and the effect of a concurrent task on a behavioral choice task that involved making either an impulsive, self-controlled, or optimal…

Impaired strategic decision making in schizophrenia.

PubMed

Kim, Hyojin; Lee, Daeyeol; Shin, Young-Min; Chey, Jeanyung

2007-11-14

Adaptive decision making in dynamic social settings requires frequent re-evaluation of choice outcomes and revision of strategies. This requires an array of multiple cognitive abilities, such as working memory and response inhibition. Thus, the disruption of such abilities in schizophrenia can have significant implications for social dysfunctions in affected patients. In the present study, 20 schizophrenia patients and 20 control subjects completed two computerized binary decision-making tasks. In the first task, the participants played a competitive zero-sum game against a computer in which the predictable choice behavior was penalized and the optimal strategy was to choose the two targets stochastically. In the second task, the expected payoffs of the two targets were fixed and unaffected by the subject's choices, so the optimal strategy was to choose the target with the higher expected payoff exclusively. The schizophrenia patients earned significantly less money during the first task, even though their overall choice probabilities were not significantly different from the control subjects. This was mostly because patients were impaired in integrating the outcomes of their previous choices appropriately in order to maintain the optimal strategy. During the second task, the choices of patients and control subjects displayed more similar patterns. This study elucidated the specific components in strategic decision making that are impaired in schizophrenia. The deficit, which can be characterized as strategic stiffness, may have implications for the poor social adjustment in schizophrenia patients.

Differential Involvement of the Agranular vs Granular Insular Cortex in the Acquisition and Performance of Choice Behavior in a Rodent Gambling Task

PubMed Central

Pushparaj, Abhiram; Kim, Aaron S; Musiol, Martin; Zangen, Abraham; Daskalakis, Zafiris J; Zack, Martin; Winstanley, Catharine A; Le Foll, Bernard

2015-01-01

Substance-related and addictive disorders, in particular gambling disorder, are known to be associated with risky decision-making behavior. Several neuroimaging studies have identified the involvement of the insular cortex in decision-making under risk. However, the extent of this involvement remains unclear and the specific contributions of two distinct insular subregions, the rostral agranular (RAIC) and the caudal granular (CGIC), have yet to be examined. Animals were trained to perform a rat gambling task (rGT), in which subjects chose between four options that differed in the magnitude and probability of rewards and penalties. In order to address the roles of the RAIC and CGIC in established choice behavior, pharmacological inactivations of these two subregions via local infusions of GABA receptor agonists were performed following 30 rGT training sessions. The contribution made by the RAIC or CGIC to the acquisition of choice behavior was also determined by lesioning these areas before behavioral training. Inactivation of the RAIC, but not of the CGIC, shifted rats' preference toward options with greater reward frequency and lower punishment. Before rGT acquisition, lesions of the RAIC, but not the CGIC, likewise resulted in a higher preference for options with greater reward frequency and lower punishment, and this persisted throughout the 30 training sessions. Our results provide confirmation of the involvement of the RAIC in rGT choice behavior and suggest that the RAIC may mediate detrimental risky decision-making behavior, such as that associated with addiction and gambling disorder. PMID:25953358

Differential Involvement of the Agranular vs Granular Insular Cortex in the Acquisition and Performance of Choice Behavior in a Rodent Gambling Task.

PubMed

Pushparaj, Abhiram; Kim, Aaron S; Musiol, Martin; Zangen, Abraham; Daskalakis, Zafiris J; Zack, Martin; Winstanley, Catharine A; Le Foll, Bernard

2015-11-01

Substance-related and addictive disorders, in particular gambling disorder, are known to be associated with risky decision-making behavior. Several neuroimaging studies have identified the involvement of the insular cortex in decision-making under risk. However, the extent of this involvement remains unclear and the specific contributions of two distinct insular subregions, the rostral agranular (RAIC) and the caudal granular (CGIC), have yet to be examined. Animals were trained to perform a rat gambling task (rGT), in which subjects chose between four options that differed in the magnitude and probability of rewards and penalties. In order to address the roles of the RAIC and CGIC in established choice behavior, pharmacological inactivations of these two subregions via local infusions of GABA receptor agonists were performed following 30 rGT training sessions. The contribution made by the RAIC or CGIC to the acquisition of choice behavior was also determined by lesioning these areas before behavioral training. Inactivation of the RAIC, but not of the CGIC, shifted rats' preference toward options with greater reward frequency and lower punishment. Before rGT acquisition, lesions of the RAIC, but not the CGIC, likewise resulted in a higher preference for options with greater reward frequency and lower punishment, and this persisted throughout the 30 training sessions. Our results provide confirmation of the involvement of the RAIC in rGT choice behavior and suggest that the RAIC may mediate detrimental risky decision-making behavior, such as that associated with addiction and gambling disorder.

Self-Handicapping by Task Choice: An Attribute Ambiguity Analysis.

ERIC Educational Resources Information Center

Handelsman, Mitchell M.; And Others

Self-handicapping strategies are behaviors or choices of performance settings which allow people to maintain self-esteem by avoiding negative self-relevant attributions. People will behave in such a way that accurate, nonambiguous attributions about their performance cannot be made. Research on self-handicapping has focused on clinically relevant…

Cognitive control predicts use of model-based reinforcement learning.

PubMed

Otto, A Ross; Skatova, Anya; Madlon-Kay, Seth; Daw, Nathaniel D

2015-02-01

Accounts of decision-making and its neural substrates have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental work suggest that this classic distinction between behaviorally and neurally dissociable systems for habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning (RL), called model-free and model-based RL, but the cognitive or computational processes by which one system may dominate over the other in the control of behavior is a matter of ongoing investigation. To elucidate this question, we leverage the theoretical framework of cognitive control, demonstrating that individual differences in utilization of goal-related contextual information--in the service of overcoming habitual, stimulus-driven responses--in established cognitive control paradigms predict model-based behavior in a separate, sequential choice task. The behavioral correspondence between cognitive control and model-based RL compellingly suggests that a common set of processes may underpin the two behaviors. In particular, computational mechanisms originally proposed to underlie controlled behavior may be applicable to understanding the interactions between model-based and model-free choice behavior.

Learning the opportunity cost of time in a patch-foraging task

PubMed Central

Constantino, Sara; Daw, Nathaniel D.

2015-01-01

Although most decision research concerns choice between simultaneously presented options, in many situations options are encountered serially and the decision is whether to exploit an option or search for a better one. Such problems have a rich history in animal foraging but we know little about the psychological processes involved. In particular, it is unknown whether learning in these problems is supported by the well studied neurocomputational mechanisms involved in more conventional tasks. We investigated how humans learn in a foraging task, which requires deciding whether to harvest a depleting resource or switch to a replenished one. The optimal choice (given by the Marginal Value Theorem; MVT) requires comparing the immediate return from harvesting to the opportunity cost of time, which is given by the long-run average reward. In two experiments, we varied opportunity cost across blocks. Subjects adjusted their behavior to blockwise changes in environmental characteristics. We examined how subjects learned their choice strategies by comparing choice adjustments to a learning rule suggested by the MVT (where the opportunity cost threshold is estimated as an average over previous rewards) and to the predominant incremental learning theory in neuroscience, temporal-difference learning (TD). Trial-by-trial decisions were better explained by the MVT threshold learning rule. These findings expand on the foraging literature, which has focused on steady-state behavior, by elucidating a computational mechanism for learning in switching tasks that is distinct from those used in traditional tasks, and suggest connections to research on average reward rates in other domains of neuroscience. PMID:25917000

Dopamine D1 and D3 Receptors Modulate Heroin-Induced Cognitive Impairment through Opponent Actions in Mice.

PubMed

Zhu, Yongsheng; Wang, Yunpeng; Lai, Jianghua; Wei, Shuguang; Zhang, Hongbo; Yan, Peng; Li, Yunxiao; Qiao, Xiaomeng; Yin, Fangyuan

2017-03-01

Chronic abuse of heroin leads to long-lasting and complicated cognitive impairment. Dopamine receptors are critically involved in the impulsive drug-driven behavior and the altered attention, processing speed, and mental flexibility that are associated with higher relapse rates. However, the effects of the different dopamine receptors and their possible involvement in heroin-induced cognitive impairment remain unclear. The 5-choice serial reaction time task was used to investigate the profiles of heroin-induced cognitive impairment in mice. The expression levels of dopamine D1- and D2-like receptors in the prefrontal cortex, nucleus accumbens, and caudate-putamen were determined. The effects of dopamine receptors on heroin-induced impulsivity in the 5-choice serial reaction time task were examined by agonist/antagonist treatment on D1 or D3 receptor mutant mice. Systemic heroin administration influences several variables in the 5-choice serial reaction time task, most notably premature responses, a measure of motor impulsivity. These behavioral impairments are associated with increased D1 receptor and decreased D3 receptor mRNA and protein levels in 3 observed brain areas. The heroin-evoked increase in premature responses is mimicked by a D1 agonist and prevented by a D1 antagonist or genetic ablation of the D1 receptor gene. In contrast, a D3 agonist decreases both basal and heroin-evoked premature responses, while genetic ablation of the D3 receptor gene results in increased basal and heroin-evoked premature responses. Heroin-induced impulsive behavior in the 5-choice serial reaction time task is oppositely modulated by D1 and D3 receptor activation. The D1 receptors in the cortical-mesolimbic region play an indispensable role in modulating such behaviors. © The Author 2016. Published by Oxford University Press on behalf of CINP.

Introducing uninteresting tasks to children: a comparison of the effects of rewards and autonomy support.

PubMed

Joussemet, Mireille; Koestner, Richard; Lekes, Natasha; Houlfort, Nathalie

2004-02-01

Two experiments compared rewards and autonomy support as methods to promote children's self-regulation for an uninteresting vigilance task. Dependent measures were ratings of positive affect, perception of the task's value, and free-choice engagement. ANOVA results revealed some positive effects associated with autonomy support, whereas no effect for rewards was found in either study. The outcomes of most interest were correlations between free-choice behavior and self-reported measures of affect and value, reflecting the level of integration in self-regulation. As predicted by self-determination theory (Deci & Ryan, 1985, 1991, 2000), rewards were associated with behaviors incongruent from affect and value, whereas autonomy support led to integrated self-regulation. This finding was first detected in Study 1 and later replicated in Study 2. Together, these results point to autonomy support as a beneficial alternative to the common use of rewards.

The Behavioral Pharmacology of Effort-related Choice Behavior: Dopamine, Adenosine and Beyond

PubMed Central

Salamone, John D; Correa, Merce; Nunes, Eric J; Randall, Patrick A; Pardo, Marta

2012-01-01

For many years, it has been suggested that drugs that interfere with dopamine (DA) transmission alter the “rewarding” impact of primary reinforcers such as food. Research and theory related to the functions of mesolimbic DA are undergoing a substantial conceptual restructuring, with the traditional emphasis on hedonia and primary reward yielding to other concepts and lines of inquiry. The present review is focused upon the involvement of nucleus accumbens DA in effort-related choice behavior. Viewed from the framework of behavioral economics, the effects of accumbens DA depletions and antagonism on food-reinforced behavior are highly dependent upon the work requirements of the instrumental task, and DA-depleted rats show a heightened sensitivity to response costs, especially ratio requirements. Moreover, interference with accumbens DA transmission exerts a powerful influence over effort-related choice behavior. Rats with accumbens DA depletions or antagonism reallocate their instrumental behavior away from food-reinforced tasks that have high response requirements, and show increased selection of low reinforcement/low cost options. Nucleus accumbens DA and adenosine interact in the regulation of effort-related functions, and other brain structures (anterior cingulate cortex, amygdala, ventral pallidum) also are involved. Studies of the brain systems regulating effort-based processes may have implications for understanding drug abuse, as well as symptoms such as psychomotor slowing, fatigue or anergia in depression and other neurological disorders. PMID:22287808

The behavioral pharmacology of effort-related choice behavior: dopamine, adenosine and beyond.

PubMed

Salamone, John D; Correa, Merce; Nunes, Eric J; Randall, Patrick A; Pardo, Marta

2012-01-01

For many years, it has been suggested that drugs that interfere with dopamine (DA) transmission alter the "rewarding" impact of primary reinforcers such as food. Research and theory related to the functions of mesolimbic DA are undergoing a substantial conceptual restructuring, with the traditional emphasis on hedonia and primary reward yielding to other concepts and lines of inquiry. The present review is focused upon the involvement of nucleus accumbens DA in effort-related choice behavior. Viewed from the framework of behavioral economics, the effects of accumbens DA depletions and antagonism on food-reinforced behavior are highly dependent upon the work requirements of the instrumental task, and DA-depleted rats show a heightened sensitivity to response costs, especially ratio requirements. Moreover, interference with accumbens DA transmission exerts a powerful influence over effort-related choice behavior. Rats with accumbens DA depletions or antagonism reallocate their instrumental behavior away from food-reinforced tasks that have high response requirements, and show increased selection of low reinforcement/low cost options. Nucleus accumbens DA and adenosine interact in the regulation of effort-related functions, and other brain structures (anterior cingulate cortex, amygdala, ventral pallidum) also are involved. Studies of the brain systems regulating effort-based processes may have implications for understanding drug abuse, as well as symptoms such as psychomotor slowing, fatigue or anergia in depression and other neurological disorders.

Strategic behavior, workload, and performance in task scheduling

NASA Technical Reports Server (NTRS)

Moray, Neville; Dessouky, Mohamed I.; Kijowski, Brian A.; Adapathya, Ravi

1991-01-01

Scheduling theory is proposed as a normative model for strategic behavior when operators are confronted by several tasks, all of which should be completed within a fixed time span, and when they are free to choose the order in which the tasks should be done. Three experiments are described to investigate the effect of knowing the correct scheduling rule on the efficiency of performance, subjective workload, and choice of strategy under different conditions of time pressure. The most potent effects are from time pressure. The reasons for the weak effect of knowing the rules are discussed, and implications for strategic behavior, displays, and decision aids are indicated.

Texting while driving as impulsive choice: A behavioral economic analysis

PubMed Central

Hayashi, Yusuke; Russo, Christopher T.; Wirth, Oliver

2015-01-01

The goal of the present study was to examine the utility of a behavioral economic analysis to investigate the role of delay discounting in texting while driving. A sample of 147 college students completed a survey to assess how frequently they send and read text messages while driving. Based on this information, students were assigned to one of two groups: 19 students who frequently text while driving and 19 matched-control students who infrequently text while driving but were similar in gender, age, years of education, and years driving. The groups were compared on the extent to which they discounted, or devalued, delayed hypothetical monetary rewards using a delay-discounting task. In this task, students made repeated choices between $1000 available after a delay (ranging from 1 week to 10 years) and an equal or lesser amount of money available immediately. The results show that the students who frequently text while driving discounted delayed rewards at a greater rate than the matched control students. The study supports the conclusions that texting while driving is fundamentally an impulsive choice made by drivers, and that a behavioral economic approach may be a useful research tool for investigating the decision-making processes underlying risky behaviors. PMID:26280804

Red Color and Risk-Taking Behavior in Online Environments

PubMed Central

Gnambs, Timo; Appel, Markus; Oeberst, Aileen

2015-01-01

In many situations red is associated with hazard and danger. As a consequence, it was expected that task-irrelevant color cues in online environments would affect risk-taking behaviors. This assumption was tested in two web-based experiments. The first study (N = 383) demonstrated that in risky choice dilemmas respondents preferred the less risky option when the displayed university logo was in red (versus gray); but only when both choice alternatives were at least moderately risky. The second study (N = 144) replicated these results with a behavioral outcome: Respondents showed more cautious behavior in a web-based game when the focal stimuli were colored red (versus blue). Together, these findings demonstrate that variations in the color design of a computerized environment affect risk taking: Red color leads to more conservative choices and behaviors. PMID:26207983

Multitasking as a choice: a perspective.

PubMed

Broeker, Laura; Liepelt, Roman; Poljac, Edita; Künzell, Stefan; Ewolds, Harald; de Oliveira, Rita F; Raab, Markus

2018-01-01

Performance decrements in multitasking have been explained by limitations in cognitive capacity, either modelled as static structural bottlenecks or as the scarcity of overall cognitive resources that prevent humans, or at least restrict them, from processing two tasks at the same time. However, recent research has shown that individual differences, flexible resource allocation, and prioritization of tasks cannot be fully explained by these accounts. We argue that understanding human multitasking as a choice and examining multitasking performance from the perspective of judgment and decision-making (JDM), may complement current dual-task theories. We outline two prominent theories from the area of JDM, namely Simple Heuristics and the Decision Field Theory, and adapt these theories to multitasking research. Here, we explain how computational modelling techniques and decision-making parameters used in JDM may provide a benefit to understanding multitasking costs and argue that these techniques and parameters have the potential to predict multitasking behavior in general, and also individual differences in behavior. Finally, we present the one-reason choice metaphor to explain a flexible use of limited capacity as well as changes in serial and parallel task processing. Based on this newly combined approach, we outline a concrete interdisciplinary future research program that we think will help to further develop multitasking research.

Apomorphine-induced hypoattention in rats and reversal of the choice performance impairment by aniracetam.

PubMed

Nakamura, K; Kurasawa, M; Tanaka, Y

1998-01-26

Aging-, disease- and medication-related imbalance of central dopaminergic neurons causes functional impairment of cognition and neuropsychological delirium in humans. We attempted to develop a new delirium model using the direct dopamine agonist, apomorphine, and a choice reaction performance task performed by middle-aged rats. The psychological properties of the model were assessed by determining behavioral measures such as choice reaction time, % correct and % omission. Apomorphine (0.03-0.3 mg/kg s.c.) produced a dose-dependent impairment of task performance. The dose of 0.1 mg/kg prolonged choice reaction time, decreased % correct and increased % omission, indicating that rats had attentional deficits and a reduced arousal or vigilance but no motor deficits or reduced food motivation. This psychological and behavioral impairment of performance resembled that of clinically defined delirium. In this model, the cholinomimetic, aniracetam (10 mg/kg p.o.), reversed the performance impairment induced by apomorphine. Its two metabolites, 2-pyrrolidinone (10 and 30 mg/kg p.o.) and N-anisoyl-gamma-aminobutyric acid (GABA, 10 mg/kg p.o.), effectively reversed the performance impairment as the intact drug did. Another pyrrolidinone derivative, nefiracetam (10 and 30 mg/kg p.o.), tended to worsen the apomorphine effect. The cholinesterase inhibitor, tacrine (10 mg/kg p.o.), markedly worsened all of the behavioral measures. Neuroleptics, haloperidol (0.025 mg/kg s.c.), tiapride (30 mg/kg p.o.) and sulpiride (10 and 30 mg/kg p.o.), antagonized the apomorphine effect. The present results suggest that apomorphine-induced behavioral disturbances in the choice reaction performance task seems to be a useful delirium model and aniracetam may improve delirium through the action of 2-pyrrolidinone and N-anisoyl-GABA, presumably by facilitating dopamine release in the striatum by acting as an AMPA or metabotropic glutamate receptor agonist.

Task-Dependent Behavioral Dynamics Make the Case for Temporal Integration in Multiple Strategies during Odor Processing

PubMed Central

Brown, Austin; Mehta, Nisarg; Vujovic, Mark; Amina, Tasneem; Fixsen, Bethany

2017-01-01

Differing results in olfactory-based decision-making research regarding the amount of time that rats and mice use to identify odors have led to some disagreements about odor-processing mechanics, including whether or not rodents use temporal integration (i.e., sniffing longer to identify odors better). Reported differences in behavioral strategies may be due to the different types of tasks used in different laboratories. Some researchers have reported that animals performing two-alternative choice (TAC) tasks need only 1–2 sniffs and do not increase performance with longer sampling. Others have reported that animals performing go/no-go (GNG) tasks increase sampling times and performance for difficult discriminations, arguing for temporal integration. We present results from four experiments comparing GNG and TAC tasks over several behavioral variables (e.g., performance, sampling duration). When rats know only one task, they perform better in GNG than in TAC. However, performance was not statistically different when rats learned and were tested in both tasks. Rats sample odors longer in GNG than in TAC, even when they know both tasks and perform them in the same or different sessions. Longer sampling is associated with better performance for both tasks in difficult discriminations, which supports the case for temporal integration over ≥2–6 sniffs in both tasks. These results illustrate that generalizations from a single task about behavioral or cognitive abilities (e.g., processing, perception) do not capture the full range of complexity and can significantly impact inferences about general abilities in sensory perception. SIGNIFICANCE STATEMENT Behavioral tasks and training and testing history affect measured outcomes in cognitive tests. Rats sample odors longer in a go/no-go (GNG) than in a two-alternative choice (TAC) task, performing better in GNG unless they know both tasks. Odor-sampling time is extended in both tasks when the odors to be discriminated are very similar. Rats may extend sampling time to integrate odor information up to ∼0.5 s (2–6 sniffs). Such factors as task, task parameters, and training history affect decision times and performance, making it important to use multiple tasks when making inferences about sensory or cognitive processing. PMID:28336570

Dopaminergic modulation of effort-related choice behavior as assessed by a progressive ratio chow feeding choice task: pharmacological studies and the role of individual differences.

PubMed

Randall, Patrick A; Pardo, Marta; Nunes, Eric J; López Cruz, Laura; Vemuri, V Kiran; Makriyannis, Alex; Baqi, Younis; Müller, Christa E; Correa, Mercè; Salamone, John D

2012-01-01

Mesolimbic dopamine (DA) is involved in behavioral activation and effort-related processes. Rats with impaired DA transmission reallocate their instrumental behavior away from food-reinforced tasks with high response requirements, and instead select less effortful food-seeking behaviors. In the present study, the effects of several drug treatments were assessed using a progressive ratio (PROG)/chow feeding concurrent choice task. With this task, rats can lever press on a PROG schedule reinforced by a preferred high-carbohydrate food pellet, or alternatively approach and consume the less-preferred but concurrently available laboratory chow. Rats pass through each ratio level 15 times, after which the ratio requirement is incremented by one additional response. The DA D(2) antagonist haloperidol (0.025-0.1 mg/kg) reduced number of lever presses and highest ratio achieved but did not reduce chow intake. In contrast, the adenosine A(2A) antagonist MSX-3 increased lever presses and highest ratio achieved, but decreased chow consumption. The cannabinoid CB1 inverse agonist and putative appetite suppressant AM251 decreased lever presses, highest ratio achieved, and chow intake; this effect was similar to that produced by pre-feeding. Furthermore, DA-related signal transduction activity (pDARPP-32(Thr34) expression) was greater in nucleus accumbens core of high responders (rats with high lever pressing output) compared to low responders. Thus, the effects of DA antagonism differed greatly from those produced by pre-feeding or reduced CB1 transmission, and it appears unlikely that haloperidol reduces PROG responding because of a general reduction in primary food motivation or the unconditioned reinforcing properties of food. Furthermore, accumbens core signal transduction activity is related to individual differences in work output.

The Latent Structure of Impulsivity: Impulsive Choice, Impulsive Action, and Impulsive Personality Traits

PubMed Central

MacKillop, James; Weafer, Jessica; Gray, Joshua; Oshri, Assaf; Palmer, Abraham; de Wit, Harriet

2016-01-01

Rationale Impulsivity has been strongly linked to addictive behaviors, but can be operationalized in a number of ways that vary considerably in overlap, suggesting multidimensionality. Objective This study tested the hypothesis that the latent structure among multiple measures of impulsivity would reflect three broad categories: impulsive choice, reflecting discounting of delayed rewards; impulsive action, reflecting ability to inhibit a prepotent motor response; and impulsive personality traits, reflecting self-reported attributions of self-regulatory capacity. Methods The study used a cross-sectional confirmatory factor analysis of multiple impulsivity assessments. Participants were 1252 young adults (62% female) with low levels of addictive behavior who were assessed in individual laboratory rooms at the University of Chicago and the University of Georgia. The battery comprised a delay discounting task, Monetary Choice Questionnaire, Conners Continuous Performance Test, Go/NoGo Task, Stop Signal Task, Barratt Impulsivity Scale, and the UPPS-P Impulsive Behavior Scale. Results The hypothesized three-factor model provided the best fit to the data, although Sensation Seeking was excluded from the final model. The three latent factors were largely unrelated to each other and were variably associated with substance use. Conclusions These findings support the hypothesis that diverse measures of impulsivity can broadly be organized into three categories that are largely distinct from one another. These findings warrant investigation among individuals with clinical levels of addictive behavior and may be applied to understanding the underlying biological mechanisms of these categories. PMID:27449350

Effects of fictive reward on rat's choice behavior

PubMed Central

Kim, Ko-Un; Huh, Namjung; Jang, Yunsil; Lee, Daeyeol; Jung, Min Whan

2015-01-01

Choices of humans and non-human primates are influenced by both actually experienced and fictive outcomes. To test whether this is also the case in rodents, we examined rat's choice behavior in a binary choice task in which variable magnitudes of actual and fictive rewards were delivered. We found that the animal's choice was significantly influenced by the magnitudes of both actual and fictive rewards in the previous trial. A model-based analysis revealed, however, that the effect of fictive reward was more transient and influenced mostly the choice in the next trial, whereas the effect of actual reward was more sustained, consistent with incremental learning of action values. Our results suggest that the capacity to modify future choices based on fictive outcomes might be shared by many different animal species, but fictive outcomes are less effective than actual outcomes in the incremental value learning system. PMID:25623929

How Individual Differences Interact with Task Demands in Text Processing

ERIC Educational Resources Information Center

Wang, Zuowei; Sabatini, John; O'Reilly, Tenaha; Feng, Gary

2017-01-01

Reading is affected by both situational requirements and one's cognitive skills. The current study investigated how individual differences interacted with task requirements to determine reading behavior and outcome. We recorded the eye movements of college students, who differed in reading efficiency, while they completed a multiple-choice (MC)…

Goal-Directed Decision Making with Spiking Neurons.

PubMed

Friedrich, Johannes; Lengyel, Máté

2016-02-03

Behavioral and neuroscientific data on reward-based decision making point to a fundamental distinction between habitual and goal-directed action selection. The formation of habits, which requires simple updating of cached values, has been studied in great detail, and the reward prediction error theory of dopamine function has enjoyed prominent success in accounting for its neural bases. In contrast, the neural circuit mechanisms of goal-directed decision making, requiring extended iterative computations to estimate values online, are still unknown. Here we present a spiking neural network that provably solves the difficult online value estimation problem underlying goal-directed decision making in a near-optimal way and reproduces behavioral as well as neurophysiological experimental data on tasks ranging from simple binary choice to sequential decision making. Our model uses local plasticity rules to learn the synaptic weights of a simple neural network to achieve optimal performance and solves one-step decision-making tasks, commonly considered in neuroeconomics, as well as more challenging sequential decision-making tasks within 1 s. These decision times, and their parametric dependence on task parameters, as well as the final choice probabilities match behavioral data, whereas the evolution of neural activities in the network closely mimics neural responses recorded in frontal cortices during the execution of such tasks. Our theory provides a principled framework to understand the neural underpinning of goal-directed decision making and makes novel predictions for sequential decision-making tasks with multiple rewards. Goal-directed actions requiring prospective planning pervade decision making, but their circuit-level mechanisms remain elusive. We show how a model circuit of biologically realistic spiking neurons can solve this computationally challenging problem in a novel way. The synaptic weights of our network can be learned using local plasticity rules such that its dynamics devise a near-optimal plan of action. By systematically comparing our model results to experimental data, we show that it reproduces behavioral decision times and choice probabilities as well as neural responses in a rich set of tasks. Our results thus offer the first biologically realistic account for complex goal-directed decision making at a computational, algorithmic, and implementational level. Copyright © 2016 the authors 0270-6474/16/361529-18$15.00/0.

Goal-Directed Decision Making with Spiking Neurons

PubMed Central

Lengyel, Máté

2016-01-01

Behavioral and neuroscientific data on reward-based decision making point to a fundamental distinction between habitual and goal-directed action selection. The formation of habits, which requires simple updating of cached values, has been studied in great detail, and the reward prediction error theory of dopamine function has enjoyed prominent success in accounting for its neural bases. In contrast, the neural circuit mechanisms of goal-directed decision making, requiring extended iterative computations to estimate values online, are still unknown. Here we present a spiking neural network that provably solves the difficult online value estimation problem underlying goal-directed decision making in a near-optimal way and reproduces behavioral as well as neurophysiological experimental data on tasks ranging from simple binary choice to sequential decision making. Our model uses local plasticity rules to learn the synaptic weights of a simple neural network to achieve optimal performance and solves one-step decision-making tasks, commonly considered in neuroeconomics, as well as more challenging sequential decision-making tasks within 1 s. These decision times, and their parametric dependence on task parameters, as well as the final choice probabilities match behavioral data, whereas the evolution of neural activities in the network closely mimics neural responses recorded in frontal cortices during the execution of such tasks. Our theory provides a principled framework to understand the neural underpinning of goal-directed decision making and makes novel predictions for sequential decision-making tasks with multiple rewards. SIGNIFICANCE STATEMENT Goal-directed actions requiring prospective planning pervade decision making, but their circuit-level mechanisms remain elusive. We show how a model circuit of biologically realistic spiking neurons can solve this computationally challenging problem in a novel way. The synaptic weights of our network can be learned using local plasticity rules such that its dynamics devise a near-optimal plan of action. By systematically comparing our model results to experimental data, we show that it reproduces behavioral decision times and choice probabilities as well as neural responses in a rich set of tasks. Our results thus offer the first biologically realistic account for complex goal-directed decision making at a computational, algorithmic, and implementational level. PMID:26843636

Further examination of factors that influence preference for positive versus negative reinforcement.

PubMed

Kodak, Tiffany; Lerman, Dorothea C; Volkert, Valerie M; Trosclair, Nicole

2007-01-01

Factors that influence choice between qualitatively different reinforcers (e.g., a food item or a break from work) are important to consider when arranging treatments for problem behavior. Previous findings indicate that children who engage in problem behavior maintained by escape from demands may choose a food item over the functional reinforcer during treatment (DeLeon, Neidert, Anders, & Rodriguez-Catter, 2001; Lalli et al., 1999). However, a number of variables may influence choice between concurrently available forms of reinforcement. An analogue for treatment situations in which positive reinforcement for compliance is in direct competition with negative reinforcement for problem behavior was used in the current study to evaluate several variables that may influence choice. Participants were 5 children who had been diagnosed with developmental disabilities and who engaged in problem behavior maintained by escape from demands. In the first phase, the effects of task preference and schedule of reinforcement on choice between a 30-s break and a high-preference food item were evaluated. The food item was preferred over the break, regardless of the preference level of the task or the reinforcement schedule, for all but 1 participant. In the second phase, the quality of the break was manipulated by combining escape with toys, attention, or both. Only 1 participant showed preference for the enriched break. In the third phase, choice of a medium- or low-preference food item versus the enriched break was evaluated. Three of 4 participants showed preference for the break over the less preferred food item. Results extend previous research by identifying some of the conditions under which individuals who engage in escape-maintained behavior will prefer a food reinforcer over the functional one.

Further Examination of Factors that Influence Preference for Positive Versus Negative Reinforcement

PubMed Central

Kodak, Tiffany; Lerman, Dorothea C; Volkert, Valerie M; Trosclair, Nicole

2007-01-01

Factors that influence choice between qualitatively different reinforcers (e.g., a food item or a break from work) are important to consider when arranging treatments for problem behavior. Previous findings indicate that children who engage in problem behavior maintained by escape from demands may choose a food item over the functional reinforcer during treatment (DeLeon, Neidert, Anders, & Rodriguez-Catter, 2001; Lalli et al., 1999). However, a number of variables may influence choice between concurrently available forms of reinforcement. An analogue for treatment situations in which positive reinforcement for compliance is in direct competition with negative reinforcement for problem behavior was used in the current study to evaluate several variables that may influence choice. Participants were 5 children who had been diagnosed with developmental disabilities and who engaged in problem behavior maintained by escape from demands. In the first phase, the effects of task preference and schedule of reinforcement on choice between a 30-s break and a high-preference food item were evaluated. The food item was preferred over the break, regardless of the preference level of the task or the reinforcement schedule, for all but 1 participant. In the second phase, the quality of the break was manipulated by combining escape with toys, attention, or both. Only 1 participant showed preference for the enriched break. In the third phase, choice of a medium- or low-preference food item versus the enriched break was evaluated. Three of 4 participants showed preference for the break over the less preferred food item. Results extend previous research by identifying some of the conditions under which individuals who engage in escape-maintained behavior will prefer a food reinforcer over the functional one. PMID:17471792

Temporal dynamics of choice behavior in rats and humans: an examination of pre- and post-choice latencies

PubMed Central

Fam, Justine; Westbrook, Fred; Arabzadeh, Ehsan

2016-01-01

Identifying similarities and differences in choice behavior across species is informative about how basic mechanisms give rise to more complex processes. In the present study, we compared pre- and post-choice latencies between rats and humans under two paradigms. In Experiment 1, we used a cued choice paradigm where subjects were presented with a cue that directed them as to which of two options to respond for rewards. In Experiment 2, subjects were free to choose between two options in order to procure rewards. In both Experiments rewards were delivered with distinct probabilities. The trial structure used in these experiments allowed the choice process to be decomposed into pre- and post-choice processes. Overall, post-choice latencies reflected the difference in reward probability between the two options, where latencies for the option with higher probability of reward were longer than those for the option with lower probability of reward. An interesting difference between rats and humans was observed: the choice behavior for humans, but not rats, was sensitive to the free-choice aspect of the tasks, such that in free-choice trials post-choice latencies no longer reflected the difference in reward probabilities between the two options. PMID:26862000

Preferential Representation of Past Outcome Information and Future Choice Behavior by Putative Inhibitory Interneurons Rather Than Putative Pyramidal Neurons in the Primate Dorsal Anterior Cingulate Cortex.

PubMed

Kawai, Takashi; Yamada, Hiroshi; Sato, Nobuya; Takada, Masahiko; Matsumoto, Masayuki

2018-05-02

The dorsal anterior cingulate cortex (dACC) plays crucial roles in monitoring the outcome of a choice and adjusting a subsequent choice behavior based on the outcome information. In the present study, we investigated how different types of dACC neurons, that is, putative pyramidal neurons and putative inhibitory interneurons, contribute to these processes. We analyzed single-unit database obtained from the dACC in monkeys performing a reversal learning task. The monkey was required to adjust choice behavior from past outcome experiences. Depending on their action potential waveforms, the recorded neurons were classified into putative pyramidal neurons and putative inhibitory interneurons. We found that these neurons do not equally contribute to outcome monitoring and behavioral adjustment. Although both neuron types evenly responded to the current outcome, a larger proportion of putative inhibitory interneurons than putative pyramidal neurons stored the information about the past outcome. The putative inhibitory interneurons further represented choice-related signals more frequently, such as whether the monkey would shift the last choice to an alternative at the next choice opportunity. Our findings suggest that putative inhibitory interneurons, which are thought not to project to brain areas outside the dACC, preferentially transmit signals that would adjust choice behavior based on past outcome experiences.

Food labels promote healthy choices by a decision bias in the amygdala.

PubMed

Grabenhorst, Fabian; Schulte, Frank P; Maderwald, Stefan; Brand, Matthias

2013-07-01

Food labeling is the major health policy strategy to counter rising obesity rates. Based on traditional economic theory, such strategies assume that detailed nutritional information will necessarily help individuals make better, healthier choices. However, in contrast to the well-known utility of labels in food marketing, evidence for the efficacy of nutritional labeling is mixed. Psychological and behavioral economic theories suggest that successful marketing strategies activate automatic decision biases and emotions, which involve implicit emotional brain systems. Accordingly, simple, intuitive food labels that engage these neural systems could represent a promising approach for promoting healthier choices. Here we used functional MRI to investigate this possibility. Healthy, mildly hungry subjects performed a food evaluation task and a food choice task. The main experimental manipulation was to pair identical foods with simple labels that emphasized either taste benefits or health-related food properties. We found that such labels biased food evaluations in the amygdala, a core emotional brain system. When labels biased the amygdala's evaluations towards health-related food properties, the strength of this bias predicted behavioral shifts towards healthier choices. At the time of decision-making, amygdala activity encoded key decision variables, potentially reflecting active amygdala participation in food choice. Our findings underscore the potential utility of food labeling in health policy and indicate a principal role for emotional brain systems when labels guide food choices. Copyright © 2013 Elsevier Inc. All rights reserved.

Parallel Representation of Value-Based and Finite State-Based Strategies in the Ventral and Dorsal Striatum

PubMed Central

Ito, Makoto; Doya, Kenji

2015-01-01

Previous theoretical studies of animal and human behavioral learning have focused on the dichotomy of the value-based strategy using action value functions to predict rewards and the model-based strategy using internal models to predict environmental states. However, animals and humans often take simple procedural behaviors, such as the “win-stay, lose-switch” strategy without explicit prediction of rewards or states. Here we consider another strategy, the finite state-based strategy, in which a subject selects an action depending on its discrete internal state and updates the state depending on the action chosen and the reward outcome. By analyzing choice behavior of rats in a free-choice task, we found that the finite state-based strategy fitted their behavioral choices more accurately than value-based and model-based strategies did. When fitted models were run autonomously with the same task, only the finite state-based strategy could reproduce the key feature of choice sequences. Analyses of neural activity recorded from the dorsolateral striatum (DLS), the dorsomedial striatum (DMS), and the ventral striatum (VS) identified significant fractions of neurons in all three subareas for which activities were correlated with individual states of the finite state-based strategy. The signal of internal states at the time of choice was found in DMS, and for clusters of states was found in VS. In addition, action values and state values of the value-based strategy were encoded in DMS and VS, respectively. These results suggest that both the value-based strategy and the finite state-based strategy are implemented in the striatum. PMID:26529522

Choices between positive and negative reinforcement during treatment for escape-maintained behavior.

PubMed

DeLeon, I G; Neidert, P L; Anders, B M; Rodriguez-Catter, V

2001-01-01

Positive reinforcement was more effective than negative reinforcement in promoting compliance and reducing escape-maintained problem behavior for a child with autism. Escape extinction was then added while the child was given a choice between positive or negative reinforcement for compliance and the reinforcement schedule was thinned. When the reinforcement requirement reached 10 consecutive tasks, the treatment effects became inconsistent and reinforcer selection shifted from a strong preference for positive reinforcement to an unstable selection pattern.

The effect of reinforcer magnitude on probability and delay discounting of experienced outcomes in a computer game task in humans.

PubMed

Greenhow, Anna K; Hunt, Maree J; Macaskill, Anne C; Harper, David N

2015-09-01

Delay and uncertainty of receipt both reduce the subjective value of reinforcers. Delay has a greater impact on the subjective value of smaller reinforcers than of larger ones while the reverse is true for uncertainty. We investigated the effect of reinforcer magnitude on discounting of delayed and uncertain reinforcers using a novel approach: embedding relevant choices within a computer game. Participants made repeated choices between smaller, certain, immediate outcomes and larger, but delayed or uncertain outcomes while experiencing the result of each choice. Participants' choices were generally well described by the hyperbolic discounting function. Smaller numbers of points were discounted more steeply than larger numbers as a function of delay but not probability. The novel experiential choice task described is a promising approach to investigating both delay and probability discounting in humans. © Society for the Experimental Analysis of Behavior.

Cognitive Control Predicts Use of Model-Based Reinforcement-Learning

PubMed Central

Otto, A. Ross; Skatova, Anya; Madlon-Kay, Seth; Daw, Nathaniel D.

2015-01-01

Accounts of decision-making and its neural substrates have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental work suggest that this classic distinction between behaviorally and neurally dissociable systems for habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning (RL), called model-free and model-based RL, but the cognitive or computational processes by which one system may dominate over the other in the control of behavior is a matter of ongoing investigation. To elucidate this question, we leverage the theoretical framework of cognitive control, demonstrating that individual differences in utilization of goal-related contextual information—in the service of overcoming habitual, stimulus-driven responses—in established cognitive control paradigms predict model-based behavior in a separate, sequential choice task. The behavioral correspondence between cognitive control and model-based RL compellingly suggests that a common set of processes may underpin the two behaviors. In particular, computational mechanisms originally proposed to underlie controlled behavior may be applicable to understanding the interactions between model-based and model-free choice behavior. PMID:25170791

Using aversive images to enhance healthy food choices and implicit attitudes: An experimental test of evaluative conditioning.

PubMed

Hollands, Gareth J; Prestwich, Andrew; Marteau, Theresa M

2011-03-01

To examine the effect of communicating images of energy-dense snack foods paired with aversive images of the potential health consequences of unhealthy eating, on implicit and explicit attitudes and food choice behavior. Participants were randomly allocated to either an evaluative conditioning (EC) procedure that paired images of snack foods with images of potential adverse health consequences or a control condition that featured images of snack foods alone. Implicit attitudes were assessed pre- and post-intervention. Explicit attitudes and food choice behavior were assessed post-intervention. The conditioning intervention made implicit attitudes toward energy-dense snacks more negative, with this effect greatest in those with relatively more favorable implicit attitudes toward these snacks at baseline. Participants in the conditioning intervention were more likely to choose fruit rather than snacks in a behavioral choice task, a relationship mediated by changes in implicit attitudes. Presenting aversive images of potential health consequences with those of specific foodstuffs can change implicit attitudes, which impacts on subsequent food choice behavior. (c) 2011 APA, all rights reserved

The hybrid delay task: Can capuchin monkeys (Cebus apella) sustain a delay after an initial choice to do so?

PubMed Central

Paglieri, Fabio; Focaroli, Valentina; Bramlett, Jessica; Tierno, Valeria; McIntyre, Joseph M.; Addessi, Elsa; Evans, Theodore A.; Beran, Michael J.

2013-01-01

Choosing to wait for a better outcome (delay choice) and sustaining the delay prior to that outcome (delay maintenance) are both prerequisites for successful self control in intertemporal choices. However, most existing experimental methods test these skills in isolation from each other, and no significant correlation has been observed in performance across these tasks. In this study we introduce a new paradigm, the hybrid delay task, which combines an initial delay choice with a subsequent delay maintenance stage. This allows testing how often choosing to wait is paired with the actual ability to do so. We tested 18 capuchin monkeys (Cebus apella) from two laboratories in various conditions, and we found that subjects frequently chose the delayed reward but then failed to wait for it, due to poor delay maintenance. However, performance improved with experience and different behavioral responses for error correction were evident. These findings have far reaching implications: if such a high error rate was observed also in other species (possibly including Homo sapiens), this may indicate that delay choice tasks that make use of salient, prepotent stimuli do not reliably assess generalized self control, insofar as choosing to wait does not entail always being able to do so. PMID:23274585

Common neural correlates of intertemporal choices and intelligence in adolescents.

PubMed

Ripke, Stephan; Hübner, Thomas; Mennigen, Eva; Müller, Kathrin U; Li, Shu-Chen; Smolka, Michael N

2015-02-01

Converging behavioral evidence indicates that temporal discounting, measured by intertemporal choice tasks, is inversely related to intelligence. At the neural level, the parieto-frontal network is pivotal for complex, higher-order cognitive processes. Relatedly, underrecruitment of the pFC during a working memory task has been found to be associated with steeper temporal discounting. Furthermore, this network has also been shown to be related to the consistency of intertemporal choices. Here we report an fMRI study that directly investigated the association of neural correlates of intertemporal choice behavior with intelligence in an adolescent sample (n = 206; age 13.7-15.5 years). After identifying brain regions where the BOLD response during intertemporal choice was correlated with individual differences in intelligence, we further tested whether BOLD responses in these areas would mediate the associations between intelligence, the discounting rate, and choice consistency. We found positive correlations between BOLD response in a value-independent decision network (i.e., dorsolateral pFC, precuneus, and occipital areas) and intelligence. Furthermore, BOLD response in a value-dependent decision network (i.e., perigenual ACC, inferior frontal gyrus, ventromedial pFC, ventral striatum) was positively correlated with intelligence. The mediation analysis revealed that BOLD responses in the value-independent network mediated the association between intelligence and choice consistency, whereas BOLD responses in the value-dependent network mediated the association between intelligence and the discounting rate. In summary, our findings provide evidence for common neural correlates of intertemporal choice and intelligence, possibly linked by valuation as well as executive functions.

Model-based influences on humans’ choices and striatal prediction errors

PubMed Central

Daw, Nathaniel D.; Gershman, Samuel J.; Seymour, Ben; Dayan, Peter; Dolan, Raymond J.

2011-01-01

Summary The mesostriatal dopamine system is prominently implicated in model-free reinforcement learning, with fMRI BOLD signals in ventral striatum notably covarying with model-free prediction errors. However, latent learning and devaluation studies show that behavior also shows hallmarks of model-based planning, and the interaction between model-based and model-free values, prediction errors and preferences is underexplored. We designed a multistep decision task in which model-based and model-free influences on human choice behavior could be distinguished. By showing that choices reflected both influences we could then test the purity of the ventral striatal BOLD signal as a model-free report. Contrary to expectations, the signal reflected both model-free and model-based predictions in proportions matching those that best explained choice behavior. These results challenge the notion of a separate model-free learner and suggest a more integrated computational architecture for high-level human decision-making. PMID:21435563

Performance of Healthy Participants on the Iowa Gambling Task

ERIC Educational Resources Information Center

Steingroever, Helen; Wetzels, Ruud; Horstmann, Annette; Neumann, Jane; Wagenmakers, Eric-Jan

2013-01-01

The Iowa Gambling Task (IGT; Bechara, Damasio, Damasio, & Anderson, 1994) is often used to assess decision-making deficits in clinical populations. The interpretation of the results hinges on 3 key assumptions: (a) healthy participants learn to prefer the good options over the bad options; (b) healthy participants show homogeneous choice behavior;…

Individual differences in voluntary alcohol intake in rats: relationship with impulsivity, decision making and Pavlovian conditioned approach.

PubMed

Spoelder, Marcia; Flores Dourojeanni, Jacques P; de Git, Kathy C G; Baars, Annemarie M; Lesscher, Heidi M B; Vanderschuren, Louk J M J

2017-07-01

Alcohol use disorder (AUD) has been associated with suboptimal decision making, exaggerated impulsivity, and aberrant responses to reward-paired cues, but the relationship between AUD and these behaviors is incompletely understood. This study aims to assess decision making, impulsivity, and Pavlovian-conditioned approach in rats that voluntarily consume low (LD) or high (HD) amounts of alcohol. LD and HD were tested in the rat gambling task (rGT) or the delayed reward task (DRT). Next, the effect of alcohol (0-1.0 g/kg) was tested in these tasks. Pavlovian-conditioned approach (PCA) was assessed both prior to and after intermittent alcohol access (IAA). Principal component analyses were performed to identify relationships between the most important behavioral parameters. HD showed more optimal decision making in the rGT. In the DRT, HD transiently showed reduced impulsive choice. In both LD and HD, alcohol treatment increased optimal decision making in the rGT and increased impulsive choice in the DRT. PCA prior to and after IAA was comparable for LD and HD. When PCA was tested after IAA only, HD showed a more sign-tracking behavior. The principal component analyses indicated dimensional relationships between alcohol intake, impulsivity, and sign-tracking behavior in the PCA task after IAA. HD showed a more efficient performance in the rGT and DRT. Moreover, alcohol consumption enhanced approach behavior to reward-predictive cues, but sign-tracking did not predict the level of alcohol consumption. Taken together, these findings suggest that high levels of voluntary alcohol intake are associated with enhanced cue- and reward-driven behavior.

The Nature of Belief-Directed Exploratory Choice in Human Decision-Making

PubMed Central

Knox, W. Bradley; Otto, A. Ross; Stone, Peter; Love, Bradley C.

2011-01-01

In non-stationary environments, there is a conflict between exploiting currently favored options and gaining information by exploring lesser-known options that in the past have proven less rewarding. Optimal decision-making in such tasks requires considering future states of the environment (i.e., planning) and properly updating beliefs about the state of the environment after observing outcomes associated with choices. Optimal belief-updating is reflective in that beliefs can change without directly observing environmental change. For example, after 10 s elapse, one might correctly believe that a traffic light last observed to be red is now more likely to be green. To understand human decision-making when rewards associated with choice options change over time, we develop a variant of the classic “bandit” task that is both rich enough to encompass relevant phenomena and sufficiently tractable to allow for ideal actor analysis of sequential choice behavior. We evaluate whether people update beliefs about the state of environment in a reflexive (i.e., only in response to observed changes in reward structure) or reflective manner. In contrast to purely “random” accounts of exploratory behavior, model-based analyses of the subjects’ choices and latencies indicate that people are reflective belief updaters. However, unlike the Ideal Actor model, our analyses indicate that people’s choice behavior does not reflect consideration of future environmental states. Thus, although people update beliefs in a reflective manner consistent with the Ideal Actor, they do not engage in optimal long-term planning, but instead myopically choose the option on every trial that is believed to have the highest immediate payoff. PMID:22319503

Complex Living Conditions Impair Behavioral Inhibition but Improve Attention in Rats

PubMed Central

van der Veen, Rixt; Kentrop, Jiska; van der Tas, Liza; Loi, Manila; van IJzendoorn, Marinus H.; Bakermans-Kranenburg, Marian J.; Joëls, Marian

2015-01-01

Rapid adaptation to changes, while maintaining a certain level of behavioral inhibition is an important feature in every day functioning. How environmental context and challenges in life can impact on the development of this quality is still unknown. In the present study, we examined the effect of a complex rearing environment during adolescence on attention and behavioral inhibition in adult male rats. We also tested whether these effects were affected by an adverse early life challenge, maternal deprivation (MD). We found that animals that were raised in large, two floor MarlauTM cages, together with 10 conspecifics, showed improved attention, but impaired behavioral inhibition in the 5-choice serial reaction time task. The early life challenge of 24 h MD on postnatal day 3 led to a decline in bodyweight during adolescence, but did not by itself influence responses in the 5-choice task in adulthood, nor did it moderate the effects of complex housing. Our data suggest that a complex rearing environment leads to a faster adaptation to changes in the environment, but at the cost of lower behavioral inhibition. PMID:26733839

Behavioral Economic Laboratory Research in Tobacco Regulatory Science.

PubMed

Tidey, Jennifer W; Cassidy, Rachel N; Miller, Mollie E; Smith, Tracy T

2016-10-01

Research that can provide a scientific foundation for the United States Food and Drug Administration (FDA) tobacco policy decisions is needed to inform tobacco regulatory policy. One factor that affects the impact of a tobacco product on public health is its intensity of use, which is determined, in part, by its abuse liability or reinforcing efficacy. Behavioral economic tasks have considerable utility for assessing the reinforcing efficacy of current and emerging tobacco products. This paper provides a narrative review of several behavioral economic laboratory tasks and identifies important applications to tobacco regulatory science. Behavioral economic laboratory assessments, including operant self-administration, choice tasks and purchase tasks, can be used generate behavioral economic data on the effect of price and other constraints on tobacco product consumption. These tasks could provide an expedited simulation of the effects of various tobacco control policies across populations of interest to the FDA. Tobacco regulatory research questions that can be addressed with behavioral economic tasks include assessments of the impact of product characteristics on product demand, assessments of the abuse liability of novel and potential modified risk tobacco products (MRTPs), and assessments of the impact of conventional and novel products in vulnerable populations.

Lithium, but not Valproate, Reduces Impulsive Choice in the Delay-Discounting Task in Mice

PubMed Central

Halcomb, Meredith E; Gould, Todd D; Grahame, Nicholas J

2013-01-01

Both lithium and valproate are well-established treatments for bipolar disorder. Studies have also found that lithium is effective at reducing suicidal behaviors in patients with mood disorders. Impulsivity is a validated endophenotype of both bipolar disorder and suicidal behavior. We assessed effects of treatment with lithium or valproate on cognitive impulsivity in selectively bred mice previously shown to manifest relatively high levels of cognitive impulsivity. Mice were trained in the delay-discounting paradigm, a measure of cognitive impulsivity reflecting a behavioral bias towards immediacy, and then treated with lithium, valproate, or control chow. After 3 weeks of drug treatment, mice were tested at various delays to a large, delayed reward. Drug treatment continued during this time. Lithium reduced impulsivity, whereas valproate had no effect on choice behavior. Both drugs increased the number of choice trials and reinforcer intake, but effects on choice behavior did not depend on these motivational changes. To our knowledge, this is the first study demonstrating lithium's effects to reduce cognitive impulsivity. Future studies may focus on the ability of putative pharmacotherapies for patients at risk for bipolar disorder or suicide to modify the impulsive choice dimension of this diseases. PMID:23584261

A role for the striatum in regret-related choice repetition

PubMed Central

Nicolle, Antoinette; Bach, Dominik R.; Driver, Jon; Dolan, Raymond J.

2011-01-01

‘Regret aversion’ is proposed to explain a tendency to avoid future choices that have induced past regret. However, regret might also motivate us to repeat previous regret-related choices to make up for their previous selection, a behavior resembling ‘chasing’ in the context of gambling. In the current experiment we acquired fMRI brain data while participants placed monetary bets on repeated gambles. Behaviorally, participants showed a tendency to repeat previously regret-related choices (operationalized as those leading to an outcome worse than what might have been), an effect restricted to early runs of the task. At gamble outcome, we show a reduction in ventral striatal activity for regret-related, relative to relief-related, outcomes. Critically, this modulation was only seen when subjects were responsible for the bet choice. Activity in dorsal striatum was associated with an influence of previous regret on participants’ subsequent choices, evident in increased activity when regret-related choices were repeated, relative to avoided, on the next trial. Our findings indicate that regret can lead to choice repetition as if seeking to make up for our mistakes and in so doing may lead to subsequent chasing behavior. PMID:20433245

Behavioral Economic Analysis of Opioid Consumption In Heroin-Dependent Individuals: Effects of Alternative Reinforcer Magnitude and Post-Session Drug Supply

PubMed Central

Greenwald, Mark K; Steinmiller, Caren L

2009-01-01

This study investigated the extent to which hydromorphone (HYD) choice and behavioral economic demand were influenced by HYD unit price (UP), alternative money reinforcement magnitude and post-session HYD supply. Heroin dependent research volunteers (n=13) stabilized on buprenorphine 8 mg/day first sampled two HYD doses (12 and 24 mg IM, labeled Drug A [session 1] and Drug B [session 2]). In each of the final six sessions, volunteers were given access to a 12-trial choice progressive ratio (PR) task and could earn a HYD unit dose (2 mg, fixed) or money ($2 or $4, varied across sessions), administered immediately after the work session. Before the PR task, volunteers were told which HYD supplemental dose (none, Drug A or B) would be available 3 hr after receiving the PR-contingent dose. PR-contingent HYD choice significantly decreased when $4 relative to $2 was concurrently available. Information about the post-session HYD supplement moderated this effect: when subjects were told a supplemental dose was available, HYD-seeking behavior decreased when the money alternative was smaller ($2), but this information did not further attenuate HYD choice, which was already low, when the money alternative was higher ($4). HYD demand elasticity was only increased by the $4 relative to $2 alternative without the HYD supplement. In summary, opioid-seeking behavior is influenced by the availability of concurrent non-drug and drug alternatives. These findings show that drug availability and non-drug alternatives interact to modulate drug-seeking behavior. PMID:19464125

A Frontal Dopamine System for Reflective Exploratory Behavior

PubMed Central

Blanco, Nathaniel J.; Love, Bradley C.; Cooper, Jessica A.; McGeary, John E.; Knopik, Valerie S.; Maddox, W. Todd

2015-01-01

The COMT gene modulates dopamine levels in prefrontal cortex with Met allele carriers having lower COMT enzyme activity and, therefore, higher dopamine levels compared to Val/Val homozygotes. Concordantly, Val/Val homozygotes tend to perform worse and display increased (interpreted as inefficient) frontal activation in certain cognitive tasks. In a sample of 209 participants, we test the hypothesis that Met carriers will be advantaged in a decision-making task that demands sequencing exploratory and exploitive choices to minimize uncertainty about the reward structure in the environment. Previous work suggests that optimal performance depends on limited cognitive resources supported by prefrontal systems. If so, Met carriers should outperform Val/Val homozygotes, particularly under dual-task conditions that tax limited cognitive resources. In accord with these a priori predictions, Met carriers were more resilient in the face of cognitive load, continuing to explore in a sophisticated manner. We fit computational models that embody sophisticated reflective and simple reflexive strategies to further evaluate participants' exploration behavior. The Ideal Actor model reflectively updates beliefs and plans ahead, taking into account the information gained by each choice and making choices that maximize long-term payoffs. In contrast, the Naïve Reinforcement Learning (RL) model instantiates the reflexive account of choice, in which the values of actions are based only on the rewards experienced so far. Its beliefs are updated reflexively in response to observed changes in rewards. Converging with standard analyses, Met carriers were best characterized by the Ideal Actor model, whereas Val/Val homozygotes were best characterized by the Naive RL model, particularly under dual-task conditions. PMID:26004676

Texting while driving as impulsive choice: A behavioral economic analysis.

PubMed

Hayashi, Yusuke; Russo, Christopher T; Wirth, Oliver

2015-10-01

The goal of the present study was to examine the utility of a behavioral economic analysis to investigate the role of delay discounting in texting while driving. A sample of 147 college students completed a survey to assess how frequently they send and read text messages while driving. Based on this information, students were assigned to one of two groups: 19 students who frequently text while driving and 19 matched-control students who infrequently text while driving but were similar in gender, age, years of education, and years driving. The groups were compared on the extent to which they discounted, or devalued, delayed hypothetical monetary rewards using a delay-discounting task. In this task, students made repeated choices between $1000 available after a delay (ranging from 1 week to 10 years) and an equal or lesser amount of money available immediately. The results show that the students who frequently text while driving discounted delayed rewards at a greater rate than the matched control students. The study supports the conclusions that texting while driving is fundamentally an impulsive choice made by drivers, and that a behavioral economic approach may be a useful research tool for investigating the decision-making processes underlying risky behaviors. Copyright © 2015 Elsevier Ltd. All rights reserved.

Keeping up with the Joneses: Interpersonal Prediction Errors and the Correlation of Behavior in a Tandem Sequential Choice Task

PubMed Central

Apple, Nathan; Montague, P. Read

2013-01-01

In many settings, copying, learning from or assigning value to group behavior is rational because such behavior can often act as a proxy for valuable returns. However, such herd behavior can also be pathologically misleading by coaxing individuals into behaviors that are otherwise irrational and it may be one source of the irrational behaviors underlying market bubbles and crashes. Using a two-person tandem investment game, we sought to examine the neural and behavioral responses of herd instincts in situations stripped of the incentive to be influenced by the choices of one's partner. We show that the investments of the two subjects correlate over time if they are made aware of their partner's choices even though these choices have no impact on either player's earnings. We computed an “interpersonal prediction error”, the difference between the investment decisions of the two subjects after each choice. BOLD responses in the striatum, implicated in valuation and action selection, were highly correlated with this interpersonal prediction error. The revelation of the partner's investment occurred after all useful information about the market had already been revealed. This effect was confirmed in two separate experiments where the impact of the time of revelation of the partner's choice was tested at 2 seconds and 6 seconds after a subject's choice; however, the effect was absent in a control condition with a computer partner. These findings strongly support the existence of mechanisms that drive correlated behavior even in contexts where there is no explicit advantage to do so. PMID:24204226

Hyperactivity in boys with attention deficit/hyperactivity disorder (ADHD): the association between deficient behavioral inhibition, attentional processes, and objectively measured activity.

PubMed

Alderson, R Matt; Rapport, Mark D; Kasper, Lisa J; Sarver, Dustin E; Kofler, Michael J

2012-01-01

Contemporary models of ADHD hypothesize that hyperactivity reflects a byproduct of inhibition deficits. The current study investigated the relationship between children's motor activity and behavioral inhibition by experimentally manipulating demands placed on the limited-resource inhibition system. Twenty-two boys (ADHD = 11, TD = 11) between the ages of 8 and 12 years completed a conventional stop-signal task, two choice-task variants (no-tone, ignore-tone), and control tasks while their motor activity was measured objectively by actigraphs placed on their nondominant wrist and ankles. All children exhibited significantly higher activity rates under all three experimental tasks relative to control conditions, and children with ADHD moved significantly more than typically developing children across conditions. No differences in activity level were observed between the inhibition and noninhibition experimental tasks for either group, indicating that activity level was primarily associated with basic attentional rather than behavioral inhibition processes.

Learning Enhances Sensory and Multiple Non-sensory Representations in Primary Visual Cortex

PubMed Central

Poort, Jasper; Khan, Adil G.; Pachitariu, Marius; Nemri, Abdellatif; Orsolic, Ivana; Krupic, Julija; Bauza, Marius; Sahani, Maneesh; Keller, Georg B.; Mrsic-Flogel, Thomas D.; Hofer, Sonja B.

2015-01-01

Summary We determined how learning modifies neural representations in primary visual cortex (V1) during acquisition of a visually guided behavioral task. We imaged the activity of the same layer 2/3 neuronal populations as mice learned to discriminate two visual patterns while running through a virtual corridor, where one pattern was rewarded. Improvements in behavioral performance were closely associated with increasingly distinguishable population-level representations of task-relevant stimuli, as a result of stabilization of existing and recruitment of new neurons selective for these stimuli. These effects correlated with the appearance of multiple task-dependent signals during learning: those that increased neuronal selectivity across the population when expert animals engaged in the task, and those reflecting anticipation or behavioral choices specifically in neuronal subsets preferring the rewarded stimulus. Therefore, learning engages diverse mechanisms that modify sensory and non-sensory representations in V1 to adjust its processing to task requirements and the behavioral relevance of visual stimuli. PMID:26051421

Individual differences in impulsive action and dopamine transporter function in rat orbitofrontal cortex.

PubMed

Yates, J R; Darna, M; Beckmann, J S; Dwoskin, L P; Bardo, M T

2016-01-28

Impulsivity, which can be subdivided into impulsive action and impulsive choice, is implicated as a factor underlying drug abuse vulnerability. Although previous research has shown that dopamine (DA) systems in prefrontal cortex are involved in impulsivity and substance abuse, it is not known if inherent variation in DA transporter (DAT) function contributes to impulsivity. The current study determined if individual differences in either impulsive action or impulsive choice are related to DAT function in orbitofrontal (OFC) and/or medial prefrontal cortex (mPFC). Rats were first tested both for impulsive action in a cued go/no-go task and for impulsive choice in a delay-discounting task. Following behavioral evaluation, in vitro [(3)H]DA uptake assays were performed in OFC and mPFC isolated from individual rats. Vmax in OFC, but not mPFC, was correlated with performance in the cued go/no-go task, with decreased OFC DAT function being associated with high impulsive action. In contrast, Vmax in OFC and mPFC was not correlated with performance in the delay-discounting task. The current results demonstrate that impulsive behavior in cued go/no-go performance is associated with decreased DAT function in OFC, suggesting that hyperdopaminergic tone in this prefrontal subregion mediates, at least in part, increased impulsive action. Copyright © 2015 IBRO. Published by Elsevier Ltd. All rights reserved.

Perceptual decision related activity in the lateral geniculate nucleus

PubMed Central

Jiang, Yaoguang; Yampolsky, Dmitry; Purushothaman, Gopathy

2015-01-01

Fundamental to neuroscience is the understanding of how the language of neurons relates to behavior. In the lateral geniculate nucleus (LGN), cells show distinct properties such as selectivity for particular wavelengths, increments or decrements in contrast, or preference for fine detail versus rapid motion. No studies, however, have measured how LGN cells respond when an animal is challenged to make a perceptual decision using information within the receptive fields of those LGN cells. In this study we measured neural activity in the macaque LGN during a two-alternative, forced-choice (2AFC) contrast detection task or during a passive fixation task and found that a small proportion (13.5%) of single LGN parvocellular (P) and magnocellular (M) neurons matched the psychophysical performance of the monkey. The majority of LGN neurons measured in both tasks were not as sensitive as the monkey. The covariation between neural response and behavior (quantified as choice probability) was significantly above chance during active detection, even when there was no external stimulus. Interneuronal correlations and task-related gain modulations were negligible under the same condition. A bottom-up pooling model that used sensory neural responses to compute perceptual choices in the absence of interneuronal correlations could fully explain these results at the level of the LGN, supporting the hypothesis that the perceptual decision pool consists of multiple sensory neurons and that response fluctuations in these neurons can influence perception. PMID:26019309

Economic rationality in choosing between short-term bad-health choices and longer-term good-health choices.

PubMed

Campbell, David

2013-11-08

Non-contagious, chronic disease has been identified as a global health risk. Poor lifestyle choices, such as smoking, alcohol, drug and solvent abuse, physical inactivity, and unhealthy diet have been identified as important factors affecting the increasing incidence of chronic disease. The following focuses on the circumstance affecting the lifestyle or behavioral choices of Aboriginal and Torres Strait Islander peoples in remote-/very remote Australia. Poor behavioral choices are the result of endogenous characteristics that are influenced by a range of stressful exogenous variables making up the psychosocial determinants including social disenfranchisement, cultural loss, insurmountable tasks, the loss of volitional control and resource constraints. It is shown that poor behavioral choices can be economically rational; especially under highly stressful conditions. Stressful circumstances erode individual capacity to commit to long-term positive health alternatives such as self-investment in education. Policies directed at removing the impediments and providing incentives to behaviors involving better health choices can lead to reductions in smoking and alcohol consumption and improved health outcomes. Multijurisdictional culturally acceptable policies directed at distal variables relating to the psychosocial determinants of health and personal mastery and control can be cost effective. While the content of this paper is focused on the conditions of colonized peoples, it has broader relevance.

Modeling Search Behaviors during the Acquisition of Expertise in a Sequential Decision-Making Task.

PubMed

Moënne-Loccoz, Cristóbal; Vergara, Rodrigo C; López, Vladimir; Mery, Domingo; Cosmelli, Diego

2017-01-01

Our daily interaction with the world is plagued of situations in which we develop expertise through self-motivated repetition of the same task. In many of these interactions, and especially when dealing with computer and machine interfaces, we must deal with sequences of decisions and actions. For instance, when drawing cash from an ATM machine, choices are presented in a step-by-step fashion and a specific sequence of choices must be performed in order to produce the expected outcome. But, as we become experts in the use of such interfaces, is it possible to identify specific search and learning strategies? And if so, can we use this information to predict future actions? In addition to better understanding the cognitive processes underlying sequential decision making, this could allow building adaptive interfaces that can facilitate interaction at different moments of the learning curve. Here we tackle the question of modeling sequential decision-making behavior in a simple human-computer interface that instantiates a 4-level binary decision tree (BDT) task. We record behavioral data from voluntary participants while they attempt to solve the task. Using a Hidden Markov Model-based approach that capitalizes on the hierarchical structure of behavior, we then model their performance during the interaction. Our results show that partitioning the problem space into a small set of hierarchically related stereotyped strategies can potentially capture a host of individual decision making policies. This allows us to follow how participants learn and develop expertise in the use of the interface. Moreover, using a Mixture of Experts based on these stereotyped strategies, the model is able to predict the behavior of participants that master the task.

Changing how I feel about the food: experimentally manipulated affective associations with fruits change fruit choice behaviors.

PubMed

Walsh, Erin M; Kiviniemi, Marc T

2014-04-01

Fewer than half of Americans meet current recommendations for fruit and vegetable intake. The behavioral affective associations model posits that feelings and emotions associated with a behavior are a proximal influence on decision making. Cross-sectional evidence supports the model and suggests that affective associations predict fruit and vegetable consumption. The purpose of this study was to test whether a causal relation exists between affective associations about fruits and future fruit consumption behavior, as measured by a snack selection task. Following a baseline assessment of cognitive and affective variables, participants' (N = 161) affective associations about fruits were experimentally manipulated with an implicit priming paradigm. Images of fruits were repeatedly paired with positive, negative, or neutral affective stimuli. The key outcome measure was a behavioral choice task in which participants chose between fruit and a granola bar. Participants in the positive prime condition were three times more likely than those in the negative condition to select a piece of fruit over the granola bar alternative in the snack selection task. They were also twice as likely as those in the neutral condition to select fruit. There were no changes in self-reported affective associations or cognitive beliefs. These findings provide further evidence of the implicit and direct influence of affective associations on behavior, suggesting the need to both incorporate the role of affect in health decision making models, as well as the potential utility of intervention strategies targeting affective associations with health-related behaviors.

Changing how I feel about the food: experimentally manipulated affective associations with fruits change fruit choice behaviors

PubMed Central

Kiviniemi, Marc T.

2013-01-01

Fewer than half of Americans meet current recommendations for fruit and vegetable intake. The behavioral affective associations model posits that feelings and emotions associated with a behavior are a proximal influence on decision making. Cross-sectional evidence supports the model and suggests that affective associations predict fruit and vegetable consumption. The purpose of this study was to test whether a causal relation exists between affective associations about fruits and future fruit consumption behavior, as measured by a snack selection task. Following a baseline assessment of cognitive and affective variables, participants’ (N = 161) affective associations about fruits were experimentally manipulated with an implicit priming paradigm. Images of fruits were repeatedly paired with positive, negative, or neutral affective stimuli. The key outcome measure was a behavioral choice task in which participants chose between fruit and a granola bar. Participants in the positive prime condition were three times more likely than those in the negative condition to select a piece of fruit over the granola bar alternative in the snack selection task. They were also twice as likely as those in the neutral condition to select fruit. There were no changes in self-reported affective associations or cognitive beliefs. These findings provide further evidence of the implicit and direct influence of affective associations on behavior, suggesting the need to both incorporate the role of affect in health decision making models, as well as the potential utility of intervention strategies targeting affective associations with health-related behaviors. PMID:23299831

Functional double dissociation within the entorhinal cortex for visual scene-dependent choice behavior

PubMed Central

Yoo, Seung-Woo; Lee, Inah

2017-01-01

How visual scene memory is processed differentially by the upstream structures of the hippocampus is largely unknown. We sought to dissociate functionally the lateral and medial subdivisions of the entorhinal cortex (LEC and MEC, respectively) in visual scene-dependent tasks by temporarily inactivating the LEC and MEC in the same rat. When the rat made spatial choices in a T-maze using visual scenes displayed on LCD screens, the inactivation of the MEC but not the LEC produced severe deficits in performance. However, when the task required the animal to push a jar or to dig in the sand in the jar using the same scene stimuli, the LEC but not the MEC became important. Our findings suggest that the entorhinal cortex is critical for scene-dependent mnemonic behavior, and the response modality may interact with a sensory modality to determine the involvement of the LEC and MEC in scene-based memory tasks. DOI: http://dx.doi.org/10.7554/eLife.21543.001 PMID:28169828

The adenosine A2A antagonist MSX-3 reverses the effects of the dopamine antagonist haloperidol on effort-related decision making in a T-maze cost/benefit procedure

PubMed Central

Mott, Allison M.; Nunes, Eric J.; Collins, Lyndsey E.; Port, Russell G.; Sink, Kelly S.; Hockemeyer, Jörg; Müller, Christa E.

2010-01-01

Rationale Mesolimbic dopamine (DA) is a critical component of the brain circuitry regulating behavioral activation and effort-related processes. Research involving choice tasks has shown that rats with impaired DA transmission reallocate their instrumental behavior away from food-reinforced tasks with high response requirements and instead select less effortful food-seeking behaviors. Objective Previous work showed that adenosine A2A antagonism can reverse the effects of the DA antagonist haloperidol in an operant task that assesses effort-related choice. The present work used a T-maze choice procedure to assess the effects of adenosine A2A and A1 antagonism. Materials and methods With this task, the two arms of the maze have different reinforcement densities (four vs. two food pellets), and a vertical 44 cm barrier is positioned in the arm with the higher density, presenting the animal with an effort-related challenge. Untreated rats strongly prefer the arm with the high density of food reward and climb the barrier in order to obtain the food. Results Haloperidol produced a dose-related (0.05–0.15 mg/kg i.p.) reduction in the number of trials in which the rats chose the high-barrier arm. Co-administration of the adenosine A2A receptor antagonist MSX-3 (0.75, 1.5, and 3.0 mg/kg i.p.), but not the A1 antagonist 8-cyclopentyl-1,3-dipropylxanthine (0.75, 1.5, and 3.0 mg/kg i.p.), reversed the effects of haloperidol on effort-related choice and latency. Conclusions Adenosine A2A and D2 receptors interact to regulate effort-related decision making, which may have implications for the treatment of psychiatric symptoms such as psychomotor slowing or anergia that can be observed in depression, parkinsonism, and other disorders. PMID:19132351

The adenosine A2A antagonist MSX-3 reverses the effects of the dopamine antagonist haloperidol on effort-related decision making in a T-maze cost/benefit procedure.

PubMed

Mott, Allison M; Nunes, Eric J; Collins, Lyndsey E; Port, Russell G; Sink, Kelly S; Hockemeyer, Jörg; Müller, Christa E; Salamone, John D

2009-05-01

Mesolimbic dopamine (DA) is a critical component of the brain circuitry regulating behavioral activation and effort-related processes. Research involving choice tasks has shown that rats with impaired DA transmission reallocate their instrumental behavior away from food-reinforced tasks with high response requirements and instead select less effortful food-seeking behaviors. Previous work showed that adenosine A(2A) antagonism can reverse the effects of the DA antagonist haloperidol in an operant task that assesses effort-related choice. The present work used a T-maze choice procedure to assess the effects of adenosine A(2A) and A(1) antagonism. With this task, the two arms of the maze have different reinforcement densities (four vs. two food pellets), and a vertical 44 cm barrier is positioned in the arm with the higher density, presenting the animal with an effort-related challenge. Untreated rats strongly prefer the arm with the high density of food reward and climb the barrier in order to obtain the food. Haloperidol produced a dose-related (0.05-0.15 mg/kg i.p.) reduction in the number of trials in which the rats chose the high-barrier arm. Co-administration of the adenosine A(2A) receptor antagonist MSX-3 (0.75, 1.5, and 3.0 mg/kg i.p.), but not the A(1) antagonist 8-cyclopentyl-1,3-dipropylxanthine (0.75, 1.5, and 3.0 mg/kg i.p.), reversed the effects of haloperidol on effort-related choice and latency. Adenosine A(2A) and D2 receptors interact to regulate effort-related decision making, which may have implications for the treatment of psychiatric symptoms such as psychomotor slowing or anergia that can be observed in depression, parkinsonism, and other disorders.

The Relationship between Observed Task Characteristics and the Pattern of Seventh Grade Students' Situational Engagement during a Science Unit

NASA Astrophysics Data System (ADS)

Glassman, Sarah J.

Student engagement is an important aspect of teaching and learning. Traditionally, engagement has been measured as a static trait. This study measured engagement as a fluid trait in order to explore the relationship between seventh grade students' situational engagement over a science unit and five specific task characteristics. Further, this study investigated how the changing pattern of instruction is related to a changing pattern of student engagement. Informed by Self-Determination Theory, the five specific task characteristics investigated were: the use of tasks that give students opportunities to act autonomously (choice), the use of tasks that challenge students (challenge), constructive feedback from the teacher or peers that guides students work on the current task (feedback), the inclusion of tasks that require student collaboration (collaboration), and tasks in which the importance or relevance is explained to students or the task includes a real-world problem or scenario (real-life significance). Student engagement was measured as a multidimensional trait consisting of behavioral, emotional, and cognitive dimensions. Participants included two teachers and 37 students. Two classrooms were observed and video-recorded for 10 consecutive 1.5 hour blocks during a unit investigating cells. At the end of each block students completed a three item survey for each task. For all tasks in both classrooms, the cumulative presence of task characteristics correlated with student engagement. However, students' behavioral engagement negatively correlated with the use of choice. Students' engagement increased from low to high during four related tasks exhibiting the highest cumulative presence of task characteristics. Nine out of 10 tasks with the highest student engagement involved hands-on learning. However, students' engagement was lower during tasks elaborating on those hands-on tasks.

Observations of Children’s Interactions with Teachers, Peers, and Tasks across Preschool Classroom Activity Settings

PubMed Central

Booren, Leslie M.; Downer, Jason T.; Vitiello, Virginia E.

2014-01-01

This descriptive study examined classroom activity settings in relation to children’s observed behavior during classroom interactions, child gender, and basic teacher behavior within the preschool classroom. 145 children were observed for an average of 80 minutes during 8 occasions across 2 days using the inCLASS, an observational measure that conceptualizes behavior into teacher, peer, task, and conflict interactions. Findings indicated that on average children’s interactions with teachers were higher in teacher-structured settings, such as large group. On average, children’s interactions with peers and tasks were more positive in child-directed settings, such as free choice. Children experienced more conflict during recess and routines/transitions. Finally, gender differences were observed within small group and meals. The implications of these findings might encourage teachers to be thoughtful and intentional about what types of support and resources are provided so children can successfully navigate the demands of particular settings. These findings are not meant to discourage certain teacher behaviors or imply value of certain classroom settings; instead, by providing an evidenced-based picture of the conditions under which children display the most positive interactions, teachers can be more aware of choices within these settings and have a powerful way to assist in professional development and interventions. PMID:25717282

Observations of Children's Interactions with Teachers, Peers, and Tasks across Preschool Classroom Activity Settings.

PubMed

Booren, Leslie M; Downer, Jason T; Vitiello, Virginia E

2012-07-01

This descriptive study examined classroom activity settings in relation to children's observed behavior during classroom interactions, child gender, and basic teacher behavior within the preschool classroom. 145 children were observed for an average of 80 minutes during 8 occasions across 2 days using the inCLASS, an observational measure that conceptualizes behavior into teacher, peer, task, and conflict interactions. Findings indicated that on average children's interactions with teachers were higher in teacher-structured settings, such as large group. On average, children's interactions with peers and tasks were more positive in child-directed settings, such as free choice. Children experienced more conflict during recess and routines/transitions. Finally, gender differences were observed within small group and meals. The implications of these findings might encourage teachers to be thoughtful and intentional about what types of support and resources are provided so children can successfully navigate the demands of particular settings. These findings are not meant to discourage certain teacher behaviors or imply value of certain classroom settings; instead, by providing an evidenced-based picture of the conditions under which children display the most positive interactions, teachers can be more aware of choices within these settings and have a powerful way to assist in professional development and interventions.

Math-Related Career Aspirations and Choices within Eccles Et Al.'s Expectancy--Value Theory of Achievement-Related Behaviors

ERIC Educational Resources Information Center

Lauermann, Fani; Tsai, Yi-Miau; Eccles, Jacquelynne S.

2017-01-01

Which occupation to pursue is one of the more consequential decisions people make and represents a key developmental task. Yet the underlying developmental processes associated with either individual or group differences in occupational choices are still not well understood. This study contributes toward filling this gap, focusing in particular on…

Does the Superior Colliculus Control Perceptual Sensitivity or Choice Bias during Attention? Evidence from a Multialternative Decision Framework

PubMed Central

Steinmetz, Nicholas A.; Moore, Tirin; Knudsen, Eric I.

2017-01-01

Distinct networks in the forebrain and the midbrain coordinate to control spatial attention. The critical involvement of the superior colliculus (SC)—the central structure in the midbrain network—in visuospatial attention has been shown by four seminal, published studies in monkeys (Macaca mulatta) performing multialternative tasks. However, due to the lack of a mechanistic framework for interpreting behavioral data in such tasks, the nature of the SC's contribution to attention remains unclear. Here we present and validate a novel decision framework for analyzing behavioral data in multialternative attention tasks. We apply this framework to re-examine the behavioral evidence from these published studies. Our model is a multidimensional extension to signal detection theory that distinguishes between two major classes of attentional mechanisms: those that alter the quality of sensory information or “sensitivity,” and those that alter the selective gating of sensory information or “choice bias.” Model-based simulations and model-based analyses of data from these published studies revealed a converging pattern of results that indicated that choice-bias changes, rather than sensitivity changes, were the primary outcome of SC manipulation. Our results suggest that the SC contributes to attentional performance predominantly by generating a spatial choice bias for stimuli at a selected location, and that this bias operates downstream of forebrain mechanisms that enhance sensitivity. The findings lead to a testable mechanistic framework of how the midbrain and forebrain networks interact to control spatial attention. SIGNIFICANCE STATEMENT Attention involves the selection of the most relevant information for differential sensory processing and decision making. While the mechanisms by which attention alters sensory encoding (sensitivity control) are well studied, the mechanisms by which attention alters decisional weighting of sensory evidence (choice-bias control) are poorly understood. Here, we introduce a model of multialternative decision making that distinguishes bias from sensitivity effects in attention tasks. With our model, we simulate experimental data from four seminal studies that microstimulated or inactivated a key attention-related midbrain structure, the superior colliculus (SC). We demonstrate that the experimental effects of SC manipulation are entirely consistent with the SC controlling attention by changing choice bias, thereby shedding new light on how the brain mediates attention. PMID:28100734

Does the Superior Colliculus Control Perceptual Sensitivity or Choice Bias during Attention? Evidence from a Multialternative Decision Framework.

PubMed

Sridharan, Devarajan; Steinmetz, Nicholas A; Moore, Tirin; Knudsen, Eric I

2017-01-18

Distinct networks in the forebrain and the midbrain coordinate to control spatial attention. The critical involvement of the superior colliculus (SC)-the central structure in the midbrain network-in visuospatial attention has been shown by four seminal, published studies in monkeys (Macaca mulatta) performing multialternative tasks. However, due to the lack of a mechanistic framework for interpreting behavioral data in such tasks, the nature of the SC's contribution to attention remains unclear. Here we present and validate a novel decision framework for analyzing behavioral data in multialternative attention tasks. We apply this framework to re-examine the behavioral evidence from these published studies. Our model is a multidimensional extension to signal detection theory that distinguishes between two major classes of attentional mechanisms: those that alter the quality of sensory information or "sensitivity," and those that alter the selective gating of sensory information or "choice bias." Model-based simulations and model-based analyses of data from these published studies revealed a converging pattern of results that indicated that choice-bias changes, rather than sensitivity changes, were the primary outcome of SC manipulation. Our results suggest that the SC contributes to attentional performance predominantly by generating a spatial choice bias for stimuli at a selected location, and that this bias operates downstream of forebrain mechanisms that enhance sensitivity. The findings lead to a testable mechanistic framework of how the midbrain and forebrain networks interact to control spatial attention. Attention involves the selection of the most relevant information for differential sensory processing and decision making. While the mechanisms by which attention alters sensory encoding (sensitivity control) are well studied, the mechanisms by which attention alters decisional weighting of sensory evidence (choice-bias control) are poorly understood. Here, we introduce a model of multialternative decision making that distinguishes bias from sensitivity effects in attention tasks. With our model, we simulate experimental data from four seminal studies that microstimulated or inactivated a key attention-related midbrain structure, the superior colliculus (SC). We demonstrate that the experimental effects of SC manipulation are entirely consistent with the SC controlling attention by changing choice bias, thereby shedding new light on how the brain mediates attention. Copyright © 2017 the authors 0270-6474/17/370480-32$15.00/0.

Psychological and physiological correlates of stress: Performance on a cooperative task

NASA Technical Reports Server (NTRS)

Roessler, R.; Lester, J.; Knapp, T.

1976-01-01

The relationship of personality dimensions to performance was investigated. The personality measure used to select subjects, the Barratt impulsiveness scale, is hypothesized to be related to a style of behavior which should affect the trend of choices which various subjects will make. Personality dimensions were specifically examined during performance of a cooperative task, the Prisoner's Dilemma.

Exploring the repetition bias in voluntary task switching.

PubMed

Mittelstädt, Victor; Dignath, David; Schmidt-Ott, Magdalena; Kiesel, Andrea

2018-01-01

In the voluntary task-switching paradigm, participants are required to randomly select tasks. We reasoned that the consistent finding of a repetition bias (i.e., participants repeat tasks more often than expected by chance) reflects reasonable adaptive task selection behavior to balance the goal of random task selection with the goals to minimize the time and effort for task performance. We conducted two experiments in which participants were provided with variable amount of preview for the non-chosen task stimuli (i.e., potential switch stimuli). We assumed that switch stimuli would initiate some pre-processing resulting in improved performance in switch trials. Results showed that reduced switch costs due to extra-preview in advance of each trial were accompanied by more task switches. This finding is in line with the characteristics of rational adaptive behavior. However, participants were not biased to switch tasks more often than chance despite large switch benefits. We suggest that participants might avoid effortful additional control processes that modulate the effects of preview on task performance and task choice.

The Effects of Condom Availability on College Women's Sexual Discounting.

PubMed

Lemley, Shea M; Jarmolowicz, David P; Parkhurst, Daniel; Celio, Mark A

2018-04-01

College students commonly engage in risky sexual behaviors, such as casual sexual encounters and inconsistent condom use. Discounting paradigms that examine how individuals devalue rewards due to their delay or uncertainty have been used to improve our understanding of behavioral problems, including sexual risk. The current study assessed relations between college women's sexual partners discounting and risky sexual behavior. In this study, college women (N = 42) completed two sexual partners delay discounting tasks that assessed how choices among hypothetical sexual partners changed across a parametric range of delays in two conditions: condom availability and condom unavailability. Participants also completed two sexual partners probability discounting tasks that assessed partner choices across a parametric range of probabilities in condom availability and unavailability conditions. Additionally, participants reported risky sexual behavior on the Sexual Risk Survey (SRS). Participants discounted delayed partners more steeply in the condom availability condition, but those differences were significant only for those women with three or fewer lifetime sexual partners. There were no consistent differences in discounting rate across condom availability conditions for probability discounting. Sexual partners discounting measures correlated with risky sexual behaviors as measured by the SRS, but a greater number of significant relations were observed with the condoms-unavailable delay discounting task. These findings suggest the importance of examining the interaction of inconsistent condom use and multiple partners in examinations of sexual decision-making.

Using SHRP 2 naturalistic driving data to assess drivers' speed choice while being engaged in different secondary tasks.

PubMed

Schneidereit, Tina; Petzoldt, Tibor; Keinath, Andreas; Krems, Josef F

2017-09-01

The engagement in secondary tasks while driving has been found to result in considerable impairments of driving performance. Texting has especially been suspected to be associated with an increased crash risk. At the same time, there is evidence that drivers use various self-regulating strategies to compensate for the increased demands caused by secondary task engagement. One of the findings reported from multiple studies is a reduction in driving speed. However, most of these studies are of experimental nature and do not let the drivers decide for themselves to (not) engage in the secondary task, and therefore, eliminate other strategies of self-regulation (e.g., postponing the task). The goal of the present analysis was to investigate if secondary task engagement results in speed adjustment also under naturalistic conditions. Our analysis relied on data of the SHRP 2 naturalistic driving study. To minimize the influence of potentially confounding factors on drivers' speed choice, we focused on episodes of free flow driving on interstates/highways. Driving speed was analyzed before, during, and after texting, smoking, eating, and adjusting/monitoring radio or climate control; in a total of 403 episodes. Data show some indication for speed adjustment for texting, especially when driving with high speed. However, the effect sizes were small and behavioral patterns varied considerably between drivers. The engagement in the other tasks did not influence drivers' speed behavior significantly. While drivers might indeed reduce speed slightly to accommodate for secondary task engagement, other forms of adaptation (e.g., strategic decisions) might play a more important role in a natural driving environment. The use of naturalistic driving data to study drivers' self-regulatory behavior at an operational level has proven to be promising. Still, in order to obtain a comprehensive understanding about drivers' self-regulatory behavior, a mixed-method approach is required. Copyright © 2017 National Safety Council and Elsevier Ltd. All rights reserved.

Hold it! The influence of lingering rewards on choice diversification and persistence.

PubMed

Schulze, Christin; van Ravenzwaaij, Don; Newell, Ben R

2017-11-01

Learning to choose adaptively when faced with uncertain and variable outcomes is a central challenge for decision makers. This study examines repeated choice in dynamic probability learning tasks in which outcome probabilities changed either as a function of the choices participants made or independently of those choices. This presence/absence of sequential choice-outcome dependencies was implemented by manipulating a single task aspect between conditions: the retention/withdrawal of reward across individual choice trials. The study addresses how people adapt to these learning environments and to what extent they engage in 2 choice strategies often contrasted as paradigmatic examples of striking violation of versus nominal adherence to rational choice: diversification and persistent probability maximizing, respectively. Results show that decisions approached adaptive choice diversification and persistence when sufficient feedback was provided on the dynamic rules of the probabilistic environments. The findings of divergent behavior in the 2 environments indicate that diversified choices represented a response to the reward retention manipulation rather than to the mere variability of outcome probabilities. Choice in both environments was well accounted for by the generalized matching law, and computational modeling-based strategy analyses indicated that adaptive choice arose mainly from reliance on reinforcement learning strategies. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Dopamine D3 Receptors Modulate the Ability of Win-Paired Cues to Increase Risky Choice in a Rat Gambling Task.

PubMed

Barrus, Michael M; Winstanley, Catharine A

2016-01-20

Similar to other addiction disorders, the cues inherent in many gambling procedures are thought to play an important role in mediating their addictive nature. Animal models of gambling-related behavior, while capturing dimensions of economic decision making, have yet to address the impact that these salient cues may have in promoting maladaptive choice. Here, we determined whether adding win-associated audiovisual cues to a rat gambling task (rGT) would influence decision making. Thirty-two male Long-Evans rats were tested on either the cued or uncued rGT. In these tasks, animals chose between four options associated with different magnitudes and frequencies of reward and punishing time-out periods. As in the Iowa Gambling Task, favoring options associated with smaller per-trial rewards but smaller losses and avoiding the tempting "high-risk, high-reward" decks maximized profits. Although the reinforcement contingencies were identical in both task versions, rats' choice of the disadvantageous risky options was significantly greater on the cued task. Furthermore, a D3 receptor agonist increased choice of the disadvantageous options, whereas a D3 antagonist had the opposite effects, only on the cued task. These findings are consistent with the reported role of D3 receptors in mediating the facilitatory effects of cues in addiction. Collectively, these results indicate that the cued rGT is a valuable model with which to study the mechanism by which salient cues can invigorate maladaptive decision making, an important and understudied component of both gambling and substance use disorders. Significance statement: We used a rodent analog of the Iowa Gambling Task to determine whether the addition of audiovisual cues would affect choice preferences. Adding reward-concurrent cues significantly increased risky choice. This is the first clear demonstration that reward-paired cues can bias cost/benefit decision making against a subject's best interests in a manner concordant with elevated addiction susceptibility. Choice on the cued task was uniquely sensitive to modulation by D3 receptor ligands, yet these drugs did not alter decision making on the uncued task. The relatively unprecedented sensitivity of choice on the cued task to D3-receptor-mediated neurotransmission data suggest that similar neurobiological processes underlie the ability of cues to both bias animals toward risky options and facilitate drug addiction. Copyright © 2016 the authors 0270-6474/16/360785-10$15.00/0.

Definitions of homework, types of homework, and ratings of the importance of homework among psychologists with cognitive behavior therapy and psychoanalytic theoretical orientations.

PubMed

Kazantzis, Nikolaos; Dattilio, Frank M

2010-07-01

A random sample of 827 psychologists were surveyed to assess their definitions of homework, use of homework tasks, and perceived importance of homework. Theoretical orientation distinguished practitioners' responses. Cognitive-behavioral therapists defined homework as being closer to empirically supported therapy, whereas psychodynamic therapists rated homework as less characteristic of a process that embraces client responsibility and adaptive skills. Cognitive-behavior therapists did not limit their choices to activity-based tasks, and psychodynamic therapists reported using behavioral tasks "sometimes." Monitoring dreams and conscious thought were also used among the entire sample surveyed. Psychodynamic therapists rated homework as "somewhat" or "moderately" important, whereas cognitive-behavior therapists more often rated homework as "very important." Data suggest some homework may be common to different psychotherapeutic approaches. Findings are discussed in the context of recent theoretical work on homework in psychotherapy and recommendations for future research.

Automatic recording of mediating behavior in delayed matching- and nonmatching-to-position procedures in rats.

PubMed

Panlilio, Leigh V; Yasar, Sevil; Thorndike, Eric B; Goldberg, Steven R; Schindler, Charles W

2011-03-01

Delayed matching-to-position and nonmatching-to-position procedures are widely used to model working memory in rodents. Mediating behavior-which enhances performance but is not explicitly required by the task-is generally considered an obstacle to the measurement of memory, but often occurs despite attempts to prevent it. The ubiquitous nature of mediating behavior suggests it might be analogous to rehearsal, an important component of learning and memory in humans. The aim was to study an easily recordable, rehearsal-like mediating response in rats under baseline conditions and after treatment with amnestic drugs [scopolamine (0.1-0.3 mg/kg) and delta-9-tetrahydrocannabinol (THC; 1-5.6 mg/kg)]. Lighted nosepoke holes were used to present position cues and record delayed matching or nonmatching responses. Performance of a distractor task was required to prevent simply waiting at the correct choice, but the nosepoke holes were left accessible during the delay. Each rat trained with the nonmatching task exhibited one of two mediating "strategies" that increased the odds of a correct choice: responding in the to-be-correct hole during the delay or responding in the opposite hole during the delay. Rats trained with the matching task all showed the former strategy. Treatment with scopolamine disrupted performance of the mediating response. Scopolamine and THC both decreased the effectiveness of the mediating response, increasing errors even on trials when the "appropriate" mediating behavior did occur. The procedures and data analysis approach used here provide an objective, automated means of measuring mediating behavior, which might be useful as an animal model of memory rehearsal.

Procedures for Behavioral Experiments in Head-Fixed Mice

PubMed Central

Guo, Zengcai V.; Hires, S. Andrew; Li, Nuo; O'Connor, Daniel H.; Komiyama, Takaki; Ophir, Eran; Huber, Daniel; Bonardi, Claudia; Morandell, Karin; Gutnisky, Diego; Peron, Simon; Xu, Ning-long; Cox, James; Svoboda, Karel

2014-01-01

The mouse is an increasingly prominent model for the analysis of mammalian neuronal circuits. Neural circuits ultimately have to be probed during behaviors that engage the circuits. Linking circuit dynamics to behavior requires precise control of sensory stimuli and measurement of body movements. Head-fixation has been used for behavioral research, particularly in non-human primates, to facilitate precise stimulus control, behavioral monitoring and neural recording. However, choice-based, perceptual decision tasks by head-fixed mice have only recently been introduced. Training mice relies on motivating mice using water restriction. Here we describe procedures for head-fixation, water restriction and behavioral training for head-fixed mice, with a focus on active, whisker-based tactile behaviors. In these experiments mice had restricted access to water (typically 1 ml/day). After ten days of water restriction, body weight stabilized at approximately 80% of initial weight. At that point mice were trained to discriminate sensory stimuli using operant conditioning. Head-fixed mice reported stimuli by licking in go/no-go tasks and also using a forced choice paradigm using a dual lickport. In some cases mice learned to discriminate sensory stimuli in a few trials within the first behavioral session. Delay epochs lasting a second or more were used to separate sensation (e.g. tactile exploration) and action (i.e. licking). Mice performed a variety of perceptual decision tasks with high performance for hundreds of trials per behavioral session. Up to four months of continuous water restriction showed no adverse health effects. Behavioral performance correlated with the degree of water restriction, supporting the importance of controlling access to water. These behavioral paradigms can be combined with cellular resolution imaging, random access photostimulation, and whole cell recordings. PMID:24520413

The diffusion decision model: theory and data for two-choice decision tasks.

PubMed

Ratcliff, Roger; McKoon, Gail

2008-04-01

The diffusion decision model allows detailed explanations of behavior in two-choice discrimination tasks. In this article, the model is reviewed to show how it translates behavioral data-accuracy, mean response times, and response time distributions-into components of cognitive processing. Three experiments are used to illustrate experimental manipulations of three components: stimulus difficulty affects the quality of information on which a decision is based; instructions emphasizing either speed or accuracy affect the criterial amounts of information that a subject requires before initiating a response; and the relative proportions of the two stimuli affect biases in drift rate and starting point. The experiments also illustrate the strong constraints that ensure the model is empirically testable and potentially falsifiable. The broad range of applications of the model is also reviewed, including research in the domains of aging and neurophysiology.

Affective-motivational influences on feedback-related ERPs in a gambling task.

PubMed

Masaki, Hiroaki; Takeuchi, Shigeki; Gehring, William J; Takasawa, Noriyoshi; Yamazaki, Katuo

2006-08-11

Theories have proposed that both the stimulus-preceding negativity (SPN) and the medial frontal negativity (MFN) reflect affective/motivational processing. We examined the effect of the motivational impact of feedback stimuli on these ERPs using a simple gambling task, focusing on the influence of prior losses and gains on ERPs and choice behavior. Choices were riskier following large losses than following small losses or large gains. The MFN, however, was larger following larger gains. The SPN preceding the outcome was also larger after a greater gain. Thus, we confirmed that both the MFN and the SPN respond to the motivational properties of the feedback. A dissociation between risk-taking behavior and these ERPs suggests that there could be two monitoring systems: one that leads to riskier responses following losses and a second that leads to heightened expectancy.

Affective and cognitive mechanisms of risky decision making.

PubMed

Shimp, Kristy G; Mitchell, Marci R; Beas, B Sofia; Bizon, Jennifer L; Setlow, Barry

2015-01-01

The ability to make advantageous decisions under circumstances in which there is a risk of adverse consequences is an important component of adaptive behavior; however, extremes in risk taking (either high or low) can be maladaptive and are characteristic of a number of neuropsychiatric disorders. To better understand the contributions of various affective and cognitive factors to risky decision making, cohorts of male Long-Evans rats were trained in a "Risky Decision making Task" (RDT), in which they made discrete trial choices between a small, "safe" food reward and a large, "risky" food reward accompanied by varying probabilities of footshock. Experiment 1 evaluated the relative contributions of the affective stimuli (i.e., punishment vs. reward) to RDT performance by parametrically varying the magnitudes of the footshock and large reward. Varying the shock magnitude had a significant impact on choice of the large, "risky" reward, such that greater magnitudes were associated with reduced choice of the large reward. In contrast, varying the large, "risky" reward magnitude had minimal influence on reward choice. Experiment 2 compared individual variability in RDT performance with performance in an attentional set shifting task (assessing cognitive flexibility), a delayed response task (assessing working memory), and a delay discounting task (assessing impulsive choice). Rats characterized as risk averse in the RDT made more perseverative errors on the set shifting task than did their risk taking counterparts, whereas RDT performance was not related to working memory abilities or impulsive choice. In addition, rats that showed greater delay discounting (greater impulsive choice) showed corresponding poorer performance in the working memory task. Together, these results suggest that reward-related decision making under risk of punishment is more strongly influenced by the punishment than by the reward, and that risky and impulsive decision making are associated with distinct components of executive function. Copyright © 2014 Elsevier Inc. All rights reserved.

Functional disconnection of the orbitofrontal cortex and basolateral amygdala impairs acquisition of a rat gambling task and disrupts animals' ability to alter decision-making behavior after reinforcer devaluation.

PubMed

Zeeb, Fiona D; Winstanley, Catharine A

2013-04-10

An inability to adjust choice preferences in response to changes in reward value may underlie key symptoms of many psychiatric disorders, including chemical and behavioral addictions. We developed the rat gambling task (rGT) to investigate the neurobiology underlying complex decision-making processes. As in the Iowa Gambling task, the optimal strategy is to avoid choosing larger, riskier rewards and to instead favor options associated with smaller rewards but less loss and, ultimately, greater long-term gain. Given the demonstrated importance of the orbitofrontal cortex (OFC) and basolateral amygdala (BLA) in acquisition of the rGT and Iowa Gambling task, we used a contralateral disconnection lesion procedure to assess whether functional connectivity between these regions is necessary for optimal decision-making. Disrupting the OFC-BLA pathway retarded acquisition of the rGT. Devaluing the reinforcer by inducing sensory-specific satiety altered decision-making in control groups. In contrast, disconnected rats did not update their choice preference following reward devaluation, either when the devalued reward was still delivered or when animals needed to rely on stored representations of reward value (i.e., during extinction). However, all rats exhibited decreased premature responding and slower response latencies after satiety manipulations. Hence, disconnecting the OFC and BLA did not affect general behavioral changes caused by reduced motivation, but instead prevented alterations in the value of a specific reward from contributing appropriately to cost-benefit decision-making. These results highlight the role of the OFC-BLA pathway in the decision-making process and suggest that communication between these areas is vital for the appropriate assessment of reward value to influence choice.

Effects of acute administration of nicotinic and muscarinic cholinergic agonists and antagonists on performance in different cost–benefit decision making tasks in rats

PubMed Central

Mendez, Ian A.; Gilbert, Ryan J.; Bizon, Jennifer L.

2012-01-01

Rationale Alterations in cost–benefit decision making accompany numerous neuropsychiatric conditions, including schizophrenia, attention deficit hyperactivity disorder, and addiction. Central cholinergic systems have been linked to the etiology and/or treatment of many of these conditions, but little is known about the role of cholinergic signaling in cost–benefit decision making. Objectives The goal of these experiments was to determine how cholinergic signaling is involved in cost–benefit decision making, using a behavioral pharmacological approach. Methods Male Long-Evans rats were trained in either “probability discounting” or “delay discounting” tasks, in which rats made discrete-trial choices between a small food reward and a large food reward associated with either varying probabilities of omission or varying delays to delivery, respectively. The effects of acute administration of different doses of nicotinic and muscarinic acetylcholine receptor agonists and antagonists were assessed in each task. Results In the probability discounting task, acute nicotine administration (1.0 mg/kg) significantly increased choice of the large risky reward, and control experiments suggested that this was due to robust nicotine-induced impairments in behavioral flexibility. In the delay discounting task, the muscarinic antagonists scopolamine (0.03, 0.1, and 0.3 mg/kg) and atropine (0.3 mg/kg) both significantly increased choice of the small immediate reward. Neither mecamylamine nor oxotremorine produced reliable effects on either of the decision making tasks. Conclusions These data suggest that cholinergic receptors play multiple roles in decision making contexts which include consideration of reward delay or probability. These roles should be considered when targeting these receptors for therapeutic purposes. PMID:22760484

Effects of acute administration of nicotinic and muscarinic cholinergic agonists and antagonists on performance in different cost-benefit decision making tasks in rats.

PubMed

Mendez, Ian A; Gilbert, Ryan J; Bizon, Jennifer L; Setlow, Barry

2012-12-01

Alterations in cost-benefit decision making accompany numerous neuropsychiatric conditions, including schizophrenia, attention deficit hyperactivity disorder, and addiction. Central cholinergic systems have been linked to the etiology and/or treatment of many of these conditions, but little is known about the role of cholinergic signaling in cost-benefit decision making. The goal of these experiments was to determine how cholinergic signaling is involved in cost-benefit decision making, using a behavioral pharmacological approach. Male Long-Evans rats were trained in either "probability discounting" or "delay discounting" tasks, in which rats made discrete-trial choices between a small food reward and a large food reward associated with either varying probabilities of omission or varying delays to delivery, respectively. The effects of acute administration of different doses of nicotinic and muscarinic acetylcholine receptor agonists and antagonists were assessed in each task. In the probability discounting task, acute nicotine administration (1.0 mg/kg) significantly increased choice of the large risky reward, and control experiments suggested that this was due to robust nicotine-induced impairments in behavioral flexibility. In the delay discounting task, the muscarinic antagonists scopolamine (0.03, 0.1, and 0.3 mg/kg) and atropine (0.3 mg/kg) both significantly increased choice of the small immediate reward. Neither mecamylamine nor oxotremorine produced reliable effects on either of the decision making tasks. These data suggest that cholinergic receptors play multiple roles in decision making contexts which include consideration of reward delay or probability. These roles should be considered when targeting these receptors for therapeutic purposes.

Amygdala and Ventral Striatum Make Distinct Contributions to Reinforcement Learning.

PubMed

Costa, Vincent D; Dal Monte, Olga; Lucas, Daniel R; Murray, Elisabeth A; Averbeck, Bruno B

2016-10-19

Reinforcement learning (RL) theories posit that dopaminergic signals are integrated within the striatum to associate choices with outcomes. Often overlooked is that the amygdala also receives dopaminergic input and is involved in Pavlovian processes that influence choice behavior. To determine the relative contributions of the ventral striatum (VS) and amygdala to appetitive RL, we tested rhesus macaques with VS or amygdala lesions on deterministic and stochastic versions of a two-arm bandit reversal learning task. When learning was characterized with an RL model relative to controls, amygdala lesions caused general decreases in learning from positive feedback and choice consistency. By comparison, VS lesions only affected learning in the stochastic task. Moreover, the VS lesions hastened the monkeys' choice reaction times, which emphasized a speed-accuracy trade-off that accounted for errors in deterministic learning. These results update standard accounts of RL by emphasizing distinct contributions of the amygdala and VS to RL. Published by Elsevier Inc.

Amygdala and ventral striatum make distinct contributions to reinforcement learning

PubMed Central

Costa, Vincent D.; Monte, Olga Dal; Lucas, Daniel R.; Murray, Elisabeth A.; Averbeck, Bruno B.

2016-01-01

Summary Reinforcement learning (RL) theories posit that dopaminergic signals are integrated within the striatum to associate choices with outcomes. Often overlooked is that the amygdala also receives dopaminergic input and is involved in Pavlovian processes that influence choice behavior. To determine the relative contributions of the ventral striatum (VS) and amygdala to appetitive RL we tested rhesus macaques with VS or amygdala lesions on deterministic and stochastic versions of a two-arm bandit reversal learning task. When learning was characterized with a RL model relative to controls, amygdala lesions caused general decreases in learning from positive feedback and choice consistency. By comparison, VS lesions only affected learning in the stochastic task. Moreover, the VS lesions hastened the monkeys’ choice reaction times, which emphasized a speed-accuracy tradeoff that accounted for errors in deterministic learning. These results update standard accounts of RL by emphasizing distinct contributions of the amygdala and VS to RL. PMID:27720488

A Multiple-Choice Task with Changes of Mind

PubMed Central

Albantakis, Larissa; Branzi, Francesca M.; Costa, Albert; Deco, Gustavo

2012-01-01

The role of changes of mind and multiple choices has recently received increased attention in the study of perceptual decision-making. Previously, these extensions to standard two-alternative tasks have been studied separately. Here we explored how changes of mind depend on the number of choice-alternatives. To this end, we tested 14 human subjects on a 2- and 4-alternative direction-discrimination task. Changes of mind in the participants' movement trajectories could be observed for two and for four choice alternatives. With fewer alternatives, participants responded faster and more accurately. The frequency of changes of mind, however, did not significantly differ for the different numbers of choice alternatives. Nevertheless, mind-changing improved the participants' final performance, particularly for intermediate difficulty levels, in both experimental conditions. Moreover, the mean reaction times of individual participants were negatively correlated with their overall tendency to make changes of mind. We further reproduced these findings with a multi-alternative attractor model for decision-making, while a simple race model could not account for the experimental data. Our experiment, combined with the theoretical models allowed us to shed light on: (1) the differences in choice behavior between two and four alternatives, (2) the differences between the data of our human subjects and previous monkey data, (3) individual differences between participants, and (4) the inhibitory interaction between neural representations of choice alternatives. PMID:22916216

Dynamic Response-by-Response Models of Matching Behavior in Rhesus Monkeys

ERIC Educational Resources Information Center

Lau, Brian; Glimcher, Paul W.

2005-01-01

We studied the choice behavior of 2 monkeys in a discrete-trial task with reinforcement contingencies similar to those Herrnstein (1961) used when he described the matching law. In each session, the monkeys experienced blocks of discrete trials at different relative-reinforcer frequencies or magnitudes with unsignalled transitions between the…

Stress Impairs Optimal Behavior in a Water Foraging Choice Task in Rats

ERIC Educational Resources Information Center

Graham, Lauren K.; Yoon, Taejib; Kim, Jeansok J.

2010-01-01

Stress is a biologically significant social-environmental factor that plays a pervasive role in influencing human and animal behaviors. While stress effects on various types of memory are well characterized, its effects on other cognitive functions are relatively unknown. Here, we investigated the effects of acute, uncontrollable stress on…

Neural correlates of forward planning in a spatial decision task in humans

PubMed Central

Simon, Dylan Alexander; Daw, Nathaniel D.

2011-01-01

Although reinforcement learning (RL) theories have been influential in characterizing the brain’s mechanisms for reward-guided choice, the predominant temporal difference (TD) algorithm cannot explain many flexible or goal-directed actions that have been demonstrated behaviorally. We investigate such actions by contrasting an RL algorithm that is model-based, in that it relies on learning a map or model of the task and planning within it, to traditional model-free TD learning. To distinguish these approaches in humans, we used fMRI in a continuous spatial navigation task, in which frequent changes to the layout of the maze forced subjects continually to relearn their favored routes, thereby exposing the RL mechanisms employed. We sought evidence for the neural substrates of such mechanisms by comparing choice behavior and BOLD signals to decision variables extracted from simulations of either algorithm. Both choices and value-related BOLD signals in striatum, though most often associated with TD learning, were better explained by the model-based theory. Further, predecessor quantities for the model-based value computation were correlated with BOLD signals in the medial temporal lobe and frontal cortex. These results point to a significant extension of both the computational and anatomical substrates for RL in the brain. PMID:21471389

Devaluation and sequential decisions: linking goal-directed and model-based behavior

PubMed Central

Friedel, Eva; Koch, Stefan P.; Wendt, Jean; Heinz, Andreas; Deserno, Lorenz; Schlagenhauf, Florian

2014-01-01

In experimental psychology different experiments have been developed to assess goal–directed as compared to habitual control over instrumental decisions. Similar to animal studies selective devaluation procedures have been used. More recently sequential decision-making tasks have been designed to assess the degree of goal-directed vs. habitual choice behavior in terms of an influential computational theory of model-based compared to model-free behavioral control. As recently suggested, different measurements are thought to reflect the same construct. Yet, there has been no attempt to directly assess the construct validity of these different measurements. In the present study, we used a devaluation paradigm and a sequential decision-making task to address this question of construct validity in a sample of 18 healthy male human participants. Correlational analysis revealed a positive association between model-based choices during sequential decisions and goal-directed behavior after devaluation suggesting a single framework underlying both operationalizations and speaking in favor of construct validity of both measurement approaches. Up to now, this has been merely assumed but never been directly tested in humans. PMID:25136310

Stimulus-response correspondence in go-nogo and choice tasks: Are reactions altered by the presence of an irrelevant salient object?

PubMed

Lien, Mei-Ching; Pedersen, Logan; Proctor, Robert W

2016-11-01

In 2-choice tasks, responses are faster when stimulus location corresponds to response location, even when stimulus location is irrelevant. Dolk et al. (J Exp Psychol Hum Percept Perform 39:1248-1260, 2013a) found this stimulus-response correspondence effect with a single response location in a go-nogo task when an irrelevant Japanese waving cat was present. They argued that salient objects trigger spatial coding of the response relative to that object. We examined this claim using both behavioral and lateralized readiness potential (LRP) measures. In Experiment 1 participants determined the pitch of a left- or right-positioned tone, whereas in Experiment 2 they determined the color of a dot within a centrally located hand pointing left, right, or straight ahead. In both experiments, participants performed a go-nogo task with the right-index finger and a 2-choice task with both index fingers, with a left-positioned Japanese waving cat present or absent. For the go-nogo task, the cat induced a correspondence effect on response times (RT) to the tones (Experiment 1) but not the visual stimuli (Experiment 2). For the 2-choice task, a correspondence effect was evident in all conditions in both experiments. Cat's presence/absence did not significantly modulate the effect for right and left responses, although there was a trend toward increased RT and LRP for right responses in Experiment 1. The results imply that a salient, irrelevant object could provide a reference frame for response coding when attention is available to process it, as is likely in an auditory task (Experiment 1) but not a visual task (Experiment 2).

A frontal dopamine system for reflective exploratory behavior.

PubMed

Blanco, Nathaniel J; Love, Bradley C; Cooper, Jessica A; McGeary, John E; Knopik, Valerie S; Maddox, W Todd

2015-09-01

The COMT gene modulates dopamine levels in prefrontal cortex with Met allele carriers having lower COMT enzyme activity and, therefore, higher dopamine levels compared to Val/Val homozygotes. Concordantly, Val/Val homozygotes tend to perform worse and display increased (interpreted as inefficient) frontal activation in certain cognitive tasks. In a sample of 209 participants, we test the hypothesis that Met carriers will be advantaged in a decision-making task that demands sequencing exploratory and exploitive choices to minimize uncertainty about the reward structure in the environment. Previous work suggests that optimal performance depends on limited cognitive resources supported by prefrontal systems. If so, Met carriers should outperform Val/Val homozygotes, particularly under dual-task conditions that tax limited cognitive resources. In accord with these a priori predictions, Met carriers were more resilient in the face of cognitive load, continuing to explore in a sophisticated manner. We fit computational models that embody sophisticated reflective and simple reflexive strategies to further evaluate participants' exploration behavior. The Ideal Actor model reflectively updates beliefs and plans ahead, taking into account the information gained by each choice and making choices that maximize long-term payoffs. In contrast, the Naïve Reinforcement Learning (RL) model instantiates the reflexive account of choice, in which the values of actions are based only on the rewards experienced so far. Its beliefs are updated reflexively in response to observed changes in rewards. Converging with standard analyses, Met carriers were best characterized by the Ideal Actor model, whereas Val/Val homozygotes were best characterized by the Naive RL model, particularly under dual-task conditions. Copyright © 2015 Elsevier Inc. All rights reserved.

Place your bets: psychophysiological correlates of decision-making under risk.

PubMed

Studer, Bettina; Clark, Luke

2011-06-01

Emotions and their psychophysiological correlates are thought to play an important role in decision-making under risk. We used a novel gambling task to measure psychophysiological responses during selection of explicitly presented risky options and feedback processing. Active-choice trials, in which the participant had to select the size of bet, were compared to fixed-bet, no-choice trials. We further tested how the chances of winning and bet size affected choice behavior and psychophysiological arousal. Individual differences in impulsive and risk-taking traits were assessed. The behavioral results showed sensitivity to the choice requirement and to the chances of winning: Participants were faster to make a response on no-choice trials and when the chances of winning were high. In active-choice trials, electrodermal activity (EDA) increased with bet size during both selection and processing of losses. Cardiac responses were sensitive to choice uncertainty: Stronger selection-related heart rate (HR) decelerations were observed in trials with lower chances of winning, particularly on active-choice trials. Finally, betting behavior and psychophysiological responsiveness were moderately correlated with self-reported impulsivity-related traits. In conclusion, we demonstrate that psychophysiological arousal covaries with risk-sensitive decision-making outside of a learning context. Our results further highlight the differential sensitivities of EDA and HR to psychological features of the decision scenario.

Impact of stimulus format and reward value on quantity discrimination in capuchin and squirrel monkeys.

PubMed

Gazes, Regina Paxton; Billas, Alison R; Schmitt, Vanessa

2018-03-01

Quantity discrimination abilities are seen in a diverse range of species with similarities in performance patterns, suggesting common underlying cognitive mechanisms. However, methodological factors that impact performance make it difficult to draw broad phylogenetic comparisons of numerical cognition across studies. For example, some Old World monkeys selected a higher quantity stimulus more frequently when choosing between inedible (pebbles) than edible (food) stimuli. In Experiment 1 we presented brown capuchin (Cebus [Sapajus] paella) and squirrel monkeys (Saimiri sciureus) with the same two-choice quantity discrimination task in three different stimulus conditions: edible, inedible, and edible replaced (in which choice stimuli were food items that stood in for the same quantity of food items that were given as a reward). Unlike Old World monkeys, capuchins selected the higher quantity stimulus more in the edible condition and squirrel monkeys showed generally poor performance across all stimulus types. Performance patterns suggested that differences in subjective reward value might motivate differences in choice behavior between and within species. In Experiment 2 we manipulated the subjective reinforcement value of the reward by varying reward type and delay to reinforcement and found that delay to reinforcement had no impact on choice behavior, while increasing the value of the reward significantly improved performance by both species. The results of this study indicate that species presented with identical tasks may respond differently to methodological factors such as stimulus and reward types, resulting in significant differences in choice behavior that may lead to spurious suggestions of species differences in cognitive abilities.

Medial Prefrontal Cortex Is Selectively Involved in Response Selection Using Visual Context in the Background

ERIC Educational Resources Information Center

Lee, Inah; Shin, Ji Yun

2012-01-01

The exact roles of the medial prefrontal cortex (mPFC) in conditional choice behavior are unknown and a visual contextual response selection task was used for examining the issue. Inactivation of the mPFC severely disrupted performance in the task. mPFC inactivations, however, did not disrupt the capability of perceptual discrimination for visual…

A questionnaire approach to measuring the relative reinforcing efficacy of snack foods

PubMed Central

Epstein, Leonard H.; Dearing, Kelly K.; Roba, Lora G.

2010-01-01

Behavioral choice theory and laboratory choice paradigms can provide a framework to understand the reinforcing efficacy or reinforcing value of food. Reinforcing efficacy is measured in the laboratory by assessing how much effort one will engage in to gain access to food as the amount of work progressively increases. However, this method to establish demand curves as estimates of reinforcer efficacy is time consuming and limits the number of reinforcers that can be tested. The general aim of this study was to compare the reinforcing efficacy of snack foods using a behavioral task that requires subjects to respond to gain access to portions of food (LAB task) with a questionnaire version of a purchasing task designed to determine demand curves (QUES task) in nonobese and obese adults (n = 24). Results showed correlations between the maximal amount of money that individuals were willing to spend for food (QUES Omax) and the maximal amount of responses made on the highest reinforcement schedule completed (LAB Omax) (r = 0.45, p < 0.05), and between BMI and the LAB Omax (r = 0.43, p < 0.05) and the QUES Omax (r = 0.52, p < 0.05). The study suggests the questionnaire provides valid measures of reinforcing efficacy that can be used in place of or in conjunction with traditional laboratory paradigms to establish demand curves that describe the behavioral maintaining properties of food. PMID:20188288

Computational Phenotyping in Psychiatry: A Worked Example

PubMed Central

2016-01-01

Abstract Computational psychiatry is a rapidly emerging field that uses model-based quantities to infer the behavioral and neuronal abnormalities that underlie psychopathology. If successful, this approach promises key insights into (pathological) brain function as well as a more mechanistic and quantitative approach to psychiatric nosology—structuring therapeutic interventions and predicting response and relapse. The basic procedure in computational psychiatry is to build a computational model that formalizes a behavioral or neuronal process. Measured behavioral (or neuronal) responses are then used to infer the model parameters of a single subject or a group of subjects. Here, we provide an illustrative overview over this process, starting from the modeling of choice behavior in a specific task, simulating data, and then inverting that model to estimate group effects. Finally, we illustrate cross-validation to assess whether between-subject variables (e.g., diagnosis) can be recovered successfully. Our worked example uses a simple two-step maze task and a model of choice behavior based on (active) inference and Markov decision processes. The procedural steps and routines we illustrate are not restricted to a specific field of research or particular computational model but can, in principle, be applied in many domains of computational psychiatry. PMID:27517087

Computational Phenotyping in Psychiatry: A Worked Example.

PubMed

Schwartenbeck, Philipp; Friston, Karl

2016-01-01

Computational psychiatry is a rapidly emerging field that uses model-based quantities to infer the behavioral and neuronal abnormalities that underlie psychopathology. If successful, this approach promises key insights into (pathological) brain function as well as a more mechanistic and quantitative approach to psychiatric nosology-structuring therapeutic interventions and predicting response and relapse. The basic procedure in computational psychiatry is to build a computational model that formalizes a behavioral or neuronal process. Measured behavioral (or neuronal) responses are then used to infer the model parameters of a single subject or a group of subjects. Here, we provide an illustrative overview over this process, starting from the modeling of choice behavior in a specific task, simulating data, and then inverting that model to estimate group effects. Finally, we illustrate cross-validation to assess whether between-subject variables (e.g., diagnosis) can be recovered successfully. Our worked example uses a simple two-step maze task and a model of choice behavior based on (active) inference and Markov decision processes. The procedural steps and routines we illustrate are not restricted to a specific field of research or particular computational model but can, in principle, be applied in many domains of computational psychiatry.

A Flexible Mechanism of Rule Selection Enables Rapid Feature-Based Reinforcement Learning

PubMed Central

Balcarras, Matthew; Womelsdorf, Thilo

2016-01-01

Learning in a new environment is influenced by prior learning and experience. Correctly applying a rule that maps a context to stimuli, actions, and outcomes enables faster learning and better outcomes compared to relying on strategies for learning that are ignorant of task structure. However, it is often difficult to know when and how to apply learned rules in new contexts. In our study we explored how subjects employ different strategies for learning the relationship between stimulus features and positive outcomes in a probabilistic task context. We test the hypothesis that task naive subjects will show enhanced learning of feature specific reward associations by switching to the use of an abstract rule that associates stimuli by feature type and restricts selections to that dimension. To test this hypothesis we designed a decision making task where subjects receive probabilistic feedback following choices between pairs of stimuli. In the task, trials are grouped in two contexts by blocks, where in one type of block there is no unique relationship between a specific feature dimension (stimulus shape or color) and positive outcomes, and following an un-cued transition, alternating blocks have outcomes that are linked to either stimulus shape or color. Two-thirds of subjects (n = 22/32) exhibited behavior that was best fit by a hierarchical feature-rule model. Supporting the prediction of the model mechanism these subjects showed significantly enhanced performance in feature-reward blocks, and rapidly switched their choice strategy to using abstract feature rules when reward contingencies changed. Choice behavior of other subjects (n = 10/32) was fit by a range of alternative reinforcement learning models representing strategies that do not benefit from applying previously learned rules. In summary, these results show that untrained subjects are capable of flexibly shifting between behavioral rules by leveraging simple model-free reinforcement learning and context-specific selections to drive responses. PMID:27064794

Model-based influences on humans' choices and striatal prediction errors.

PubMed

Daw, Nathaniel D; Gershman, Samuel J; Seymour, Ben; Dayan, Peter; Dolan, Raymond J

2011-03-24

The mesostriatal dopamine system is prominently implicated in model-free reinforcement learning, with fMRI BOLD signals in ventral striatum notably covarying with model-free prediction errors. However, latent learning and devaluation studies show that behavior also shows hallmarks of model-based planning, and the interaction between model-based and model-free values, prediction errors, and preferences is underexplored. We designed a multistep decision task in which model-based and model-free influences on human choice behavior could be distinguished. By showing that choices reflected both influences we could then test the purity of the ventral striatal BOLD signal as a model-free report. Contrary to expectations, the signal reflected both model-free and model-based predictions in proportions matching those that best explained choice behavior. These results challenge the notion of a separate model-free learner and suggest a more integrated computational architecture for high-level human decision-making. Copyright © 2011 Elsevier Inc. All rights reserved.

Optogenetic Inhibition Reveals Distinct Roles for Basolateral Amygdala Activity at Discrete Time Points during Risky Decision Making.

PubMed

Orsini, Caitlin A; Hernandez, Caesar M; Singhal, Sarthak; Kelly, Kyle B; Frazier, Charles J; Bizon, Jennifer L; Setlow, Barry

2017-11-29

Decision making is a multifaceted process, consisting of several distinct phases that likely require different cognitive operations. Previous work showed that the basolateral amygdala (BLA) is a critical substrate for decision making involving risk of punishment; however, it is unclear how the BLA is recruited at different stages of the decision process. To this end, the current study used optogenetics to inhibit the BLA during specific task phases in a model of risky decision making (risky decision-making task) in which rats choose between a small, "safe" reward and a large reward accompanied by varying probabilities of footshock punishment. Male Long-Evans rats received intra-BLA microinjections of viral vectors carrying either halorhodopsin (eNpHR3.0-mCherry) or mCherry alone (control) followed by optic fiber implants and were trained in the risky decision-making task. Laser delivery during the task occurred during intertrial interval, deliberation, or reward outcome phases, the latter of which was further divided into the three possible outcomes (small, safe; large, unpunished; large, punished). Inhibition of the BLA selectively during the deliberation phase decreased choice of the large, risky outcome (decreased risky choice). In contrast, BLA inhibition selectively during delivery of the large, punished outcome increased risky choice. Inhibition had no effect during the other phases, nor did laser delivery affect performance in control rats. Collectively, these data indicate that the BLA can either inhibit or promote choice of risky options, depending on the phase of the decision process in which it is active. SIGNIFICANCE STATEMENT To date, most behavioral neuroscience research on neural mechanisms of decision making has used techniques that preclude assessment of distinct phases of the decision process. Here we show that optogenetic inhibition of the BLA has opposite effects on choice behavior in a rat model of risky decision making, depending on the phase in which inhibition occurs. BLA inhibition during a period of deliberation between small, safe and large, risky outcomes decreased risky choice. In contrast, BLA inhibition during receipt of the large, punished outcome increased risky choice. These findings highlight the importance of temporally targeted approaches to understand neural substrates underlying complex cognitive processes. More importantly, they reveal novel information about dynamic BLA modulation of risky choice. Copyright © 2017 the authors 0270-6474/17/3711537-12$15.00/0.

Basolateral amygdala supports the maintenance of value and effortful choice of a preferred option.

PubMed

Hart, Evan E; Izquierdo, Alicia

2017-02-01

The basolateral amygdala (BLA) is known to be involved in appetitive behavior, yet its role in cost-benefit choice of qualitatively different rewards (more/less preferred), beyond magnitude differences (larger/smaller), is poorly understood. We assessed the effects of BLA inactivations on effortful choice behavior. Rats were implanted with cannulae in BLA and trained to stable lever pressing for sucrose pellets on a progressive ratio schedule. Rats were then introduced to a choice: chow was concurrently available while they could work for the preferred sucrose pellets. Rats were infused with either vehicle control (aCSF) or baclofen/muscimol prior to test. BLA inactivations produced a significant decrease in lever presses for sucrose pellets compared to vehicle, and chow consumption was unaffected. Inactivation had no effect on sucrose pellet preference when both options were freely available. Critically, when lab chow was not concurrently available, BLA inactivations had no effect on the number of lever presses for sucrose pellets, indicating that primary motivation in the absence of choice remains intact with BLA offline. After a test under specific satiety for sucrose pellets, BLA inactivation rendered animals less sensitive to devaluation relative to control. The effects of BLA inactivations in our task are not mediated by decreased appetite, an inability to perform the task, a change in food preference, or decrements in primary motivation. Taken together, BLA supports the specific value and effortful choice of a preferred option. © 2016 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

Choice-impulsivity in children and adolescents with attention-deficit/hyperactivity disorder (ADHD): A meta-analytic review.

PubMed

Patros, Connor H G; Alderson, R Matt; Kasper, Lisa J; Tarle, Stephanie J; Lea, Sarah E; Hudec, Kristen L

2016-02-01

Impulsive behavior is a core DSM-5 diagnostic feature of attention-deficit/hyperactivity disorder (ADHD) that is associated with several pejorative outcomes. Impulsivity is multidimensional, consisting of two sub-constructs: rapid-response impulsivity and reward-delay impulsivity (i.e., choice-impulsivity). While previous research has extensively examined the presence and implications of rapid-response impulsivity in children with ADHD, reviews of choice-impulsive behavior have been both sparse and relatively circumscribed. This review used meta-analytic methods to comprehensively examine between-group differences in choice-impulsivity among children and adolescents with and without ADHD. Twenty-eight tasks (from 26 studies), consisting of 4320 total children (ADHD=2360, TD=1,960), provided sufficient information to compute an overall between-group effect size for choice-impulsivity performance. Results revealed a medium-magnitude between-group effect size (g=.47), suggesting that children and adolescents with ADHD exhibited moderately increased impulsive decision-making compared to TD children and adolescents. Further, relative to the TD group, children and adolescents with ADHD exhibited similar patterns of impulsive decision-making across delay discounting and delay of gratification tasks. However, the use of single-informant diagnostic procedures relative to multiple informants yielded larger between-group effects, and a similar pattern was observed across samples that excluded females relative to samples that included females. Copyright © 2015 Elsevier Ltd. All rights reserved.

What would you do? The effect of verbal persuasion on task choice.

PubMed

Lamarche, Larkin; Gionfriddo, Alicia M; Cline, Lindsay E; Gammage, Kimberley L; Adkin, Allan L

2014-01-01

Verbal persuasion has been shown to influence psychological and behavioral outcomes. The present study had two objectives: (1) to examine the effect of verbal persuasion on task choice in a balance setting and (2) to evaluate the use of verbal persuasion as an approach to experimentally induce mismatches between perceived and actual balance. Healthy young adults (N=68) completed an 8-m tandem walk task without vision and then were randomly assigned to a feedback group (good, control, or poor), regardless of actual balance. Following the feedback, participants chose to perform the task in one of three conditions differing in level of challenge and also were required to perform the task under the same pre-feedback conditions. Balance efficacy and perceived stability were rated before and after each pre- and post-feedback task, respectively. Balance performance measures were also collected. Following the feedback, participants in the good group were more likely to choose the most challenging task while those in the poor group were more likely to choose the least challenging task. Following the feedback, all groups showed improved balance performance. However, balance efficacy and perceived stability increased for the good and control groups but balance efficacy decreased and perceived stability was unchanged for the poor group. Thus, these findings demonstrate that verbal persuasion can influence task choice and may be used as an approach to experimentally create mismatches between perceived and actual balance. Copyright © 2013 Elsevier B.V. All rights reserved.

Report of an EU-US symposium on understanding nutrition-related consumer behavior: strategies to promote a lifetime of healthy food choices

PubMed Central

Friedl, Karl E.; Rowe, Sylvia; Bellows, Laura L.; Johnson, Susan L.; Hetherington, Marion M.; de Froidmont-Görtz, Isabelle; Lammens, Veerle; Hubbard, Van S.

2014-01-01

This report summarizes an EU-US Task Force on Biotechnology Research symposium on healthy food choices and nutrition-related purchasing behaviors. This meeting was unique in its transdisciplinary approach to obesity and for bringing together scientists from academia, government, and industry. Discussion relevant to funders and researchers centered on: (1) increased use of public-private partnerships; (2) the complexity of food behaviors and obesity risk and multilevel aspects that must be considered; and (3) the importance of transatlantic cooperation and collaboration that could accelerate advances in this field. A call to action stressed these points along with a commitment to enhanced communication strategies. PMID:24974355

Neural correlates of decision making on a gambling task.

PubMed

Carlson, Stephanie M; Zayas, Vivian; Guthormsen, Amy

2009-01-01

Individual differences in affective decision making were examined by recording event-related potentials (ERPs) while 74 typically developing 8-year-olds (38 boys, 36 girls) completed a 4-choice gambling task (Hungry Donkey Task; E. A. Crone & M. W. van der Molen, 2004). ERP results indicated: (a) a robust P300 component in response to feedback (punishment vs. reward outcomes), (b) anticipation effects (stimulus-preceding negativity) prior to outcomes presented on frequent (vs. infrequent) punishment choices, (c) anticipation effects prior to selections associated with short and long-term losses (vs. gains), and (d) individual differences in ERP components were significantly correlated with behavioral performance and verbal ability. These findings suggest that neurophysiological responses may be an index of children's trait-based and/or developmental level of decision-making skills in affective-motivational situations.

Greater preference consistency during the Willingness-to-Pay task is related to higher resting state connectivity between the ventromedial prefrontal cortex and the ventral striatum.

PubMed

Mackey, Scott; Olafsson, Valur; Aupperle, Robin L; Lu, Kun; Fonzo, Greg A; Parnass, Jason; Liu, Thomas; Paulus, Martin P

2016-09-01

The significance of why a similar set of brain regions are associated with the default mode network and value-related neural processes remains to be clarified. Here, we examined i) whether brain regions exhibiting willingness-to-pay (WTP) task-related activity are intrinsically connected when the brain is at rest, ii) whether these regions overlap spatially with the default mode network, and iii) whether individual differences in choice behavior during the WTP task are reflected in functional brain connectivity at rest. Blood-oxygen-level dependent (BOLD) signal was measured by functional magnetic resonance imaging while subjects performed the WTP task and at rest with eyes open. Brain regions that tracked the value of bids during the WTP task were used as seed regions in an analysis of functional connectivity in the resting state data. The seed in the ventromedial prefrontal cortex was functionally connected to core regions of the WTP task-related network. Brain regions within the WTP task-related network, namely the ventral precuneus, ventromedial prefrontal and posterior cingulate cortex overlapped spatially with publically available maps of the default mode network. Also, those individuals with higher functional connectivity during rest between the ventromedial prefrontal cortex and the ventral striatum showed greater preference consistency during the WTP task. Thus, WTP task-related regions are an intrinsic network of the brain that corresponds spatially with the default mode network, and individual differences in functional connectivity within the WTP network at rest may reveal a priori biases in choice behavior.

Greater preference consistency during the Willingness-to-Pay task is related to higher resting state connectivity between the ventromedial prefrontal cortex and the ventral striatum

PubMed Central

Mackey, Scott; Olafsson, Valur; Aupperle, Robin; Lu, Kun; Fonzo, Greg; Parnass, Jason; Liu, Thomas; Paulus, Martin P.

2015-01-01

The significance of why a similar set of brain regions are associated with the default mode network and value-related neural processes remains to be clarified. Here, we examined i) whether brain regions exhibiting willingness-to-pay (WTP) task-related activity are intrinsically connected when the brain is at rest, ii) whether these regions overlap spatially with the default mode network, and iii) whether individual differences in choice behavior during the WTP task are reflected in functional brain connectivity at rest. Blood-oxygen-level dependent (BOLD) signal was measured by functional magnetic resonance imaging while subjects performed the WTP task and at rest with eyes open. Brain regions that tracked the value of bids during the WTP task were used as seed regions in an analysis of functional connectivity in the resting state data. The seed in the ventromedial prefrontal cortex was functionally connected to core regions of the WTP task-related network. Brain regions within the WTP task-related network, namely the ventral precuneus, ventromedial prefrontal and posterior cingulate cortex overlapped spatially with publically available maps of the default mode network. Also, those individuals with higher functional connectivity during rest between the ventromedial prefrontal cortex and the ventral striatum showed greater preference consistency during the WTP task. Thus, WTP task-related regions are an intrinsic network of the brain that corresponds spatially with the default mode network, and individual differences in functional connectivity within the WTP network at rest may reveal a priori biases in choice behavior. PMID:26271206

Relating lab to life: Decrements in attention over time predict math productivity among children with ADHD.

PubMed

Fosco, Whitney D; Hawk, Larry W

2017-02-01

A child's ability to sustain attention over time (AOT) is critical in attention-deficit/hyperactivity disorder (ADHD), yet no prior work has examined the extent to which a child's decrement in AOT on laboratory tasks relates to clinically-relevant behavior. The goal of this study is to provide initial evidence for the criterion validity of laboratory assessments of AOT. A total of 20 children with ADHD (7-12 years of age) who were enrolled in a summer treatment program completed two lab attention tasks (a continuous performance task and a self-paced choice discrimination task) and math seatwork. Analyses focused on relations between attention task parameters and math productivity. Individual differences in overall attention (OA) measures (averaged across time) accounted for 23% of the variance in math productivity, supporting the criterion validity of lab measures of attention. The criterion validity was enhanced by consideration of changes in AOT. Performance on all laboratory attention measures deteriorated as time-on-task increased, and individual differences in the decrement in AOT accounted for 40% of the variance in math productivity. The only variable to uniquely predict math productivity was from the self-paced choice discrimination task. This study suggests that attention tasks in the lab do predict a clinically-relevant target behavior in children with ADHD, supporting their use as a means to study attention processes in a controlled environment. Furthermore, this prediction is improved when attention is examined as a function of time-on-task and when the attentional demands are consistent between lab and life contexts.

Comparing species decisions in a dichotomous choice task: adjusting task parameters improves performance in monkeys.

PubMed

Prétôt, Laurent; Bshary, Redouan; Brosnan, Sarah F

2016-07-01

In comparative psychology, both similarities and differences among species are studied to better understand the evolution of their behavior. To do so, we first test species in tasks using similar procedures, but if differences are found, it is important to determine their underlying cause(s) (e.g., are they due to ecology, cognitive ability, an artifact of the study, and/or some other factor?). In our previous work, primates performed unexpectedly poorly on an apparently simple two-choice discrimination task based on the natural behavior of cleaner fish, while the fish did quite well. In this task, if the subjects first chose one of the options (ephemeral) they received both food items, but if they chose the other (permanent) option first, the ephemeral option disappeared. Here, we test several proposed explanations for primates' relatively poorer performance. In Study 1, we used a computerized paradigm that differed from the previous test by removing interaction with human experimenters, which may be distracting, and providing a more standardized testing environment. In Study 2, we adapted the computerized paradigm from Study 1 to be more relevant to primate ecology. Monkeys' overall performance in these adapted tasks matched the performance of the fish in the original study, showing that with the appropriate modifications they can solve the task. We discuss these results in light of comparative research, which requires balancing procedural similarity with considerations of how the details of the task or the context may influence how different species perceive and solve tasks differently.

Gender Labeling and the Adoption of Sex-Typed Behaviors

ERIC Educational Resources Information Center

Fagot, Beverly I.; And Others

1986-01-01

Tests the ability of 43 children, ranging in age from 20 months to 40 months, to discriminate between pictures of boys and girls and male and female adults. Compares children who passed this gender-task with those who failed it on three behaviors most often categorized as sex-typed: toy choice, aggression, and peer playmate selection. (HOD)

Delay and probability discounting among payday and title loan recipients.

PubMed

Mahoney, Colin T; Lawyer, Steven R

2016-04-01

Payday and title loans are short-term loans associated with significant economic impact. Behavioral theories of impulsive choice may provide insight into behavioral processes that underlie the propensity to take out payday and title loans. Adults between the ages of 18 and 30 recruited from the community completed delay and probability discounting tasks for hypothetical money as well as measures of substance use. Patterns of discounting were characterized using a hyperbolic decay model and area under the curve. Participants who took out a payday and/or title loan in the past (n=41) exhibited more impulsive choice patterns on the delay discounting task than did those who did not (n=255). Substance use mediated this relationship between payday and title loan retention and delay discounting. These findings suggest potentially important relationships between payday/title loan borrowing, substance use, and delay discounting. Copyright © 2016 Elsevier B.V. All rights reserved.

Inattention blindness to motion in area MT

PubMed Central

Harrison, Ian T.; Weiner, Katherine F.; Ghose, Geoffrey M.

2013-01-01

Subjects naturally form and use expectations to solve familiar tasks, but the accuracy of these expectations, and the neuronal mechanisms by which these expectations enhance behavior, are unclear. We trained animals (Macaca mulatta) in a challenging perceptual task in which the likelihood of a very brief pulse of motion was consistently modulated over time and space. Pulse likelihood had dramatic effects on behavior: unexpected pulses were nearly invisible to the animals. To examine the neuronal basis of such inattention blindness, we recorded from single neurons in the middle temporal (MT) area, an area related to motion perception. Fluctuations in how reliably MT neurons both signaled stimulus events and predicted behavioral choices were highly correlated with changes in performance over the course of individual trials. A simple neuronal pooling model reveals the dramatic behavioral effects of attention in this task can be completely explained by changes in the reliability of a small number of MT neurons. PMID:23658178

The Effects of the Previous Outcome on Probabilistic Choice in Rats

PubMed Central

Marshall, Andrew T.; Kirkpatrick, Kimberly

2014-01-01

This study examined the effects of previous outcomes on subsequent choices in a probabilistic-choice task. Twenty-four rats were trained to choose between a certain outcome (1 or 3 pellets) versus an uncertain outcome (3 or 9 pellets), delivered with a probability of .1, .33, .67, and .9 in different phases. Uncertain outcome choices increased with the probability of uncertain food. Additionally, uncertain choices increased with the probability of uncertain food following both certain-choice outcomes and unrewarded uncertain choices. However, following uncertain-choice food outcomes, there was a tendency to choose the uncertain outcome in all cases, indicating that the rats continued to “gamble” after successful uncertain choices, regardless of the overall probability or magnitude of food. A subsequent manipulation, in which the probability of uncertain food varied within each session as a function of the previous uncertain outcome, examined how the previous outcome and probability of uncertain food affected choice in a dynamic environment. Uncertain-choice behavior increased with the probability of uncertain food. The rats exhibited increased sensitivity to probability changes and a greater degree of win–stay/lose–shift behavior than in the static phase. Simulations of two sequential choice models were performed to explore the possible mechanisms of reward value computations. The simulation results supported an exponentially decaying value function that updated as a function of trial (rather than time). These results emphasize the importance of analyzing global and local factors in choice behavior and suggest avenues for the future development of sequential-choice models. PMID:23205915

Aging and the Effects of Exploratory Behavior on Spatial Memory.

PubMed

Varner, Kaitlin M; Dopkins, Stephen; Philbeck, John W

2016-03-01

The present research examined the effect of encoding from multiple viewpoints on scene recall in a group of younger (18-22 years) and older (65-80 years) adults. Participants completed a visual search task, during which they were given the opportunity to examine a room using two sets of windows that partitioned the room differently. Their choice of window set was recorded, to determine whether an association between these choices and spatial memory performance existed. Subsequently, participants were tested for spatial memory of the domain in which the search task was completed. Relative to younger adults, older adults demonstrated an increased tendency to use a single set of windows as well as decreased spatial memory for the domain. Window-set usage was associated with spatial memory, such that older adults who relied more heavily on a single set of windows also had better performance on the spatial memory task. These findings suggest that, in older adults, moderation in exploratory behavior may have a positive effect on memory for the domain of exploration. © The Author(s) 2016.

Model of rhythmic ball bouncing using a visually controlled neural oscillator.

PubMed

Avrin, Guillaume; Siegler, Isabelle A; Makarov, Maria; Rodriguez-Ayerbe, Pedro

2017-10-01

The present paper investigates the sensory-driven modulations of central pattern generator dynamics that can be expected to reproduce human behavior during rhythmic hybrid tasks. We propose a theoretical model of human sensorimotor behavior able to account for the observed data from the ball-bouncing task. The novel control architecture is composed of a Matsuoka neural oscillator coupled with the environment through visual sensory feedback. The architecture's ability to reproduce human-like performance during the ball-bouncing task in the presence of perturbations is quantified by comparison of simulated and recorded trials. The results suggest that human visual control of the task is achieved online. The adaptive behavior is made possible by a parametric and state control of the limit cycle emerging from the interaction of the rhythmic pattern generator, the musculoskeletal system, and the environment. NEW & NOTEWORTHY The study demonstrates that a behavioral model based on a neural oscillator controlled by visual information is able to accurately reproduce human modulations in a motor action with respect to sensory information during the rhythmic ball-bouncing task. The model attractor dynamics emerging from the interaction between the neuromusculoskeletal system and the environment met task requirements, environmental constraints, and human behavioral choices without relying on movement planning and explicit internal models of the environment. Copyright © 2017 the American Physiological Society.

Choosing to regulate: does choice enhance craving regulation?

PubMed Central

Mobasser, Arian; Zeithamova, Dagmar; Pfeifer, Jennifer H

2018-01-01

Abstract Goal-directed behavior and lifelong well-being often depend on the ability to control appetitive motivations, such as cravings. Cognitive reappraisal is an effective way to modulate emotional states, including cravings, but is often studied under explicit instruction to regulate. Despite the strong prediction from Self-Determination Theory that choice should enhance task engagement and regulation success, little is known empirically about whether and how regulation is different when participants choose (vs are told) to exert control. To investigate how choice affects neural activity and regulation success, participants reappraised their responses to images of personally-craved foods while undergoing functional neuroimaging. Participants were either instructed to view or reappraise (‘no-choice’) or chose freely to view or reappraise (‘yes-choice’). Choice increased activity in the frontoparietal control network. We expected this activity would be associated with increased task engagement, resulting in better regulation success. However, contrary to this prediction, choice slightly reduced regulation success. Follow-up multivariate functional neuroimaging analyses indicated that choice likely disrupted allocation of limited cognitive resources during reappraisal. While unexpected, these results highlight the importance of studying upstream processes such as regulation choice, as they may affect the ability to regulate cravings and other emotional states. PMID:29462475

Task design influences prosociality in captive chimpanzees (Pan troglodytes).

PubMed

House, Bailey R; Silk, Joan B; Lambeth, Susan P; Schapiro, Steven J

2014-01-01

Chimpanzees confer benefits on group members, both in the wild and in captive populations. Experimental studies of how animals allocate resources can provide useful insights about the motivations underlying prosocial behavior, and understanding the relationship between task design and prosocial behavior provides an important foundation for future research exploring these animals' social preferences. A number of studies have been designed to assess chimpanzees' preferences for outcomes that benefit others (prosocial preferences), but these studies vary greatly in both the results obtained and the methods used, and in most cases employ procedures that reduce critical features of naturalistic social interactions, such as partner choice. The focus of the current study is on understanding the link between experimental methodology and prosocial behavior in captive chimpanzees, rather than on describing these animals' social motivations themselves. We introduce a task design that avoids isolating subjects and allows them to freely decide whether to participate in the experiment. We explore key elements of the methods utilized in previous experiments in an effort to evaluate two possibilities that have been offered to explain why different experimental designs produce different results: (a) chimpanzees are less likely to deliver food to others when they obtain food for themselves, and (b) evidence of prosociality may be obscured by more "complex" experimental apparatuses (e.g., those including more components or alternative choices). Our results suggest that the complexity of laboratory tasks may generate observed variation in prosocial behavior in laboratory experiments, and highlights the need for more naturalistic research designs while also providing one example of such a paradigm.

Task Design Influences Prosociality in Captive Chimpanzees (Pan troglodytes)

PubMed Central

House, Bailey R.; Silk, Joan B.; Lambeth, Susan P.; Schapiro, Steven J.

2014-01-01

Chimpanzees confer benefits on group members, both in the wild and in captive populations. Experimental studies of how animals allocate resources can provide useful insights about the motivations underlying prosocial behavior, and understanding the relationship between task design and prosocial behavior provides an important foundation for future research exploring these animals' social preferences. A number of studies have been designed to assess chimpanzees' preferences for outcomes that benefit others (prosocial preferences), but these studies vary greatly in both the results obtained and the methods used, and in most cases employ procedures that reduce critical features of naturalistic social interactions, such as partner choice. The focus of the current study is on understanding the link between experimental methodology and prosocial behavior in captive chimpanzees, rather than on describing these animals' social motivations themselves. We introduce a task design that avoids isolating subjects and allows them to freely decide whether to participate in the experiment. We explore key elements of the methods utilized in previous experiments in an effort to evaluate two possibilities that have been offered to explain why different experimental designs produce different results: (a) chimpanzees are less likely to deliver food to others when they obtain food for themselves, and (b) evidence of prosociality may be obscured by more “complex” experimental apparatuses (e.g., those including more components or alternative choices). Our results suggest that the complexity of laboratory tasks may generate observed variation in prosocial behavior in laboratory experiments, and highlights the need for more naturalistic research designs while also providing one example of such a paradigm. PMID:25191860

Motivational changes that develop in a mouse model of inflammation-induced depression are independent of indoleamine 2,3 dioxygenase.

PubMed

Vichaya, Elisabeth G; Laumet, Geoffroy; Christian, Diana L; Grossberg, Aaron J; Estrada, Darlene J; Heijnen, Cobi J; Kavelaars, Annemieke; Robert Dantzer

2018-04-27

Despite years of research, our understanding of the mechanisms by which inflammation induces depression is still limited. As clinical data points to a strong association between depression and motivational alterations, we sought to (1) characterize the motivational changes that are associated with inflammation in mice, and (2) determine if they depend on inflammation-induced activation of indoleamine 2,3 dioxygenase-1 (IDO1). Lipopolysaccharide (LPS)-treated or spared nerve injured (SNI) wild type (WT) and Ido1 -/- mice underwent behavioral tests of antidepressant activity (e.g., forced swim test) and motivated behavior, including assessment of (1) reward expectancy using a food-related anticipatory activity task, (2) willingness to work for reward using a progressive ratio schedule of food reinforcement, (3) effort allocation using a concurrent choice task, and (4) ability to associate environmental cues with reward using conditioned place preference. LPS- and SNI-induced deficits in behavioral tests of antidepressant activity in WT but not Ido1 -/- mice. Further, LPS decreased food related-anticipatory activity, reduced performance in the progressive ratio task, and shifted effort toward the preferred reward in the concurrent choice task. These effects were observed in both WT and Ido1 -/- mice. Finally, SNI mice developed a conditioned place preference based on relief from pain in an IDO1-independent manner. These findings demonstrate that the motivational effects of inflammation do not require IDO1. Further, they indicate that the motivational component of inflammation-induced depression is mechanistically distinct from that measured by behavioral tests of antidepressant activity.

Choice as an engine of analytic thought.

PubMed

Savani, Krishna; Stephens, Nicole M; Markus, Hazel Rose

2017-09-01

Choice is a behavioral act that has a variety of well-documented motivational consequences-it fosters independence by allowing people to simultaneously express themselves and influence the environment. Given the link between independence and analytic thinking, the current research tested whether choice also leads people to think in a more analytic rather than holistic manner. Four experiments demonstrate that making choices, recalling choices, and viewing others make choices leads people to think more analytically, as indicated by their attitudes, perceptual judgments, categorization, and patterns of attention allocation. People who made choices scored higher on a subjective self-report measure of analytic cognition compared to whose did not make a choice (pilot study). Using an objective task-based measure, people who recalled choices rather than actions were less influenced by changes in the background when making judgments about focal objects (Experiment 1). People who thought of others' behaviors as choices rather than actions were more likely to group objects based on categories rather than relationships (Experiment 2). People who recalled choices rather than actions subsequently allocated more visual attention to focal objects in a scene (Experiment 3). Together, these experiments demonstrate that choice has important yet previously unexamined consequences for basic psychological processes such as attention and cognition. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Affective and cognitive mechanisms of risky decision making

PubMed Central

Shimp, Kristy G.; Mitchell, Marci R.; Beas, B. Sofia; Bizon, Jennifer L.; Setlow, Barry

2014-01-01

The ability to make advantageous decisions under circumstances in which there is a risk of adverse consequences is an important component of adaptive behavior; however, extremes in risk taking (either high or low) can be maladaptive and are characteristic of a number of neuropsychiatric disorders. To better understand the contributions of various affective and cognitive factors to risky decision making, cohorts of male Long-Evans rats were trained in a “Risky Decision making Task” (RDT), in which they made discrete trial choices between a small, “safe” food reward and a large, “risky” food reward accompanied by varying probabilities of footshock. Experiment 1 evaluated the relative contributions of the affective stimuli (i.e., punishment vs. reward) to RDT performance by parametrically varying the magnitudes of the footshock and large reward. Varying the shock magnitude had a significant impact on choice of the large, “risky” reward, such that greater magnitudes were associated with reduced choice of the large reward. In contrast, varying the large, “risky” reward magnitude had minimal influence on reward choice. Experiment 2 compared individual variability in RDT performance with performance in an attentional set shifting task (assessing cognitive flexibility), a delayed response task (assessing working memory), and a delay discounting task (assessing impulsive choice). Rats characterized as risk averse in the RDT made more perseverative errors on the set shifting task than did their risk taking counterparts, whereas RDT performance was not related to working memory abilities or impulsive choice. In addition, rats that showed greater delay discounting (greater impulsive choice) showed corresponding poorer performance in the working memory task. Together, these results suggest that reward-related decision making under risk of punishment is more strongly influenced by the punishment than by the reward, and that risky and impulsive decision making are associated with distinct components of executive function. PMID:24642448

Decreasing Ventromedial Prefrontal Cortex Activity During Sequential Risk-Taking: An fMRI Investigation of the Balloon Analog Risk Task

PubMed Central

Schonberg, Tom; Fox, Craig R.; Mumford, Jeanette A.; Congdon, Eliza; Trepel, Christopher; Poldrack, Russell A.

2012-01-01

Functional imaging studies examining the neural correlates of risk have mainly relied on paradigms involving exposure to simple chance gambles and an economic definition of risk as variance in the probability distribution over possible outcomes. However, there is little evidence that choices made during gambling tasks predict naturalistic risk-taking behaviors such as drug use, extreme sports, or even equity investing. To better understand the neural basis of naturalistic risk-taking, we scanned participants using fMRI while they completed the Balloon Analog Risk Task, an experimental measure that includes an active decision/choice component and that has been found to correlate with a number of naturalistic risk-taking behaviors. In the task, as in many naturalistic settings, escalating risk-taking occurs under uncertainty and might be experienced either as the accumulation of greater potential rewards, or as exposure to increasing possible losses (and decreasing expected value). We found that areas previously linked to risk and risk-taking (bilateral anterior insula, anterior cingulate cortex, and right dorsolateral prefrontal cortex) were activated as participants continued to inflate balloons. Interestingly, we found that ventromedial prefrontal cortex (vmPFC) activity decreased as participants further expanded balloons. In light of previous findings implicating the vmPFC in value calculation, this result suggests that escalating risk-taking in the task might be perceived as exposure to increasing possible losses (and decreasing expected value) rather than the increasing potential total reward relative to the starting point of the trial. A better understanding of how neural activity changes with risk-taking behavior in the task offers insight into the potential neural mechanisms driving naturalistic risk-taking. PMID:22675289

Report of an EU-US symposium on understanding nutrition-related consumer behavior: strategies to promote a lifetime of healthy food choices.

PubMed

Friedl, Karl E; Rowe, Sylvia; Bellows, Laura L; Johnson, Susan L; Hetherington, Marion M; de Froidmont-Görtz, Isabelle; Lammens, Veerle; Hubbard, Van S

2014-01-01

This report summarizes an EU-US Task Force on Biotechnology Research symposium on healthy food choices and nutrition-related purchasing behaviors. This meeting was unique in its transdisciplinary approach to obesity and in bringing together scientists from academia, government, and industry. Discussion relevant to funders and researchers centered on (1) increased use of public-private partnerships, (2) the complexity of food behaviors and obesity risk and multilevel aspects that must be considered, and (3) the importance of transatlantic cooperation and collaboration that could accelerate advances in this field. A call to action stressed these points along with a commitment to enhanced communication strategies. Copyright © 2014 Society for Nutrition Education and Behavior. All rights reserved.

Evidence that primary visual cortex is required for image, orientation, and motion discrimination by rats.

PubMed

Petruno, Sarah K; Clark, Robert E; Reinagel, Pamela

2013-01-01

The pigmented Long-Evans rat has proven to be an excellent subject for studying visually guided behavior including quantitative visual psychophysics. This observation, together with its experimental accessibility and its close homology to the mouse, has made it an attractive model system in which to dissect the thalamic and cortical circuits underlying visual perception. Given that visually guided behavior in the absence of primary visual cortex has been described in the literature, however, it is an empirical question whether specific visual behaviors will depend on primary visual cortex in the rat. Here we tested the effects of cortical lesions on performance of two-alternative forced-choice visual discriminations by Long-Evans rats. We present data from one highly informative subject that learned several visual tasks and then received a bilateral lesion ablating >90% of primary visual cortex. After the lesion, this subject had a profound and persistent deficit in complex image discrimination, orientation discrimination, and full-field optic flow motion discrimination, compared with both pre-lesion performance and sham-lesion controls. Performance was intact, however, on another visual two-alternative forced-choice task that required approaching a salient visual target. A second highly informative subject learned several visual tasks prior to receiving a lesion ablating >90% of medial extrastriate cortex. This subject showed no impairment on any of the four task categories. Taken together, our data provide evidence that these image, orientation, and motion discrimination tasks require primary visual cortex in the Long-Evans rat, whereas approaching a salient visual target does not.

Delay and probability discounting of multiple commodities in smokers and never-smokers using multiple-choice tasks.

PubMed

Poltavski, Dmitri V; Weatherly, Jeffrey N

2013-12-01

The purpose of the present study was to investigate temporal and probabilistic discounting in smokers and never-smokers, across a number of commodities, using a multiple-choice method. One hundred and eighty-two undergraduate university students, of whom 90 had never smoked, 73 were self-reported light smokers (<10 cigarettes/day), and 17 were heavy smokers (10+cigarettes/day), completed computerized batteries of delay and probability discounting questions pertaining to a total of eight commodities and administered in a multiple-choice format. In addition to cigarettes, monetary rewards, and health outcomes, the tasks included novel commodities such as ideal dating partner and retirement income. The results showed that heavy smokers probability discounted commodities at a significantly shallower rate than never-smokers, suggesting greater risk-taking. No effect of smoking status was observed for delay discounting questions. The only commodity that was probability discounted significantly less than others was 'finding an ideal dating partner'. The results suggest that probability discounting tasks using the multiple-choice format can discriminate between non-abstaining smokers and never-smokers and could be further explored in the context of behavioral and drug addictions.

Impulsive choice behavior in four strains of rats: Evaluation of possible models of Attention Deficit/Hyperactivity Disorder

PubMed Central

Garcia, Ana; Kirkpatrick, Kimberly

2012-01-01

Several studies have examined impulsive choice behavior in spontaneously hypertensive rats (SHRs) as a possible pre-clinical model for Attention-Deficit/Hyperactivity Disorder (ADHD). However, this strain was not specifically selected for the traits of ADHD and as a result their appropriateness as a model has been questioned. The present study investigated whether SHRs would exhibit impulsive behavior in comparison to their control strain, Wistar Kyoto (WKY) rats. In addition, we evaluated a strain that has previously shown high levels of impulsive choice, the Lewis (LEW) rats and compared them with their source strain, Wistar (WIS) rats. In the first phase, rats could choose between a Smaller-sooner (SS) reward of 1 pellet after 10 s and a Larger-later (LL) reward of 2 pellets after 30 s. Subsequently, the rats were exposed to increases in LL reward magnitude and SS delay. These manipulations were designed to assess sensitivity to magnitude and delay within the choice task to parse out possible differences in using the strains as models of specific deficits associated with ADHD. The SHR and WKY strains did not differ in their choice behavior under either delay or magnitude manipulations. In comparison to WIS, LEW showed deficits in choice behavior in the delay manipulation, and to a lesser extent in the magnitude manipulation. An examination of individual differences indicated that the SHR strain may not be sufficiently homogeneous in their impulsive choice behavior to be considered as a viable model for impulse control disorders such as ADHD. The LEW strain may be worthy of further consideration for their suitability as an animal model. PMID:23085479

Sensitivity to cognitive effort mediates psychostimulant effects on a novel rodent cost/benefit decision-making task.

PubMed

Cocker, Paul J; Hosking, Jay G; Benoit, James; Winstanley, Catharine A

2012-07-01

Amotivational states and insufficient recruitment of mental effort have been observed in a variety of clinical populations, including depression, traumatic brain injury, post-traumatic stress disorder, and attention deficit hyperactivity disorder. Previous rodent models of effort-based decision making have utilized physical costs whereas human studies of effort are primarily cognitive in nature, and it is unclear whether the two types of effortful decision making are underpinned by the same neurobiological processes. We therefore designed a novel rat cognitive effort task (rCET) based on the 5-choice serial reaction time task, a well-validated measure of attention and impulsivity. Within each trial of the rCET, rats are given the choice between an easy or hard visuospatial discrimination, and successful hard trials are rewarded with double the number of sugar pellets. Similar to previous human studies, stable individual variation in choice behavior was observed, with 'workers' choosing hard trials significantly more than their 'slacker' counterparts. Whereas workers 'slacked off' in response to administration of amphetamine and caffeine, slackers 'worked harder' under amphetamine, but not caffeine. Conversely, these stimulants increased motor impulsivity in all animals. Ethanol did not affect animals' choice but invigorated behavior. In sum, we have shown for the first time that rats are differentially sensitive to cognitive effort when making decisions, independent of other processes such as impulsivity, and these baseline differences can influence the cognitive response to psychostimulants. Such findings could inform our understanding of impairments in effort-based decision making and contribute to treatment development.

Sensitivity to Cognitive Effort Mediates Psychostimulant Effects on a Novel Rodent Cost/Benefit Decision-Making Task

PubMed Central

Cocker, Paul J; Hosking, Jay G; Benoit, James; Winstanley, Catharine A

2012-01-01

Amotivational states and insufficient recruitment of mental effort have been observed in a variety of clinical populations, including depression, traumatic brain injury, post-traumatic stress disorder, and attention deficit hyperactivity disorder. Previous rodent models of effort-based decision making have utilized physical costs whereas human studies of effort are primarily cognitive in nature, and it is unclear whether the two types of effortful decision making are underpinned by the same neurobiological processes. We therefore designed a novel rat cognitive effort task (rCET) based on the 5-choice serial reaction time task, a well-validated measure of attention and impulsivity. Within each trial of the rCET, rats are given the choice between an easy or hard visuospatial discrimination, and successful hard trials are rewarded with double the number of sugar pellets. Similar to previous human studies, stable individual variation in choice behavior was observed, with ‘workers' choosing hard trials significantly more than their ‘slacker' counterparts. Whereas workers ‘slacked off' in response to administration of amphetamine and caffeine, slackers ‘worked harder' under amphetamine, but not caffeine. Conversely, these stimulants increased motor impulsivity in all animals. Ethanol did not affect animals' choice but invigorated behavior. In sum, we have shown for the first time that rats are differentially sensitive to cognitive effort when making decisions, independent of other processes such as impulsivity, and these baseline differences can influence the cognitive response to psychostimulants. Such findings could inform our understanding of impairments in effort-based decision making and contribute to treatment development. PMID:22453140

Sweet taste liking is associated with impulsive behaviors in humans

PubMed Central

Weafer, Jessica; Burkhardt, Anne; de Wit, Harriet

2014-01-01

Evidence from both human and animal studies suggests that sensitivity to rewarding stimuli is positively associated with impulsive behaviors, including both impulsive decision making and inhibitory control. The current study examined associations between the hedonic value of a sweet taste and two forms of impulsivity (impulsive choice and impulsive action) in healthy young adults (N = 100). Participants completed a sweet taste test in which they rated their liking of various sweetness concentrations. Subjects also completed measures of impulsive choice (delay discounting), and impulsive action (go/no-go task). Subjects who discounted more steeply (i.e., greater impulsive choice) liked the high sweetness concentration solutions more. By contrast, sweet liking was not related to impulsive action. These findings indicate that impulsive choice may be associated with heightened sensitivity to the hedonic value of a rewarding stimulus, and that these constructs might share common underlying neurobiological mechanisms. PMID:24987343

Is it patience or motivation? On motivational confounds in intertemporal choice tasks.

PubMed

Paglieri, Fabio; Addessi, Elsa; Sbaffi, Agnese; Tasselli, Maria Isabella; Delfino, Alexia

2015-01-01

Intertemporal choices create a tension between amount maximization, which would favor the larger and later option (LL), and delay minimization, which would promote the smaller and sooner reward (SS). Two common interpretations of intertemporal choice behavior are discussed: looking at LL responses as indicative of self-control, and using intertemporal choices to assess delay aversion. We argue that both interpretations need to take into account motivational confounds, in order to be warranted by data. In intertemporal choices with prepotent, salient stimuli (e.g., food amounts, typically used with nonhuman primates), LL responses could also be indicative of failed inhibition of a "go for more" impulsive response-the opposite of self-control. Similarly, intertemporal choices can be used to measure delay aversion only with respect to the subject's baseline motivation to maximize the reinforcer in question, and this baseline is not always assessed in current experimental protocols. This concern is especially crucial in comparing intertemporal choices across different groups or manipulation. We focus in particular on the effects of reward types on intertemporal choices, presenting two experimental studies where the difference in behavior with monetary versus food rewards is the product of different baseline motivation, rather than variations in delay aversion. We conclude discussing the implications of these and other similar recent findings, which are far-reaching. © Society for the Experimental Analysis of Behavior.

Bayesian deterministic decision making: a normative account of the operant matching law and heavy-tailed reward history dependency of choices.

PubMed

Saito, Hiroshi; Katahira, Kentaro; Okanoya, Kazuo; Okada, Masato

2014-01-01

The decision making behaviors of humans and animals adapt and then satisfy an "operant matching law" in certain type of tasks. This was first pointed out by Herrnstein in his foraging experiments on pigeons. The matching law has been one landmark for elucidating the underlying processes of decision making and its learning in the brain. An interesting question is whether decisions are made deterministically or probabilistically. Conventional learning models of the matching law are based on the latter idea; they assume that subjects learn choice probabilities of respective alternatives and decide stochastically with the probabilities. However, it is unknown whether the matching law can be accounted for by a deterministic strategy or not. To answer this question, we propose several deterministic Bayesian decision making models that have certain incorrect beliefs about an environment. We claim that a simple model produces behavior satisfying the matching law in static settings of a foraging task but not in dynamic settings. We found that the model that has a belief that the environment is volatile works well in the dynamic foraging task and exhibits undermatching, which is a slight deviation from the matching law observed in many experiments. This model also demonstrates the double-exponential reward history dependency of a choice and a heavier-tailed run-length distribution, as has recently been reported in experiments on monkeys.

Recent Translational Findings on Impulsivity in Relation to Drug Abuse

PubMed Central

Weafer, Jessica; Mitchell, Suzanne H.

2015-01-01

Impulsive behavior is strongly implicated in drug abuse, as both a cause and a consequence of drug use. To understand how impulsive behaviors lead to and result from drug use, translational evidence from both human and non-human animal studies is needed. Here, we review recent (2009 or later) studies that have investigated two major components of impulsive behavior, inhibitory control and impulsive choice, across preclinical and clinical studies. We concentrate on the stop-signal task as the measure of inhibitory control and delay discounting as the measure of impulsive choice. Consistent with previous reports, recent studies show greater impulsive behavior in drug users compared with non-users. Additionally, new evidence supports the prospective role of impulsive behavior in drug abuse, and has begun to identify the neurobiological mechanisms underlying impulsive behavior. We focus on the commonalities and differences in findings between preclinical and clinical studies, and suggest future directions for translational research. PMID:25678985

Dopaminergic modulation of reward-guided decision making in alcohol-preferring AA rats.

PubMed

Oinio, Ville; Bäckström, Pia; Uhari-Väänänen, Johanna; Raasmaja, Atso; Piepponen, Petteri; Kiianmaa, Kalervo

2017-05-30

R**esults from animal gambling models have highlighted the importance of dopaminergic neurotransmission in modulating decision making when large sucrose rewards are combined with uncertainty. The majority of these models use food restriction as a tool to motivate animals to accomplish operant behavioral tasks, in which sucrose is used as a reward. As enhanced motivation to obtain sucrose due to hunger may impact its reward-seeking effect, we wanted to examine the decision-making behavior of rats in a situation where rats were fed ad libitum. For this purpose, we chose alcohol-preferring AA (alko alcohol) rats, as these rats have been shown to have high preference for sweet agents. In the present study, AA rats were trained to self-administer sucrose pellet rewards in a two-lever choice task (one pellet vs. three pellets). Once rational choice behavior had been established, the probability of gaining three pellets was decreased over time (50%, 33%, 25% then 20%). The effect of d-amphetamine on decision making was studied at every probability level, as well as the effect of the dopamine D 1 receptor agonist SKF-81297 and D 2 agonist quinpirole at probability levels of 100% and 25%. d-Amphetamine increased unprofitable choices in a dose-dependent manner at the two lowest probability levels. Quinpirole increased the frequency of unprofitable decisions at the 25% probability level, and SKF-82197 did not affect choice behavior. These results mirror the findings of probabilistic discounting studies using food-restricted rats. Based on this, the use of AA rats provides a new approach for studies on reward-guided decision making. Copyright © 2017 Elsevier B.V. All rights reserved.

Lateral orbitofrontal cortex anticipates choices and integrates prior with current information

PubMed Central

Nogueira, Ramon; Abolafia, Juan M.; Drugowitsch, Jan; Balaguer-Ballester, Emili; Sanchez-Vives, Maria V.; Moreno-Bote, Rubén

2017-01-01

Adaptive behavior requires integrating prior with current information to anticipate upcoming events. Brain structures related to this computation should bring relevant signals from the recent past into the present. Here we report that rats can integrate the most recent prior information with sensory information, thereby improving behavior on a perceptual decision-making task with outcome-dependent past trial history. We find that anticipatory signals in the orbitofrontal cortex about upcoming choice increase over time and are even present before stimulus onset. These neuronal signals also represent the stimulus and relevant second-order combinations of past state variables. The encoding of choice, stimulus and second-order past state variables resides, up to movement onset, in overlapping populations. The neuronal representation of choice before stimulus onset and its build-up once the stimulus is presented suggest that orbitofrontal cortex plays a role in transforming immediate prior and stimulus information into choices using a compact state-space representation. PMID:28337990

Caudate responses to reward anticipation associated with delay discounting behavior in healthy youth

PubMed Central

Benningfield, Margaret M.; Blackford, Jennifer U.; Ellsworth, Melissa E.; Samanez-Larkin, Gregory R.; Martin, Peter R.; Cowan, Ronald L.; Zald, David H.

2014-01-01

Background Choices requiring delay of gratification made during adolescence can have significant impact on life trajectory. Willingness to delay gratification can be measured using delay discounting tasks that require a choice between a smaller immediate reward and a larger delayed reward. Individual differences in the subjective value of delayed rewards are associated with risk for development of psychopathology including substance abuse. The neurobiological underpinnings related to these individual differences early in life are not fully understood. Using functional magnetic resonance imaging (fMRI), we tested the hypothesis that individual differences in delay discounting behavior in healthy youth are related to differences in responsiveness to potential reward. Method Nineteen 10 to 14 year-olds performed a monetary incentive delay task to assess neural sensitivity to potential reward and a questionnaire to measure discounting of future monetary rewards. Results Left ventromedial caudate activation during anticipation of potential reward was negatively correlated with delay discounting behavior. There were no regions where brain responses during notification of reward outcome were associated with discounting behavior. Conclusions Brain activation during anticipation of potential reward may serve as a marker for individual differences in ability or willingness to delay gratification in healthy youth. PMID:24309299

On the Relationship between the Indirectly Measured Attitude Towards Beer and Beer Consumption: The Role of Attitude Accessibility

PubMed Central

Descheemaeker, Mathilde; Spruyt, Adriaan; Hermans, Dirk

2014-01-01

Although some studies have demonstrated that the indirectly measured attitude towards alcohol is related to alcohol use, this relationship has not always been confirmed. In the current study, we attempted to shed light on this issue by investigating whether the predictive validity of an indirect attitude measure is dependent upon attitude accessibility. In a sample of 88 students, the picture-picture naming task, an adaptation of the affective priming paradigm, was used to measure the automatically activated attitude towards beer. Attitude accessibility was measured using a speeded evaluative categorization task. Behavioral measures were the amount of beer poured and drunk during a bogus taste test and the choice between a bottle of beer or water at the end of the experiment. In line with our hypothesis, the indirectly measured attitude towards beer predicted behavior during the taste test only when it was highly accessible. In contrast, this attitude was related to choice behavior irrespective of attitude accessibility. This study confirms that indirect attitude measures can be valuable predictors of alcohol-related behavior, but that it is sometimes necessary to take attitude accessibility into account. PMID:24777156

On the relationship between the indirectly measured attitude towards beer and beer consumption: the role of attitude accessibility.

PubMed

Descheemaeker, Mathilde; Spruyt, Adriaan; Hermans, Dirk

2014-01-01

Although some studies have demonstrated that the indirectly measured attitude towards alcohol is related to alcohol use, this relationship has not always been confirmed. In the current study, we attempted to shed light on this issue by investigating whether the predictive validity of an indirect attitude measure is dependent upon attitude accessibility. In a sample of 88 students, the picture-picture naming task, an adaptation of the affective priming paradigm, was used to measure the automatically activated attitude towards beer. Attitude accessibility was measured using a speeded evaluative categorization task. Behavioral measures were the amount of beer poured and drunk during a bogus taste test and the choice between a bottle of beer or water at the end of the experiment. In line with our hypothesis, the indirectly measured attitude towards beer predicted behavior during the taste test only when it was highly accessible. In contrast, this attitude was related to choice behavior irrespective of attitude accessibility. This study confirms that indirect attitude measures can be valuable predictors of alcohol-related behavior, but that it is sometimes necessary to take attitude accessibility into account.

Attention.

PubMed

Callahan, Patrick M; Terry, Alvin V

2015-01-01

The ability to focus one's attention on important environmental stimuli while ignoring irrelevant stimuli is fundamental to human cognition and intellectual function. Attention is inextricably linked to perception, learning and memory, and executive function; however, it is often impaired in a variety of neuropsychiatric disorders, including Alzheimer's disease, schizophrenia, depression, and attention deficit hyperactivity disorder (ADHD). Accordingly, attention is considered as an important therapeutic target in these disorders. The purpose of this chapter is to provide an overview of the most common behavioral paradigms of attention that have been used in animals (particularly rodents) and to review the literature where these tasks have been employed to elucidate neurobiological substrates of attention as well as to evaluate novel pharmacological agents for their potential as treatments for disorders of attention. These paradigms include two tasks of sustained attention that were developed as rodent analogues of the human Continuous Performance Task (CPT), the Five-Choice Serial Reaction Time Task (5-CSRTT) and the more recently introduced Five-Choice Continuous Performance Task (5C-CPT), and the Signal Detection Task (SDT) which was designed to emphasize temporal components of attention.

Of goals and habits: age-related and individual differences in goal-directed decision-making.

PubMed

Eppinger, Ben; Walter, Maik; Heekeren, Hauke R; Li, Shu-Chen

2013-01-01

In this study we investigated age-related and individual differences in habitual (model-free) and goal-directed (model-based) decision-making. Specifically, we were interested in three questions. First, does age affect the balance between model-based and model-free decision mechanisms? Second, are these age-related changes due to age differences in working memory (WM) capacity? Third, can model-based behavior be affected by manipulating the distinctiveness of the reward value of choice options? To answer these questions we used a two-stage Markov decision task in in combination with computational modeling to dissociate model-based and model-free decision mechanisms. To affect model-based behavior in this task we manipulated the distinctiveness of reward probabilities of choice options. The results show age-related deficits in model-based decision-making, which are particularly pronounced if unexpected reward indicates the need for a shift in decision strategy. In this situation younger adults explore the task structure, whereas older adults show perseverative behavior. Consistent with previous findings, these results indicate that older adults have deficits in the representation and updating of expected reward value. We also observed substantial individual differences in model-based behavior. In younger adults high WM capacity is associated with greater model-based behavior and this effect is further elevated when reward probabilities are more distinct. However, in older adults we found no effect of WM capacity. Moreover, age differences in model-based behavior remained statistically significant, even after controlling for WM capacity. Thus, factors other than decline in WM, such as deficits in the in the integration of expected reward value into strategic decisions may contribute to the observed impairments in model-based behavior in older adults.

Of goals and habits: age-related and individual differences in goal-directed decision-making

PubMed Central

Eppinger, Ben; Walter, Maik; Heekeren, Hauke R.; Li, Shu-Chen

2013-01-01

In this study we investigated age-related and individual differences in habitual (model-free) and goal-directed (model-based) decision-making. Specifically, we were interested in three questions. First, does age affect the balance between model-based and model-free decision mechanisms? Second, are these age-related changes due to age differences in working memory (WM) capacity? Third, can model-based behavior be affected by manipulating the distinctiveness of the reward value of choice options? To answer these questions we used a two-stage Markov decision task in in combination with computational modeling to dissociate model-based and model-free decision mechanisms. To affect model-based behavior in this task we manipulated the distinctiveness of reward probabilities of choice options. The results show age-related deficits in model-based decision-making, which are particularly pronounced if unexpected reward indicates the need for a shift in decision strategy. In this situation younger adults explore the task structure, whereas older adults show perseverative behavior. Consistent with previous findings, these results indicate that older adults have deficits in the representation and updating of expected reward value. We also observed substantial individual differences in model-based behavior. In younger adults high WM capacity is associated with greater model-based behavior and this effect is further elevated when reward probabilities are more distinct. However, in older adults we found no effect of WM capacity. Moreover, age differences in model-based behavior remained statistically significant, even after controlling for WM capacity. Thus, factors other than decline in WM, such as deficits in the in the integration of expected reward value into strategic decisions may contribute to the observed impairments in model-based behavior in older adults. PMID:24399925

Mechanisms of Choice Behavior Shift Using Cue-approach Training.

PubMed

Bakkour, Akram; Leuker, Christina; Hover, Ashleigh M; Giles, Nathan; Poldrack, Russell A; Schonberg, Tom

2016-01-01

Cue-approach training has been shown to effectively shift choices for snack food items by associating a cued button-press motor response to particular food items. Furthermore, attention was biased toward previously cued items, even when the cued item is not chosen for real consumption during a choice phase. However, the exact mechanism by which preferences shift during cue-approach training is not entirely clear. In three experiments, we shed light on the possible underlying mechanisms at play during this novel paradigm: (1) Uncued, wholly predictable motor responses paired with particular food items were not sufficient to elicit a preference shift; (2) Cueing motor responses early - concurrently with food item onset - and thus eliminating the need for heightened top-down attention to the food stimulus in preparation for a motor response also eliminated the shift in food preferences. This finding reinforces our hypothesis that heightened attention at behaviorally relevant points in time is key to changing choice behavior in the cue-approach task; (3) Crucially, indicating choice using eye movements rather than manual button presses preserves the effect, thus demonstrating that the shift in preferences is not governed by a learned motor response but more likely via modulation of subjective value in higher associative regions, consistent with previous neuroimaging results. Cue-approach training drives attention at behaviorally relevant points in time to modulate the subjective value of individual items, providing a mechanism for behavior change that does not rely on external reinforcement and that holds great promise for developing real world behavioral interventions.

Preference bias of head orientation in choosing between two non-durables.

PubMed

Funaya, Hiroyuki; Shibata, Tomohiro

2015-01-01

The goal of this study is to investigate how customers' gaze, head and body orientations reflect their choices. Although the relationship between human choice and gaze behavior has been well-studied, other behaviors such as head and body are unknown. We conducted a two-alternatives-forced-choice task to examine (1) whether preference bias, i.e., a positional bias in gaze, head and body toward the item that was later chosen, exists in choice, (2) when preference bias is observed and when prediction of the resulting choice becomes possible (3) whether human choice is affected when the body orientations are manipulated. We used real non-durable products (cheap snacks and clothing) on a shopping shelf. The results showed that there was a significant preference bias in head orientation at the beginning 1 s when the subjects stood straight toward the shelf, and that the head orientation was more biased toward the selected item than the gaze and the center of pressure at the ending 1 s. Manipulating body orientation did not affect the result of choice. The preference bias detected by observing the head orientation would be useful in marketing science for predicting customers' choice.

Α4β2 and α7 nicotinic acetylcholine receptor binding predicts choice preference in two cost benefit decision-making tasks.

PubMed

Mendez, I A; Damborsky, J C; Winzer-Serhan, U H; Bizon, J L; Setlow, B

2013-01-29

Nicotinic receptors have been linked to a wide range of cognitive and behavioral functions, but surprisingly little is known about their involvement in cost benefit decision making. The goal of these experiments was to determine how nicotinic acetylcholine receptor (nAChR) expression is related to two forms of cost benefit decision making. Male Long Evans rats were tested in probability- and delay-discounting tasks, which required discrete trial choices between a small reward and a large reward associated with varying probabilities of omission and varying delays to reward delivery, respectively. Following testing, radioligand binding to α4β2 and α7 nAChR subtypes in brain regions implicated in cost benefit decision making was examined. Significant linear relationships were observed between choice of the large delayed reward in the delay discounting task and α4β2 receptor binding in both the dorsal and ventral hippocampus. Additionally, trends were found suggesting that choice of the large costly reward in both discounting tasks was inversely related to α4β2 receptor binding in the medial prefrontal cortex and nucleus accumbens shell. Similar trends suggested that choice of the large delayed reward in the delay discounting task was inversely related to α4β2 receptor binding in the orbitofrontal cortex, nucleus accumbens core, and basolateral amygdala, as well as to α7 receptor binding in the basolateral amygdala. These data suggest that nAChRs (particularly α4β2) play both unique and common roles in decisions that require consideration of different types of reward costs. Copyright © 2012 IBRO. Published by Elsevier Ltd. All rights reserved.

Emergence of relations and the essence of learning: a review of Sidman's Equivalence relations and behavior: a research story. Book review

NASA Technical Reports Server (NTRS)

Rumbaugh, D. M.

1995-01-01

The author reviews and comments on the book Equivalence relations and behavior: a research story by Murray Sidman. Sidman's book reports his research about equivalence relations and competencies in children with mental retardation and how it relates to behavior. Sidman used the idea of stimulus-stimulus relations among features of the environment to develop his theories about equivalence relations. Experimental work with children and animals demonstrated their ability to use equivalence relations to learn new tasks. The subject received feedback and reinforcement for specific choices made during training, then was presented with new choices during testing. Results of the tests indicate that subjects were able to establish relations and retrieve them in different situations.

Not all choices are created equal: Task-relevant choices enhance motor learning compared to task-irrelevant choices.

PubMed

Carter, Michael J; Ste-Marie, Diane M

2017-12-01

Lewthwaite et al. (2015) reported that the learning benefits of exercising choice (i.e., their self-controlled condition) are not restricted to task-relevant features (e.g., feedback). They found that choosing one's golf ball color (Exp. 1) or choosing which of two tasks to perform at a later time plus which of two artworks to hang (Exp. 2) resulted in better retention than did being denied these same choices (i.e., yoked condition). The researchers concluded that the learning benefits derived from choice, whether irrelevant or relevant to the to-be-learned task, are predominantly motivational because choice is intrinsically rewarding and satisfies basic psychological needs. However, the absence of a group that made task-relevant choices and the lack of psychological measures significantly weakened their conclusions. Here, we investigated how task-relevant and task-irrelevant choices affect motor-skill learning. Participants practiced a spatiotemporal motor task in either a task-relevant group (choice over feedback schedule), a task-irrelevant group (choice over the color of an arm-wrap plus game selection), or a no-choice group. The results showed significantly greater learning in the task-relevant group than in both the task-irrelevant and no-choice groups, who did not differ significantly. Critically, these learning differences were not attributed to differences in perceptions of competence or autonomy, but instead to superior error-estimation abilities. These results challenge the perspective that motivational influences are the root cause of self-controlled learning advantages. Instead, the findings add to the growing evidence highlighting that the informational value gained from task-relevant choices makes a greater relative contribution to these advantages than motivational influences do.

Huperzine A: Behavioral and Pharmacological Evaluation in Rhesus Monkeys

DTIC Science & Technology

2008-06-01

challenged with 30 ug/kg scopolamine . Doses of 1 and 10 ug/kg HUP improved choice accuracy on a previously learned delayed spatial memory task in the...elderly subjects, and doses of 10 and 100 ug/kg reversed the scopolamine -induced deficits in the younger monkeys. Unfortunately, no data regarding...interval) in the spatial memory task differentially modulated the drug effects on performance. Specifically, scopolamine impaired accuracy

Impaired Decision Making and Loss of Inhibitory-Control in a Rat Model of Huntington Disease

PubMed Central

El Massioui, Nicole; Lamirault, Charlotte; Yagüe, Sara; Adjeroud, Najia; Garces, Daniel; Maillard, Alexis; Tallot, Lucille; Yu-Taeger, Libo; Riess, Olaf; Allain, Philippe; Nguyen, Huu Phuc; von Hörsten, Stephan; Doyère, Valérie

2016-01-01

Cognitive deficits associated with Huntington disease (HD) are generally dominated by executive function disorders often associated with disinhibition and impulsivity/compulsivity. Few studies have directly examined symptoms and consequences of behavioral disinhibition in HD and its relation with decision-making. To assess the different forms of impulsivity in a transgenic model of HD (tgHD rats), two tasks assessing cognitive/choice impulsivity were used: risky decision-making with a rat gambling task (RGT) and intertemporal choices with a delay discounting task (DD). To assess waiting or action impulsivity the differential reinforcement of low rate of responding task (DRL) was used. In parallel, the volume as well as cellular activity of the amygdala was analyzed. In contrast to WT rats, 15 months old tgHD rats exhibited a poor efficiency in the RGT task with difficulties to choose advantageous options, a steep DD curve as delays increased in the DD task and a high rate of premature and bursts responses in the DRL task. tgHD rats also demonstrated a concomitant and correlated presence of both action and cognitive/choice impulsivity in contrast to wild type (WT) animals. Moreover, a reduced volume associated with an increased basal cellular activity of the central nucleus of amygdala indicated a dysfunctional amygdala in tgHD rats, which could underlie inhibitory dyscontrol. In conclusion, tgHD rats are a good model for impulsivity disorder that could be used more widely to identify potential pharmacotherapies to treat these invasive symptoms in HD. PMID:27833538

Using psychophysics to ask if the brain samples or maximizes

PubMed Central

Acuna, Daniel E.; Berniker, Max; Fernandes, Hugo L.; Kording, Konrad P.

2015-01-01

The two-alternative forced-choice (2AFC) task is the workhorse of psychophysics and is used to measure the just-noticeable difference, generally assumed to accurately quantify sensory precision. However, this assumption is not true for all mechanisms of decision making. Here we derive the behavioral predictions for two popular mechanisms, sampling and maximum a posteriori, and examine how they affect the outcome of the 2AFC task. These predictions are used in a combined visual 2AFC and estimation experiment. Our results strongly suggest that subjects use a maximum a posteriori mechanism. Further, our derivations and experimental paradigm establish the already standard 2AFC task as a behavioral tool for measuring how humans make decisions under uncertainty. PMID:25767093

Behavioral and Neural Signatures of Reduced Updating of Alternative Options in Alcohol-Dependent Patients during Flexible Decision-Making.

PubMed

Reiter, Andrea M F; Deserno, Lorenz; Kallert, Thomas; Heinze, Hans-Jochen; Heinz, Andreas; Schlagenhauf, Florian

2016-10-26

Addicted individuals continue substance use despite the knowledge of harmful consequences and often report having no choice but to consume. Computational psychiatry accounts have linked this clinical observation to difficulties in making flexible and goal-directed decisions in dynamic environments via consideration of potential alternative choices. To probe this in alcohol-dependent patients (n = 43) versus healthy volunteers (n = 35), human participants performed an anticorrelated decision-making task during functional neuroimaging. Via computational modeling, we investigated behavioral and neural signatures of inference regarding the alternative option. While healthy control subjects exploited the anticorrelated structure of the task to guide decision-making, alcohol-dependent patients were relatively better explained by a model-free strategy due to reduced inference on the alternative option after punishment. Whereas model-free prediction error signals were preserved, alcohol-dependent patients exhibited blunted medial prefrontal signatures of inference on the alternative option. This reduction was associated with patients' behavioral deficit in updating the alternative choice option and their obsessive-compulsive drinking habits. All results remained significant when adjusting for potential confounders (e.g., neuropsychological measures and gray matter density). A disturbed integration of alternative choice options implemented by the medial prefrontal cortex appears to be one important explanation for the puzzling question of why addicted individuals continue drug consumption despite negative consequences. In addiction, patients maintain substance use despite devastating consequences and often report having no choice but to consume. These clinical observations have been theoretically linked to disturbed mechanisms of inference, for example, to difficulties when learning statistical regularities of the environmental structure to guide decisions. Using computational modeling, we demonstrate disturbed inference on alternative choice options in alcohol addiction. Patients neglecting "what might have happened" was accompanied by blunted coding of inference regarding alternative choice options in the medial prefrontal cortex. An impaired integration of alternative choice options implemented by the medial prefrontal cortex might contribute to ongoing drug consumption in the face of evident negative consequences. Copyright © 2016 the authors 0270-6474/16/3610935-14$15.00/0.

Motivational state and reward content determine choice behavior under risk in mice.

PubMed

Leblond, Mona; Fan, David; Brynildsen, Julia K; Yin, Henry H

2011-01-01

Risk is a ubiquitous feature of the environment for most organisms, who must often choose between a small and certain reward and a larger but less certain reward. To study choice behavior under risk in a genetically well characterized species, we trained mice (C57BL/6) on a discrete trial, concurrent-choice task in which they must choose between two levers. Pressing one lever (safe choice) is always followed by a small reward. Pressing the other lever (risky choice) is followed by a larger reward, but only on some of the trials. The overall payoff is the same on both levers. When mice were not food deprived, they were indifferent to risk, choosing both levers with equal probability regardless of the level of risk. In contrast, following food or water deprivation, mice earning 10% sucrose solution were risk-averse, though the addition of alcohol to the sucrose solution dose-dependently reduced risk aversion, even before the mice became intoxicated. Our results falsify the budget rule in optimal foraging theory often used to explain behavior under risk. Instead, they suggest that the overall demand or desired amount for a particular reward determines risk preference. Changes in motivational state or reward identity affect risk preference by changing demand. Any manipulation that increases the demand for a reward also increases risk aversion, by selectively increasing the frequency of safe choices without affecting frequency of risky choices.

Prefrontal spatial working memory network predicts animal's decision making in a free choice saccade task

PubMed Central

Mochizuki, Kei

2015-01-01

While neurons in the lateral prefrontal cortex (PFC) encode spatial information during the performance of working memory tasks, they are also known to participate in subjective behavior such as spatial attention and action selection. In the present study, we analyzed the activity of primate PFC neurons during the performance of a free choice memory-guided saccade task in which the monkeys needed to choose a saccade direction by themselves. In trials when the receptive field location was subsequently chosen by the animal, PFC neurons with spatially selective visual response started to show greater activation before cue onset. This result suggests that the fluctuation of firing before cue presentation prematurely biased the representation of a certain spatial location and eventually encouraged the subsequent choice of that location. In addition, modulation of the activity by the animal's choice was observed only in neurons with high sustainability of activation and was also dependent on the spatial configuration of the visual cues. These findings were consistent with known characteristics of PFC neurons in information maintenance in spatial working memory function. These results suggest that precue fluctuation of spatial representation was shared and enhanced through the working memory network in the PFC and could finally influence the animal's free choice of saccade direction. The present study revealed that the PFC plays an important role in decision making in a free choice condition and that the dynamics of decision making are constrained by the network architecture embedded in this cortical area. PMID:26490287

Neural Correlates of Object-Associated Choice Behavior in the Perirhinal Cortex of Rats

PubMed Central

Ahn, Jae-Rong

2015-01-01

The perirhinal cortex (PRC) is reportedly important for object recognition memory, with supporting physiological evidence obtained largely from primate studies. Whether neurons in the rodent PRC also exhibit similar physiological correlates of object recognition, however, remains to be determined. We recorded single units from the PRC in a PRC-dependent, object-cued spatial choice task in which, when cued by an object image, the rat chose the associated spatial target from two identical discs appearing on a touchscreen monitor. The firing rates of PRC neurons were significantly modulated by critical events in the task, such as object sampling and choice response. Neuronal firing in the PRC was correlated primarily with the conjunctive relationships between an object and its associated choice response, although some neurons also responded to the choice response alone. However, we rarely observed a PRC neuron that represented a specific object exclusively regardless of spatial response in rats, although the neurons were influenced by the perceptual ambiguity of the object at the population level. Some PRC neurons fired maximally after a choice response, and this post-choice feedback signal significantly enhanced the neuronal specificity for the choice response in the subsequent trial. Our findings suggest that neurons in the rat PRC may not participate exclusively in object recognition memory but that their activity may be more dynamically modulated in conjunction with other variables, such as choice response and its outcomes. PMID:25632144

Dissecting "Peer Presence" and "Decisions" to Deepen Understanding of Peer Influence on Adolescent Risky Choice.

PubMed

Somerville, Leah H; Haddara, Nadia; Sasse, Stephanie F; Skwara, Alea C; Moran, Joseph M; Figner, Bernd

2018-04-27

This study evaluated the aspects of complex decisions influenced by peers, and components of peer involvement influential to adolescents' risky decisions. Participants (N = 140) aged 13-25 completed the Columbia Card Task (CCT), a risky choice task, isolating deliberation-reliant and affect-reliant decisions while alone, while a friend monitors choices, and while a friend is merely present. There is no condition in which a nonfriend peer is present. Results demonstrated the risk-increasing peer effect occurred in the youngest participants in the cold CCT and middle-late adolescents in the hot CCT, whereas other ages and contexts showed a risk-decreasing peer effect. Mere presence was not sufficient to influence risky behavior. These boundaries in age, decision, and peer involvement constrain prevailing models of adolescent peer influence. © 2018 Society for Research in Child Development.

Salience driven value integration explains decision biases and preference reversal

PubMed Central

Tsetsos, Konstantinos; Chater, Nick; Usher, Marius

2012-01-01

Human choice behavior exhibits many paradoxical and challenging patterns. Traditional explanations focus on how values are represented, but little is known about how values are integrated. Here we outline a psychophysical task for value integration that can be used as a window on high-level, multiattribute decisions. Participants choose between alternative rapidly presented streams of numerical values. By controlling the temporal distribution of the values, we demonstrate that this process underlies many puzzling choice paradoxes, such as temporal, risk, and framing biases, as well as preference reversals. These phenomena can be explained by a simple mechanism based on the integration of values, weighted by their salience. The salience of a sampled value depends on its temporal order and momentary rank in the decision context, whereas the direction of the weighting is determined by the task framing. We show that many known choice anomalies may arise from the microstructure of the value integration process. PMID:22635271

Estimating the executive demands of a one-back choice reaction time task by means of the selective interference paradigm.

PubMed

Szmalec, Arnaud; Vandierendonck, André

2007-08-01

The present study proposes a new executive task, the one-back choice reaction time (RT) task, and implements the selective interference paradigm to estimate the executive demands of the processing components involved in this task. Based on the similarities between a one-back choice RT task and the n-back updating task, it was hypothesized that one-back delaying of a choice reaction involves executive control. In three experiments, framed within Baddeley's (1986) working-memory model, a one-back choice RT task, a choice RT task, articulatory suppression, and matrix tapping were performed concurrently with primary tasks involving verbal, visuospatial, and executive processing. The results demonstrate that one-back delaying of a choice reaction interferes with tasks requiring executive control, while the potential interference at the level of the verbal or visuospatial working memory slave systems remains minimal.

Identity-Specific Reward Representations in Orbitofrontal Cortex Are Modulated by Selective Devaluation

PubMed Central

Howard, James D.

2017-01-01

Goal-directed behavior is sensitive to the current value of expected outcomes. This requires independent representations of specific rewards, which have been linked to orbitofrontal cortex (OFC) function. However, the mechanisms by which the human brain updates specific goals on the fly, and translates those updates into choices, have remained unknown. Here we implemented selective devaluation of appetizing food odors in combination with pattern-based neuroimaging and a decision-making task. We found that in a hungry state, participants chose to smell high-intensity versions of two value-matched food odor rewards. After eating a meal corresponding to one of the two odors, participants switched choices toward the low intensity of the sated odor but continued to choose the high intensity of the nonsated odor. This sensory-specific behavioral effect was mirrored by pattern-based changes in fMRI signal in lateral posterior OFC, where specific reward identity representations were altered after the meal for the sated food odor but retained for the nonsated counterpart. In addition, changes in functional connectivity between the OFC and general value coding in ventromedial prefrontal cortex (vmPFC) predicted individual differences in satiety-related choice behavior. These findings demonstrate how flexible representations of specific rewards in the OFC are updated by devaluation, and how functional connections to vmPFC reflect the current value of outcomes and guide goal-directed behavior. SIGNIFICANCE STATEMENT The orbitofrontal cortex (OFC) is critical for goal-directed behavior. A recent proposal is that OFC fulfills this function by representing a variety of state and task variables (“cognitive maps”), including a conjunction of expected reward identity and value. Here we tested how identity-specific representations of food odor reward are updated by satiety. We found that fMRI pattern-based signatures of reward identity in lateral posterior OFC were modulated after selective devaluation, and that connectivity between this region and general value coding ventromedial prefrontal cortex (vmPFC) predicted choice behavior. These results provide evidence for a mechanism by which devaluation modulates a cognitive map of expected reward in OFC and thereby alters general value signals in vmPFC to guide goal-directed behavior. PMID:28159906

Associative learning rapidly establishes neuronal representations of upcoming behavioral choices in crows

PubMed Central

Veit, Lena; Pidpruzhnykova, Galyna; Nieder, Andreas

2015-01-01

The ability to form associations between behaviorally relevant sensory stimuli is fundamental for goal-directed behaviors. We investigated neuronal activity in the telencephalic area nidopallium caudolaterale (NCL) while two crows (Corvus corone) performed a delayed association task. Whereas some paired associates were familiar to the crows, novel associations had to be learned and mapped to the same target stimuli within a single session. We found neurons that prospectively encoded the chosen test item during the delay for both familiar and newly learned associations. These neurons increased their selectivity during learning in parallel with the crows' increased behavioral performance. Thus, sustained activity in the NCL actively processes information for the upcoming behavioral choice. These data provide new insights into memory representations of behaviorally meaningful stimuli in birds, and how such representations are formed during learning. The findings suggest that the NCL plays a role in learning arbitrary associations, a cornerstone of corvids’ remarkable behavioral flexibility and adaptability. PMID:26598669

A Multi-Area Stochastic Model for a Covert Visual Search Task.

PubMed

Schwemmer, Michael A; Feng, Samuel F; Holmes, Philip J; Gottlieb, Jacqueline; Cohen, Jonathan D

2015-01-01

Decisions typically comprise several elements. For example, attention must be directed towards specific objects, their identities recognized, and a choice made among alternatives. Pairs of competing accumulators and drift-diffusion processes provide good models of evidence integration in two-alternative perceptual choices, but more complex tasks requiring the coordination of attention and decision making involve multistage processing and multiple brain areas. Here we consider a task in which a target is located among distractors and its identity reported by lever release. The data comprise reaction times, accuracies, and single unit recordings from two monkeys' lateral interparietal area (LIP) neurons. LIP firing rates distinguish between targets and distractors, exhibit stimulus set size effects, and show response-hemifield congruence effects. These data motivate our model, which uses coupled sets of leaky competing accumulators to represent processes hypothesized to occur in feature-selective areas and limb motor and pre-motor areas, together with the visual selection process occurring in LIP. Model simulations capture the electrophysiological and behavioral data, and fitted parameters suggest that different connection weights between LIP and the other cortical areas may account for the observed behavioral differences between the animals.

Subjective costs drive overly patient foraging strategies in rats on an intertemporal foraging task.

PubMed

Wikenheiser, Andrew M; Stephens, David W; Redish, A David

2013-05-14

Laboratory studies of decision making often take the form of two-alternative, forced-choice paradigms. In natural settings, however, many decision problems arise as stay/go choices. We designed a foraging task to test intertemporal decision making in rats via stay/go decisions. Subjects did not follow the rate-maximizing strategy of choosing only food items associated with short delays. Instead, rats were often willing to wait for surprisingly long periods, and consequently earned a lower rate of food intake than they might have by ignoring long-delay options. We tested whether foraging theory or delay discounting models predicted the behavior we observed but found that these models could not account for the strategies subjects selected. Subjects' behavior was well accounted for by a model that incorporated a cost for rejecting potential food items. Interestingly, subjects' cost sensitivity was proportional to environmental richness. These findings are at odds with traditional normative accounts of decision making but are consistent with retrospective considerations having a deleterious influence on decisions (as in the "sunk-cost" effect). More broadly, these findings highlight the utility of complementing existing assays of decision making with tasks that mimic more natural decision topologies.

Subjective costs drive overly patient foraging strategies in rats on an intertemporal foraging task

PubMed Central

Wikenheiser, Andrew M.; Stephens, David W.; Redish, A. David

2013-01-01

Laboratory studies of decision making often take the form of two-alternative, forced-choice paradigms. In natural settings, however, many decision problems arise as stay/go choices. We designed a foraging task to test intertemporal decision making in rats via stay/go decisions. Subjects did not follow the rate-maximizing strategy of choosing only food items associated with short delays. Instead, rats were often willing to wait for surprisingly long periods, and consequently earned a lower rate of food intake than they might have by ignoring long-delay options. We tested whether foraging theory or delay discounting models predicted the behavior we observed but found that these models could not account for the strategies subjects selected. Subjects’ behavior was well accounted for by a model that incorporated a cost for rejecting potential food items. Interestingly, subjects’ cost sensitivity was proportional to environmental richness. These findings are at odds with traditional normative accounts of decision making but are consistent with retrospective considerations having a deleterious influence on decisions (as in the “sunk-cost” effect). More broadly, these findings highlight the utility of complementing existing assays of decision making with tasks that mimic more natural decision topologies. PMID:23630289

Improving Motivation for Academics in Children with Autism

ERIC Educational Resources Information Center

Koegel, Lynn Kern; Singh, Anjileen K.; Koegel, Robert L.

2010-01-01

Many children with autism show very little interest in academic assignments and exhibit disruptive behavior when assignments are presented. Research indicates that incorporating specific motivational variables such as choice, interspersal of maintenance tasks, and natural reinforcers during intervention leads to improvements in core symptoms of…

How reinforcer type affects choice in economic games.

PubMed

Fantino, Edmund; Gaitan, Santino; Kennelly, Art; Stolarz-Fantino, Stephanie

2007-06-01

Behavioral economists stress that experiments on judgment and decision-making using economic games should be played with real money if the results are to have generality. Behavior analysts have sometimes disputed this contention and have reported results in which hypothetical rewards and real money have produced comparable outcomes. We review studies that have compared hypothetical and real money and discuss the results of two relevant experiments. In the first, using the Sharing Game developed in our laboratory, subjects' choices differed markedly depending on whether the rewards were real or hypothetical. In the second, using the Ultimatum and Dictator Games, we again found sharp differences between real and hypothetical rewards. However, this study also showed that time off from a tedious task could serve as a reinforcer every bit as potent as money. In addition to their empirical and theoretical contributions, these studies make the methodological point that meaningful studies may be conducted with economic games without spending money: time off from a tedious task can serve as a powerful reward.

Stimulus conflict triggers behavioral avoidance.

PubMed

Dignath, David; Eder, Andreas B

2015-12-01

According to a recent extension of the conflict-monitoring theory, conflict between two competing response tendencies is registered as an aversive event and triggers a motivation to avoid the source of conflict. In the present study, we tested this assumption. Over five experiments, we examined whether conflict is associated with an avoidance motivation and whether stimulus conflict or response conflict triggers an avoidance tendency. Participants first performed a color Stroop task. In a subsequent motivation test, participants responded to Stroop stimuli with approach- and avoidance-related lever movements. These results showed that Stroop-conflict stimuli increased the frequency of avoidance responses in a free-choice motivation test, and also increased the speed of avoidance relative to approach responses in a forced-choice test. High and low proportions of response conflict in the Stroop task had no effect on avoidance in the motivation test. Avoidance of conflict was, however, obtained even with new conflict stimuli that had not been presented before in a Stroop task, and when the Stroop task was replaced with an unrelated filler task. Taken together, these results suggest that stimulus conflict is sufficient to trigger avoidance.

Framing of task performance strategies: effects on performance in a multiattribute dynamic decision making environment.

PubMed

Nygren, T E

1997-09-01

It is well documented that the way a static choice task is "framed" can dramatically alter choice behavior, often leading to observable preference reversals. This framing effect appears to result from perceived changes in the nature or location of a person's initial reference point, but it is not clear how framing effects might generalize to performance on dynamic decision making tasks that are characterized by high workload, time constraints, risk, or stress. A study was conducted to examine the hypothesis that framing can introduce affective components to the decision making process and can influence, either favorably (positive frame) or adversely (negative frame), the implementation and use of decision making strategies in dynamic high-workload environments. Results indicated that negative frame participants were significantly impaired in developing and employing a simple optimal decision strategy relative to a positive frame group. Discussion focuses on implications of these results for models of dynamic decision making.

Decision-making impairments in the context of intact reward sensitivity in schizophrenia.

PubMed

Heerey, Erin A; Bell-Warren, Kimberly R; Gold, James M

2008-07-01

Deficits in motivated behavior and decision-making figure prominently in the behavioral syndrome that characterizes schizophrenia and are difficult both to treat and to understand. One explanation for these deficits is that schizophrenia decreases sensitivity to rewards in the environment. An alternate explanation is that sensitivity to rewards is intact but that poor integration of affective with cognitive information impairs the ability to use this information to guide behavior. We tested reward sensitivity with a modified version of an existing signal detection task with asymmetric reinforcement and decision-making with a probabilistic decision-making task in 40 participants with schizophrenia and 26 healthy participants. Results showed normal sensitivity to reward in participants with schizophrenia but differences in choice patterns on the decision-making task. A logistic regression model of the decision-making data showed that participants with schizophrenia differed from healthy participants in the ability to weigh potential outcomes, specifically potential losses, when choosing between competing response options. Deficits in working memory ability accounted for group differences in ability to use potential outcomes during decision-making. These results suggest that the implicit mechanisms that drive reward-based learning are surprisingly intact in schizophrenia but that poor ability to integrate cognitive and affective information when calculating the value of possible choices might hamper the ability to use such information during explicit decision-making.

Decision Making in Concurrent Multitasking: Do People Adapt to Task Interference?

PubMed Central

Nijboer, Menno; Taatgen, Niels A.; Brands, Annelies; Borst, Jelmer P.; van Rijn, Hedderik

2013-01-01

While multitasking has received a great deal of attention from researchers, we still know little about how well people adapt their behavior to multitasking demands. In three experiments, participants were presented with a multicolumn subtraction task, which required working memory in half of the trials. This primary task had to be combined with a secondary task requiring either working memory or visual attention, resulting in different types of interference. Before each trial, participants were asked to choose which secondary task they wanted to perform concurrently with the primary task. We predicted that if people seek to maximize performance or minimize effort required to perform the dual task, they choose task combinations that minimize interference. While performance data showed that the predicted optimal task combinations indeed resulted in minimal interference between tasks, the preferential choice data showed that a third of participants did not show any adaptation, and for the remainder it took a considerable number of trials before the optimal task combinations were chosen consistently. On the basis of these results we argue that, while in principle people are able to adapt their behavior according to multitasking demands, selection of the most efficient combination of strategies is not an automatic process. PMID:24244527

Diet-induced impulsivity: Effects of a high-fat and a high-sugar diet on impulsive choice in rats

PubMed Central

Pirkle, Jesseca R. A.; Kirkpatrick, Kimberly

2017-01-01

Impulsive choice is a common charactertistic among individuals with gambling problems, obesity, and substance abuse issues. Impulsive choice has been classified as a trans-disease process, and understanding the etiology of trait impulsivity could help to understand how diseases and disorders related to impulsive choice are manifested. The Western diet is a possible catalyst of impulsive choice as individuals who are obese and who eat diets high in fat and sugar are typically more impulsive. However, such correlational evidence is unable to discern the direction and causal nature of the relationship. The present study sought to determine how diet may directly contribute to impulsive choice. After 8 weeks of dietary exposure (high-fat, high-sugar, chow), the rats were tested on an impulsive choice task, which presented choices between a smaller-sooner reward (SS) and a larger-later reward (LL). Then, the rats were transferred to a chow diet and retested on the impulsive choice task. The high-sugar and high-fat groups made significantly more impulsive choices than the chow group. Both groups became more self-controlled when they were off the diet, but there were some residual effects of the diet on choice behavior. These results suggest that diet, specifically one high in processed fat or sugar, induces impulsive choice. This diet-induced impulsivity could be a precursor to other disorders that are characterized by impulsivity, such as diet-induced obesity, and could offer potential understanding of the trans-disease nature of impulsive choice. PMID:28662133

Diet-induced impulsivity: Effects of a high-fat and a high-sugar diet on impulsive choice in rats.

PubMed

Steele, Catherine C; Pirkle, Jesseca R A; Kirkpatrick, Kimberly

2017-01-01

Impulsive choice is a common charactertistic among individuals with gambling problems, obesity, and substance abuse issues. Impulsive choice has been classified as a trans-disease process, and understanding the etiology of trait impulsivity could help to understand how diseases and disorders related to impulsive choice are manifested. The Western diet is a possible catalyst of impulsive choice as individuals who are obese and who eat diets high in fat and sugar are typically more impulsive. However, such correlational evidence is unable to discern the direction and causal nature of the relationship. The present study sought to determine how diet may directly contribute to impulsive choice. After 8 weeks of dietary exposure (high-fat, high-sugar, chow), the rats were tested on an impulsive choice task, which presented choices between a smaller-sooner reward (SS) and a larger-later reward (LL). Then, the rats were transferred to a chow diet and retested on the impulsive choice task. The high-sugar and high-fat groups made significantly more impulsive choices than the chow group. Both groups became more self-controlled when they were off the diet, but there were some residual effects of the diet on choice behavior. These results suggest that diet, specifically one high in processed fat or sugar, induces impulsive choice. This diet-induced impulsivity could be a precursor to other disorders that are characterized by impulsivity, such as diet-induced obesity, and could offer potential understanding of the trans-disease nature of impulsive choice.

Mechanisms of Choice Behavior Shift Using Cue-approach Training

PubMed Central

Bakkour, Akram; Leuker, Christina; Hover, Ashleigh M.; Giles, Nathan; Poldrack, Russell A.; Schonberg, Tom

2016-01-01

Cue-approach training has been shown to effectively shift choices for snack food items by associating a cued button-press motor response to particular food items. Furthermore, attention was biased toward previously cued items, even when the cued item is not chosen for real consumption during a choice phase. However, the exact mechanism by which preferences shift during cue-approach training is not entirely clear. In three experiments, we shed light on the possible underlying mechanisms at play during this novel paradigm: (1) Uncued, wholly predictable motor responses paired with particular food items were not sufficient to elicit a preference shift; (2) Cueing motor responses early – concurrently with food item onset – and thus eliminating the need for heightened top–down attention to the food stimulus in preparation for a motor response also eliminated the shift in food preferences. This finding reinforces our hypothesis that heightened attention at behaviorally relevant points in time is key to changing choice behavior in the cue-approach task; (3) Crucially, indicating choice using eye movements rather than manual button presses preserves the effect, thus demonstrating that the shift in preferences is not governed by a learned motor response but more likely via modulation of subjective value in higher associative regions, consistent with previous neuroimaging results. Cue-approach training drives attention at behaviorally relevant points in time to modulate the subjective value of individual items, providing a mechanism for behavior change that does not rely on external reinforcement and that holds great promise for developing real world behavioral interventions. PMID:27047435

Motor control is decision-making.

PubMed

Wolpert, Daniel M; Landy, Michael S

2012-12-01

Motor behavior may be viewed as a problem of maximizing the utility of movement outcome in the face of sensory, motor and task uncertainty. Viewed in this way, and allowing for the availability of prior knowledge in the form of a probability distribution over possible states of the world, the choice of a movement plan and strategy for motor control becomes an application of statistical decision theory. This point of view has proven successful in recent years in accounting for movement under risk, inferring the loss function used in motor tasks, and explaining motor behavior in a wide variety of circumstances. Copyright © 2012 Elsevier Ltd. All rights reserved.

Recording single neurons' action potentials from freely moving pigeons across three stages of learning.

PubMed

Starosta, Sarah; Stüttgen, Maik C; Güntürkün, Onur

2014-06-02

While the subject of learning has attracted immense interest from both behavioral and neural scientists, only relatively few investigators have observed single-neuron activity while animals are acquiring an operantly conditioned response, or when that response is extinguished. But even in these cases, observation periods usually encompass only a single stage of learning, i.e. acquisition or extinction, but not both (exceptions include protocols employing reversal learning; see Bingman et al.(1) for an example). However, acquisition and extinction entail different learning mechanisms and are therefore expected to be accompanied by different types and/or loci of neural plasticity. Accordingly, we developed a behavioral paradigm which institutes three stages of learning in a single behavioral session and which is well suited for the simultaneous recording of single neurons' action potentials. Animals are trained on a single-interval forced choice task which requires mapping each of two possible choice responses to the presentation of different novel visual stimuli (acquisition). After having reached a predefined performance criterion, one of the two choice responses is no longer reinforced (extinction). Following a certain decrement in performance level, correct responses are reinforced again (reacquisition). By using a new set of stimuli in every session, animals can undergo the acquisition-extinction-reacquisition process repeatedly. Because all three stages of learning occur in a single behavioral session, the paradigm is ideal for the simultaneous observation of the spiking output of multiple single neurons. We use pigeons as model systems, but the task can easily be adapted to any other species capable of conditioned discrimination learning.

Development and implementation of a three-choice serial reaction time task for zebrafish (Danio rerio).

PubMed

Parker, Matthew O; Millington, Mollie E; Combe, Fraser J; Brennan, Caroline H

2012-02-01

Zebrafish are an established and widely utilized developmental genetic model system, but limitations in developed behavioral assays have meant that their potential as a model in behavioral neuroscience has yet to be fully realized. Here, we describe the development of a novel operant behavioral assay to examine a variety of aspects of stimulus control in zebrafish using a 3 choice serial reaction time task (3 CSRTT). Fish were briefly exposed to three spatially distinct, but perceptually identical stimuli, presented in a random order after a fixed-time inter-trial interval (ITI). Entries to the correct response aperture either during the stimulus presentation, or within a brief limited hold period following presentation, were reinforced with illumination of the magazine light and delivery of a small food reward. Following training, premature responding was probed with a long-ITI session three times; once at baseline, once following a saline injection and once following an injection of a low dose of amphetamine (AMPH; 0.025 mg/kg). We predicted that if premature responding was related to impulsivity (as in rodents) it would be reduced following the AMPH injection. Results confirmed that zebrafish could learn to perform a complex operant task similar to tasks developed for rodents which are used to probe sustained attention and impulsivity, but the results from the AMPH trials were inconclusive. This study provides the foundations for development and further validation of this species as a model for some aspects of human attentional and impulse control disorders, such as substance abuse disorder. Copyright © 2011 Elsevier B.V. All rights reserved.

Cannabinoid CB1 Receptor Activation Mediates the Opposing Effects of Amphetamine on Impulsive Action and Impulsive Choice

PubMed Central

Wiskerke, Joost; Stoop, Nicky; Schetters, Dustin; Schoffelmeer, Anton N. M.; Pattij, Tommy

2011-01-01

It is well known that acute challenges with psychostimulants such as amphetamine affect impulsive behavior. We here studied the pharmacology underlying the effects of amphetamine in two rat models of impulsivity, the 5-choice serial reaction time task (5-CSRTT) and the delayed reward task (DRT), providing measures of inhibitory control, an aspect of impulsive action, and impulsive choice, respectively. We focused on the role of cannabinoid CB1 receptor activation in amphetamine-induced impulsivity as there is evidence that acute challenges with psychostimulants activate the endogenous cannabinoid system, and CB1 receptor activity modulates impulsivity in both rodents and humans. Results showed that pretreatment with either the CB1 receptor antagonist/inverse agonist SR141716A or the neutral CB1 receptor antagonist O-2050 dose-dependently improved baseline inhibitory control in the 5-CSRTT. Moreover, both compounds similarly attenuated amphetamine-induced inhibitory control deficits, suggesting that CB1 receptor activation by endogenously released cannabinoids mediates this aspect of impulsive action. Direct CB1 receptor activation by Δ9-Tetrahydrocannabinol (Δ9-THC) did, however, not affect inhibitory control. Although neither SR141716A nor O-2050 affected baseline impulsive choice in the DRT, both ligands completely prevented amphetamine-induced reductions in impulsive decision making, indicating that CB1 receptor activity may decrease this form of impulsivity. Indeed, acute Δ9-THC was found to reduce impulsive choice in a CB1 receptor-dependent way. Together, these results indicate an important, though complex role for cannabinoid CB1 receptor activity in the regulation of impulsive action and impulsive choice as well as the opposite effects amphetamine has on both forms of impulsive behavior. PMID:22016780

Prestimulus influences on auditory perception from sensory representations and decision processes.

PubMed

Kayser, Stephanie J; McNair, Steven W; Kayser, Christoph

2016-04-26

The qualities of perception depend not only on the sensory inputs but also on the brain state before stimulus presentation. Although the collective evidence from neuroimaging studies for a relation between prestimulus state and perception is strong, the interpretation in the context of sensory computations or decision processes has remained difficult. In the auditory system, for example, previous studies have reported a wide range of effects in terms of the perceptually relevant frequency bands and state parameters (phase/power). To dissociate influences of state on earlier sensory representations and higher-level decision processes, we collected behavioral and EEG data in human participants performing two auditory discrimination tasks relying on distinct acoustic features. Using single-trial decoding, we quantified the relation between prestimulus activity, relevant sensory evidence, and choice in different task-relevant EEG components. Within auditory networks, we found that phase had no direct influence on choice, whereas power in task-specific frequency bands affected the encoding of sensory evidence. Within later-activated frontoparietal regions, theta and alpha phase had a direct influence on choice, without involving sensory evidence. These results delineate two consistent mechanisms by which prestimulus activity shapes perception. However, the timescales of the relevant neural activity depend on the specific brain regions engaged by the respective task.

Prestimulus influences on auditory perception from sensory representations and decision processes

PubMed Central

McNair, Steven W.

2016-01-01

The qualities of perception depend not only on the sensory inputs but also on the brain state before stimulus presentation. Although the collective evidence from neuroimaging studies for a relation between prestimulus state and perception is strong, the interpretation in the context of sensory computations or decision processes has remained difficult. In the auditory system, for example, previous studies have reported a wide range of effects in terms of the perceptually relevant frequency bands and state parameters (phase/power). To dissociate influences of state on earlier sensory representations and higher-level decision processes, we collected behavioral and EEG data in human participants performing two auditory discrimination tasks relying on distinct acoustic features. Using single-trial decoding, we quantified the relation between prestimulus activity, relevant sensory evidence, and choice in different task-relevant EEG components. Within auditory networks, we found that phase had no direct influence on choice, whereas power in task-specific frequency bands affected the encoding of sensory evidence. Within later-activated frontoparietal regions, theta and alpha phase had a direct influence on choice, without involving sensory evidence. These results delineate two consistent mechanisms by which prestimulus activity shapes perception. However, the timescales of the relevant neural activity depend on the specific brain regions engaged by the respective task. PMID:27071110

Response allocation to concurrent fixed-ratio reinforcement schedules with work requirements by adults with mental retardation and typical preschool children.

PubMed Central

Cuvo, A J; Lerch, L J; Leurquin, D A; Gaffaney, T J; Poppen, R L

1998-01-01

The present experiments examined the effect of work requirements in combination with reinforcement schedule on the choice behavior of adults with mental retardation and preschool children. The work requirements of age-appropriate tasks (i.e., sorting silverware, jumping hurdles, tossing beanbags) were manipulated. Participants were presented with their choice of two response options for each trial that varied simultaneously on both work requirement and reinforcement schedule. Results showed that when responding to both choices occurred on the same reinforcement schedule, participants allocated most of their responses to the option with the easier work requirement. When the response option requiring less work was on a leaner reinforcement schedule, most participants shifted their choice to exert more work. There were individual differences across participants regarding their pattern of responding and when they switched from the lesser to the greater work requirement. Data showed that participants' responding was largely controlled by the reinforcement received for responding to each level of work. Various conceptualizations regarding the effects of work requirements on choice behavior are discussed. PMID:9532750

Differential neurobiological effects of expert advice on risky choice in adolescents and adults.

PubMed

Engelmann, Jan B; Moore, Sara; Monica Capra, C; Berns, Gregory S

2012-06-01

We investigated behavioral and neurobiological mechanisms by which risk-averse advice, provided by an expert, affected risky decisions across three developmental groups [early adolescents (12-14 years), late adolescents (15-17 years), adults (18+ years)]. Using cumulative prospect theory, we modeled choice behavior during a risky-choice task. Results indicate that advice had a significantly greater impact on risky choice in both adolescent groups than in adults. Using functional magnetic resonance imaging, we investigated the neural correlates of this behavioral effect. Developmental effects on correlations between brain activity and valuation parameters were obtained in regions that can be classified into (i) cognitive control regions, such as dorsolateral prefrontal cortex (DLPFC) and ventrolateral PFC; (ii) social cognition regions, such as posterior temporoparietal junction; and (iii) reward-related regions, such as ventromedial PFC (vmPFC) and ventral striatum. Within these regions, differential effects of advice on neural correlates of valuation were observed across development. Specifically, advice increased the correlation strength between brain activity and parameters reflective of safe choice options in adolescent DLPFC and decreased correlation strength between activity and parameters reflective of risky choice options in adult vmPFC. Taken together, results indicate that, across development, distinct brain systems involved in cognitive control and valuation mediate the risk-reducing effect of advice during decision making under risk via specific enhancements and reductions of the correlation strength between brain activity and valuation parameters.

Loss of lateral prefrontal cortex control in food-directed attention and goal-directed food choice in obesity.

PubMed

Janssen, Lieneke K; Duif, Iris; van Loon, Ilke; Wegman, Joost; de Vries, Jeanne H M; Cools, Roshan; Aarts, Esther

2017-02-01

Loss of lateral prefrontal cortex (lPFC)-mediated attentional control may explain the automatic tendency to eat in the face of food. Here, we investigate the neurocognitive mechanism underlying attentional bias to food words and its association with obesity using a food Stroop task. We tested 76 healthy human subjects with a wide body mass index (BMI) range (19-35kg/m 2 ) using fMRI. As a measure of obesity we calculated individual obesity scores based on BMI, waist circumference and waist-to-hip ratio using principal component analyses. To investigate the automatic tendency to overeat directly, the same subjects performed a separate behavioral outcome devaluation task measuring the degree of goal-directed versus automatic food choices. We observed that increased obesity scores were associated with diminished lPFC responses during food attentional bias. This was accompanied by decreased goal-directed control of food choices following outcome devaluation. Together these findings suggest that deficient control of both food-directed attention and choice may contribute to obesity, particularly given our obesogenic environment with food cues everywhere, and the choice to ignore or indulge despite satiety. Copyright © 2016 Elsevier Inc. All rights reserved.

Math-related career aspirations and choices within Eccles et al.'s expectancy-value theory of achievement-related behaviors.

PubMed

Lauermann, Fani; Tsai, Yi-Miau; Eccles, Jacquelynne S

2017-08-01

Which occupation to pursue is one of the more consequential decisions people make and represents a key developmental task. Yet the underlying developmental processes associated with either individual or group differences in occupational choices are still not well understood. This study contributes toward filling this gap, focusing in particular on the math domain. We examined two aspects of Eccles et al.'s (1983) expectancy-value theory of achievement-related behaviors: (a) the reciprocal associations between adolescents' expectancy and subjective task value beliefs and adolescents' career plans and (b) the multiplicative association between expectancies and values in predicting occupational outcomes in the math domain. Our analyses indicate that adolescents' expectancy and subjective task value beliefs about math and their math- or science-related career plans reported at the beginning and end of high school predict each other over time, with the exception of intrinsic interest in math. Furthermore, multiplicative associations between adolescents' expectancy and subjective task value beliefs about math predict math-related career attainment approximately 15 years after graduation from high school. Gender differences emerged regarding career-related beliefs and career attainment, with male students being more likely than female to both pursue and attain math-related careers. These gender differences could not be explained by differences in beliefs about math as an academic subject. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Network approaches for expert decisions in sports.

PubMed

Glöckner, Andreas; Heinen, Thomas; Johnson, Joseph G; Raab, Markus

2012-04-01

This paper focuses on a model comparison to explain choices based on gaze behavior via simulation procedures. We tested two classes of models, a parallel constraint satisfaction (PCS) artificial neuronal network model and an accumulator model in a handball decision-making task from a lab experiment. Both models predict action in an option-generation task in which options can be chosen from the perspective of a playmaker in handball (i.e., passing to another player or shooting at the goal). Model simulations are based on a dataset of generated options together with gaze behavior measurements from 74 expert handball players for 22 pieces of video footage. We implemented both classes of models as deterministic vs. probabilistic models including and excluding fitted parameters. Results indicated that both classes of models can fit and predict participants' initially generated options based on gaze behavior data, and that overall, the classes of models performed about equally well. Early fixations were thereby particularly predictive for choices. We conclude that the analyses of complex environments via network approaches can be successfully applied to the field of experts' decision making in sports and provide perspectives for further theoretical developments. Copyright © 2011 Elsevier B.V. All rights reserved.

Dopamine D3 Receptor Availability Is Associated with Inflexible Decision Making.

PubMed

Groman, Stephanie M; Smith, Nathaniel J; Petrullli, J Ryan; Massi, Bart; Chen, Lihui; Ropchan, Jim; Huang, Yiyun; Lee, Daeyeol; Morris, Evan D; Taylor, Jane R

2016-06-22

Dopamine D2/3 receptor signaling is critical for flexible adaptive behavior; however, it is unclear whether D2, D3, or both receptor subtypes modulate precise signals of feedback and reward history that underlie optimal decision making. Here, PET with the radioligand [(11)C]-(+)-PHNO was used to quantify individual differences in putative D3 receptor availability in rodents trained on a novel three-choice spatial acquisition and reversal-learning task with probabilistic reinforcement. Binding of [(11)C]-(+)-PHNO in the midbrain was negatively related to the ability of rats to adapt to changes in rewarded locations, but not to the initial learning. Computational modeling of choice behavior in the reversal phase indicated that [(11)C]-(+)-PHNO binding in the midbrain was related to the learning rate and sensitivity to positive, but not negative, feedback. Administration of a D3-preferring agonist likewise impaired reversal performance by reducing the learning rate and sensitivity to positive feedback. These results demonstrate a previously unrecognized role for D3 receptors in select aspects of reinforcement learning and suggest that individual variation in midbrain D3 receptors influences flexible behavior. Our combined neuroimaging, behavioral, pharmacological, and computational approach implicates the dopamine D3 receptor in decision-making processes that are altered in psychiatric disorders. Flexible decision-making behavior is dependent upon dopamine D2/3 signaling in corticostriatal brain regions. However, the role of D3 receptors in adaptive, goal-directed behavior has not been thoroughly investigated. By combining PET imaging with the D3-preferring radioligand [(11)C]-(+)-PHNO, pharmacology, a novel three-choice probabilistic discrimination and reversal task and computational modeling of behavior in rats, we report that naturally occurring variation in [(11)C]-(+)-PHNO receptor availability relates to specific aspects of flexible decision making. We confirm these relationships using a D3-preferring agonist, thus identifying a unique role of midbrain D3 receptors in decision-making processes. Copyright © 2016 the authors 0270-6474/16/366732-10$15.00/0.

Prefrontal spatial working memory network predicts animal's decision making in a free choice saccade task.

PubMed

Mochizuki, Kei; Funahashi, Shintaro

2016-01-01

While neurons in the lateral prefrontal cortex (PFC) encode spatial information during the performance of working memory tasks, they are also known to participate in subjective behavior such as spatial attention and action selection. In the present study, we analyzed the activity of primate PFC neurons during the performance of a free choice memory-guided saccade task in which the monkeys needed to choose a saccade direction by themselves. In trials when the receptive field location was subsequently chosen by the animal, PFC neurons with spatially selective visual response started to show greater activation before cue onset. This result suggests that the fluctuation of firing before cue presentation prematurely biased the representation of a certain spatial location and eventually encouraged the subsequent choice of that location. In addition, modulation of the activity by the animal's choice was observed only in neurons with high sustainability of activation and was also dependent on the spatial configuration of the visual cues. These findings were consistent with known characteristics of PFC neurons in information maintenance in spatial working memory function. These results suggest that precue fluctuation of spatial representation was shared and enhanced through the working memory network in the PFC and could finally influence the animal's free choice of saccade direction. The present study revealed that the PFC plays an important role in decision making in a free choice condition and that the dynamics of decision making are constrained by the network architecture embedded in this cortical area. Copyright © 2016 the American Physiological Society.

Motivational State and Reward Content Determine Choice Behavior under Risk in Mice

PubMed Central

Leblond, Mona; Fan, David; Brynildsen, Julia K.; Yin, Henry H.

2011-01-01

Risk is a ubiquitous feature of the environment for most organisms, who must often choose between a small and certain reward and a larger but less certain reward. To study choice behavior under risk in a genetically well characterized species, we trained mice (C57BL/6) on a discrete trial, concurrent-choice task in which they must choose between two levers. Pressing one lever (safe choice) is always followed by a small reward. Pressing the other lever (risky choice) is followed by a larger reward, but only on some of the trials. The overall payoff is the same on both levers. When mice were not food deprived, they were indifferent to risk, choosing both levers with equal probability regardless of the level of risk. In contrast, following food or water deprivation, mice earning 10% sucrose solution were risk-averse, though the addition of alcohol to the sucrose solution dose-dependently reduced risk aversion, even before the mice became intoxicated. Our results falsify the budget rule in optimal foraging theory often used to explain behavior under risk. Instead, they suggest that the overall demand or desired amount for a particular reward determines risk preference. Changes in motivational state or reward identity affect risk preference by changing demand. Any manipulation that increases the demand for a reward also increases risk aversion, by selectively increasing the frequency of safe choices without affecting frequency of risky choices. PMID:21966504

The cognitive and neural basis of option generation and subsequent choice.

PubMed

Kaiser, Stefan; Simon, Joe J; Kalis, Annemarie; Schweizer, Sophie; Tobler, Philippe N; Mojzisch, Andreas

2013-12-01

Decision-making research has thoroughly investigated how people choose from a set of externally provided options. However, in ill-structured real-world environments, possible options for action are not defined by the situation but have to be generated by the agent. Here, we apply behavioral analysis (Study 1) and functional magnetic resonance imaging (Study 2) to investigate option generation and subsequent choice. For this purpose, we employ a new experimental task that requires participants to generate options for simple real-world scenarios and to subsequently decide among the generated options. Correlational analysis with a cognitive test battery suggests that retrieval of options from long-term memory is a relevant process during option generation. The results of the fMRI study demonstrate that option generation in simple real-world scenarios recruits the anterior prefrontal cortex. Furthermore, we show that choice behavior and its neural correlates differ between self-generated and externally provided options. Specifically, choice between self-generated options is associated with stronger recruitment of the dorsal anterior cingulate cortex. This impact of option generation on subsequent choice underlines the need for an expanded model of decision making to accommodate choice between self-generated options.

Risk preferences impose a hidden distortion on measures of choice impulsivity

PubMed Central

Konova, Anna B.; Louie, Kenway; Glimcher, Paul W.

2018-01-01

Measuring temporal discounting through the use of intertemporal choice tasks is now the gold standard method for quantifying human choice impulsivity (impatience) in neuroscience, psychology, behavioral economics, public health and computational psychiatry. A recent area of growing interest is individual differences in discounting levels, as these may predispose to (or protect from) mental health disorders, addictive behaviors, and other diseases. At the same time, more and more studies have been dedicated to the quantification of individual attitudes towards risk, which have been measured in many clinical and non-clinical populations using closely related techniques. Economists have pointed to interactions between measurements of time preferences and risk preferences that may distort estimations of the discount rate. However, although becoming standard practice in economics, discount rates and risk preferences are rarely measured simultaneously in the same subjects in other fields, and the magnitude of the imposed distortion is unknown in the assessment of individual differences. Here, we show that standard models of temporal discounting —such as a hyperbolic discounting model widely present in the literature which fails to account for risk attitudes in the estimation of discount rates— result in a large and systematic pattern of bias in estimated discounting parameters. This can lead to the spurious attribution of differences in impulsivity between individuals when in fact differences in risk attitudes account for observed behavioral differences. We advance a model which, when applied to standard choice tasks typically used in psychology and neuroscience, provides both a better fit to the data and successfully de-correlates risk and impulsivity parameters. This results in measures that are more accurate and thus of greater utility to the many fields interested in individual differences in impulsivity. PMID:29373590

Identifying the mechanisms through which behavioral weight-loss treatment improves food decision-making in obesity.

PubMed

Demos, Kathryn E; McCaffery, Jeanne M; Thomas, J Graham; Mailloux, Kimberly A; Hare, Todd A; Wing, Rena R

2017-07-01

Behavioral weight loss (BWL) programs are the recommended treatment for obesity, yet it is unknown whether these programs change one's ability to use self-control in food choices and what specific mechanisms support such change. Using experimental economics methods, we investigated whether changes in dietary behavior in individuals with obesity following BWL are driven by one or more of the following potential mechanisms: changes in the perception of the 1) health or 2) taste of food items, and/or 3) shifting decision weights for health versus taste attributes. Therefore, we compared these mechanisms between obese participants and lifetime normal weight controls (NW) both before and after BWL. Females with obesity (N = 37, mean BMI = 33.2) completed a food choice task involving health ratings, taste ratings, and decision-making pre- and post-standard BWL intervention. NW controls (N = 30, BMI = 22.4) completed the same task. Individuals with obesity exhibited increased self-control (selecting healthier, less tasty food choices) post-treatment. However, their rates of self-control remained significantly lower than NW. We found no differences in initial health perceptions across groups, and no changes with treatment. In contrast, taste ratings and the relative value of taste versus health decreased following treatment. Although, post-treatment participants continued to perceive unhealthy foods as tastier and used less self-control than NW controls, they showed significant improvements in these domains following a BWL intervention. To help individuals improve dietary decisions, additional research is needed to determine how to make greater changes in taste preferences and/or the assignment of value to taste versus health attributes in food choices. Copyright © 2017 Elsevier Ltd. All rights reserved.

Risk preferences impose a hidden distortion on measures of choice impulsivity.

PubMed

Lopez-Guzman, Silvia; Konova, Anna B; Louie, Kenway; Glimcher, Paul W

2018-01-01

Measuring temporal discounting through the use of intertemporal choice tasks is now the gold standard method for quantifying human choice impulsivity (impatience) in neuroscience, psychology, behavioral economics, public health and computational psychiatry. A recent area of growing interest is individual differences in discounting levels, as these may predispose to (or protect from) mental health disorders, addictive behaviors, and other diseases. At the same time, more and more studies have been dedicated to the quantification of individual attitudes towards risk, which have been measured in many clinical and non-clinical populations using closely related techniques. Economists have pointed to interactions between measurements of time preferences and risk preferences that may distort estimations of the discount rate. However, although becoming standard practice in economics, discount rates and risk preferences are rarely measured simultaneously in the same subjects in other fields, and the magnitude of the imposed distortion is unknown in the assessment of individual differences. Here, we show that standard models of temporal discounting -such as a hyperbolic discounting model widely present in the literature which fails to account for risk attitudes in the estimation of discount rates- result in a large and systematic pattern of bias in estimated discounting parameters. This can lead to the spurious attribution of differences in impulsivity between individuals when in fact differences in risk attitudes account for observed behavioral differences. We advance a model which, when applied to standard choice tasks typically used in psychology and neuroscience, provides both a better fit to the data and successfully de-correlates risk and impulsivity parameters. This results in measures that are more accurate and thus of greater utility to the many fields interested in individual differences in impulsivity.

Restrictive Food Intake As A Choice – A Paradigm for Study

PubMed Central

Steinglass, Joanna; Foerde, Karin; Kostro, Katrina; Shohamy, Daphna; Timothy Walsh, B.

2014-01-01

Objective: Inadequate intake and preference for low-calorie foods are salient behavioral features of Anorexia Nervosa (AN). The neurocognitive mechanisms underlying pathological food choice have not been characterized. This study aimed to develop a new paradigm for experimentally modeling maladaptive food choice in AN. Method: Individuals with AN (n=22) and healthy controls (HC, n=20) participated in a computer-based Food Choice Task, adapted for individuals with eating disorders. Participants first rated 43 food images (including high-fat and low-fat items) for Healthiness and Tastiness; an item rated neutral on both blocks was then selected as the Reference item. On each of 42 subsequent trials participants were asked to choose between the food item presented and the Reference item. Results: The AN group was less likely to choose high-fat foods relative to HC, as evidenced both in multilevel logistic regression (z=2.59, p=0.009) and ANOVA (F(1,39)=7.80, p=0.008) analyses. Health ratings influenced choice significantly more in AN relative to HC (z=2.7, p=0.006), and were more related to Taste among AN (χ2=4.10, p=0.04). Additionally, Taste ratings declined with duration of illness(r=−0.50, p=0.02). Conclusions: The Food Choice Task captures the preference for low-fat foods among individuals with AN. The findings suggest that the experience of tastiness changes over time and may contribute to perpetuation of illness. By providing an experimental quantitative measure of food restriction, this task opens the door to new experimental investigations into the cognitive, affective and neural factors contributing to maladaptive food choices characteristic of AN. PMID:25130380

Restrictive food intake as a choice--a paradigm for study.

PubMed

Steinglass, Joanna; Foerde, Karin; Kostro, Katrina; Shohamy, Daphna; Walsh, B Timothy

2015-01-01

Inadequate intake and preference for low-calorie foods are salient behavioral features of Anorexia Nervosa (AN). The neurocognitive mechanisms underlying pathological food choice have not been characterized. This study aimed to develop a new paradigm for experimentally modeling maladaptive food choice in AN. Individuals with AN (n = 22) and healthy controls (HC, n = 20) participated in a computer-based Food Choice Task, adapted for individuals with eating disorders. Participants first rated 43 food images (including high-fat and low-fat items) for Healthiness and Tastiness; an item rated neutral on both blocks was then selected as the Reference item. On each of 42 subsequent trials participants were asked to choose between the food item presented and the Reference item. The AN group was less likely to choose high-fat foods relative to HC, as evidenced both in multilevel logistic regression (z = 2.59, p = .009) and ANOVA (F(1,39) = 7.80, p = .008) analyses. Health ratings influenced choice significantly more in AN relative to HC (z = 2.7, p = .006), and were more related to Taste among AN (χ(2) = 4.10, p = .04). Additionally, taste ratings declined with duration of illness (r = -.50, p = .02). The Food Choice Task captures the preference for low-fat foods among individuals with AN. The findings suggest that the experience of tastiness changes over time and may contribute to perpetuation of illness. By providing an experimental quantitative measure of food restriction, this task opens the door to new experimental investigations into the cognitive, affective, and neural factors contributing to maladaptive food choices characteristic of AN. © 2014 Wiley Periodicals, Inc.

The effects of task difficulty, novelty and the size of the search space on intrinsically motivated exploration.

PubMed

Baranes, Adrien F; Oudeyer, Pierre-Yves; Gottlieb, Jacqueline

2014-01-01

Devising efficient strategies for exploration in large open-ended spaces is one of the most difficult computational problems of intelligent organisms. Because the available rewards are ambiguous or unknown during the exploratory phase, subjects must act in intrinsically motivated fashion. However, a vast majority of behavioral and neural studies to date have focused on decision making in reward-based tasks, and the rules guiding intrinsically motivated exploration remain largely unknown. To examine this question we developed a paradigm for systematically testing the choices of human observers in a free play context. Adult subjects played a series of short computer games of variable difficulty, and freely choose which game they wished to sample without external guidance or physical rewards. Subjects performed the task in three distinct conditions where they sampled from a small or a large choice set (7 vs. 64 possible levels of difficulty), and where they did or did not have the possibility to sample new games at a constant level of difficulty. We show that despite the absence of external constraints, the subjects spontaneously adopted a structured exploration strategy whereby they (1) started with easier games and progressed to more difficult games, (2) sampled the entire choice set including extremely difficult games that could not be learnt, (3) repeated moderately and high difficulty games much more frequently than was predicted by chance, and (4) had higher repetition rates and chose higher speeds if they could generate new sequences at a constant level of difficulty. The results suggest that intrinsically motivated exploration is shaped by several factors including task difficulty, novelty and the size of the choice set, and these come into play to serve two internal goals-maximize the subjects' knowledge of the available tasks (exploring the limits of the task set), and maximize their competence (performance and skills) across the task set.

Developing Academic Self-Efficacy: Strategies to Support Gifted Elementary School Students

ERIC Educational Resources Information Center

Merriman, Lauren

2012-01-01

Self-efficacy is the belief in one's capacity to perform and accomplish goals. Specifically, academic self-efficacy refers to a student's perception of their ability to engage and successfully complete academic tasks. Self-efficacy affects students' behavioral choices, motivation, thought patterns and responses, perception of control, and…

Action Monitoring and Perfectionism in Anorexia Nervosa

ERIC Educational Resources Information Center

Pieters, Guido L. M.; de Bruijn, Ellen R. A.; Maas, Yvonne; Hulstijn, Wouter; Vandereycken, Walter; Peuskens, Joseph; Sabbe, Bernard G.

2007-01-01

To study action monitoring in anorexia nervosa, behavioral and EEG measures were obtained in underweight anorexia nervosa patients (n=17) and matched healthy controls (n=19) while performing a speeded choice-reaction task. Our main measures of interest were questionnaire outcomes, reaction times, error rates, and the error-related negativity ERP…

Temporal Discounting and Inter-Temporal Choice in Rhesus Monkeys

PubMed Central

Hwang, Jaewon; Kim, Soyoun; Lee, Daeyeol

2009-01-01

Humans and animals are more likely to take an action leading to an immediate reward than actions with delayed rewards of similar magnitudes. Although such devaluation of delayed rewards has been almost universally described by hyperbolic discount functions, the rate of this temporal discounting varies substantially among different animal species. This might be in part due to the differences in how the information about reward is presented to decision makers. In previous animal studies, reward delays or magnitudes were gradually adjusted across trials, so the animals learned the properties of future rewards from the rewards they waited for and consumed previously. In contrast, verbal cues have been used commonly in human studies. In the present study, rhesus monkeys were trained in a novel inter-temporal choice task in which the magnitude and delay of reward were indicated symbolically using visual cues and varied randomly across trials. We found that monkeys could extract the information about reward delays from visual symbols regardless of the number of symbols used to indicate the delay. The rate of temporal discounting observed in the present study was comparable to the previous estimates in other mammals, and the animal's choice behavior was largely consistent with hyperbolic discounting. Our results also suggest that the rate of temporal discounting might be influenced by contextual factors, such as the novelty of the task. The flexibility furnished by this new inter-temporal choice task might be useful for future neurobiological investigations on inter-temporal choice in non-human primates. PMID:19562091

Acute alcohol effects on impulsivity: associations with drinking and driving behavior.

PubMed

McCarthy, Denis M; Niculete, Maria E; Treloar, Hayley R; Morris, David H; Bartholow, Bruce D

2012-12-01

Although drink drivers exhibit higher levels of trait impulsivity, no studies have tested the hypothesis that drink drivers experience increased impulsivity while intoxicated. We tested this hypothesis for two impulsivity constructs: delay discounting and behavioral inhibition. A within-subjects study comparing performance of drink drivers and non-drink drivers on behavioral measures of impulsivity in alcohol and no-beverage sessions. A laboratory setting at the University of Missouri. Twenty-nine young adults who were at least moderate drinkers were recruited from the local community and the University of Missouri. Impulsivity was assessed using the Two Choice Impulsivity Paradigm (TCIP) and the Stop-Signal Task. Participants also completed self-report measures of binge drinking and trait impulsivity. In the no-beverage session, TCIP impulsive choices did not differ between drinking and driving groups (P = 0.93). In the alcohol session, drink drivers made more TCIP impulsive choices on both the ascending (P < 0.01) and descending limb (P < 0.01) of the blood alcohol concentration curve than their peers who did not drink and drive. Drinking and driving groups did not differ on the Stop-Signal Task. Supplementary analyses indicated that effects for the TCIP were not explained by individual differences in trait impulsivity. Individuals who report having three or more drinks before driving show greater impulsivity when under the influence of alcohol than those who do not report heavy drinking before driving. © 2012 The Authors, Addiction © 2012 Society for the Study of Addiction.

Acute alcohol effects on impulsivity: Associations with drinking and driving behavior

PubMed Central

McCarthy, Denis M.; Niculete, Maria E.; Treloar, Hayley R.; Morris, David H.; Bartholow, Bruce D.

2012-01-01

Aims Although drink drivers exhibit higher levels of trait impulsivity, no studies have tested the hypothesis that drink drivers experience increased impulsivity while intoxicated. We tested this hypothesis for two impulsivity constructs: delay discounting and behavioral inhibition. Design A within-subjects study comparing performance of drink drivers and non-drink drivers on behavioral measures of impulsivity in alcohol and no-beverage sessions. Setting A laboratory setting at the University of Missouri. Participants Twenty-nine young adults who were at least moderate drinkers were recruited from the local community and the University of Missouri. Measurements Impulsivity was assessed using the Two Choice Impulsivity Paradigm (TCIP) and the Stop-Signal Task. Participants also completed self-report measures of binge drinking and trait impulsivity. Findings In the no-beverage session, TCIP impulsive choices did not differ between drinking and driving groups (p = .93). In the alcohol session, drink drivers made more TCIP impulsive choices on both the ascending (p < .01) and descending limb (p < .01) of the blood alcohol concentration curve than their peers who did not drink and drive. Drinking and driving groups did not differ on the Stop-Signal Task. Supplementary analyses indicated that effects for the TCIP were not explained by individual differences in trait impulsivity. Conclusions Individuals who report having three or more drinks before driving show greater impulsivity when under the influence of alcohol than those who do not report heavy drinking before driving. PMID:22690907

Posterior cingulate cortex mediates outcome-contingent allocation of behavior

PubMed Central

Hayden, Benjamin Y.; Nair, Amrita C.; McCoy, Allison N.; Platt, Michael L.

2008-01-01

SUMMARY Adaptive decision making requires selecting an action and then monitoring its consequences to improve future decisions. The neuronal mechanisms supporting action evaluation and subsequent behavioral modification, however, remain poorly understood. To investigate the contribution of posterior cingulate cortex (CGp) to these processes, we recorded activity of single neurons in monkeys performing a gambling task in which the reward outcome of each choice strongly influenced subsequent choices. We found that CGp neurons signaled reward outcomes in a nonlinear fashion, and that outcome-contingent modulations in firing rate persisted into subsequent trials. Moreover, firing rate on any one trial predicted switching to the alternative option on the next trial. Finally, microstimulation in CGp following risky choices promoted a preference reversal for the safe option on the following trial. Collectively, these results demonstrate that CGp directly contributes to the evaluative processes that support dynamic changes in decision making in volatile environments. PMID:18940585

Individual behavioral and neurochemical markers of unadapted decision-making processes in healthy inbred mice.

PubMed

Pittaras, Elsa; Callebert, Jacques; Chennaoui, Mounir; Rabat, Arnaud; Granon, Sylvie

2016-12-01

One of the hallmarks of decision-making processes is the inter-individual variability between healthy subjects. These behavioral patterns could constitute risk factors for the development of psychiatric disorders. Therefore, finding predictive markers of safe or risky decision-making is an important challenge for psychiatry research. We set up a mouse gambling task (MGT)-adapted from the human Iowa gambling task with uncertain contingencies between response and outcome that furthermore enables the emergence of inter-individual differences. Mice (n = 54) were further individually characterized for locomotive, emotional and cognitive behavior. Individual basal rates of monoamines and brain activation after the MGT were assessed in brain regions related to reward, emotion or cognition. In a large healthy mice population, 44 % showed a balanced strategy with limited risk-taking and flexible choices, 29 % showed a safe but rigid strategy, while 27 % adopted risky behavior. Risky mice took also more risks in other apparatus behavioral devices and were less sensitive to reward. No difference existed between groups regarding anxiety, working memory, locomotion and impulsivity. Safe/rigid mice exhibited a hypoactivation of prefrontal subareas, a high level of serotonin in the orbitofrontal cortex combined with a low level of dopamine in the putamen that predicted the emergence of rigid behavior. By contrast, high levels of dopamine, serotonin and noradrenalin in the hippocampus predicted the emergence of more exploratory and risky behaviors. The coping of C57bl/6J mice in MGT enables the determination of extreme patterns of choices either safe/rigid or risky/flexible, related to specific neurochemical and behavioral markers.

Learning to use working memory: a reinforcement learning gating model of rule acquisition in rats

PubMed Central

Lloyd, Kevin; Becker, Nadine; Jones, Matthew W.; Bogacz, Rafal

2012-01-01

Learning to form appropriate, task-relevant working memory representations is a complex process central to cognition. Gating models frame working memory as a collection of past observations and use reinforcement learning (RL) to solve the problem of when to update these observations. Investigation of how gating models relate to brain and behavior remains, however, at an early stage. The current study sought to explore the ability of simple RL gating models to replicate rule learning behavior in rats. Rats were trained in a maze-based spatial learning task that required animals to make trial-by-trial choices contingent upon their previous experience. Using an abstract version of this task, we tested the ability of two gating algorithms, one based on the Actor-Critic and the other on the State-Action-Reward-State-Action (SARSA) algorithm, to generate behavior consistent with the rats'. Both models produced rule-acquisition behavior consistent with the experimental data, though only the SARSA gating model mirrored faster learning following rule reversal. We also found that both gating models learned multiple strategies in solving the initial task, a property which highlights the multi-agent nature of such models and which is of importance in considering the neural basis of individual differences in behavior. PMID:23115551

Contextual and social influences on valuation and choice.

PubMed

Engelmann, Jan B; Hein, Grit

2013-01-01

To survive in our complex environment, we have to adapt to changing contexts. Prior research that investigated how contextual changes are processed in the human brain has demonstrated important modulatory influences on multiple cognitive processes underlying decision-making, including perceptual judgments, working memory, as well as cognitive and attentional control. However, in everyday life, the importance of context is even more obvious during economic and social interactions, which often have implicit rule sets that need to be recognized by a decision-maker. Here, we review recent evidence from an increasing number of studies in the fields of Neuroeconomics and Social Neuroscience that investigate the neurobiological basis of contextual effects on valuation and social choice. Contrary to the assumptions of rational choice theory, multiple contextual factors, such as the availability of alternative choice options, shifts in reference point, and social context, have been shown to modulate behavior, as well as signals in task-relevant neural networks. A consistent picture that emerges from neurobiological results is that valuation-related activity in striatum and ventromedial prefrontal cortex is highly context dependent during both social and nonsocial choice. Alternative approaches to model and explain choice behavior, such as comparison-based choice models, as well as implications for future research are discussed. Copyright © 2013 Elsevier B.V. All rights reserved.

Episodic memories predict adaptive value-based decision-making

PubMed Central

Murty, Vishnu; FeldmanHall, Oriel; Hunter, Lindsay E.; Phelps, Elizabeth A; Davachi, Lila

2016-01-01

Prior research illustrates that memory can guide value-based decision-making. For example, previous work has implicated both working memory and procedural memory (i.e., reinforcement learning) in guiding choice. However, other types of memories, such as episodic memory, may also influence decision-making. Here we test the role for episodic memory—specifically item versus associative memory—in supporting value-based choice. Participants completed a task where they first learned the value associated with trial unique lotteries. After a short delay, they completed a decision-making task where they could choose to re-engage with previously encountered lotteries, or new never before seen lotteries. Finally, participants completed a surprise memory test for the lotteries and their associated values. Results indicate that participants chose to re-engage more often with lotteries that resulted in high versus low rewards. Critically, participants not only formed detailed, associative memories for the reward values coupled with individual lotteries, but also exhibited adaptive decision-making only when they had intact associative memory. We further found that the relationship between adaptive choice and associative memory generalized to more complex, ecologically valid choice behavior, such as social decision-making. However, individuals more strongly encode experiences of social violations—such as being treated unfairly, suggesting a bias for how individuals form associative memories within social contexts. Together, these findings provide an important integration of episodic memory and decision-making literatures to better understand key mechanisms supporting adaptive behavior. PMID:26999046

International Behavior Analysis: The Operationalization Task

DTIC Science & Technology

1976-02-15

IJiC. L This report eoBStlttttoa tha first technical report of year t^.-o of the Intcrr.ational Behavior Analysis (IM) Project, vhich is designed ...builders continued to generate "grond designs ," but none of them attempted to specify variable areas in a comprehensive fashion. Ac a result, specific...1970; Meckstroth, 1975). The distinction between "most similar systems" and "most different systems" designs presents the fundamental choice that a

Discrimination of Complex Human Behavior by Pigeons (Columba livia) and Humans

PubMed Central

Qadri, Muhammad A. J.; Sayde, Justin M.; Cook, Robert G.

2014-01-01

The cognitive and neural mechanisms for recognizing and categorizing behavior are not well understood in non-human animals. In the current experiments, pigeons and humans learned to categorize two non-repeating, complex human behaviors (“martial arts” vs. “Indian dance”). Using multiple video exemplars of a digital human model, pigeons discriminated these behaviors in a go/no-go task and humans in a choice task. Experiment 1 found that pigeons already experienced with discriminating the locomotive actions of digital animals acquired the discrimination more rapidly when action information was available than when only pose information was available. Experiments 2 and 3 found this same dynamic superiority effect with naïve pigeons and human participants. Both species used the same combination of immediately available static pose information and more slowly perceived dynamic action cues to discriminate the behavioral categories. Theories based on generalized visual mechanisms, as opposed to embodied, species-specific action networks, offer a parsimonious account of how these different animals recognize behavior across and within species. PMID:25379777

Reducing Brain Signal Noise in the Prediction of Economic Choices: A Case Study in Neuroeconomics

PubMed Central

Sundararajan, Raanju R.; Palma, Marco A.; Pourahmadi, Mohsen

2017-01-01

In order to reduce the noise of brain signals, neuroeconomic experiments typically aggregate data from hundreds of trials collected from a few individuals. This contrasts with the principle of simple and controlled designs in experimental and behavioral economics. We use a frequency domain variant of the stationary subspace analysis (SSA) technique, denoted as DSSA, to filter out the noise (nonstationary sources) in EEG brain signals. The nonstationary sources in the brain signal are associated with variations in the mental state that are unrelated to the experimental task. DSSA is a powerful tool for reducing the number of trials needed from each participant in neuroeconomic experiments and also for improving the prediction performance of an economic choice task. For a single trial, when DSSA is used as a noise reduction technique, the prediction model in a food snack choice experiment has an increase in overall accuracy by around 10% and in sensitivity and specificity by around 20% and in AUC by around 30%, respectively. PMID:29311784

Reducing Brain Signal Noise in the Prediction of Economic Choices: A Case Study in Neuroeconomics.

PubMed

Sundararajan, Raanju R; Palma, Marco A; Pourahmadi, Mohsen

2017-01-01

In order to reduce the noise of brain signals, neuroeconomic experiments typically aggregate data from hundreds of trials collected from a few individuals. This contrasts with the principle of simple and controlled designs in experimental and behavioral economics. We use a frequency domain variant of the stationary subspace analysis (SSA) technique, denoted as DSSA, to filter out the noise (nonstationary sources) in EEG brain signals. The nonstationary sources in the brain signal are associated with variations in the mental state that are unrelated to the experimental task. DSSA is a powerful tool for reducing the number of trials needed from each participant in neuroeconomic experiments and also for improving the prediction performance of an economic choice task. For a single trial, when DSSA is used as a noise reduction technique, the prediction model in a food snack choice experiment has an increase in overall accuracy by around 10% and in sensitivity and specificity by around 20% and in AUC by around 30%, respectively.

Anterior cingulate dysfunction during choice anticipation in schizophrenia.

PubMed

Quintana, Javier; Wong, Tiffany; Ortiz-Portillo, Elena; Marder, Stephen R; Mazziotta, John C

2004-12-15

The anterior cingulate cortex (ACGC) participates in selective attention, working memory (WM), anticipation, and behavioral monitoring. Subjects with schizophrenia exhibit deficits in these mechanisms during selective attention and WM tasks. However, ACGC dysfunctions have not been specifically investigated during behavioral anticipation, whose deficits may relate to salient schizophrenic features such as foresight abnormalities and impaired social functioning and behavior. We thus studied ACGC function in relation to two aspects of WM, remembering information and anticipating responses, in control and schizophrenic subjects. We measured brain activation in eight subjects with schizophrenia and eight healthy volunteers using functional magnetic resonance imaging. All subjects performed stimulus-response delay tasks with color dots or facial expression diagrams as cues and either 50% or 100% response predictability, which emphasized demands on remembering the cues or anticipating the response for correct performance, respectively. We found a double dissociation of ACGC activation between subject groups and task type. In controls, the ACGC became intensely activated during response anticipation (more extensively and bilaterally when the cues were colors than when they were facial diagrams) but remained at resting activity levels during remembering. In schizophrenic patients, significant ACGC activation was seen only when remembering a percept (more extensively and bilaterally when it was a facial diagram than when it was a color) but not when anticipating a response. These results reveal an ACGC dysfunction during choice anticipation in schizophrenia and suggest that it might underlie the foresight deficits seen in schizophrenic patients.

Attentional Selection Can Be Predicted by Reinforcement Learning of Task-relevant Stimulus Features Weighted by Value-independent Stickiness.

PubMed

Balcarras, Matthew; Ardid, Salva; Kaping, Daniel; Everling, Stefan; Womelsdorf, Thilo

2016-02-01

Attention includes processes that evaluate stimuli relevance, select the most relevant stimulus against less relevant stimuli, and bias choice behavior toward the selected information. It is not clear how these processes interact. Here, we captured these processes in a reinforcement learning framework applied to a feature-based attention task that required macaques to learn and update the value of stimulus features while ignoring nonrelevant sensory features, locations, and action plans. We found that value-based reinforcement learning mechanisms could account for feature-based attentional selection and choice behavior but required a value-independent stickiness selection process to explain selection errors while at asymptotic behavior. By comparing different reinforcement learning schemes, we found that trial-by-trial selections were best predicted by a model that only represents expected values for the task-relevant feature dimension, with nonrelevant stimulus features and action plans having only a marginal influence on covert selections. These findings show that attentional control subprocesses can be described by (1) the reinforcement learning of feature values within a restricted feature space that excludes irrelevant feature dimensions, (2) a stochastic selection process on feature-specific value representations, and (3) value-independent stickiness toward previous feature selections akin to perseveration in the motor domain. We speculate that these three mechanisms are implemented by distinct but interacting brain circuits and that the proposed formal account of feature-based stimulus selection will be important to understand how attentional subprocesses are implemented in primate brain networks.

Lose-Shift Responding in Humans Is Promoted by Increased Cognitive Load

PubMed Central

Ivan, Victorita E.; Banks, Parker J.; Goodfellow, Kris; Gruber, Aaron J.

2018-01-01

The propensity of animals to shift choices immediately after unexpectedly poor reinforcement outcomes is a pervasive strategy across species and tasks. We report here on the memory supporting such lose-shift responding in humans, assessed using a binary choice task in which random responding is the optimal strategy. Participants exhibited little lose-shift responding when fully attending to the task, but this increased by 30%–40% in participants that performed with additional cognitive load that is known to tax executive systems. Lose-shift responding in the cognitively loaded adults persisted throughout the testing session, despite being a sub-optimal strategy, but was less likely as the time increased between reinforcement and the subsequent choice. Furthermore, children (5–9 years old) without load performed similarly to the cognitively loaded adults. This effect disappeared in older children aged 11–13 years old. These data provide evidence supporting our hypothesis that lose-shift responding is a default and reflexive strategy in the mammalian brain, likely mediated by a decaying memory trace, and is normally suppressed by executive systems. Reducing the efficacy of executive control by cognitive load (adults) or underdevelopment (children) increases its prevalence. It may therefore be an important component to consider when interpreting choice data, and may serve as an objective behavioral assay of executive function in humans that is easy to measure. PMID:29568264

Walking delays anticipatory postural adjustments but not reaction times in a choice reaction task.

PubMed

Haridas, C; Gordon, I T; Misiaszek, J E

2005-06-01

During standing, anticipatory postural adjustments (APAs) and focal movements are delayed while performing a choice reaction task, compared with a simple reaction task. We hypothesized that APAs and focal movements of a choice reaction task would be similarly delayed during walking. Furthermore, reaction times are delayed during walking compared with standing. We further hypothesized that APAs and focal movements would be delayed during walking, compared with standing, for both simple and choice reaction tasks. Subjects either walked or stood on a treadmill while holding on to stable handles. They were asked to push or pull on the handles in response to a visual cue. Muscle activity was recorded from muscles of the leg (APA) and arm (RT). Our results were in agreement with previous work showing APA onset was delayed in the choice reaction task compared with the simple reaction task. In addition, the interval between the onset of APA and focal movement activity increased with choice reaction tasks. The task of walking did not delay the onset of focal movement for either the simple or choice reaction tasks. Walking did delay the onset of the APA, but only during choice reaction tasks. The results suggest the added demand of walking does not significantly modify the control of focal arm movements. However, additional attentional demands while walking may compromise anticipatory postural control.

Identity-Specific Reward Representations in Orbitofrontal Cortex Are Modulated by Selective Devaluation.

PubMed

Howard, James D; Kahnt, Thorsten

2017-03-08

Goal-directed behavior is sensitive to the current value of expected outcomes. This requires independent representations of specific rewards, which have been linked to orbitofrontal cortex (OFC) function. However, the mechanisms by which the human brain updates specific goals on the fly, and translates those updates into choices, have remained unknown. Here we implemented selective devaluation of appetizing food odors in combination with pattern-based neuroimaging and a decision-making task. We found that in a hungry state, participants chose to smell high-intensity versions of two value-matched food odor rewards. After eating a meal corresponding to one of the two odors, participants switched choices toward the low intensity of the sated odor but continued to choose the high intensity of the nonsated odor. This sensory-specific behavioral effect was mirrored by pattern-based changes in fMRI signal in lateral posterior OFC, where specific reward identity representations were altered after the meal for the sated food odor but retained for the nonsated counterpart. In addition, changes in functional connectivity between the OFC and general value coding in ventromedial prefrontal cortex (vmPFC) predicted individual differences in satiety-related choice behavior. These findings demonstrate how flexible representations of specific rewards in the OFC are updated by devaluation, and how functional connections to vmPFC reflect the current value of outcomes and guide goal-directed behavior. SIGNIFICANCE STATEMENT The orbitofrontal cortex (OFC) is critical for goal-directed behavior. A recent proposal is that OFC fulfills this function by representing a variety of state and task variables ("cognitive maps"), including a conjunction of expected reward identity and value. Here we tested how identity-specific representations of food odor reward are updated by satiety. We found that fMRI pattern-based signatures of reward identity in lateral posterior OFC were modulated after selective devaluation, and that connectivity between this region and general value coding ventromedial prefrontal cortex (vmPFC) predicted choice behavior. These results provide evidence for a mechanism by which devaluation modulates a cognitive map of expected reward in OFC and thereby alters general value signals in vmPFC to guide goal-directed behavior. Copyright © 2017 the authors 0270-6474/17/372627-12$15.00/0.

Theory of choice in bandit, information sampling and foraging tasks.

PubMed

Averbeck, Bruno B

2015-03-01

Decision making has been studied with a wide array of tasks. Here we examine the theoretical structure of bandit, information sampling and foraging tasks. These tasks move beyond tasks where the choice in the current trial does not affect future expected rewards. We have modeled these tasks using Markov decision processes (MDPs). MDPs provide a general framework for modeling tasks in which decisions affect the information on which future choices will be made. Under the assumption that agents are maximizing expected rewards, MDPs provide normative solutions. We find that all three classes of tasks pose choices among actions which trade-off immediate and future expected rewards. The tasks drive these trade-offs in unique ways, however. For bandit and information sampling tasks, increasing uncertainty or the time horizon shifts value to actions that pay-off in the future. Correspondingly, decreasing uncertainty increases the relative value of actions that pay-off immediately. For foraging tasks the time-horizon plays the dominant role, as choices do not affect future uncertainty in these tasks.

Visual Aids for Positive Behavior Support of Young Children with Autism Spectrum Disorders

ERIC Educational Resources Information Center

Kidder, Jaimee E.; McDonnell, Andrea P.

2017-01-01

Research suggests that many children with ASD are visual learners (Quill, 1997) and may struggle to comprehend expectations presented in a verbal mode only. Visually structured interventions present choices, expectations, tasks, and communication exchanges in a way that is appealing and approachable for visual learners. There are many types of…

Road-Crossing Safety in Virtual Reality: A Comparison of Adolescents With and Without ADHD

ERIC Educational Resources Information Center

Clancy, Tamera A.; Rucklidge, Julia J.; Owen, Dean

2006-01-01

This study investigated the potential accident-proneness of adolescents with attention deficit hyperactivity disorder (ADHD) in a hazardous road-crossing environment. An immersive virtual reality traffic gap-choice task was used to determine whether ADHD adolescents show more unsafe road-crossing behavior than controls. Participants (ages 13 to…

Diminished neural responses predict enhanced intrinsic motivation and sensitivity to external incentive.

PubMed

Marsden, Karen E; Ma, Wei Ji; Deci, Edward L; Ryan, Richard M; Chiu, Pearl H

2015-06-01

The duration and quality of human performance depend on both intrinsic motivation and external incentives. However, little is known about the neuroscientific basis of this interplay between internal and external motivators. Here, we used functional magnetic resonance imaging to examine the neural substrates of intrinsic motivation, operationalized as the free-choice time spent on a task when this was not required, and tested the neural and behavioral effects of external reward on intrinsic motivation. We found that increased duration of free-choice time was predicted by generally diminished neural responses in regions associated with cognitive and affective regulation. By comparison, the possibility of additional reward improved task accuracy, and specifically increased neural and behavioral responses following errors. Those individuals with the smallest neural responses associated with intrinsic motivation exhibited the greatest error-related neural enhancement under the external contingency of possible reward. Together, these data suggest that human performance is guided by a "tonic" and "phasic" relationship between the neural substrates of intrinsic motivation (tonic) and the impact of external incentives (phasic).

Selective Cooperation in Early Childhood – How to Choose Models and Partners

PubMed Central

Hermes, Jonas; Behne, Tanya; Studte, Kristin; Zeyen, Anna-Maria; Gräfenhain, Maria; Rakoczy, Hannes

2016-01-01

Cooperation is essential for human society, and children engage in cooperation from early on. It is unclear, however, how children select their partners for cooperation. We know that children choose selectively whom to learn from (e.g. preferring reliable over unreliable models) on a rational basis. The present study investigated whether children (and adults) also choose their cooperative partners selectively and what model characteristics they regard as important for cooperative partners and for informants about novel words. Three- and four-year-old children (N = 64) and adults (N = 14) saw contrasting pairs of models differing either in physical strength or in accuracy (in labeling known objects). Participants then performed different tasks (cooperative problem solving and word learning) requiring the choice of a partner or informant. Both children and adults chose their cooperative partners selectively. Moreover they showed the same pattern of selective model choice, regarding a wide range of model characteristics as important for cooperation (preferring both the strong and the accurate model for a strength-requiring cooperation tasks), but only prior knowledge as important for word learning (preferring the knowledgeable but not the strong model for word learning tasks). Young children’s selective model choice thus reveals an early rational competence: They infer characteristics from past behavior and flexibly consider what characteristics are relevant for certain tasks. PMID:27505043

Basolateral amygdala lesions abolish mutual reward preferences in rats.

PubMed

Hernandez-Lallement, Julen; van Wingerden, Marijn; Schäble, Sandra; Kalenscher, Tobias

2016-01-01

In a recent study, we demonstrated that rats prefer mutual rewards in a Prosocial Choice Task. Here, employing the same task, we show that the integrity of basolateral amygdala was necessary for the expression of mutual reward preferences. Actor rats received bilateral excitotoxic (n=12) or sham lesions (n=10) targeting the basolateral amygdala and were subsequently tested in a Prosocial Choice Task where they could decide between rewarding ("Both Reward") or not rewarding a partner rat ("Own Reward"), either choice yielding identical reward to the actors themselves. To manipulate the social context and control for secondary reinforcement sources, actor rats were paired with either a partner rat (partner condition) or with an inanimate rat toy (toy condition). Sham-operated animals revealed a significant preference for the Both-Reward-option in the partner condition, but not in the toy condition. Amygdala-lesioned animals exhibited significantly lower Both-Reward preferences than the sham group in the partner but not in the toy condition, suggesting that basolateral amygdala was required for the expression of mutual reward preferences. Critically, in a reward magnitude discrimination task in the same experimental setup, both sham-operated and amygdala-lesioned animals preferred large over small rewards, suggesting that amygdala lesion effects were restricted to decision making in social contexts, leaving self-oriented behavior unaffected. Copyright © 2015 Elsevier Inc. All rights reserved.

Intra-accumbens injections of the adenosine A2A agonist CGS 21680 affect effort-related choice behavior in rats

PubMed Central

Font, Laura; Mingote, Susana; Farrar, Andrew M.; Pereira, Mariana; Worden, Lila; Stopper, Colin; Port, Russell G.

2009-01-01

Rationale Nucleus accumbens dopamine (DA) participates in the modulation of instrumental behavior, including aspects of behavioral activation and effort-related choice behavior. Rats with impaired accumbens DA transmission reallocate their behavior away from food-reinforced activities that have high response requirements and instead select less-effortful types of food-seeking behavior. Although accumbens DA is considered a critical component of the brain circuitry regulating effort-related processes, emerging evidence also implicates adenosine A2A receptors. Objective The present work was undertaken to test the hypothesis that accumbens A2A receptor stimulation would produce effects similar to those produced by DA depletion or antagonism. Materials and methods Three experiments assessed the effects of the adenosine A2A agonist CGS 21680 on performance of a concurrent choice task (lever pressing for preferred food vs. intake of less preferred chow) that is known to be sensitive to DA antagonists and accumbens DA depletions. Results Systemic injections of CGS 21680 reduced lever pressing but did not increase feeding. In contrast, bilateral infusions of the adenosine A2A receptor agonist CGS 21680 (6.0–24.0 ng) into the nucleus accumbens decreased lever pressing for the preferred food but substantially increased consumption of the less preferred chow. Injections of CGS 21680 into a control site dorsal to the accumbens were ineffective. Conclusions Taken together, these results are consistent with the hypothesis that local stimulation of adenosine A2A receptors in nucleus accumbens produces behavioral effects similar to those induced by accumbens DA depletions. Accumbens adenosine A2A receptors appear to be a component of the brain circuitry regulating effort-related choice behavior. PMID:18491078

Anxiety Evokes Hypofrontality and Disrupts Rule-Relevant Encoding by Dorsomedial Prefrontal Cortex Neurons.

PubMed

Park, Junchol; Wood, Jesse; Bondi, Corina; Del Arco, Alberto; Moghaddam, Bita

2016-03-16

Anxiety is a debilitating symptom of most psychiatric disorders, including major depression, post-traumatic stress disorder, schizophrenia, and addiction. A detrimental aspect of anxiety is disruption of prefrontal cortex (PFC)-mediated executive functions, such as flexible decision making. Here we sought to understand how anxiety modulates PFC neuronal encoding of flexible shifting between behavioral strategies. We used a clinically substantiated anxiogenic treatment to induce sustained anxiety in rats and recorded from dorsomedial PFC (dmPFC) and orbitofrontal cortex (OFC) neurons while they were freely moving in a home cage and while they performed a PFC-dependent task that required flexible switches between rules in two distinct perceptual dimensions. Anxiety elicited a sustained background "hypofrontality" in dmPFC and OFC by reducing the firing rate of spontaneously active neuronal subpopulations. During task performance, the impact of anxiety was subtle, but, consistent with human data, behavior was selectively impaired when previously correct conditions were presented as conflicting choices. This impairment was associated with reduced recruitment of dmPFC neurons that selectively represented task rules at the time of action. OFC rule representation was not affected by anxiety. These data indicate that a neural substrate of the decision-making deficits in anxiety is diminished dmPFC neuronal encoding of task rules during conflict-related actions. Given the translational relevance of the model used here, the data provide a neuronal encoding mechanism for how anxiety biases decision making when the choice involves overcoming a conflict. They also demonstrate that PFC encoding of actions, as opposed to cues or outcome, is especially vulnerable to anxiety. A debilitating aspect of anxiety is its impact on decision making and flexible control of behavior. These cognitive constructs depend on proper functioning of the prefrontal cortex (PFC). Understanding how anxiety affects PFC encoding of cognitive events is of great clinical and evolutionary significance. Using a clinically valid experimental model, we find that, under anxiety, decision making may be skewed by salient and conflicting environmental stimuli at the expense of flexible top-down guided choices. We also find that anxiety suppresses spontaneous activity of PFC neurons, and weakens encoding of task rules by dorsomedial PFC neurons. These data provide a neuronal encoding scheme for how anxiety disengages PFC during decision making. Copyright © 2016 the authors 0270-6474/16/363322-14$15.00/0.

Approach–Avoidance Processes Contribute to Dissociable Impacts of Risk and Loss on Choice

PubMed Central

Wright, Nicholas D.; Symmonds, Mkael; Hodgson, Karen; Fitzgerald, Thomas H. B.; Crawford, Bonni; Dolan, Raymond J.

2013-01-01

Value-based choices are influenced both by risk in potential outcomes and by whether outcomes reflect potential gains or losses. These variables are held to be related in a specific fashion, manifest in risk aversion for gains and risk seeking for losses. Instead, we hypothesized that there are independent impacts of risk and loss on choice such that, depending on context, subjects can show either risk aversion for gains and risk seeking for losses or the exact opposite. We demonstrate this independence in a gambling task, by selectively reversing a loss-induced effect (causing more gambling for gains than losses and the reverse) while leaving risk aversion unaffected. Consistent with these dissociable behavioral impacts of risk and loss, fMRI data revealed dissociable neural correlates of these variables, with parietal cortex tracking risk and orbitofrontal cortex and striatum tracking loss. Based on our neural data, we hypothesized that risk and loss influence action selection through approach–avoidance mechanisms, a hypothesis supported in an experiment in which we show valence and risk-dependent reaction time effects in line with this putative mechanism. We suggest that in the choice process risk and loss can independently engage approach–avoidance mechanisms. This can provide a novel explanation for how risk influences action selection and explains both classically described choice behavior as well as behavioral patterns not predicted by existing theory. PMID:22593069

Does a peer model's task proficiency influence children's solution choice and innovation?

PubMed

Wood, Lara A; Kendal, Rachel L; Flynn, Emma G

2015-11-01

The current study investigated whether 4- to 6-year-old children's task solution choice was influenced by the past proficiency of familiar peer models and the children's personal prior task experience. Peer past proficiency was established through behavioral assessments of interactions with novel tasks alongside peer and teacher predictions of each child's proficiency. Based on these assessments, one peer model with high past proficiency and one age-, sex-, dominance-, and popularity-matched peer model with lower past proficiency were trained to remove a capsule using alternative solutions from a three-solution artificial fruit task. Video demonstrations of the models were shown to children after they had either a personal successful interaction or no interaction with the task. In general, there was not a strong bias toward the high past-proficiency model, perhaps due to a motivation to acquire multiple methods and the salience of other transmission biases. However, there was some evidence of a model-based past-proficiency bias; when the high past-proficiency peer matched the participants' original solution, there was increased use of that solution, whereas if the high past-proficiency peer demonstrated an alternative solution, there was increased use of the alternative social solution and novel solutions. Thus, model proficiency influenced innovation. Copyright © 2015 Elsevier Inc. All rights reserved.

ARCPEP 2 - SHUPEP (ARCPEP 2: Seton Hill University Personal Empowerment Project (SHU-PEP))

DTIC Science & Technology

2012-10-01

will be used to determine the proportion of young adults attending college who engage in unhealthy behaviors with regard to diet habits and choices...Marina Vernalis, DO, FACC 5d. PROJECT NUMBER Janice Sandrick, Ph.D. 5e. TASK NUMBER email : marnia.vernalis@med.navy.mil 5f. WORK UNIT...study will evaluate the behavioral patterns of university students in the domains of diet , exercise, stress management, smoking and sleep (phase 1

DYT1 dystonia increases risk taking in humans.

PubMed

Arkadir, David; Radulescu, Angela; Raymond, Deborah; Lubarr, Naomi; Bressman, Susan B; Mazzoni, Pietro; Niv, Yael

2016-06-01

It has been difficult to link synaptic modification to overt behavioral changes. Rodent models of DYT1 dystonia, a motor disorder caused by a single gene mutation, demonstrate increased long-term potentiation and decreased long-term depression in corticostriatal synapses. Computationally, such asymmetric learning predicts risk taking in probabilistic tasks. Here we demonstrate abnormal risk taking in DYT1 dystonia patients, which is correlated with disease severity, thereby supporting striatal plasticity in shaping choice behavior in humans.

Computational Cognitive Modeling of Adaptive Choice Behavior in a Dynamic Decision Paradigm

DTIC Science & Technology

2006-02-01

Cognitive Psychology (Fu & Gray, in press), an exploration of the limits of ACT-R’s credit assignment mechanism published in the Cognitive System Research...Macmillan & Creelman , 2004) to "determine the optimal performance in a task, given the physical properties of the environment and stimuli" (Geisler, 2004...allocation for interactive behavior. Psychological Review, in press. Gray, W. D. 0., & Myers, C. W. (2005). From models to methods to models: Tools and

Stimulus ambiguity elicits response conflict.

PubMed

Szmalec, Arnaud; Verbruggen, Frederick; Vandierendonck, André; De Baene, Wouter; Verguts, Tom; Notebaert, Wim

2008-04-18

Conflict monitoring theory [M.M. Botvinick, T. Braver, D. Barch, C. Carter, J.D. Cohen, Conflict monitoring and cognitive control, Psychol. Rev. 108 (2001) 625-652] assumes that perceptual ambiguity among choice stimuli elicits response conflict in choice reaction. It hence predicts that response conflict is also involved in elementary variants of choice reaction time (RT) tasks, i.e., those variants that, by contrast with the Stroop task or the Go/No-Go task for instance, are rarely associated with cognitive control. In order to test this prediction, an experiment was designed in which participants performed a simple RT task and a regular between-hand 2-choice RT task under three different levels of stimulus ambiguity. The data show that response conflict, as measured by the N2 component of the event-related brain potential (ERP), was elicited in the 2-choice RT task but not in the simple RT task and that the degree of response conflict in the 2-choice RT task was a function of stimulus ambiguity. These results show that response conflict is also present in a regular choice RT task which is traditionally not considered to be a measure of cognitive conflict.

Balancing Risk and Reward: A Rat Model of Risky Decision-Making

PubMed Central

Simon, Nicholas W.; Gilbert, Ryan J.; Mayse, Jeffrey D.; Bizon, Jennifer L.; Setlow, Barry

2009-01-01

We developed a behavioral task in rats to assess the influence of risk of punishment on decision-making. Male Long-Evans rats were given choices between pressing a lever to obtain a small, “safe” food reward and a large food reward associated with risk of punishment (footshock). Each test session consisted of 5 blocks of 10 choice trials, with punishment risk increasing with each consecutive block (0, 25, 50, 75, 100%). Preference for the large, “risky” reward declined with both increased probability and increased magnitude of punishment, and reward choice was not affected by the level of satiation or the order of risk presentation. Performance in this risky decision-making task was correlated with the degree to which the rats discounted the value of probabilistic rewards, but not delayed rewards. Finally, the acute effects of different doses of amphetamine and cocaine on risky decision-making were assessed. Systemic amphetamine administration caused a dose-dependent decrease in choice of the large risky reward (i.e. – it made rats more risk-averse). Cocaine did not cause a shift in reward choice, but instead impaired rats’ sensitivity to changes in punishment risk. These results should prove useful for investigating neuropsychiatric disorders in which risk taking is a prominent feature, such as attention deficit/hyperactivity disorder and addiction. PMID:19440192

An effect of loudness of advisory speech on a choice response task

NASA Astrophysics Data System (ADS)

Utsuki, Narisuke; Takeuchi, Yoshinori; Nomiyama, Takenori

1995-03-01

Recent technologies have realized talking advisory/guidance systems in which machines give advice and guidance to operators in speech. However, nonverbal aspects of spoken messages may have significant effects on an operator's behavior. Twelve subjects participated in a TV game-like choice response task where they were asked to choose a 'true' target from three invader-like figures displayed on a CRT screen. The subjects had received a prerecorded advice designating either left, center, or right target that would be true before each choice. The position of the 'true' targets and advice were preprogrammed in pseudorandom sequences. In other words, there was no way for the subjects to predict the 'true' target and there was no relationship between spoken advice and the true target position. The subjects tended to make more choices corresponding to the presented messages when the messages were presented in a louder voice than in a softer voice. Choice response time was significantly shorter when the response was the same as the advice indicated. The shortening of response time was slightly greater when advice was presented in a louder voice. This study demonstrates that spoken advice may result in faster and less deliberate reponses in accordance with the presented messages which are given by talking guidance systems.

Balancing risk and reward: a rat model of risky decision making.

PubMed

Simon, Nicholas W; Gilbert, Ryan J; Mayse, Jeffrey D; Bizon, Jennifer L; Setlow, Barry

2009-09-01

We developed a behavioral task in rats to assess the influence of risk of punishment on decision making. Male Long-Evans rats were given choices between pressing a lever to obtain a small, 'safe' food reward and a large food reward associated with risk of punishment (footshock). Each test session consisted of 5 blocks of 10 choice trials, with punishment risk increasing with each consecutive block (0, 25, 50, 75, 100%). Preference for the large, 'risky' reward declined with both increased probability and increased magnitude of punishment, and reward choice was not affected by the level of satiation or the order of risk presentation. Performance in this risky decision-making task was correlated with the degree to which the rats discounted the value of probabilistic rewards, but not delayed rewards. Finally, the acute effects of different doses of amphetamine and cocaine on risky decision making were assessed. Systemic amphetamine administration caused a dose-dependent decrease in choice of the large risky reward (ie, it made rats more risk averse). Cocaine did not cause a shift in reward choice, but instead impaired the rats' sensitivity to changes in punishment risk. These results should prove useful for investigating neuropsychiatric disorders in which risk taking is a prominent feature, such as attention deficit/hyperactivity disorder and addiction.

Influence of branding on preference-based decision making.

PubMed

Philiastides, Marios G; Ratcliff, Roger

2013-07-01

Branding has become one of the most important determinants of consumer choices. Intriguingly, the psychological mechanisms of how branding influences decision making remain elusive. In the research reported here, we used a preference-based decision-making task and computational modeling to identify which internal components of processing are affected by branding. We found that a process of noisy temporal integration of subjective value information can model preference-based choices reliably and that branding biases are explained by changes in the rate of the integration process itself. This result suggests that branding information and subjective preference are integrated into a single source of evidence in the decision-making process, thereby altering choice behavior.

Individual differences in the influence of task-irrelevant Pavlovian cues on human behavior.

PubMed

Garofalo, Sara; di Pellegrino, Giuseppe

2015-01-01

Pavlovian-to-instrumental transfer (PIT) refers to the process of a Pavlovian reward-paired cue acquiring incentive motivational proprieties that drive choices. It represents a crucial phenomenon for understanding cue-controlled behavior, and it has both adaptive and maladaptive implications (i.e., drug-taking). In animals, individual differences in the degree to which such cues bias performance have been identified in two types of individuals that exhibit distinct Conditioned Responses (CR) during Pavlovian conditioning: Sign-Trackers (ST) and Goal-Trackers (GT). Using an appetitive PIT procedure with a monetary reward, the present study investigated, for the first time, the extent to which such individual differences might affect the influence of reward-paired cues in humans. In a first task, participants learned an instrumental response leading to reward; then, in a second task, a visual Pavlovian cue was associated with the same reward; finally, in a third task, PIT was tested by measuring the preference for the reward-paired instrumental response when the task-irrelevant reward-paired cue was presented, in the absence of the reward itself. In ST individuals, but not in GT individuals, reward-related cues biased behavior, resulting in an increased likelihood to perform the instrumental response independently paired with the same reward when presented with the task-irrelevant reward-paired cue, even if the reward itself was no longer available (i.e., stronger PIT effect). This finding has important implications for developing individualized treatment for maladaptive behaviors, such as addiction.

To Pass or Not to Pass: Modeling the Movement and Affordance Dynamics of a Pick and Place Task

PubMed Central

Lamb, Maurice; Kallen, Rachel W.; Harrison, Steven J.; Di Bernardo, Mario; Minai, Ali; Richardson, Michael J.

2017-01-01

Humans commonly engage in tasks that require or are made more efficient by coordinating with other humans. In this paper we introduce a task dynamics approach for modeling multi-agent interaction and decision making in a pick and place task where an agent must move an object from one location to another and decide whether to act alone or with a partner. Our aims were to identify and model (1) the affordance related dynamics that define an actor's choice to move an object alone or to pass it to their co-actor and (2) the trajectory dynamics of an actor's hand movements when moving to grasp, relocate, or pass the object. Using a virtual reality pick and place task, we demonstrate that both the decision to pass or not pass an object and the movement trajectories of the participants can be characterized in terms of a behavioral dynamics model. Simulations suggest that the proposed behavioral dynamics model exhibits features observed in human participants including hysteresis in decision making, non-straight line trajectories, and non-constant velocity profiles. The proposed model highlights how the same low-dimensional behavioral dynamics can operate to constrain multiple (and often nested) levels of human activity and suggests that knowledge of what, when, where and how to move or act during pick and place behavior may be defined by these low dimensional task dynamics and, thus, can emerge spontaneously and in real-time with little a priori planning. PMID:28701975

Individual differences in the influence of task-irrelevant Pavlovian cues on human behavior

PubMed Central

Garofalo, Sara; di Pellegrino, Giuseppe

2015-01-01

Pavlovian-to-instrumental transfer (PIT) refers to the process of a Pavlovian reward-paired cue acquiring incentive motivational proprieties that drive choices. It represents a crucial phenomenon for understanding cue-controlled behavior, and it has both adaptive and maladaptive implications (i.e., drug-taking). In animals, individual differences in the degree to which such cues bias performance have been identified in two types of individuals that exhibit distinct Conditioned Responses (CR) during Pavlovian conditioning: Sign-Trackers (ST) and Goal-Trackers (GT). Using an appetitive PIT procedure with a monetary reward, the present study investigated, for the first time, the extent to which such individual differences might affect the influence of reward-paired cues in humans. In a first task, participants learned an instrumental response leading to reward; then, in a second task, a visual Pavlovian cue was associated with the same reward; finally, in a third task, PIT was tested by measuring the preference for the reward-paired instrumental response when the task-irrelevant reward-paired cue was presented, in the absence of the reward itself. In ST individuals, but not in GT individuals, reward-related cues biased behavior, resulting in an increased likelihood to perform the instrumental response independently paired with the same reward when presented with the task-irrelevant reward-paired cue, even if the reward itself was no longer available (i.e., stronger PIT effect). This finding has important implications for developing individualized treatment for maladaptive behaviors, such as addiction. PMID:26157371

Reward Size Informs Repeat-Switch Decisions and Strongly Modulates the Activity of Neurons in Parietal Cortex

PubMed Central

Kubanek, Jan; Snyder, Lawrence H.

2017-01-01

Abstract Behavior is guided by previous experience. Good, positive outcomes drive a repetition of a previous behavior or choice, whereas poor or bad outcomes lead to an avoidance. How these basic drives are implemented by the brain has been of primary interest to psychology and neuroscience. We engaged animals in a choice task in which the size of a reward outcome strongly governed the animals' subsequent decision whether to repeat or switch the previous choice. We recorded the discharge activity of neurons implicated in reward-based choice in 2 regions of parietal cortex. We found that the tendency to retain previous choice following a large (small) reward was paralleled by a marked decrease (increase) in the activity of parietal neurons. This neural effect is independent of, and of sign opposite to, value-based modulations reported in parietal cortex previously. This effect shares the same basic properties with signals previously reported in the limbic system that detect the size of the recently obtained reward to mediate proper repeat-switch decisions. We conclude that the size of the obtained reward is a decision variable that guides the decision between retaining a choice or switching, and neurons in parietal cortex strongly respond to this novel decision variable. PMID:26491065

Predicting risky choices from brain activity patterns

PubMed Central

Helfinstein, Sarah M.; Schonberg, Tom; Congdon, Eliza; Karlsgodt, Katherine H.; Mumford, Jeanette A.; Sabb, Fred W.; Cannon, Tyrone D.; London, Edythe D.; Bilder, Robert M.; Poldrack, Russell A.

2014-01-01

Previous research has implicated a large network of brain regions in the processing of risk during decision making. However, it has not yet been determined if activity in these regions is predictive of choices on future risky decisions. Here, we examined functional MRI data from a large sample of healthy subjects performing a naturalistic risk-taking task and used a classification analysis approach to predict whether individuals would choose risky or safe options on upcoming trials. We were able to predict choice category successfully in 71.8% of cases. Searchlight analysis revealed a network of brain regions where activity patterns were reliably predictive of subsequent risk-taking behavior, including a number of regions known to play a role in control processes. Searchlights with significant predictive accuracy were primarily located in regions more active when preparing to avoid a risk than when preparing to engage in one, suggesting that risk taking may be due, in part, to a failure of the control systems necessary to initiate a safe choice. Additional analyses revealed that subject choice can be successfully predicted with minimal decrements in accuracy using highly condensed data, suggesting that information relevant for risky choice behavior is encoded in coarse global patterns of activation as well as within highly local activation within searchlights. PMID:24550270

Performance monitoring and response conflict resolution associated with choice stepping reaction tasks.

PubMed

Watanabe, Tatsunori; Tsutou, Kotaro; Saito, Kotaro; Ishida, Kazuto; Tanabe, Shigeo; Nojima, Ippei

2016-11-01

Choice reaction requires response conflict resolution, and the resolution processes that occur during a choice stepping reaction task undertaken in a standing position, which requires maintenance of balance, may be different to those processes occurring during a choice reaction task performed in a seated position. The study purpose was to investigate the resolution processes during a choice stepping reaction task at the cortical level using electroencephalography and compare the results with a control task involving ankle dorsiflexion responses. Twelve young adults either stepped forward or dorsiflexed the ankle in response to a visual imperative stimulus presented on a computer screen. We used the Simon task and examined the error-related negativity (ERN) that follows an incorrect response and the correct-response negativity (CRN) that follows a correct response. Error was defined as an incorrect initial weight transfer for the stepping task and as an incorrect initial tibialis anterior activation for the control task. Results revealed that ERN and CRN amplitudes were similar in size for the stepping task, whereas the amplitude of ERN was larger than that of CRN for the control task. The ERN amplitude was also larger in the stepping task than the control task. These observations suggest that a choice stepping reaction task involves a strategy emphasizing post-response conflict and general performance monitoring of actual and required responses and also requires greater cognitive load than a choice dorsiflexion reaction. The response conflict resolution processes appear to be different for stepping tasks and reaction tasks performed in a seated position.

Beyond pain: modeling decision-making deficits in chronic pain

PubMed Central

Hess, Leonardo Emanuel; Haimovici, Ariel; Muñoz, Miguel Angel; Montoya, Pedro

2014-01-01

Risky decision-making seems to be markedly disrupted in patients with chronic pain, probably due to the high cost that impose pain and negative mood on executive control functions. Patients’ behavioral performance on decision-making tasks such as the Iowa Gambling Task (IGT) is characterized by selecting cards more frequently from disadvantageous than from advantageous decks, and by switching often between competing responses in comparison with healthy controls (HCs). In the present study, we developed a simple heuristic model to simulate individuals’ choice behavior by varying the level of decision randomness and the importance given to gains and losses. The findings revealed that the model was able to differentiate the behavioral performance of patients with chronic pain and HCs at the group, as well as at the individual level. The best fit of the model in patients with chronic pain was yielded when decisions were not based on previous choices and when gains were considered more relevant than losses. By contrast, the best account of the available data in HCs was obtained when decisions were based on previous experiences and losses loomed larger than gains. In conclusion, our model seems to provide useful information to measure each individual participant extensively, and to deal with the data on a participant-by-participant basis. PMID:25136301

Beyond pain: modeling decision-making deficits in chronic pain.

PubMed

Hess, Leonardo Emanuel; Haimovici, Ariel; Muñoz, Miguel Angel; Montoya, Pedro

2014-01-01

Risky decision-making seems to be markedly disrupted in patients with chronic pain, probably due to the high cost that impose pain and negative mood on executive control functions. Patients' behavioral performance on decision-making tasks such as the Iowa Gambling Task (IGT) is characterized by selecting cards more frequently from disadvantageous than from advantageous decks, and by switching often between competing responses in comparison with healthy controls (HCs). In the present study, we developed a simple heuristic model to simulate individuals' choice behavior by varying the level of decision randomness and the importance given to gains and losses. The findings revealed that the model was able to differentiate the behavioral performance of patients with chronic pain and HCs at the group, as well as at the individual level. The best fit of the model in patients with chronic pain was yielded when decisions were not based on previous choices and when gains were considered more relevant than losses. By contrast, the best account of the available data in HCs was obtained when decisions were based on previous experiences and losses loomed larger than gains. In conclusion, our model seems to provide useful information to measure each individual participant extensively, and to deal with the data on a participant-by-participant basis.

Cracking the Neural Code for Sensory Perception by Combining Statistics, Intervention, and Behavior.

PubMed

Panzeri, Stefano; Harvey, Christopher D; Piasini, Eugenio; Latham, Peter E; Fellin, Tommaso

2017-02-08

The two basic processes underlying perceptual decisions-how neural responses encode stimuli, and how they inform behavioral choices-have mainly been studied separately. Thus, although many spatiotemporal features of neural population activity, or "neural codes," have been shown to carry sensory information, it is often unknown whether the brain uses these features for perception. To address this issue, we propose a new framework centered on redefining the neural code as the neural features that carry sensory information used by the animal to drive appropriate behavior; that is, the features that have an intersection between sensory and choice information. We show how this framework leads to a new statistical analysis of neural activity recorded during behavior that can identify such neural codes, and we discuss how to combine intersection-based analysis of neural recordings with intervention on neural activity to determine definitively whether specific neural activity features are involved in a task. Copyright © 2017 Elsevier Inc. All rights reserved.

Planning activity for internally generated reward goals in monkey amygdala neurons

PubMed Central

Schultz, Wolfram

2015-01-01

The best rewards are often distant and can only be achieved by planning and decision-making over several steps. We designed a multi-step choice task in which monkeys followed internal plans to save rewards towards self-defined goals. During this self-controlled behavior, amygdala neurons showed future-oriented activity that reflected the animal’s plan to obtain specific rewards several trials ahead. This prospective activity encoded crucial components of the animal’s plan, including value and length of the planned choice sequence. It began on initial trials when a plan would be formed, reappeared step-by-step until reward receipt, and readily updated with a new sequence. It predicted performance, including errors, and typically disappeared during instructed behavior. Such prospective activity could underlie the formation and pursuit of internal plans characteristic for goal-directed behavior. The existence of neuronal planning activity in the amygdala suggests an important role for this structure in guiding behavior towards internally generated, distant goals. PMID:25622146

On the Flexibility of Basic Risk Attitudes in Monkeys.

PubMed

Farashahi, Shiva; Azab, Habiba; Hayden, Benjamin; Soltani, Alireza

2018-05-02

Monkeys and other animals appear to share with humans two risk attitudes predicted by prospect theory: an inverse-S-shaped probability-weighting (PW) function and a steeper utility curve for losses than for gains. These findings suggest that such preferences are stable traits with common neural substrates. We hypothesized instead that animals tailor their preferences to subtle changes in task contexts, making risk attitudes flexible. Previous studies used a limited number of outcomes, trial types, and contexts. To gain a broader perspective, we examined two large datasets of male macaques' risky choices: one from a task with real (juice) gains and another from a token task with gains and losses. In contrast to previous findings, monkeys were risk seeking for both gains and losses (i.e., lacked a reflection effect) and showed steeper gain than loss curves (loss seeking). Utility curves for gains were substantially different in the two tasks. Monkeys showed nearly linear PWs in one task and S-shaped ones in the other; neither task produced a consistent inverse-S-shaped curve. To account for these observations, we developed and tested various computational models of the processes involved in the construction of reward value. We found that adaptive differential weighting of prospective gamble outcomes could partially account for the observed differences in the utility functions across the two experiments and thus provide a plausible mechanism underlying flexible risk attitudes. Together, our results support the idea that risky choices are constructed flexibly at the time of elicitation and place important constraints on neural models of economic choice. SIGNIFICANCE STATEMENT We respond in reliable ways to risk, but are our risk preferences stable traits or ephemeral states? Using various computational models, we examined two large datasets of macaque risky choices in two different tasks. We observed several deviations from "classic" risk preferences seen in humans and monkeys: no reflection effect, loss seeking as opposed to loss aversion, and linear and S-shaped, as opposed to inverse-S-shaped, probability distortion. These results challenge the idea that our risk attitudes are evolved traits shared with the last common ancestor of macaques and humans, suggesting instead that behavioral flexibility is the hallmark of risky choice in primates. We show how this flexibility can emerge partly as a result of interactions between attentional and reward systems. Copyright © 2018 the authors 0270-6474/18/384383-16$15.00/0.

Social signals of safety and risk confer utility and have asymmetric effects on observers' choices.

PubMed

Chung, Dongil; Christopoulos, George I; King-Casas, Brooks; Ball, Sheryl B; Chiu, Pearl H

2015-06-01

Individuals' risk attitudes are known to guide choices about uncertain options. However, in the presence of others' decisions, these choices can be swayed and manifest as riskier or safer behavior than one would express alone. To test the mechanisms underlying effective social 'nudges' in human decision-making, we used functional neuroimaging and a task in which participants made choices about gambles alone and after observing others' selections. Against three alternative explanations, we found that observing others' choices of gambles increased the subjective value (utility) of those gambles for the observer. This 'other-conferred utility' was encoded in ventromedial prefrontal cortex, and these neural signals predicted conformity. We further identified a parametric interaction with individual risk preferences in anterior cingulate cortex and insula. These data provide a neuromechanistic account of how information from others is integrated with individual preferences that may explain preference-congruent susceptibility to social signals of safety and risk.

A behavioral and neural evaluation of prospective decision-making under risk.

PubMed

Symmonds, Mkael; Bossaerts, Peter; Dolan, Raymond J

2010-10-27

Making the best choice when faced with a chain of decisions requires a person to judge both anticipated outcomes and future actions. Although economic decision-making models account for both risk and reward in single-choice contexts, there is a dearth of similar knowledge about sequential choice. Classical utility-based models assume that decision-makers select and follow an optimal predetermined strategy, regardless of the particular order in which options are presented. An alternative model involves continuously reevaluating decision utilities, without prescribing a specific future set of choices. Here, using behavioral and functional magnetic resonance imaging (fMRI) data, we studied human subjects in a sequential choice task and use these data to compare alternative decision models of valuation and strategy selection. We provide evidence that subjects adopt a model of reevaluating decision utilities, in which available strategies are continuously updated and combined in assessing action values. We validate this model by using simultaneously acquired fMRI data to show that sequential choice evokes a pattern of neural response consistent with a tracking of anticipated distribution of future reward, as expected in such a model. Thus, brain activity evoked at each decision point reflects the expected mean, variance, and skewness of possible payoffs, consistent with the idea that sequential choice evokes a prospective evaluation of both available strategies and possible outcomes.

Transient inactivation of basolateral amygdala during selective satiation disrupts reinforcer devaluation in rats

PubMed Central

West, Elizabeth A.; Forcelli, Patrick A.; Murnen, Alice T.; McCue, David L.; Gale, Karen; Malkova, Ludise

2012-01-01

Basolateral amygdala (BLA) function is critical for flexible, goal-directed behavior, including performance on reinforcer devaluation tasks. Here we tested, in rats, the hypothesis that BLA is critical for conditioned reinforcer devaluation during the period when the primary reinforcer (food) is being devalued (by feeding it to satiety), but not thereafter for guiding behavioral choices. We used a spatially-independent task, which employed two visual cues, each predicting one of two foods. An instrumental action (lever press) was required for reinforcer delivery. After training, rats received BLA or sham lesions, or cannulae implanted in BLA. Under control conditions (sham lesions, saline infusions), devaluation of one food significantly decreased responding to the cue associated with that food, when both cues were presented simultaneously during extinction. BLA lesions impaired this devaluation effect. Transient inactivation of BLA by microinfusion of the GABAA agonist muscimol resulted in an impairment, only when BLA was inactivated during satiation. When muscimol was infused after satiation and, therefore, BLA was inactivated only during the choice test, rats showed no impairment. Thus, BLA is necessary for registering or updating cues to reflect updated reinforcer values, but not for guiding choices once the value has been updated. Our results are the first to describe the contribution of rat BLA to specific components of reinforcer devaluation, and are the first to show impairment in reinforcer devaluation following transient inactivation in the rat. PMID:22845705

Solving the Credit Assignment Problem With the Prefrontal Cortex

PubMed Central

Stolyarova, Alexandra

2018-01-01

In naturalistic multi-cue and multi-step learning tasks, where outcomes of behavior are delayed in time, discovering which choices are responsible for rewards can present a challenge, known as the credit assignment problem. In this review, I summarize recent work that highlighted a critical role for the prefrontal cortex (PFC) in assigning credit where it is due in tasks where only a few of the multitude of cues or choices are relevant to the final outcome of behavior. Collectively, these investigations have provided compelling support for specialized roles of the orbitofrontal (OFC), anterior cingulate (ACC), and dorsolateral prefrontal (dlPFC) cortices in contingent learning. However, recent work has similarly revealed shared contributions and emphasized rich and heterogeneous response properties of neurons in these brain regions. Such functional overlap is not surprising given the complexity of reciprocal projections spanning the PFC. In the concluding section, I overview the evidence suggesting that the OFC, ACC and dlPFC communicate extensively, sharing the information about presented options, executed decisions and received rewards, which enables them to assign credit for outcomes to choices on which they are contingent. This account suggests that lesion or inactivation/inhibition experiments targeting a localized PFC subregion will be insufficient to gain a fine-grained understanding of credit assignment during learning and instead poses refined questions for future research, shifting the focus from focal manipulations to experimental techniques targeting cortico-cortical projections. PMID:29636659

Active learning: learning a motor skill without a coach.

PubMed

Huang, Vincent S; Shadmehr, Reza; Diedrichsen, Jörn

2008-08-01

When we learn a new skill (e.g., golf) without a coach, we are "active learners": we have to choose the specific components of the task on which to train (e.g., iron, driver, putter, etc.). What guides our selection of the training sequence? How do choices that people make compare with choices made by machine learning algorithms that attempt to optimize performance? We asked subjects to learn the novel dynamics of a robotic tool while moving it in four directions. They were instructed to choose their practice directions to maximize their performance in subsequent tests. We found that their choices were strongly influenced by motor errors: subjects tended to immediately repeat an action if that action had produced a large error. This strategy was correlated with better performance on test trials. However, even when participants performed perfectly on a movement, they did not avoid repeating that movement. The probability of repeating an action did not drop below chance even when no errors were observed. This behavior led to suboptimal performance. It also violated a strong prediction of current machine learning algorithms, which solve the active learning problem by choosing a training sequence that will maximally reduce the learner's uncertainty about the task. While we show that these algorithms do not provide an adequate description of human behavior, our results suggest ways to improve human motor learning by helping people choose an optimal training sequence.

Pigeons and humans use action and pose information to categorize complex human behaviors.

PubMed

Qadri, Muhammad A J; Cook, Robert G

2017-02-01

The biological mechanisms used to categorize and recognize behaviors are poorly understood in both human and non-human animals. Using animated digital models, we have recently shown that pigeons can categorize different locomotive animal gaits and types of complex human behaviors. In the current experiments, pigeons (go/no-go task) and humans (choice task) both learned to conditionally categorize two categories of human behaviors that did not repeat and were comprised of the coordinated motions of multiple limbs. These "martial arts" and "Indian dance" action sequences were depicted by a digital human model. Depending upon whether the model was in motion or not, each species was required to engage in different and opposing responses to the two behavioral categories. Both species learned to conditionally and correctly act on this dynamic and static behavioral information, indicating that both species use a combination of static pose cues that are available from stimulus onset in addition to less rapidly available action information in order to successfully discriminate between the behaviors. Human participants additionally demonstrated a bias towards the dynamic information in the display when re-learning the task. Theories that rely on generalized, non-specific visual mechanisms involving channels for motion and static cues offer a parsimonious account of how humans and pigeons recognize and categorize behaviors within and across species. Copyright © 2016 Elsevier Ltd. All rights reserved.

Improved discriminability of spatiotemporal neural patterns in rat motor cortical areas as directional choice learning progresses

PubMed Central

Mao, Hongwei; Yuan, Yuan; Si, Jennie

2015-01-01

Animals learn to choose a proper action among alternatives to improve their odds of success in food foraging and other activities critical for survival. Through trial-and-error, they learn correct associations between their choices and external stimuli. While a neural network that underlies such learning process has been identified at a high level, it is still unclear how individual neurons and a neural ensemble adapt as learning progresses. In this study, we monitored the activity of single units in the rat medial and lateral agranular (AGm and AGl, respectively) areas as rats learned to make a left or right side lever press in response to a left or right side light cue. We noticed that rat movement parameters during the performance of the directional choice task quickly became stereotyped during the first 2–3 days or sessions. But learning the directional choice problem took weeks to occur. Accompanying rats' behavioral performance adaptation, we observed neural modulation by directional choice in recorded single units. Our analysis shows that ensemble mean firing rates in the cue-on period did not change significantly as learning progressed, and the ensemble mean rate difference between left and right side choices did not show a clear trend of change either. However, the spatiotemporal firing patterns of the neural ensemble exhibited improved discriminability between the two directional choices through learning. These results suggest a spatiotemporal neural coding scheme in a motor cortical neural ensemble that may be responsible for and contributing to learning the directional choice task. PMID:25798093

Evaluating psychological markers for human nicotine dependence: tobacco choice, extinction, and Pavlovian-to-instrumental transfer.

PubMed

Hogarth, Lee; Chase, Henry W

2012-06-01

Individual differences in drug dependence may be mediated by several abnormalities in associative learning, including perseveration of drug-seeking following contingency change, greater control over drug-seeking by Pavlovian stimuli, or greater sensitivity to drug reinforcement establishing higher rates of drug-seeking. To evaluate these three candidate markers for nicotine dependence, Experiment 1 contrasted daily (N = 22) and nondaily smoker groups (N = 22) on a novel instrumental learning task, where one S+ was first trained as a predictor of tobacco reward before being extinguished. Experiment 2 compared daily (N = 18) and nondaily smoker groups (N = 18) on a concurrent-choice task for tobacco and chocolate reward before an extinction test in which the tobacco response was extinguished, followed by a Pavlovian-to-instrumental transfer test, wherein the impact of tobacco and chocolate cues on concurrent choice was measured (gender was balanced within each smoker group). The results showed no group difference in sensitivity to extinction of either the stimulus-drug or response-drug contingency in Experiments 1 and 2, respectively, nor did groups show a difference in Pavlovian-to-instrumental transfer of control over tobacco choice. By contrast, nicotine-dependence status was marked by a higher frequency of tobacco choice in the concurrent-choice procedure, and this choice preference was associated with subjective craving (gender did not affect any behavioral measure). These results favor the view that nicotine dependence in this sample is not determined by individual predilection for perseveration or stimulus-control over drug-seeking, but by greater sensitivity to reinforcement of instrumental drug choice. Value-based decision theories of dependence are discussed.

Threat affects risk preferences in movement decision making

PubMed Central

O'Brien, Megan K.; Ahmed, Alaa A.

2015-01-01

Emotional states such as sadness, anger, and threat have been shown to play a critical role in decision-making processes. Here we addressed the question of whether risk preferences are influenced by postural threat and whether this influence generalizes across motor tasks. We examined risk attitudes in the context of arm-reaching (ARM) and whole-body (WB) leaning movements, expecting that increased postural threat would lead to proportionally similar changes in risk-sensitivity for each motor task. Healthy young adults were shown a series of two-alternative forced-choice lotteries, where they were asked to choose between a riskier lottery and a safer lottery on each trial. Our lotteries consisted of different monetary rewards and target sizes. Subjects performed each choice task at ground level and atop an elevated platform. In the presence of this postural threat, increased physiological arousal was correlated with decreased movement variability. To determine risk-sensitivity, we quantified the frequency with which a subject chose the riskier lottery and fit lottery responses to a choice model based on cumulative prospect theory (CPT). Subjects exhibited idiosyncratic changes in risk-sensitivity between motor tasks and between elevations. However, we found that overweighting of small probabilities increased with postural threat in the WB task, indicating a more cautious, risk-averse strategy is ascribed to the possibility of a fall. Subjects were also more risk-seeking in the WB movements than in ARM at low elevation; this behavior does not seem to derive from consistent distortions in utility or probability representations but may be explained by subjects' inaccurate estimation of their own motor variability. Overall, our findings suggest that implicit threat can modify risk attitudes in the motor domain, and the threat may induce risk-aversion in salient movement tasks. PMID:26106311

Threat affects risk preferences in movement decision making.

PubMed

O'Brien, Megan K; Ahmed, Alaa A

2015-01-01

Emotional states such as sadness, anger, and threat have been shown to play a critical role in decision-making processes. Here we addressed the question of whether risk preferences are influenced by postural threat and whether this influence generalizes across motor tasks. We examined risk attitudes in the context of arm-reaching (ARM) and whole-body (WB) leaning movements, expecting that increased postural threat would lead to proportionally similar changes in risk-sensitivity for each motor task. Healthy young adults were shown a series of two-alternative forced-choice lotteries, where they were asked to choose between a riskier lottery and a safer lottery on each trial. Our lotteries consisted of different monetary rewards and target sizes. Subjects performed each choice task at ground level and atop an elevated platform. In the presence of this postural threat, increased physiological arousal was correlated with decreased movement variability. To determine risk-sensitivity, we quantified the frequency with which a subject chose the riskier lottery and fit lottery responses to a choice model based on cumulative prospect theory (CPT). Subjects exhibited idiosyncratic changes in risk-sensitivity between motor tasks and between elevations. However, we found that overweighting of small probabilities increased with postural threat in the WB task, indicating a more cautious, risk-averse strategy is ascribed to the possibility of a fall. Subjects were also more risk-seeking in the WB movements than in ARM at low elevation; this behavior does not seem to derive from consistent distortions in utility or probability representations but may be explained by subjects' inaccurate estimation of their own motor variability. Overall, our findings suggest that implicit threat can modify risk attitudes in the motor domain, and the threat may induce risk-aversion in salient movement tasks.

Procrastination in the pigeon: Can conditioned reinforcement increase the likelihood of human procrastination?

PubMed

Zentall, Thomas R; Case, Jacob P; Andrews, Danielle M

2017-11-29

Procrastination is the tendency to put off initiation or completion of a task. Although people are typically known to procrastinate, recent research suggests that they sometimes "pre-crastinate" by initiating a task sooner than they need to (Rosenbaum et al. in Psychological Science, 25(7), 1487-1496, 2014). A similar finding of precrastination was reported by Wasserman and Brzykcy (Psychonomic Bulletin & Review, 22, 1130-1134, 2015) with pigeons using a somewhat different procedure. In the present experiment, we used a procedure with pigeons that was more similar to the procedure used by Rosenbaum et al. Pigeons were given a choice between two sequences of events (concurrent chains). Choice of the procrastination chain resulted in color A, which 15-s later would change to color B and 5-s later resulted in reinforcement. Choice of the precrastination chain resulted in color C, which 5-s later would change to color D and 15-s later resulted in reinforcement. Thus, both chains led to reinforcement after 20 s. Results indicated that the pigeons procrastinated. That is, they preferred the 15-5 chain over the 5-15 chain. The results are consistent with Fantino's (Journal of the Experimental Analysis of Behavior, 12, 723-730, 1969) delay reduction theory, which posits that stimuli that signal a reduction in the delay to reinforcement, such as the 5-s stimulus that occurred immediately prior to reinforcement, serve as strong conditioned reinforcers and should be preferred. In support of this theory, the pigeons pecked most at the 5-s stimulus that led immediately to reinforcement, indicating that it had become a strong conditioned reinforcer. The results suggest that delay reduction theory, a theory that emphasizes the attraction to stimuli that predict reinforcement with a short delay, also may contribute to human procrastination behavior because when task completion comes just before the deadline, it may become a stronger conditioned reinforcer than if task completion comes earlier.

A Brief Experimental Analysis of Reinforcer and Response Dimensions Related to Self-Control in an Outpatient Clinic

ERIC Educational Resources Information Center

Falcomata, Terry S.; Cooper-Brown, Linda J.; Wacker, David P.; Gardner, Andrew W.; Boelter, Eric W.

2010-01-01

We conducted an assessment of self-control and impulsivity with 9 children referred to an outpatient clinic for impulsive, inattentive, and hyperactive behaviors. Each condition of the assessment consisted of a choice between 2 concurrently presented math or writing tasks, with 1 alternative reflecting impulsive responding and 1 alternative…

Segregation in Residential Areas: Papers on Racial and Socioeconomic Factors in Choice of Housing.

ERIC Educational Resources Information Center

Hawley, Amos H., Ed.; Rock, Vincent P., Ed.

The papers included in this volume were originally prepared for the Social Science Panel brought together by the Division of Behavioral Sciences of the National Research Council at the request of the National Academy of Sciences--National Academy of Engineering's Advisory Committee to the Department of Housing and Urban Development. The task of…

Decision Making in Children and Adolescents: Impaired Iowa Gambling Task Performance in Early Adolescence

ERIC Educational Resources Information Center

Smith, Dana G.; Xiao, Lin; Bechara, Antoine

2012-01-01

Disadvantageous decision making is cited as one of the premier problems in childhood development, underlying risky behavior and causing adolescents to make poor choices that could prove detrimental later in life. However, there are relatively few studies looking at the development of decision making in children and adolescents, and fewer still…

Predicting Risk-Taking Behavior from Prefrontal Resting-State Activity and Personality

PubMed Central

Studer, Bettina; Pedroni, Andreas; Rieskamp, Jörg

2013-01-01

Risk-taking is subject to considerable individual differences. In the current study, we tested whether resting-state activity in the prefrontal cortex and trait sensitivity to reward and punishment can help predict risk-taking behavior. Prefrontal activity at rest was assessed in seventy healthy volunteers using electroencephalography, and compared to their choice behavior on an economic risk-taking task. The Behavioral Inhibition System/Behavioral Activation System scale was used to measure participants’ trait sensitivity to reward and punishment. Our results confirmed both prefrontal resting-state activity and personality traits as sources of individual differences in risk-taking behavior. Right-left asymmetry in prefrontal activity and scores on the Behavioral Inhibition System scale, reflecting trait sensitivity to punishment, were correlated with the level of risk-taking on the task. We further discovered that scores on the Behavioral Inhibition System scale modulated the relationship between asymmetry in prefrontal resting-state activity and risk-taking. The results of this study demonstrate that heterogeneity in risk-taking behavior can be traced back to differences in the basic physiology of decision-makers’ brains, and suggest that baseline prefrontal activity and personality traits might interplay in guiding risk-taking behavior. PMID:24116176

Impulsivity and AMPA receptors: aniracetam ameliorates impulsive behavior induced by a blockade of AMPA receptors in rats.

PubMed

Nakamura, K; Kurasawa, M; Shirane, M

2000-04-17

The study aimed to ascertain the involvement of central AMPA receptors in impulsive behaviors of aged rats and to examine the effects of aniracetam. Premature response in the two-lever choice reaction task was assessed as an index of impulsivity. Intracerebroventricular injection of 2, 3-dihydroxy-6-nitro-7-sulfamoyl-benzo(F)quinoxaline (NBQX), an AMPA receptor antagonist, dose-dependently (10.1-1009 ng/rat) increased only premature response without altering responding speed and choice accuracy 30 min after the injection. Aniracetam (30 mg/kg p.o.), a positive allosteric modulator of AMPA receptors, or AMPA (55.9 ng/rat, co-injected with NBQX) completely restored the NBQX-induced increase in impulsivity. These results indicate that AMPA receptors are tonically involved in the regulation of impulsivity.

From creatures of habit to goal-directed learners: Tracking the developmental emergence of model-based reinforcement learning

PubMed Central

Decker, Johannes H.; Otto, A. Ross; Daw, Nathaniel D.; Hartley, Catherine A.

2016-01-01

Theoretical models distinguish two decision-making strategies that have been formalized in reinforcement-learning theory. A model-based strategy leverages a cognitive model of potential actions and their consequences to make goal-directed choices, whereas a model-free strategy evaluates actions based solely on their reward history. Research in adults has begun to elucidate the psychological mechanisms and neural substrates underlying these learning processes and factors that influence their relative recruitment. However, the developmental trajectory of these evaluative strategies has not been well characterized. In this study, children, adolescents, and adults, performed a sequential reinforcement-learning task that enables estimation of model-based and model-free contributions to choice. Whereas a model-free strategy was evident in choice behavior across all age groups, evidence of a model-based strategy only emerged during adolescence and continued to increase into adulthood. These results suggest that recruitment of model-based valuation systems represents a critical cognitive component underlying the gradual maturation of goal-directed behavior. PMID:27084852

Neural representation of expected value in the adolescent brain.

PubMed

Barkley-Levenson, Emily; Galván, Adriana

2014-01-28

Previous work shows that the adolescent reward system is hyperactive, but this finding may be confounded by differences in how teens value money. To address this, we examined the neural ontogeny of objective value representation. Adolescent and adult participants performed a monetary gambling task in which they chose to accept or reject gambles of varying expected value. Increasing expected value had a stronger influence over gambling choices in adolescents relative to adults, an effect that was paralleled by greater activation in the ventral striatum in adolescents. This unique adolescent ventral striatum response remained even after matching groups on acceptance behavior. These behavioral and neural data suggest that the value of available options has a greater influence in adolescent versus adult choices, even when objective value and subjective choice are held constant. This research provides further evidence that hyperactivation of reward circuitry in adolescence may be a normative ontogenetic shift that is due to greater valuation in the adolescent brain.

Neural representation of expected value in the adolescent brain

PubMed Central

Barkley-Levenson, Emily; Galván, Adriana

2014-01-01

Previous work shows that the adolescent reward system is hyperactive, but this finding may be confounded by differences in how teens value money. To address this, we examined the neural ontogeny of objective value representation. Adolescent and adult participants performed a monetary gambling task in which they chose to accept or reject gambles of varying expected value. Increasing expected value had a stronger influence over gambling choices in adolescents relative to adults, an effect that was paralleled by greater activation in the ventral striatum in adolescents. This unique adolescent ventral striatum response remained even after matching groups on acceptance behavior. These behavioral and neural data suggest that the value of available options has a greater influence in adolescent versus adult choices, even when objective value and subjective choice are held constant. This research provides further evidence that hyperactivation of reward circuitry in adolescence may be a normative ontogenetic shift that is due to greater valuation in the adolescent brain. PMID:24474790

Sex differences in impulsive action and impulsive choice.

PubMed

Weafer, Jessica; de Wit, Harriet

2014-11-01

Here, we review the evidence for sex differences in behavioral measures of impulsivity for both humans and laboratory animals. We focus on two specific components of impulsivity: impulsive action (i.e., difficulty inhibiting a prepotent response) and impulsive choice (i.e., difficulty delaying gratification). Sex differences appear to exist on these measures, but the direction and magnitude of the differences vary. In laboratory animals, impulsive action is typically greater in males than females, whereas impulsive choice is typically greater in females. In humans, women discount more steeply than men, but sex differences on measures of impulsive action depend on tasks and subject samples. We discuss implications of these findings as they relate to drug addiction. We also point out the major gaps in this research to date, including the lack of studies designed specifically to examine sex differences in behavioral impulsivity, and the lack of consideration of menstrual or estrous phase or sex hormone levels in the studies. © 2013.

Sex differences in impulsive action and impulsive choice

PubMed Central

Weafer, Jessica; de Wit, Harriet

2013-01-01

Here, we review the evidence for sex differences in behavioral measures of impulsivity for both humans and laboratory animals. We focus on two specific components of impulsivity: impulsive action (i.e., difficulty inhibiting a prepotent response) and impulsive choice (i.e., difficulty delaying gratification). Sex differences appear to exist on these measures, but the direction and magnitude of the differences vary. In laboratory animals, impulsive action is typically greater in males than females, whereas impulsive choice is typically greater in females. In humans, women discount more steeply than men, but sex differences on measures of impulsive action depend on tasks and subject samples. We discuss implications of these findings as they relate to drug addiction. We also point out the major gaps in this research to date, including the lack of studies designed specifically to examine sex differences in behavioral impulsivity, and the lack of consideration of menstrual or estrous phase or sex hormone levels in the studies. PMID:24286704

Dynamic modulation of decision biases by brainstem arousal systems.

PubMed

de Gee, Jan Willem; Colizoli, Olympia; Kloosterman, Niels A; Knapen, Tomas; Nieuwenhuis, Sander; Donner, Tobias H

2017-04-11

Decision-makers often arrive at different choices when faced with repeated presentations of the same evidence. Variability of behavior is commonly attributed to noise in the brain's decision-making machinery. We hypothesized that phasic responses of brainstem arousal systems are a significant source of this variability. We tracked pupil responses (a proxy of phasic arousal) during sensory-motor decisions in humans, across different sensory modalities and task protocols. Large pupil responses generally predicted a reduction in decision bias. Using fMRI, we showed that the pupil-linked bias reduction was (i) accompanied by a modulation of choice-encoding pattern signals in parietal and prefrontal cortex and (ii) predicted by phasic, pupil-linked responses of a number of neuromodulatory brainstem centers involved in the control of cortical arousal state, including the noradrenergic locus coeruleus. We conclude that phasic arousal suppresses decision bias on a trial-by-trial basis, thus accounting for a significant component of the variability of choice behavior.

Dynamic modulation of decision biases by brainstem arousal systems

PubMed Central

de Gee, Jan Willem; Colizoli, Olympia; Kloosterman, Niels A; Knapen, Tomas; Nieuwenhuis, Sander; Donner, Tobias H

2017-01-01

Decision-makers often arrive at different choices when faced with repeated presentations of the same evidence. Variability of behavior is commonly attributed to noise in the brain’s decision-making machinery. We hypothesized that phasic responses of brainstem arousal systems are a significant source of this variability. We tracked pupil responses (a proxy of phasic arousal) during sensory-motor decisions in humans, across different sensory modalities and task protocols. Large pupil responses generally predicted a reduction in decision bias. Using fMRI, we showed that the pupil-linked bias reduction was (i) accompanied by a modulation of choice-encoding pattern signals in parietal and prefrontal cortex and (ii) predicted by phasic, pupil-linked responses of a number of neuromodulatory brainstem centers involved in the control of cortical arousal state, including the noradrenergic locus coeruleus. We conclude that phasic arousal suppresses decision bias on a trial-by-trial basis, thus accounting for a significant component of the variability of choice behavior. DOI: http://dx.doi.org/10.7554/eLife.23232.001 PMID:28383284

Nucleus accumbens dopamine and the regulation of effort in food-seeking behavior: implications for studies of natural motivation, psychiatry, and drug abuse.

PubMed

Salamone, J D; Correa, M; Mingote, S; Weber, S M

2003-04-01

For several decades, it has been suggested that dopamine (DA), especially in nucleus accumbens, mediates the primary reinforcing characteristics of natural stimuli such as food, as well as drugs of abuse. Yet, several fundamental aspects of primary food reinforcement, motivation, and appetite are left intact after interference with accumbens DA transmission. Recent studies have shown that accumbens DA is involved in responsiveness to conditioned stimuli and activational aspects of motivation. In concurrent choice tasks, accumbens DA depletions cause animals to reallocate their choice behavior in the direction of instrumental behaviors that involve less effort. Also, an emerging body of evidence has demonstrated that the effects of accumbens DA depletions on instrumental food-seeking behavior can vary greatly depending upon the task. For example, some schedules of reinforcement are insensitive to the effects of DA depletions, whereas others are highly sensitive (e.g., large fixed ratios). Accumbens DA depletions slow the rate of operant responding, blunt the rate-facilitating effects of moderate-sized ratios, and enhance the rate-suppressing effects of very large ratios (i.e., produce ratio strain). Accumbens DA may be important for enabling rats to overcome behavioral constraints, such as work-related response costs, and may be critical for the behavioral organization and conditioning processes that enable animals to engage in vigorous responses, such as barrier climbing, or to emit large numbers of responses in ratio schedules in the absence of primary reinforcement. The involvement of accumbens DA in activational aspects of motivation has implications for energy-related disorders in psychiatry, as well as aspects of drug-seeking behavior.

Heterogeneous Suppression of Sequential Effects in Random Sequence Generation, but Not in Operant Learning.

PubMed

Shteingart, Hanan; Loewenstein, Yonatan

2016-01-01

There is a long history of experiments in which participants are instructed to generate a long sequence of binary random numbers. The scope of this line of research has shifted over the years from identifying the basic psychological principles and/or the heuristics that lead to deviations from randomness, to one of predicting future choices. In this paper, we used generalized linear regression and the framework of Reinforcement Learning in order to address both points. In particular, we used logistic regression analysis in order to characterize the temporal sequence of participants' choices. Surprisingly, a population analysis indicated that the contribution of the most recent trial has only a weak effect on behavior, compared to more preceding trials, a result that seems irreconcilable with standard sequential effects that decay monotonously with the delay. However, when considering each participant separately, we found that the magnitudes of the sequential effect are a monotonous decreasing function of the delay, yet these individual sequential effects are largely averaged out in a population analysis because of heterogeneity. The substantial behavioral heterogeneity in this task is further demonstrated quantitatively by considering the predictive power of the model. We show that a heterogeneous model of sequential dependencies captures the structure available in random sequence generation. Finally, we show that the results of the logistic regression analysis can be interpreted in the framework of reinforcement learning, allowing us to compare the sequential effects in the random sequence generation task to those in an operant learning task. We show that in contrast to the random sequence generation task, sequential effects in operant learning are far more homogenous across the population. These results suggest that in the random sequence generation task, different participants adopt different cognitive strategies to suppress sequential dependencies when generating the "random" sequences.

The Stomach-Derived Hormone Ghrelin Increases Impulsive Behavior

PubMed Central

Anderberg, Rozita H; Hansson, Caroline; Fenander, Maya; Richard, Jennifer E; Dickson, Suzanne L; Nissbrandt, Hans; Bergquist, Filip; Skibicka, Karolina P

2016-01-01

Impulsivity, defined as impaired decision making, is associated with many psychiatric and behavioral disorders, such as attention-deficit/hyperactivity disorder as well as eating disorders. Recent data indicate that there is a strong positive correlation between food reward behavior and impulsivity, but the mechanisms behind this relationship remain unknown. Here we hypothesize that ghrelin, an orexigenic hormone produced by the stomach and known to increase food reward behavior, also increases impulsivity. In order to assess the impact of ghrelin on impulsivity, rats were trained in three complementary tests of impulsive behavior and choice: differential reinforcement of low rate (DRL), go/no-go, and delay discounting. Ghrelin injection into the lateral ventricle increased impulsive behavior, as indicated by reduced efficiency of performance in the DRL test, and increased lever pressing during the no-go periods of the go/no-go test. Central ghrelin stimulation also increased impulsive choice, as evidenced by the reduced choice for large rewards when delivered with a delay in the delay discounting test. In order to determine whether signaling at the central ghrelin receptors is necessary for maintenance of normal levels of impulsive behavior, DRL performance was assessed following ghrelin receptor blockade with central infusion of a ghrelin receptor antagonist. Central ghrelin receptor blockade reduced impulsive behavior, as reflected by increased efficiency of performance in the DRL task. To further investigate the neurobiological substrate underlying the impulsivity effect of ghrelin, we microinjected ghrelin into the ventral tegmental area, an area harboring dopaminergic cell bodies. Ghrelin receptor stimulation within the VTA was sufficient to increase impulsive behavior. We further evaluated the impact of ghrelin on dopamine-related gene expression and dopamine turnover in brain areas key in impulsive behavior control. This study provides the first demonstration that the stomach-produced hormone ghrelin increases impulsivity and also indicates that ghrelin can change two major components of impulsivity—motor and choice impulsivity. PMID:26424164

Implicit affective associations predict snack choice for those with low, but not high levels of eating disorder symptomatology

PubMed Central

Ellis, Erin M.; Kiviniemi, Marc T.; Cook-Cottone, Catherine

2014-01-01

OBJECTIVE The central purpose of the current study was to examine whether eating disorder symptomatology moderates the extent to which implicitly and explicitly measured affective associations with fruits, or the feelings and emotions individuals associate with them, predict food choice. METHOD Participants (N=107) completed both implicit and explicit measures of affective associations with fruits, a self-report of eating disorder symptomatology, and their cognitive beliefs about fruits. In a subsequent snack selection task, they selected either a granola bar or fruit as a measure of their food choice behavior. RESULTS Logistic regression analyses revealed that eating disorder symptomatology moderated the relation of implicit affective associations on behavior, OR=0.27, p=.024, 95% CI (0.085, 0.84). A test of the simple effects indicated that implicit affective associations predicted snack choice at or below mean symptomatology levels [OR=2.073, p=.02, 95% CI (1.12, 3.84)], but not at high levels [OR=0.56, p=.28, 95% CI (0.18, 1.74)]. The effects of explicit measures on eating behavior were not moderated by eating disorder symptomatology (ps>.05). CONCLUSION These findings advance our understanding of both the relation of implicit affective associations on behavior, as well as the ways in which eating disorder symptomatology may impact the decision-making process, thereby perpetuating disorder-related eating behavior. These findings have implications for both health decision-making theory and practice, as well as for the study and treatment of eating disorders. PMID:24630936

Moral transgressions corrupt neural representations of value.

PubMed

Crockett, Molly J; Siegel, Jenifer Z; Kurth-Nelson, Zeb; Dayan, Peter; Dolan, Raymond J

2017-06-01

Moral systems universally prohibit harming others for personal gain. However, we know little about how such principles guide moral behavior. Using a task that assesses the financial cost participants ascribe to harming others versus themselves, we probed the relationship between moral behavior and neural representations of profit and pain. Most participants displayed moral preferences, placing a higher cost on harming others than themselves. Moral preferences correlated with neural responses to profit, where participants with stronger moral preferences had lower dorsal striatal responses to profit gained from harming others. Lateral prefrontal cortex encoded profit gained from harming others, but not self, and tracked the blameworthiness of harmful choices. Moral decisions also modulated functional connectivity between lateral prefrontal cortex and the profit-sensitive region of dorsal striatum. The findings suggest moral behavior in our task is linked to a neural devaluation of reward realized by a prefrontal modulation of striatal value representations.

Moral transgressions corrupt neural representations of value

PubMed Central

Crockett, Molly J.; Siegel, Jenifer Z.; Kurth-Nelson, Zeb; Dayan, Peter; Dolan, Raymond J.

2017-01-01

Moral systems universally prohibit harming others for personal gain. However, we know little about how such principles guide moral behavior. Using a task that assesses the financial cost participants ascribe to harming others versus themselves, we probed the relationship between moral behavior and neural representations of profit and pain. Most participants displayed moral preferences, placing a higher cost on harming others than themselves. Moral preferences correlated with neural responses to profit, where participants with stronger moral preferences had lower dorsal striatal (DS) responses to profit gained from harming others. Lateral prefrontal cortex (LPFC) encoded profits gained from harming others, but not self, and tracked the blameworthiness of harmful choices. Moral decisions also modulated functional connectivity between LPFC and the profit-sensitive region of DS. The findings suggest moral behavior in our task is linked to a neural devaluation of reward realized by a prefrontal modulation of striatal value representations. PMID:28459442

Who are the real bird brains? Qualitative differences in behavioral flexibility between dogs (Canis familiaris) and pigeons (Columba livia).

PubMed

Laude, Jennifer R; Pattison, Kristina F; Rayburn-Reeves, Rebecca M; Michler, Daniel M; Zentall, Thomas R

2016-01-01

Pigeons given a simultaneous spatial discrimination reversal, in which a single reversal occurs at the midpoint of each session, consistently show anticipation prior to the reversal as well as perseveration after the reversal, suggesting that they use a less effective cue (time or trial number into the session) than what would be optimal to maximize reinforcement (local feedback from the most recent trials). In contrast, rats (Rattus norvegicus) and humans show near-optimal reversal learning on this task. To determine whether this is a general characteristic of mammals, in the present research, pigeons (Columba livia) and dogs (Canis familiaris) were tested with a simultaneous spatial discrimination mid-session reversal. Overall, dogs performed the task more poorly than pigeons. Interestingly, both pigeons and dogs employed what resembled a timing strategy. However, dogs showed greater perseverative errors, suggesting that they may have relatively poorer working memory and inhibitory control with this task. The greater efficiency shown by pigeons with this task suggests they are better able to time and use the feedback from their preceding choice as the basis of their future choice, highlighting what may be a qualitative difference between the species.

Influence of sleep deprivation and auditory intensity on reaction time and response force.

PubMed

Włodarczyk, Dariusz; Jaśkowski, Piotr; Nowik, Agnieszka

2002-06-01

Arousal and activation are two variables supposed to underlie change in response force. This study was undertaken to explain these roles, specifically, for strong auditory stimuli and sleep deficit. Loud auditory stimuli can evoke phasic overarousal whereas sleep deficit leads to general underarousal. Moreover, Van der Molen and Keuss (1979, 1981) showed that paradoxically long reaction times occurred with extremely strong auditory stimuli when the task was difficult, e.g., choice reaction or Simon paradigm. It was argued that this paradoxical behavior related to reaction time is due to active disconnecting of the coupling between arousal and activation to prevent false responses. If so, we predicted that for extremely loud stimuli and for difficult tasks, the lengthening of reaction time should be associated with reduction of response force. The effects of loudness and sleep deficit on response time and force were investigated in three different tasks: simple response, choice response, and Simon paradigm. According to our expectation, we found a detrimental effect of sleep deficit on reaction time and on response force. In contrast to Van der Molen and Keuss, we found no increase in reaction time for loud stimuli (up to 110 dB) even on the Simon task.

Suboptimal foraging behavior: A new perspective on gambling

PubMed Central

Addicott, Merideth A.; Pearson, John M.; Kaiser, Nicole; Platt, Michael L.; McClernon, F. Joseph

2015-01-01

Why do people gamble? Conventional views hold that gambling may be motivated by irrational beliefs, risk-seeking, impulsive temperament, or dysfunction within the same reward circuitry affected by drugs of abuse. An alternate, unexplored perspective is that gambling is an extension of natural foraging behavior to a financial environment. However, when these foraging algorithms are applied to stochastic gambling outcomes, undesirable results may occur. To test this hypothesis, we recruited participants based on their frequency of gambling – yearly (or less), monthly, and weekly – and investigated how gambling frequency related to irrational beliefs, risk-taking/impulsivity, and foraging behavior. We found that increased gambling frequency corresponded to greater gambling-related beliefs, more exploratory choices on an explore/exploit foraging task, and fewer points earned on a patchy foraging task. Gambling-related beliefs negatively related to performance on the patchy foraging task, indicating that individuals with more gambling-related cognitions tended to leave a patch too quickly. This indicates that frequent gamblers have reduced foraging ability to maximize rewards; however, gambling frequency- and by extension, poor foraging ability- was not related to risk-taking or impulsive behavior. These results suggest that gambling reflects the application of a dysfunctional foraging process to financial outcomes. PMID:26191945

Suboptimal foraging behavior: a new perspective on gambling.

PubMed

Addicott, Merideth A; Pearson, John M; Kaiser, Nicole; Platt, Michael L; McClernon, F Joseph

2015-10-01

Why do people gamble? Conventional views hold that gambling may be motivated by irrational beliefs, risk-seeking, impulsive temperament, or dysfunction within the same reward circuitry affected by drugs of abuse. An alternate, unexplored perspective is that gambling is an extension of natural foraging behavior to a financial environment. However, when these foraging algorithms are applied to stochastic gambling outcomes, undesirable results may occur. To test this hypothesis, we recruited participants based on their frequency of gambling-yearly (or less), monthly, and weekly-and investigated how gambling frequency related to irrational beliefs, risk-taking/impulsivity, and foraging behavior. We found that increased gambling frequency corresponded to greater gambling-related beliefs, more exploratory choices on an explore/exploit foraging task, and fewer points earned on a Patchy Foraging Task. Gambling-related beliefs negatively related to performance on the Patchy Foraging Task, indicating that individuals with more gambling-related cognitions tended to leave a patch too quickly. This indicates that frequent gamblers have reduced foraging ability to maximize rewards; however, gambling frequency -and by extension, poor foraging ability- was not related to risk-taking or impulsive behavior. These results suggest that gambling reflects the application of a dysfunctional foraging process to financial outcomes. (c) 2015 APA, all rights reserved).

The monoamine-oxidase B inhibitor deprenyl increases selection of high-effort activity in rats tested on a progressive ratio/chow feeding choice procedure: Implications for treating motivational dysfunctions.

PubMed

Yohn, Samantha E; Reynolds, Shanika; Tripodi, Giuseppe; Correa, Merce; Salamone, John D

2018-04-16

Motivated behaviors often are characterized by a high degree of behavioral activation and work output, and organisms frequently make effort-related decisions based upon cost/benefit analyses. Moreover, people with depression and other disorders frequently show effort-related motivational symptoms, such as anergia, psychomotor retardation, and fatigue. Tasks measuring effort-related choice are being used as animal models of these motivational symptoms. The present studies characterized the ability of the monoamine oxidase -B (MAO-B) inhibitor deprenyl (selegiline) to enhance selection of high-effort lever pressing in rats tested on a concurrent progressive ratio (PROG)/chow feeding choice task. Deprenyl is widely used as an antiparkinsonian drug, but it also has been shown to have antidepressant effects in humans, and to induce antidepressant-like effects in traditional rodent models of depression. Systemic administration of deprenyl (1.5-12.0 mg/kg IP) shifted choice behavior, significantly increasing markers of PROG lever pressing at a moderate dose (6.0 mg/kg), and decreasing chow intake at 6.0 and 12.0 mg/kg. Intracranial injections of deprenyl into nucleus accumbens (2.0 and 4.0 μg) also increased PROG lever pressing and decreased chow intake. Microdialysis studies showed that the dose of deprenyl that was effective at increasing PROG lever pressing (6.0 mg/kg) also significantly elevated extracellular dopamine in nucleus accumbens. Thus, similar to the well-known antidepressant bupropion, deprenyl is capable of increasing selection of high-effort PROG lever pressing at doses that increase extracellular dopamine in nucleus accumbens. These studies have implications for the potential use of MAO-B inhibitors as treatments for the motivational symptoms of depression and Parkinsonism. Copyright © 2018 Elsevier B.V. All rights reserved.

Mice plan decision strategies based on previously learned time intervals, locations, and probabilities

PubMed Central

Tosun, Tuğçe; Gür, Ezgi; Balcı, Fuat

2016-01-01

Animals can shape their timed behaviors based on experienced probabilistic relations in a nearly optimal fashion. On the other hand, it is not clear if they adopt these timed decisions by making computations based on previously learnt task parameters (time intervals, locations, and probabilities) or if they gradually develop their decisions based on trial and error. To address this question, we tested mice in the timed-switching task, which required them to anticipate when (after a short or long delay) and at which of the two delay locations a reward would be presented. The probability of short trials differed between test groups in two experiments. Critically, we first trained mice on relevant task parameters by signaling the active trial with a discriminative stimulus and delivered the corresponding reward after the associated delay without any response requirement (without inducing switching behavior). During the test phase, both options were presented simultaneously to characterize the emergence and temporal characteristics of the switching behavior. Mice exhibited timed-switching behavior starting from the first few test trials, and their performance remained stable throughout testing in the majority of the conditions. Furthermore, as the probability of the short trial increased, mice waited longer before switching from the short to long location (experiment 1). These behavioral adjustments were in directions predicted by reward maximization. These results suggest that rather than gradually adjusting their time-dependent choice behavior, mice abruptly adopted temporal decision strategies by directly integrating their previous knowledge of task parameters into their timed behavior, supporting the model-based representational account of temporal risk assessment. PMID:26733674

Performance of Young Adult Cannabis Users on Neurocognitive Measures of Impulsive Behavior and their Relationship to Symptoms of Cannabis Use Disorders

PubMed Central

Gonzalez, Raul; Schuster, Randi Melissa; Mermelstein, Robin J.; Vassileva, Jasmin; Martin, Eileen M.; Diviak, Kathleen R.

2012-01-01

Recent studies suggest that abstinent cannabis users show deficits on neurocognitive laboratory tasks of impulsive behavior. But results are mixed and less is known on the performance of non-treatment seeking, young adult cannabis users. Importantly, relationships between performance on measures of impulsive behavior and symptoms of cannabis addiction remain relatively unexplored. We compared young adult current cannabis users (CU, n = 65) and non-using controls (NU, n = 65) on several laboratory measures of impulsive behavior, as well as on a measure of episodic memory commonly impacted by cannabis use. The CU group performed more poorly than the NU group on the Hopkins Verbal Learning Test-Revised Total Immediate Recall and Delayed Recall. No significant differences were observed on the measures of impulsive behavior (i.e., Iowa Gambling Task [IGT], Go-Stop Task, Monetary Choice Questionnaire, Balloon Analogue Risk Task). We examined relationships between neurocognitive performance and symptoms of cannabis use disorder symptoms (DSM-IV CUD) among the CU group, which revealed that poorer IGT performance was associated with more symptoms of DSM-IV CUD. Our results show poorer memory performance among young adult cannabis users relative to healthy controls, but no differences on measures of impulsive behavior. However, performance on a specific type of impulsive behavior (i.e., poorer decision-making) was associated with more cannabis use disorder symptoms. These results provide preliminary evidence to suggest that decision-making deficits may be more strongly associated with problems experienced from cannabis use, rather than solely being a consequence of cannabis use, per se. PMID:22882144

Linking dynamic patterns of neural activity in orbitofrontal cortex with decision making.

PubMed

Rich, Erin L; Stoll, Frederic M; Rudebeck, Peter H

2018-04-01

Humans and animals demonstrate extraordinary flexibility in choice behavior, particularly when deciding based on subjective preferences. We evaluate options on different scales, deliberate, and often change our minds. Little is known about the neural mechanisms that underlie these dynamic aspects of decision-making, although neural activity in orbitofrontal cortex (OFC) likely plays a central role. Recent evidence from studies in macaques shows that attention modulates value responses in OFC, and that ensembles of OFC neurons dynamically signal different options during choices. When contexts change, these ensembles flexibly remap to encode the new task. Determining how these dynamic patterns emerge and relate to choices will inform models of decision-making and OFC function. Copyright © 2017 Elsevier Ltd. All rights reserved.

Let the sunshine in? The effects of luminance on economic preferences, choice consistency and dominance violations

PubMed Central

Glimcher, Paul W.

2017-01-01

Weather, in particular the intensity and duration of sunshine (luminance), has been shown to significantly affect financial markets. Yet, because of the complexity of market interactions we do not know how human behavior is affected by luminance in a way that could inform theoretical choice models. In this paper, we use data from a field study using an incentive-compatible, decision task conducted daily over a period of two years and from the US Earth System Research Laboratory luminance sensor to investigate the impact of luminance on risk preferences, ambiguity preferences, choice consistency and dominance violations. We find that luminance levels affect all of these. Age and gender influence the strength of some of these effects. PMID:28783734

The Language of Substance Use and Recovery: Novel Use of the Go/No-Go Association Task to Measure Implicit Bias.

PubMed

Ashford, Robert D; Brown, Austin M; Curtis, Brenda

2018-06-04

Previous research has found initial evidence that word choice impacts the perception and treatment of those with behavioral health disorders through explicit bias (i.e., stigma). A more robust picture of behavioral health disorder stigma should incorporate both explicit and implicit bias, rather than relying on only one form. The current study uses the Go/No-Go Association Task to calculate a d' (sensitivity) indexed score of automatic attitudes (i.e., implicit associations) to two terms, "addict" and "person with substance use disorder." Participants have significantly more negative automatic attitudes (i.e., implicit bias) toward the term "addict" in isolation as well as when compared to "person with a substance use disorder." Consistent with previous research on explicit bias, implicit bias does exist for terms commonly used in the behavioral health field. "Addict" should not be used in professional or lay settings. Additionally, these results constitute the second pilot study employed the Go/No-Go Association Task in this manner, suggesting it is a viable option for continued linguistic stigma related research.

Social contagion of ethnic hostility

PubMed Central

Cahlíková, Jana; Chytilová, Julie; Želinský, Tomáš

2018-01-01

Interethnic conflicts often escalate rapidly. Why does the behavior of masses easily change from cooperation to aggression? This paper provides an experimental test of whether ethnic hostility is contagious. Using incentivized tasks, we measured willingness to sacrifice one’s own resources to harm others among adolescents from a region with a history of animosities toward the Roma people, the largest ethnic minority in Europe. To identify the influence of peers, subjects made choices after observing either destructive or peaceful behavior of peers in the same task. We found that susceptibility to follow destructive behavior more than doubled when harm was targeted against Roma rather than against coethnics. When peers were peaceful, subjects did not discriminate. We observed very similar patterns in a norms-elicitation experiment: destructive behavior toward Roma was not generally rated as more socially appropriate than when directed at coethnics, but the ratings were more sensitive to social contexts. The findings may illuminate why ethnic hostilities can spread quickly, even in societies with few visible signs of interethnic hatred. PMID:29686071

Chronic pain impairs cognitive flexibility and engages novel learning strategies in rats.

PubMed

Cowen, Stephen L; Phelps, Caroline E; Navratilova, Edita; McKinzie, David L; Okun, Alec; Husain, Omar; Gleason, Scott D; Witkin, Jeffrey M; Porreca, Frank

2018-03-22

Cognitive flexibility, the ability to adapt behavior to changing outcomes, is critical for survival. The prefrontal cortex is a key site of cognitive control and chronic pain is known to lead to significant morphological changes to this brain region. Nevertheless, the effects of chronic pain on cognitive flexibility and learning remain uncertain. We used an instrumental paradigm to assess adaptive learning in an experimental model of chronic pain induced by tight ligation of the spinal nerves L5/6 (SNL model). Naïve, sham-operated, and SNL rats were trained to perform fixed-ratio, variable-ratio, and contingency-shift behaviors for food reward. Although all groups learned an initial lever-reward contingency, learning was slower in SNL animals in a subsequent choice task that reversed reinforcement contingencies. Temporal analysis of lever-press responses across sessions indicated no apparent deficits in memory consolidation or retrieval. However, analysis of learning within sessions revealed that the lever presses of SNL animals occurred in bursts followed by delays. Unexpectedly, the degree of bursting correlated positively with learning. Under a variable-ratio probabilistic task, SNL rats chose a less profitable behavioral strategy compared to naïve and sham-operated animals. Following extinction of behavior for learned preferences, SNL animals reverted to their initially preferred (i.e., less profitable) behavioral choice. Our data suggest, that in the face of uncertainty, chronic pain drives a preference for familiar associations, consistent with reduced cognitive flexibility. The observed burst-like responding may represent a novel learning strategy in animals with chronic pain.

Preference for oddity: uniqueness heuristic or hierarchical choice process?

PubMed

Waite, Thomas A

2008-10-01

Traditional economic theories assume decision makers in multialternative choice tasks "assign" a value to each option and then express rational preferences. Here, I report an apparent violation of such rationality in gray jays (Perisoreus canadensis). I tested the jays' preference in a quaternary choice task where three options were the same color and the fourth option was a different color. All options offered an identical food reward and so the strictly rational expectation was that subjects would choose the odd-colored option in 25% of choices. In clear disagreement, every subject chose the odd option more frequently than expected. I speculate as to how this surprising preference for oddity might have been ecologically rational: by using a unique-choice heuristic, the jays might have been able to bypass a deliberative phase of the decision process and devote more attention to scanning for predators. Alternatively, it is conceivable that the jays did not prefer oddity per se. Instead, they might have used a hierarchical process, assigning options to color categories and then choosing between categories. If so, their behavior matches expectation after all (on average, subjects chose the odd option 50% of the time). It should be straightforward to test these competing hypotheses. The current results can be viewed as a new example of how simple mechanisms sometimes produce economically puzzling yet ecologically rational decision making.

Dissociable Brain Signatures of Choice Conflict and Immediate Reward Preferences in Alcohol Use Disorders

PubMed Central

Amlung, Michael; Sweet, Lawrence H.; Acker, John; Brown, Courtney L.; MacKillop, James

2013-01-01

Impulsive delayed reward discounting (DRD) is an important behavioral process in alcohol use disorders (AUDs), reflecting incapacity to delay gratification. Recent work in neuroeconomics has begun to unravel the neural mechanisms supporting DRD, but applications of neuroeconomics in relation to AUDs have been limited. This study examined the neural mechanisms of DRD preferences in AUDs, with emphasis on dissociating activation patterns based on DRD choice type and level of cognitive conflict. Heavy drinking adult males with (n = 13) and without (n = 12) a diagnosis of an AUD completed a monetary DRD task during a functional magnetic resonance imaging scan. Participant responses were coded based on choice type (impulsive vs. restrained) and level of cognitive conflict (easy vs. hard). AUD+ participants exhibited significantly more impulsive DRD decision-making. Significant activation during DRD was found in several decision-making regions, including dorsolateral prefrontal cortex (DLPFC), insula, posterior parietal cortex (PPC), and posterior cingulate. An axis of cognitive conflict was also observed, with hard choices associated with anterior cingulate cortex and easy choices associated with activation in supplementary motor area. AUD+ individuals exhibited significant hyperactivity in regions associated with cognitive control (DLPFC) and prospective thought (PPC) and exhibited less task-related deactivation of areas associated with the brain's default network during DRD decisions. This study provides further clarification of the brain systems supporting DRD in general and in relation to AUDs. PMID:23231650

Individual laboratory-measured discount rates predict field behavior

PubMed Central

Chabris, Christopher F.; Laibson, David; Morris, Carrie L.; Schuldt, Jonathon P.; Taubinsky, Dmitry

2009-01-01

We estimate discount rates of 555 subjects using a laboratory task and find that these individual discount rates predict inter-individual variation in field behaviors (e.g., exercise, BMI, smoking). The correlation between the discount rate and each field behavior is small: none exceeds 0.28 and many are near 0. However, the discount rate has at least as much predictive power as any variable in our dataset (e.g., sex, age, education). The correlation between the discount rate and field behavior rises when field behaviors are aggregated: these correlations range from 0.09-0.38. We present a model that explains why specific intertemporal choice behaviors are only weakly correlated with discount rates, even though discount rates robustly predict aggregates of intertemporal decisions. PMID:19412359

Individual laboratory-measured discount rates predict field behavior.

PubMed

Chabris, Christopher F; Laibson, David; Morris, Carrie L; Schuldt, Jonathon P; Taubinsky, Dmitry

2008-12-01

We estimate discount rates of 555 subjects using a laboratory task and find that these individual discount rates predict inter-individual variation in field behaviors (e.g., exercise, BMI, smoking). The correlation between the discount rate and each field behavior is small: none exceeds 0.28 and many are near 0. However, the discount rate has at least as much predictive power as any variable in our dataset (e.g., sex, age, education). The correlation between the discount rate and field behavior rises when field behaviors are aggregated: these correlations range from 0.09-0.38. We present a model that explains why specific intertemporal choice behaviors are only weakly correlated with discount rates, even though discount rates robustly predict aggregates of intertemporal decisions.

Deficits in novelty exploration after controlled cortical impact.

PubMed

Wagner, Amy K; Postal, Brett A; Darrah, Shaun D; Chen, Xiangbai; Khan, Amina S

2007-08-01

Experimental models of traumatic brain injury (TBI) have been utilized to characterize the behavioral derangements associated with brain trauma. Several studies exist characterizing motor function in the controlled cortical impact (CCI) injury model of TBI, but less research has focused on how CCI affects exploratory behavior. The goal of this study was to characterize deficits in three novelty exploration tasks after the CCI. Under anesthesia, 37 adult male Sprague Dawley rats received CCI (2.7 mm and 2.9 mm; 4 m/sec) over the right parietal cortex or sham surgery. For days 1-6 post-surgery, the beam balance and beam walking tasks were used to assess motor deficits. The Open Field, Y-Maze, and Free Choice Novelty (FCN) tasks were used to measure exploratory deficits from days 7-14 post-surgery. Injured rats displayed a significant, but transient, deficit on each motor task (p < 0.0001). Open Field results showed that injured rats had lower activity levels than shams (p < 0.0001), displayed less habituation to the task, and had more anxiety related behaviors (thigmotaxis) across days (p < 0.0001). Y-maze results suggest that injured rats spent less time in the novel arm versus the familiar arms when compared to shams (p < 0.0001). For FCN, injured rats were less active (p < 0.05) and spent less time and had fewer interactions with objects in the novel environment compared to shams (p < 0.05). These results suggest that several ethological factors contribute to exploratory deficits after CCI and can be effectively characterized with the behavioral tasks described. Future work will utilize these tasks to evaluate the neural substrates underlying exploratory deficits after TBI.

English Bar as a Venue to Boost Students' Speaking Self-Efficacy at the Tertiary Level

ERIC Educational Resources Information Center

Liu, Mingxu

2013-01-01

Research in EFL and ESL has confirmed that self-efficacy affects language learners' choices of learning tasks, persistence, motivation and achievement. As a cognitive construct, self-efficacy can be strengthened by both outcomes of behaviors and input from the environment. This paper studies the effects of an English Bar, a self-access center for…

Looking and Touching: What Extant Approaches Reveal about the Structure of Early Word Knowledge

ERIC Educational Resources Information Center

Hendrickson, Kristi; Mitsven, Samantha; Poulin-Dubois, Diane; Zesiger, Pascal; Friend, Margaret

2015-01-01

The goal of the current study is to assess the temporal dynamics of vision and action to evaluate the underlying word representations that guide infants' responses. Sixteen-month-old infants participated in a two-alternative forced-choice word-picture matching task. We conducted a moment-by-moment analysis of looking and reaching behaviors as they…

Indirect Goal Priming Is More Powerful than Explicit Instruction in Children

ERIC Educational Resources Information Center

Kesek, Amanda; Cunningham, William A.; Packer, Dominic J.; Zelazo, Philip David

2011-01-01

This study examined the relative efficacy of explicit instruction and indirect priming on young children's behavior in a task that required a series of choices between a small immediate reward and a larger delayed reward. One hundred and six 4-year-old children were randomly assigned to one of four conditions involving one of two goals (maximize…

The Role of Gender, Self- and Task Perceptions in Mathematics and Science Participation among College Students.

ERIC Educational Resources Information Center

Lips, Hilary M.

The tendency of female students to avoid mathematics and science courses has been of concern to many researchers. The concern stems from the fact that avoidance of these academic areas places young women in a position of reduced choice with respect to careers. This research examined mathematics and science related attitudes and behaviors among…

Strong seduction: impulsivity and the impact of contextual cues on instrumental behavior in alcohol dependence.

PubMed

Sommer, C; Garbusow, M; Jünger, E; Pooseh, S; Bernhardt, N; Birkenstock, J; Schad, D J; Jabs, B; Glöckler, T; Huys, Q M; Heinz, A; Smolka, M N; Zimmermann, U S

2017-08-01

Alcohol-related cues acquire incentive salience through Pavlovian conditioning and then can markedly affect instrumental behavior of alcohol-dependent patients to promote relapse. However, it is unclear whether similar effects occur with alcohol-unrelated cues. We tested 116 early-abstinent alcohol-dependent patients and 91 healthy controls who completed a delay discounting task to assess choice impulsivity, and a Pavlovian-to-instrumental transfer (PIT) paradigm employing both alcohol-unrelated and alcohol-related stimuli. To modify instrumental choice behavior, we tiled the background of the computer screen either with conditioned stimuli (CS) previously generated by pairing abstract pictures with pictures indicating monetary gains or losses, or with pictures displaying alcohol or water beverages. CS paired to money gains and losses affected instrumental choices differently. This PIT effect was significantly more pronounced in patients compared to controls, and the group difference was mainly driven by highly impulsive patients. The PIT effect was particularly strong in trials in which the instrumental stimulus required inhibition of instrumental response behavior and the background CS was associated to monetary gains. Under that condition, patients performed inappropriate approach behavior, contrary to their previously formed behavioral intention. Surprisingly, the effect of alcohol and water pictures as background stimuli resembled that of aversive and appetitive CS, respectively. These findings suggest that positively valenced background CS can provoke dysfunctional instrumental approach behavior in impulsive alcohol-dependent patients. Consequently, in real life they might be easily seduced by environmental cues to engage in actions thwarting their long-term goals. Such behaviors may include, but are not limited to, approaching alcohol.

Relationship between impulsivity and decision-making in cocaine dependence

PubMed Central

Kjome, Kimberly L.; Lane, Scott D.; Schmitz, Joy M.; Green, Charles; Ma, Liangsuo; Prasla, Irshad; Swann, Alan C.; Moeller, F. Gerard

2010-01-01

Impulsivity and decision-making are associated on a theoretical level in that impaired planning is a component of both. However, few studies have examined the relationship between measures of decision-making and impulsivity in clinical populations. The purpose of this study was to compare cocaine-dependent subjects to controls on a measure of decision-making (the Iowa Gambling Task or IGT), a questionnaire measure of impulsivity (the Barratt Impulsiveness Scale or BIS-11), and a measure of behavioral inhibition (the immediate memory task or IMT), and to examine the interrelationship among these measures. Results of the study showed that cocaine-dependent subjects made more disadvantageous choices on the IGT, had higher scores on the BIS, and more commission errors on the IMT. Cognitive model analysis showed that choice consistency factors on the IGT differed between cocaine-dependent subjects and controls. However, there was no significant correlation between IGT performance and the BIS total score or subscales or IMT commission errors. These results suggest that in cocaine dependent subjects there is little overlap between decision-making as measured by the IGT and impulsivity/behavioral inhibition as measured by the BIS and IMT. PMID:20478631

Comparison of obese adults with poor versus good sleep quality during a functional neuroimaging delay discounting task: A pilot study.

PubMed

Martin, Laura E; Pollack, Lauren; McCune, Ashley; Schulte, Erica; Savage, Cary R; Lundgren, Jennifer D

2015-10-30

This study aimed to determine if obese adults with poor versus good sleep quality demonstrate reduced self-regulatory capacity and different patterns of neural activation when making impulsive monetary choices. Six obese, good quality sleepers (M age=44.7 years, M BMI=38.1 kg/m(2)) were compared to 13 obese, poor quality sleepers (M age=42.6, M BMI=39.2 kg/m(2)) on sleep and eating behavior and brain activation in prefrontal and insular regions while engaging in a delay discounting task during functional magnetic resonance imaging (fMRI). Poor quality sleepers demonstrated significantly lower brain activation in the right inferior frontal gyrus, right middle frontal gyrus, and bilateral insula when making immediate and smaller (impulsive) monetary choices compared to the baseline condition. Behaviorally, poor compared to good quality sleepers reported higher scores in the night eating questionnaire. Obese adults with poor sleep quality demonstrate decreased brain activation in multiple regions that regulate cognitive control and interceptive awareness, possibly reducing self-regulatory capacity when making immediately gratifying decisions. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Personal Conflict Impairs Performance on an Unrelated Self-Control Task: Lingering Costs of Uncertainty and Conflict.

PubMed

Alquist, Jessica L; Baumeister, Roy F; McGregor, Ian; Core, Tammy J; Benjamin, Ilil; Tice, Dianne M

2018-01-01

People have the ability to make important choices in their lives, but deliberating about these choices can have costs. The present study was designed to test the hypothesis that writing about conflicted personal goals and values (conflict condition) would impair self-control on an unrelated subsequent task as compared to writing about clear personal goals and values (clarity condition). Personal conflict activates the behavioral inhibition system (BIS; Hirsh, Mar, & Peterson, 2012), which may make it harder for participants to successfully execute self-control. In this large ( N =337), pre-registered study participants in the conflict condition performed worse on anagrams than participants in the clarity condition, and the effect of condition on anagram performance was mediated by a subjective uncertainty measure of BIS activation. This suggests that BIS activation leads to poor self-control. Moreover, given that conflict is inherent in the exercise of self-control, results point to BIS activation as a mechanism for why initial acts of self-control impair self-control on subsequent, unrelated tasks.

Single dose testosterone administration modulates emotional reactivity and counterfactual choice in healthy males.

PubMed

Wu, Yin; Clark, Luke; Zilioli, Samuele; Eisenegger, Christoph; Gillan, Claire M; Deng, Huihua; Li, Hong

2018-04-01

Testosterone has been implicated in the regulation of emotional responses and risky decision-making. However, the causal effect of testosterone upon emotional decision-making, especially in non-social settings, is still unclear. The present study investigated the role of testosterone in counterfactual thinking: regret is an intense negative emotion that arises from comparison of an obtained outcome from a decision against a better, non-obtained (i.e. counterfactual) alternative. Healthy male participants (n = 64) received a single-dose of 150 mg testosterone Androgel in a double-blind, placebo-controlled, between-participants design. At 180 min post-administration, participants performed the counterfactual thinking task. We applied a computational model derived from behavioral economic principles to uncover latent decision-making mechanisms that may be invisible in simple choice analyses. Our data showed that testosterone increased the ability to use anticipated regret to guide choice behavior, while reducing choice based on expected value. On affective ratings, testosterone increased sensitivity to both obtained and counterfactual outcomes. These findings provide evidence that testosterone causally modulates emotional decision-making, and highlight the role of testosterone in affective sensitivity. Copyright © 2018 Elsevier Ltd. All rights reserved.

Effects of acute buspirone administration on inhibitory control and sexual discounting in cocaine users.

PubMed

Strickland, Justin C; Bolin, B Levi; Romanelli, Michael R; Rush, Craig R; Stoops, William W

2017-01-01

Cocaine users display deficits in inhibitory control and make impulsive choices that may increase risky behavior. Buspirone is an anxiolytic that activates dopaminergic and serotonergic systems and improves impulsive choice (i.e., reduces sexual risk-taking intent) in cocaine users when administered chronically. We evaluated the effects of acutely administered buspirone on inhibitory control and impulsive choice. Eleven subjects with a recent history of cocaine use completed this within-subject, placebo-controlled study. Subjects performed two cued go/no-go and a sexual risk delay-discounting task following oral administration of buspirone (10 and 30 mg), triazolam (0.375 mg; positive control), and placebo (negative control). Physiological and psychomotor performance and subject-rated data were also collected. Buspirone failed to change inhibitory control or impulsive choice; however, slower reaction times were observed at the highest dose tested. Buspirone did not produce subject-rated drug effects but dose-dependently decreased diastolic blood pressure. Triazolam impaired psychomotor performance and increased ratings of positive subject-rated effects (e.g., Like Drug). These findings indicate that acutely administered buspirone has little impact on behavioral measures of inhibitory control and impulsive sexual decision-making. Considering previous findings with chronic dosing, these findings highlight that the behavioral effects of buspirone differ as a function of dosing conditions. Copyright © 2017 John Wiley & Sons, Ltd.

Gender Differences in Food Choice: Effects of Superior Temporal Sulcus Stimulation.

PubMed

Manippa, Valerio; Padulo, Caterina; van der Laan, Laura N; Brancucci, Alfredo

2017-01-01

The easy availability of food has caused a shift from eating for survival to hedonic eating. Women, compared to men, have shown to respond differently to food cues in the environment on a behavioral and a neural level, in particular to energy rich (compared to low energy) foods. It has been demonstrated that the right posterior superior temporal sulcus (STS) is the only region exhibiting greater activation for high vs. low calorie food choices. In order to test for a possible causal role of STS in food choice, we applied high frequency transcranial random noise stimulation (tRNS) on STS assuming a different response pattern between males and females. Our participants (18 females, 17 males) performed a forced choice task between food pairs matched for individual liking but differed in calorie, during the left STS, right STS stimulation and sham condition. Male participants showed a general preference for low calorie (LC) foods compared to females. In addition, we observed in males, but not in females, an increase of high calorie (HC) food choice during right STS tRNS compared to sham condition and left STS tRNS. Finally, we found an increase of missed choices during right STS stimulation compared to sham condition and left STS stimulation. In conclusion, thanks to tRNS evidence, we both confirm the involvement and suggest a causal role of right posterior STS in feeding behavior. Moreover, we suggest that gender differences exist in STS mechanisms underlying food choice.

The Monty Hall dilemma in pigeons: effect of investment in initial choice.

PubMed

Stagner, Jessica P; Rayburn-Reeves, Rebecca; Zentall, Thomas R

2013-10-01

In the Monty Hall dilemma, humans are initially given a choice among three alternatives, one of which has a hidden prize. After choosing, but before it is revealed whether they have won the prize, they are shown that one of the remaining alternatives does not have the prize. They are then asked whether they want to stay with their original choice or switch to the remaining alternative. Although switching results in obtaining the prize two thirds of the time, humans consistently fail to adopt the optimal strategy of switching even after considerable training. Interestingly, there is evidence that pigeons show more optimal switching performance with this task than humans. Because humans often view even random choices already made as being more valuable than choices not made, we reasoned that if pigeons made a greater investment, it might produce an endowment or ownership effect resulting in more human-like suboptimal performance. On the other hand, the greater investment in the initial choice by the pigeons might facilitate switching behavior by helping them to better discriminate their staying versus switching behavior. In Experiment 1, we examined the effect of requiring pigeons to make a greater investment in their initial choice (20 pecks rather than the usual 1 peck). We found that the increased response requirement facilitated acquisition of the switching response. In Experiment 2, we showed that facilitation of switching due to the increased response requirement did not result from extinction of responding to the initially chosen location.

Gender Differences in Food Choice: Effects of Superior Temporal Sulcus Stimulation

PubMed Central

Manippa, Valerio; Padulo, Caterina; van der Laan, Laura N.; Brancucci, Alfredo

2017-01-01

The easy availability of food has caused a shift from eating for survival to hedonic eating. Women, compared to men, have shown to respond differently to food cues in the environment on a behavioral and a neural level, in particular to energy rich (compared to low energy) foods. It has been demonstrated that the right posterior superior temporal sulcus (STS) is the only region exhibiting greater activation for high vs. low calorie food choices. In order to test for a possible causal role of STS in food choice, we applied high frequency transcranial random noise stimulation (tRNS) on STS assuming a different response pattern between males and females. Our participants (18 females, 17 males) performed a forced choice task between food pairs matched for individual liking but differed in calorie, during the left STS, right STS stimulation and sham condition. Male participants showed a general preference for low calorie (LC) foods compared to females. In addition, we observed in males, but not in females, an increase of high calorie (HC) food choice during right STS tRNS compared to sham condition and left STS tRNS. Finally, we found an increase of missed choices during right STS stimulation compared to sham condition and left STS stimulation. In conclusion, thanks to tRNS evidence, we both confirm the involvement and suggest a causal role of right posterior STS in feeding behavior. Moreover, we suggest that gender differences exist in STS mechanisms underlying food choice. PMID:29270120

Working Memory and Decision-Making Biases in Young Adults With a Family History of Alcoholism: Studies from the Oklahoma Family Health Patterns Project

PubMed Central

Lovallo, William R.; Yechiam, Eldad; Sorocco, Kristen H.; Vincent, Andrea S.; Collins, Frank L.

2008-01-01

Background Alcohol misuse is more common in persons with a family history of alcoholism (FH+) than in those with no such history (FH−). Among FH+, behavioral disinhibition and male sex seem to signal the presence of an increased risk. Methods This study examined cognitive and behavioral characteristics of 175 nonabusing 18- to 30-year-olds, 87 FH+ and 88 FH−, who were further characterized by their degree of behavioral disinhibition using the Sociability scale of the California Personality Inventory. Working memory and decision making were tested using the Stroop Color-Word Test and the Iowa Gambling Task, a simulated card game. Results Persons with a family history of alcoholism who were behaviorally disinhibited displayed significantly greater interference on the Stroop task than the other subgroups. On the Iowa Gambling Task, FH+ males, but not the females, were significantly more attentive to financial gains than other subgroups, and they had greater consistency in their choice behaviors. Conclusions Persons with a family history of alcoholism, in combination with behavioral disinhibition, appears to signal working memory deficits and in combination with male sex indicates an attraction to the rewarding aspects of a risk-taking challenge. These findings are not secondary to heavy exposure to alcohol or other drugs, but instead reflect intrinsic risk-related familial and personal characteristics of the subjects. PMID:16634844

Comparison of Motor Inhibition in Variants of the Instructed-Delay Choice Reaction Time Task

PubMed Central

Quoilin, Caroline; Lambert, Julien; Jacob, Benvenuto; Klein, Pierre-Alexandre; Duque, Julie

2016-01-01

Using instructed-delay choice reaction time (RT) paradigms, many previous studies have shown that the motor system is transiently inhibited during response preparation: motor-evoked potentials (MEPs) elicited by transcranial magnetic stimulation (TMS) over the primary motor cortex are typically suppressed during the delay period. This effect has been observed in both selected and non-selected effectors, although MEP changes in selected effectors have been more inconsistent across task versions. Here, we compared changes in MEP amplitudes in three different variants of an instructed-delay choice RT task. All variants required participants to choose between left and right index finger movements but the responses were either provided “in the air” (Variant 1), on a regular keyboard (Variant 2), or on a response device designed to control from premature responses (Variant 3). The task variants also differed according to the visual layout (more concrete in Variant 3) and depending on whether participants received a feedback of their performance (absent in Variant 1). Behavior was globally comparable between the three variants of the task although the propensity to respond prematurely was highest in Variant 2 and lowest in Variant 3. MEPs elicited in a non-selected hand were similarly suppressed in the three variants of the task. However, significant differences emerged when considering MEPs elicited in the selected hand: these MEPs were suppressed in Variants 1 and 3 whereas they were often facilitated in Variant 2, especially in the right dominant hand. In conclusion, MEPs elicited in selected muscles seem to be more sensitive to small variations to the task design than those recorded in non-selected effectors, probably because they reflect a complex combination of inhibitory and facilitatory influences on the motor output system. Finally, the use of a standard keyboard seems to be particularly inappropriate because it encourages participants to respond promptly with no means to control for premature responses, probably increasing the relative amount of facilitatory influences at the time motor inhibition is probed. PMID:27579905

Comparison of Motor Inhibition in Variants of the Instructed-Delay Choice Reaction Time Task.

PubMed

Quoilin, Caroline; Lambert, Julien; Jacob, Benvenuto; Klein, Pierre-Alexandre; Duque, Julie

2016-01-01

Using instructed-delay choice reaction time (RT) paradigms, many previous studies have shown that the motor system is transiently inhibited during response preparation: motor-evoked potentials (MEPs) elicited by transcranial magnetic stimulation (TMS) over the primary motor cortex are typically suppressed during the delay period. This effect has been observed in both selected and non-selected effectors, although MEP changes in selected effectors have been more inconsistent across task versions. Here, we compared changes in MEP amplitudes in three different variants of an instructed-delay choice RT task. All variants required participants to choose between left and right index finger movements but the responses were either provided "in the air" (Variant 1), on a regular keyboard (Variant 2), or on a response device designed to control from premature responses (Variant 3). The task variants also differed according to the visual layout (more concrete in Variant 3) and depending on whether participants received a feedback of their performance (absent in Variant 1). Behavior was globally comparable between the three variants of the task although the propensity to respond prematurely was highest in Variant 2 and lowest in Variant 3. MEPs elicited in a non-selected hand were similarly suppressed in the three variants of the task. However, significant differences emerged when considering MEPs elicited in the selected hand: these MEPs were suppressed in Variants 1 and 3 whereas they were often facilitated in Variant 2, especially in the right dominant hand. In conclusion, MEPs elicited in selected muscles seem to be more sensitive to small variations to the task design than those recorded in non-selected effectors, probably because they reflect a complex combination of inhibitory and facilitatory influences on the motor output system. Finally, the use of a standard keyboard seems to be particularly inappropriate because it encourages participants to respond promptly with no means to control for premature responses, probably increasing the relative amount of facilitatory influences at the time motor inhibition is probed.

Reason's Enemy Is Not Emotion: Engagement of Cognitive Control Networks Explains Biases in Gain/Loss Framing

PubMed Central

2017-01-01

In the classic gain/loss framing effect, describing a gamble as a potential gain or loss biases people to make risk-averse or risk-seeking decisions, respectively. The canonical explanation for this effect is that frames differentially modulate emotional processes, which in turn leads to irrational choice behavior. Here, we evaluate the source of framing biases by integrating functional magnetic resonance imaging data from 143 human participants performing a gain/loss framing task with meta-analytic data from >8000 neuroimaging studies. We found that activation during choices consistent with the framing effect were most correlated with activation associated with the resting or default brain, while activation during choices inconsistent with the framing effect was most correlated with the task-engaged brain. Our findings argue against the common interpretation of gain/loss framing as a competition between emotion and control. Instead, our study indicates that this effect results from differential cognitive engagement across decision frames. SIGNIFICANCE STATEMENT The biases frequently exhibited by human decision makers have often been attributed to the presence of emotion. Using a large fMRI sample and analysis of whole-brain networks defined with the meta-analytic tool Neurosynth, we find that neural activity during frame-biased decisions was more significantly associated with default behaviors (and the absence of executive control) than with emotion. These findings point to a role for neuroscience in shaping long-standing psychological theories in decision science. PMID:28264981

Reason's Enemy Is Not Emotion: Engagement of Cognitive Control Networks Explains Biases in Gain/Loss Framing.

PubMed

Li, Rosa; Smith, David V; Clithero, John A; Venkatraman, Vinod; Carter, R McKell; Huettel, Scott A

2017-03-29

In the classic gain/loss framing effect, describing a gamble as a potential gain or loss biases people to make risk-averse or risk-seeking decisions, respectively. The canonical explanation for this effect is that frames differentially modulate emotional processes, which in turn leads to irrational choice behavior. Here, we evaluate the source of framing biases by integrating functional magnetic resonance imaging data from 143 human participants performing a gain/loss framing task with meta-analytic data from >8000 neuroimaging studies. We found that activation during choices consistent with the framing effect were most correlated with activation associated with the resting or default brain, while activation during choices inconsistent with the framing effect was most correlated with the task-engaged brain. Our findings argue against the common interpretation of gain/loss framing as a competition between emotion and control. Instead, our study indicates that this effect results from differential cognitive engagement across decision frames. SIGNIFICANCE STATEMENT The biases frequently exhibited by human decision makers have often been attributed to the presence of emotion. Using a large fMRI sample and analysis of whole-brain networks defined with the meta-analytic tool Neurosynth, we find that neural activity during frame-biased decisions was more significantly associated with default behaviors (and the absence of executive control) than with emotion. These findings point to a role for neuroscience in shaping long-standing psychological theories in decision science. Copyright © 2017 the authors 0270-6474/17/373588-11$15.00/0.

Self-Regulatory Capacities Are Depleted in a Domain-Specific Manner

PubMed Central

Zhang, Rui; Stock, Ann-Kathrin; Rzepus, Anneka; Beste, Christian

2017-01-01

Performing an act of self-regulation such as making decisions has been suggested to deplete a common limited resource, which impairs all subsequent self-regulatory actions (ego depletion theory). It has however remained unclear whether self-referred decisions truly impair behavioral control even in seemingly unrelated cognitive domains, and which neurophysiological mechanisms are affected by these potential depletion effects. In the current study, we therefore used an inter-individual design to compare two kinds of depletion, namely a self-referred choice-based depletion and a categorization-based switching depletion, to a non-depleted control group. We used a backward inhibition (BI) paradigm to assess the effects of depletion on task switching and associated inhibition processes. It was combined with EEG and source localization techniques to assess both behavioral and neurophysiological depletion effects. The results challenge the ego depletion theory in its current form: Opposing the theory’s prediction of a general limited resource, which should have yielded comparable effects in both depletion groups, or maybe even a larger depletion in the self-referred choice group, there were stronger performance impairments following a task domain-specific depletion (i.e., the switching-based depletion) than following a depletion based on self-referred choices. This suggests at least partly separate and independent resources for various cognitive control processes rather than just one joint resource for all self-regulation activities. The implications are crucial to consider for people making frequent far-reaching decisions e.g., in law or economy. PMID:29033798

Self-Regulatory Capacities Are Depleted in a Domain-Specific Manner.

PubMed

Zhang, Rui; Stock, Ann-Kathrin; Rzepus, Anneka; Beste, Christian

2017-01-01

Performing an act of self-regulation such as making decisions has been suggested to deplete a common limited resource, which impairs all subsequent self-regulatory actions (ego depletion theory). It has however remained unclear whether self-referred decisions truly impair behavioral control even in seemingly unrelated cognitive domains, and which neurophysiological mechanisms are affected by these potential depletion effects. In the current study, we therefore used an inter-individual design to compare two kinds of depletion, namely a self-referred choice-based depletion and a categorization-based switching depletion, to a non-depleted control group. We used a backward inhibition (BI) paradigm to assess the effects of depletion on task switching and associated inhibition processes. It was combined with EEG and source localization techniques to assess both behavioral and neurophysiological depletion effects. The results challenge the ego depletion theory in its current form: Opposing the theory's prediction of a general limited resource, which should have yielded comparable effects in both depletion groups, or maybe even a larger depletion in the self-referred choice group, there were stronger performance impairments following a task domain-specific depletion (i.e., the switching-based depletion) than following a depletion based on self-referred choices. This suggests at least partly separate and independent resources for various cognitive control processes rather than just one joint resource for all self-regulation activities. The implications are crucial to consider for people making frequent far-reaching decisions e.g., in law or economy.

Condition interference in rats performing a choice task with switched variable- and fixed-reward conditions.

PubMed

Funamizu, Akihiro; Ito, Makoto; Doya, Kenji; Kanzaki, Ryohei; Takahashi, Hirokazu

2015-01-01

Because humans and animals encounter various situations, the ability to adaptively decide upon responses to any situation is essential. To date, however, decision processes and the underlying neural substrates have been investigated under specific conditions; thus, little is known about how various conditions influence one another in these processes. In this study, we designed a binary choice task with variable- and fixed-reward conditions and investigated neural activities of the prelimbic cortex and dorsomedial striatum in rats. Variable- and fixed-reward conditions induced flexible and inflexible behaviors, respectively; one of the two conditions was randomly assigned in each trial for testing the possibility of condition interference. Rats were successfully conditioned such that they could find the better reward holes of variable-reward-condition and fixed-reward-condition trials. A learning interference model, which updated expected rewards (i.e., values) used in variable-reward-condition trials on the basis of combined experiences of both conditions, better fit choice behaviors than conventional models which updated values in each condition independently. Thus, although rats distinguished the trial condition, they updated values in a condition-interference manner. Our electrophysiological study suggests that this interfering value-updating is mediated by the prelimbic cortex and dorsomedial striatum. First, some prelimbic cortical and striatal neurons represented the action-reward associations irrespective of trial conditions. Second, the striatal neurons kept tracking the values of variable-reward condition even in fixed-reward-condition trials, such that values were possibly interferingly updated even in the fixed-reward condition.

Effects of pallidal deep brain stimulation and levodopa treatment on reaction-time performance in Parkinson's disease.

PubMed

Schubert, T; Volkmann, J; Müller, U; Sturm, V; Voges, J; Freund, H-J; Von Cramon, D Y

2002-05-01

Basal ganglia-thalamocortical circuits play an important role in movement preparation and execution. Tracer, single-cell, and lesion studies in monkeys suggest the existence of topologically segregated motor and nonmotor basal ganglia cortical circuits. In this study we used deep brain stimulation (DBS) of the posteroventrolateral globus pallidus internus (GPi) in patients with Parkinson's disease to elucidate the function of the GPi in human sensorimotor behavior. This question was investigated by comparing the influence of DBS on patients' performance in various reaction-time tasks that differed with respect to cognitive but not motor requirements. As a main result, DBS improved performance on the different tasks independently of the complexity of the involved cognitive processing functions. Furthermore, the observed effects did not depend on the modality of the processed information. These results suggest that the functional state of the posteroventrolateral GPi selectively affects the motor stage in simple sensorimotor acts, because this stage was the only stage involved in all investigated tasks. In addition to DBS, we manipulated the levodopa medication state of the PD patients. In contrast to DBS, levodopa effects on reaction times were less consistent. Levodopa improved reaction times in choice reaction tasks significantly, while affecting reaction times in a simple reaction task to a lesser extent. Error analysis revealed that the medication-dependent reaction-time improvement in the choice reaction tasks was accompanied by an increase in errors, suggesting a shift of the speed-accuracy criteria of the patients. A similar pattern of results was not observed for the DBS effects. Taken together, our data are in agreement with recent findings in monkeys that indicate a topological organization of the GPi in which motor functions are localized in posterolateral regions apart from cognitive regions. Furthermore, our data show a way to uncover the subcortical-cortical circuitry serving human sensorimotor behavior.

Selective suppression of the incorrect response implementation in choice behavior assessed by transcranial magnetic stimulation.

PubMed

Tandonnet, Christophe; Garry, Michael I; Summers, Jeffery J

2011-04-01

Selecting the adequate alternative in choice situations may involve an inhibition process. Here we assessed response implementation during the reaction time of a between-hand choice task with single- or paired-pulse (3 or 15 ms interstimulus intervals [ISIs]) transcranial magnetic stimulation of the motor cortex. The amplitude of the single-pulse motor evoked potential (MEP) initially increased for both hands. At around 130 ms, the single-pulse MEP kept increasing for the responding hand and decreased for the nonresponding hand. The paired-pulse MEP revealed a similar pattern for both ISIs with no effect on short intracortical inhibition and intracortical facilitation measures. The results suggest that the incorrect response implementation was selectively suppressed before execution of the correct response, preventing errors in choice context. The results favor models assuming that decision making involves an inhibition process. Copyright © 2010 Society for Psychophysiological Research.

Evaluating The Influence of Postsession Reinforcement on Choice of Reinforcers

PubMed Central

Kodak, Tiffany; Lerman, Dorothea C; Call, Nathan

2007-01-01

Factors that influence reinforcer choice have been examined in a number of applied studies (e.g., Neef, Mace, Shea, & Shade, 1992; Shore, Iwata, DeLeon, Kahng, & Smith, 1997; Tustin, 1994). However, no applied studies have evaluated the effects of postsession reinforcement on choice between concurrently available reinforcers, even though basic findings indicate that this is an important factor to consider (Hursh, 1978; Zeiler, 1999). In this bridge investigation, we evaluated the influence of postsession reinforcement on choice of two food items when task responding was reinforced on progressive-ratio schedules. Participants were 3 children who had been diagnosed with developmental disabilities. Results indicated that response allocation shifted from one food item to the other food item under thinner schedules of reinforcement when no postsession reinforcement was provided. These findings suggest that the efficacy of instructional programs or treatments for problem behavior may be improved by restricting reinforcers outside treatment sessions. PMID:17970264

Evaluating the influence of postsession reinforcement on choice of reinforcers.

PubMed

Kodak, Tiffany; Lerman, Dorothea C; Call, Nathan

2007-01-01

Factors that influence reinforcer choice have been examined in a number of applied studies (e.g., Neef, Mace, Shea, & Shade, 1992; Shore, Iwata, DeLeon, Kahng, & Smith, 1997; Tustin, 1994). However, no applied studies have evaluated the effects of postsession reinforcement on choice between concurrently available reinforcers, even though basic findings indicate that this is an important factor to consider (Hursh, 1978; Zeiler, 1999). In this bridge investigation, we evaluated the influence of postsession reinforcement on choice of two food items when task responding was reinforced on progressive-ratio schedules. Participants were 3 children who had been diagnosed with developmental disabilities. Results indicated that response allocation shifted from one food item to the other food item under thinner schedules of reinforcement when no postsession reinforcement was provided. These findings suggest that the efficacy of instructional programs or treatments for problem behavior may be improved by restricting reinforcers outside treatment sessions.

Decision making in recurrent neuronal circuits.

PubMed

Wang, Xiao-Jing

2008-10-23

Decision making has recently emerged as a central theme in neurophysiological studies of cognition, and experimental and computational work has led to the proposal of a cortical circuit mechanism of elemental decision computations. This mechanism depends on slow recurrent synaptic excitation balanced by fast feedback inhibition, which not only instantiates attractor states for forming categorical choices but also long transients for gradually accumulating evidence in favor of or against alternative options. Such a circuit endowed with reward-dependent synaptic plasticity is able to produce adaptive choice behavior. While decision threshold is a core concept for reaction time tasks, it can be dissociated from a general decision rule. Moreover, perceptual decisions and value-based economic choices are described within a unified framework in which probabilistic choices result from irregular neuronal activity as well as iterative interactions of a decision maker with an uncertain environment or other unpredictable decision makers in a social group.

Modeling the Violation of Reward Maximization and Invariance in Reinforcement Schedules

PubMed Central

La Camera, Giancarlo; Richmond, Barry J.

2008-01-01

It is often assumed that animals and people adjust their behavior to maximize reward acquisition. In visually cued reinforcement schedules, monkeys make errors in trials that are not immediately rewarded, despite having to repeat error trials. Here we show that error rates are typically smaller in trials equally distant from reward but belonging to longer schedules (referred to as “schedule length effect”). This violates the principles of reward maximization and invariance and cannot be predicted by the standard methods of Reinforcement Learning, such as the method of temporal differences. We develop a heuristic model that accounts for all of the properties of the behavior in the reinforcement schedule task but whose predictions are not different from those of the standard temporal difference model in choice tasks. In the modification of temporal difference learning introduced here, the effect of schedule length emerges spontaneously from the sensitivity to the immediately preceding trial. We also introduce a policy for general Markov Decision Processes, where the decision made at each node is conditioned on the motivation to perform an instrumental action, and show that the application of our model to the reinforcement schedule task and the choice task are special cases of this general theoretical framework. Within this framework, Reinforcement Learning can approach contextual learning with the mixture of empirical findings and principled assumptions that seem to coexist in the best descriptions of animal behavior. As examples, we discuss two phenomena observed in humans that often derive from the violation of the principle of invariance: “framing,” wherein equivalent options are treated differently depending on the context in which they are presented, and the “sunk cost” effect, the greater tendency to continue an endeavor once an investment in money, effort, or time has been made. The schedule length effect might be a manifestation of these phenomena in monkeys. PMID:18688266

Modeling the violation of reward maximization and invariance in reinforcement schedules.

PubMed

La Camera, Giancarlo; Richmond, Barry J

2008-08-08

It is often assumed that animals and people adjust their behavior to maximize reward acquisition. In visually cued reinforcement schedules, monkeys make errors in trials that are not immediately rewarded, despite having to repeat error trials. Here we show that error rates are typically smaller in trials equally distant from reward but belonging to longer schedules (referred to as "schedule length effect"). This violates the principles of reward maximization and invariance and cannot be predicted by the standard methods of Reinforcement Learning, such as the method of temporal differences. We develop a heuristic model that accounts for all of the properties of the behavior in the reinforcement schedule task but whose predictions are not different from those of the standard temporal difference model in choice tasks. In the modification of temporal difference learning introduced here, the effect of schedule length emerges spontaneously from the sensitivity to the immediately preceding trial. We also introduce a policy for general Markov Decision Processes, where the decision made at each node is conditioned on the motivation to perform an instrumental action, and show that the application of our model to the reinforcement schedule task and the choice task are special cases of this general theoretical framework. Within this framework, Reinforcement Learning can approach contextual learning with the mixture of empirical findings and principled assumptions that seem to coexist in the best descriptions of animal behavior. As examples, we discuss two phenomena observed in humans that often derive from the violation of the principle of invariance: "framing," wherein equivalent options are treated differently depending on the context in which they are presented, and the "sunk cost" effect, the greater tendency to continue an endeavor once an investment in money, effort, or time has been made. The schedule length effect might be a manifestation of these phenomena in monkeys.

DYT1 dystonia increases risk taking in humans

PubMed Central

Arkadir, David; Radulescu, Angela; Raymond, Deborah; Lubarr, Naomi; Bressman, Susan B; Mazzoni, Pietro; Niv, Yael

2016-01-01

It has been difficult to link synaptic modification to overt behavioral changes. Rodent models of DYT1 dystonia, a motor disorder caused by a single gene mutation, demonstrate increased long-term potentiation and decreased long-term depression in corticostriatal synapses. Computationally, such asymmetric learning predicts risk taking in probabilistic tasks. Here we demonstrate abnormal risk taking in DYT1 dystonia patients, which is correlated with disease severity, thereby supporting striatal plasticity in shaping choice behavior in humans. DOI: http://dx.doi.org/10.7554/eLife.14155.001 PMID:27249418

Choosing Actions

PubMed Central

Rosenbaum, David A.; Chapman, Kate M.; Coelho, Chase J.; Gong, Lanyun; Studenka, Breanna E.

2013-01-01

Actions that are chosen have properties that distinguish them from actions that are not. Of the nearly infinite possible actions that can achieve any given task, many of the unchosen actions are irrelevant, incorrect, or inappropriate. Others are relevant, correct, or appropriate but are disfavored for other reasons. Our research focuses on the question of what distinguishes actions that are chosen from actions that are possible but are not. We review studies that use simple preference methods to identify factors that contribute to action choices, especially for object-manipulation tasks. We can determine which factors are especially important through simple behavioral experiments. PMID:23761769

Associability-modulated loss learning is increased in posttraumatic stress disorder

PubMed Central

Brown, Vanessa M; Zhu, Lusha; Wang, John M; Frueh, B Christopher

2018-01-01

Disproportionate reactions to unexpected stimuli in the environment are a cardinal symptom of posttraumatic stress disorder (PTSD). Here, we test whether these heightened responses are associated with disruptions in distinct components of reinforcement learning. Specifically, using functional neuroimaging, a loss-learning task, and a computational model-based approach, we assessed the mechanistic hypothesis that overreactions to stimuli in PTSD arise from anomalous gating of attention during learning (i.e., associability). Behavioral choices of combat-deployed veterans with and without PTSD were fit to a reinforcement learning model, generating trial-by-trial prediction errors (signaling unexpected outcomes) and associability values (signaling attention allocation to the unexpected outcomes). Neural substrates of associability value and behavioral parameter estimates of associability updating, but not prediction error, increased with PTSD during loss learning. Moreover, the interaction of PTSD severity with neural markers of associability value predicted behavioral choices. These results indicate that increased attention-based learning may underlie aspects of PTSD and suggest potential neuromechanistic treatment targets. PMID:29313489

The curse of planning: dissecting multiple reinforcement-learning systems by taxing the central executive.

PubMed

Otto, A Ross; Gershman, Samuel J; Markman, Arthur B; Daw, Nathaniel D

2013-05-01

A number of accounts of human and animal behavior posit the operation of parallel and competing valuation systems in the control of choice behavior. In these accounts, a flexible but computationally expensive model-based reinforcement-learning system has been contrasted with a less flexible but more efficient model-free reinforcement-learning system. The factors governing which system controls behavior-and under what circumstances-are still unclear. Following the hypothesis that model-based reinforcement learning requires cognitive resources, we demonstrated that having human decision makers perform a demanding secondary task engenders increased reliance on a model-free reinforcement-learning strategy. Further, we showed that, across trials, people negotiate the trade-off between the two systems dynamically as a function of concurrent executive-function demands, and people's choice latencies reflect the computational expenses of the strategy they employ. These results demonstrate that competition between multiple learning systems can be controlled on a trial-by-trial basis by modulating the availability of cognitive resources.

Age-Related Impairment on a Forced-Choice Version of the Mnemonic Similarity Task

PubMed Central

Huffman, Derek J.; Stark, Craig E. L.

2018-01-01

Previous studies from our lab have indicated that healthy older adults are impaired in their ability to mnemonically discriminate between previously viewed objects and similar lure objects in the Mnemonic Similarity Task (MST). These studies have used either old/similar/new or old/new test formats. The forced-choice test format (e.g., “Did you see object A or object A’ during the encoding phase?”) relies on different assumptions than the old/new test format (e.g., “Did you see this object during the encoding phase?”); hence, converging evidence from these approaches would bolster the conclusion that healthy aging is accompanied by impaired performance on the MST. Consistent with our hypothesis, healthy older adults exhibited impaired performance on a forced-choice test format that required discriminating between a target and a similar lure. We also tested the hypothesis that age-related impairments on the MST could be modeled within a global matching computational framework. We found that decreasing the probability of successful feature encoding in the models caused changes that were similar to the empirical data in healthy older adults. Collectively, our behavioral results extend to the forced-choice test format the finding that healthy aging is accompanied by an impaired ability to discriminate between targets and similar lures, and our modeling results suggest that a diminished probability of encoding stimulus features is a candidate mechanism for memory changes in healthy aging. We also discuss the ability of global matching models to account for findings in other studies that have used variants on mnemonic similarity tasks. PMID:28004951

Age-related impairment on a forced-choice version of the Mnemonic Similarity Task.

PubMed

Huffman, Derek J; Stark, Craig E L

2017-02-01

Previous studies from our lab have indicated that healthy older adults are impaired in their ability to mnemonically discriminate between previously viewed objects and similar lure objects in the Mnemonic Similarity Task (MST). These studies have used either old/similar/new or old/new test formats. The forced-choice test format (e.g., "Did you see object A or object A' during the encoding phase?") relies on different assumptions than the old/new test format (e.g., "Did you see this object during the encoding phase?"); hence, converging evidence from these approaches would bolster the conclusion that healthy aging is accompanied by impaired performance on the MST. Consistent with our hypothesis, healthy older adults exhibited impaired performance on a forced-choice test format that required discriminating between a target and a similar lure. We also tested the hypothesis that age-related impairments on the MST could be modeled within a global matching computational framework. We found that decreasing the probability of successful feature encoding in the models caused changes that were similar to the empirical data in healthy older adults. Collectively, our behavioral results using the forced-choice format extend the finding that healthy aging is accompanied by an impaired ability to discriminate between targets and similar lures, and our modeling results suggest that a diminished probability of encoding stimulus features is a candidate mechanism for memory changes in healthy aging. We also discuss the ability of global matching models to account for findings in other studies that have used variants on mnemonic similarity tasks. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

The nicotine metabolite, cotinine, attenuates glutamate (NMDA) antagonist-related effects on the performance of the five choice serial reaction time task (5C-SRTT) in rats

PubMed Central

Terry, Alvin V.; Buccafusco, Jerry J.; Schade, R. Foster; Vandenhuerk, Leah; Callahan, Patrick M.; Beck, Wayne D.; Hutchings, Elizabeth J.; Chapman, James M.; Li, Pei; Bartlett, Michael G.

2012-01-01

Cotinine, the most predominant metabolite of nicotine in mammalian species, has a pharmacological half-life that greatly exceeds its precursor. However, until recently, relatively few studies had been conducted to systematically characterize the behavioral pharmacology of cotinine. Our previous work indicated that cotinine improves prepulse inhibition of the auditory startle response in rats in pharmacological impairment models and that it improves working memory in non-human primates. Here we tested the hypothesis that cotinine improves sustained attention in rats and attenuates behavioral alterations induced by the glutamate (NMDA) antagonist MK-801. The effects of acute subcutaneous (dose range 0.03–10.0 mg/kg) and chronic oral administration (2.0 mg/kg/day in drinking water) of cotinine were evaluated in fixed and variable stimulus duration (VSD) as well as variable intertrial interval (VITI) versions of a five choice serial reaction time task (5C-SRTT). The results indicated only subtle effects of acute cotinine (administered alone) on performance of the 5C-SRTT (e.g., decreases in timeout responses). However, depending on dose, acute treatment with cotinine attenuated MK-801-related impairments in accuracy and elevations in timeout responses, and it increased the number of completed trials. Moreover, chronic cotinine attenuated MK-801-related impairments in accuracy and it reduced premature and timeout responses when the demands of the task were increased (i.e., by presenting VSDs or VITIs in addition to administering MK-801). These data suggest that cotinine may represent a prototype for compounds that have therapeutic potential for neuropsychiatric disorders (i.e., by improving sustained attention and decreasing impulsive and compulsive behaviors), especially those characterized by glutamate receptor alterations. PMID:22244928

Cognitive regulation during decision making shifts behavioral control between ventromedial and dorsolateral prefrontal value systems.

PubMed

Hutcherson, Cendri A; Plassmann, Hilke; Gross, James J; Rangel, Antonio

2012-09-26

Cognitive regulation is often used to influence behavioral outcomes. However, the computational and neurobiological mechanisms by which it affects behavior remain unknown. We studied this issue using an fMRI task in which human participants used cognitive regulation to upregulate and downregulate their cravings for foods at the time of choice. We found that activity in both ventromedial prefrontal cortex (vmPFC) and dorsolateral prefrontal cortex (dlPFC) correlated with value. We also found evidence that two distinct regulatory mechanisms were at work: value modulation, which operates by changing the values assigned to foods in vmPFC and dlPFC at the time of choice, and behavioral control modulation, which operates by changing the relative influence of the vmPFC and dlPFC value signals on the action selection process used to make choices. In particular, during downregulation, activation decreased in the value-sensitive region of dlPFC (indicating value modulation) but not in vmPFC, and the relative contribution of the two value signals to behavior shifted toward the dlPFC (indicating behavioral control modulation). The opposite pattern was observed during upregulation: activation increased in vmPFC but not dlPFC, and the relative contribution to behavior shifted toward the vmPFC. Finally, ventrolateral PFC and posterior parietal cortex were more active during both upregulation and downregulation, and were functionally connected with vmPFC and dlPFC during cognitive regulation, which suggests that they help to implement the changes to the decision-making circuitry generated by cognitive regulation.

Cognitive Regulation during Decision Making Shifts Behavioral Control between Ventromedial and Dorsolateral Prefrontal Value Systems

PubMed Central

Plassmann, Hilke; Gross, James J.; Rangel, Antonio

2012-01-01

Cognitive regulation is often used to influence behavioral outcomes. However, the computational and neurobiological mechanisms by which it affects behavior remain unknown. We studied this issue using an fMRI task in which human participants used cognitive regulation to upregulate and downregulate their cravings for foods at the time of choice. We found that activity in both ventromedial prefrontal cortex (vmPFC) and dorsolateral prefrontal cortex (dlPFC) correlated with value. We also found evidence that two distinct regulatory mechanisms were at work: value modulation, which operates by changing the values assigned to foods in vmPFC and dlPFC at the time of choice, and behavioral control modulation, which operates by changing the relative influence of the vmPFC and dlPFC value signals on the action selection process used to make choices. In particular, during downregulation, activation decreased in the value-sensitive region of dlPFC (indicating value modulation) but not in vmPFC, and the relative contribution of the two value signals to behavior shifted toward the dlPFC (indicating behavioral control modulation). The opposite pattern was observed during upregulation: activation increased in vmPFC but not dlPFC, and the relative contribution to behavior shifted toward the vmPFC. Finally, ventrolateral PFC and posterior parietal cortex were more active during both upregulation and downregulation, and were functionally connected with vmPFC and dlPFC during cognitive regulation, which suggests that they help to implement the changes to the decision-making circuitry generated by cognitive regulation. PMID:23015444

Working-memory load and temporal myopia in dynamic decision making.

PubMed

Worthy, Darrell A; Otto, A Ross; Maddox, W Todd

2012-11-01

We examined the role of working memory (WM) in dynamic decision making by having participants perform decision-making tasks under single-task or dual-task conditions. In 2 experiments participants performed dynamic decision-making tasks in which they chose 1 of 2 options on each trial. The decreasing option always gave a larger immediate reward but caused future rewards for both options to decrease. The increasing option always gave a smaller immediate reward but caused future rewards for both options to increase. In each experiment we manipulated the reward structure such that the decreasing option was the optimal choice in 1 condition and the increasing option was the optimal choice in the other condition. Behavioral results indicated that dual-task participants selected the immediately rewarding decreasing option more often, and single-task participants selected the increasing option more often, regardless of which option was optimal. Thus, dual-task participants performed worse on 1 type of task but better on the other type. Modeling results showed that single-task participants' data were most often best fit by a win-stay, lose-shift (WSLS) rule-based model that tracked differences across trials, and dual-task participants' data were most often best fit by a Softmax reinforcement learning model that tracked recency-weighted average rewards for each option. This suggests that manipulating WM load affects the degree to which participants focus on the immediate versus delayed consequences of their actions and whether they employ a rule-based WSLS strategy, but it does not necessarily affect how well people weigh the immediate versus delayed benefits when determining the long-term utility of each option.

Credit Assignment in a Motor Decision Making Task Is Influenced by Agency and Not Sensory Prediction Errors.

PubMed

Parvin, Darius E; McDougle, Samuel D; Taylor, Jordan A; Ivry, Richard B

2018-05-09

Failures to obtain reward can occur from errors in action selection or action execution. Recently, we observed marked differences in choice behavior when the failure to obtain a reward was attributed to errors in action execution compared with errors in action selection (McDougle et al., 2016). Specifically, participants appeared to solve this credit assignment problem by discounting outcomes in which the absence of reward was attributed to errors in action execution. Building on recent evidence indicating relatively direct communication between the cerebellum and basal ganglia, we hypothesized that cerebellar-dependent sensory prediction errors (SPEs), a signal indicating execution failure, could attenuate value updating within a basal ganglia-dependent reinforcement learning system. Here we compared the SPE hypothesis to an alternative, "top-down" hypothesis in which changes in choice behavior reflect participants' sense of agency. In two experiments with male and female human participants, we manipulated the strength of SPEs, along with the participants' sense of agency in the second experiment. The results showed that, whereas the strength of SPE had no effect on choice behavior, participants were much more likely to discount the absence of rewards under conditions in which they believed the reward outcome depended on their ability to produce accurate movements. These results provide strong evidence that SPEs do not directly influence reinforcement learning. Instead, a participant's sense of agency appears to play a significant role in modulating choice behavior when unexpected outcomes can arise from errors in action execution. SIGNIFICANCE STATEMENT When learning from the outcome of actions, the brain faces a credit assignment problem: Failures of reward can be attributed to poor choice selection or poor action execution. Here, we test a specific hypothesis that execution errors are implicitly signaled by cerebellar-based sensory prediction errors. We evaluate this hypothesis and compare it with a more "top-down" hypothesis in which the modulation of choice behavior from execution errors reflects participants' sense of agency. We find that sensory prediction errors have no significant effect on reinforcement learning. Instead, instructions influencing participants' belief of causal outcomes appear to be the main factor influencing their choice behavior. Copyright © 2018 the authors 0270-6474/18/384521-10$15.00/0.

Sex differences in the Kimchi-Palmer task revisited: Global reaction times, but not number of global choices differ between adult men and women.

PubMed

Scheuringer, Andrea; Pletzer, Belinda

2016-10-15

Research, directly assessing sex-dependent differences in global versus local processing is sparse, but predominantly suggesting that men show a stronger global processing bias than women. Utilizing the Kimchi-Palmer task however, sex differences in the number of global choices can only be found in children, but not in adults. In the current study 52 men and 46 women completed a computerized version of the Kimchi Palmer task, in order to investigate whether sex-differences in global-local processing in the Kimchi-Palmer task are reflected in choice reaction times rather than choices per se. While no sex differences were found in the number of global choices, we found that especially women are faster in making local choices than men, while men are faster in making global choices than women. We did not find support for the assumption that this sex difference was modulated by menstrual cycle phase of women, since the difference between reaction times to global and local choices was consistent across the menstrual cycle of women. Accordingly there was no relationship between progesterone and global-local processing in the Kimchi-Palmer task. However, like in studies utilizing the Navon task, testosterone was positively related to the number of global choices in both men and women. To our knowledge, this is the first study including reaction times as outcome measure in a Kimchi Palmer paradigm and also the first study demonstrating sex differences in the Kimchi Palmer task in adults. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

Vacillation, indecision and hesitation in moment-by-moment decoding of monkey motor cortex

PubMed Central

Kaufman, Matthew T; Churchland, Mark M; Ryu, Stephen I; Shenoy, Krishna V

2015-01-01

When choosing actions, we can act decisively, vacillate, or suffer momentary indecision. Studying how individual decisions unfold requires moment-by-moment readouts of brain state. Here we provide such a view from dorsal premotor and primary motor cortex. Two monkeys performed a novel decision task while we recorded from many neurons simultaneously. We found that a decoder trained using ‘forced choices’ (one target viable) was highly reliable when applied to ‘free choices’. However, during free choices internal events formed three categories. Typically, neural activity was consistent with rapid, unwavering choices. Sometimes, though, we observed presumed ‘changes of mind’: the neural state initially reflected one choice before changing to reflect the final choice. Finally, we observed momentary ‘indecision’: delay forming any clear motor plan. Further, moments of neural indecision accompanied moments of behavioral indecision. Together, these results reveal the rich and diverse set of internal events long suspected to occur during free choice. DOI: http://dx.doi.org/10.7554/eLife.04677.001 PMID:25942352

Social signals of safety and risk confer utility and have asymmetric effects on observers’ choices

PubMed Central

Chung, Dongil; Ball, Sheryl B; Chiu, Pearl H

2015-01-01

Individuals’ risk attitudes are known to guide choices about uncertain options. However, in the presence of others’ decisions, these choices can be swayed and manifest as riskier or safer behavior than one would express alone. To test the mechanisms underlying effective social ‘nudges’ in human decision-making, we used functional neuroimaging and a task in which participants made choices about gambles alone and after observing others’ selections. Against three alternative explanations, we found that observing others’ choices of gambles increased the subjective value (utility) of those gambles for the observer. This ‘other-conferred utility’ was encoded in ventromedial prefrontal cortex, and these neural signals predicted conformity. We further identified a parametric interaction with individual risk preferences in anterior cingulate cortex and insula. These data provide a neuromechanistic account of how information from others is integrated with individual preferences that may explain preference-congruent susceptibility to social signals of safety and risk. PMID:25984890

Physiological Evidence for Response Inhibition in Choice Reaction Time Tasks

ERIC Educational Resources Information Center

Burle, Boris; Vidal, Frank; Tandonnet, Christophe; Hasbroucq, Thierry

2004-01-01

Inhibition is a widely used notion proposed to account for data obtained in choice reaction time (RT) tasks. However, this concept is weakly supported by empirical facts. In this paper, we review a series of experiments using Hoffman reflex, transcranial magnetic stimulation and electroencephalography to study inhibition in choice RT tasks. We…

Behavioral responses of trained squirrel and rhesus monkeys during oculomotor tasks

PubMed Central

Heiney, Shane A.; Blazquez, Pablo M.

2018-01-01

The oculomotor system is the motor system of choice for many neuroscientists studying motor control and learning because of its simplicity, easy control of inputs (e.g., visual stimulation), and precise control and measurement of motor outputs (eye position). This is especially true in primates, which are easily trained to perform oculomotor tasks. Here we provide the first detailed characterization of the oculomotor performance of trained squirrel monkeys, primates used extensively in oculomotor physiology, during saccade and smooth pursuit tasks, and compare it to that of the rhesus macaque. We found that both primates have similar oculomotor behavior but the rhesus shows a larger oculomotor range, better performance for horizontal saccades above 10 degrees, and better horizontal smooth pursuit gain to target velocities above 15 deg/s. These results are important for interspecies comparisons and necessary when selecting the best stimuli to study motor control and motor learning in the oculomotor systems of these primates. PMID:21656216

Rule-Selection and Action-Selection have a Shared Neuroanatomical Basis in the Human Prefrontal and Parietal Cortex

PubMed Central

Hughes, L.; Eckstein, D.; Owen, A.M.

2008-01-01

The human capacity for voluntary action is one of the major contributors to our success as a species. In addition to choosing actions themselves, we can also voluntarily choose behavioral codes or sets of rules that can guide future responses to events. Such rules have been proposed to be superordinate to actions in a cognitive hierarchy and mediated by distinct brain regions. We used event-related functional magnetic resonance imaging to study novel tasks of rule-based and voluntary action. We show that the voluntary selection of rules to govern future responses to events is associated with activation of similar regions of prefrontal and parietal cortex as the voluntary selection of an action itself. The results are discussed in terms of hierarchical models and the adaptive coding potential of prefrontal neurons and their contribution to a global workspace for nonautomatic tasks. These tasks include the choices we make about our behavior. PMID:18234684

Development of Using Experimenter-Given Cues in Infant Chimpanzees: Longitudinal Changes in Behavior and Cognitive Development

ERIC Educational Resources Information Center

Okamoto-Barth, Sanae; Tomonaga, Masaki; Tanaka, Masayuki; Matsuzawa, Tetsuro

2008-01-01

The use of gaze shifts as social cues has various evolutionary advantages. To investigate the developmental processes of this ability, we conducted an object-choice task by using longitudinal methods with infant chimpanzees tested from 8 months old until 3 years old. The experimenter used one of six gestures towards a cup concealing food; tapping,…

Covert face recognition in congenital prosopagnosia: a group study.

PubMed

Rivolta, Davide; Palermo, Romina; Schmalzl, Laura; Coltheart, Max

2012-03-01

Even though people with congenital prosopagnosia (CP) never develop a normal ability to "overtly" recognize faces, some individuals show indices of "covert" (or implicit) face recognition. The aim of this study was to demonstrate covert face recognition in CP when participants could not overtly recognize the faces. Eleven people with CP completed three tasks assessing their overt face recognition ability, and three tasks assessing their "covert" face recognition: a Forced choice familiarity task, a Forced choice cued task, and a Priming task. Evidence of covert recognition was observed with the Forced choice familiarity task, but not the Priming task. In addition, we propose that the Forced choice cued task does not measure covert processing as such, but instead "provoked-overt" recognition. Our study clearly shows that people with CP demonstrate covert recognition for faces that they cannot overtly recognize, and that behavioural tasks vary in their sensitivity to detect covert recognition in CP. Copyright © 2011 Elsevier Srl. All rights reserved.

Reversible inactivation of the lateral hypothalamus reversed high reward choices in cost-benefit decision-making in rats.

PubMed

Karimi, Sara; Mesdaghinia, Azam; Farzinpour, Zahra; Hamidi, Gholamali; Haghparast, Abbas

2017-11-01

The Lateral hypothalamus (LH) is an important component of the networks underlying the control of feeding and other motivated behaviors. Cost-benefit decision-making is mediated largely by the prefrontal cortex (PFC) which strongly innervates the LH. Therefore, in the current study, we conducted a series of experiments to elucidate the role of the perifornical area of the lateral hypothalamus (PeF-LH) in effort and/or delay-based decision-making. We trained different groups of rats in a delay-based and/or an effort-based form of cost-benefit T-maze decision- making task in which they could either choose to pay the cost to obtain a high reward in one arm or could obtain a low reward in the other arm with no cost. During test days, the rats received local injections of either vehicle or lidocaine4% (0.5 μl/side), in the PeF-LH. In an effort-based decision task, PeF-LH inactivation led to decrease in high reward choice. Similarly, in a delay-based decision task animals' preference changed to a low but immediately available reward. This was not caused by a spatial memory or motor deficit. PeF-LH inactivation modified decision behavior. The results imply that PeF-LH is important for allowing the animal to pay a cost to acquire greater rewards. Copyright © 2017 Elsevier Inc. All rights reserved.

Choice in experiential learning: True preferences or experimental artifacts?

PubMed

Ashby, Nathaniel J S; Konstantinidis, Emmanouil; Yechiam, Eldad

2017-03-01

The rate of selecting different options in the decisions-from-feedback paradigm is commonly used to measure preferences resulting from experiential learning. While convergence to a single option increases with experience, some variance in choice remains even when options are static and offer fixed rewards. Employing a decisions-from-feedback paradigm followed by a policy-setting task, we examined whether the observed variance in choice is driven by factors related to the paradigm itself: Continued exploration (e.g., believing options are non-stationary) or exploitation of perceived outcome patterns (i.e., a belief that sequential choices are not independent). Across two studies, participants showed variance in their choices, which was related (i.e., proportional) to the policies they set. In addition, in Study 2, participants' reported under-confidence was associated with the amount of choice variance in later choices and policies. These results suggest that variance in choice is better explained by participants lacking confidence in knowing which option is better, rather than methodological artifacts (i.e., exploration or failures to recognize outcome independence). As such, the current studies provide evidence for the decisions-from-feedback paradigm's validity as a behavioral research method for assessing learned preferences. Copyright © 2017 Elsevier B.V. All rights reserved.

Prospective and retrospective timing by pigeons.

PubMed

Fetterman, J Gregor; Killeen, P Richard

2010-05-01

Pigeons discriminated between two pairs of durations: a short set (2.5 and 5 sec) and a long set (5 and 10 sec). The pairs were intermixed within sessions and identified by the colors on the signal and choice keys. Once the task was learned, the pigeons experienced the following three conditions seriatim: (1) The signal key was made ambiguous about the test change, but the choice keys were informative (retrospective); (2) the signal key identified the test range, but the choice keys did not (prospective); (3) probe trials were introduced in which the color of the center key signaled one test range, but the color of the choice keys signaled the other test range (inconsistent). Accuracy of choice decreased in the retrospective condition and, returned to baseline levels, was higher under the prospective condition than under the retrospective condition. In a final condition, referred to as conflict trials, the center-key color signified one test range and the choice-key colors the other range. The results from these conflict-inconsistent tests indicate that choice behavior was largely controlled by the signal-key color and not by the choice-key color. We relate these findings to different approaches to timing in animals.

Measuring pilot workload in a motion base simulator. III - Synchronous secondary task

NASA Technical Reports Server (NTRS)

Kantowitz, Barry H.; Bortolussi, Michael R.; Hart, Sandra G.

1987-01-01

This experiment continues earlier research of Kantowitz et al. (1983) conducted in a GAT-1 motion-base trainer to evaluate choice-reaction secondary tasks as measures of pilot work load. The earlier work used an asynchronous secondary task presented every 22 sec regardless of flying performance. The present experiment uses a synchronous task presented only when a critical event occurred on the flying task. Both two- and four-choice visual secondary tasks were investigated. Analysis of primary flying-task results showed no decrement in error for altitude, indicating that the key assumption necessary for using a choice secondary task was satisfied. Reaction times showed significant differences between 'easy' and 'hard' flight scenarios as well as the ability to discriminate among flight tasks.

Negative mood-induced alcohol-seeking is greater in young adults who report depression symptoms, drinking to cope, and subjective reactivity.

PubMed

Hogarth, Lee; Hardy, Lorna; Mathew, Amanda R; Hitsman, Brian

2018-04-01

Acute negative mood powerfully motivates alcohol-seeking behavior, but it remains unclear whether sensitivity to this effect is greater in drinkers who report depression symptoms, drinking to cope, and subjective reactivity. To examine these questions, 128 young adult alcohol drinkers (ages 18-25) completed questionnaires of alcohol use disorder symptoms, depression symptoms, and drinking to cope with negative affect. Baseline alcohol choice was measured by preference to enlarge alcohol versus food thumbnail images in two-alternative forced-choice trials. Negative mood was then induced by depressive statements and music, before alcohol choice was tested. Subjective reactivity was indexed by increased sadness pre- to post-mood induction. Baseline alcohol choice correlated with alcohol dependence symptoms (p = .001), and drinking coping motives (ps ≤ .01). Mood induction increased alcohol choice and subjective sadness overall (ps < .001). The mood-induced increase in alcohol choice was associated with depression symptoms (p = .007), drinking to cope (ps ≤ .03), and subjective reactivity (p = .007). The relationship between mood-induced alcohol choice and drinking to cope remained significant after covarying for other drinking motives. Furthermore, the three predictors (depression, drinking to cope, and subjective reactivity) accounted for unique variance in mood-induced alcohol choice (ps ≥ .03), and collectively accounted for 18% of the variance (p < .001). These findings validate the pictorial alcohol choice task as sensitive to the relative value of alcohol and acute negative mood. The findings also accord with the core prediction of negative reinforcement theory that sensitivity to the motivational impact of negative mood on alcohol-seeking behavior may be an important mechanism that links depression and alcohol dependence. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Negative Mood-Induced Alcohol-Seeking Is Greater in Young Adults Who Report Depression Symptoms, Drinking to Cope, and Subjective Reactivity

PubMed Central

2018-01-01

Acute negative mood powerfully motivates alcohol-seeking behavior, but it remains unclear whether sensitivity to this effect is greater in drinkers who report depression symptoms, drinking to cope, and subjective reactivity. To examine these questions, 128 young adult alcohol drinkers (ages 18–25) completed questionnaires of alcohol use disorder symptoms, depression symptoms, and drinking to cope with negative affect. Baseline alcohol choice was measured by preference to enlarge alcohol versus food thumbnail images in two-alternative forced-choice trials. Negative mood was then induced by depressive statements and music, before alcohol choice was tested. Subjective reactivity was indexed by increased sadness pre- to post-mood induction. Baseline alcohol choice correlated with alcohol dependence symptoms (p = .001), and drinking coping motives (ps ≤ .01). Mood induction increased alcohol choice and subjective sadness overall (ps < .001). The mood-induced increase in alcohol choice was associated with depression symptoms (p = .007), drinking to cope (ps ≤ .03), and subjective reactivity (p = .007). The relationship between mood-induced alcohol choice and drinking to cope remained significant after covarying for other drinking motives. Furthermore, the three predictors (depression, drinking to cope, and subjective reactivity) accounted for unique variance in mood-induced alcohol choice (ps ≥ .03), and collectively accounted for 18% of the variance (p < .001). These findings validate the pictorial alcohol choice task as sensitive to the relative value of alcohol and acute negative mood. The findings also accord with the core prediction of negative reinforcement theory that sensitivity to the motivational impact of negative mood on alcohol-seeking behavior may be an important mechanism that links depression and alcohol dependence. PMID:29389212

Working-memory capacity protects model-based learning from stress.

PubMed

Otto, A Ross; Raio, Candace M; Chiang, Alice; Phelps, Elizabeth A; Daw, Nathaniel D

2013-12-24

Accounts of decision-making have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental advances suggest that this classic distinction between habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning, called model-free and model-based learning. Popular neurocomputational accounts of reward processing emphasize the involvement of the dopaminergic system in model-free learning and prefrontal, central executive-dependent control systems in model-based choice. Here we hypothesized that the hypothalamic-pituitary-adrenal (HPA) axis stress response--believed to have detrimental effects on prefrontal cortex function--should selectively attenuate model-based contributions to behavior. To test this, we paired an acute stressor with a sequential decision-making task that affords distinguishing the relative contributions of the two learning strategies. We assessed baseline working-memory (WM) capacity and used salivary cortisol levels to measure HPA axis stress response. We found that stress response attenuates the contribution of model-based, but not model-free, contributions to behavior. Moreover, stress-induced behavioral changes were modulated by individual WM capacity, such that low-WM-capacity individuals were more susceptible to detrimental stress effects than high-WM-capacity individuals. These results enrich existing accounts of the interplay between acute stress, working memory, and prefrontal function and suggest that executive function may be protective against the deleterious effects of acute stress.

Working-memory capacity protects model-based learning from stress

PubMed Central

Otto, A. Ross; Raio, Candace M.; Chiang, Alice; Phelps, Elizabeth A.; Daw, Nathaniel D.

2013-01-01

Accounts of decision-making have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental advances suggest that this classic distinction between habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning, called model-free and model-based learning. Popular neurocomputational accounts of reward processing emphasize the involvement of the dopaminergic system in model-free learning and prefrontal, central executive–dependent control systems in model-based choice. Here we hypothesized that the hypothalamic-pituitary-adrenal (HPA) axis stress response—believed to have detrimental effects on prefrontal cortex function—should selectively attenuate model-based contributions to behavior. To test this, we paired an acute stressor with a sequential decision-making task that affords distinguishing the relative contributions of the two learning strategies. We assessed baseline working-memory (WM) capacity and used salivary cortisol levels to measure HPA axis stress response. We found that stress response attenuates the contribution of model-based, but not model-free, contributions to behavior. Moreover, stress-induced behavioral changes were modulated by individual WM capacity, such that low-WM-capacity individuals were more susceptible to detrimental stress effects than high-WM-capacity individuals. These results enrich existing accounts of the interplay between acute stress, working memory, and prefrontal function and suggest that executive function may be protective against the deleterious effects of acute stress. PMID:24324166

Stress enhances model-free reinforcement learning only after negative outcome

PubMed Central

Lee, Daeyeol

2017-01-01

Previous studies found that stress shifts behavioral control by promoting habits while decreasing goal-directed behaviors during reward-based decision-making. It is, however, unclear how stress disrupts the relative contribution of the two systems controlling reward-seeking behavior, i.e. model-free (or habit) and model-based (or goal-directed). Here, we investigated whether stress biases the contribution of model-free and model-based reinforcement learning processes differently depending on the valence of outcome, and whether stress alters the learning rate, i.e., how quickly information from the new environment is incorporated into choices. Participants were randomly assigned to either a stress or a control condition, and performed a two-stage Markov decision-making task in which the reward probabilities underwent periodic reversals without notice. We found that stress increased the contribution of model-free reinforcement learning only after negative outcome. Furthermore, stress decreased the learning rate. The results suggest that stress diminishes one’s ability to make adaptive choices in multiple aspects of reinforcement learning. This finding has implications for understanding how stress facilitates maladaptive habits, such as addictive behavior, and other dysfunctional behaviors associated with stress in clinical and educational contexts. PMID:28723943

Stress enhances model-free reinforcement learning only after negative outcome.

PubMed

Park, Heyeon; Lee, Daeyeol; Chey, Jeanyung

2017-01-01

Previous studies found that stress shifts behavioral control by promoting habits while decreasing goal-directed behaviors during reward-based decision-making. It is, however, unclear how stress disrupts the relative contribution of the two systems controlling reward-seeking behavior, i.e. model-free (or habit) and model-based (or goal-directed). Here, we investigated whether stress biases the contribution of model-free and model-based reinforcement learning processes differently depending on the valence of outcome, and whether stress alters the learning rate, i.e., how quickly information from the new environment is incorporated into choices. Participants were randomly assigned to either a stress or a control condition, and performed a two-stage Markov decision-making task in which the reward probabilities underwent periodic reversals without notice. We found that stress increased the contribution of model-free reinforcement learning only after negative outcome. Furthermore, stress decreased the learning rate. The results suggest that stress diminishes one's ability to make adaptive choices in multiple aspects of reinforcement learning. This finding has implications for understanding how stress facilitates maladaptive habits, such as addictive behavior, and other dysfunctional behaviors associated with stress in clinical and educational contexts.

A Simplified Model of Choice Behavior under Uncertainty

PubMed Central

Lin, Ching-Hung; Lin, Yu-Kai; Song, Tzu-Jiun; Huang, Jong-Tsun; Chiu, Yao-Chu

2016-01-01

The Iowa Gambling Task (IGT) has been standardized as a clinical assessment tool (Bechara, 2007). Nonetheless, numerous research groups have attempted to modify IGT models to optimize parameters for predicting the choice behavior of normal controls and patients. A decade ago, most researchers considered the expected utility (EU) model (Busemeyer and Stout, 2002) to be the optimal model for predicting choice behavior under uncertainty. However, in recent years, studies have demonstrated that models with the prospect utility (PU) function are more effective than the EU models in the IGT (Ahn et al., 2008). Nevertheless, after some preliminary tests based on our behavioral dataset and modeling, it was determined that the Ahn et al. (2008) PU model is not optimal due to some incompatible results. This study aims to modify the Ahn et al. (2008) PU model to a simplified model and used the IGT performance of 145 subjects as the benchmark data for comparison. In our simplified PU model, the best goodness-of-fit was found mostly as the value of α approached zero. More specifically, we retested the key parameters α, λ, and A in the PU model. Notably, the influence of the parameters α, λ, and A has a hierarchical power structure in terms of manipulating the goodness-of-fit in the PU model. Additionally, we found that the parameters λ and A may be ineffective when the parameter α is close to zero in the PU model. The present simplified model demonstrated that decision makers mostly adopted the strategy of gain-stay loss-shift rather than foreseeing the long-term outcome. However, there are other behavioral variables that are not well revealed under these dynamic-uncertainty situations. Therefore, the optimal behavioral models may not have been found yet. In short, the best model for predicting choice behavior under dynamic-uncertainty situations should be further evaluated. PMID:27582715

Aberrant Food Choices after Satiation in Human Orexin-Deficient Narcolepsy Type 1.

PubMed

van Holst, Ruth Janke; van der Cruijsen, Lisa; van Mierlo, Petra; Lammers, Gert Jan; Cools, Roshan; Overeem, Sebastiaan; Aarts, Esther

2016-11-01

Besides influencing vigilance, orexin neurotransmission serves a variety of functions, including reward, motivation, and appetite regulation. As obesity is an important symptom in orexin-deficient narcolepsy, we explored the effects of satiety on food-related choices and spontaneous snack intake in patients with narcolepsy type 1 (n = 24) compared with healthy matched controls (n = 19). In additional analyses, we also included patients with idiopathic hypersomnia (n = 14) to assess sleepiness-related influences. Participants were first trained on a choice task to earn salty and sweet snacks. Next, one of the snack outcomes was devalued by having participants consume it until satiation (i.e., sensory-specific satiety). We then measured the selective reduction in choices for the devalued snack outcome. Finally, we assessed the number of calories that participants consumed spontaneously from ad libitum available snacks afterwards. After satiety, all participants reported reduced hunger and less wanting for the devalued snack. However, while controls and idiopathic hypersomnia patients chose the devalued snack less often in the choice task, patients with narcolepsy still chose the devalued snack as often as before satiety. Subsequently, narcolepsy patients spontaneously consumed almost 4 times more calories during ad libitum snack intake. We show that the manipulation of food-specific satiety has reduced effects on food choices and caloric intake in narcolepsy type 1 patients. These mechanisms may contribute to their obesity, and suggest an important functional role for orexin in human eating behavior. Study registered at Netherlands Trial Register. URL: www.trialregister.nl. Trial ID: NTR4508. © 2016 Associated Professional Sleep Societies, LLC.

From Creatures of Habit to Goal-Directed Learners: Tracking the Developmental Emergence of Model-Based Reinforcement Learning.

PubMed

Decker, Johannes H; Otto, A Ross; Daw, Nathaniel D; Hartley, Catherine A

2016-06-01

Theoretical models distinguish two decision-making strategies that have been formalized in reinforcement-learning theory. A model-based strategy leverages a cognitive model of potential actions and their consequences to make goal-directed choices, whereas a model-free strategy evaluates actions based solely on their reward history. Research in adults has begun to elucidate the psychological mechanisms and neural substrates underlying these learning processes and factors that influence their relative recruitment. However, the developmental trajectory of these evaluative strategies has not been well characterized. In this study, children, adolescents, and adults performed a sequential reinforcement-learning task that enabled estimation of model-based and model-free contributions to choice. Whereas a model-free strategy was apparent in choice behavior across all age groups, a model-based strategy was absent in children, became evident in adolescents, and strengthened in adults. These results suggest that recruitment of model-based valuation systems represents a critical cognitive component underlying the gradual maturation of goal-directed behavior. © The Author(s) 2016.

Intelligence moderates neural responses to monetary reward and punishment.

PubMed

Hawes, Daniel R; DeYoung, Colin G; Gray, Jeremy R; Rustichini, Aldo

2014-05-01

The relations between intelligence (IQ) and neural responses to monetary gains and losses were investigated in a simple decision task. In 94 healthy adults, typical responses of striatal blood oxygen level-dependent (BOLD) signal after monetary reward and punishment were weaker for subjects with higher IQ. IQ-moderated differential responses to gains and losses were also found for regions in the medial prefrontal cortex, posterior cingulate cortex, and left inferior frontal cortex. These regions have previously been identified with the subjective utility of monetary outcomes. Analysis of subjects' behavior revealed a correlation between IQ and the extent to which choices were related to experienced decision outcomes in preceding trials. Specifically, higher IQ predicted behavior to be more strongly correlated with an extended period of previously experienced decision outcomes, whereas lower IQ predicted behavior to be correlated exclusively to the most recent decision outcomes. We link these behavioral and imaging findings to a theoretical model capable of describing a role for intelligence during the evaluation of rewards generated by unknown probabilistic processes. Our results demonstrate neural differences in how people of different intelligence respond to experienced monetary rewards and punishments. Our theoretical discussion offers a functional description for how these individual differences may be linked to choice behavior. Together, our results and model support the hypothesis that observed correlations between intelligence and preferences may be rooted in the way decision outcomes are experienced ex post, rather than deriving exclusively from how choices are evaluated ex ante.

The role of first impression in operant learning.

PubMed

Shteingart, Hanan; Neiman, Tal; Loewenstein, Yonatan

2013-05-01

We quantified the effect of first experience on behavior in operant learning and studied its underlying computational principles. To that goal, we analyzed more than 200,000 choices in a repeated-choice experiment. We found that the outcome of the first experience has a substantial and lasting effect on participants' subsequent behavior, which we term outcome primacy. We found that this outcome primacy can account for much of the underweighting of rare events, where participants apparently underestimate small probabilities. We modeled behavior in this task using a standard, model-free reinforcement learning algorithm. In this model, the values of the different actions are learned over time and are used to determine the next action according to a predefined action-selection rule. We used a novel nonparametric method to characterize this action-selection rule and showed that the substantial effect of first experience on behavior is consistent with the reinforcement learning model if we assume that the outcome of first experience resets the values of the experienced actions, but not if we assume arbitrary initial conditions. Moreover, the predictive power of our resetting model outperforms previously published models regarding the aggregate choice behavior. These findings suggest that first experience has a disproportionately large effect on subsequent actions, similar to primacy effects in other fields of cognitive psychology. The mechanism of resetting of the initial conditions that underlies outcome primacy may thus also account for other forms of primacy. PsycINFO Database Record (c) 2013 APA, all rights reserved.

From cookies to carrots; the effect of inhibitory control training on children's snack selections.

PubMed

Porter, L; Bailey-Jones, C; Priudokaite, G; Allen, S; Wood, K; Stiles, K; Parvin, O; Javaid, M; Verbruggen, F; Lawrence, N S

2018-05-01

Children consume too much sugar and not enough fruit and vegetables, increasing their risk of adverse health outcomes. Inhibitory control training (ICT) reduces children's and adults' intake of energy-dense foods in both laboratory and real-life settings. However, no studies have yet examined whether ICT can increase healthy food choice when energy-dense options are also available. We investigated whether a food-specific Go/No-Go task could influence the food choices of children aged 4-11, as measured by a hypothetical food choice task using healthy and unhealthy food images printed on cards. Participants played either an active game (healthy foods = 100% go, unhealthy foods = 100% no-go; Studies 1 & 2), a food control game (both healthy and unhealthy foods = 50% go, 50% no-go; Studies 1 & 2) or a non-food control game (sports equipment = 100% go, technology = 100% no-go; Study 2 only) followed by the choice task. In Study 2, food card choices were also measured before training to examine change in choices. A post-training real food choice task was added to check that choices made in the card-based task were representative of choices made when faced with real healthy and unhealthy foods. Overall, the active group chose the greatest number of healthy food cards. Study 2 confirmed that this was due to increases in healthy food card choice in this group only. Active group participants chose a greater number of healthy foods in the real food choice task compared to children in the non-food control group only. The results are discussed with reference to methodological issues and the development of future healthy eating interventions. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Aberrant Food Choices after Satiation in Human Orexin-Deficient Narcolepsy Type 1

PubMed Central

van Holst, Ruth Janke; van der Cruijsen, Lisa; van Mierlo, Petra; Lammers, Gert Jan; Cools, Roshan; Overeem, Sebastiaan; Aarts, Esther

2016-01-01

Study Objectives: Besides influencing vigilance, orexin neurotransmission serves a variety of functions, including reward, motivation, and appetite regulation. As obesity is an important symptom in orexin-deficient narcolepsy, we explored the effects of satiety on food-related choices and spontaneous snack intake in patients with narcolepsy type 1 (n = 24) compared with healthy matched controls (n = 19). In additional analyses, we also included patients with idiopathic hypersomnia (n = 14) to assess sleepiness-related influences. Methods: Participants were first trained on a choice task to earn salty and sweet snacks. Next, one of the snack outcomes was devalued by having participants consume it until satiation (i.e., sensory-specific satiety). We then measured the selective reduction in choices for the devalued snack outcome. Finally, we assessed the number of calories that participants consumed spontaneously from ad libitum available snacks afterwards. Results: After satiety, all participants reported reduced hunger and less wanting for the devalued snack. However, while controls and idiopathic hypersomnia patients chose the devalued snack less often in the choice task, patients with narcolepsy still chose the devalued snack as often as before satiety. Subsequently, narcolepsy patients spontaneously consumed almost 4 times more calories during ad libitum snack intake. Conclusions: We show that the manipulation of food-specific satiety has reduced effects on food choices and caloric intake in narcolepsy type 1 patients. These mechanisms may contribute to their obesity, and suggest an important functional role for orexin in human eating behavior. Clinical Trials Registration: Study registered at Netherlands Trial Register. URL: www.trialregister.nl. Trial ID: NTR4508. Citation: van Holst RJ, van der Cruijsen L, van Mierlo P, Lammers GJ, Cools R, Overeem S, Aarts E. Aberrant food choices after satiation in human orexindeficient narcolepsy type 1. SLEEP 2016;39(11):1951–1959. PMID:27568806

Effects of High-Definition and Conventional tDCS on Response Inhibition.

PubMed

Hogeveen, J; Grafman, J; Aboseria, M; David, A; Bikson, M; Hauner, K K

2016-01-01

Response inhibition is a critical executive function, enabling the adaptive control of behavior in a changing environment. The inferior frontal cortex (IFC) is considered to be critical for response inhibition, leading researchers to develop transcranial direct current stimulation (tDCS) montages attempting to target the IFC and improve inhibitory performance. However, conventional tDCS montages produce diffuse current through the brain, making it difficult to establish causality between stimulation of any one given brain region and resulting behavioral changes. Recently, high-definition tDCS (HD-tDCS) methods have been developed to target brain regions with increased focality relative to conventional tDCS. Remarkably few studies have utilized HD-tDCS to improve cognitive task performance, however, and no study has directly compared the behavioral effects of HD-tDCS to conventional tDCS. In the present study, participants received either HD-tDCS or conventional tDCS to the IFC during performance of a response inhibition task (stop-signal task, SST) or a control task (choice reaction time task, CRT). A third group of participants completed the same behavioral protocols, but received tDCS to a control site (mid-occipital cortex). Post-stimulation improvement in SST performance was analyzed as a function of tDCS group and the task performed during stimulation using both conventional and Bayesian parameter estimation analyses. Bayesian estimation of the effects of HD- and conventional tDCS to IFC relative to control site stimulation demonstrated enhanced response inhibition for both conditions. No improvements were found after control task (CRT) training in any tDCS condition. Results support the use of both HD- and conventional tDCS to the IFC for improving response inhibition, providing empirical evidence that HD-tDCS can be used to facilitate performance on an executive function task. Copyright © 2016 Elsevier Inc. All rights reserved.

Automating CPM-GOMS

NASA Technical Reports Server (NTRS)

John, Bonnie; Vera, Alonso; Matessa, Michael; Freed, Michael; Remington, Roger

2002-01-01

CPM-GOMS is a modeling method that combines the task decomposition of a GOMS analysis with a model of human resource usage at the level of cognitive, perceptual, and motor operations. CPM-GOMS models have made accurate predictions about skilled user behavior in routine tasks, but developing such models is tedious and error-prone. We describe a process for automatically generating CPM-GOMS models from a hierarchical task decomposition expressed in a cognitive modeling tool called Apex. Resource scheduling in Apex automates the difficult task of interleaving the cognitive, perceptual, and motor resources underlying common task operators (e.g. mouse move-and-click). Apex's UI automatically generates PERT charts, which allow modelers to visualize a model's complex parallel behavior. Because interleaving and visualization is now automated, it is feasible to construct arbitrarily long sequences of behavior. To demonstrate the process, we present a model of automated teller interactions in Apex and discuss implications for user modeling. available to model human users, the Goals, Operators, Methods, and Selection (GOMS) method [6, 21] has been the most widely used, providing accurate, often zero-parameter, predictions of the routine performance of skilled users in a wide range of procedural tasks [6, 13, 15, 27, 28]. GOMS is meant to model routine behavior. The user is assumed to have methods that apply sequences of operators and to achieve a goal. Selection rules are applied when there is more than one method to achieve a goal. Many routine tasks lend themselves well to such decomposition. Decomposition produces a representation of the task as a set of nested goal states that include an initial state and a final state. The iterative decomposition into goals and nested subgoals can terminate in primitives of any desired granularity, the choice of level of detail dependent on the predictions required. Although GOMS has proven useful in HCI, tools to support the construction of GOMS models have not yet come into general use.

Bayesian-based integration of multisensory naturalistic perithreshold stimuli.

PubMed

Regenbogen, Christina; Johansson, Emilia; Andersson, Patrik; Olsson, Mats J; Lundström, Johan N

2016-07-29

Most studies exploring multisensory integration have used clearly perceivable stimuli. According to the principle of inverse effectiveness, the added neural and behavioral benefit of integrating clear stimuli is reduced in comparison to stimuli with degraded and less salient unisensory information. Traditionally, speed and accuracy measures have been analyzed separately with few studies merging these to gain an understanding of speed-accuracy trade-offs in multisensory integration. In two separate experiments, we assessed multisensory integration of naturalistic audio-visual objects consisting of individually-tailored perithreshold dynamic visual and auditory stimuli, presented within a multiple-choice task, using a Bayesian Hierarchical Drift Diffusion Model that combines response time and accuracy. For both experiments, unisensory stimuli were degraded to reach a 75% identification accuracy level for all individuals and stimuli to promote multisensory binding. In Experiment 1, we subsequently presented uni- and their respective bimodal stimuli followed by a 5-alternative-forced-choice task. In Experiment 2, we controlled for low-level integration and attentional differences. Both experiments demonstrated significant superadditive multisensory integration of bimodal perithreshold dynamic information. We present evidence that the use of degraded sensory stimuli may provide a link between previous findings of inverse effectiveness on a single neuron level and overt behavior. We further suggest that a combined measure of accuracy and reaction time may be a more valid and holistic approach of studying multisensory integration and propose the application of drift diffusion models for studying behavioral correlates as well as brain-behavior relationships of multisensory integration. Copyright © 2015 Elsevier Ltd. All rights reserved.

Prefrontal Contribution to Decision-Making under Free-Choice Conditions

PubMed Central

Funahashi, Shintaro

2017-01-01

Executive function is thought to be the coordinated operation of multiple neural processes and allows to accomplish a current goal flexibly. The most important function of the prefrontal cortex is the executive function. Among a variety of executive functions in which the prefrontal cortex participates, decision-making is one of the most important. Although the prefrontal contribution to decision-making has been examined using a variety of behavioral tasks, recent studies using fMRI have shown that the prefrontal cortex participates in decision-making under free-choice conditions. Since decision-making under free-choice conditions represents the very first stage for any kind of decision-making process, it is important that we understand its neural mechanism. Although few studies have examined this issue while a monkey performed a free-choice task, those studies showed that, when the monkey made a decision to subsequently choose one particular option, prefrontal neurons showing selectivity to that option exhibited transient activation just before presentation of the imperative cue. Further studies have suggested that this transient increase is caused by the irregular fluctuation of spontaneous firing just before cue presentation, which enhances the response to the cue and biases the strength of the neuron's selectivity to the option. In addition, this biasing effect was observed only in neurons that exhibited sustained delay-period activity, indicating that this biasing effect not only influences the animal's decision for an upcoming choice, but also is linked to working memory mechanisms in the prefrontal cortex. PMID:28798662

Dissociable brain signatures of choice conflict and immediate reward preferences in alcohol use disorders.

PubMed

Amlung, Michael; Sweet, Lawrence H; Acker, John; Brown, Courtney L; MacKillop, James

2014-07-01

Impulsive delayed reward discounting (DRD) is an important behavioral process in alcohol use disorders (AUDs), reflecting incapacity to delay gratification. Recent work in neuroeconomics has begun to unravel the neural mechanisms supporting DRD, but applications of neuroeconomics in relation to AUDs have been limited. This study examined the neural mechanisms of DRD preferences in AUDs, with emphasis on dissociating activation patterns based on DRD choice type and level of cognitive conflict. Heavy drinking adult men with (n = 13) and without (n = 12) a diagnosis of an AUD completed a monetary DRD task during a functional magnetic resonance imaging scan. Participant responses were coded based on choice type (impulsive versus restrained) and level of cognitive conflict (easy versus hard). AUD+ participants exhibited significantly more impulsive DRD decision-making. Significant activation during DRD was found in several decision-making regions, including dorsolateral prefrontal cortex (DLPFC), insula, posterior parietal cortex (PPC), and posterior cingulate. An axis of cognitive conflict was also observed, with hard choices associated with anterior cingulate cortex and easy choices associated with activation in supplementary motor area. AUD+ individuals exhibited significant hyperactivity in regions associated with cognitive control (DLPFC) and prospective thought (PPC) and exhibited less task-related deactivation of areas associated with the brain's default network during DRD decisions. This study provides further clarification of the brain systems supporting DRD in general and in relation to AUDs. © 2012 The Authors, Addiction Biology © 2012 Society for the Study of Addiction.

Economic games quantify diminished sense of guilt in patients with damage to the prefrontal cortex

PubMed Central

Krajbich, Ian; Adolphs, Ralph; Tranel, Daniel; Denburg, Natalie L.; Camerer, Colin F.

2009-01-01

Damage to the ventromedial prefrontal cortex (VMPFC) impairs concern for other people, as reflected in the dysfunctional real-life social behavior of patients with such damage, as well as their abnormal performances on tasks ranging from moral judgment to economic games. Despite these convergent data, we lack a formal model of how, and to what degree, VMPFC lesions affect an individual’s social decision-making. Here we provide a quantification of these effects using a formal economic model of choice that incorporates terms for the disutility of unequal payoffs, with parameters that index behaviors normally evoked by guilt and envy. Six patients with focal VMPFC lesions participated in a battery of economic games that measured concern about payoffs to themselves and to others: dictator, ultimatum, and trust games. We analyzed each task individually, but also derived estimates of the guilt and envy parameters from aggregate behavior across all of the tasks. Compared to control subjects, the patients donated significantly less and were less trustworthy, and overall our model found a significant insensitivity to guilt. Despite these abnormalities, the patients had normal expectations about what other people would do, and they also did not simply generate behavior that was more noisy. Instead, the findings argue for a specific insensitivity to guilt, an abnormality that we suggest characterizes a key contribution made by the VMPFC to social behavior. PMID:19228971

Economic games quantify diminished sense of guilt in patients with damage to the prefrontal cortex.

PubMed

Krajbich, Ian; Adolphs, Ralph; Tranel, Daniel; Denburg, Natalie L; Camerer, Colin F

2009-02-18

Damage to the ventromedial prefrontal cortex (VMPFC) impairs concern for other people, as reflected in the dysfunctional real-life social behavior of patients with such damage, as well as their abnormal performances on tasks ranging from moral judgment to economic games. Despite these convergent data, we lack a formal model of how, and to what degree, VMPFC lesions affect an individual's social decision-making. Here we provide a quantification of these effects using a formal economic model of choice that incorporates terms for the disutility of unequal payoffs, with parameters that index behaviors normally evoked by guilt and envy. Six patients with focal VMPFC lesions participated in a battery of economic games that measured concern about payoffs to themselves and to others: dictator, ultimatum, and trust games. We analyzed each task individually, but also derived estimates of the guilt and envy parameters from aggregate behavior across all of the tasks. Compared with control subjects, the patients donated significantly less and were less trustworthy, and overall our model found a significant insensitivity to guilt. Despite these abnormalities, the patients had normal expectations about what other people would do, and they also did not simply generate behavior that was more noisy. Instead, the findings argue for a specific insensitivity to guilt, an abnormality that we suggest characterizes a key contribution made by the VMPFC to social behavior.

Guessing versus Choosing an Upcoming Task

PubMed Central

Kleinsorge, Thomas; Scheil, Juliane

2016-01-01

We compared the effects of guessing vs. choosing an upcoming task. In a task-switching paradigm with four tasks, two groups of participants were asked to either guess or choose which task will be presented next under otherwise identical conditions. The upcoming task corresponded to participants’ guesses or choices in 75 % of the trials. However, only participants in the Choosing condition were correctly informed about this, whereas participants in the Guessing condition were told that tasks were determined at random. In the Guessing condition, we replicated previous findings of a pronounced reduction of switch costs in case of incorrect guesses. This switch cost reduction was considerably less pronounced with denied choices in the Choosing condition. We suggest that in the Choosing condition, the signaling of prediction errors associated with denied choices is attenuated because a certain proportion of denied choices is consistent with the overall representation of the situation as conveyed by task instructions. In the Guessing condition, in contrast, the mismatch of guessed and actual task is resolved solely on the level of individual trials by strengthening the representation of the actual task. PMID:27047423

Motivational Differences in Seeking Out Evaluative Categorization Information.

PubMed

Smallman, Rachel; Becker, Brittney

2017-07-01

Previous research shows that people draw finer evaluative distinctions when rating liked versus disliked objects (e.g., wanting a 5-point scale to evaluate liked cuisines and a 3-point scale to rate disliked cuisines). Known as the preference-categorization effect, this pattern may exist not only in how individuals form evaluative distinctions but also in how individuals seek out evaluative information. The current research presents three experiments that examine motivational differences in evaluative information seeking (rating scales and attributes). Experiment 1 found that freedom of choice (the ability to avoid undesirable stimuli) and sensitivity to punishment (as measured by the Behavior Inhibition System/Behavioral Approach System [BIS/BAS] scale) influenced preferences for desirable and undesirable evaluative information in a health-related decision. Experiment 2 examined choice optimization, finding that maximizers prefer finer evaluative information for both liked and disliked options in a consumer task. Experiment 3 found that this pattern generalizes to another type of evaluative categorization, attributes.

A Neural Mechanism of Preference Shifting Under Zero Price Condition

PubMed Central

Votinov, Mikhail; Aso, Toshihiko; Fukuyama, Hidenao; Mima, Tatsuya

2016-01-01

In everyday life, free products have a strong appeal to us, even if we do not need them. Behavioral studies demonstrated that people have a tendency to switch their preference from preferred more expensive products to less preferable, cheaper alternatives, when the cheaper option becomes free. However, the neural representation of this behavioral anomaly called “Zero price” is still unclear. Using fMRI, we studied subjects while they performed binary preference choice task for items with different prices. We found that zero-related change of preference was associated with activation of the choice network, which includes inferior parietal lobule (IPL), posterior cingulate cortex and medial prefrontal cortex. Moreover, the amount of activation in medial prefrontal cortex was positively correlated with the subjective happiness score of getting free products. Our findings suggest that the Zero-price effect is driven by affective evaluations during decision-making. PMID:27148024

Time discounting and time preference in animals: A critical review.

PubMed

Hayden, Benjamin Y

2016-02-01

Animals are an important model for studies of impulsivity and self-control. Many studies have made use of the intertemporal choice task, which pits small rewards available sooner against larger rewards available later (typically several seconds), repeated over many trials. Preference for the sooner reward is often taken to indicate impulsivity and/or a failure of self-control. This review shows that very little evidence supports this assumption; on the contrary, ostensible discounting behavior may reflect a boundedly rational but not necessarily impulsive reward-maximizing strategy. Specifically, animals may discount weakly, or even adopt a long-term rate-maximizing strategy, but fail to fully incorporate postreward delays into their choices. This failure may reflect learning biases. Consequently, tasks that measure animal discounting may greatly overestimate the true discounting and may be confounded by processes unrelated to time preferences. If so, animals may be much more patient than is widely believed; human and animal intertemporal choices may reflect unrelated mental operations; and the shared hyperbolic shape of the human and animal discount curves, which is used to justify cross-species comparisons, may be coincidental. The discussion concludes with a consideration of alternative ways to measure self-control in animals.

Role of accentuation in the selection/rejection task framing effect.

PubMed

Chen, Jing; Proctor, Robert W

2017-04-01

Procedure invariance is a basic assumption of rational theories of choice, however, it has been shown to be violated: Different response modes, or task frames, sometimes reveal opposite preferences. The current study focused on selection and rejection task frames, involving a unique type of problem with enriched and impoverished options, which has previously led to conflicting findings and theoretical explanations: the compatibility hypothesis (Shafir, 1993) and the accentuation hypothesis (Wedell, 1997). We examined the role of task frame by distinguishing these 2 hypotheses and evaluating the information-processing basis of the choices. Experiments conducted online (Experiments 1 and 3) and in-lab (Experiment 4 with eye-tracking technique) revealed a difference between the 2 task frames in the choice data (i.e., the task-framing effect) as a function of the relative attractiveness of the options. Also, this task-framing effect was not influenced by imposed time constraints (Experiments 5 and 6) and was similarly evident with a more direct measure for the option attractiveness (obtained in Experiment 7). Experiment 2, conducted in a lab setting with verbal-protocol requirements, yielded no task-framing effect, suggesting that a requirement to verbalize reasons for choice minimizes accentuation. With this exception, the choice data are in agreement with the accentuation hypothesis, and the combined findings in choice, decision time, task confusion, and eye-tracking data provide evidence of a basis in cognitive effort rather than motivation, as Wedell proposed. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Discounting the value of safety: effects of perceived risk and effort.

PubMed

Sigurdsson, Sigurdur O; Taylor, Matthew A; Wirth, Oliver

2013-09-01

Although falls from heights remain the most prevalent cause of fatalities in the construction industry, factors impacting safety-related choices associated with work at heights are not completely understood. Better tools are needed to identify and study the factors influencing safety-related choices and decision making. Using a computer-based task within a behavioral economics paradigm, college students were presented a choice between two hypothetical scenarios that differed in working height and effort associated with retrieving and donning a safety harness. Participants were instructed to choose the scenario in which they were more likely to wear the safety harness. Based on choice patterns, switch points were identified, indicating when the perceived risk in both scenarios was equivalent. Switch points were a systematic function of working height and effort, and the quantified relation between perceived risk and effort was described well by a hyperbolic equation. Choice patterns revealed that the perceived risk of working at heights decreased as the effort to retrieve and don a safety harness increased. Results contribute to the development of computer-based procedure for assessing risk discounting within a behavioral economics framework. Such a procedure can be used as a research tool to study factors that influence safety-related decision making with a goal of informing more effective prevention and intervention strategies. Copyright © 2013 National Safety Council and Elsevier Ltd. All rights reserved.

Mirtazapine and ketanserin alter preference for gambling-like schedules of reinforcement in rats.

PubMed

Persons, Amanda L; Tedford, Stephanie E; Celeste Napier, T

2017-07-03

Drug and behavioral addictions have overlapping features, e.g., both manifest preference for larger, albeit costlier, reinforcement options in cost/benefit decision-making tasks. Our prior work revealed that the mixed-function serotonergic compound, mirtazapine, attenuates behaviors by rats motivated by abused drugs. To extend this work to behavioral addictions, here we determined if mirtazapine and/or ketanserin, another mixed-function serotonin-acting compound, can alter decision-making in rats that is independent of drug (or food)-motivated reward. Accordingly, we developed a novel variable-ratio task in rats wherein intracranial self-stimulation was used as the positive reinforcer. Using lever pressing for various levels of brain stimulation, the operant task provided choices between a small brain stimulation current delivered on a fixed-ratio schedule (i.e., a predictable reward) and a large brain stimulation delivered following an unpredictable number of responses (i.e., a variable-ratio schedule). This task allowed for demonstration of individualized preference and detection of shifts in motivational influences during a pharmacological treatment. Once baseline preference was established, we determined that pretreatment with mirtazapine or ketanserin significantly decreased preference for the large reinforcer presented after gambling-like schedules of reinforcement. When the rats were tested the next day without drug, preference for the unpredictable large reinforcer option was restored. These data demonstrate that mirtazapine and ketanserin can reduce preference for larger, costlier reinforcement options, and illustrate the potential for these drugs to alter behavior. Copyright © 2017 Elsevier Inc. All rights reserved.

Brain mechanisms controlling decision making and motor planning.

PubMed

Ramakrishnan, Arjun; Murthy, Aditya

2013-01-01

Accumulator models of decision making provide a unified framework to understand decision making and motor planning. In these models, the evolution of a decision is reflected in the accumulation of sensory information into a motor plan that reaches a threshold, leading to choice behavior. While these models provide an elegant framework to understand performance and reaction times, their ability to explain complex behaviors such as decision making and motor control of sequential movements in dynamic environments is unclear. To examine and probe the limits of online modification of decision making and motor planning, an oculomotor "redirect" task was used. Here, subjects were expected to change their eye movement plan when a new saccade target appeared. Based on task performance, saccade reaction time distributions, computational models of behavior, and intracortical microstimulation of monkey frontal eye fields, we show how accumulator models can be tested and extended to study dynamic aspects of decision making and motor control. Copyright © 2013 Elsevier B.V. All rights reserved.

Chimpanzees can point to smaller amounts of food to accumulate larger amounts but they still fail the reverse-reward contingency task.

PubMed

Beran, Michael J; James, Brielle T; Whitham, Will; Parrish, Audrey E

2016-10-01

The reverse-reward contingency task presents 2 food sets to an animal, and they are required to choose the smaller of the 2 sets in order to receive the larger food set. Intriguingly, the majority of species tested on the reverse-reward task fail to learn this contingency in the absence of large trial counts, correction trials, and punishment techniques. The unique difficulty of this seemingly simple task likely reflects a failure of inhibitory control which is required to point toward a smaller and less desirable reward rather than a larger and more desirable reward. This failure by chimpanzees and other primates to pass the reverse-reward task is striking given the self-control they exhibit in a variety of other paradigms. For example, chimpanzees have consistently demonstrated a high capacity for delay of gratification in order to maximize accumulating food rewards in which foods are added item-by-item to a growing set until the subject consumes the rewards. To study the mechanisms underlying success in the accumulation task and failure in the reverse-reward task, we presented chimpanzees with several combinations of these 2 tasks to determine when chimpanzees might succeed in pointing to smaller food sets over larger food sets and how the nature of the task might determine the animals' success or failure. Across experiments, 3 chimpanzees repeatedly failed to solve the reverse-reward task, whereas they accumulated nearly all food items across all instances of the accumulation self-control task, even when they had to point to small amounts of food to accumulate larger amounts. These data indicate that constraints of these 2 related but still different tasks of behavioral inhibition are dependent upon the animals' perceptions of the choice set, their sense of control over the contents of choice sets, and the nature of the task constraints. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Social contagion of ethnic hostility.

PubMed

Bauer, Michal; Cahlíková, Jana; Chytilová, Julie; Želinský, Tomáš

2018-05-08

Interethnic conflicts often escalate rapidly. Why does the behavior of masses easily change from cooperation to aggression? This paper provides an experimental test of whether ethnic hostility is contagious. Using incentivized tasks, we measured willingness to sacrifice one's own resources to harm others among adolescents from a region with a history of animosities toward the Roma people, the largest ethnic minority in Europe. To identify the influence of peers, subjects made choices after observing either destructive or peaceful behavior of peers in the same task. We found that susceptibility to follow destructive behavior more than doubled when harm was targeted against Roma rather than against coethnics. When peers were peaceful, subjects did not discriminate. We observed very similar patterns in a norms-elicitation experiment: destructive behavior toward Roma was not generally rated as more socially appropriate than when directed at coethnics, but the ratings were more sensitive to social contexts. The findings may illuminate why ethnic hostilities can spread quickly, even in societies with few visible signs of interethnic hatred. Copyright © 2018 the Author(s). Published by PNAS.

Enhanced attention and impulsive action following NMDA receptor GluN2B-selective antagonist pretreatment.

PubMed

Higgins, Guy A; Silenieks, Leo B; MacMillan, Cam; Sevo, Julia; Zeeb, Fiona D; Thevarkunnel, Sandy

2016-09-15

NMDA GluN2B (NR2B) subtype selective antagonists are currently in clinical development for a variety of indications, including major depression. We previously reported the selective NMDA GluN2B antagonists Ro 63-1908 and traxoprodil, increase premature responding in a 5-choice serial reaction time task (5-CSRTT) suggesting an effect on impulsive action. The present studies extend these investigations to a Go-NoGo and delay discounting task, and the 5-CSRTT under test conditions of both regular (5s) and short (2-5s) multiple ITI (Intertrial interval). Dizocilpine was included for comparison. Both Ro 63-1908 (0.1-1mg/kg SC) and traxoprodil (0.3-3mg/kg SC) increased premature and perseverative responses in both 5-CSRT tasks and improved attention when tested under a short ITI test condition. Ro 63-1908 but not traxoprodil increased motor impulsivity (false alarms) in a Go-NoGo task. Dizocilpine (0.01-0.06mg/kg SC) affected both measures of motor impulsivity and marginally improved attention. In a delay discounting test of impulsive choice, both dizocilpine and Ro 63-1908 decreased impulsive choice (increased choice for the larger, delayed reward), while traxoprodil showed a similar trend. Motor stimulant effects were evident following Ro 63-1908, but not traxoprodil treatment - although no signs of motor stereotypy characteristic of dizocilpine (>0.1mg/kg) were noted. The findings of both NMDA GluN2B antagonists affecting measures of impulsive action and compulsive behavior may underpin emerging evidence to suggest glutamate signaling through the NMDA GluN2B receptor plays an important role in behavioural flexibility. The profiles between Ro 63-1908 and traxoprodil were not identical, perhaps suggesting differences between members of this drug class. Copyright © 2016 Elsevier B.V. All rights reserved.

The Effects of Task Fluency and Concurrent Reinforcement Schedules on Student Choice Allocation between Math Tasks

ERIC Educational Resources Information Center

Zaman, Maliha

2010-01-01

Students may avoid working on difficult tasks because it takes them longer to complete those tasks, which results in a delay to reinforcement. Research studies show that reinforcer and response dimensions can be manipulated within a concurrent operants framework to bias choice allocation toward more difficult tasks. The current study extends…

Introduction of Women into Work Groups in Traditionally Male Career Fields: Annotated Bibliography.

DTIC Science & Technology

1980-06-01

based on Bass’ theory of interpersonal behavior in organizations, consists of 27 forced-choice interest and opinion items. There are three scales in...Constantinople reviews the theory and measurement of mas- culinity-femininity as a unidimensional bipolar concept. She concludes that evidence...tends toward traditional stereotypes (male-task oriented, female- socioemotional ), but in mixed-sex groups they are less likely to indulge in stereo

Modeling the Direct and Indirect Determinants of Different Types of Individual Job Performance

DTIC Science & Technology

2008-06-01

cognitions , and self-regulation). A different model was found to describe the process depending on whether the performance dimension was an element of...performing the behaviors they indicated they intended to perform, and assembled a battery of existing instruments to measure cognitive ability, personality...model came from the task performance dimension. For this dimension, knowledge, skill, cognitive choice aspects of motivation, and self-regulation

A behavioral economic analysis of texting while driving: Delay discounting processes

PubMed Central

Hayashi, Yusuke; Miller, Kimberly; Foreman, Anne M.; Wirth, Oliver

2016-01-01

The purpose of the present study was to examine an impulsive decision-making process underlying texting while driving from a behavioral economic perspective. A sample of 108 college students completed a novel discounting task that presented participants with a hypothetical scenario in which, after receiving a text message while driving, they rated the likelihood of replying to a text message immediately versus waiting to reply for a specific period of time. Participants also completed a delay discounting task in which they made repeated hypothetical choices between obtaining a larger amount of money available after a delay and an equal or lesser amount of money available immediately. The results show that the duration of the delay is a critical variable that strongly determines whether participants choose to wait to reply to a text message, and that the decrease in the likelihood of waiting as a function of delay is best described by a hyperbolic delay discounting function. The results also show that participants who self-reported higher frequency of texting while driving discounted the opportunity to reply to a text message at greater rates, whereas there was no relation between the rates of discounting of hypothetical monetary rewards and the frequency of texting while driving. The results support the conclusion that texting while driving is fundamentally an impulsive choice. PMID:27614547

Neural predictors of evaluative attitudes toward celebrities

PubMed Central

Shibata, Kazuhisa; Matsumoto, Kenji; Adolphs, Ralph

2017-01-01

Abstract Our attitudes toward others influence a wide range of everyday behaviors and have been the most extensively studied concept in the history of social psychology. Yet they remain difficult to measure reliably and objectively, since both explicit and implicit measures are typically confounded by other psychological processes. We here address the feasibility of decoding incidental attitudes based on brain activations. Participants were presented with pictures of members of a Japanese idol group inside an functional magnetic resonance imaging scanner while performing an unrelated detection task, and subsequently (outside the scanner) performed an incentive-compatible choice task that revealed their attitude toward each celebrity. We used a real-world election scheme that exists for this idol group, which confirmed both strongly negative and strongly positive attitudes toward specific individuals. Whole-brain multivariate analyses (searchlight-based support vector regression) showed that activation patterns in the anterior striatum predicted each participant’s revealed attitudes (choice behavior) using leave-one-out (as well as 4-fold) cross-validation across participants. In contrast, attitude extremity (unsigned magnitude) could be decoded from a distinct region in the posterior striatum. The findings demonstrate dissociable striatal representations of valenced attitude and attitude extremity and constitute a first step toward an objective and process-pure neural measure of attitudes. PMID:27651542

Mechanisms underlying the influence of saliency on value-based decisions

PubMed Central

Chen, Xiaomo; Mihalas, Stefan; Niebur, Ernst; Stuphorn, Veit

2013-01-01

Objects in the environment differ in their low-level perceptual properties (e.g., how easily a fruit can be recognized) as well as in their subjective value (how tasty it is). We studied the influence of visual salience on value-based decisions using a two alternative forced choice task, in which human subjects rapidly chose items from a visual display. All targets were equally easy to detect. Nevertheless, both value and salience strongly affected choices made and reaction times. We analyzed the neuronal mechanisms underlying these behavioral effects using stochastic accumulator models, allowing us to characterize not only the averages of reaction times but their full distributions. Independent models without interaction between the possible choices failed to reproduce the observed choice behavior, while models with mutual inhibition between alternative choices produced much better results. Mutual inhibition thus is an important feature of the decision mechanism. Value influenced the amount of accumulation in all models. In contrast, increased salience could either lead to an earlier start (onset model) or to a higher rate (speed model) of accumulation. Both models explained the data from the choice trials equally well. However, salience also affected reaction times in no-choice trials in which only one item was present, as well as error trials. Only the onset model could explain the observed reaction time distributions of error trials and no-choice trials. In contrast, the speed model could not, irrespective of whether the rate increase resulted from more frequent accumulated quanta or from larger quanta. Visual salience thus likely provides an advantage in the onset, not in the processing speed, of value-based decision making. PMID:24167161

Choosing spouses and houses: Impaired congruence between preference and choice following damage to the ventromedial prefrontal cortex.

PubMed

Bowren, Mark D; Croft, Katie E; Reber, Justin; Tranel, Daniel

2018-03-01

A well-documented effect of focal ventromedial prefrontal cortex (vmPFC) damage is a deficit in real-world decision making. An important aspect of this deficit may be a deficiency in "internal consistency" during social decision making-that is, impaired congruence between expressed preferences versus actual behavioral choices. An example of low internal consistency would be if one expressed the desire to marry someone with impeccable moral character, yet proceeded to marry someone convicted of multiple felonies. Here, we used a neuropsychological approach to investigate neural correlates of internal consistency in complex decision making. Sixteen individuals with focal vmPFC lesions, 16 brain damage comparison individuals, and 16 normal comparison individuals completed a 3-option forced-choice preference task in which choices were made using attribute sets. Participants also completed visual-analogue preference ratings to indicate how much they liked each option, and rated the influence of each attribute on their decision making. Options were either social (potential spouses) or nonsocial (potential houses). Internal consistency for a trial was defined as agreement between the choice and the most positively rated option. A mixed design analysis of variance revealed that internal consistency between choices and preferences derived from summed attribute ratings was significantly lower for the vmPFC group relative to comparison participants, but only in the social condition (pη2 = .09), 95% CI [.002, .163]. Internal consistency during social decisions may be deficient in patients with vmPFC damage, leading to a discrepancy between preferences and choices. The vmPFC may provide an important neural mechanism for aligning behavioral choices with expressed preferences. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Choosing Spouses and Houses: Impaired Congruence Between Preference and Choice Following Damage to the Ventromedial Prefrontal Cortex

PubMed Central

Bowren, Mark D.; Croft, Katie E.; Reber, Justin; Tranel, Daniel

2017-01-01

Objective A well-documented effect of focal ventromedial prefrontal cortex (vmPFC) damage is a deficit in real-world decision-making. An important aspect of this deficit may be a deficiency in “internal consistency” during social decision-making – that is, impaired congruence between expressed preferences versus actual behavioral choices. An example of low internal consistency would be if one expressed the desire to marry someone with impeccable moral character,” yet proceeded to marry someone convicted of multiple felonies. Here, we used a neuropsychological approach to investigate neural correlates of internal consistency in complex decision-making. Method Sixteen individuals with focal vmPFC lesions, 16 brain-damage comparison individuals, and 16 normal comparison individuals completed a three-option forced-choice preference task in which choices were made using attribute sets. Participants also completed visual-analogue preference ratings to indicate how much they liked each option, and rated the influence of each attribute on their decision-making. Options were either social (potential spouses) or non-social (potential houses). Internal consistency for a trial was defined as agreement between the choice and the most positively rated option. Results A mixed design ANOVA revealed that internal consistency between choices and preferences derived from summed attribute ratings was significantly lower for the vmPFC group relative to comparison participants, but only in the social condition (pη2 = .09), 95% CI [.002, .163]. Conclusions Internal consistency during social decisions may be deficient in patients with vmPFC damage, leading to a discrepancy between preferences and choices. The vmPFC may provide an important neural mechanism for aligning behavioral choices with expressed preferences. PMID:29620403

Developmental trends and individual differences in brain systems involved in intertemporal choice during adolescence.

PubMed

Banich, Marie T; De La Vega, Alejandro; Andrews-Hanna, Jessica R; Mackiewicz Seghete, Kristen; Du, Yiping; Claus, Eric D

2013-06-01

This study used functional magnetic resonance imaging (fMRI) to examine the neural systems activated during an intertemporal choice task in a group of 14- to 19-year-old adolescents, as well as the relationship of such activation patterns to individual differences in the self-reported ability to engage in nonimmediate thinking (i.e., less impulsive and more future-oriented thoughts and action). With increasing age, there was greater differentiation between patterns of brain activity for immediate versus future choices across three distinct brain systems involved in intertemporal choice--those involved in exerting control over behavior, attributing affective value to choices, and imagining future outcomes. Furthermore, a greater propensity toward self-reported nonimmediate thinking was associated with decreased activity in the systems involved in cognitive control, possibly suggesting that individuals with greater self-reported nonimmediate thinking need to rely less on cognitive control regions during conditions of intertemporal choice. These results highlight the role that both developmental age and individual differences play in influencing neural systems involved in intertemporal choice. Implications for understanding the onset of substance abuse disorders during adolescence are discussed. 2013 APA, all rights reserved

Deficits in emotion based decision-making in schizophrenia; a new insight based on the Iowa Gambling Task.

PubMed

Matsuzawa, Daisuke; Shirayama, Yukihiko; Niitsu, Tomihisa; Hashimoto, Kenji; Iyo, Masaomi

2015-03-03

Defective decision-making is a symptom of impaired cognitive function observed in patients with schizophrenia. Impairment on the Iowa Gambling Task (IGT) has been reported in patients with schizophrenia, but these results are inconsistent among studies. We differentiated subjects based on whether they expressed certainty at having deciphered an advantageous strategy in the course of the task. We investigated this impairment using the IGT in patients with schizophrenia and performed analysis different to standard advantageous decks minus disadvantageous decks in all 100 card choices, [C+D]-[A+B](1-100). We examined the effects on behavior after receiving a big penalty. Results were dependent on participants utilizing with or without certainty, the best strategy for positive gain. Schizophrenic patients without certainty failed to show card choice shift, from disadvantageous to advantageous decks. Differences in card choices on the IGT were clearly shown between patients with schizophrenia and normal controls by the use of improvement from block 1 to blocks 3-5, [C+D]-[A+B]([41-100]-[1-20]) (P<0.001), rather than by the composite value of blocks 3-5, [C+D]-[A+B](41-100) (P=0.011). The deficit of emotion-based learning in schizophrenia without uncertainty were related to scores on the SANS and S5 attention. In addition, S1 affective flattering and S4 anhedonia-asociality were also related to these deficits. For a while, normal controls showed a smooth shift from disadvantageous to advantageous decks after big penalties, with or without a certainty for strategy. However, patients with schizophrenia failed to show switching from disadvantageous to advantageous decks, even after big penalties, under the same conditions. Our results highlight certainty of strategy and behavior after a big penalty, as two points of difference between patients with schizophrenia and normal controls in the accumulation of net scores. Copyright © 2014 Elsevier Inc. All rights reserved.

Human reinforcement learning subdivides structured action spaces by learning effector-specific values

PubMed Central

Gershman, Samuel J.; Pesaran, Bijan; Daw, Nathaniel D.

2009-01-01

Humans and animals are endowed with a large number of effectors. Although this enables great behavioral flexibility, it presents an equally formidable reinforcement learning problem of discovering which actions are most valuable, due to the high dimensionality of the action space. An unresolved question is how neural systems for reinforcement learning – such as prediction error signals for action valuation associated with dopamine and the striatum – can cope with this “curse of dimensionality.” We propose a reinforcement learning framework that allows for learned action valuations to be decomposed into effector-specific components when appropriate to a task, and test it by studying to what extent human behavior and BOLD activity can exploit such a decomposition in a multieffector choice task. Subjects made simultaneous decisions with their left and right hands and received separate reward feedback for each hand movement. We found that choice behavior was better described by a learning model that decomposed the values of bimanual movements into separate values for each effector, rather than a traditional model that treated the bimanual actions as unitary with a single value. A decomposition of value into effector-specific components was also observed in value-related BOLD signaling, in the form of lateralized biases in striatal correlates of prediction error and anticipatory value correlates in the intraparietal sulcus. These results suggest that the human brain can use decomposed value representations to “divide and conquer” reinforcement learning over high-dimensional action spaces. PMID:19864565

Human reinforcement learning subdivides structured action spaces by learning effector-specific values.

PubMed

Gershman, Samuel J; Pesaran, Bijan; Daw, Nathaniel D

2009-10-28

Humans and animals are endowed with a large number of effectors. Although this enables great behavioral flexibility, it presents an equally formidable reinforcement learning problem of discovering which actions are most valuable because of the high dimensionality of the action space. An unresolved question is how neural systems for reinforcement learning-such as prediction error signals for action valuation associated with dopamine and the striatum-can cope with this "curse of dimensionality." We propose a reinforcement learning framework that allows for learned action valuations to be decomposed into effector-specific components when appropriate to a task, and test it by studying to what extent human behavior and blood oxygen level-dependent (BOLD) activity can exploit such a decomposition in a multieffector choice task. Subjects made simultaneous decisions with their left and right hands and received separate reward feedback for each hand movement. We found that choice behavior was better described by a learning model that decomposed the values of bimanual movements into separate values for each effector, rather than a traditional model that treated the bimanual actions as unitary with a single value. A decomposition of value into effector-specific components was also observed in value-related BOLD signaling, in the form of lateralized biases in striatal correlates of prediction error and anticipatory value correlates in the intraparietal sulcus. These results suggest that the human brain can use decomposed value representations to "divide and conquer" reinforcement learning over high-dimensional action spaces.

Adaptive History Biases Result from Confidence-Weighted Accumulation of past Choices

PubMed Central

2018-01-01

Perceptual decision-making is biased by previous events, including the history of preceding choices: observers tend to repeat (or alternate) their judgments of the sensory environment more often than expected by chance. Computational models postulate that these so-called choice history biases result from the accumulation of internal decision signals across trials. Here, we provide psychophysical evidence for such a mechanism and its adaptive utility. Male and female human observers performed different variants of a challenging visual motion discrimination task near psychophysical threshold. In a first experiment, we decoupled categorical perceptual choices and motor responses on a trial-by-trial basis. Choice history bias was explained by previous perceptual choices, not motor responses, highlighting the importance of internal decision signals in action-independent formats. In a second experiment, observers performed the task in stimulus environments containing different levels of autocorrelation and providing no external feedback about choice correctness. Despite performing under overall high levels of uncertainty, observers adjusted both the strength and the sign of their choice history biases to these environments. When stimulus sequences were dominated by either repetitions or alternations, the individual degree of this adjustment of history bias was about as good a predictor of individual performance as individual perceptual sensitivity. The history bias adjustment scaled with two proxies for observers' confidence about their previous choices (accuracy and reaction time). Together, our results are consistent with the idea that action-independent, confidence-modulated decision variables are accumulated across choices in a flexible manner that depends on decision-makers' model of their environment. SIGNIFICANCE STATEMENT Decisions based on sensory input are often influenced by the history of one's preceding choices, manifesting as a bias to systematically repeat (or alternate) choices. We here provide support for the idea that such choice history biases arise from the context-dependent accumulation of a quantity referred to as the decision variable: the variable's sign dictates the choice and its magnitude the confidence about choice correctness. We show that choices are accumulated in an action-independent format and a context-dependent manner, weighted by the confidence about their correctness. This confidence-weighted accumulation of choices enables decision-makers to flexibly adjust their behavior to different sensory environments. The bias adjustment can be as important for optimizing performance as one's sensitivity to the momentary sensory input. PMID:29371318

Adaptive History Biases Result from Confidence-weighted Accumulation of Past Choices.

PubMed

Braun, Anke; Urai, Anne E; Donner, Tobias H

2018-01-25

Perceptual decision-making is biased by previous events, including the history of preceding choices: Observers tend to repeat (or alternate) their judgments of the sensory environment more often than expected by chance. Computational models postulate that these so-called choice history biases result from the accumulation of internal decision signals across trials. Here, we provide psychophysical evidence for such a mechanism and its adaptive utility. Male and female human observers performed different variants of a challenging visual motion discrimination task near psychophysical threshold. In a first experiment, we decoupled categorical perceptual choices and motor responses on a trial-by-trial basis. Choice history bias was explained by previous perceptual choices, not motor responses, highlighting the importance of internal decision signals in action-independent formats. In a second experiment, observers performed the task in stimulus environments containing different levels of auto-correlation and providing no external feedback about choice correctness. Despite performing under overall high levels of uncertainty, observers adjusted both the strength and the sign of their choice history biases to these environments. When stimulus sequences were dominated by either repetitions or alternations, the individual degree of this adjustment of history bias was about as good a predictor of individual performance as individual perceptual sensitivity. The history bias adjustment scaled with two proxies for observers' confidence about their previous choices (accuracy and reaction time). Taken together, our results are consistent with the idea that action-independent, confidence-modulated decision variables are accumulated across choices in a flexible manner that depends on decision-makers' model of their environment. Significance statement: Decisions based on sensory input are often influenced by the history of one's preceding choices, manifesting as a bias to systematically repeat (or alternate) choices. We here provide support for the idea that such choice history biases arise from the context-dependent accumulation of a quantity referred to as the decision variable: the variable's sign dictates the choice and its magnitude the confidence about choice correctness. We show that choices are accumulated in an action-independent format and a context-dependent manner, weighted by the confidence about their correctness. This confidence-weighted accumulation of choices enables decision-makers to flexibly adjust their behavior to different sensory environments. The bias adjustment can be as important for optimizing performance as one's sensitivity to the momentary sensory input. Copyright © 2018 Braun et al.

Effects of Experimental Unemployment, Employment and Punishment Analogs on Opioid Seeking and Consumption in Heroin-Dependent Volunteers

PubMed Central

Greenwald, Mark K.

2010-01-01

This study investigated the extent to which hydromorphone (HYD) choice and behavioral economic demand differed during experimental analogs of Unemployment (Drug Only: HYD and no money alternative), Employment (Drug or Money: HYD and $4 alternative), and Punishment (Drug Only + Money Loss: HYD only and $4 subtracted for each HYD choice), in the context of anticipated high vs. low post-session drug availability (HYD 24 mg vs. placebo). Eleven heroin-dependent, buprenorphine-stabilized (8-mg/day) volunteers first sampled two HYD doses (0 and 24 mg IM in randomized, counterbalanced order, labeled Drug A [session 1] and Drug B [session 2]). In each of the final six sessions, volunteers were given access to a 12-trial choice progressive ratio (PR) task and could work to receive HYD unit doses (2 mg each); cumulative dose units earned were administered in a bolus injection after the work session. Before the PR task, volunteers were told which HYD dose (Drug A or B) would be available 3 hr after the PR-contingent injection. Relative to Unemployment (Drug Only), Employment (Drug or Money) and Punishment (Drug Only + Money Loss) each significantly suppressed HYD seeking (e.g., breakpoints). Employment and Punishment also reduced HYD behavioral economic demand, but via different mechanisms: Employment increased HYD price-elasticity, whereas Punishment decreased HYD demand intensity. Adjusting for the initial level difference (i.e., normalized demand), Employment significantly decreased Pmax (i.e., lower “essential value” of HYD) and Omax (maximum HYD responding) compared to Punishment or Unemployment. These effects were not significantly altered by post-session drug availability. PMID:20537815

Neural markers of loss aversion in resting-state brain activity.

PubMed

Canessa, Nicola; Crespi, Chiara; Baud-Bovy, Gabriel; Dodich, Alessandra; Falini, Andrea; Antonellis, Giulia; Cappa, Stefano F

2017-02-01

Neural responses in striatal, limbic and somatosensory brain regions track individual differences in loss aversion, i.e. the higher sensitivity to potential losses compared with equivalent gains in decision-making under risk. The engagement of structures involved in the processing of aversive stimuli and experiences raises a further question, i.e. whether the tendency to avoid losses rather than acquire gains represents a transient fearful overreaction elicited by choice-related information, or rather a stable component of one's own preference function, reflecting a specific pattern of neural activity. We tested the latter hypothesis by assessing in 57 healthy human subjects whether the relationship between behavioral and neural loss aversion holds at rest, i.e. when the BOLD signal is collected during 5minutes of cross-fixation in the absence of an explicit task. Within the resting-state networks highlighted by a spatial group Independent Component Analysis (gICA), we found a significant correlation between strength of activity and behavioral loss aversion in the left ventral striatum and right posterior insula/supramarginal gyrus, i.e. the very same regions displaying a pattern of neural loss aversion during explicit choices. Cross-study analyses confirmed that this correlation holds when voxels identified by gICA are used as regions of interest in task-related activity and vice versa. These results suggest that the individual degree of (neural) loss aversion represents a stable dimension of decision-making, which reflects in specific metrics of intrinsic brain activity at rest possibly modulating cortical excitability at choice. Copyright © 2016 Elsevier Inc. All rights reserved.