Group choice: the ideal free distribution of human social behavior.

PubMed

Kraft, J R; Baum, W M

2001-07-01

Group choice refers to the distribution of group members between two choice alternatives over time. The ideal free distribution (IFD), an optimal foraging model from behavioral ecology, predicts that the ratio of foragers at two resource sites should equal the ratio of obtained resources, a prediction that is formally analogous to the matching law of individual choice, except that group choice is a social phenomenon. Two experiments investigated the usefulness of IFD analyses of human group choice and individual-based explanations that might account for the group-level events. Instead of nonhuman animals foraging at two sites for resources, a group of humans chose blue and red cards to receive points that could earn cash prizes. The groups chose blue and red cards in ratios in positive relation to the ratios of points associated with the cards. When group choice ratios and point ratios were plotted on logarithmic coordinates and fitted with regression lines, the slopes (i.e., sensitivity measures) approached 1.0 but tended to fall short of it (i.e., undermatching), with little bias and little unaccounted for variance. These experiments demonstrate that an IFD analysis of group choice is possible and useful, and suggest that group choice may be explained by the individual members' tendency to optimize reinforcement.

Melioration as rational choice: sequential decision making in uncertain environments.

PubMed

Sims, Chris R; Neth, Hansjörg; Jacobs, Robert A; Gray, Wayne D

2013-01-01

Melioration-defined as choosing a lesser, local gain over a greater longer term gain-is a behavioral tendency that people and pigeons share. As such, the empirical occurrence of meliorating behavior has frequently been interpreted as evidence that the mechanisms of human choice violate the norms of economic rationality. In some environments, the relationship between actions and outcomes is known. In this case, the rationality of choice behavior can be evaluated in terms of how successfully it maximizes utility given knowledge of the environmental contingencies. In most complex environments, however, the relationship between actions and future outcomes is uncertain and must be learned from experience. When the difficulty of this learning challenge is taken into account, it is not evident that melioration represents suboptimal choice behavior. In the present article, we examine human performance in a sequential decision-making experiment that is known to induce meliorating behavior. In keeping with previous results using this paradigm, we find that the majority of participants in the experiment fail to adopt the optimal decision strategy and instead demonstrate a significant bias toward melioration. To explore the origins of this behavior, we develop a rational analysis (Anderson, 1990) of the learning problem facing individuals in uncertain decision environments. Our analysis demonstrates that an unbiased learner would adopt melioration as the optimal response strategy for maximizing long-term gain. We suggest that many documented cases of melioration can be reinterpreted not as irrational choice but rather as globally optimal choice under uncertainty.

The Monty Hall dilemma in pigeons: effect of investment in initial choice.

PubMed

Stagner, Jessica P; Rayburn-Reeves, Rebecca; Zentall, Thomas R

2013-10-01

In the Monty Hall dilemma, humans are initially given a choice among three alternatives, one of which has a hidden prize. After choosing, but before it is revealed whether they have won the prize, they are shown that one of the remaining alternatives does not have the prize. They are then asked whether they want to stay with their original choice or switch to the remaining alternative. Although switching results in obtaining the prize two thirds of the time, humans consistently fail to adopt the optimal strategy of switching even after considerable training. Interestingly, there is evidence that pigeons show more optimal switching performance with this task than humans. Because humans often view even random choices already made as being more valuable than choices not made, we reasoned that if pigeons made a greater investment, it might produce an endowment or ownership effect resulting in more human-like suboptimal performance. On the other hand, the greater investment in the initial choice by the pigeons might facilitate switching behavior by helping them to better discriminate their staying versus switching behavior. In Experiment 1, we examined the effect of requiring pigeons to make a greater investment in their initial choice (20 pecks rather than the usual 1 peck). We found that the increased response requirement facilitated acquisition of the switching response. In Experiment 2, we showed that facilitation of switching due to the increased response requirement did not result from extinction of responding to the initially chosen location.

Melioration as Rational Choice: Sequential Decision Making in Uncertain Environments

ERIC Educational Resources Information Center

Sims, Chris R.; Neth, Hansjorg; Jacobs, Robert A.; Gray, Wayne D.

2013-01-01

Melioration--defined as choosing a lesser, local gain over a greater longer term gain--is a behavioral tendency that people and pigeons share. As such, the empirical occurrence of meliorating behavior has frequently been interpreted as evidence that the mechanisms of human choice violate the norms of economic rationality. In some environments, the…

Covert rapid action-memory simulation (CRAMS): a hypothesis of hippocampal-prefrontal interactions for adaptive behavior.

PubMed

Wang, Jane X; Cohen, Neal J; Voss, Joel L

2015-01-01

Effective choices generally require memory, yet little is known regarding the cognitive or neural mechanisms that allow memory to influence choices. We outline a new framework proposing that covert memory processing of hippocampus interacts with action-generation processing of prefrontal cortex in order to arrive at optimal, memory-guided choices. Covert, rapid action-memory simulation (CRAMS) is proposed here as a framework for understanding cognitive and/or behavioral choices, whereby prefrontal-hippocampal interactions quickly provide multiple simulations of potential outcomes used to evaluate the set of possible choices. We hypothesize that this CRAMS process is automatic, obligatory, and covert, meaning that many cycles of action-memory simulation occur in response to choice conflict without an individual's necessary intention and generally without awareness of the simulations, leading to adaptive behavior with little perceived effort. CRAMS is thus distinct from influential proposals that adaptive memory-based behavior in humans requires consciously experienced memory-based construction of possible future scenarios and deliberate decisions among possible future constructions. CRAMS provides an account of why hippocampus has been shown to make critical contributions to the short-term control of behavior, and it motivates several new experimental approaches and hypotheses that could be used to better understand the ubiquitous role of prefrontal-hippocampal interactions in situations that require adaptively using memory to guide choices. Importantly, this framework provides a perspective that allows for testing decision-making mechanisms in a manner that translates well across human and nonhuman animal model systems. Copyright © 2014 Elsevier Inc. All rights reserved.

Use of Preclinical Drug vs. Food Choice Procedures to Evaluate Candidate Medications for Cocaine Addiction.

PubMed

Banks, Matthew L; Hutsell, Blake A; Schwienteck, Kathryn L; Negus, S Stevens

2015-06-01

Drug addiction is a disease that manifests as an inappropriate allocation of behavior towards the procurement and use of the abused substance and away from other behaviors that produce more adaptive reinforcers (e.g. exercise, work, family and social relationships). The goal of treating drug addiction is not only to decrease drug-maintained behaviors, but also to promote a reallocation of behavior towards alternative, nondrug reinforcers. Experimental procedures that offer concurrent access to both a drug reinforcer and an alternative, nondrug reinforcer provide a research tool for assessment of medication effects on drug choice and behavioral allocation. Choice procedures are currently the standard in human laboratory research on medications development. Preclinical choice procedures have been utilized in biomedical research since the early 1940's, and during the last 10-15 years, their use for evaluation of medications to treat drug addiction has increased. We propose here that parallel use of choice procedures in preclinical and clinical studies will facilitate translational research on development of medications to treat cocaine addiction. In support of this proposition, a review of the literature suggests strong concordance between preclinical effectiveness of candidate medications to modify cocaine choice in nonhuman primates and rodents and clinical effectiveness of these medications to modify either cocaine choice in human laboratory studies or metrics of cocaine abuse in patients with cocaine use disorder. The strongest evidence for medication effectiveness in preclinical choice studies has been obtained with maintenance on the monoamine releaser d -amphetamine, a candidate agonist medication for cocaine use analogous to use of methadone to treat heroin abuse or nicotine formulations to treat tobacco dependence.

Use of Preclinical Drug vs. Food Choice Procedures to Evaluate Candidate Medications for Cocaine Addiction

PubMed Central

Banks, Matthew L; Hutsell, Blake A; Schwienteck, Kathryn L; Negus, S. Stevens

2015-01-01

Opinion Statement Drug addiction is a disease that manifests as an inappropriate allocation of behavior towards the procurement and use of the abused substance and away from other behaviors that produce more adaptive reinforcers (e.g. exercise, work, family and social relationships). The goal of treating drug addiction is not only to decrease drug-maintained behaviors, but also to promote a reallocation of behavior towards alternative, nondrug reinforcers. Experimental procedures that offer concurrent access to both a drug reinforcer and an alternative, nondrug reinforcer provide a research tool for assessment of medication effects on drug choice and behavioral allocation. Choice procedures are currently the standard in human laboratory research on medications development. Preclinical choice procedures have been utilized in biomedical research since the early 1940’s, and during the last 10–15 years, their use for evaluation of medications to treat drug addiction has increased. We propose here that parallel use of choice procedures in preclinical and clinical studies will facilitate translational research on development of medications to treat cocaine addiction. In support of this proposition, a review of the literature suggests strong concordance between preclinical effectiveness of candidate medications to modify cocaine choice in nonhuman primates and rodents and clinical effectiveness of these medications to modify either cocaine choice in human laboratory studies or metrics of cocaine abuse in patients with cocaine use disorder. The strongest evidence for medication effectiveness in preclinical choice studies has been obtained with maintenance on the monoamine releaser d-amphetamine, a candidate agonist medication for cocaine use analogous to use of methadone to treat heroin abuse or nicotine formulations to treat tobacco dependence. PMID:26009706

Relative Gains, Losses, and Reference Points in Probabilistic Choice in Rats

PubMed Central

Marshall, Andrew T.; Kirkpatrick, Kimberly

2015-01-01

Theoretical reference points have been proposed to differentiate probabilistic gains from probabilistic losses in humans, but such a phenomenon in non-human animals has yet to be thoroughly elucidated. Three experiments evaluated the effect of reward magnitude on probabilistic choice in rats, seeking to determine reference point use by examining the effect of previous outcome magnitude(s) on subsequent choice behavior. Rats were trained to choose between an outcome that always delivered reward (low-uncertainty choice) and one that probabilistically delivered reward (high-uncertainty). The probability of high-uncertainty outcome receipt and the magnitudes of low-uncertainty and high-uncertainty outcomes were manipulated within and between experiments. Both the low- and high-uncertainty outcomes involved variable reward magnitudes, so that either a smaller or larger magnitude was probabilistically delivered, as well as reward omission following high-uncertainty choices. In Experiments 1 and 2, the between groups factor was the magnitude of the high-uncertainty-smaller (H-S) and high-uncertainty-larger (H-L) outcome, respectively. The H-S magnitude manipulation differentiated the groups, while the H-L magnitude manipulation did not. Experiment 3 showed that manipulating the probability of differential losses as well as the expected value of the low-uncertainty choice produced systematic effects on choice behavior. The results suggest that the reference point for probabilistic gains and losses was the expected value of the low-uncertainty choice. Current theories of probabilistic choice behavior have difficulty accounting for the present results, so an integrated theoretical framework is proposed. Overall, the present results have implications for understanding individual differences and corresponding underlying mechanisms of probabilistic choice behavior. PMID:25658448

Normalization is a general neural mechanism for context-dependent decision making

PubMed Central

Louie, Kenway; Khaw, Mel W.; Glimcher, Paul W.

2013-01-01

Understanding the neural code is critical to linking brain and behavior. In sensory systems, divisive normalization seems to be a canonical neural computation, observed in areas ranging from retina to cortex and mediating processes including contrast adaptation, surround suppression, visual attention, and multisensory integration. Recent electrophysiological studies have extended these insights beyond the sensory domain, demonstrating an analogous algorithm for the value signals that guide decision making, but the effects of normalization on choice behavior are unknown. Here, we show that choice models using normalization generate significant (and classically irrational) choice phenomena driven by either the value or number of alternative options. In value-guided choice experiments, both monkey and human choosers show novel context-dependent behavior consistent with normalization. These findings suggest that the neural mechanism of value coding critically influences stochastic choice behavior and provide a generalizable quantitative framework for examining context effects in decision making. PMID:23530203

The Behavioral and Social Sciences.

ERIC Educational Resources Information Center

Simon, Herbert A.

1980-01-01

This article reviews some recent technical progress in the social sciences and three frontier areas including evolutionary theory as related to sociobiology, the theory of human rational choice, and cognitive science. These areas offer explanations for broad areas of human behavior. (Author/SA)

Hunger enhances consistent economic choices in non-human primates.

PubMed

Yamada, Hiroshi

2017-05-24

Hunger and thirst are fundamental biological processes that drive consumption behavior in humans and non-human animals. While the existing literature in neuroscience suggests that these satiety states change how consumable rewards are represented in the brain, it remains unclear as to how they change animal choice behavior and the underlying economic preferences. Here, I used combined techniques from experimental economics, psychology, and neuroscience to measure food preferences of marmoset monkeys (Callithrix jacchus), a recently developed primate model for neuroscience. Hunger states of animals were manipulated by scheduling feeding intervals, resulting in three different conditions: sated, non-sated, and hungry. During these hunger states, animals performed pairwise choices of food items, which included all possible pairwise combinations of five different food items except for same-food pairs. Results showed that hunger enhanced economic rationality, evident as a decrease of transitivity violations (item A was preferred to item B, and B to C, but C was preferred to A). Further analysis demonstrated that hungry monkeys chose more-preferred items over less-preferred items in a more deterministic manner, while the individual food preferences appeared to remain stable across hunger states. These results suggest that hunger enhances consistent choice behavior and shifts animals towards efficient outcome maximization.

Evidence for surprise minimization over value maximization in choice behavior

PubMed Central

Schwartenbeck, Philipp; FitzGerald, Thomas H. B.; Mathys, Christoph; Dolan, Ray; Kronbichler, Martin; Friston, Karl

2015-01-01

Classical economic models are predicated on the idea that the ultimate aim of choice is to maximize utility or reward. In contrast, an alternative perspective highlights the fact that adaptive behavior requires agents’ to model their environment and minimize surprise about the states they frequent. We propose that choice behavior can be more accurately accounted for by surprise minimization compared to reward or utility maximization alone. Minimizing surprise makes a prediction at variance with expected utility models; namely, that in addition to attaining valuable states, agents attempt to maximize the entropy over outcomes and thus ‘keep their options open’. We tested this prediction using a simple binary choice paradigm and show that human decision-making is better explained by surprise minimization compared to utility maximization. Furthermore, we replicated this entropy-seeking behavior in a control task with no explicit utilities. These findings highlight a limitation of purely economic motivations in explaining choice behavior and instead emphasize the importance of belief-based motivations. PMID:26564686

Choices Matter, but How Do We Model Them?

NASA Astrophysics Data System (ADS)

Brelsford, C.; Dumas, M.

2017-12-01

Quantifying interactions between social systems and the physical environment we live within has long been a major scientific challenge. Humans have had such a large influence on our environment that it is no longer reasonable to consider the behavior of an ecological or hydrological system from a purely `physical' perspective: imagining a system that excludes the influence of human choices and behavior. Understanding the role that human social choices play in the energy water nexus is crucial for developing accurate models in that space. The relatively new field of socio-hydrology is making progress towards understanding the role humans play in hydrological systems. While this fact is now widely recognized across the many academic fields that study water systems, we have yet to develop a coherent set of theories for how to model the behavior of these complex and highly interdependent socio-hydrological systems. How should we conceptualize hydrological systems as socio-ecological systems (i.e. system with variables, states, parameters, actors who can control certain variables and a sense of the desirability of states) within which the rigorous study of feedbacks becomes possible? This talk reviews the state of knowledge of how social decisions around water consumption, allocation, and transport influence and are influenced by the physical hydrology that water also moves within. We cover recent papers in socio-hydrology, engineering, water law, and institutional analysis. There have been several calls within socio-hydrology to model human social behavior endogenously along with the hydrology. These improvements are needed across a range of spatial and temporal scales. We suggest two potential strategies for coupled models that allow endogenous water consumption behavior: a social first model which looks for empirical relationships between water consumption and allocation choices and the hydrological state, and a hydrology first model in which we look for regularities in how water regimes influence behavior, regional economies, or allocation institutions.

Quantification of Ethanol's Anti-Punishment Effect in Humans Using the Generalized Matching Equation

ERIC Educational Resources Information Center

Rasmussen, Erin B.; Newland, M. Christopher

2009-01-01

Increases in rates of punished behavior by the administration of drugs with anxiolytic effects (called antipunishment effects) are well established in animals but not humans. The present study examined antipunishment effects of ethanol in humans using a choice procedure. The behavior of 5 participants was placed under six concurrent…

Objective Physiological Measurements but Not Subjective Reports Moderate the Effect of Hunger on Choice Behavior

PubMed Central

Shabat-Simon, Maytal; Shuster, Anastasia; Sela, Tal; Levy, Dino J.

2018-01-01

Hunger is a powerful driver of human behavior, and is therefore of great interest to the study of psychology, economics, and consumer behavior. Assessing hunger levels in experiments is often biased, when using self-report methods, or complex, when using blood tests. We propose a novel way of objectively measuring subjects’ levels of hunger by identifying levels of alpha-amylase (AA) enzyme in their saliva samples. We used this measure to uncover the effect of hunger on different types of choice behaviors. We found that hunger increases risk-seeking behavior in a lottery-choice task, modifies levels of vindictiveness in a social decision-making task, but does not have a detectible effect on economic inconsistency in a budget-set choice task. Importantly, these findings were moderated by AA levels and not by self-report measures. We demonstrate the effects hunger has on choice behavior and the problematic nature of subjective measures of physiological states, and propose to use reliable and valid biologically based methods to overcome these problems. PMID:29875715

Preference bias of head orientation in choosing between two non-durables.

PubMed

Funaya, Hiroyuki; Shibata, Tomohiro

2015-01-01

The goal of this study is to investigate how customers' gaze, head and body orientations reflect their choices. Although the relationship between human choice and gaze behavior has been well-studied, other behaviors such as head and body are unknown. We conducted a two-alternatives-forced-choice task to examine (1) whether preference bias, i.e., a positional bias in gaze, head and body toward the item that was later chosen, exists in choice, (2) when preference bias is observed and when prediction of the resulting choice becomes possible (3) whether human choice is affected when the body orientations are manipulated. We used real non-durable products (cheap snacks and clothing) on a shopping shelf. The results showed that there was a significant preference bias in head orientation at the beginning 1 s when the subjects stood straight toward the shelf, and that the head orientation was more biased toward the selected item than the gaze and the center of pressure at the ending 1 s. Manipulating body orientation did not affect the result of choice. The preference bias detected by observing the head orientation would be useful in marketing science for predicting customers' choice.

Hedonism and the choice of everyday activities.

PubMed

Taquet, Maxime; Quoidbach, Jordi; de Montjoye, Yves-Alexandre; Desseilles, Martin; Gross, James J

2016-08-30

Most theories of motivation have highlighted that human behavior is guided by the hedonic principle, according to which our choices of daily activities aim to minimize negative affect and maximize positive affect. However, it is not clear how to reconcile this idea with the fact that people routinely engage in unpleasant yet necessary activities. To address this issue, we monitored in real time the activities and moods of over 28,000 people across an average of 27 d using a multiplatform smartphone application. We found that people's choices of activities followed a hedonic flexibility principle. Specifically, people were more likely to engage in mood-increasing activities (e.g., play sports) when they felt bad, and to engage in useful but mood-decreasing activities (e.g., housework) when they felt good. These findings clarify how hedonic considerations shape human behavior. They may explain how humans overcome the allure of short-term gains in happiness to maximize long-term welfare.

Sweet taste liking is associated with impulsive behaviors in humans

PubMed Central

Weafer, Jessica; Burkhardt, Anne; de Wit, Harriet

2014-01-01

Evidence from both human and animal studies suggests that sensitivity to rewarding stimuli is positively associated with impulsive behaviors, including both impulsive decision making and inhibitory control. The current study examined associations between the hedonic value of a sweet taste and two forms of impulsivity (impulsive choice and impulsive action) in healthy young adults (N = 100). Participants completed a sweet taste test in which they rated their liking of various sweetness concentrations. Subjects also completed measures of impulsive choice (delay discounting), and impulsive action (go/no-go task). Subjects who discounted more steeply (i.e., greater impulsive choice) liked the high sweetness concentration solutions more. By contrast, sweet liking was not related to impulsive action. These findings indicate that impulsive choice may be associated with heightened sensitivity to the hedonic value of a rewarding stimulus, and that these constructs might share common underlying neurobiological mechanisms. PMID:24987343

Recent Translational Findings on Impulsivity in Relation to Drug Abuse

PubMed Central

Weafer, Jessica; Mitchell, Suzanne H.

2015-01-01

Impulsive behavior is strongly implicated in drug abuse, as both a cause and a consequence of drug use. To understand how impulsive behaviors lead to and result from drug use, translational evidence from both human and non-human animal studies is needed. Here, we review recent (2009 or later) studies that have investigated two major components of impulsive behavior, inhibitory control and impulsive choice, across preclinical and clinical studies. We concentrate on the stop-signal task as the measure of inhibitory control and delay discounting as the measure of impulsive choice. Consistent with previous reports, recent studies show greater impulsive behavior in drug users compared with non-users. Additionally, new evidence supports the prospective role of impulsive behavior in drug abuse, and has begun to identify the neurobiological mechanisms underlying impulsive behavior. We focus on the commonalities and differences in findings between preclinical and clinical studies, and suggest future directions for translational research. PMID:25678985

Neural correlates of value, risk, and risk aversion contributing to decision making under risk.

PubMed

Christopoulos, George I; Tobler, Philippe N; Bossaerts, Peter; Dolan, Raymond J; Schultz, Wolfram

2009-10-07

Decision making under risk is central to human behavior. Economic decision theory suggests that value, risk, and risk aversion influence choice behavior. Although previous studies identified neural correlates of decision parameters, the contribution of these correlates to actual choices is unknown. In two different experiments, participants chose between risky and safe options. We identified discrete blood oxygen level-dependent (BOLD) correlates of value and risk in the ventral striatum and anterior cingulate, respectively. Notably, increasing inferior frontal gyrus activity to low risk and safe options correlated with higher risk aversion. Importantly, the combination of these BOLD responses effectively decoded the behavioral choice. Striatal value and cingulate risk responses increased the probability of a risky choice, whereas inferior frontal gyrus responses showed the inverse relationship. These findings suggest that the BOLD correlates of decision factors are appropriate for an ideal observer to detect behavioral choices. More generally, these biological data contribute to the validity of the theoretical decision parameters for actual decisions under risk.

Chimpanzee choice rates in competitive games match equilibrium game theory predictions.

PubMed

Martin, Christopher Flynn; Bhui, Rahul; Bossaerts, Peter; Matsuzawa, Tetsuro; Camerer, Colin

2014-06-05

The capacity for strategic thinking about the payoff-relevant actions of conspecifics is not well understood across species. We use game theory to make predictions about choices and temporal dynamics in three abstract competitive situations with chimpanzee participants. Frequencies of chimpanzee choices are extremely close to equilibrium (accurate-guessing) predictions, and shift as payoffs change, just as equilibrium theory predicts. The chimpanzee choices are also closer to the equilibrium prediction, and more responsive to past history and payoff changes, than two samples of human choices from experiments in which humans were also initially uninformed about opponent payoffs and could not communicate verbally. The results are consistent with a tentative interpretation of game theory as explaining evolved behavior, with the additional hypothesis that chimpanzees may retain or practice a specialized capacity to adjust strategy choice during competition to perform at least as well as, or better than, humans have.

Motor heuristics and embodied choices: how to choose and act.

PubMed

Raab, Markus

2017-08-01

Human performance requires choosing what to do and how to do it. The goal of this theoretical contribution is to advance understanding of how the motor and cognitive components of choices are intertwined. From a holistic perspective I extend simple heuristics that have been tested in cognitive tasks to motor tasks, coining the term motor heuristics. Similarly I extend the concept of embodied cognition, that has been tested in simple sensorimotor processes changing decisions, to complex sport behavior coining the term embodied choices. Thus both motor heuristics and embodied choices explain complex behavior such as studied in sport and exercise psychology. Copyright © 2017 Elsevier Ltd. All rights reserved.

Irrational choice behavior in human and nonhuman primates.

PubMed

Perdue, Bonnie M; Brown, Ella R

2018-03-01

Choice behavior in humans has motivated a large body of research with a focus on whether decisions can be considered to be rational. In general, humans prefer having choice, as do a number of other species that have been tested, even though having increased choice does not necessarily yield a positive outcome. Humans have been found to choose an option more often only because the opportunity to select it was diminishing, an example of a deviation from economic rationality. Here we extend this paradigm to nonhuman primates in an effort to understand the mechanisms underlying this finding. In this study, we presented two groups of laboratory monkeys, capuchins (Cebus apella) and rhesus macaques (Macaca mulatta), as well as human subjects, with a computerized task in which subjects were presented with two differently colored icons. When the subject selected an icon, differing numbers of food pellets were dispensed (or points were assigned), making each icon correspond to a certain level of risk (one icon yielded 1 or 4 pellets/points and the other yielded 2 or 3). Initially, both options remained constantly available and we established choice preference scores for each subject. Then, we assessed preference patterns once the options were not continuously available. Specifically, choosing one icon would cause the other to shrink in size on the screen and eventually disappear if never selected. Selecting it would restore it to its full size. As predicted, humans shifted their risk preferences in the diminishing options phase, choosing to click on both icons more equally in order to keep both options available. At the group level, capuchin monkeys showed this pattern as well, but there was a great deal of individual variability in both capuchins and macaques. The present work suggests that there is some degree of continuity between human and nonhuman primates in the desire to have choice simply for the sake of having choice.

[Significance of motivation balance for a choice of dog's behavior under conditions of environmental uncertainty].

PubMed

Chilingarian, L I; Grigor'ian, G A

2007-01-01

Two experimental models with a choice between two reinforcements were used for assessment of individual typological features of dogs. In the first model dogs were given the choice of homogeneous food reinforcements: between less valuable constantly delivered reinforcement and more valuable reinforcement but delivered with low probabilities. In the second model the dogs had the choice of heterogeneous reinforcements: between performing alimentary and defensive reactions. Under conditions of rise of uncertainty owing to a decrease in probability of getting the valuable food, two dogs continued to prefer the valuable reinforcement, while the third animal gradually shifted its behavior from the choice of a highly valuable but infrequent reward to a less valuable but easily achieved reinforcement. Under condition of choice between the valuable food reinforcement and avoidance of electrocutaneous stimulation, the first two dogs preferred food, whereas the third animal which had been previously oriented to the choice of the low-valuable constant reinforcement, steadily preferred the avoidance behavior. The data obtained are consistent with the hypothesis according to which the individual typological characteristics of animals's (human's) behavior substantially depend on two parameters: extent of environmental uncertainty and subjective features of reinforcement assessment.

Interdependent Utilities: How Social Ranking Affects Choice Behavior

PubMed Central

Bault, Nadège; Coricelli, Giorgio; Rustichini, Aldo

2008-01-01

Organization in hierarchical dominance structures is prevalent in animal societies, so a strong preference for higher positions in social ranking is likely to be an important motivation of human social and economic behavior. This preference is also likely to influence the way in which we evaluate our outcome and the outcome of others, and finally the way we choose. In our experiment participants choose among lotteries with different levels of risk, and can observe the choice that others have made. Results show that the relative weight of gains and losses is the opposite in the private and social domain. For private outcomes, experience and anticipation of losses loom larger than gains, whereas in the social domain, gains loom larger than losses, as indexed by subjective emotional evaluations and physiological responses. We propose a theoretical model (interdependent utilities), predicting the implication of this effect for choice behavior. The relatively larger weight assigned to social gains strongly affects choices, inducing complementary behavior: faced with a weaker competitor, participants adopt a more risky and dominant behavior. PMID:18941538

Primate amygdala neurons evaluate the progress of self-defined economic choice sequences

PubMed Central

Grabenhorst, Fabian; Hernadi, Istvan; Schultz, Wolfram

2016-01-01

The amygdala is a prime valuation structure yet its functions in advanced behaviors are poorly understood. We tested whether individual amygdala neurons encode a critical requirement for goal-directed behavior: the evaluation of progress during sequential choices. As monkeys progressed through choice sequences toward rewards, amygdala neurons showed phasic, gradually increasing responses over successive choice steps. These responses occurred in the absence of external progress cues or motor preplanning. They were often specific to self-defined sequences, typically disappearing during instructed control sequences with similar reward expectation. Their build-up rate reflected prospectively the forthcoming choice sequence, suggesting adaptation to an internal plan. Population decoding demonstrated a high-accuracy progress code. These findings indicate that amygdala neurons evaluate the progress of planned, self-defined behavioral sequences. Such progress signals seem essential for aligning stepwise choices with internal plans. Their presence in amygdala neurons may inform understanding of human conditions with amygdala dysfunction and deregulated reward pursuit. DOI: http://dx.doi.org/10.7554/eLife.18731.001 PMID:27731795

Primate amygdala neurons evaluate the progress of self-defined economic choice sequences.

PubMed

Grabenhorst, Fabian; Hernadi, Istvan; Schultz, Wolfram

2016-10-12

The amygdala is a prime valuation structure yet its functions in advanced behaviors are poorly understood. We tested whether individual amygdala neurons encode a critical requirement for goal-directed behavior: the evaluation of progress during sequential choices. As monkeys progressed through choice sequences toward rewards, amygdala neurons showed phasic, gradually increasing responses over successive choice steps. These responses occurred in the absence of external progress cues or motor preplanning. They were often specific to self-defined sequences, typically disappearing during instructed control sequences with similar reward expectation. Their build-up rate reflected prospectively the forthcoming choice sequence, suggesting adaptation to an internal plan. Population decoding demonstrated a high-accuracy progress code. These findings indicate that amygdala neurons evaluate the progress of planned, self-defined behavioral sequences. Such progress signals seem essential for aligning stepwise choices with internal plans. Their presence in amygdala neurons may inform understanding of human conditions with amygdala dysfunction and deregulated reward pursuit.

There Are at Least Two Kinds of Probability Matching: Evidence from a Secondary Task

ERIC Educational Resources Information Center

Otto, A. Ross; Taylor, Eric G.; Markman, Arthur B.

2011-01-01

Probability matching is a suboptimal behavior that often plagues human decision-making in simple repeated choice tasks. Despite decades of research, recent studies cannot find agreement on what choice strategies lead to probability matching. We propose a solution, showing that two distinct local choice strategies--which make different demands on…

Neural Mechanism for Stochastic Behavior During a Competitive Game

PubMed Central

Soltani, Alireza; Lee, Daeyeol; Wang, Xiao-Jing

2006-01-01

Previous studies have shown that non-human primates can generate highly stochastic choice behavior, especially when this is required during a competitive interaction with another agent. To understand the neural mechanism of such dynamic choice behavior, we propose a biologically plausible model of decision making endowed with synaptic plasticity that follows a reward-dependent stochastic Hebbian learning rule. This model constitutes a biophysical implementation of reinforcement learning, and it reproduces salient features of behavioral data from an experiment with monkeys playing a matching pennies game. Due to interaction with an opponent and learning dynamics, the model generates quasi-random behavior robustly in spite of intrinsic biases. Furthermore, non-random choice behavior can also emerge when the model plays against a non-interactive opponent, as observed in the monkey experiment. Finally, when combined with a meta-learning algorithm, our model accounts for the slow drift in the animal’s strategy based on a process of reward maximization. PMID:17015181

Insights from Preclinical Choice Models on Treating Drug Addiction.

PubMed

Banks, Matthew L; Negus, S Stevens

2017-02-01

Substance-use disorders are a global public health problem that arises from behavioral misallocation between drug use and more adaptive behaviors maintained by nondrug alternatives (e.g., food or money). Preclinical drug self-administration procedures that incorporate a concurrently available nondrug reinforcer (e.g., food) provide translationally relevant and distinct dependent measures of behavioral allocation (i.e., to assess the relative reinforcing efficacy of the drug) and behavioral rate (i.e., to assess motor competence). In particular, preclinical drug versus food 'choice' procedures have produced increasingly concordant results with both human laboratory drug self-administration studies and double-blind placebo-controlled clinical trials. Accordingly, here we provide a heuristic framework of substance-use disorders based on a behavioral-centric perspective and recent insights from these preclinical choice procedures. Copyright © 2016 Elsevier Ltd. All rights reserved.

The Effect of Religion on Ethnic Tolerance in Malaysia: The Application of Rational Choice Theory (RCT) and the Theory of Planned Behaviour (TPB)

ERIC Educational Resources Information Center

Idris, Fazilah; Abdullah, Mohd Richard Neles; Ahmad, Abdul Razak; Mansor, Ahmad Zamri

2016-01-01

There has been little research done on explaining the ethnic tolerance behavior from the perspective of sociological theories. The authors chose rational choice theory and the theory of planned behavior as they are widely used in explaining the human social behaviour. In this article, the theories are used to explain the effects of religion on…

Alterations in choice behavior by manipulations of world model.

PubMed

Green, C S; Benson, C; Kersten, D; Schrater, P

2010-09-14

How to compute initially unknown reward values makes up one of the key problems in reinforcement learning theory, with two basic approaches being used. Model-free algorithms rely on the accumulation of substantial amounts of experience to compute the value of actions, whereas in model-based learning, the agent seeks to learn the generative process for outcomes from which the value of actions can be predicted. Here we show that (i) "probability matching"-a consistent example of suboptimal choice behavior seen in humans-occurs in an optimal Bayesian model-based learner using a max decision rule that is initialized with ecologically plausible, but incorrect beliefs about the generative process for outcomes and (ii) human behavior can be strongly and predictably altered by the presence of cues suggestive of various generative processes, despite statistically identical outcome generation. These results suggest human decision making is rational and model based and not consistent with model-free learning.

PICU Nurses' Pain Assessments And Intervention Choices for Virtual Human And Written Vignettes

PubMed Central

LaFond, Cynthia M.; Vincent, Catherine Van Hulle; Corte, Colleen; Hershberger, Patricia E.; Johnson, Andrew; Park, Chang G.; Wilkie, Diana J.

2015-01-01

The purpose of this concurrent mixed-methods study was to 1) examine the factors pediatric intensive care unit nurses consider when assessing and intervening for children who report severe pain and to 2) determine the effect of child behavior and diagnosis on the nurses’ pain ratings and intervention choices for written and virtual human vignettes. Quantitative and qualitative results substantiated that despite recommendations to use self-report, many PICU nurses use behavior as the primary indicator to assess and treat pain, even when a child is old enough to articulate pain intensity and there is sufficient cause for pain to be present. PMID:25682019

Suboptimal Choice by Pigeons: An Analog of Human Gambling Behavior

PubMed Central

Zentall, Thomas R.

2014-01-01

Human gambling often involves the choice of a low probability but high valued outcome over a high probability (certain) low valued outcome (not gambling) that is economically more optimal. We have developed an analog of gambling in which pigeons prefer a suboptimal alternative that infrequently provides a signal for a high probability (or high magnitude) of reinforcement over an optimal alternative that always provides a signal for a lower probability (or lower magnitude) of reinforcement. We have identified two mechanisms that may be responsible for this suboptimal behavior. First, the effect of nonreinforcement results in considerably less inhibition of choice than ideally it should. Second, the frequency of the occurrence of the signal for a high probability or high magnitude of reinforcement is less important than ideally it should. Also analogous to human gambling is the finding that pigeons that are normally food restricted choose suboptimally, whereas those that are minimally food restricted choose optimally. In addition, pigeons that are singly housed choose suboptimally, whereas those that are exposed to a more enriched environment choose less suboptimally. We believe that these findings have implications for the understanding and treatment of problem gambling behavior. PMID:24291801

Suboptimal choice by pigeons: an analog of human gambling behavior.

PubMed

Zentall, Thomas R

2014-03-01

Human gambling often involves the choice of a low probability but high valued outcome over a high probability (certain) low valued outcome (not gambling) that is economically more optimal. We have developed an analog of gambling in which pigeons prefer a suboptimal alternative that infrequently provides a signal for a high probability (or high magnitude) of reinforcement over an optimal alternative that always provides a signal for a lower probability (or lower magnitude) of reinforcement. We have identified two mechanisms that may be responsible for this suboptimal behavior. First, the effect of nonreinforcement results in considerably less inhibition of choice than ideally it should. Second, the frequency of the occurrence of the signal for a high probability or high magnitude of reinforcement is less important than ideally it should. Also analogous to human gambling is the finding that pigeons that are normally food restricted choose suboptimally, whereas those that are minimally food restricted choose optimally. In addition, pigeons that are singly housed choose suboptimally, whereas those that are exposed to a more enriched environment choose less suboptimally. We believe that these findings have implications for the understanding and treatment of problem gambling behavior. Copyright © 2013 Elsevier B.V. All rights reserved.

Hedonism and the choice of everyday activities

PubMed Central

Taquet, Maxime; Quoidbach, Jordi; de Montjoye, Yves-Alexandre; Desseilles, Martin; Gross, James J.

2016-01-01

Most theories of motivation have highlighted that human behavior is guided by the hedonic principle, according to which our choices of daily activities aim to minimize negative affect and maximize positive affect. However, it is not clear how to reconcile this idea with the fact that people routinely engage in unpleasant yet necessary activities. To address this issue, we monitored in real time the activities and moods of over 28,000 people across an average of 27 d using a multiplatform smartphone application. We found that people’s choices of activities followed a hedonic flexibility principle. Specifically, people were more likely to engage in mood-increasing activities (e.g., play sports) when they felt bad, and to engage in useful but mood-decreasing activities (e.g., housework) when they felt good. These findings clarify how hedonic considerations shape human behavior. They may explain how humans overcome the allure of short-term gains in happiness to maximize long-term welfare. PMID:27528666

A lack of appetite for information and computation. Simple heuristics in food choice.

PubMed

Schulte-Mecklenbeck, Michael; Sohn, Matthias; de Bellis, Emanuel; Martin, Nathalie; Hertwig, Ralph

2013-12-01

The predominant, but largely untested, assumption in research on food choice is that people obey the classic commandments of rational behavior: they carefully look up every piece of relevant information, weight each piece according to subjective importance, and then combine them into a judgment or choice. In real world situations, however, the available time, motivation, and computational resources may simply not suffice to keep these commandments. Indeed, there is a large body of research suggesting that human choice is often better accommodated by heuristics-simple rules that enable decision making on the basis of a few, but important, pieces of information. We investigated the prevalence of such heuristics in a computerized experiment that engaged participants in a series of choices between two lunch dishes. Employing MouselabWeb, a process-tracing technique, we found that simple heuristics described an overwhelmingly large proportion of choices, whereas strategies traditionally deemed rational were barely apparent in our data. Replicating previous findings, we also observed that visual stimulus segments received a much larger proportion of attention than any nutritional values did. Our results suggest that, consistent with human behavior in other domains, people make their food choices on the basis of simple and informationally frugal heuristics. Copyright © 2013 Elsevier Ltd. All rights reserved.

When Brain Beats Behavior: Neuroforecasting Crowdfunding Outcomes

PubMed Central

Yoon, Carolyn

2017-01-01

Although traditional economic and psychological theories imply that individual choice best scales to aggregate choice, primary components of choice reflected in neural activity may support even more generalizable forecasts. Crowdfunding represents a significant and growing platform for funding new and unique projects, causes, and products. To test whether neural activity could forecast market-level crowdfunding outcomes weeks later, 30 human subjects (14 female) decided whether to fund proposed projects described on an Internet crowdfunding website while undergoing scanning with functional magnetic resonance imaging. Although activity in both the nucleus accumbens (NAcc) and medial prefrontal cortex predicted individual choices to fund on a trial-to-trial basis in the neuroimaging sample, only NAcc activity generalized to forecast market funding outcomes weeks later on the Internet. Behavioral measures from the neuroimaging sample, however, did not forecast market funding outcomes. This pattern of associations was replicated in a second study. These findings demonstrate that a subset of the neural predictors of individual choice can generalize to forecast market-level crowdfunding outcomes—even better than choice itself. SIGNIFICANCE STATEMENT Forecasting aggregate behavior with individual neural data has proven elusive; even when successful, neural forecasts have not historically supplanted behavioral forecasts. In the current research, we find that neural responses can forecast market-level choice and outperform behavioral measures in a novel Internet crowdfunding context. Targeted as well as model-free analyses convergently indicated that nucleus accumbens activity can support aggregate forecasts. Beyond providing initial evidence for neuropsychological processes implicated in crowdfunding choices, these findings highlight the ability of neural features to forecast aggregate choice, which could inform applications relevant to business and policy. PMID:28821681

The roles of dopamine and serotonin in decision making: evidence from pharmacological experiments in humans.

PubMed

Rogers, Robert D

2011-01-01

Neurophysiological experiments in primates, alongside neuropsychological and functional magnetic resonance investigations in humans, have significantly enhanced our understanding of the neural architecture of decision making. In this review, I consider the more limited database of experiments that have investigated how dopamine and serotonin activity influences the choices of human adults. These include those experiments that have involved the administration of drugs to healthy controls, experiments that have tested genotypic influences upon dopamine and serotonin function, and, finally, some of those experiments that have examined the effects of drugs on the decision making of clinical samples. Pharmacological experiments in humans are few in number and face considerable methodological challenges in terms of drug specificity, uncertainties about pre- vs post-synaptic modes of action, and interactions with baseline cognitive performance. However, the available data are broadly consistent with current computational models of dopamine function in decision making and highlight the dissociable roles of dopamine receptor systems in the learning about outcomes that underpins value-based decision making. Moreover, genotypic influences on (interacting) prefrontal and striatal dopamine activity are associated with changes in choice behavior that might be relevant to understanding exploratory behaviors and vulnerability to addictive disorders. Manipulations of serotonin in laboratory tests of decision making in human participants have provided less consistent results, but the information gathered to date indicates a role for serotonin in learning about bad decision outcomes, non-normative aspects of risk-seeking behavior, and social choices involving affiliation and notions of fairness. Finally, I suggest that the role played by serotonin in the regulation of cognitive biases, and representation of context in learning, point toward a role in the cortically mediated cognitive appraisal of reinforcers when selecting between actions, potentially accounting for its influence upon the processing salient aversive outcomes and social choice.

Economic Choices Reveal Probability Distortion in Macaque Monkeys

PubMed Central

Lak, Armin; Bossaerts, Peter; Schultz, Wolfram

2015-01-01

Economic choices are largely determined by two principal elements, reward value (utility) and probability. Although nonlinear utility functions have been acknowledged for centuries, nonlinear probability weighting (probability distortion) was only recently recognized as a ubiquitous aspect of real-world choice behavior. Even when outcome probabilities are known and acknowledged, human decision makers often overweight low probability outcomes and underweight high probability outcomes. Whereas recent studies measured utility functions and their corresponding neural correlates in monkeys, it is not known whether monkeys distort probability in a manner similar to humans. Therefore, we investigated economic choices in macaque monkeys for evidence of probability distortion. We trained two monkeys to predict reward from probabilistic gambles with constant outcome values (0.5 ml or nothing). The probability of winning was conveyed using explicit visual cues (sector stimuli). Choices between the gambles revealed that the monkeys used the explicit probability information to make meaningful decisions. Using these cues, we measured probability distortion from choices between the gambles and safe rewards. Parametric modeling of the choices revealed classic probability weighting functions with inverted-S shape. Therefore, the animals overweighted low probability rewards and underweighted high probability rewards. Empirical investigation of the behavior verified that the choices were best explained by a combination of nonlinear value and nonlinear probability distortion. Together, these results suggest that probability distortion may reflect evolutionarily preserved neuronal processing. PMID:25698750

Economic choices reveal probability distortion in macaque monkeys.

PubMed

Stauffer, William R; Lak, Armin; Bossaerts, Peter; Schultz, Wolfram

2015-02-18

Economic choices are largely determined by two principal elements, reward value (utility) and probability. Although nonlinear utility functions have been acknowledged for centuries, nonlinear probability weighting (probability distortion) was only recently recognized as a ubiquitous aspect of real-world choice behavior. Even when outcome probabilities are known and acknowledged, human decision makers often overweight low probability outcomes and underweight high probability outcomes. Whereas recent studies measured utility functions and their corresponding neural correlates in monkeys, it is not known whether monkeys distort probability in a manner similar to humans. Therefore, we investigated economic choices in macaque monkeys for evidence of probability distortion. We trained two monkeys to predict reward from probabilistic gambles with constant outcome values (0.5 ml or nothing). The probability of winning was conveyed using explicit visual cues (sector stimuli). Choices between the gambles revealed that the monkeys used the explicit probability information to make meaningful decisions. Using these cues, we measured probability distortion from choices between the gambles and safe rewards. Parametric modeling of the choices revealed classic probability weighting functions with inverted-S shape. Therefore, the animals overweighted low probability rewards and underweighted high probability rewards. Empirical investigation of the behavior verified that the choices were best explained by a combination of nonlinear value and nonlinear probability distortion. Together, these results suggest that probability distortion may reflect evolutionarily preserved neuronal processing. Copyright © 2015 Stauffer et al.

Neural bases of human mate choice: multiple value dimensions, sex difference, and self-assessment system.

PubMed

Funayama, Risa; Sugiura, Motoaki; Sassa, Yuko; Jeong, Hyeonjeong; Wakusawa, Keisuke; Horie, Kaoru; Sato, Shigeru; Kawashima, Ryuta

2012-01-01

Mate choice is an example of sophisticated daily decision making supported by multiple componential processes. In mate-choice literature, different characteristics of the value dimensions, including the sex difference in the value dimensions, and the involvement of self-assessment due to the mutual nature of the choice, have been suggested. We examined whether the brain-activation pattern during virtual mate choice would be congruent with these characteristics in terms of stimulus selectivity and activated brain regions. In measuring brain activity, young men and women were shown two pictures of either faces or behaviors, and they indicated which person they would choose either as a spouse or as a friend. Activation selective to spouse choice was observed face-selectively in men's amygdala and behavior-selectively in women's motor system. During both partner-choice conditions, behavior-selective activation was observed in the temporoparietal regions. Taking the available knowledge of these regions into account, these results are congruent with the suggested characteristics of value dimensions for physical attractiveness, parenting resources, and beneficial personality traits for a long-lasting relationship, respectively. The medial prefrontal and posterior cingulate cortices were nonselectively activated during the partner choices, suggesting the involvement of a self-assessment process. The results thus provide neuroscientific support for the multi-component mate-choice mechanism.

Development of a translational model to screen medications for cocaine use disorder II: Choice between intravenous cocaine and money in humans

PubMed Central

Lile, Joshua A.; Stoops, William W.; Rush, Craig R.; Negus, S. Stevens; Glaser, Paul E. A.; Hatton, Kevin W.; Hays, Lon R.

2016-01-01

Background A medication for treating cocaine use disorder has yet to be approved. Laboratory-based evaluation of candidate medications in animals and humans is a valuable means to demonstrate safety, tolerability and initial efficacy of potential medications. However, animal-to-human translation has been hampered by a lack of coordination. Therefore, we designed homologous cocaine self-administration studies in rhesus monkeys (see companion article) and human subjects in an attempt to develop linked, functionally equivalent procedures for research on candidate medications for cocaine use disorder. Methods Eight (N=8) subjects with cocaine use disorder completed 12 experimental sessions in which they responded to receive money ($0.01, $1.00 and $3.00) or intravenous cocaine (0, 3, 10 and 30 mg/70 kg) under independent, concurrent progressive-ratio schedules. Prior to the completion of 9 choice trials, subjects sampled the cocaine dose available during that session and were informed of the monetary alternative value. Results The allocation of behavior varied systematically as a function of cocaine dose and money value. Moreover, a similar pattern of cocaine choice was demonstrated in rhesus monkeys and humans across different cocaine doses and magnitudes of the species-specific alternative reinforcers. The subjective and cardiovascular responses to IV cocaine were an orderly function of dose, although heart rate and blood pressure remained within safe limits. Conclusions These coordinated studies successfully established drug vs. non-drug choice procedures in humans and rhesus monkeys that yielded similar cocaine choice behavior across species. This translational research platform will be used in future research to enhance the efficiency of developing interventions to reduce cocaine use. PMID:27269368

Development of a translational model to screen medications for cocaine use disorder II: Choice between intravenous cocaine and money in humans.

PubMed

Lile, Joshua A; Stoops, William W; Rush, Craig R; Negus, S Stevens; Glaser, Paul E A; Hatton, Kevin W; Hays, Lon R

2016-08-01

A medication for treating cocaine use disorder has yet to be approved. Laboratory-based evaluation of candidate medications in animals and humans is a valuable means to demonstrate safety, tolerability and initial efficacy of potential medications. However, animal-to-human translation has been hampered by a lack of coordination. Therefore, we designed homologous cocaine self-administration studies in rhesus monkeys (see companion article) and human subjects in an attempt to develop linked, functionally equivalent procedures for research on candidate medications for cocaine use disorder. Eight (N=8) subjects with cocaine use disorder completed 12 experimental sessions in which they responded to receive money ($0.01, $1.00 and $3.00) or intravenous cocaine (0, 3, 10 and 30mg/70kg) under independent, concurrent progressive-ratio schedules. Prior to the completion of 9 choice trials, subjects sampled the cocaine dose available during that session and were informed of the monetary alternative value. The allocation of behavior varied systematically as a function of cocaine dose and money value. Moreover, a similar pattern of cocaine choice was demonstrated in rhesus monkeys and humans across different cocaine doses and magnitudes of the species-specific alternative reinforcers. The subjective and cardiovascular responses to IV cocaine were an orderly function of dose, although heart rate and blood pressure remained within safe limits. These coordinated studies successfully established drug versus non-drug choice procedures in humans and rhesus monkeys that yielded similar cocaine choice behavior across species. This translational research platform will be used in future research to enhance the efficiency of developing interventions to reduce cocaine use. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Parallel Representation of Value-Based and Finite State-Based Strategies in the Ventral and Dorsal Striatum

PubMed Central

Ito, Makoto; Doya, Kenji

2015-01-01

Previous theoretical studies of animal and human behavioral learning have focused on the dichotomy of the value-based strategy using action value functions to predict rewards and the model-based strategy using internal models to predict environmental states. However, animals and humans often take simple procedural behaviors, such as the “win-stay, lose-switch” strategy without explicit prediction of rewards or states. Here we consider another strategy, the finite state-based strategy, in which a subject selects an action depending on its discrete internal state and updates the state depending on the action chosen and the reward outcome. By analyzing choice behavior of rats in a free-choice task, we found that the finite state-based strategy fitted their behavioral choices more accurately than value-based and model-based strategies did. When fitted models were run autonomously with the same task, only the finite state-based strategy could reproduce the key feature of choice sequences. Analyses of neural activity recorded from the dorsolateral striatum (DLS), the dorsomedial striatum (DMS), and the ventral striatum (VS) identified significant fractions of neurons in all three subareas for which activities were correlated with individual states of the finite state-based strategy. The signal of internal states at the time of choice was found in DMS, and for clusters of states was found in VS. In addition, action values and state values of the value-based strategy were encoded in DMS and VS, respectively. These results suggest that both the value-based strategy and the finite state-based strategy are implemented in the striatum. PMID:26529522

Effects of income on drug choice in humans.

PubMed Central

DeGrandpre, R J; Bickel, W K; Rizvi, S A; Hughes, J R

1993-01-01

The effects of income (money available to spend during the experimental session) on human choice were examined in a concurrent-schedule arrangement. Subjects were 7 nicotine-dependent smokers, and reinforcers were puffs on the subject's usual brand of cigarette ("own") and puffs on a less preferred brand of cigarette with equal nicotine content ("other"). Across sessions, income varied and the price of the two reinforcers was held constant, with the other puffs one fifth the price of the own puffs. As income increased, consumption of own puffs increased while consumption of the less expensive other puffs decreased. These effects of income on choice were highly consistent across subjects. For some subjects, however, income had little effect on total puff consumption. Finally, an additional condition examined whether price and income manipulations would have functionally equivalent effects on choice by repeating an income condition in which the price of the other brand was increased. Although the increased price of the other puffs decreased their consumption in 4 subjects, 2 subjects showed increased consumption of the other puffs at the higher price. The results, when defined in economic terms, indicate that the own puffs were a normal good (consumption and income are directly related), the other puffs were an inferior good (consumption and income are inversely related), and the direct relationship between consumption of the other puffs and their price is defined as a Giffengood effect. The latter result also suggests that for these 2 subjects, price and income manipulations had equivalent effects on choice. These results extend findings from previous studies that have examined the effects of income on choice responding to human subjects and drug reinforcers, and provide a framework for further experimental tests of the effects of income on human choice behavior. Methodological and theoretical implications for the study of choice and for behavioral pharmacology are discussed. PMID:8315366

Neural Basis of Strategic Decision Making

PubMed Central

Lee, Daeyeol; Seo, Hyojung

2015-01-01

Human choice behaviors during social interactions often deviate from the predictions of game theory. This might arise partly from the limitations in cognitive abilities necessary for recursive reasoning about the behaviors of others. In addition, during iterative social interactions, choices might change dynamically, as knowledge about the intentions of others and estimates for choice outcomes are incrementally updated via reinforcement learning. Some of the brain circuits utilized during social decision making might be general-purpose and contribute to isomorphic individual and social decision making. By contrast, regions in the medial prefrontal cortex and temporal parietal junction might be recruited for cognitive processes unique to social decision making. PMID:26688301

Recursive Rational Choice.

DTIC Science & Technology

1981-11-01

that a decision entity acted as though it were making rational choices among a set of alternatives, as a not unreason- able paradigm of human behavior...Gottinger l / , which, like Kramer’s approach, consider the item of rationality in decision making for social decision rules as representable by finite...1974] in the consideration of whether or not a decisive choice function that is regular rational in the sense of Richter [19711 when defined on subsets

When Brain Beats Behavior: Neuroforecasting Crowdfunding Outcomes.

PubMed

Genevsky, Alexander; Yoon, Carolyn; Knutson, Brian

2017-09-06

Although traditional economic and psychological theories imply that individual choice best scales to aggregate choice, primary components of choice reflected in neural activity may support even more generalizable forecasts. Crowdfunding represents a significant and growing platform for funding new and unique projects, causes, and products. To test whether neural activity could forecast market-level crowdfunding outcomes weeks later, 30 human subjects (14 female) decided whether to fund proposed projects described on an Internet crowdfunding website while undergoing scanning with functional magnetic resonance imaging. Although activity in both the nucleus accumbens (NAcc) and medial prefrontal cortex predicted individual choices to fund on a trial-to-trial basis in the neuroimaging sample, only NAcc activity generalized to forecast market funding outcomes weeks later on the Internet. Behavioral measures from the neuroimaging sample, however, did not forecast market funding outcomes. This pattern of associations was replicated in a second study. These findings demonstrate that a subset of the neural predictors of individual choice can generalize to forecast market-level crowdfunding outcomes-even better than choice itself. SIGNIFICANCE STATEMENT Forecasting aggregate behavior with individual neural data has proven elusive; even when successful, neural forecasts have not historically supplanted behavioral forecasts. In the current research, we find that neural responses can forecast market-level choice and outperform behavioral measures in a novel Internet crowdfunding context. Targeted as well as model-free analyses convergently indicated that nucleus accumbens activity can support aggregate forecasts. Beyond providing initial evidence for neuropsychological processes implicated in crowdfunding choices, these findings highlight the ability of neural features to forecast aggregate choice, which could inform applications relevant to business and policy. Copyright © 2017 Genevsky et al.

Utility of preclinical drug versus food choice procedures to evaluate candidate medications for methamphetamine use disorder.

PubMed

Banks, Matthew L

2017-04-01

Substance use disorders are diagnosed as a manifestation of inappropriate behavioral allocation toward abused drugs and away from other behaviors maintained by more adaptive nondrug reinforcers (e.g., money and social relationships). Substance use disorder treatment goals include not only decreasing drug-maintained behavior but also promoting behavioral reallocation toward these socially adaptive alternative reinforcers. Preclinical drug self-administration procedures that offer concurrent access to both drug and nondrug reinforcers provide a translationally relevant dependent measure of behavioral allocation that may be useful for candidate medication evaluation. In contrast to other abused drugs, such as heroin or cocaine, preclinical methamphetamine versus food choice procedures have been a more recent development. We hypothesize that preclinical to clinical translatability would be improved by the evaluation of repeated pharmacological treatment effects on methamphetamine self-administration under a methamphetamine versus food choice procedure. In support of this hypothesis, a literature review suggests strong concordance between preclinical pharmacological treatment effects on methamphetamine versus food choice in nonhuman primates and clinical medication treatment effects on methamphetamine self-administration in human laboratory studies or methamphetamine abuse metrics in clinical trials. In conclusion, this literature suggests preclinical methamphetamine versus food choice procedures may be useful in developing innovative pharmacotherapies for methamphetamine use disorder. © 2016 New York Academy of Sciences.

Utility of preclinical drug versus food choice procedures to evaluate candidate medications for methamphetamine use disorder

PubMed Central

Banks, Matthew L.

2016-01-01

Substance use disorders are diagnosed as a manifestation of inappropriate behavioral allocation towards abused drugs and away from other behaviors maintained by more adaptive nondrug reinforcers (e.g., work and social relationships). Substance use disorder treatment goals include not only decreasing drug-maintained behavior but also promoting behavioral reallocation toward these socially adaptive alternative reinforcers. Preclinical drug self-administration procedures that offer concurrent access to both drug and nondrug reinforcers provide a translationally relevant dependent measure of behavioral allocation that may be useful for candidate medication evaluation. In contrast to other abused drugs, such as heroin or cocaine, preclinical methamphetamine versus food choice procedures have been a more recent development. We hypothesize that preclinical to clinical translatability would be improved by the evaluation of repeated pharmacological treatment effects on methamphetamine self-administration under a methamphetamine versus food choice procedure. In support of this hypothesis, a literature review suggests strong concordance between preclinical pharmacological treatment effects on methamphetamine versus food choice in nonhuman primates and clinical medication treatment effects on methamphetamine self-administration in human laboratory studies or methamphetamine abuse metrics in clinical trials. In conclusion, this literature suggests preclinical methamphetamine versus food choice procedures may be useful in developing innovative pharmacotherapies for methamphetamine use disorder. PMID:27936284

Brain, emotion and decision making: the paradigmatic example of regret.

PubMed

Coricelli, Giorgio; Dolan, Raymond J; Sirigu, Angela

2007-06-01

Human decisions cannot be explained solely by rational imperatives but are strongly influenced by emotion. Theoretical and behavioral studies provide a sound empirical basis to the impact of the emotion of regret in guiding choice behavior. Recent neuropsychological and neuroimaging data have stressed the fundamental role of the orbitofrontal cortex in mediating the experience of regret. Functional magnetic resonance imaging data indicate that reactivation of activity within the orbitofrontal cortex and amygdala occurring during the phase of choice, when the brain is anticipating possible future consequences of decisions, characterizes the anticipation of regret. In turn, these patterns reflect learning based on cumulative emotional experience. Moreover, affective consequences can induce specific mechanisms of cognitive control of the choice processes, involving reinforcement or avoidance of the experienced behavior.

Evidence against integration of spatial maps in humans.

PubMed

Sturz, Bradley R; Bodily, Kent D; Katz, Jeffrey S

2006-07-01

A dynamic 3-D virtual environment was constructed for humans as an open-field analogue of Blaisdell and Cook's (2005) pigeon foraging task to determine if humans, like pigeons, were capable of integrating separate spatial maps. Participants used keyboard keys and a mouse to search for a hidden goal in a 4x4 grid of raised cups. During Phase 1 training, a goal was consistently located between two landmarks (Map 1: blue T and red L). During Phase 2 training, a goal was consistently located down and left of a single landmark (Map 2: blue T). Transfer trials were then conducted in which participants were required to make choices in the presence of the red L alone. Cup choices during transfer assessed participants' strategies: association (from Map 1), generalization (from Map 2), or integration (combining Map 1 and 2). During transfer, cup choices increased to a location which suggested an integration strategy and was consistent with results obtained with pigeons. However, additional analyses of the human data suggested participants initially used a generalization strategy followed by a progressive shift in search behavior away from the red L. This shift in search behavior during transfer was responsible for the changes in cup choices across transfer trials and was confirmed by a control condition. These new analyses offer an alternative explanation to the spatial integration account proposed for pigeons.

Discrimination of Complex Human Behavior by Pigeons (Columba livia) and Humans

PubMed Central

Qadri, Muhammad A. J.; Sayde, Justin M.; Cook, Robert G.

2014-01-01

The cognitive and neural mechanisms for recognizing and categorizing behavior are not well understood in non-human animals. In the current experiments, pigeons and humans learned to categorize two non-repeating, complex human behaviors (“martial arts” vs. “Indian dance”). Using multiple video exemplars of a digital human model, pigeons discriminated these behaviors in a go/no-go task and humans in a choice task. Experiment 1 found that pigeons already experienced with discriminating the locomotive actions of digital animals acquired the discrimination more rapidly when action information was available than when only pose information was available. Experiments 2 and 3 found this same dynamic superiority effect with naïve pigeons and human participants. Both species used the same combination of immediately available static pose information and more slowly perceived dynamic action cues to discriminate the behavioral categories. Theories based on generalized visual mechanisms, as opposed to embodied, species-specific action networks, offer a parsimonious account of how these different animals recognize behavior across and within species. PMID:25379777

The Nature of Belief-Directed Exploratory Choice in Human Decision-Making

PubMed Central

Knox, W. Bradley; Otto, A. Ross; Stone, Peter; Love, Bradley C.

2011-01-01

In non-stationary environments, there is a conflict between exploiting currently favored options and gaining information by exploring lesser-known options that in the past have proven less rewarding. Optimal decision-making in such tasks requires considering future states of the environment (i.e., planning) and properly updating beliefs about the state of the environment after observing outcomes associated with choices. Optimal belief-updating is reflective in that beliefs can change without directly observing environmental change. For example, after 10 s elapse, one might correctly believe that a traffic light last observed to be red is now more likely to be green. To understand human decision-making when rewards associated with choice options change over time, we develop a variant of the classic “bandit” task that is both rich enough to encompass relevant phenomena and sufficiently tractable to allow for ideal actor analysis of sequential choice behavior. We evaluate whether people update beliefs about the state of environment in a reflexive (i.e., only in response to observed changes in reward structure) or reflective manner. In contrast to purely “random” accounts of exploratory behavior, model-based analyses of the subjects’ choices and latencies indicate that people are reflective belief updaters. However, unlike the Ideal Actor model, our analyses indicate that people’s choice behavior does not reflect consideration of future environmental states. Thus, although people update beliefs in a reflective manner consistent with the Ideal Actor, they do not engage in optimal long-term planning, but instead myopically choose the option on every trial that is believed to have the highest immediate payoff. PMID:22319503

Behavioral modeling of human choices reveals dissociable effects of physical effort and temporal delay on reward devaluation.

PubMed

Klein-Flügge, Miriam C; Kennerley, Steven W; Saraiva, Ana C; Penny, Will D; Bestmann, Sven

2015-03-01

There has been considerable interest from the fields of biology, economics, psychology, and ecology about how decision costs decrease the value of rewarding outcomes. For example, formal descriptions of how reward value changes with increasing temporal delays allow for quantifying individual decision preferences, as in animal species populating different habitats, or normal and clinical human populations. Strikingly, it remains largely unclear how humans evaluate rewards when these are tied to energetic costs, despite the surge of interest in the neural basis of effort-guided decision-making and the prevalence of disorders showing a diminished willingness to exert effort (e.g., depression). One common assumption is that effort discounts reward in a similar way to delay. Here we challenge this assumption by formally comparing competing hypotheses about effort and delay discounting. We used a design specifically optimized to compare discounting behavior for both effort and delay over a wide range of decision costs (Experiment 1). We then additionally characterized the profile of effort discounting free of model assumptions (Experiment 2). Contrary to previous reports, in both experiments effort costs devalued reward in a manner opposite to delay, with small devaluations for lower efforts, and progressively larger devaluations for higher effort-levels (concave shape). Bayesian model comparison confirmed that delay-choices were best predicted by a hyperbolic model, with the largest reward devaluations occurring at shorter delays. In contrast, an altogether different relationship was observed for effort-choices, which were best described by a model of inverse sigmoidal shape that is initially concave. Our results provide a novel characterization of human effort discounting behavior and its first dissociation from delay discounting. This enables accurate modelling of cost-benefit decisions, a prerequisite for the investigation of the neural underpinnings of effort-guided choice and for understanding the deficits in clinical disorders characterized by behavioral inactivity.

Behavioral Modeling of Human Choices Reveals Dissociable Effects of Physical Effort and Temporal Delay on Reward Devaluation

PubMed Central

Klein-Flügge, Miriam C.; Kennerley, Steven W.; Saraiva, Ana C.; Penny, Will D.; Bestmann, Sven

2015-01-01

There has been considerable interest from the fields of biology, economics, psychology, and ecology about how decision costs decrease the value of rewarding outcomes. For example, formal descriptions of how reward value changes with increasing temporal delays allow for quantifying individual decision preferences, as in animal species populating different habitats, or normal and clinical human populations. Strikingly, it remains largely unclear how humans evaluate rewards when these are tied to energetic costs, despite the surge of interest in the neural basis of effort-guided decision-making and the prevalence of disorders showing a diminished willingness to exert effort (e.g., depression). One common assumption is that effort discounts reward in a similar way to delay. Here we challenge this assumption by formally comparing competing hypotheses about effort and delay discounting. We used a design specifically optimized to compare discounting behavior for both effort and delay over a wide range of decision costs (Experiment 1). We then additionally characterized the profile of effort discounting free of model assumptions (Experiment 2). Contrary to previous reports, in both experiments effort costs devalued reward in a manner opposite to delay, with small devaluations for lower efforts, and progressively larger devaluations for higher effort-levels (concave shape). Bayesian model comparison confirmed that delay-choices were best predicted by a hyperbolic model, with the largest reward devaluations occurring at shorter delays. In contrast, an altogether different relationship was observed for effort-choices, which were best described by a model of inverse sigmoidal shape that is initially concave. Our results provide a novel characterization of human effort discounting behavior and its first dissociation from delay discounting. This enables accurate modelling of cost-benefit decisions, a prerequisite for the investigation of the neural underpinnings of effort-guided choice and for understanding the deficits in clinical disorders characterized by behavioral inactivity. PMID:25816114

Decision processes in choice overload: a product of delay and probability discounting?

PubMed

Kaplan, Brent A; Reed, Derek D

2013-07-01

Recent research in the behavioral decision making literature has demonstrated that humans hyperbolically discount the subjective value of options as the number of options increases (Reed et al., 2012). These findings provide a cognitive-behavioral synthesis of the "choice overload" phenomenon, also known as the "paradox of choice." Specifically, these findings suggest that temporal discounting may serve as the underlying process contributing to this effect. As an extension, this study examined the effects of reward magnitude sizes had on rates temporal and options discounting. This manipulation was conducted to determine what role temporal discounting plays in discounting of options. The present results suggest that temporal discounting may not be the only process contributing to the choice overload effect. Copyright © 2013 Elsevier B.V. All rights reserved.

Meat morals: relationship between meat consumption consumer attitudes towards human and animal welfare and moral behavior.

PubMed

De Backer, Charlotte J S; Hudders, Liselot

2015-01-01

The aim of this work is to explore the relation between morality and diet choice by investigating how animal and human welfare attitudes and donation behaviors can predict a meat eating versus flexitarian versus vegetarian diet. The results of a survey study (N=299) show that animal health concerns (measured by the Animal Attitude Scale) can predict diet choice. Vegetarians are most concerned, while full-time meat eaters are least concerned, and the contrast between flexitarians and vegetarians is greater than the contrast between flexitarians and full-time meat eaters. With regards to human welfare (measured by the Moral Foundations Questionnaire), results show that attitudes towards human suffering set flexitarians apart from vegetarians and attitudes towards authority and respect distinguish between flexitarians and meat eaters. To conclude, results show that vegetarians donate more often to animal oriented charities than flexitarians and meat eaters, while no differences between the three diet groups occur for donations to human oriented charities. Copyright © 2014 Elsevier Ltd. All rights reserved.

The effects of a time-based intervention on experienced middle-aged rats

PubMed Central

Peterson, Jennifer R.; Kirkpatrick, Kimberly

2016-01-01

Impulsive behavior is a common symptom in Attention Deficit Hyperactivity Disorder, schizophrenia, drug abuse, smoking, obesity and compulsive gambling. Stable levels of impulsive choice have been found in humans and rats and a recent study reported significant test-retest reliability of impulsive choice behavior after 1 and 5 months in rats. Time-based behavioral interventions have been successful in decreasing impulsive choices. These interventions led to improvements in the ability to time and respond more appropriately to adventitious choices. The current study examined the use of a time-based intervention in experienced, middle-aged rats. This intervention utilized a variable interval schedule previously found to be successful in improving timing and decreasing impulsive choice. This study found that the intervention led to a decrease in impulsive choices and there was a significant correlation between the improvement in self-control and post-intervention temporal precision in middle-aged rats. Although there were no overall group difference in bisection performance, individual differences were observed, suggesting an improvement in timing. This is an important contribution to the field because previous studies have utilized only young rats and because previous research indicates a decrease in general timing abilities with age. PMID:27826006

Glucocorticoid Regulation of Food-Choice Behavior in Humans: Evidence from Cushing's Syndrome

PubMed Central

Moeller, Scott J.; Couto, Lizette; Cohen, Vanessa; Lalazar, Yelena; Makotkine, Iouri; Williams, Nia; Yehuda, Rachel; Goldstein, Rita Z.; Geer, Eliza B.

2016-01-01

The mechanisms by which glucocorticoids regulate food intake and resulting body mass in humans are not well-understood. One potential mechanism could involve modulation of reward processing, but human stress models examining effects of glucocorticoids on behavior contain important confounds. Here, we studied individuals with Cushing's syndrome, a rare endocrine disorder characterized by chronic excess endogenous glucocorticoids. Twenty-three patients with Cushing's syndrome (13 with active disease; 10 with disease in remission) and 15 controls with a comparably high body mass index (BMI) completed two simulated food-choice tasks (one with “explicit” task contingencies and one with “probabilistic” task contingencies), during which they indicated their objective preference for viewing high calorie food images vs. standardized pleasant, unpleasant, and neutral images. All participants also completed measures of food craving, and approximately half of the participants provided 24-h urine samples for assessment of cortisol and cortisone concentrations. Results showed that on the explicit task (but not the probabilistic task), participants with active Cushing's syndrome made fewer food-related choices than participants with Cushing's syndrome in remission, who in turn made fewer food-related choices than overweight controls. Corroborating this group effect, higher urine cortisone was negatively correlated with food-related choice in the subsample of all participants for whom these data were available. On the probabilistic task, despite a lack of group differences, higher food-related choice correlated with higher state and trait food craving in active Cushing's patients. Taken together, relative to overweight controls, Cushing's patients, particularly those with active disease, displayed a reduced vigor of responding for food rewards that was presumably attributable to glucocorticoid abnormalities. Beyond Cushing's, these results may have relevance for elucidating glucocorticoid contributions to food-seeking behavior, enhancing mechanistic understanding of weight fluctuations associated with oral glucocorticoid therapy and/or chronic stress, and informing the neurobiology of neuropsychiatric conditions marked by abnormal cortisol dynamics (e.g., major depression, Alzheimer's disease). PMID:26903790

Glucocorticoid Regulation of Food-Choice Behavior in Humans: Evidence from Cushing's Syndrome.

PubMed

Moeller, Scott J; Couto, Lizette; Cohen, Vanessa; Lalazar, Yelena; Makotkine, Iouri; Williams, Nia; Yehuda, Rachel; Goldstein, Rita Z; Geer, Eliza B

2016-01-01

The mechanisms by which glucocorticoids regulate food intake and resulting body mass in humans are not well-understood. One potential mechanism could involve modulation of reward processing, but human stress models examining effects of glucocorticoids on behavior contain important confounds. Here, we studied individuals with Cushing's syndrome, a rare endocrine disorder characterized by chronic excess endogenous glucocorticoids. Twenty-three patients with Cushing's syndrome (13 with active disease; 10 with disease in remission) and 15 controls with a comparably high body mass index (BMI) completed two simulated food-choice tasks (one with "explicit" task contingencies and one with "probabilistic" task contingencies), during which they indicated their objective preference for viewing high calorie food images vs. standardized pleasant, unpleasant, and neutral images. All participants also completed measures of food craving, and approximately half of the participants provided 24-h urine samples for assessment of cortisol and cortisone concentrations. Results showed that on the explicit task (but not the probabilistic task), participants with active Cushing's syndrome made fewer food-related choices than participants with Cushing's syndrome in remission, who in turn made fewer food-related choices than overweight controls. Corroborating this group effect, higher urine cortisone was negatively correlated with food-related choice in the subsample of all participants for whom these data were available. On the probabilistic task, despite a lack of group differences, higher food-related choice correlated with higher state and trait food craving in active Cushing's patients. Taken together, relative to overweight controls, Cushing's patients, particularly those with active disease, displayed a reduced vigor of responding for food rewards that was presumably attributable to glucocorticoid abnormalities. Beyond Cushing's, these results may have relevance for elucidating glucocorticoid contributions to food-seeking behavior, enhancing mechanistic understanding of weight fluctuations associated with oral glucocorticoid therapy and/or chronic stress, and informing the neurobiology of neuropsychiatric conditions marked by abnormal cortisol dynamics (e.g., major depression, Alzheimer's disease).

Applying Social Psychological Models to Predicting HIV-Related Sexual Risk Behaviors Among African Americans

PubMed Central

Cochran, Susan D.; Mays, Vickie M.

2011-01-01

Existing models of attitude-behavior relationships, including the Health Belief Model, the Theory of Reasoned Action, and the Self-Efficacy Theory, are increasingly being used by psychologists to predict human immunodeficiency virus (HIV)-related risk behaviors. The authors briefly highlight some of the difficulties that might arise in applying these models to predicting the risk behaviors of African Americans. These social psychological models tend to emphasize the importance of individualistic, direct control of behavioral choices and deemphasize factors, such as racism and poverty, particularly relevant to that segment of the African American population most at risk for HIV infection. Applications of these models without taking into account the unique issues associated with behavioral choices within the African American community may fail to capture the relevant determinants of risk behaviors. PMID:23529205

Neural Basis of Strategic Decision Making.

PubMed

Lee, Daeyeol; Seo, Hyojung

2016-01-01

Human choice behaviors during social interactions often deviate from the predictions of game theory. This might arise partly from the limitations in the cognitive abilities necessary for recursive reasoning about the behaviors of others. In addition, during iterative social interactions, choices might change dynamically as knowledge about the intentions of others and estimates for choice outcomes are incrementally updated via reinforcement learning. Some of the brain circuits utilized during social decision making might be general-purpose and contribute to isomorphic individual and social decision making. By contrast, regions in the medial prefrontal cortex (mPFC) and temporal parietal junction (TPJ) might be recruited for cognitive processes unique to social decision making. Copyright © 2015 Elsevier Ltd. All rights reserved.

Alterations in choice behavior by manipulations of world model

PubMed Central

Green, C. S.; Benson, C.; Kersten, D.; Schrater, P.

2010-01-01

How to compute initially unknown reward values makes up one of the key problems in reinforcement learning theory, with two basic approaches being used. Model-free algorithms rely on the accumulation of substantial amounts of experience to compute the value of actions, whereas in model-based learning, the agent seeks to learn the generative process for outcomes from which the value of actions can be predicted. Here we show that (i) “probability matching”—a consistent example of suboptimal choice behavior seen in humans—occurs in an optimal Bayesian model-based learner using a max decision rule that is initialized with ecologically plausible, but incorrect beliefs about the generative process for outcomes and (ii) human behavior can be strongly and predictably altered by the presence of cues suggestive of various generative processes, despite statistically identical outcome generation. These results suggest human decision making is rational and model based and not consistent with model-free learning. PMID:20805507

Accommodating complexity and human behaviors in decision analysis.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Backus, George A.; Siirola, John Daniel; Schoenwald, David Alan

2007-11-01

This is the final report for a LDRD effort to address human behavior in decision support systems. One sister LDRD effort reports the extension of this work to include actual human choices and additional simulation analyses. Another provides the background for this effort and the programmatic directions for future work. This specific effort considered the feasibility of five aspects of model development required for analysis viability. To avoid the use of classified information, healthcare decisions and the system embedding them became the illustrative example for assessment.

Hemispheric dissociation of reward processing in humans: insights from deep brain stimulation.

PubMed

Palminteri, Stefano; Serra, Giulia; Buot, Anne; Schmidt, Liane; Welter, Marie-Laure; Pessiglione, Mathias

2013-01-01

Rewards have various effects on human behavior and multiple representations in the human brain. Behaviorally, rewards notably enhance response vigor in incentive motivation paradigms and bias subsequent choices in instrumental learning paradigms. Neurally, rewards affect activity in different fronto-striatal regions attached to different motor effectors, for instance in left and right hemispheres for the two hands. Here we address the question of whether manipulating reward-related brain activity has local or general effects, with respect to behavioral paradigms and motor effectors. Neuronal activity was manipulated in a single hemisphere using unilateral deep brain stimulation (DBS) in patients with Parkinson's disease. Results suggest that DBS amplifies the representation of reward magnitude within the targeted hemisphere, so as to affect the behavior of the contralateral hand specifically. These unilateral DBS effects on behavior include both boosting incentive motivation and biasing instrumental choices. Furthermore, using computational modeling we show that DBS effects on incentive motivation can predict DBS effects on instrumental learning (or vice versa). Thus, we demonstrate the feasibility of causally manipulating reward-related neuronal activity in humans, in a manner that is specific to a class of motor effectors but that generalizes to different computational processes. As these findings proved independent from therapeutic effects on parkinsonian motor symptoms, they might provide insight into DBS impact on non-motor disorders, such as apathy or hypomania. Copyright © 2013 Elsevier Ltd. All rights reserved.

Making Good Choices: How Autonomy Support Influences the Behavior Change and Motivation of Troubled and Troubling Youth

ERIC Educational Resources Information Center

Harper, Elaine

2007-01-01

Autonomy is a basic human need having influence on motivation. Facilitating student autonomy is an essential ingredient of effective programs for maximizing internalized change and increasing motivation in troubled and troubling youth. This article examines the theoretical concepts of autonomy and control related to choices and considers their…

The effect of reinforcer magnitude on probability and delay discounting of experienced outcomes in a computer game task in humans.

PubMed

Greenhow, Anna K; Hunt, Maree J; Macaskill, Anne C; Harper, David N

2015-09-01

Delay and uncertainty of receipt both reduce the subjective value of reinforcers. Delay has a greater impact on the subjective value of smaller reinforcers than of larger ones while the reverse is true for uncertainty. We investigated the effect of reinforcer magnitude on discounting of delayed and uncertain reinforcers using a novel approach: embedding relevant choices within a computer game. Participants made repeated choices between smaller, certain, immediate outcomes and larger, but delayed or uncertain outcomes while experiencing the result of each choice. Participants' choices were generally well described by the hyperbolic discounting function. Smaller numbers of points were discounted more steeply than larger numbers as a function of delay but not probability. The novel experiential choice task described is a promising approach to investigating both delay and probability discounting in humans. © Society for the Experimental Analysis of Behavior.

Insights from Preclinical Choice Models on Treating Drug Addiction

PubMed Central

Banks, Matthew L.; Negus, S. Stevens

2016-01-01

Substance-use disorders are a global public health problem that arises from behavioral misallocation between drug use and more adaptive behaviors maintained by nondrug alternatives (e.g., food or money). Preclinical drug self-administration procedures that incorporate a concurrently available nondrug reinforcer (e.g., food) provide translationally relevant and distinct dependent measures of behavioral allocation (i.e., to assess the relative reinforcing efficacy of the drug) and behavioral rate (i.e., to assess motor competence). In particular, preclinical drug versus food ‘choice’ procedures have produced increasingly concordant results with both human laboratory drug self-administration studies and double-blind placebo-controlled clinical trials. Accordingly, here we provide a heuristic framework of substance-use disorders based on a behavioral-centric perspective and recent insights from these preclinical choice procedures. PMID:27916279

Generous economic investments after basolateral amygdala damage.

PubMed

van Honk, Jack; Eisenegger, Christoph; Terburg, David; Stein, Dan J; Morgan, Barak

2013-02-12

Contemporary economic models hold that instrumental and impulsive behaviors underlie human social decision making. The amygdala is assumed to be involved in social-economic behavior, but its role in human behavior is poorly understood. Rodent research suggests that the basolateral amygdala (BLA) subserves instrumental behaviors and regulates the central-medial amygdala, which subserves impulsive behaviors. The human amygdala, however, typically is investigated as a single unit. If these rodent data could be translated to humans, selective dysfunction of the human BLA might constrain instrumental social-economic decisions and result in more impulsive social-economic choice behavior. Here we show that humans with selective BLA damage and a functional central-medial amygdala invest nearly 100% more money in unfamiliar others in a trust game than do healthy controls. We furthermore show that this generosity is not caused by risk-taking deviations in nonsocial contexts. Moreover, these BLA-damaged subjects do not expect higher returns or perceive people as more trustworthy, implying that their generous investments are not instrumental in nature. These findings suggest that the human BLA is essential for instrumental behaviors in social-economic interactions.

Sex differences in impulsive action and impulsive choice.

PubMed

Weafer, Jessica; de Wit, Harriet

2014-11-01

Here, we review the evidence for sex differences in behavioral measures of impulsivity for both humans and laboratory animals. We focus on two specific components of impulsivity: impulsive action (i.e., difficulty inhibiting a prepotent response) and impulsive choice (i.e., difficulty delaying gratification). Sex differences appear to exist on these measures, but the direction and magnitude of the differences vary. In laboratory animals, impulsive action is typically greater in males than females, whereas impulsive choice is typically greater in females. In humans, women discount more steeply than men, but sex differences on measures of impulsive action depend on tasks and subject samples. We discuss implications of these findings as they relate to drug addiction. We also point out the major gaps in this research to date, including the lack of studies designed specifically to examine sex differences in behavioral impulsivity, and the lack of consideration of menstrual or estrous phase or sex hormone levels in the studies. © 2013.

Sex differences in impulsive action and impulsive choice

PubMed Central

Weafer, Jessica; de Wit, Harriet

2013-01-01

Here, we review the evidence for sex differences in behavioral measures of impulsivity for both humans and laboratory animals. We focus on two specific components of impulsivity: impulsive action (i.e., difficulty inhibiting a prepotent response) and impulsive choice (i.e., difficulty delaying gratification). Sex differences appear to exist on these measures, but the direction and magnitude of the differences vary. In laboratory animals, impulsive action is typically greater in males than females, whereas impulsive choice is typically greater in females. In humans, women discount more steeply than men, but sex differences on measures of impulsive action depend on tasks and subject samples. We discuss implications of these findings as they relate to drug addiction. We also point out the major gaps in this research to date, including the lack of studies designed specifically to examine sex differences in behavioral impulsivity, and the lack of consideration of menstrual or estrous phase or sex hormone levels in the studies. PMID:24286704

Understanding the Hows and Whys of Decision-Making: From Expected Utility to Divisive Normalization.

PubMed

Glimcher, Paul

2014-01-01

Over the course of the last century, economists and ethologists have built detailed models from first principles of how humans and animals should make decisions. Over the course of the last few decades, psychologists and behavioral economists have gathered a wealth of data at variance with the predictions of these economic models. This has led to the development of highly descriptive models that can often predict what choices people or animals will make but without offering any insight into why people make the choices that they do--especially when those choices reduce a decision-maker's well-being. Over the course of the last two decades, neurobiologists working with economists and psychologists have begun to use our growing understanding of how the nervous system works to develop new models of how the nervous system makes decisions. The result, a growing revolution at the interdisciplinary border of neuroscience, psychology, and economics, is a new field called Neuroeconomics. Emerging neuroeconomic models stand to revolutionize our understanding of human and animal choice behavior by combining fundamental properties of neurobiological representation with decision-theoretic analyses. In this overview, one class of these models, based on the widely observed neural computation known as divisive normalization, is presented in detail. The work demonstrates not only that a discrete class of computation widely observed in the nervous system is fundamentally ubiquitous, but how that computation shapes behaviors ranging from visual perception to financial decision-making. It also offers the hope of reconciling economic analysis of what choices we should make with psychological observations of the choices we actually do make. Copyright © 2014 Cold Spring Harbor Laboratory Press; all rights reserved.

Make the healthy choice the easy choice: using behavioral economics to advance a culture of health.

PubMed

Volpp, K G; Asch, D A

2017-05-01

Despite great advances in the science and technology of health care, a large gap separates theoretically achievable advances in health from what individuals and populations actually achieve. Human behavior sits on the final common pathway to so many of our health and health care goals, including the prevention and management of illness and the fostering of wellness. Behavioral economics is a relatively new field offering approaches to supplement many of the conventional approaches to improving health behaviors that rely on education or standard economic theory. While those conventional approaches presume that an educated public will naturally make decisions that optimize personal welfare, approaches derived from behavioral economics harness existing and predictable patterns of behavior that often lead people to make choices against their best interests. By keeping these predictable patterns of behavior in mind when designing health insurance, health care programs or the health-related aspects of everyday life, behavioral economists aim to meet people half-way: no longer asking them to reshape their behavior to something more health promoting, but helping the behavioral patterns they already follow lead them to better health. © The Author 2016. Published by Oxford University Press on behalf of the Association of Physicians. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

The Sociocognitive Determinates of HIV/AIDS Prevention Behaviors among Baby Boomers

ERIC Educational Resources Information Center

Haynes, Carion R.

2016-01-01

Human immunodeficiency virus (HIV) is steadily increasing among the baby boom population. Among this population, there is a gap between knowledge and behavioral choices. HIV risk perception is multifaceted and shaped by different sociodemographic factors. Baby boomers' perception of risk and sociocognitive determinates that impact their decision…

Human behavior research and the design of sustainable transport systems

NASA Astrophysics Data System (ADS)

Schauer, James J.

2011-09-01

Transport currently represents approximately 19% of the global energy demand and accounts for about 23% of the global carbon dioxide emissions (IEA 2009). As the demand for mobility is expected to continue to increase in the coming decades, the stabilization of atmospheric carbon dioxide levels will require the evolution of transport, along with power generation, building design and manufacturing. The continued development of these sectors will need to include changes in energy sources, energy delivery, materials, infrastructure and human behavior. Pathways to reducing carbon from the transport sector have unique challenges and opportunities that are inherent to the human choices and behavioral patterns that mold the transportation systems and the associated energy needs. Technology, government investment, and regulatory policies have a significant impact on the formulation of transportation infrastructure; however, the role of human behavior and public acceptance on the efficiency and effectiveness of transport systems should not be underestimated. Although developed, rapidly developing, and underdeveloped nations face different challenges in the establishment of transport infrastructure that can meet transport needs while achieving sustainable carbon dioxide emissions, the constraints that establish the domain of possibilities are closely related for all nations. These constraints include capital investment, fuel supplies, power systems, and human behavior. Throughout the world, there are considerable efforts directed at advancing and optimizing the financing of sustainable infrastructures, the production of low carbon fuels, and the production of advanced power systems, but the foundational work on methods to understand human preferences and behavior within the context of transport and the valuation of reductions in carbon dioxide emissions is greatly lagging behind. These methods and the associated understanding of human behavior and the willingness to pay for reduced carbon emissions are central to the design and optimization of future low carbon transport systems. Gaker et al (2011) suggest a framework, and provide insight into the willingness of transport consumers to pay for emission reductions of carbon dioxide from their personal transport choices within the context of other attributes of transport variables. The results of this study, although limited to a small demographic segment of the US population, demonstrate that people can integrate information on greenhouse gas emissions with other transport attributes including cost and time. Likewise, the research shows that the study group was willing to pay for reduction in greenhouse gas emissions associated with their transport choices. The study examined auto purchase choice, transport mode choice and transport route choice, which represent key decisions associated with transport that impact greenhouse gas emissions. Interestingly, they found that the study group was willing to pay for reductions in greenhouse gas emissions at a relatively consistent price across these transport choices. Clearly, the study results may not broadly apply to all demographics of users of transport, even in the study domain, due to the small demographic segment that was examined and the fact that the study was conducted in the laboratory. However, the methods used by Gaker et al (2011) are cause for optimism that future studies can obtain much needed mapping of transport preferences and willingness to pay for greenhouse gas emission reductions associated with personal transport choices. Although the Gaker et al (2011) study is directed at understanding the promotion of low carbon transport in the context of existing infrastructures, the ability of these studies to elucidate human behavior and preferences within the trade-offs of transport are critical to the design of future transport systems that seek to meet transport demand with constrained greenhouse gas emissions. Additional studies of this nature that examine broader demographic groups in real world conditions are greatly needed in different regions of the US and around the world. As interventions are sought to stabilize atmospheric carbon dioxide levels at levels that are expected to have limited climate impact, there is recognition that the mitigation strategies that will be implemented in the next 5-10 years will have a profound impact on the ability to constrain climate change. The evolution of the transport infrastructure over the next decade, which will provide intermodal opportunities and modal trade-offs, will be an important constraint in the ability of transport systems to reduce greenhouse gas emissions. Likewise, the evolution of the transport infrastructure over the next decade will have an equally profound impact on the ability of transport systems to meet society's expectations for transport in a cost effective and efficient manner. The ability to design and build transport infrastructures that can achieve maximum reductions in greenhouse gas emissions while satisfying the demand for transport by the society relies on the ability to understand the human behavior and human preferences for transport in the context of costs, time, time variability, safety and emission reductions. The study by Gaker et al (2011) is central to answering these questions and will hopefully serve as a conduit to motivate additional studies that examine broader segments of society in developed, rapidly developing, and underdeveloped nations to provide the human input needed to assure future transport systems that can meet greenhouse gas emission reduction targets and the transport needs of society. References Gaker D, Vautin D, Vij A and Walker J L 2011 The power and value of green in promoting sustainable transport behavior Environ. Res. Lett. 6 034010 IEA 2009 Transport, Energy and CO2: Moving Toward Sustainability (Paris: International Energy Agency) (available at www.iea.org/publications/free_new_Desc.asp?PUBS_ID=2133)

Free mate choice does not influence reproductive success in humans.

PubMed

Sorokowski, Piotr; Groyecka, Agata; Karwowski, Maciej; Manral, Upma; Kumar, Amit; Niemczyk, Agnieszka; Marczak, Michalina; Misiak, Michał; Sorokowska, Agnieszka; Huanca, Thomas; Conde, Esther; Wojciszke, Bogdan; Pawłowski, Bogusław

2017-08-31

The effect of free mate choice on the relative magnitude of fitness benefits has been examined among various species. The majority of the data show significant fitness benefits of mating with partners of an individual's own choice, highlighting elevated behavioral compatibility between partners with free mate choice. Similarities between humans and other species that benefit from free mate choice led us to hypothesize that it also confers reproductive benefits in Homo sapiens. To test this hypothesis, we conducted a study among three indigenous societies-the Tsimane', Yali, and Bhotiya-who employ natural birth control. In all three samples, we compared the marriages arranged by parents with the non-arranged ones in terms of number of offspring. Here, we show that there were no significant relationships between type of marriage and the total number of alive children and number of dead children among the three sampled groups. The presented study is the first to date to examine the fitness benefits of free mate choice in humans. In discussion we present limitations of our research and discuss the possibility of love having a beneficial influence in terms of the number of offspring.

Rethinking What Motivates and Inspires Students

ERIC Educational Resources Information Center

Bowman, Richard

2011-01-01

Drawing on four decades of scientific research on human motivation, contemporary behavioral scientists contend that exceptional educators provide students with a contextual sense of their intrinsic worth by creating academic environments that engage three overarching human needs: "autonomy," the freedom to make choices and determine one's future;…

Pathological choice: the neuroscience of gambling and gambling addiction.

PubMed

Clark, Luke; Averbeck, Bruno; Payer, Doris; Sescousse, Guillaume; Winstanley, Catharine A; Xue, Gui

2013-11-06

Gambling is pertinent to neuroscience research for at least two reasons. First, gambling is a naturalistic and pervasive example of risky decision making, and thus gambling games can provide a paradigm for the investigation of human choice behavior and "irrationality." Second, excessive gambling involvement (i.e., pathological gambling) is currently conceptualized as a behavioral addiction, and research on this condition may provide insights into addictive mechanisms in the absence of exogenous drug effects. This article is a summary of topics covered in a Society for Neuroscience minisymposium, focusing on recent advances in understanding the neural basis of gambling behavior, including translational findings in rodents and nonhuman primates, which have begun to delineate neural circuitry and neurochemistry involved.

Anterior Cingulate Engagement in a Foraging Context Reflects Choice Difficulty, Not Foraging Value

PubMed Central

Shenhav, Amitai; Straccia, Mark A.; Cohen, Jonathan D.; Botvinick, Matthew M.

2014-01-01

Previous theories predict that human dorsal anterior cingulate (dACC) should respond to decision difficulty. An alternative theory has been recently advanced which proposes that dACC evolved to represent the value of “non-default,” foraging behavior, calling into question its role in choice difficulty. However, this new theory does not take into account that choosing whether or not to pursue foraging-like behavior can also be more difficult than simply resorting to a “default.” The results of two neuroimaging experiments show that dACC is only associated with foraging value when foraging value is confounded with choice difficulty; when the two are dissociated, dACC engagement is only explained by choice difficulty, and not the value of foraging. In addition to refuting this new theory, our studies help to formalize a fundamental connection between choice difficulty and foraging-like decisions, while also prescribing a solution for a common pitfall in studies of reward-based decision making. PMID:25064851

Decision making: the neuroethological turn

PubMed Central

Pearson, John M.; Watson, Karli K.; Platt, Michael L.

2014-01-01

Neuroeconomics applies models from economics and psychology to inform neurobiological studies of choice. This approach has revealed neural signatures of concepts like value, risk, and ambiguity, which are known to influence decision-making. Such observations have led theorists to hypothesize a single, unified decision process that mediates choice behavior via a common neural currency for outcomes like food, money, or social praise. In parallel, recent neuroethological studies of decision-making have focused on natural behaviors like foraging, mate choice, and social interactions. These decisions strongly impact evolutionary fitness and thus are likely to have played a key role in shaping the neural circuits that mediate decision-making. This approach has revealed a suite of computational motifs that appear to be shared across a wide variety of organisms. We argue that the existence of deep homologies in the neural circuits mediating choice may have profound implications for understanding human decision-making in health and disease. PMID:24908481

Emergence of Relations and the Essence of Learning: A Review of Sidman's Equivalence Relations and Behavior: A Research Story

NASA Technical Reports Server (NTRS)

Rumbaugh, Duane M.

1995-01-01

Sidman addresses two very important questions in Equivalence Relations and Behavior: A Research Story: What are the bases of behavioral competence? And how do units of learning become related? The book recounts the story of how an understanding of emergent relations and competencies was achieved through studies in his teaching-research program with mentally retarded subjects. Although children normally accrue vast networks of relations between stimuli and events, those with mental retardation typically do not. Consequently, by learning how to establish those networks, Sidman and his students contribute richly both to the cultivation of competencies by their subjects and, more generally, to an understanding of real-world human behavior. The basic equivalence paradigm affords the subject feedback and reinforcement for very specific choices during training, but the test is not for those choices! Rather, tests for equivalence look for new choices, ones seemingly quite foreign to the training regimen. The tests for equivalence relations entail presentations of stimuli that were the options for conditional choice during reinforced training. In tests of equivalence, correct choices are novel; hence, they have never been reinforced during training. The study of equivalence relations can encourage the emergence of new perspectives that are more symbiotic than competitive. In full acknowledgment of the important role and contributions made by those who identify themselves as experimental analysts of behavior, it is timely that rapprochements be worked toward, as indeed they are, to meld that perspective with others of our time. Both our research methods and our expectations about the nature of the learning process and the abilities of our subjects can delimit what they might learn and what we, in turn, learn about their learning. The text will be of great value for instruction at the upper-division and graduate levels. Its impact will be substantial, for it defines an important advance in our efforts to understand the richness of behavior in both humans and nonhuman animals. Although not presented to that end, the book might also serve to bridge communications with other groups of animal researchers whose interests lie more in a comparative or ethological framework.

Dual Extended Kalman Filter for the Identification of Time-Varying Human Manual Control Behavior

NASA Technical Reports Server (NTRS)

Popovici, Alexandru; Zaal, Peter M. T.; Pool, Daan M.

2017-01-01

A Dual Extended Kalman Filter was implemented for the identification of time-varying human manual control behavior. Two filters that run concurrently were used, a state filter that estimates the equalization dynamics, and a parameter filter that estimates the neuromuscular parameters and time delay. Time-varying parameters were modeled as a random walk. The filter successfully estimated time-varying human control behavior in both simulated and experimental data. Simple guidelines are proposed for the tuning of the process and measurement covariance matrices and the initial parameter estimates. The tuning was performed on simulation data, and when applied on experimental data, only an increase in measurement process noise power was required in order for the filter to converge and estimate all parameters. A sensitivity analysis to initial parameter estimates showed that the filter is more sensitive to poor initial choices of neuromuscular parameters than equalization parameters, and bad choices for initial parameters can result in divergence, slow convergence, or parameter estimates that do not have a real physical interpretation. The promising results when applied to experimental data, together with its simple tuning and low dimension of the state-space, make the use of the Dual Extended Kalman Filter a viable option for identifying time-varying human control parameters in manual tracking tasks, which could be used in real-time human state monitoring and adaptive human-vehicle haptic interfaces.

DYT1 dystonia increases risk taking in humans.

PubMed

Arkadir, David; Radulescu, Angela; Raymond, Deborah; Lubarr, Naomi; Bressman, Susan B; Mazzoni, Pietro; Niv, Yael

2016-06-01

It has been difficult to link synaptic modification to overt behavioral changes. Rodent models of DYT1 dystonia, a motor disorder caused by a single gene mutation, demonstrate increased long-term potentiation and decreased long-term depression in corticostriatal synapses. Computationally, such asymmetric learning predicts risk taking in probabilistic tasks. Here we demonstrate abnormal risk taking in DYT1 dystonia patients, which is correlated with disease severity, thereby supporting striatal plasticity in shaping choice behavior in humans.

Stress Impairs Optimal Behavior in a Water Foraging Choice Task in Rats

ERIC Educational Resources Information Center

Graham, Lauren K.; Yoon, Taejib; Kim, Jeansok J.

2010-01-01

Stress is a biologically significant social-environmental factor that plays a pervasive role in influencing human and animal behaviors. While stress effects on various types of memory are well characterized, its effects on other cognitive functions are relatively unknown. Here, we investigated the effects of acute, uncontrollable stress on…

Contexts and Individual Differences as Influences on Consumers' Delay Discounting

ERIC Educational Resources Information Center

Foxall, Gordon R.; Doyle, John R.; Yani-de-Soriano, Mirella; Wells, Victoria K.

2011-01-01

Delay discounting is often considered a universal feature of human choice behavior, but there is controversy over whether it is an individual difference that reflects an underlying psychological trait or a domain-specific behavior. Trait influence on discounting would manifest in (a) highly correlated discount rates for all decisions, regardless…

Devaluation and sequential decisions: linking goal-directed and model-based behavior

PubMed Central

Friedel, Eva; Koch, Stefan P.; Wendt, Jean; Heinz, Andreas; Deserno, Lorenz; Schlagenhauf, Florian

2014-01-01

In experimental psychology different experiments have been developed to assess goal–directed as compared to habitual control over instrumental decisions. Similar to animal studies selective devaluation procedures have been used. More recently sequential decision-making tasks have been designed to assess the degree of goal-directed vs. habitual choice behavior in terms of an influential computational theory of model-based compared to model-free behavioral control. As recently suggested, different measurements are thought to reflect the same construct. Yet, there has been no attempt to directly assess the construct validity of these different measurements. In the present study, we used a devaluation paradigm and a sequential decision-making task to address this question of construct validity in a sample of 18 healthy male human participants. Correlational analysis revealed a positive association between model-based choices during sequential decisions and goal-directed behavior after devaluation suggesting a single framework underlying both operationalizations and speaking in favor of construct validity of both measurement approaches. Up to now, this has been merely assumed but never been directly tested in humans. PMID:25136310

State-Dependent Risk Preferences in Evolutionary Games

NASA Astrophysics Data System (ADS)

Roos, Patrick; Nau, Dana

There is much empirical evidence that human decision-making under risk does not correspond the decision-theoretic notion of "rational" decision making, namely to make choices that maximize the expected value. An open question is how such behavior could have arisen evolutionarily. We believe that the answer to this question lies, at least in part, in the interplay between risk-taking and sequentiality of choice in evolutionary environments.

Rats prefer mutual rewards in a prosocial choice task.

PubMed

Hernandez-Lallement, Julen; van Wingerden, Marijn; Marx, Christine; Srejic, Milan; Kalenscher, Tobias

2014-01-01

Pro-sociality, i.e., the preference for outcomes that produce benefits for other individuals, is ubiquitous in humans. Recently, cross-species comparisons of social behavior have offered important new insights into the evolution of pro-sociality. Here, we present a rodent analog of the Pro-social Choice Task that controls strategic components, de-confounds other-regarding choice motives from the animals' natural tendencies to maximize own food access and directly tests the effect of social context on choice allocation. We trained pairs of rats-an actor and a partner rat-in a double T-maze task where actors decided between two alternatives only differing in the reward delivered to the partner. The "own reward" choice yielded a reward only accessible to the actor whereas the "both reward" choice produced an additional reward for a partner (partner condition) or an inanimate toy (toy Condition), located in an adjacent compartment. We found that actors chose "both reward" at levels above chance and more often in the partner than in the toy condition. Moreover, we show that this choice pattern adapts to the current social context and that the observed behavior is stable over time.

Rats prefer mutual rewards in a prosocial choice task

PubMed Central

Hernandez-Lallement, Julen; van Wingerden, Marijn; Marx, Christine; Srejic, Milan; Kalenscher, Tobias

2015-01-01

Pro-sociality, i.e., the preference for outcomes that produce benefits for other individuals, is ubiquitous in humans. Recently, cross-species comparisons of social behavior have offered important new insights into the evolution of pro-sociality. Here, we present a rodent analog of the Pro-social Choice Task that controls strategic components, de-confounds other-regarding choice motives from the animals' natural tendencies to maximize own food access and directly tests the effect of social context on choice allocation. We trained pairs of rats—an actor and a partner rat—in a double T-maze task where actors decided between two alternatives only differing in the reward delivered to the partner. The “own reward” choice yielded a reward only accessible to the actor whereas the “both reward” choice produced an additional reward for a partner (partner condition) or an inanimate toy (toy Condition), located in an adjacent compartment. We found that actors chose “both reward” at levels above chance and more often in the partner than in the toy condition. Moreover, we show that this choice pattern adapts to the current social context and that the observed behavior is stable over time. PMID:25642162

Gambling for Gatorade: risk-sensitive decision making for fluid rewards in humans

PubMed Central

Platt, Michael L.

2009-01-01

Determining how both humans and animals make decisions in risky situations is a central problem in economics, experimental psychology, behavioral economics, and neurobiology. Typically, humans are risk seeking for gains and risk averse for losses, while animals may display a variety of preferences under risk depending on, amongst other factors, internal state. Such differences in behavior may reflect major cognitive and cultural differences or they may reflect differences in the way risk sensitivity is probed in humans and animals. Notably, in most studies humans make one or a few choices amongst hypothetical or real monetary options, while animals make dozens of repeated choices amongst options offering primary rewards like food or drink. To address this issue, we probed risk-sensitive decision making in human participants using a paradigm modeled on animal studies, in which rewards were either small squirts of Gatorade or small amounts of real money. Possible outcomes and their probabilities were not made explicit in either case. We found that individual patterns of decision making were strikingly similar for both juice and for money, both in overall risk preferences and in trial-to-trial effects of reward outcome on choice. Comparison with decisions made by monkeys for juice in a similar task revealed highly similar gambling styles. These results unite known patterns of risk-sensitive decision making in human and nonhuman primates and suggest that factors such as the way a decision is framed or internal state may underlie observed variation in risk preferences between and within species. PMID:18719953

The curse of planning: dissecting multiple reinforcement-learning systems by taxing the central executive.

PubMed

Otto, A Ross; Gershman, Samuel J; Markman, Arthur B; Daw, Nathaniel D

2013-05-01

A number of accounts of human and animal behavior posit the operation of parallel and competing valuation systems in the control of choice behavior. In these accounts, a flexible but computationally expensive model-based reinforcement-learning system has been contrasted with a less flexible but more efficient model-free reinforcement-learning system. The factors governing which system controls behavior-and under what circumstances-are still unclear. Following the hypothesis that model-based reinforcement learning requires cognitive resources, we demonstrated that having human decision makers perform a demanding secondary task engenders increased reliance on a model-free reinforcement-learning strategy. Further, we showed that, across trials, people negotiate the trade-off between the two systems dynamically as a function of concurrent executive-function demands, and people's choice latencies reflect the computational expenses of the strategy they employ. These results demonstrate that competition between multiple learning systems can be controlled on a trial-by-trial basis by modulating the availability of cognitive resources.

Collective Behavior of Market Participants during Abrupt Stock Price Changes

PubMed Central

Maskawa, Jun-ichi

2016-01-01

Under uncertainty, human and animal collectives often respond stochastically to events they encounter. Human or animal individuals behave depending on others’ actions, and sometimes follow choices that are sub-optimal for individuals. Such mimetic behaviors are enhanced during emergencies, creating collective behavior of a group. A stock market that is about to crash, as markets did immediately after the Lehman Brothers bankruptcy, provides illustrative examples of such behaviors. We provide empirical evidence proving the existence of collective behavior among stock market participants in emergent situations. We investigated the resolution of extreme supply-and-demand order imbalances by increased balancing counter orders: buy and sell orders for excess supply and demand respectively, during times of price adjustment, so-called special quotes on the Tokyo Stock Exchange. Counter orders increase positively depending on the quantity of revealed counter orders: the accumulated orders in the book until then. Statistics of the coming counter order are well described using a logistic regression model with the ratio of revealed orders until then to the finally revealed orders as the explanatory variable. Results given here show that the market participants make Bayesian estimations of optimal choices to ascertain whether to order using information about orders of other participants. PMID:27513335

Collective Behavior of Market Participants during Abrupt Stock Price Changes.

PubMed

Maskawa, Jun-Ichi

2016-01-01

Under uncertainty, human and animal collectives often respond stochastically to events they encounter. Human or animal individuals behave depending on others' actions, and sometimes follow choices that are sub-optimal for individuals. Such mimetic behaviors are enhanced during emergencies, creating collective behavior of a group. A stock market that is about to crash, as markets did immediately after the Lehman Brothers bankruptcy, provides illustrative examples of such behaviors. We provide empirical evidence proving the existence of collective behavior among stock market participants in emergent situations. We investigated the resolution of extreme supply-and-demand order imbalances by increased balancing counter orders: buy and sell orders for excess supply and demand respectively, during times of price adjustment, so-called special quotes on the Tokyo Stock Exchange. Counter orders increase positively depending on the quantity of revealed counter orders: the accumulated orders in the book until then. Statistics of the coming counter order are well described using a logistic regression model with the ratio of revealed orders until then to the finally revealed orders as the explanatory variable. Results given here show that the market participants make Bayesian estimations of optimal choices to ascertain whether to order using information about orders of other participants.

My owner, right or wrong: the effect of familiarity on the domestic dog's behavior in a food-choice task.

PubMed

Cook, Amy; Arter, Jennifer; Jacobs, Lucia F

2014-03-01

Dogs are strongly influenced by human behavior, and they readily form bonds with specific humans. Yet these lines of inquiry are not often combined. The goal of this study was to investigate whether such bonds would play a role in how dogs behave in response to human signals. Using various types of signals, we compared dogs' use of information from a familiar human (their owner) versus an unfamiliar human when choosing between two food containers. In some conditions, the owner indicated a container that gave food and a stranger indicated a container that did not; in other conditions, this was reversed. Dogs more often chose the container indicated by or nearest to their owner, even when this container never yielded a food reward. In two conditions, dogs chose at chance: a control condition in which both pointers were strangers and a condition in which the owner and stranger sat reading books and provided no social signal. This is the first study to directly compare owners to strangers in a single food-choice situation. Our results suggest that dogs make decisions by attending preferentially to social signals from humans with whom they have become familiar.

Effort-Related Motivational Effects of the VMAT-2 Inhibitor Tetrabenazine: Implications for Animal Models of the Motivational Symptoms of Depression

PubMed Central

Nunes, Eric J.; Randall, Patrick A.; Hart, Evan E.; Freeland, Charlotte; Yohn, Samantha E.; Baqi, Younis; Müller, Christa E.; López-Cruz, Laura; Correa, Mercè

2013-01-01

Motivated behaviors are often characterized by a high degree of behavioral activation, and work output and organisms frequently make effort-related decisions based upon cost/benefit analyses. Moreover, people with major depression and other disorders often show effort-related motivational symptoms such as anergia, psychomotor retardation, and fatigue. It has been suggested that tasks measuring effort-related choice behavior could be used as animal models of the motivational symptoms of depression, and the present studies characterized the effort-related effects of the vesicular monoamine transport (VMAT) inhibitor tetrabenazine. Tetrabenazine produces depressive symptoms in humans and, because of its selective inhibition of VMAT-2, it preferentially depletes dopamine (DA). Rats were assessed using a concurrent fixed-ratio 5/chow feeding choice task that is known to be sensitive to dopaminergic manipulations. Tetrabenazine shifted response choice in rats, producing a dose-related decrease in lever pressing and a concomitant increase in chow intake. However, it did not alter food intake or preference in parallel free-feeding choice studies. The effects of tetrabenazine on effort-related choice were reversed by the adenosine A2A antagonist MSX-3 and the antidepressant bupropion. A behaviorally active dose of tetrabenazine decreased extracellular DA in nucleus accumbens and increased expression of DARPP-32 in accumbens medium spiny neurons in a pattern indicative of reduced transmission at both D1 and D2 DA receptors. These experiments demonstrate that tetrabenazine, which is used in animal models to produce depression-like effects, can alter effort-related choice behavior. These studies have implications for the development of animal models of the motivational symptoms of depression and related disorders. PMID:24305809

Building a framework to manage trust in automation

NASA Astrophysics Data System (ADS)

Metcalfe, J. S.; Marathe, A. R.; Haynes, B.; Paul, V. J.; Gremillion, G. M.; Drnec, K.; Atwater, C.; Estepp, J. R.; Lukos, J. R.; Carter, E. C.; Nothwang, W. D.

2017-05-01

All automations must, at some point in their lifecycle, interface with one or more humans. Whether operators, end-users, or bystanders, human responses can determine the perceived utility and acceptance of an automation. It has been long believed that human trust is a primary determinant of human-automation interactions and further presumed that calibrating trust can lead to appropriate choices regarding automation use. However, attempts to improve joint system performance by calibrating trust have not yet provided a generalizable solution. To address this, we identified several factors limiting the direct integration of trust, or metrics thereof, into an active mitigation strategy. The present paper outlines our approach to addressing this important issue, its conceptual underpinnings, and practical challenges encountered in execution. Among the most critical outcomes has been a shift in focus from trust to basic interaction behaviors and their antecedent decisions. This change in focus inspired the development of a testbed and paradigm that was deployed in two experiments of human interactions with driving automation that were executed in an immersive, full-motion simulation environment. Moreover, by integrating a behavior and physiology-based predictor within a novel consequence-based control system, we demonstrated that it is possible to anticipate particular interaction behaviors and influence humans towards more optimal choices about automation use in real time. Importantly, this research provides a fertile foundation for the development and integration of advanced, wearable technologies for sensing and inferring critical state variables for better integration of human elements into otherwise fully autonomous systems.

Choice Impulsivity: Definitions, Measurement Issues, and Clinical Implications

PubMed Central

Hamilton, Kristen R.; Mitchell, Marci R.; Wing, Victoria C.; Balodis, Iris M.; Bickel, Warren K.; Fillmore, Mark; Lane, Scott D.; Lejuez, C. W.; Littlefield, Andrew K.; Luijten, Maartje; Mathias, Charles W.; Mitchell, Suzanne H.; Napier, T. Celeste; Reynolds, Brady; Schütz, Christian G.; Setlow, Barry; Sher, Kenneth J.; Swann, Alan C.; Tedford, Stephanie E.; White, Melanie J.; Winstanley, Catharine A.; Yi, Richard; Potenza, Marc N.; Moeller, F. Gerard

2015-01-01

Background Impulsivity critically relates to many psychiatric disorders. Given the multi-faceted construct that impulsivity represents, defining core aspects of impulsivity is vital for the assessment and understanding of clinical conditions. Choice impulsivity (CI), involving the preferential selection of smaller sooner rewards over larger later rewards, represents one important type of impulsivity. Method The International Society for Research on Impulsivity (InSRI) convened to discuss the definition and assessment of CI and provide recommendations regarding measurement across species. Results Commonly used preclinical and clinical CI behavioral tasks are described, and considerations for each task are provided to guide CI task selection. Differences in assessment of CI (self-report, behavioral) and calculating CI indices (e.g., area-under-the-curve, indifference point, steepness of discounting curve) are discussed along with properties of specific behavioral tasks used in preclinical and clinical settings. Conclusions The InSRI group recommends inclusion of measures of CI in human studies examining impulsivity. Animal studies examining impulsivity should also include assessments of CI and these measures should be harmonized in accordance with human studies of the disorders being modeled in the preclinical investigations. The choice of specific CI measures to be included should be based on the goals of the study and existing preclinical and clinical literature using established CI measures. PMID:25867841

Pigeons and humans use action and pose information to categorize complex human behaviors.

PubMed

Qadri, Muhammad A J; Cook, Robert G

2017-02-01

The biological mechanisms used to categorize and recognize behaviors are poorly understood in both human and non-human animals. Using animated digital models, we have recently shown that pigeons can categorize different locomotive animal gaits and types of complex human behaviors. In the current experiments, pigeons (go/no-go task) and humans (choice task) both learned to conditionally categorize two categories of human behaviors that did not repeat and were comprised of the coordinated motions of multiple limbs. These "martial arts" and "Indian dance" action sequences were depicted by a digital human model. Depending upon whether the model was in motion or not, each species was required to engage in different and opposing responses to the two behavioral categories. Both species learned to conditionally and correctly act on this dynamic and static behavioral information, indicating that both species use a combination of static pose cues that are available from stimulus onset in addition to less rapidly available action information in order to successfully discriminate between the behaviors. Human participants additionally demonstrated a bias towards the dynamic information in the display when re-learning the task. Theories that rely on generalized, non-specific visual mechanisms involving channels for motion and static cues offer a parsimonious account of how humans and pigeons recognize and categorize behaviors within and across species. Copyright © 2016 Elsevier Ltd. All rights reserved.

The applied importance of research on the matching law

PubMed Central

Pierce, W. David; Epling, W. Frank

1995-01-01

In this essay, we evaluate the applied implications of two articles related to the matching law and published in the Journal of the Experimental Analysis of Behavior, May 1994. Building on Mace's (1994) criteria for increasing the applied relevance of basic research, we evaluate the applied implications of basic research studies. Research by Elsmore and McBride (1994) and Savastano and Fantino (1994) involve an extension of the behavioral model of choice. Elsmore and McBride used rats as subjects, but arranged a multioperant environment that resembles some of the complex contingencies of human behavior. Savastino and Fantino used human subjects and extended the matching law to ratio and interval contingencies. These experiments contribute to a growing body of knowledge on the matching law and its relevance for human behavior. PMID:16795866

Using a Novel Alternative to Drug Choice in a Human Laboratory Model of a Cocaine Binge: A Game of Chance

PubMed Central

Vosburg, Suzanne K.; Haney, Margaret; Rubin, Eric; Foltin, Richard W.

2010-01-01

Human laboratory studies have shown that, once initiated, cocaine self-administration is difficult to disrupt using non-drug alternatives. This inpatient study examined whether binge self-administration of cocaine could be altered by an immediate, non-drug reinforcer. Ten cocaine-dependent participants completed 5 consecutive laboratory session days with 2 sessions per day (a model binge), 9 days where cocaine was not available, and subsequent 2 laboratory session days where cocaine was again available (a second model binge). In each laboratory session, participants could choose to either self-administer smoked cocaine or play a game of chance by drawing a pre-determined number of balls from a bingo wheel. Balls were worth monetary amounts from $0 – $20. Participants’ choice to smoke cocaine varied as a function of number of balls drawn. Thus, this game of chance served as an alternative reinforcer to smoking cocaine. Choice varied lawfully as a function of the number of opportunities to earn money indicating that an immediate behavioral alternative can reduce cocaine self-administration after initiation of use. The current model could be used to evaluate whether behavioral and pharmacological manipulations shift choice from cocaine to a non-drug alternative. PMID:20346597

Growing an Ideology: How the Mormons Do It

DTIC Science & Technology

2011-12-01

philosophy, belief, choice, behavior, doctrine, religion, religious, religiosity , church, Mormon, Church of Jesus Christ of Latter-day Saints...to explain a generic construct of prescriptions based on a shared philosophy helps us understand human behavior and interaction. B. PURPOSE This...thesis seeks to understand how ideology- based organizations grow, for understanding ideological promulgation is imperative to understanding conflicts

Human Newborns Prefer Human Milk: Conspecific Milk Odor Is Attractive Without Postnatal Exposure

ERIC Educational Resources Information Center

Marlier, Luc; Schaal, Benoist

2005-01-01

Behavioral responses of 3- to 4-day-old newborns to the odors of various human milk (HM) and formula milk (FM) were examined in paired-choice tests. When both stimuli were nonfamiliar, breast-fed, as well as bottle-fed, infants oriented their head and mouthed more vigorously to HM than to FM. When breast-fed infants were exposed to nonfamiliar HM…

The role of testosterone and estrogen in consumer behavior and social & economic decision making: A review.

PubMed

Stanton, Steven J

2017-06-01

A contribution to a special issue on Hormones and Human Competition.This manuscript reviews the current literature on the actions of the steroid hormones testosterone and estradiol in shaping humans' behavior within two applied contexts, specifically consumer behavior and decision making (both social and economic). The theoretical argument put forth is that steroids shape these everyday behaviors and choices in service to being more competitive in achieving long-term goals related to resource acquisition, mating success, and social dominance. In addition, a discussion of the increased research focus on the role of steroids in other applied business domains will highlight the relevant applications of basic science discoveries in behavioral endocrinology. Copyright © 2016 Elsevier Inc. All rights reserved.

Crows spontaneously exhibit analogical reasoning.

PubMed

Smirnova, Anna; Zorina, Zoya; Obozova, Tanya; Wasserman, Edward

2015-01-19

Analogical reasoning is vital to advanced cognition and behavioral adaptation. Many theorists deem analogical thinking to be uniquely human and to be foundational to categorization, creative problem solving, and scientific discovery. Comparative psychologists have long been interested in the species generality of analogical reasoning, but they initially found it difficult to obtain empirical support for such thinking in nonhuman animals (for pioneering efforts, see [2, 3]). Researchers have since mustered considerable evidence and argument that relational matching-to-sample (RMTS) effectively captures the essence of analogy, in which the relevant logical arguments are presented visually. In RMTS, choice of test pair BB would be correct if the sample pair were AA, whereas choice of test pair EF would be correct if the sample pair were CD. Critically, no items in the correct test pair physically match items in the sample pair, thus demanding that only relational sameness or differentness is available to support accurate choice responding. Initial evidence suggested that only humans and apes can successfully learn RMTS with pairs of sample and test items; however, monkeys have subsequently done so. Here, we report that crows too exhibit relational matching behavior. Even more importantly, crows spontaneously display relational responding without ever having been trained on RMTS; they had only been trained on identity matching-to-sample (IMTS). Such robust and uninstructed relational matching behavior represents the most convincing evidence yet of analogical reasoning in a nonprimate species, as apes alone have spontaneously exhibited RMTS behavior after only IMTS training. Copyright © 2015 Elsevier Ltd. All rights reserved.

Dopamine modulates risk-taking as a function of baseline sensation-seeking trait.

PubMed

Norbury, Agnes; Manohar, Sanjay; Rogers, Robert D; Husain, Masud

2013-08-07

Trait sensation-seeking, defined as a need for varied, complex, and intense sensations, represents a relatively underexplored hedonic drive in human behavioral neuroscience research. It is related to increased risk for a range of behaviors including substance use, gambling, and risky sexual practice. Individual differences in self-reported sensation-seeking have been linked to brain dopamine function, particularly at D2-like receptors, but so far no causal evidence exists for a role of dopamine in sensation-seeking behavior in humans. Here, we investigated the effects of the selective D2/D3 agonist cabergoline on performance of a probabilistic risky choice task in healthy humans using a sensitive within-subject, placebo-controlled design. Cabergoline significantly influenced the way participants combined different explicit signals regarding probability and loss when choosing between response options associated with uncertain outcomes. Importantly, these effects were strongly dependent on baseline sensation-seeking score. Overall, cabergoline increased sensitivity of choice to information about probability of winning; while decreasing discrimination according to magnitude of potential losses associated with different options. The largest effects of the drug were observed in participants with lower sensation-seeking scores. These findings provide evidence that risk-taking behavior in humans can be directly manipulated by a dopaminergic drug, but that the effectiveness of such a manipulation depends on baseline differences in sensation-seeking trait. This emphasizes the importance of considering individual differences when investigating manipulation of risky decision-making, and may have relevance for the development of pharmacotherapies for disorders involving excessive risk-taking in humans, such as pathological gambling.

The neural substrates of social influence on decision making.

PubMed

Tomlin, Damon; Nedic, Andrea; Prentice, Deborah A; Holmes, Philip; Cohen, Jonathan D

2013-01-01

The mechanisms that govern human learning and decision making under uncertainty have been the focus of intense behavioral and, more recently, neuroscientific investigation. Substantial progress has been made in building models of the processes involved, and identifying underlying neural mechanisms using simple, two-alternative forced choice decision tasks. However, less attention has been given to how social information influences these processes, and the neural systems that mediate this influence. Here we sought to address these questions by using tasks similar to ones that have been used to study individual decision making behavior, and adding conditions in which participants were given trial-by-trial information about the performance of other individuals (their choices and/or their rewards) simultaneously playing the same tasks. We asked two questions: How does such information about the behavior of others influence performance in otherwise simple decision tasks, and what neural systems mediate this influence? We found that bilateral insula exhibited a parametric relationship to the degree of misalignment of the individual's performance with those of others in the group. Furthermore, activity in the bilateral insula significantly predicted participants' subsequent choices to align their behavior with others in the group when they were misaligned either in their choices (independent of success) or their degree of success (independent of specific choices). These findings add to the growing body of empirical data suggesting that the insula participates in an important way in social information processing and decision making.

Diverse ontogenies of reciprocal and prosocial behavior: cooperative development in Fiji and the United States.

PubMed

House, Bailey R

2017-11-01

Contingent reciprocity is an important foundation of human cooperation, but we know little about how reciprocal behavior develops across diverse societies, nor about how the development of reciprocal behavior is related to the development of prosocial behavior more broadly. Three- to 16-year-old children were presented with the opportunity to control the allocation of real food rewards in a binary-choice cooperative dilemma. Within dyads children alternated making choices across multiple trials, and reciprocal behavior emerged in three diverse populations (rural Fijian villages, and urban communities in both Fiji and the United States) by age 7-8. There was more societal variation in prosocial behavior than in reciprocal behavior, and there were more substantial differences between Fijians and Americans than between rural and urban populations. This suggests that the development of prosocial behavior is not driven entirely by the development of reciprocity, and differences in prosocial behavior across rural Fijians and urban Americans may not be due only to differences across rural and urban populations. © 2016 John Wiley & Sons Ltd.

Validating vignette and conjoint survey experiments against real-world behavior

PubMed Central

Hainmueller, Jens; Hangartner, Dominik; Yamamoto, Teppei

2015-01-01

Survey experiments, like vignette and conjoint analyses, are widely used in the social sciences to elicit stated preferences and study how humans make multidimensional choices. However, there is a paucity of research on the external validity of these methods that examines whether the determinants that explain hypothetical choices made by survey respondents match the determinants that explain what subjects actually do when making similar choices in real-world situations. This study compares results from conjoint and vignette analyses on which immigrant attributes generate support for naturalization with closely corresponding behavioral data from a natural experiment in Switzerland, where some municipalities used referendums to decide on the citizenship applications of foreign residents. Using a representative sample from the same population and the official descriptions of applicant characteristics that voters received before each referendum as a behavioral benchmark, we find that the effects of the applicant attributes estimated from the survey experiments perform remarkably well in recovering the effects of the same attributes in the behavioral benchmark. We also find important differences in the relative performances of the different designs. Overall, the paired conjoint design, where respondents evaluate two immigrants side by side, comes closest to the behavioral benchmark; on average, its estimates are within 2% percentage points of the effects in the behavioral benchmark. PMID:25646415

The cognitive basis of social behavior: cognitive reflection overrides antisocial but not always prosocial motives

PubMed Central

Corgnet, Brice; Espín, Antonio M.; Hernán-González, Roberto

2015-01-01

Even though human social behavior has received considerable scientific attention in the last decades, its cognitive underpinnings are still poorly understood. Applying a dual-process framework to the study of social preferences, we show in two studies that individuals with a more reflective/deliberative cognitive style, as measured by scores on the Cognitive Reflection Test (CRT), are more likely to make choices consistent with “mild” altruism in simple non-strategic decisions. Such choices increase social welfare by increasing the other person's payoff at very low or no cost for the individual. The choices of less reflective individuals (i.e., those who rely more heavily on intuition), on the other hand, are more likely to be associated with either egalitarian or spiteful motives. We also identify a negative link between reflection and choices characterized by “strong” altruism, but this result holds only in Study 2. Moreover, we provide evidence that the relationship between social preferences and CRT scores is not driven by general intelligence. We discuss how our results can reconcile some previous conflicting findings on the cognitive basis of social behavior. PMID:26594158

Approaches based on behavioral economics could help nudge patients and providers toward lower health spending growth.

PubMed

King, Dominic; Greaves, Felix; Vlaev, Ivo; Darzi, Ara

2013-04-01

Policies that change the environment or context in which decisions are made and "nudge" people toward particular choices have been relatively ignored in health care. This article examines the role that approaches based on behavioral economics could play in "nudging" providers and patients in ways that could slow health care spending growth. The basic insight of behavioral economics is that behavior is guided by the very fallible human brain and greatly influenced by the environment or context in which choices are made. In policy arenas such as pensions and personal savings, approaches based on behavioral economics have provided notable results. In health care, such approaches have been used successfully but in limited ways, as in the use of surgical checklists that have increased patient safety and reduced costs. With health care spending climbing at unsustainable rates, we review the role that approaches based on behavioral economics could play in offering policy makers a potential set of new tools to slow spending growth.

Cocaine versus food choice procedure in rats: environmental manipulations and effects of amphetamine.

PubMed

Thomsen, Morgane; Barrett, Andrew C; Negus, S Stevens; Caine, S Barak

2013-03-01

We have adapted a nonhuman primate model of cocaine versus food choice to the rat species. To evaluate the procedure, we tested cocaine versus food choice under a variety of environmental manipulations as well as pharmacological pretreatments. Complete cocaine-choice dose-effect curves (0-1.0 mg/kg/infusion) were obtained for each condition under concurrent fixed ratio schedules of reinforcement. Percentage of responding emitted on the cocaine-reinforced lever was not affected significantly by removal of cocaine-associated visual or auditory cues, but it was decreased after removal of response-contingent or response-independent cocaine infusions. Cocaine choice was sensitive to the magnitude and fixed ratio requirement of both the cocaine and food reinforcers. We also tested the effects of acute (0.32, 0.56, 1.0, 1.8 mg/kg) and chronic (0.1, 0.32 mg/kg/hr) d-amphetamine treatment on cocaine choice. Acute and chronic d-amphetamine had opposite effects, with acute increasing and chronic decreasing cocaine choice, similar to observations in humans and in nonhuman primates. The results suggest feasibility and utility of the choice procedure in rats and support its comparability to similar procedures used in humans and monkeys. © Society for the Experimental Analysis of Behavior.

Contextual and social influences on valuation and choice.

PubMed

Engelmann, Jan B; Hein, Grit

2013-01-01

To survive in our complex environment, we have to adapt to changing contexts. Prior research that investigated how contextual changes are processed in the human brain has demonstrated important modulatory influences on multiple cognitive processes underlying decision-making, including perceptual judgments, working memory, as well as cognitive and attentional control. However, in everyday life, the importance of context is even more obvious during economic and social interactions, which often have implicit rule sets that need to be recognized by a decision-maker. Here, we review recent evidence from an increasing number of studies in the fields of Neuroeconomics and Social Neuroscience that investigate the neurobiological basis of contextual effects on valuation and social choice. Contrary to the assumptions of rational choice theory, multiple contextual factors, such as the availability of alternative choice options, shifts in reference point, and social context, have been shown to modulate behavior, as well as signals in task-relevant neural networks. A consistent picture that emerges from neurobiological results is that valuation-related activity in striatum and ventromedial prefrontal cortex is highly context dependent during both social and nonsocial choice. Alternative approaches to model and explain choice behavior, such as comparison-based choice models, as well as implications for future research are discussed. Copyright © 2013 Elsevier B.V. All rights reserved.

Impulsive actions and choices in laboratory animals and humans: effects of high vs. low dopamine states produced by systemic treatments given to neurologically intact subjects

PubMed Central

D’Amour-Horvat, Valérie; Leyton, Marco

2014-01-01

Increases and decreases in dopamine (DA) transmission have both been suggested to influence reward-related impulse-control. The present literature review suggests that, in laboratory animals, the systemic administration of DA augmenters preferentially increases susceptibility to premature responding; with continued DA transmission, reward approach behaviors are sustained. Decreases in DA transmission, in comparison, diminish the appeal of distal and difficult to obtain rewards, thereby increasing susceptibility to temporal discounting and other forms of impulsive choice. The evidence available in humans is not incompatible with this model but is less extensive. PMID:25566001

DYT1 dystonia increases risk taking in humans

PubMed Central

Arkadir, David; Radulescu, Angela; Raymond, Deborah; Lubarr, Naomi; Bressman, Susan B; Mazzoni, Pietro; Niv, Yael

2016-01-01

It has been difficult to link synaptic modification to overt behavioral changes. Rodent models of DYT1 dystonia, a motor disorder caused by a single gene mutation, demonstrate increased long-term potentiation and decreased long-term depression in corticostriatal synapses. Computationally, such asymmetric learning predicts risk taking in probabilistic tasks. Here we demonstrate abnormal risk taking in DYT1 dystonia patients, which is correlated with disease severity, thereby supporting striatal plasticity in shaping choice behavior in humans. DOI: http://dx.doi.org/10.7554/eLife.14155.001 PMID:27249418

Behavioral and neurophysiological correlates of regret in rat decision-making on a neuroeconomic task

PubMed Central

Steiner, Adam P.; Redish, A. David

2014-01-01

Summary Disappointment entails the recognition that one did not get the value one expected. In contrast, regret entails the recognition that an alternate (counterfactual) action would have produced a more valued outcome. Thus, the key to identifying regret is the representation of that counterfactual option in situations in which a mistake has been made. In humans, the orbitofrontal cortex is active during expressions of regret, and humans with damage to the orbitofrontal cortex do not express regret. In rats and non-human primates, both the orbitofrontal cortex and the ventral striatum have been implicated in decision-making, particularly in representations of expectations of reward. In order to examine representations of regretful situations, we recorded neural ensembles from orbitofrontal cortex and ventral striatum in rats encountering a spatial sequence of wait/skip choices for delayed delivery of different food flavors. We were able to measure preferences using an economic framework. Rats occasionally skipped low-cost choices and then encountered a high-cost choice. This sequence economically defines a potential regret-inducing instance. In these situations, rats looked backwards towards the lost option, the cells within the orbitofrontal cortex and ventral striatum represented that missed action, rats were more likely to wait for the long delay, and rats rushed through eating the food after that delay. That these situations drove rats to modify their behavior suggests that regret-like processes modify decision-making in non-human mammals. PMID:24908102

A Comparison of Three Approaches to Model Human Behavior

NASA Astrophysics Data System (ADS)

Palmius, Joel; Persson-Slumpi, Thomas

2010-11-01

One way of studying social processes is through the use of simulations. The use of simulations for this purpose has been established as its own field, social simulations, and has been used for studying a variety of phenomena. A simulation of a social setting can serve as an aid for thinking about that social setting, and for experimenting with different parameters and studying the outcomes caused by them. When using the simulation as an aid for thinking and experimenting, the chosen simulation approach will implicitly steer the simulationist towards thinking in a certain fashion in order to fit the model. To study the implications of model choice on the understanding of a setting where human anticipation comes into play, a simulation scenario of a coffee room was constructed using three different simulation approaches: Cellular Automata, Systems Dynamics and Agent-based modeling. The practical implementations of the models were done in three different simulation packages: Stella for Systems Dynamic, CaFun for Cellular automata and SesAM for Agent-based modeling. The models were evaluated both using Randers' criteria for model evaluation, and through introspection where the authors reflected upon how their understanding of the scenario was steered through the model choice. Further the software used for implementing the simulation models was evaluated, and practical considerations for the choice of software package are listed. It is concluded that the models have very different strengths. The Agent-based modeling approach offers the most intuitive support for thinking about and modeling a social setting where the behavior of the individual is in focus. The Systems Dynamics model would be preferable in situations where populations and large groups would be studied as wholes, but where individual behavior is of less concern. The Cellular Automata models would be preferable where processes need to be studied from the basis of a small set of very simple rules. It is further concluded that in most social simulation settings the Agent-based modeling approach would be the probable choice. This since the other models does not offer much in the way of supporting the modeling of the anticipatory behavior of humans acting in an organization.

Radio Frequency Identification and Motion-sensitive Video Efficiently Automate Recording of Unrewarded Choice Behavior by Bumblebees

PubMed Central

Orbán, Levente L.; Plowright, Catherine M.S.

2014-01-01

We present two methods for observing bumblebee choice behavior in an enclosed testing space. The first method consists of Radio Frequency Identification (RFID) readers built into artificial flowers that display various visual cues, and RFID tags (i.e., passive transponders) glued to the thorax of bumblebee workers. The novelty in our implementation is that RFID readers are built directly into artificial flowers that are capable of displaying several distinct visual properties such as color, pattern type, spatial frequency (i.e., “busyness” of the pattern), and symmetry (spatial frequency and symmetry were not manipulated in this experiment). Additionally, these visual displays in conjunction with the automated systems are capable of recording unrewarded and untrained choice behavior. The second method consists of recording choice behavior at artificial flowers using motion-sensitive high-definition camcorders. Bumblebees have number tags glued to their thoraces for unique identification. The advantage in this implementation over RFID is that in addition to observing landing behavior, alternate measures of preference such as hovering and antennation may also be observed. Both automation methods increase experimental control, and internal validity by allowing larger scale studies that take into account individual differences. External validity is also improved because bees can freely enter and exit the testing environment without constraints such as the availability of a research assistant on-site. Compared to human observation in real time, the automated methods are more cost-effective and possibly less error-prone. PMID:25489677

Radio Frequency Identification and motion-sensitive video efficiently automate recording of unrewarded choice behavior by bumblebees.

PubMed

Orbán, Levente L; Plowright, Catherine M S

2014-11-15

We present two methods for observing bumblebee choice behavior in an enclosed testing space. The first method consists of Radio Frequency Identification (RFID) readers built into artificial flowers that display various visual cues, and RFID tags (i.e., passive transponders) glued to the thorax of bumblebee workers. The novelty in our implementation is that RFID readers are built directly into artificial flowers that are capable of displaying several distinct visual properties such as color, pattern type, spatial frequency (i.e., "busyness" of the pattern), and symmetry (spatial frequency and symmetry were not manipulated in this experiment). Additionally, these visual displays in conjunction with the automated systems are capable of recording unrewarded and untrained choice behavior. The second method consists of recording choice behavior at artificial flowers using motion-sensitive high-definition camcorders. Bumblebees have number tags glued to their thoraces for unique identification. The advantage in this implementation over RFID is that in addition to observing landing behavior, alternate measures of preference such as hovering and antennation may also be observed. Both automation methods increase experimental control, and internal validity by allowing larger scale studies that take into account individual differences. External validity is also improved because bees can freely enter and exit the testing environment without constraints such as the availability of a research assistant on-site. Compared to human observation in real time, the automated methods are more cost-effective and possibly less error-prone.

The neuronal and molecular basis of quinine-dependent bitter taste signaling in Drosophila larvae

PubMed Central

Apostolopoulou, Anthi A.; Mazija, Lorena; Wüst, Alexander; Thum, Andreas S.

2014-01-01

The sensation of bitter substances can alert an animal that a specific type of food is harmful and should not be consumed. However, not all bitter compounds are equally toxic and some may even be beneficial in certain contexts. Thus, taste systems in general may have a broader range of functions than just in alerting the animal. In this study we investigate bitter sensing and processing in Drosophila larvae using quinine, a substance perceived by humans as bitter. We show that behavioral choice, feeding, survival, and associative olfactory learning are all directly affected by quinine. On the cellular level, we show that 12 gustatory sensory receptor neurons that express both GR66a and GR33a are required for quinine-dependent choice and feeding behavior. Interestingly, these neurons are not necessary for quinine-dependent survival or associative learning. On the molecular receptor gene level, the GR33a receptor, but not GR66a, is required for quinine-dependent choice behavior. A screen for gustatory sensory receptor neurons that trigger quinine-dependent choice behavior revealed that a single GR97a receptor gene expressing neuron located in the peripheral terminal sense organ is partially necessary and sufficient. For the first time, we show that the elementary chemosensory system of the Drosophila larva can serve as a simple model to understand the neuronal basis of taste information processing on the single cell level with respect to different behavioral outputs. PMID:24478653

EMOTIONAL INTELLIGENCE, MORAL, ETHICS, BIO-ETHICS AND WHAT IS IN BETWEEN.

PubMed

Keidar, Daniella; Yagoda, Arie

2014-10-01

In recent years, the study of emotions has broadened its scope and established its standing as a new scientific discipline. Humanity has become increasingly conscious of the seminal role played by the emotional components in both intrapersonal and interpersonal behavior. A deeply rooted and inherent correlation exists between emotional intelligence (E.I. - Emotional Intelligence) and positive social results: social adaptation, quality social relationships, the capacity for healthy social behaviors, caring, altruism, empathy, enlightened communication and the efficacy and personal coherence essential to moral and ethical behavior, including its manifestation in the sphere of bio-ethics. The importance of the personal relationship between the doctor and the patient is especially fundamental in the current era of immense and accelerated scientific-technological development, forcing doctors to cope with an increasingly complicated technical environment. Precisely because of this reality, it is essential that a doctor's actions and interpersonal relationship with the patient proceed from an ethical base, grounded in both professional and emotional responsibility. Emotional responsibility is one of the central elements underlying bioethical conduct and is the element that provides the guideposts for the treatment of others. The symbiotic connection between emotional intelligence and the sphere of ethics and morals is what delineates human beings. Human beings, by definition and in essence, bear responsibility for their actions. The beginning of ethics is in the human being's consciousness of choice in relation to self and to others. An individual's choices integrate emotion and cognition. That ability to integrate alongside the capacity for choice enables the human race to act in accordance with ethical and moral codes. At work, on a daily basis, a doctor is positioned opposite to the physical, emotional, cognitive and ethical entirety of the patient. Beyond the doctor's technical ability to heal, there also exists his capacity to create within the patient the desire to heal.

A Bibliography of Research on the Influence of Irrelevant Information on Psychological Judgments

DTIC Science & Technology

1981-09-01

Kansas State University " I 00 -.HUMAN FACTORS TECHNICAL AREA C.3)(iiA € U.S. Army LUResearch Institute for the Behavioral and Social Sciences... Behavioral September 1981 and Social Sciences, 5001 Eisenhower Avenue, 13. NUMBER OF PAGES Alexandria, VA 22333 10 14. MONITORING AGENCY NAME & ADDRESS(if...81. Anderson, N. H., & Grant, D. A. A test of a statisticil learning theory model for two-choice behavior models with double stimulus events. Journal

Why Contextual Preference Reversals Maximize Expected Value

PubMed Central

2016-01-01

Contextual preference reversals occur when a preference for one option over another is reversed by the addition of further options. It has been argued that the occurrence of preference reversals in human behavior shows that people violate the axioms of rational choice and that people are not, therefore, expected value maximizers. In contrast, we demonstrate that if a person is only able to make noisy calculations of expected value and noisy observations of the ordinal relations among option features, then the expected value maximizing choice is influenced by the addition of new options and does give rise to apparent preference reversals. We explore the implications of expected value maximizing choice, conditioned on noisy observations, for a range of contextual preference reversal types—including attraction, compromise, similarity, and phantom effects. These preference reversal types have played a key role in the development of models of human choice. We conclude that experiments demonstrating contextual preference reversals are not evidence for irrationality. They are, however, a consequence of expected value maximization given noisy observations. PMID:27337391

Human female orgasm as evolved signal: a test of two hypotheses.

PubMed

Ellsworth, Ryan M; Bailey, Drew H

2013-11-01

We present the results of a study designed to empirically test predictions derived from two hypotheses regarding human female orgasm behavior as an evolved communicative trait or signal. One hypothesis tested was the female fidelity hypothesis, which posits that human female orgasm signals a woman's sexual satisfaction and therefore her likelihood of future fidelity to a partner. The other was sire choice hypothesis, which posits that women's orgasm behavior signals increased chances of fertilization. To test the two hypotheses of human female orgasm, we administered a questionnaire to 138 females and 121 males who reported that they were currently in a romantic relationship. Key predictions of the female fidelity hypothesis were not supported. In particular, orgasm was not associated with female sexual fidelity nor was orgasm associated with male perceptions of partner sexual fidelity. However, faked orgasm was associated with female sexual infidelity and lower male relationship satisfaction. Overall, results were in greater support of the sire choice signaling hypothesis than the female fidelity hypothesis. Results also suggest that male satisfaction with, investment in, and sexual fidelity to a mate are benefits that favored the selection of orgasmic signaling in ancestral females.

Instructional versus schedule control of humans' choices in situations of diminishing returns

PubMed Central

Hackenberg, Timothy D.; Joker, Veronica R.

1994-01-01

Four adult humans chose repeatedly between a fixed-time schedule (of points later exchangeable for money) and a progressive-time schedule that began at 0 s and increased by a fixed number of seconds with each point delivered by that schedule. Each point delivered by the fixed-time schedule reset the requirements of the progressive-time schedule to its minimum value. Subjects were provided with instructions that specified a particular sequence of choices. Under the initial conditions, the instructions accurately specified the optimal choice sequence. Thus, control by instructions and optimal control by the programmed contingencies both supported the same performance. To distinguish the effects of instructions from schedule sensitivity, the correspondence between the instructed and optimal choice patterns was gradually altered across conditions by varying the step size of the progressive-time schedule while maintaining the same instructions. Step size was manipulated, typically in 1-s units, first in an ascending and then in a descending sequence of conditions. Instructions quickly established control in all 4 subjects but, by narrowing the range of choice patterns, they reduced subsequent sensitivity to schedule changes. Instructional control was maintained across the ascending sequence of progressive-time values for each subject, but eventually diminished, giving way to more schedule-appropriate patterns. The transition from instruction-appropriate to schedule-appropriate behavior was characterized by an increase in the variability of choice patterns and local increases in point density. On the descending sequence of progressive-time values, behavior appeared to be schedule sensitive, sometimes even optimally sensitive, but it did not always change systematically with the contingencies, suggesting the involvement of other factors. PMID:16812747

Development of a Navy Job-Specific Vocational Interest Model

DTIC Science & Technology

2006-12-01

The role of job satisfaction in absence behavior. Organizational Behavior and Human Performance , 19, 148-161. Jackofsky, E. F., & Peters, L. H. (1983...Guidance Quarterly, (December), 160-165. Spencer, D. G., & Steers, R. M. (1981). Performance as a moderator of the job- satisfaction -turnover relationship...Application of Process Model to Measurement of Career Choice Satisfaction .............. 9 Content Model of Vocational Interests: Constructs and Structures

Hierarchical competitions subserving multi-attribute choice

PubMed Central

Hunt, Laurence T; Dolan, Raymond J; Behrens, Timothy EJ

2015-01-01

Valuation is a key tenet of decision neuroscience, where it is generally assumed that different attributes of competing options are assimilated into unitary values. Such values are central to current neural models of choice. By contrast, psychological studies emphasize complex interactions between choice and valuation. Principles of neuronal selection also suggest competitive inhibition may occur in early valuation stages, before option selection. Here, we show behavior in multi-attribute choice is best explained by a model involving competition at multiple levels of representation. This hierarchical model also explains neural signals in human brain regions previously linked to valuation, including striatum, parietal and prefrontal cortex, where activity represents competition within-attribute, competition between attributes, and option selection. This multi-layered inhibition framework challenges the assumption that option values are computed before choice. Instead our results indicate a canonical competition mechanism throughout all stages of a processing hierarchy, not simply at a final choice stage. PMID:25306549

Determinants of choice for pigeons and humans on concurrent-chains schedules of reinforcement.

PubMed

Belke, T W; Pierce, W D; Powell, R A

1989-09-01

Concurrent-chains schedules of reinforcement were arranged for humans and pigeons. Responses of humans were reinforced with tokens exchangeable for money, and key pecks of 4 birds were reinforced with food. Variable-interval 30-s and 40-s schedules operated in the terminal links of the chains. Condition 1 exposed subjects to variable-interval 90-s and variable-interval 30-s initial links, respectively. Conditions 2 and 3 arranged equal initial-link schedules of 40 s or 120 s. Experimental conditions tested the descriptive adequacy of five equations: reinforcement density, delay reduction, modified delay reduction, matching and maximization. Results based on choice proportions and switch rates during the initial links showed that pigeons behaved in accord with delay-reduction models, whereas humans maximized overall rate of reinforcement. As discussed by Logue and associates in self-control research, different types of reinforcement may affect sensitivity to delay differentially. Pigeons' responses were reinforced with food, a reinforcer that is consumable upon presentation. Humans' responses were reinforced with money, a reinforcer exchanged for consumable reinforcers after it was earned. Reinforcers that are immediately consumed may generate high sensitivity to delay and behavior described as delay reduction. Reinforces with longer times to consumption may generate low sensitivity to delay and behavior that maximizes overall payoff.

Optimal decision making and matching are tied through diminishing returns

PubMed Central

2017-01-01

How individuals make decisions has been a matter of long-standing debate among economists and researchers in the life sciences. In economics, subjects are viewed as optimal decision makers who maximize their overall reward income. This framework has been widely influential, but requires a complete knowledge of the reward contingencies associated with a given choice situation. Psychologists and ecologists have observed that individuals tend to use a simpler “matching” strategy, distributing their behavior in proportion to relative rewards associated with their options. This article demonstrates that the two dominant frameworks of choice behavior are linked through the law of diminishing returns. The relatively simple matching can in fact provide maximal reward when the rewards associated with decision makers’ options saturate with the invested effort. Such saturating relationships between reward and effort are hallmarks of the law of diminishing returns. Given the prevalence of diminishing returns in nature and social settings, this finding can explain why humans and animals so commonly behave according to the matching law. The article underscores the importance of the law of diminishing returns in choice behavior. PMID:28739920

Optimal decision making and matching are tied through diminishing returns.

PubMed

Kubanek, Jan

2017-08-08

How individuals make decisions has been a matter of long-standing debate among economists and researchers in the life sciences. In economics, subjects are viewed as optimal decision makers who maximize their overall reward income. This framework has been widely influential, but requires a complete knowledge of the reward contingencies associated with a given choice situation. Psychologists and ecologists have observed that individuals tend to use a simpler "matching" strategy, distributing their behavior in proportion to relative rewards associated with their options. This article demonstrates that the two dominant frameworks of choice behavior are linked through the law of diminishing returns. The relatively simple matching can in fact provide maximal reward when the rewards associated with decision makers' options saturate with the invested effort. Such saturating relationships between reward and effort are hallmarks of the law of diminishing returns. Given the prevalence of diminishing returns in nature and social settings, this finding can explain why humans and animals so commonly behave according to the matching law. The article underscores the importance of the law of diminishing returns in choice behavior.

A behavioral and neural evaluation of prospective decision-making under risk.

PubMed

Symmonds, Mkael; Bossaerts, Peter; Dolan, Raymond J

2010-10-27

Making the best choice when faced with a chain of decisions requires a person to judge both anticipated outcomes and future actions. Although economic decision-making models account for both risk and reward in single-choice contexts, there is a dearth of similar knowledge about sequential choice. Classical utility-based models assume that decision-makers select and follow an optimal predetermined strategy, regardless of the particular order in which options are presented. An alternative model involves continuously reevaluating decision utilities, without prescribing a specific future set of choices. Here, using behavioral and functional magnetic resonance imaging (fMRI) data, we studied human subjects in a sequential choice task and use these data to compare alternative decision models of valuation and strategy selection. We provide evidence that subjects adopt a model of reevaluating decision utilities, in which available strategies are continuously updated and combined in assessing action values. We validate this model by using simultaneously acquired fMRI data to show that sequential choice evokes a pattern of neural response consistent with a tracking of anticipated distribution of future reward, as expected in such a model. Thus, brain activity evoked at each decision point reflects the expected mean, variance, and skewness of possible payoffs, consistent with the idea that sequential choice evokes a prospective evaluation of both available strategies and possible outcomes.

Reward Contrast Effects on Impulsive Choice and Timing in Rats

PubMed Central

Smith, Aaron P.; Peterson, Jennifer R.; Kirkpatrick, Kimberly

2016-01-01

Despite considerable interest in impulsive choice as a predictor of a variety of maladaptive behaviors, the mechanisms that drive choice behavior are still poorly understood. The present study sought to examine the influence of one understudied variable, reward magnitude contrast, on choice and timing behavior as changes in magnitude commonly occur within choice procedures. In addition, assessments of indirect effects on choice behavior through magnitude-timing interactions were assessed by measuring timing within the choice task. Rats were exposed to choice procedures composed of different pairs of magnitudes of rewards for either the smaller-sooner (SS) or larger-later (LL) option. In Phase 2, the magnitude of reward either increased or decreased by 1 pellet in different groups (LL increase = 1v1→1v2; SS decrease = 2v2 → 1v2; SS increase = 1v2 → 2v2), followed by a return to baseline in Phase 3. Choice behavior was affected by the initial magnitudes experienced in the task, demonstrating a strong anchor effect. The nature of the change in magnitude affected choice behavior as well. Timing behavior was also affected by the reward contrast manipulation albeit to a lesser degree and the timing and choice effects were correlated. The results suggest that models of choice behavior should incorporate reinforcement history, reward contrast elements, and magnitude-timing interactions, but that direct effects of reward contrast on choice should be given more weight than the indirect reward-timing interactions. A better understanding of the factors that contribute to choice behavior could supply key insights into this important individual differences variable. PMID:27867839

Conditioned associations and economic decision biases.

PubMed

Guitart-Masip, Marc; Talmi, Deborah; Dolan, Ray

2010-10-15

Humans show substantial deviation from rationality during economic decision making under uncertainty. A computational perspective suggests these deviations arise out of an interaction between distinct valuation systems in the brain. Here, we provide behavioural data showing that the incidental presentation of aversive and appetitive conditioned stimuli can alter subjects' preferences in an economic task, involving a choice between a safe or gamble option. These behavioural effects informed a model-based analysis of a functional magnetic resonance imaging (fMRI) experiment, involving an identical paradigm, where we demonstrate that this conditioned behavioral bias engages the amygdala, a brain structure associated with acquisition and expression of conditioned associations. Our findings suggest that a well known bias in human economic choice can arise from an influence of conditioned associations on goal-directed decision making, consistent with an architecture of choice that invokes distinct decision-making systems. Copyright 2010 Elsevier Inc. All rights reserved.

Anticipation and Choice Heuristics in the Dynamic Consumption of Pain Relief

PubMed Central

Story, Giles W.; Vlaev, Ivo; Dayan, Peter; Seymour, Ben; Darzi, Ara; Dolan, Raymond J.

2015-01-01

Humans frequently need to allocate resources across multiple time-steps. Economic theory proposes that subjects do so according to a stable set of intertemporal preferences, but the computational demands of such decisions encourage the use of formally less competent heuristics. Few empirical studies have examined dynamic resource allocation decisions systematically. Here we conducted an experiment involving the dynamic consumption over approximately 15 minutes of a limited budget of relief from moderately painful stimuli. We had previously elicited the participants’ time preferences for the same painful stimuli in one-off choices, allowing us to assess self-consistency. Participants exhibited three characteristic behaviors: saving relief until the end, spreading relief across time, and early spending, of which the last was markedly less prominent. The likelihood that behavior was heuristic rather than normative is suggested by the weak correspondence between one-off and dynamic choices. We show that the consumption choices are consistent with a combination of simple heuristics involving early-spending, spreading or saving of relief until the end, with subjects predominantly exhibiting the last two. PMID:25793302

Anticipation and choice heuristics in the dynamic consumption of pain relief.

PubMed

Story, Giles W; Vlaev, Ivo; Dayan, Peter; Seymour, Ben; Darzi, Ara; Dolan, Raymond J

2015-03-01

Humans frequently need to allocate resources across multiple time-steps. Economic theory proposes that subjects do so according to a stable set of intertemporal preferences, but the computational demands of such decisions encourage the use of formally less competent heuristics. Few empirical studies have examined dynamic resource allocation decisions systematically. Here we conducted an experiment involving the dynamic consumption over approximately 15 minutes of a limited budget of relief from moderately painful stimuli. We had previously elicited the participants' time preferences for the same painful stimuli in one-off choices, allowing us to assess self-consistency. Participants exhibited three characteristic behaviors: saving relief until the end, spreading relief across time, and early spending, of which the last was markedly less prominent. The likelihood that behavior was heuristic rather than normative is suggested by the weak correspondence between one-off and dynamic choices. We show that the consumption choices are consistent with a combination of simple heuristics involving early-spending, spreading or saving of relief until the end, with subjects predominantly exhibiting the last two.

Behavioral Dynamics in the Cooperative Control of Mixed Human/Robotic Teams

DTIC Science & Technology

2015-01-05

models of cognitive and social psychology play a major role in the work. A particular objective is to develop a fundamental understanding of how...dynamics. In addition to exploring cognitive and social psychological aspects of decision making, research is focused on formal approaches to...SUBJECT TERMS human-machine interactions, two-alternative-forced-choice (TAFC), cognitive and social psychological aspects of decision making, action

Orbitofrontal cortical activity during repeated free choice.

PubMed

Campos, Michael; Koppitch, Kari; Andersen, Richard A; Shimojo, Shinsuke

2012-06-01

Neurons in the orbitofrontal cortex (OFC) have been shown to encode subjective values, suggesting a role in preference-based decision-making, although the precise relation to choice behavior is unclear. In a repeated two-choice task, subjective values of each choice can account for aggregate choice behavior, which is the overall likelihood of choosing one option over the other. Individual choices, however, are impossible to predict with knowledge of relative subjective values alone. In this study we investigated the role of internal factors in choice behavior with a simple but novel free-choice task and simultaneous recording from individual neurons in nonhuman primate OFC. We found that, first, the observed sequences of choice behavior included periods of exceptionally long runs of each of two available options and periods of frequent switching. Neither a satiety-based mechanism nor a random selection process could explain the observed choice behavior. Second, OFC neurons encode important features of the choice behavior. These features include activity selective for exceptionally long runs of a given choice (stay selectivity) as well as activity selective for switches between choices (switch selectivity). These results suggest that OFC neural activity, in addition to encoding subjective values on a long timescale that is sensitive to satiety, also encodes a signal that fluctuates on a shorter timescale and thereby reflects some of the statistically improbable aspects of free-choice behavior.

Orbitofrontal cortical activity during repeated free choice

PubMed Central

Koppitch, Kari; Andersen, Richard A.; Shimojo, Shinsuke

2012-01-01

Neurons in the orbitofrontal cortex (OFC) have been shown to encode subjective values, suggesting a role in preference-based decision-making, although the precise relation to choice behavior is unclear. In a repeated two-choice task, subjective values of each choice can account for aggregate choice behavior, which is the overall likelihood of choosing one option over the other. Individual choices, however, are impossible to predict with knowledge of relative subjective values alone. In this study we investigated the role of internal factors in choice behavior with a simple but novel free-choice task and simultaneous recording from individual neurons in nonhuman primate OFC. We found that, first, the observed sequences of choice behavior included periods of exceptionally long runs of each of two available options and periods of frequent switching. Neither a satiety-based mechanism nor a random selection process could explain the observed choice behavior. Second, OFC neurons encode important features of the choice behavior. These features include activity selective for exceptionally long runs of a given choice (stay selectivity) as well as activity selective for switches between choices (switch selectivity). These results suggest that OFC neural activity, in addition to encoding subjective values on a long timescale that is sensitive to satiety, also encodes a signal that fluctuates on a shorter timescale and thereby reflects some of the statistically improbable aspects of free-choice behavior. PMID:22423007

Influences on food choice and dietary behavior.

PubMed

Shepherd, Richard

2005-01-01

There are a number of possible reasons for the lack of effectiveness of attempts at changing dietary behaviors. While lack of information and knowledge about foods and nutrient contents might play a part, motivation to change is likely to be much more important. Food choice, like any complex human behavior, is influenced by many interrelating factors, including various physiological, social and cultural factors, and these need to be taken into account when considering dietary interventions. In many cases people lack motivation to change. This can be related to optimistic bias, where people underestimate the risk to themselves relative to others from a variety of hazards. People feel less at risk personally for many dietary risks and this is related both to the control they feel they have over dietary behaviors and also to their considering themselves to have better diets than the average. The 'stages of change' model is a possible means for trying to address these motivational issues. While this model has been applied to various forms of behavior such as smoking, there are a number of problems transferring such a model from smoking to dietary behaviors, including the lack of clear cut specific behaviors and behavior change targets in the dietary field.

Why Teach Playwriting?

ERIC Educational Resources Information Center

Levy, Jonathan

2001-01-01

Ponders what students might learn from a course in playwriting: the ability to think in vivid instances and moments; the habit of close observation of the details of human behavior; the ability to think through and see through cliches; making hard choices; sympathy; dreaming within limits; and concision. (SR)

Do polymorphisms in chemosensory genes matter for human ingestive behavior?

PubMed Central

Hayes, John E.; Feeney, Emma L.; Allen, Alissa L.

2013-01-01

In the last decade, basic research in chemoreceptor genetics and neurobiology have revolutionized our understanding of individual differences in chemosensation. From an evolutionary perspective, chemosensory variations appear to have arisen in response to different living environments, generally in the avoidance of toxins and to better detect vital food sources. Today, it is often assumed that these differences may drive variable food preferences and choices, with downstream effects on health and wellness. A growing body of evidence indicates chemosensory variation is far more complex than previously believed. However, just because a genetic polymorphism results in altered receptor function in cultured cells or even behavioral phenotypes in the laboratory, this variation may not be sufficient to influence food choice in free living humans. Still, there is ample evidence to indicate allelic variation in TAS2R38 predicts variation in bitterness of synthetic pharmaceuticals (e.g., propylthiouracil) and natural plant compounds (e.g., goitrin), and this variation associates with differential intake of alcohol and vegetables. Further, this is only one of 25 unique bitter taste genes (TAS2Rs) in humans, and emerging evidence suggests other TAS2Rs may also contain polymorphisms that a functional with respect to ingestive behavior. For example, TAS2R16 polymorphisms are linked to the bitterness of naturally occurring plant compounds and alcoholic beverage intake, a TAS2R19 polymorphism predicts differences in quinine bitterness and grapefruit bitterness and liking, and TAS2R31 polymorphisms associate with differential bitterness of plant compounds like aristolochic acid and the sulfonyl amide sweeteners saccharin and acesulfame-K. More critically with respect to food choices, these polymorphisms may vary independently from each other within and across individuals, meaning a monolithic one-size-fits-all approach to bitterness needs to be abandoned. Nor are genetic differences restricted to bitterness. Perceptual variation has also been associated with polymorphisms in genes involved in odors associated with meat defects (boar taint), green/grassy notes, and cilantro, as well as umami and sweet tastes (TAS1R1/2/3). Here, a short primer on receptor genetics is provided, followed by a summary of current knowledge, and implications for human ingestive behavior are discussed. PMID:23878414

The Curse of Planning: Dissecting multiple reinforcement learning systems by taxing the central executive

PubMed Central

Otto, A. Ross; Gershman, Samuel J.; Markman, Arthur B.; Daw, Nathaniel D.

2013-01-01

A number of accounts of human and animal behavior posit the operation of parallel and competing valuation systems in the control of choice behavior. Along these lines, a flexible but computationally expensive model-based reinforcement learning system has been contrasted with a less flexible but more efficient model-free reinforcement learning system. The factors governing which system controls behavior—and under what circumstances—are still unclear. Based on the hypothesis that model-based reinforcement learning requires cognitive resources, we demonstrate that having human decision-makers perform a demanding secondary task engenders increased reliance on a model-free reinforcement learning strategy. Further, we show that across trials, people negotiate this tradeoff dynamically as a function of concurrent executive function demands and their choice latencies reflect the computational expenses of the strategy employed. These results demonstrate that competition between multiple learning systems can be controlled on a trial-by-trial basis by modulating the availability of cognitive resources. PMID:23558545

Credit Assignment in a Motor Decision Making Task Is Influenced by Agency and Not Sensory Prediction Errors.

PubMed

Parvin, Darius E; McDougle, Samuel D; Taylor, Jordan A; Ivry, Richard B

2018-05-09

Failures to obtain reward can occur from errors in action selection or action execution. Recently, we observed marked differences in choice behavior when the failure to obtain a reward was attributed to errors in action execution compared with errors in action selection (McDougle et al., 2016). Specifically, participants appeared to solve this credit assignment problem by discounting outcomes in which the absence of reward was attributed to errors in action execution. Building on recent evidence indicating relatively direct communication between the cerebellum and basal ganglia, we hypothesized that cerebellar-dependent sensory prediction errors (SPEs), a signal indicating execution failure, could attenuate value updating within a basal ganglia-dependent reinforcement learning system. Here we compared the SPE hypothesis to an alternative, "top-down" hypothesis in which changes in choice behavior reflect participants' sense of agency. In two experiments with male and female human participants, we manipulated the strength of SPEs, along with the participants' sense of agency in the second experiment. The results showed that, whereas the strength of SPE had no effect on choice behavior, participants were much more likely to discount the absence of rewards under conditions in which they believed the reward outcome depended on their ability to produce accurate movements. These results provide strong evidence that SPEs do not directly influence reinforcement learning. Instead, a participant's sense of agency appears to play a significant role in modulating choice behavior when unexpected outcomes can arise from errors in action execution. SIGNIFICANCE STATEMENT When learning from the outcome of actions, the brain faces a credit assignment problem: Failures of reward can be attributed to poor choice selection or poor action execution. Here, we test a specific hypothesis that execution errors are implicitly signaled by cerebellar-based sensory prediction errors. We evaluate this hypothesis and compare it with a more "top-down" hypothesis in which the modulation of choice behavior from execution errors reflects participants' sense of agency. We find that sensory prediction errors have no significant effect on reinforcement learning. Instead, instructions influencing participants' belief of causal outcomes appear to be the main factor influencing their choice behavior. Copyright © 2018 the authors 0270-6474/18/384521-10$15.00/0.

Human reinforcement learning subdivides structured action spaces by learning effector-specific values

PubMed Central

Gershman, Samuel J.; Pesaran, Bijan; Daw, Nathaniel D.

2009-01-01

Humans and animals are endowed with a large number of effectors. Although this enables great behavioral flexibility, it presents an equally formidable reinforcement learning problem of discovering which actions are most valuable, due to the high dimensionality of the action space. An unresolved question is how neural systems for reinforcement learning – such as prediction error signals for action valuation associated with dopamine and the striatum – can cope with this “curse of dimensionality.” We propose a reinforcement learning framework that allows for learned action valuations to be decomposed into effector-specific components when appropriate to a task, and test it by studying to what extent human behavior and BOLD activity can exploit such a decomposition in a multieffector choice task. Subjects made simultaneous decisions with their left and right hands and received separate reward feedback for each hand movement. We found that choice behavior was better described by a learning model that decomposed the values of bimanual movements into separate values for each effector, rather than a traditional model that treated the bimanual actions as unitary with a single value. A decomposition of value into effector-specific components was also observed in value-related BOLD signaling, in the form of lateralized biases in striatal correlates of prediction error and anticipatory value correlates in the intraparietal sulcus. These results suggest that the human brain can use decomposed value representations to “divide and conquer” reinforcement learning over high-dimensional action spaces. PMID:19864565

Human reinforcement learning subdivides structured action spaces by learning effector-specific values.

PubMed

Gershman, Samuel J; Pesaran, Bijan; Daw, Nathaniel D

2009-10-28

Humans and animals are endowed with a large number of effectors. Although this enables great behavioral flexibility, it presents an equally formidable reinforcement learning problem of discovering which actions are most valuable because of the high dimensionality of the action space. An unresolved question is how neural systems for reinforcement learning-such as prediction error signals for action valuation associated with dopamine and the striatum-can cope with this "curse of dimensionality." We propose a reinforcement learning framework that allows for learned action valuations to be decomposed into effector-specific components when appropriate to a task, and test it by studying to what extent human behavior and blood oxygen level-dependent (BOLD) activity can exploit such a decomposition in a multieffector choice task. Subjects made simultaneous decisions with their left and right hands and received separate reward feedback for each hand movement. We found that choice behavior was better described by a learning model that decomposed the values of bimanual movements into separate values for each effector, rather than a traditional model that treated the bimanual actions as unitary with a single value. A decomposition of value into effector-specific components was also observed in value-related BOLD signaling, in the form of lateralized biases in striatal correlates of prediction error and anticipatory value correlates in the intraparietal sulcus. These results suggest that the human brain can use decomposed value representations to "divide and conquer" reinforcement learning over high-dimensional action spaces.

Do Political and Economic Choices Rely on Common Neural Substrates? A Systematic Review of the Emerging Neuropolitics Literature.

PubMed

Krastev, Sekoul; McGuire, Joseph T; McNeney, Denver; Kable, Joseph W; Stolle, Dietlind; Gidengil, Elisabeth; Fellows, Lesley K

2016-01-01

The methods of cognitive neuroscience are beginning to be applied to the study of political behavior. The neural substrates of value-based decision-making have been extensively examined in economic contexts; this might provide a powerful starting point for understanding political decision-making. Here, we asked to what extent the neuropolitics literature to date has used conceptual frameworks and experimental designs that make contact with the reward-related approaches that have dominated decision neuroscience. We then asked whether the studies of political behavior that can be considered in this light implicate the brain regions that have been associated with subjective value related to "economic" reward. We performed a systematic literature review to identify papers addressing the neural substrates of political behavior and extracted the fMRI studies reporting behavioral measures of subjective value as defined in decision neuroscience studies of reward. A minority of neuropolitics studies met these criteria and relatively few brain activation foci from these studies overlapped with regions where activity has been related to subjective value. These findings show modest influence of reward-focused decision neuroscience on neuropolitics research to date. Whether the neural substrates of subjective value identified in economic choice paradigms generalize to political choice thus remains an open question. We argue that systematically addressing the commonalities and differences in these two classes of value-based choice will be important in developing a more comprehensive model of the brain basis of human decision-making.

Do Political and Economic Choices Rely on Common Neural Substrates? A Systematic Review of the Emerging Neuropolitics Literature

PubMed Central

Krastev, Sekoul; McGuire, Joseph T.; McNeney, Denver; Kable, Joseph W.; Stolle, Dietlind; Gidengil, Elisabeth; Fellows, Lesley K.

2016-01-01

The methods of cognitive neuroscience are beginning to be applied to the study of political behavior. The neural substrates of value-based decision-making have been extensively examined in economic contexts; this might provide a powerful starting point for understanding political decision-making. Here, we asked to what extent the neuropolitics literature to date has used conceptual frameworks and experimental designs that make contact with the reward-related approaches that have dominated decision neuroscience. We then asked whether the studies of political behavior that can be considered in this light implicate the brain regions that have been associated with subjective value related to “economic” reward. We performed a systematic literature review to identify papers addressing the neural substrates of political behavior and extracted the fMRI studies reporting behavioral measures of subjective value as defined in decision neuroscience studies of reward. A minority of neuropolitics studies met these criteria and relatively few brain activation foci from these studies overlapped with regions where activity has been related to subjective value. These findings show modest influence of reward-focused decision neuroscience on neuropolitics research to date. Whether the neural substrates of subjective value identified in economic choice paradigms generalize to political choice thus remains an open question. We argue that systematically addressing the commonalities and differences in these two classes of value-based choice will be important in developing a more comprehensive model of the brain basis of human decision-making. PMID:26941703

The Detrimental Effects of Oxytocin-Induced Conformity on Dishonesty in Competition.

PubMed

Aydogan, Gökhan; Jobst, Andrea; D'Ardenne, Kimberlee; Müller, Norbert; Kocher, Martin G

2017-06-01

Justifications may promote unethical behavior because they constitute a convenient loophole through which people can gain from immoral behavior and preserve a positive self-image at the same time. A justification that is widely used is rooted in conformity: Unethical choices become more permissible because one's peers are expected to make the same unethical choices. In the current study, we tested whether an exogenous alteration of conformity led to a lower inclination to adhere to a widely accepted norm (i.e., honesty) under the pressure of competition. We took advantage of the well-known effects of intranasally applied oxytocin on affiliation, in-group conformity, and in-group favoritism in humans. We found that conformity was enhanced by oxytocin, and this enhancement had a detrimental effect on honesty in a competitive environment but not in a noncompetitive environment. Our findings contribute to recent evidence showing that competition may lead to unethical behavior and erode moral values.

A Multiple-Choice Task with Changes of Mind

PubMed Central

Albantakis, Larissa; Branzi, Francesca M.; Costa, Albert; Deco, Gustavo

2012-01-01

The role of changes of mind and multiple choices has recently received increased attention in the study of perceptual decision-making. Previously, these extensions to standard two-alternative tasks have been studied separately. Here we explored how changes of mind depend on the number of choice-alternatives. To this end, we tested 14 human subjects on a 2- and 4-alternative direction-discrimination task. Changes of mind in the participants' movement trajectories could be observed for two and for four choice alternatives. With fewer alternatives, participants responded faster and more accurately. The frequency of changes of mind, however, did not significantly differ for the different numbers of choice alternatives. Nevertheless, mind-changing improved the participants' final performance, particularly for intermediate difficulty levels, in both experimental conditions. Moreover, the mean reaction times of individual participants were negatively correlated with their overall tendency to make changes of mind. We further reproduced these findings with a multi-alternative attractor model for decision-making, while a simple race model could not account for the experimental data. Our experiment, combined with the theoretical models allowed us to shed light on: (1) the differences in choice behavior between two and four alternatives, (2) the differences between the data of our human subjects and previous monkey data, (3) individual differences between participants, and (4) the inhibitory interaction between neural representations of choice alternatives. PMID:22916216

INDIVIDUAL DIFFERENCES IN IMPULSIVE CHOICE AND TIMING IN RATS

PubMed Central

Galtress, Tiffany; Garcia, Ana; Kirkpatrick, Kimberly

2012-01-01

Individual differences in impulsive choice behavior have been linked to a variety of behavioral problems including substance abuse, smoking, gambling, and poor financial decision-making. Given the potential importance of individual differences in impulsive choice as a predictor of behavioral problems, the present study sought to measure the extent of individual differences in a normal sample of hooded Lister rats. Three experiments utilized variations of a delay discounting task to measure the degree of variation in impulsive choice behavior across individual rats. The individual differences accounted for 22–55% of the variance in choice behavior across the three experiments. In Experiments 2 and 3, the individual differences were still apparent when behavior was measured across multiple choice points. Large individual differences in the rate of responding, and modest individual differences in timing of responding were also observed during occasional peak trials. The individual differences in timing and rate, however, did not correlate consistently with individual differences in choice behavior. This suggests that a variety of factors may affect choice behavior, response rate, and response timing. PMID:22851792

Community Discovery in Dynamic, Rich-Context Social Networks

ERIC Educational Resources Information Center

Lin, Yu-Ru

2010-01-01

My research interest has been in understanding the human communities formed through interpersonal social activities. Participation in online communities on social network sites such as Twitter has been observed to influence people's behavior in diverse ways including financial decision-making and political choices, suggesting the rich potential…

Improving health outcomes for youth living with the human immunodeficiency virus: a multisite randomized trial of a motivational intervention targeting multiple risk behaviors.

PubMed

Naar-King, Sylvie; Parsons, Jeffrey T; Murphy, Debra A; Chen, Xinguang; Harris, D Robert; Belzer, Marvin E

2009-12-01

To determine if Healthy Choices, a motivational interviewing intervention targeting multiple risk behaviors, improved human immunodeficiency virus (HIV) viral load. A randomized, 2-group repeated measures design with analysis of data from baseline and 6- and 9-month follow-up collected from 2005 to 2007. Five US adolescent medicine HIV clinics. A convenience sample with at least 1 of 3 risk behaviors (nonadherence to HIV medications, substance abuse, and unprotected sex) was enrolled. The sample was aged 16 to 24 years and primarily African American. Of the 205 enrolled, 19 did not complete baseline data collections, for a final sample size of 186. Young people living with HIV were randomized to the intervention plus specialty care (n = 94) or specialty care alone (n = 92). The 3- and 6-month follow-up rates, respectively, were 86% and 82% for the intervention group and 81% and 73% for controls. Intervention Healthy Choices was a 4-session individual clinic-based motivational interviewing intervention delivered during a 10-week period. Motivational interviewing is a method of communication designed to elicit and reinforce intrinsic motivation for change. Outcome Measure Plasma viral load. Youth randomized to Healthy Choices showed a significant decline in viral load at 6 months postintervention compared with youth in the control condition (beta = -0.36, t = -2.15, P = .03), with those prescribed antiretroviral medications showing the lowest viral loads. Differences were no longer significant at 9 months. A motivational interviewing intervention targeting multiple risk behaviors resulted in short-term improvements in viral load for youth living with HIV. Trial Registration clinicaltrials.gov Identifier: NCT00103532.

Neural correlates of forward planning in a spatial decision task in humans

PubMed Central

Simon, Dylan Alexander; Daw, Nathaniel D.

2011-01-01

Although reinforcement learning (RL) theories have been influential in characterizing the brain’s mechanisms for reward-guided choice, the predominant temporal difference (TD) algorithm cannot explain many flexible or goal-directed actions that have been demonstrated behaviorally. We investigate such actions by contrasting an RL algorithm that is model-based, in that it relies on learning a map or model of the task and planning within it, to traditional model-free TD learning. To distinguish these approaches in humans, we used fMRI in a continuous spatial navigation task, in which frequent changes to the layout of the maze forced subjects continually to relearn their favored routes, thereby exposing the RL mechanisms employed. We sought evidence for the neural substrates of such mechanisms by comparing choice behavior and BOLD signals to decision variables extracted from simulations of either algorithm. Both choices and value-related BOLD signals in striatum, though most often associated with TD learning, were better explained by the model-based theory. Further, predecessor quantities for the model-based value computation were correlated with BOLD signals in the medial temporal lobe and frontal cortex. These results point to a significant extension of both the computational and anatomical substrates for RL in the brain. PMID:21471389

Multitasking as a choice: a perspective.

PubMed

Broeker, Laura; Liepelt, Roman; Poljac, Edita; Künzell, Stefan; Ewolds, Harald; de Oliveira, Rita F; Raab, Markus

2018-01-01

Performance decrements in multitasking have been explained by limitations in cognitive capacity, either modelled as static structural bottlenecks or as the scarcity of overall cognitive resources that prevent humans, or at least restrict them, from processing two tasks at the same time. However, recent research has shown that individual differences, flexible resource allocation, and prioritization of tasks cannot be fully explained by these accounts. We argue that understanding human multitasking as a choice and examining multitasking performance from the perspective of judgment and decision-making (JDM), may complement current dual-task theories. We outline two prominent theories from the area of JDM, namely Simple Heuristics and the Decision Field Theory, and adapt these theories to multitasking research. Here, we explain how computational modelling techniques and decision-making parameters used in JDM may provide a benefit to understanding multitasking costs and argue that these techniques and parameters have the potential to predict multitasking behavior in general, and also individual differences in behavior. Finally, we present the one-reason choice metaphor to explain a flexible use of limited capacity as well as changes in serial and parallel task processing. Based on this newly combined approach, we outline a concrete interdisciplinary future research program that we think will help to further develop multitasking research.

[Factors behind action, emotion, and decision making].

PubMed

Watanabe, Katsumi

2009-12-01

Human actions, emotions, and decision making are products of complex interactions between explicit and implicit processes at various levels of spatial and temporal scales. Although it may not be possible to obtain to experimental data for all the complexity of human behavioral and emotional processes in our everyday life, recent studies have investigated the effects of social contexts on actions, emotions, and decision making; these studies include those in the fields of experimental psychology, cognitive science, and neuroscience. In this paper, we review several empirical studies that exemplify how our actions, social emotions, and decision making are influenced by the presence of implicit external, rather than internal factors, particularly by presence of other individuals. The following are the main principles identified. (1) Unconscious behavioral contagion: Individuals tend to mimic others' actions. This tendency occurs unconsciously even when the observed and the to-be-executed movements are unrelated at various levels and aspects of behaviors (e. g., behavioral tempo and speed). (2) Neural substrates of social emotions: Various social emotions, including admiration, compassion, envy, and schadenfreude, are represented in neuronal networks that are similar to those of basic emotional processes. (3) Evasive nature of human decision making: Individuals tend to overrate their own subjective impression of and emotional reaction in forecasting affective reaction to events in the future, even though the predictive power of information from peer group is much larger in this regard. Individuals are seldom aware of the dissociation between their intended choice and excuted actions and are willing to give elaborate explanations for the choices they, in fact, did not make. Using these empirical examples, I will illustrate the considerable influences of implicit, unconscious processes on human actions, emotions, and decision making.

Modeling detour behavior of pedestrian dynamics under different conditions

NASA Astrophysics Data System (ADS)

Qu, Yunchao; Xiao, Yao; Wu, Jianjun; Tang, Tao; Gao, Ziyou

2018-02-01

Pedestrian simulation approach has been widely used to reveal the human behavior and evaluate the performance of crowd evacuation. In the existing pedestrian simulation models, the social force model is capable of predicting many collective phenomena. Detour behavior occurs in many cases, and the important behavior is a dominate factor of the crowd evacuation efficiency. However, limited attention has been attracted for analyzing and modeling the characteristics of detour behavior. In this paper, a modified social force model integrated by Voronoi diagram is proposed to calculate the detour direction and preferred velocity. Besides, with the consideration of locations and velocities of neighbor pedestrians, a Logit-based choice model is built to describe the detour direction choice. The proposed model is applied to analyze pedestrian dynamics in a corridor scenario with either unidirectional or bidirectional flow, and a building scenario in real-world. Simulation results show that the modified social force model including detour behavior could reduce the frequency of collision and deadlock, increase the average speed of the crowd, and predict more practical crowd dynamics with detour behavior. This model can also be potentially applied to understand the pedestrian dynamics and design emergent management strategies for crowd evacuations.

Payoff Information Biases a Fast Guess Process in Perceptual Decision Making under Deadline Pressure: Evidence from Behavior, Evoked Potentials, and Quantitative Model Comparison.

PubMed

Noorbaloochi, Sharareh; Sharon, Dahlia; McClelland, James L

2015-08-05

We used electroencephalography (EEG) and behavior to examine the role of payoff bias in a difficult two-alternative perceptual decision under deadline pressure in humans. The findings suggest that a fast guess process, biased by payoff and triggered by stimulus onset, occurred on a subset of trials and raced with an evidence accumulation process informed by stimulus information. On each trial, the participant judged whether a rectangle was shifted to the right or left and responded by squeezing a right- or left-hand dynamometer. The payoff for each alternative (which could be biased or unbiased) was signaled 1.5 s before stimulus onset. The choice response was assigned to the first hand reaching a squeeze force criterion and reaction time was defined as time to criterion. Consistent with a fast guess account, fast responses were strongly biased toward the higher-paying alternative and the EEG exhibited an abrupt rise in the lateralized readiness potential (LRP) on a subset of biased payoff trials contralateral to the higher-paying alternative ∼ 150 ms after stimulus onset and 50 ms before stimulus information influenced the LRP. This rise was associated with poststimulus dynamometer activity favoring the higher-paying alternative and predicted choice and response time. Quantitative modeling supported the fast guess account over accounts of payoff effects supported in other studies. Our findings, taken with previous studies, support the idea that payoff and prior probability manipulations produce flexible adaptations to task structure and do not reflect a fixed policy for the integration of payoff and stimulus information. Humans and other animals often face situations in which they must make choices based on uncertain sensory information together with information about expected outcomes (gains or losses) about each choice. We investigated how differences in payoffs between available alternatives affect neural activity, overt choice, and the timing of choice responses. In our experiment, in which participants were under strong time pressure, neural and behavioral findings together with model fitting suggested that our human participants often made a fast guess toward the higher reward rather than integrating stimulus and payoff information. Our findings, taken with findings from other studies, support the idea that payoff and prior probability manipulations produce flexible adaptations to task structure and do not reflect a fixed policy. Copyright © 2015 the authors 0270-6474/15/3510989-23$15.00/0.

Model of rhythmic ball bouncing using a visually controlled neural oscillator.

PubMed

Avrin, Guillaume; Siegler, Isabelle A; Makarov, Maria; Rodriguez-Ayerbe, Pedro

2017-10-01

The present paper investigates the sensory-driven modulations of central pattern generator dynamics that can be expected to reproduce human behavior during rhythmic hybrid tasks. We propose a theoretical model of human sensorimotor behavior able to account for the observed data from the ball-bouncing task. The novel control architecture is composed of a Matsuoka neural oscillator coupled with the environment through visual sensory feedback. The architecture's ability to reproduce human-like performance during the ball-bouncing task in the presence of perturbations is quantified by comparison of simulated and recorded trials. The results suggest that human visual control of the task is achieved online. The adaptive behavior is made possible by a parametric and state control of the limit cycle emerging from the interaction of the rhythmic pattern generator, the musculoskeletal system, and the environment. NEW & NOTEWORTHY The study demonstrates that a behavioral model based on a neural oscillator controlled by visual information is able to accurately reproduce human modulations in a motor action with respect to sensory information during the rhythmic ball-bouncing task. The model attractor dynamics emerging from the interaction between the neuromusculoskeletal system and the environment met task requirements, environmental constraints, and human behavioral choices without relying on movement planning and explicit internal models of the environment. Copyright © 2017 the American Physiological Society.

Social signals of safety and risk confer utility and have asymmetric effects on observers' choices.

PubMed

Chung, Dongil; Christopoulos, George I; King-Casas, Brooks; Ball, Sheryl B; Chiu, Pearl H

2015-06-01

Individuals' risk attitudes are known to guide choices about uncertain options. However, in the presence of others' decisions, these choices can be swayed and manifest as riskier or safer behavior than one would express alone. To test the mechanisms underlying effective social 'nudges' in human decision-making, we used functional neuroimaging and a task in which participants made choices about gambles alone and after observing others' selections. Against three alternative explanations, we found that observing others' choices of gambles increased the subjective value (utility) of those gambles for the observer. This 'other-conferred utility' was encoded in ventromedial prefrontal cortex, and these neural signals predicted conformity. We further identified a parametric interaction with individual risk preferences in anterior cingulate cortex and insula. These data provide a neuromechanistic account of how information from others is integrated with individual preferences that may explain preference-congruent susceptibility to social signals of safety and risk.

MouSensor: A Versatile Genetic Platform to Create Super Sniffer Mice for Studying Human Odor Coding.

PubMed

D'Hulst, Charlotte; Mina, Raena B; Gershon, Zachary; Jamet, Sophie; Cerullo, Antonio; Tomoiaga, Delia; Bai, Li; Belluscio, Leonardo; Rogers, Matthew E; Sirotin, Yevgeniy; Feinstein, Paul

2016-07-26

Typically, ∼0.1% of the total number of olfactory sensory neurons (OSNs) in the main olfactory epithelium express the same odorant receptor (OR) in a singular fashion and their axons coalesce into homotypic glomeruli in the olfactory bulb. Here, we have dramatically increased the total number of OSNs expressing specific cloned OR coding sequences by multimerizing a 21-bp sequence encompassing the predicted homeodomain binding site sequence, TAATGA, known to be essential in OR gene choice. Singular gene choice is maintained in these "MouSensors." In vivo synaptopHluorin imaging of odor-induced responses by known M71 ligands shows functional glomerular activation in an M71 MouSensor. Moreover, a behavioral avoidance task demonstrates that specific odor detection thresholds are significantly decreased in multiple transgenic lines, expressing mouse or human ORs. We have developed a versatile platform to study gene choice and axon identity, to create biosensors with great translational potential, and to finally decode human olfaction. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

Serotonin Depletion Induces ‘Waiting Impulsivity' on the Human Four-Choice Serial Reaction Time Task: Cross-Species Translational Significance

PubMed Central

Worbe, Yulia; Savulich, George; Voon, Valerie; Fernandez-Egea, Emilio; Robbins, Trevor W

2014-01-01

Convergent results from animal and human studies suggest that reducing serotonin neurotransmission promotes impulsive behavior. Here, serotonin depletion was induced by the dietary tryptophan depletion procedure (TD) in healthy volunteers to examine the role of serotonin in impulsive action and impulsive choice. We used a novel translational analog of a rodent 5-choice serial reaction time task (5-CSRTT)— the human 4-CSRTT—and a reward delay-discounting questionnaire to measure effects on these different forms of ‘waiting impulsivity'. There was no effect of TD on impulsive choice as indexed by the reward delay-discounting questionnaire. However, TD significantly increased 4-CSRTT premature responses (or impulsive action), which is remarkably similar to the previous findings of effect of serotonin depletion on rodent 5-CSRTT performance. Moreover, the increased premature responding in TD correlated significantly with individual differences on the motor impulsivity subscale of the Barratt Impulsivity Scale. TD also improved the accuracy of performance and speeded responding, possibly indicating enhanced attention and reward processing. The results suggest: (i) the 4-CSRTT will be a valuable addition to the tests already available to measure impulsivity in humans in a direct translational analog of a test extensively used in rodents; (ii) TD in humans produces a qualitatively similar profile of effects to those in rodents (ie, enhancing premature responding), hence supporting the conclusion that TD in humans exerts at least some of its effects on central serotonin; and (iii) this manipulation of serotonin produces dissociable effects on different measures of impulsivity, suggesting considerable specificity in its modulatory role. PMID:24385133

Relatively high motivation for context-evoked reward produces the magnitude effect in rats.

PubMed

Yuki, Shoko; Okanoya, Kazuo

2014-09-01

Using a concurrent-chain schedule, we demonstrated the effect of absolute reinforcement (i.e., the magnitude effect) on choice behavior in rats. In general, animals' simultaneous choices conform to a relative reinforcement ratio between alternatives. However, studies in pigeons and rats have found that on a concurrent-chain schedule, the overall reinforcement ratio, or absolute amount, also influences choice. The effect of reinforcement amount has also been studied in inter-temporal choice situations, and this effect has been referred to as the magnitude effect. The magnitude effect has been observed in humans under various conditions, but little research has assessed it in animals (e.g., pigeons and rats). The present study confirmed the effect of reinforcement amount in rats during simultaneous and inter-temporal choice situations. We used a concurrent-chain procedure to examine the cause of the magnitude effect during inter-temporal choice. Our results suggest that rats can use differences in reinforcement amount as a contextual cue during choice, and the direction of the magnitude effect in rats might be similar to humans when using the present procedure. Furthermore, our results indicate that the magnitude effect was caused by the initial-link effect when the reinforcement amount was relatively small, while a loss aversion tendency was observed when the reinforcement amount changed within a session. The emergence of the initial-link effect and loss aversion suggests that rats make choices through cognitive processes predicted by prospect theory. Copyright © 2014 Elsevier B.V. All rights reserved.

Neural Correlates of Dynamically Evolving Interpersonal Ties Predict Prosocial Behavior

PubMed Central

Fahrenfort, Johannes J.; van Winden, Frans; Pelloux, Benjamin; Stallen, Mirre; Ridderinkhof, K. Richard

2011-01-01

There is a growing interest for the determinants of human choice behavior in social settings. Upon initial contact, investment choices in social settings can be inherently risky, as the degree to which the other person will reciprocate is unknown. Nevertheless, people have been shown to exhibit prosocial behavior even in one-shot laboratory settings where all interaction has been taken away. A logical step has been to link such behavior to trait empathy-related neurobiological networks. However, as a social interaction unfolds, the degree of uncertainty with respect to the expected payoff of choice behavior may change as a function of the interaction. Here we attempt to capture this factor. We show that the interpersonal tie one develops with another person during interaction – rather than trait empathy – motivates investment in a public good that is shared with an anonymous interaction partner. We examined how individual differences in trait empathy and interpersonal ties modulate neural responses to imposed monetary sharing. After, but not before interaction in a public good game, sharing prompted activation of neural systems associated with reward (striatum), empathy (anterior insular cortex and anterior cingulate cortex) as well as altruism, and social significance [posterior superior temporal sulcus (pSTS)]. Although these activations could be linked to both empathy and interpersonal ties, only tie-related pSTS activation predicted prosocial behavior during subsequent interaction, suggesting a neural substrate for keeping track of social relevance. PMID:22403524

An integrated brain-behavior model for working memory.

PubMed

Moser, D A; Doucet, G E; Ing, A; Dima, D; Schumann, G; Bilder, R M; Frangou, S

2017-12-05

Working memory (WM) is a central construct in cognitive neuroscience because it comprises mechanisms of active information maintenance and cognitive control that underpin most complex cognitive behavior. Individual variation in WM has been associated with multiple behavioral and health features including demographic characteristics, cognitive and physical traits and lifestyle choices. In this context, we used sparse canonical correlation analyses (sCCAs) to determine the covariation between brain imaging metrics of WM-network activation and connectivity and nonimaging measures relating to sensorimotor processing, affective and nonaffective cognition, mental health and personality, physical health and lifestyle choices derived from 823 healthy participants derived from the Human Connectome Project. We conducted sCCAs at two levels: a global level, testing the overall association between the entire imaging and behavioral-health data sets; and a modular level, testing associations between subsets of the two data sets. The behavioral-health and neuroimaging data sets showed significant interdependency. Variables with positive correlation to the neuroimaging variate represented higher physical endurance and fluid intelligence as well as better function in multiple higher-order cognitive domains. Negatively correlated variables represented indicators of suboptimal cardiovascular and metabolic control and lifestyle choices such as alcohol and nicotine use. These results underscore the importance of accounting for behavioral-health factors in neuroimaging studies of WM and provide a neuroscience-informed framework for personalized and public health interventions to promote and maintain the integrity of the WM network.Molecular Psychiatry advance online publication, 5 December 2017; doi:10.1038/mp.2017.247.

Quantifying Engagement: Measuring Player Involvement in Human-Avatar Interactions

PubMed Central

Norris, Anne E.; Weger, Harry; Bullinger, Cory; Bowers, Alyssa

2014-01-01

This research investigated the merits of using an established system for rating behavioral cues of involvement in human dyadic interactions (i.e., face-to-face conversation) to measure involvement in human-avatar interactions. Gameplay audio-video and self-report data from a Feasibility Trial and Free Choice study of an effective peer resistance skill building simulation game (DRAMA-RAMA™) were used to evaluate reliability and validity of the rating system when applied to human-avatar interactions. The Free Choice study used a revised game prototype that was altered to be more engaging. Both studies involved girls enrolled in a public middle school in Central Florida that served a predominately Hispanic (greater than 80%), low-income student population. Audio-video data were coded by two raters, trained in the rating system. Self-report data were generated using measures of perceived realism, predictability and flow administered immediately after game play. Hypotheses for reliability and validity were supported: Reliability values mirrored those found in the human dyadic interaction literature. Validity was supported by factor analysis, significantly higher levels of involvement in Free Choice as compared to Feasibility Trial players, and correlations between involvement dimension sub scores and self-report measures. Results have implications for the science of both skill-training intervention research and game design. PMID:24748718

Choosy but not chaste: multiple mating in human females.

PubMed

Scelza, Brooke A

2013-01-01

When Charles Darwin set out to relate his theory of evolution by natural selection to humans he discovered that a complementary explanation was needed to properly understand the great variation seen in human behavior. The resulting work, The Descent of Man and Selection in Relation to Sex, laid out the defining principles and evidence of sexual selection. In brief, this work is best known for illuminating the typically male strategy of intrasexual competition and the typically female response of intersexual choice. While these sexual stereotypes were first laid out by Darwin, they grew in importance when, years later, A. J. Bateman, in a careful study of Drosophila mating strategies, noted that multiple mating appeared to provide great benefit to male reproductive success, but to have no such effect on females. As a result, female choice soon became synonymous with being coy, and only males were thought to gain from promiscuous behavior. However, the last thirty years of research have served to question much of the traditional wisdom about sex differences proposed by Darwin and Bateman, illuminating the many ways that women (and females more generally) can and do engage in multiple mating. Copyright © 2013 Wiley Periodicals, Inc.

Multiple Neural Mechanisms of Decision Making and Their Competition under Changing Risk Pressure

PubMed Central

Kolling, Nils; Wittmann, Marco; Rushworth, Matthew F.S.

2014-01-01

Summary Sometimes when a choice is made, the outcome is not guaranteed and there is only a probability of its occurrence. Each individual’s attitude to probability, sometimes called risk proneness or aversion, has been assumed to be static. Behavioral ecological studies, however, suggest such attitudes are dynamically modulated by the context an organism finds itself in; in some cases, it may be optimal to pursue actions with a low probability of success but which are associated with potentially large gains. We show that human subjects rapidly adapt their use of probability as a function of current resources, goals, and opportunities for further foraging. We demonstrate that dorsal anterior cingulate cortex (dACC) carries signals indexing the pressure to pursue unlikely choices and signals related to the taking of such choices. We show that dACC exerts this control over behavior when it, rather than ventromedial prefrontal cortex, interacts with posterior cingulate cortex. PMID:24607236

Dynamic modulation of decision biases by brainstem arousal systems.

PubMed

de Gee, Jan Willem; Colizoli, Olympia; Kloosterman, Niels A; Knapen, Tomas; Nieuwenhuis, Sander; Donner, Tobias H

2017-04-11

Decision-makers often arrive at different choices when faced with repeated presentations of the same evidence. Variability of behavior is commonly attributed to noise in the brain's decision-making machinery. We hypothesized that phasic responses of brainstem arousal systems are a significant source of this variability. We tracked pupil responses (a proxy of phasic arousal) during sensory-motor decisions in humans, across different sensory modalities and task protocols. Large pupil responses generally predicted a reduction in decision bias. Using fMRI, we showed that the pupil-linked bias reduction was (i) accompanied by a modulation of choice-encoding pattern signals in parietal and prefrontal cortex and (ii) predicted by phasic, pupil-linked responses of a number of neuromodulatory brainstem centers involved in the control of cortical arousal state, including the noradrenergic locus coeruleus. We conclude that phasic arousal suppresses decision bias on a trial-by-trial basis, thus accounting for a significant component of the variability of choice behavior.

Dynamic modulation of decision biases by brainstem arousal systems

PubMed Central

de Gee, Jan Willem; Colizoli, Olympia; Kloosterman, Niels A; Knapen, Tomas; Nieuwenhuis, Sander; Donner, Tobias H

2017-01-01

Decision-makers often arrive at different choices when faced with repeated presentations of the same evidence. Variability of behavior is commonly attributed to noise in the brain’s decision-making machinery. We hypothesized that phasic responses of brainstem arousal systems are a significant source of this variability. We tracked pupil responses (a proxy of phasic arousal) during sensory-motor decisions in humans, across different sensory modalities and task protocols. Large pupil responses generally predicted a reduction in decision bias. Using fMRI, we showed that the pupil-linked bias reduction was (i) accompanied by a modulation of choice-encoding pattern signals in parietal and prefrontal cortex and (ii) predicted by phasic, pupil-linked responses of a number of neuromodulatory brainstem centers involved in the control of cortical arousal state, including the noradrenergic locus coeruleus. We conclude that phasic arousal suppresses decision bias on a trial-by-trial basis, thus accounting for a significant component of the variability of choice behavior. DOI: http://dx.doi.org/10.7554/eLife.23232.001 PMID:28383284

Aberrant Food Choices after Satiation in Human Orexin-Deficient Narcolepsy Type 1

PubMed Central

van Holst, Ruth Janke; van der Cruijsen, Lisa; van Mierlo, Petra; Lammers, Gert Jan; Cools, Roshan; Overeem, Sebastiaan; Aarts, Esther

2016-01-01

Study Objectives: Besides influencing vigilance, orexin neurotransmission serves a variety of functions, including reward, motivation, and appetite regulation. As obesity is an important symptom in orexin-deficient narcolepsy, we explored the effects of satiety on food-related choices and spontaneous snack intake in patients with narcolepsy type 1 (n = 24) compared with healthy matched controls (n = 19). In additional analyses, we also included patients with idiopathic hypersomnia (n = 14) to assess sleepiness-related influences. Methods: Participants were first trained on a choice task to earn salty and sweet snacks. Next, one of the snack outcomes was devalued by having participants consume it until satiation (i.e., sensory-specific satiety). We then measured the selective reduction in choices for the devalued snack outcome. Finally, we assessed the number of calories that participants consumed spontaneously from ad libitum available snacks afterwards. Results: After satiety, all participants reported reduced hunger and less wanting for the devalued snack. However, while controls and idiopathic hypersomnia patients chose the devalued snack less often in the choice task, patients with narcolepsy still chose the devalued snack as often as before satiety. Subsequently, narcolepsy patients spontaneously consumed almost 4 times more calories during ad libitum snack intake. Conclusions: We show that the manipulation of food-specific satiety has reduced effects on food choices and caloric intake in narcolepsy type 1 patients. These mechanisms may contribute to their obesity, and suggest an important functional role for orexin in human eating behavior. Clinical Trials Registration: Study registered at Netherlands Trial Register. URL: www.trialregister.nl. Trial ID: NTR4508. Citation: van Holst RJ, van der Cruijsen L, van Mierlo P, Lammers GJ, Cools R, Overeem S, Aarts E. Aberrant food choices after satiation in human orexindeficient narcolepsy type 1. SLEEP 2016;39(11):1951–1959. PMID:27568806

Animal Experimentation: Issues for the 1980s.

ERIC Educational Resources Information Center

Zola, Judith C.; And Others

1984-01-01

Examines the extent to which issues related to animal experimentation are in conflict and proposes choices that might least comprise them. These issues include animal well-being, human well-being, self-interest of science, scientific validity and responsibility, progress in biomedical and behavioral science, and the future quality of medical care.…

Proceedings--symposium on recreation choice behavior

Treesearch

George H. Stankey; Stephen F. McCool

1985-01-01

Presents an overview paper and 11 contributed papers focused on the issue of the processes that underlie decision making by recreationists. The papers span a range of topics including the theory of choice behavior, empirical investigations of choice, and methodological approaches to the study of choice behavior.

Chance, choice, and the future of reproduction.

PubMed

Miller, W B

1983-11-01

The evolution of reproduction has been characterized by the development of complex biological and behavioral mechanisms that serve to regulate chance events. Human reproduction has been characterized by the increasing importance of individual choice. Some contemporary manifestations of this broad trend are the high incidence of contraceptive and "proceptive" behavior among couples in Western, industrialized nations. The former behavior willingly attempts to prevent conception while the latter actively attempts to induce conception (such as concentrating intercourse around the time of ovulation). Both patterns of behavior indicate that a choice is being made. A 3-year study of 1000 women revealed proceptive behavior as the most important factor predicting occurance of conception among married couples in the United States. The general strategeis people follow while making childbearing decisions: termination, sequencing, and pre-planning form a continuum following the historical trend toward greater reproductive control. In the terminating strategy, a couple makes no decision about child bearing until the number of children they have become enough or too much. In the sequencing strategy, decisions to have children are made 1 child at a time until a satisfactory limit is reached. In the pre-planning strategy, a plan is worked out ahead of time and is subsequently carried out. As new reproductive technology is introduced and as progressive change is made in society's reproductive related values and beliefs, choice will continue to dominate chance as the highly likely trend for the future of reproduction. Surrogate maternity is just 1 example of this trend. However, these new options, which culminate in the theory and practice of "progensis," (still in its infancy), as well as offering a rich opportunity, can also incur psychological burdens on a couple. Thus, as with any kind of freedom, these developments will require care, caution and responsibility.

‘Put Your Money Where Your Mouth Is!’: Effects of Streaks on Confidence and Betting in a Binary Choice Task

PubMed Central

Studer, Bettina; Limbrick-Oldfield, Eve H; Clark, Luke

2015-01-01

Human choice under uncertainty is influenced by erroneous beliefs about randomness. In simple binary choice tasks, such as red/black predictions in roulette, long outcome runs (e.g. red, red, red) typically increase the tendency to predict the other outcome (i.e. black), an effect labeled the “gambler's fallacy.” In these settings, participants may also attend to streaks in their predictive performance. Winning and losing streaks are thought to affect decision confidence, although prior work indicates conflicting directions. Over three laboratory experiments involving red/black predictions in a sequential roulette task, we sought to identify the effects of outcome runs and winning/losing streaks upon color predictions, decision confidence and betting behavior. Experiments 1 (n = 40) and 3 (n = 40) obtained trial-by-trial confidence ratings, with a win/no win payoff and a no loss/loss payoff, respectively. Experiment 2 (n = 39) obtained a trial-by-trial bet amount on an equivalent scale. In each experiment, the gambler's fallacy was observed on choice behavior after color runs and, in experiment 2, on betting behavior after color runs. Feedback streaks exerted no reliable influence on confidence ratings, in either payoff condition. Betting behavior, on the other hand, increased as a function of losing streaks. The increase in betting on losing streaks is interpreted as a manifestation of loss chasing; these data help clarify the psychological mechanisms underlying loss chasing and caution against the use of betting measures (“post-decision wagering”) as a straightforward index of decision confidence. © 2014 The Authors. Journal of Behavioral Decision Making published by John Wiley & Sons Ltd. PMID:26236092

'Put Your Money Where Your Mouth Is!': Effects of Streaks on Confidence and Betting in a Binary Choice Task.

PubMed

Studer, Bettina; Limbrick-Oldfield, Eve H; Clark, Luke

2015-07-01

Human choice under uncertainty is influenced by erroneous beliefs about randomness. In simple binary choice tasks, such as red/black predictions in roulette, long outcome runs (e.g. red, red, red) typically increase the tendency to predict the other outcome (i.e. black), an effect labeled the "gambler's fallacy." In these settings, participants may also attend to streaks in their predictive performance. Winning and losing streaks are thought to affect decision confidence, although prior work indicates conflicting directions. Over three laboratory experiments involving red/black predictions in a sequential roulette task, we sought to identify the effects of outcome runs and winning/losing streaks upon color predictions, decision confidence and betting behavior. Experiments 1 ( n  = 40) and 3 ( n  = 40) obtained trial-by-trial confidence ratings, with a win/no win payoff and a no loss/loss payoff, respectively. Experiment 2 ( n  = 39) obtained a trial-by-trial bet amount on an equivalent scale. In each experiment, the gambler's fallacy was observed on choice behavior after color runs and, in experiment 2, on betting behavior after color runs. Feedback streaks exerted no reliable influence on confidence ratings, in either payoff condition. Betting behavior, on the other hand, increased as a function of losing streaks. The increase in betting on losing streaks is interpreted as a manifestation of loss chasing; these data help clarify the psychological mechanisms underlying loss chasing and caution against the use of betting measures ("post-decision wagering") as a straightforward index of decision confidence. © 2014 The Authors. Journal of Behavioral Decision Making published by John Wiley & Sons Ltd.

Cognitive regulation during decision making shifts behavioral control between ventromedial and dorsolateral prefrontal value systems.

PubMed

Hutcherson, Cendri A; Plassmann, Hilke; Gross, James J; Rangel, Antonio

2012-09-26

Cognitive regulation is often used to influence behavioral outcomes. However, the computational and neurobiological mechanisms by which it affects behavior remain unknown. We studied this issue using an fMRI task in which human participants used cognitive regulation to upregulate and downregulate their cravings for foods at the time of choice. We found that activity in both ventromedial prefrontal cortex (vmPFC) and dorsolateral prefrontal cortex (dlPFC) correlated with value. We also found evidence that two distinct regulatory mechanisms were at work: value modulation, which operates by changing the values assigned to foods in vmPFC and dlPFC at the time of choice, and behavioral control modulation, which operates by changing the relative influence of the vmPFC and dlPFC value signals on the action selection process used to make choices. In particular, during downregulation, activation decreased in the value-sensitive region of dlPFC (indicating value modulation) but not in vmPFC, and the relative contribution of the two value signals to behavior shifted toward the dlPFC (indicating behavioral control modulation). The opposite pattern was observed during upregulation: activation increased in vmPFC but not dlPFC, and the relative contribution to behavior shifted toward the vmPFC. Finally, ventrolateral PFC and posterior parietal cortex were more active during both upregulation and downregulation, and were functionally connected with vmPFC and dlPFC during cognitive regulation, which suggests that they help to implement the changes to the decision-making circuitry generated by cognitive regulation.

Cognitive Regulation during Decision Making Shifts Behavioral Control between Ventromedial and Dorsolateral Prefrontal Value Systems

PubMed Central

Plassmann, Hilke; Gross, James J.; Rangel, Antonio

2012-01-01

Cognitive regulation is often used to influence behavioral outcomes. However, the computational and neurobiological mechanisms by which it affects behavior remain unknown. We studied this issue using an fMRI task in which human participants used cognitive regulation to upregulate and downregulate their cravings for foods at the time of choice. We found that activity in both ventromedial prefrontal cortex (vmPFC) and dorsolateral prefrontal cortex (dlPFC) correlated with value. We also found evidence that two distinct regulatory mechanisms were at work: value modulation, which operates by changing the values assigned to foods in vmPFC and dlPFC at the time of choice, and behavioral control modulation, which operates by changing the relative influence of the vmPFC and dlPFC value signals on the action selection process used to make choices. In particular, during downregulation, activation decreased in the value-sensitive region of dlPFC (indicating value modulation) but not in vmPFC, and the relative contribution of the two value signals to behavior shifted toward the dlPFC (indicating behavioral control modulation). The opposite pattern was observed during upregulation: activation increased in vmPFC but not dlPFC, and the relative contribution to behavior shifted toward the vmPFC. Finally, ventrolateral PFC and posterior parietal cortex were more active during both upregulation and downregulation, and were functionally connected with vmPFC and dlPFC during cognitive regulation, which suggests that they help to implement the changes to the decision-making circuitry generated by cognitive regulation. PMID:23015444

Female perception of male body odor.

PubMed

Sergeant, Mark J T

2010-01-01

Olfaction is one of the most crucial forms of communication among nonhuman animals. Historically, olfaction has been perceived as being of limited importance for humans, but recent research has documented that not only do humans have sensitive olfactory abilities, but also odors have the potential to influence our physiology and behavior. This chapter reviews research on olfactory communication among humans, focusing on the effects of male bodily odors on female physiology and behavior. The process of body odor production and the detection of olfactory signals are reviewed, focusing on potential sex differences in these abilities. The effects of male body odors on female physiological and behavioral effects of body odors are considered. Finally, with specific regard to female mate choice, evidence regarding the influence of the major histocompatibility complex and fluctuating asymmetry on male olfactory cues is reviewed. Copyright © 2010 Elsevier Inc. All rights reserved.

Effects of disulfiram on choice behavior in a rodent gambling task: association with catecholamine levels.

PubMed

Di Ciano, Patricia; Manvich, Daniel F; Pushparaj, Abhiram; Gappasov, Andrew; Hess, Ellen J; Weinshenker, David; Le Foll, Bernard

2018-01-01

Gambling disorder is a growing societal concern, as recognized by its recent classification as an addictive disorder in the DSM-5. Case reports have shown that disulfiram reduces gambling-related behavior in humans. The purpose of the present study was to determine whether disulfiram affects performance on a rat gambling task, a rodent version of the Iowa gambling task in humans, and whether any changes were associated with alterations in dopamine and/or norepinephrine levels. Rats were administered disulfiram prior to testing on the rat gambling task or prior to analysis of dopamine or norepinephrine levels in brain homogenates. Rats in the behavioral task were divided into two subgroups (optimal vs suboptimal) based on their baseline levels of performance in the rat gambling task. Rats in the optimal group chose the advantageous strategy more, and rats in the suboptimal group (a parallel to problem gambling) chose the disadvantageous strategy more. Rats were not divided into optimal or suboptimal groups prior to neurochemical analysis. Disulfiram administered 2 h, but not 30 min, before the task dose-dependently improved choice behavior in the rats with an initial disadvantageous "gambling-like" strategy, while having no effect on the rats employing an advantageous strategy. The behavioral effects of disulfiram were associated with increased striatal dopamine and decreased striatal norepinephrine. These findings suggest that combined actions on dopamine and norepinephrine may be a useful treatment for gambling disorders.

The snacking rat as model of human obesity: effects of a free-choice high-fat high-sugar diet on meal patterns.

PubMed

la Fleur, S E; Luijendijk, M C M; van der Zwaal, E M; Brans, M A D; Adan, R A H

2014-05-01

Rats subjected to a free-choice high-fat high-sugar (fcHFHS) diet persistently overeat, exhibit increased food-motivated behavior and become overtly obese. Conversely, several studies using a non-choice (nc) high-energy diet showed only an initial increase in food intake with unaltered or reduced food-motivated behavior. This raises the question of the importance of choice in the persistence of hyperphagia in rats on a fcHFHS diet. Meal patterns, food intake and body weight gain were studied in male Wistar rats on free-choice diets with fat and/or sugar and in rats on nc diets with fat and sugar (custom made with ingredients similar to the fcHFHS diet). Rats on a ncHFHS diet initially overconsumed, but reduced intake thereafter, whereas rats on a fcHFHS diet remained hyperphagic. Because half of the sugar intake in the fcHFHS group occurred during the inactive period, we next determined whether sugar intake during the light phase was a necessary requirement for hyperphagia, by restricting access to liquid sugar to either the light or dark period with unlimited access to fat and chow. Results showed that hyperphagia occurred irrespective of the timing of sugar intake. Meal pattern analysis revealed consumption of larger but fewer meals in the ncHFHS group, as well as the fcHF group. Interestingly, meal number was increased in all rats drinking liquid sugar (whether on a fcHFHS or a fcHS diet), whereas a compensatory decrease in meal size was only observed in the fcHS group, but not the fcHFHS group. We hereby show the importance of choice in the observation of fcHFHS diet-induced hyperphagia, which results in increases in meal number due to sugar drinking without any compensatory decrease in meal size. We thus provide a novel dietary model in rats that mimics important features of human overconsumption that have been ignored in rodent models of obesity.

A case for human systems neuroscience.

PubMed

Gardner, J L

2015-06-18

Can the human brain itself serve as a model for a systems neuroscience approach to understanding the human brain? After all, how the brain is able to create the richness and complexity of human behavior is still largely mysterious. What better choice to study that complexity than to study it in humans? However, measurements of brain activity typically need to be made non-invasively which puts severe constraints on what can be learned about the internal workings of the brain. Our approach has been to use a combination of psychophysics in which we can use human behavioral flexibility to make quantitative measurements of behavior and link those through computational models to measurements of cortical activity through magnetic resonance imaging. In particular, we have tested various computational hypotheses about what neural mechanisms could account for behavioral enhancement with spatial attention (Pestilli et al., 2011). Resting both on quantitative measurements and considerations of what is known through animal models, we concluded that weighting of sensory signals by the magnitude of their response is a neural mechanism for efficient selection of sensory signals and consequent improvements in behavioral performance with attention. While animal models have many technical advantages over studying the brain in humans, we believe that human systems neuroscience should endeavor to validate, replicate and extend basic knowledge learned from animal model systems and thus form a bridge to understanding how the brain creates the complex and rich cognitive capacities of humans. Copyright © 2014 IBRO. Published by Elsevier Ltd. All rights reserved.

Temporal Discounting and Inter-Temporal Choice in Rhesus Monkeys

PubMed Central

Hwang, Jaewon; Kim, Soyoun; Lee, Daeyeol

2009-01-01

Humans and animals are more likely to take an action leading to an immediate reward than actions with delayed rewards of similar magnitudes. Although such devaluation of delayed rewards has been almost universally described by hyperbolic discount functions, the rate of this temporal discounting varies substantially among different animal species. This might be in part due to the differences in how the information about reward is presented to decision makers. In previous animal studies, reward delays or magnitudes were gradually adjusted across trials, so the animals learned the properties of future rewards from the rewards they waited for and consumed previously. In contrast, verbal cues have been used commonly in human studies. In the present study, rhesus monkeys were trained in a novel inter-temporal choice task in which the magnitude and delay of reward were indicated symbolically using visual cues and varied randomly across trials. We found that monkeys could extract the information about reward delays from visual symbols regardless of the number of symbols used to indicate the delay. The rate of temporal discounting observed in the present study was comparable to the previous estimates in other mammals, and the animal's choice behavior was largely consistent with hyperbolic discounting. Our results also suggest that the rate of temporal discounting might be influenced by contextual factors, such as the novelty of the task. The flexibility furnished by this new inter-temporal choice task might be useful for future neurobiological investigations on inter-temporal choice in non-human primates. PMID:19562091

Effects of Environmental Manipulations and Treatment with Bupropion and Risperidone on Choice between Methamphetamine and Food in Rhesus Monkeys.

PubMed

Banks, Matthew L; Blough, Bruce E

2015-08-01

Preclinical and human laboratory choice procedures have been invaluable in improving our knowledge of the neurobiological mechanisms of drug reinforcement and in the drug development process for candidate medications to treat drug addiction. However, little is known about the neuropharmacological mechanisms of methamphetamine vs food choice. The aims of this study were to develop a methamphetamine vs food choice procedure and determine treatment effects with two clinically relevant compounds: the monoamine uptake inhibitor bupropion and the dopamine antagonist risperidone. Rhesus monkeys (n=6) responded under a concurrent schedule of food delivery (1-g pellets, fixed-ratio (FR) 100 schedule) and intravenous methamphetamine injections (0-0.32 mg/kg/injection, FR10 schedule) during 7-day bupropion (0.32-1.8 mg/kg/h) and risperidone (0.001-0.0056 mg/kg/h) treatment periods. For comparison, effects of removing food pellets or methamphetamine injections and FR response requirement manipulations were also examined. Under saline treatment conditions, food was preferred over no methamphetamine or small unit methamphetamine doses (0.01-0.032 mg/kg/injection). Larger methamphetamine doses resulted in greater methamphetamine preference and 0.32 mg/kg/injection methamphetamine maintained near exclusive preference. Removing food availability increased methamphetamine choice, whereas removing methamphetamine availability decreased methamphetamine choice. Methamphetamine choice was not significantly altered when the FR response requirements for food and drug were the same (FR100:FR100 or FR10:FR10). Risperidone treatment increased methamphetamine choice, whereas bupropion treatment did not alter methamphetamine choice up to doses that decreased rates of operant behavior. Overall, these negative results with bupropion and risperidone are concordant with previous human laboratory and clinical trials and support the potential validity of this preclinical methamphetamine vs food choice model.

The Human Behavioral Ecology of Contemporary World Issues : Applications to Public Policy and International Development.

PubMed

Tucker, Bram; Rende Taylor, Lisa

2007-09-01

Human behavioral ecology (HBE) began as an attempt to explain human economic, reproductive, and social behavior using neodarwinian theory in concert with theory from ecology and economics, and ethnographic methods. HBE has addressed subsistence decision-making, cooperation, life history trade-offs, parental investment, mate choice, and marriage strategies among hunter-gatherers, herders, peasants, and wage earners in rural and urban settings throughout the world. Despite our rich insights into human behavior, HBE has very rarely been used as a tool to help the people with whom we work. This article introduces a special issue of Human Nature which explores the application of HBE to significant world issues through the design and critique of public policy and international development projects. The articles by Tucker, Shenk, Leonetti et al., and Neil were presented at the 104th annual meeting of the American Anthropological Association (AAA) in Washington, D.C., in December 2005, in the first organized session of the nascent Evolutionary Anthropology Section (EAS). We conclude this introduction by summarizing some theoretical challenges to applying HBE, and ways in which evolutionary anthropologists can contribute to solving tough world issues.

Alternative Reinforcer Response Cost Impacts Methamphetamine Choice in Humans

PubMed Central

Bennett, J. Adam; Stoops, William W.; Rush, Craig R.

2012-01-01

Methamphetamine use disorders are a persistent public health concern. Behavioral treatments have demonstrated that providing access to non-drug alternative reinforcers reduces methamphetamine use. The purpose of this human laboratory experiment was to determine how changes in response cost for non-drug alternative reinforcers influenced methamphetamine choice. Seven subjects with past year histories of recreational stimulant use completed a placebo-controlled, crossover, double-blind protocol in which they first sampled doses of oral methamphetamine (0, 8 or 16 mg) and completed a battery of subject-rated and physiological measures. During subsequent sessions, subjects then made eight discrete choices between 1/8th of the sampled dose and an alternative reinforcer ($0.25). The response cost to earn a methamphetamine dose was always 500 responses (FR500). The response cost for the alternative reinforcer varied across sessions (FR500, FR1000, FR2000, FR3000). Methamphetamine functioned as a positive reinforcer and produced prototypical stimulant-like effects (e.g., elevated blood pressure, increased ratings of “Stimulated”). Choice for doses over money was sensitive to changes in response cost for alternative reinforcers in that more doses were taken at higher FR values than at lower FR values. Placebo choices changed as a function of alternative reinforcer response cost to a greater degree than active methamphetamine choices. These findings suggest that manipulating the effort necessary to earn alternative reinforcers could impact methamphetamine use. PMID:23046851

What counts as a choice? U.S. Americans are more likely than Indians to construe actions as choices.

PubMed

Savani, Krishna; Markus, Hazel Rose; Naidu, N V R; Kumar, Satishchandra; Berlia, Neha

2010-03-01

People everywhere select among multiple alternatives, but are they always making choices? In five studies, we found that people in U.S. American contexts, where the disjoint model of agency is prevalent, are more likely than those in Indian contexts to construe their own and other individuals' behaviors as choices, to construe ongoing behaviors and behaviors recalled from memory as choices, to construe naturally occurring and experimentally controlled behaviors as choices, to construe mundane and important actions as choices, and to construe personal and interpersonal actions as choices. Indians showed a greater tendency to construe actions as choices when these actions involved responding to other people than when they did not. These findings show that whether people construe actions as choices is significantly shaped by sociocultural systems of meanings and practices. Together, they suggest that the positive consequences associated with maximizing the availability of personal choice may not be universal and instead may be limited to North American contexts.

Alternative Reinforcer Response Cost Impacts Cocaine Choice in Humans

PubMed Central

Stoops, William W.; Lile, Joshua A.; Glaser, Paul E.A.; Hays, Lon R.; Rush, Craig R.

2011-01-01

Cocaine use disorders are an unrelenting public health concern. Behavioral treatments reduce cocaine use by providing non-drug alternative reinforcers. The purpose of this human laboratory experiment was to determine how response cost for non-drug alternative reinforcers influenced cocaine choice. Seven cocaine-using, non-treatment-seeking subjects completed a crossover, double-blind protocol in which they first sampled doses of intranasal cocaine (5, 10, 20 or 30 mg) and completed a battery of subject-rated and physiological measures. Subjects then made eight discrete choices between the sampled dose and an alternative reinforce (US$0.25). The response cost to earn a cocaine dose was always a fixed ratio (FR) of 100 responses. The response cost for the alternative reinforcer varied across sessions (FR1, FR10, FR100, FR1000). Dose-related increases were observed for cocaine choice. Subjects made fewer drug choices when the FR requirements for the alternative reinforcers were lower than that for drug relative to when the FR requirements were equal to or higher than that for drug. Intranasal cocaine also produced prototypical stimulant-like subject-rated and physiological effects (e.g., increased ratings of Like Drug; elevated blood pressure). These data demonstrate that making alternative reinforcers easier to earn reduces cocaine self-administration, which has implications for treatment efforts. PMID:22015480

Mechanisms of impulsive choice: II. Time-based interventions to improve self-control

PubMed Central

Smith, Aaron P.; Marshall, Andrew T.; Kirkpatrick, Kimberly

2014-01-01

Impulsive choice behavior has been proposed as a primary risk factor for other maladaptive behaviors (e.g., gambling, substance abuse). Recent research has suggested that timing processes may play a key role in impulsive choice behavior, and could provide an avenue for altering impulsive choice. Accordingly, the current experiments assessed a set of time-based behavioral interventions to increase self-control while simultaneously assessing effects on timing processes within the impulsive choice task. Three experiments assessed temporal interventions using a differential reinforcement of low rates task (Experiment 1) and exposure to either a variable or fixed interval schedule (Experiments 2–3). The efficacy of the interventions was assessed in Sprague-Dawley (Experiments 1–2) and Lewis (Experiment 3) rat strains. Impulsive choice behavior was assessed by measuring preferences of a smaller-sooner (SS) versus a larger-later (LL) reward, while timing of the SS and LL durations was measured during peak trials within the impulsive choice procedure. The rats showed an increased preference for the LL following all three time-based interventions and also displayed increased temporal precision. These results add to the increasing evidence that supports a possible role for temporal processing in impulsive choice behavior and supply novel behavioral interventions to decrease impulsive behavior. PMID:25444771

Fear no colors? Observer clothing color influences lizard escape behavior

PubMed Central

Drury, Jonathan P.; Blumstein, Daniel T.; Pauly, Gregory B.

2017-01-01

Animals often view humans as predators, leading to alterations in their behavior. Even nuanced aspects of human activity like clothing color affect animal behavior, but we lack an understanding of when and where such effects will occur. The species confidence hypothesis posits that birds are attracted to colors found on their bodies and repelled by non-body colors. Here, we extend this hypothesis taxonomically and conceptually to test whether this pattern is applicable in a non-avian reptile and to suggest that species should respond less fearfully to their sexually-selected signaling color. Responses to clothing color could also be impacted by habituation to humans, so we examine whether behavior varied between areas with low and high human activity. We quantified the effects of four T-shirt colors on flight initiation distances (FID) and on the ease of capture in western fence lizards (Sceloporus occidentalis), and we accounted for detectability against the background environment. We found no differences in lizard behavior between sites. However, lizards tolerated the closest approaches and were most likely to be captured when approached with the T-shirt that resembled their sexually-selected signaling color. Because changes in individual behavior affect fitness, choice of clothing color by people, including tourists, hikers, and researchers, could impact wildlife populations and research outcomes. PMID:28792983

Fear no colors? Observer clothing color influences lizard escape behavior.

PubMed

Putman, Breanna J; Drury, Jonathan P; Blumstein, Daniel T; Pauly, Gregory B

2017-01-01

Animals often view humans as predators, leading to alterations in their behavior. Even nuanced aspects of human activity like clothing color affect animal behavior, but we lack an understanding of when and where such effects will occur. The species confidence hypothesis posits that birds are attracted to colors found on their bodies and repelled by non-body colors. Here, we extend this hypothesis taxonomically and conceptually to test whether this pattern is applicable in a non-avian reptile and to suggest that species should respond less fearfully to their sexually-selected signaling color. Responses to clothing color could also be impacted by habituation to humans, so we examine whether behavior varied between areas with low and high human activity. We quantified the effects of four T-shirt colors on flight initiation distances (FID) and on the ease of capture in western fence lizards (Sceloporus occidentalis), and we accounted for detectability against the background environment. We found no differences in lizard behavior between sites. However, lizards tolerated the closest approaches and were most likely to be captured when approached with the T-shirt that resembled their sexually-selected signaling color. Because changes in individual behavior affect fitness, choice of clothing color by people, including tourists, hikers, and researchers, could impact wildlife populations and research outcomes.

Sensitivity to cognitive effort mediates psychostimulant effects on a novel rodent cost/benefit decision-making task.

PubMed

Cocker, Paul J; Hosking, Jay G; Benoit, James; Winstanley, Catharine A

2012-07-01

Amotivational states and insufficient recruitment of mental effort have been observed in a variety of clinical populations, including depression, traumatic brain injury, post-traumatic stress disorder, and attention deficit hyperactivity disorder. Previous rodent models of effort-based decision making have utilized physical costs whereas human studies of effort are primarily cognitive in nature, and it is unclear whether the two types of effortful decision making are underpinned by the same neurobiological processes. We therefore designed a novel rat cognitive effort task (rCET) based on the 5-choice serial reaction time task, a well-validated measure of attention and impulsivity. Within each trial of the rCET, rats are given the choice between an easy or hard visuospatial discrimination, and successful hard trials are rewarded with double the number of sugar pellets. Similar to previous human studies, stable individual variation in choice behavior was observed, with 'workers' choosing hard trials significantly more than their 'slacker' counterparts. Whereas workers 'slacked off' in response to administration of amphetamine and caffeine, slackers 'worked harder' under amphetamine, but not caffeine. Conversely, these stimulants increased motor impulsivity in all animals. Ethanol did not affect animals' choice but invigorated behavior. In sum, we have shown for the first time that rats are differentially sensitive to cognitive effort when making decisions, independent of other processes such as impulsivity, and these baseline differences can influence the cognitive response to psychostimulants. Such findings could inform our understanding of impairments in effort-based decision making and contribute to treatment development.

Sensitivity to Cognitive Effort Mediates Psychostimulant Effects on a Novel Rodent Cost/Benefit Decision-Making Task

PubMed Central

Cocker, Paul J; Hosking, Jay G; Benoit, James; Winstanley, Catharine A

2012-01-01

Amotivational states and insufficient recruitment of mental effort have been observed in a variety of clinical populations, including depression, traumatic brain injury, post-traumatic stress disorder, and attention deficit hyperactivity disorder. Previous rodent models of effort-based decision making have utilized physical costs whereas human studies of effort are primarily cognitive in nature, and it is unclear whether the two types of effortful decision making are underpinned by the same neurobiological processes. We therefore designed a novel rat cognitive effort task (rCET) based on the 5-choice serial reaction time task, a well-validated measure of attention and impulsivity. Within each trial of the rCET, rats are given the choice between an easy or hard visuospatial discrimination, and successful hard trials are rewarded with double the number of sugar pellets. Similar to previous human studies, stable individual variation in choice behavior was observed, with ‘workers' choosing hard trials significantly more than their ‘slacker' counterparts. Whereas workers ‘slacked off' in response to administration of amphetamine and caffeine, slackers ‘worked harder' under amphetamine, but not caffeine. Conversely, these stimulants increased motor impulsivity in all animals. Ethanol did not affect animals' choice but invigorated behavior. In sum, we have shown for the first time that rats are differentially sensitive to cognitive effort when making decisions, independent of other processes such as impulsivity, and these baseline differences can influence the cognitive response to psychostimulants. Such findings could inform our understanding of impairments in effort-based decision making and contribute to treatment development. PMID:22453140

Selectivity in early prosocial behavior

PubMed Central

Kuhlmeier, Valerie A.; Dunfield, Kristen A.; O’Neill, Amy C.

2014-01-01

Prosocial behavior requires expenditure of personal resources for the benefit of others, a fact that creates a “problem” when considering the evolution of prosociality. Models that address this problem have been developed, with emphasis typically placed on reciprocity. One model considers the advantages of being selective in terms of one’s allocation of prosocial behavior so as to improve the chance that one will be benefitted in return. In this review paper, we first summarize this “partner choice” model and then focus on prosocial development in the preschool years, where we make the case for selective partner choice in early instances of human prosocial behavior. PMID:25120526

Education and Conservation Benefits of Marine Wildlife Tours: Developing Free-Choice Learning Experiences

ERIC Educational Resources Information Center

Zeppel, Heather

2008-01-01

Marine wildlife tours can provide a range of education and conservation benefits for visitors, including emotional (i.e., affective) responses and learning (i.e., cognition). Interpretive programs cover the biology, ecology, and behavior of marine species; best practice guidelines; and human threats to marine areas. The author reviews the…

Verbal Word Choice of Effective Reading Teachers

ERIC Educational Resources Information Center

Moran, Kelly A.

2013-01-01

Humans are fragile beings easily influenced by the verbal behaviors of others. Spoken words can have a multitude of effects on an individual, and the phrases and statements teachers use in their classrooms on a daily basis have the potential to be either detrimental or inspirational. As increasing numbers of students arrive at schools from broken…

Facilitation of Learning by Social-Emotional Feedback in Humans Is Beta-Noradrenergic-Dependent

ERIC Educational Resources Information Center

Mihov, Yoan; Mayer, Simon; Musshoff, Frank; Maier, Wolfgang; Kendrick, Keith M.; Hurlemann, Rene

2010-01-01

Adaptive behavior in dynamic environments critically depends on the ability to learn rapidly and flexibly from the outcomes of prior choices. In social environments, facial expressions of emotion often serve as performance feedback and thereby guide declarative learning. Abundant evidence implicates beta-noradrenergic signaling in the modulatory…

A Social Cognitive Examination of East Asian American Career Development: Contextual Factors Influencing Career Choice

ERIC Educational Resources Information Center

Liu, Jane

2012-01-01

Despite their educational and economic achievements in the United States, Asian Americans continue to be occupationally segregated in the labor force. Asian Americans are overrepresented in mathematics, engineering and biological sciences while underrepresented in field such as education, humanities, social and behavioral sciences (Bureau of Labor…

Sex ratio and women's career choice: does a scarcity of men lead women to choose briefcase over baby?

PubMed

Durante, Kristina M; Griskevicius, Vladas; Simpson, Jeffry A; Cantú, Stephanie M; Tybur, Joshua M

2012-07-01

Although the ratio of males to females in a population is known to influence behavior in nonhuman animals, little is known about how sex ratio influences human behavior. We propose that sex ratio affects women's family planning and career choices. Using both historical data and experiments, we examined how sex ratio influences women's career aspirations. Findings showed that a scarcity of men led women to seek high-paying careers and to delay starting a family. This effect was driven by how sex ratio altered the mating market, not just the job market. Sex ratios involving a scarcity of men led women to seek lucrative careers because of the difficulty women have in finding an investing, long-term mate under such circumstances. Accordingly, this low-male sex ratio produced the strongest desire for lucrative careers in women who are least able to secure a mate. These findings demonstrate that sex ratio has far-reaching effects in humans, including whether women choose briefcase over baby. PsycINFO Database Record (c) 2012 APA, all rights reserved

Diminished neural responses predict enhanced intrinsic motivation and sensitivity to external incentive.

PubMed

Marsden, Karen E; Ma, Wei Ji; Deci, Edward L; Ryan, Richard M; Chiu, Pearl H

2015-06-01

The duration and quality of human performance depend on both intrinsic motivation and external incentives. However, little is known about the neuroscientific basis of this interplay between internal and external motivators. Here, we used functional magnetic resonance imaging to examine the neural substrates of intrinsic motivation, operationalized as the free-choice time spent on a task when this was not required, and tested the neural and behavioral effects of external reward on intrinsic motivation. We found that increased duration of free-choice time was predicted by generally diminished neural responses in regions associated with cognitive and affective regulation. By comparison, the possibility of additional reward improved task accuracy, and specifically increased neural and behavioral responses following errors. Those individuals with the smallest neural responses associated with intrinsic motivation exhibited the greatest error-related neural enhancement under the external contingency of possible reward. Together, these data suggest that human performance is guided by a "tonic" and "phasic" relationship between the neural substrates of intrinsic motivation (tonic) and the impact of external incentives (phasic).

Linking dynamic patterns of neural activity in orbitofrontal cortex with decision making.

PubMed

Rich, Erin L; Stoll, Frederic M; Rudebeck, Peter H

2018-04-01

Humans and animals demonstrate extraordinary flexibility in choice behavior, particularly when deciding based on subjective preferences. We evaluate options on different scales, deliberate, and often change our minds. Little is known about the neural mechanisms that underlie these dynamic aspects of decision-making, although neural activity in orbitofrontal cortex (OFC) likely plays a central role. Recent evidence from studies in macaques shows that attention modulates value responses in OFC, and that ensembles of OFC neurons dynamically signal different options during choices. When contexts change, these ensembles flexibly remap to encode the new task. Determining how these dynamic patterns emerge and relate to choices will inform models of decision-making and OFC function. Copyright © 2017 Elsevier Ltd. All rights reserved.

Let the sunshine in? The effects of luminance on economic preferences, choice consistency and dominance violations

PubMed Central

Glimcher, Paul W.

2017-01-01

Weather, in particular the intensity and duration of sunshine (luminance), has been shown to significantly affect financial markets. Yet, because of the complexity of market interactions we do not know how human behavior is affected by luminance in a way that could inform theoretical choice models. In this paper, we use data from a field study using an incentive-compatible, decision task conducted daily over a period of two years and from the US Earth System Research Laboratory luminance sensor to investigate the impact of luminance on risk preferences, ambiguity preferences, choice consistency and dominance violations. We find that luminance levels affect all of these. Age and gender influence the strength of some of these effects. PMID:28783734

The evolution of human warfare.

PubMed

Pitman, George R

2011-01-01

Here we propose a new theory for the origins and evolution of human warfare as a complex social phenomenon involving several behavioral traits, including aggression, risk taking, male bonding, ingroup altruism, outgroup xenophobia, dominance and subordination, and territoriality, all of which are encoded in the human genome. Among the family of great apes only chimpanzees and humans engage in war; consequently, warfare emerged in their immediate common ancestor that lived in patrilocal groups who fought one another for females. The reasons for warfare changed when the common ancestor females began to immigrate into the groups of their choice, and again, during the agricultural revolution.

Abstinence and abstinence-only education: a review of U.S. policies and programs.

PubMed

Santelli, John; Ott, Mary A; Lyon, Maureen; Rogers, Jennifer; Summers, Daniel; Schleifer, Rebecca

2006-01-01

Abstinence from sexual intercourse is an important behavioral strategy for preventing human immunodeficiency virus (HIV), other sexually transmitted infections (STIs), and pregnancy among adolescents. Many adolescents, including most younger adolescents, have not initiated sexual intercourse and many sexually experienced adolescents and young adults are abstinent for varying periods of time. There is broad support for abstinence as a necessary and appropriate part of sexuality education. Controversy arises when abstinence is provided to adolescents as a sole choice and where health information on other choices is restricted or misrepresented. Although abstinence is theoretically fully effective, in actual practice abstinence often fails to protect against pregnancy and STIs. Few Americans remain abstinent until marriage; many do not or cannot marry, and most initiate sexual intercourse and other sexual behaviors as adolescents. Although abstinence is a healthy behavioral option for teens, abstinence as a sole option for adolescents is scientifically and ethically problematic. A recent emphasis on abstinence-only programs and policies appears to be undermining more comprehensive sexuality education and other government-sponsored programs. We believe that abstinence-only education programs, as defined by federal funding requirements, are morally problematic, by withholding information and promoting questionable and inaccurate opinions. Abstinence-only programs threaten fundamental human rights to health, information, and life.

Behavioral economic analysis of drug preference using multiple choice procedure data.

PubMed

Greenwald, Mark K

2008-01-11

The multiple choice procedure has been used to evaluate preference for psychoactive drugs, relative to money amounts (price), in human subjects. The present re-analysis shows that MCP data are compatible with behavioral economic analysis of drug choices. Demand curves were constructed from studies with intravenous fentanyl, intramuscular hydromorphone and oral methadone in opioid-dependent individuals; oral d-amphetamine, oral MDMA alone and during fluoxetine treatment, and smoked marijuana alone or following naltrexone pretreatment in recreational drug users. For each participant and dose, the MCP crossover point was converted into unit price (UP) by dividing the money value ($) by the drug dose (mg/70kg). At the crossover value, the dose ceases to function as a reinforcer, so "0" was entered for this and higher UPs to reflect lack of drug choice. At lower UPs, the dose functions as a reinforcer and "1" was entered to reflect drug choice. Data for UP vs. average percent choice were plotted in log-log space to generate demand functions. Rank of order of opioid inelasticity (slope of non-linear regression) was: fentanyl>hydromorphone (continuing heroin users)>methadone>hydromorphone (heroin abstainers). Rank order of psychostimulant inelasticity was d-amphetamine>MDMA>MDMA+fluoxetine. Smoked marijuana was more inelastic with high-dose naltrexone. These findings show this method translates individuals' drug preferences into estimates of population demand, which has the potential to yield insights into pharmacotherapy efficacy, abuse liability assessment, and individual differences in susceptibility to drug abuse.

Behavioral Economic Analysis of Drug Preference Using Multiple Choice Procedure Data

PubMed Central

Greenwald, Mark K.

2008-01-01

The Multiple Choice Procedure has been used to evaluate preference for psychoactive drugs, relative to money amounts (price), in human subjects. The present re-analysis shows that MCP data are compatible with behavioral economic analysis of drug choices. Demand curves were constructed from studies with intravenous fentanyl, intramuscular hydromorphone and oral methadone in opioid-dependent individuals; oral d-amphetamine, oral MDMA alone and during fluoxetine treatment, and smoked marijuana alone or following naltrexone pretreatment in recreational drug users. For each participant and dose, the MCP crossover point was converted into unit price (UP) by dividing the money value ($) by the drug dose (mg/70 kg). At the crossover value, the dose ceases to function as a reinforcer, so “0” was entered for this and higher UPs to reflect lack of drug choice. At lower UPs, the dose functions as a reinforcer and “1” was entered to reflect drug choice. Data for UP vs. average percent choice were plotted in log-log space to generate demand functions. Rank of order of opioid inelasticity (slope of non-linear regression) was: fentanyl > hydromorphone (continuing heroin users) > methadone > hydromorphone (heroin abstainers). Rank order of psychostimulant inelasticity was d-amphetamine > MDMA > MDMA + fluoxetine. Smoked marijuana was more inelastic with high-dose naltrexone. These findings show this method translates individuals’ drug preferences into estimates of population demand, which has the potential to yield insights into pharmacotherapy efficacy, abuse liability assessment, and individual differences in susceptibility to drug abuse. PMID:17949924

The Neural Basis of Social Influence in a Dictator Decision.

PubMed

Wei, Zhenyu; Zhao, Zhiying; Zheng, Yong

2017-01-01

Humans tend to reduce inequitable distributions. Previous neuroimaging studies have shown that inequitable decisions are related to brain regions that associated with negative emotion and signaling conflict. In the highly complex human social environment, our opinions and behaviors can be affected by social information. In current study, we used a modified dictator game to investigate the effect of social influence on making an equitable decision. We found that the choices of participants in present task was influenced by the choices of peers. However, participants' decisions were influenced by equitable rather than inequitable group choices. fMRI results showed that brain regions that related to norm violation and social conflict were related to the inequitable social influence. The neural responses in the dorsomedial prefrontal cortex, rostral cingulate zone, and insula predicted subsequent conforming behavior in individuals. Additionally, psychophysiological interaction analysis revealed that the interconnectivity between the dorsal striatum and insula was elevated in advantageous inequity influence versus no-social influence conditions. We found decreased functional connectivity between the medial prefrontal cortex and insula, supplementary motor area, posterior cingulate gyrus and dorsal anterior cingulate cortex in the disadvantageous inequity influence versus no-social influence conditions. This suggests that a disadvantageous inequity influence may decrease the functional connectivity among brain regions that are related to reward processes. Thus, the neural mechanisms underlying social influence in an equitable decision may be similar to those implicated in social norms and reward processing.

Active learning: learning a motor skill without a coach.

PubMed

Huang, Vincent S; Shadmehr, Reza; Diedrichsen, Jörn

2008-08-01

When we learn a new skill (e.g., golf) without a coach, we are "active learners": we have to choose the specific components of the task on which to train (e.g., iron, driver, putter, etc.). What guides our selection of the training sequence? How do choices that people make compare with choices made by machine learning algorithms that attempt to optimize performance? We asked subjects to learn the novel dynamics of a robotic tool while moving it in four directions. They were instructed to choose their practice directions to maximize their performance in subsequent tests. We found that their choices were strongly influenced by motor errors: subjects tended to immediately repeat an action if that action had produced a large error. This strategy was correlated with better performance on test trials. However, even when participants performed perfectly on a movement, they did not avoid repeating that movement. The probability of repeating an action did not drop below chance even when no errors were observed. This behavior led to suboptimal performance. It also violated a strong prediction of current machine learning algorithms, which solve the active learning problem by choosing a training sequence that will maximally reduce the learner's uncertainty about the task. While we show that these algorithms do not provide an adequate description of human behavior, our results suggest ways to improve human motor learning by helping people choose an optimal training sequence.

Differential use of sensory information in sexual behavior as a function of gender.

PubMed

Herz, R S; Cahill, E D

1997-09-01

Olfactory information is critical to mammalian sexual behavior. Based on parental investment theory the relative importance of olfaction compared with vision, touch, and hearing should be different for human males and females. In particular, because of its link to immunological profile and offspring viability, odor should be a more important determinant of sexual choice and arousal for females than for males. To test this hypothesis a questionnaire was developed and administered to 332 adults (166 males, 166 females). Subjects used a 1-7 scale to indicate how much they agreed with a series of statements concerning the importance of olfactory, visual, auditory, and tactile information for their sexual responsivity. The data reveal that males rated visual and olfactory information as being equally important for selecting a lover, while females considered olfactory information to be the single most important variable in mate choice. Additionally, when considering sexual activity, females singled out body odor from all other sensory experiences as most able to negatively affect desire, while males regarded odors as much more neutral stimuli for sexual arousal. The present results support recent findings in mice and humans concerning the relation of female preferences in body odor and major histocompatibility complex (MHC) compatibility and can be explained by an evolutionary analysis of sex differences in reproductive strategies. This work represents the first direct examination of the role of different forms of sensory information in human sexual behavior.

Mechanisms underlying the influence of saliency on value-based decisions

PubMed Central

Chen, Xiaomo; Mihalas, Stefan; Niebur, Ernst; Stuphorn, Veit

2013-01-01

Objects in the environment differ in their low-level perceptual properties (e.g., how easily a fruit can be recognized) as well as in their subjective value (how tasty it is). We studied the influence of visual salience on value-based decisions using a two alternative forced choice task, in which human subjects rapidly chose items from a visual display. All targets were equally easy to detect. Nevertheless, both value and salience strongly affected choices made and reaction times. We analyzed the neuronal mechanisms underlying these behavioral effects using stochastic accumulator models, allowing us to characterize not only the averages of reaction times but their full distributions. Independent models without interaction between the possible choices failed to reproduce the observed choice behavior, while models with mutual inhibition between alternative choices produced much better results. Mutual inhibition thus is an important feature of the decision mechanism. Value influenced the amount of accumulation in all models. In contrast, increased salience could either lead to an earlier start (onset model) or to a higher rate (speed model) of accumulation. Both models explained the data from the choice trials equally well. However, salience also affected reaction times in no-choice trials in which only one item was present, as well as error trials. Only the onset model could explain the observed reaction time distributions of error trials and no-choice trials. In contrast, the speed model could not, irrespective of whether the rate increase resulted from more frequent accumulated quanta or from larger quanta. Visual salience thus likely provides an advantage in the onset, not in the processing speed, of value-based decision making. PMID:24167161

Constructing food choice decisions.

PubMed

Sobal, Jeffery; Bisogni, Carole A

2009-12-01

Food choice decisions are frequent, multifaceted, situational, dynamic, and complex and lead to food behaviors where people acquire, prepare, serve, give away, store, eat, and clean up. Many disciplines and fields examine decision making. Several classes of theories are applicable to food decision making, including social behavior, social facts, and social definition perspectives. Each offers some insights but also makes limiting assumptions that prevent fully explaining food choice decisions. We used constructionist social definition perspectives to inductively develop a food choice process model that organizes a broad scope of factors and dynamics involved in food behaviors. This food choice process model includes (1) life course events and experiences that establish a food choice trajectory through transitions, turning points, timing, and contexts; (2) influences on food choices that include cultural ideals, personal factors, resources, social factors, and present contexts; and (3) a personal system that develops food choice values, negotiates and balances values, classifies foods and situations, and forms/revises food choice strategies, scripts, and routines. The parts of the model dynamically interact to make food choice decisions leading to food behaviors. No single theory can fully explain decision making in food behavior. Multiple perspectives are needed, including constructionist thinking.

Reducing suboptimal employee decisions can build the business case for employee benefits.

PubMed

Goldsmith, Christopher; Cyboran, Steven F

2013-01-01

Suboptimal employee decisions are prevalent in employee benefit plans. Poor decisions have significant consequences for employees and employers. Improving participant decisions produces beneficial outcomes such as lower labor costs, higher productivity and better workforce management. The business case for employee benefits can be strengthened by applying lessons learned from the field of behavioral economics to employee benefit plan design and to workforce communication. This article explains the types of behavioral biases that influence suboptimal decisions and explores how enlightened employee benefit plan choice architecture and vivid behavioral messaging contribute to human and better organizational outcomes.

Quantitative comparisons of the acute neurotoxicity of toluene in rats and humans.

PubMed

Benignus, Vernon A; Boyes, William K; Kenyon, Elaina M; Bushnell, Philip J

2007-11-01

The behavioral and neurophysiological effects of acute exposure to toluene are the most thoroughly explored of all the hydrocarbon solvents. Behavioral effects have been experimentally studied in humans and other species, for example, rats. The existence of both rat and human dosimetric data offers the opportunity to quantitatively compare the relative sensitivity to acute toluene exposure. The purpose of this study was to fit dose-effect curves to existing data and to estimate the dose-equivalence equation (DEE) between rats and humans. The DEE gives the doses that produce the same magnitude of effect in the two species. Doses were brain concentrations of toluene estimated from physiologically based pharmacokinetic models. Human experiments measuring toluene effects on choice reaction time (CRT) were meta-analyzed. Rat studies employed various dependent variables: amplitude of visual-evoked potentials (VEPs), signal detection (SIGDET) accuracy (ACCU) and reaction time (RT), and escape-avoidance (ES-AV) behaviors. Comparison of dose-effect functions showed that human and rat sensitivity was practically the same for those two task regimens that exerted the least control over the behaviors being measured (VEP in rats and CRT in humans) and the sensitivity was progressively lower for SIGDET RT, SIGDET ACCU, and ES-AV behaviors in rats. These results suggested that the sensitivity to impairment by toluene depends on the strength of control over the measured behavior rather than on the species being tested. This interpretation suggests that (1) sensitivity to toluene would be equivalent in humans and rats if both species performed behaviors that were controlled to the same extent, (2) the most sensitive tests of neurobehavioral effects would be those in which least control is exerted on the behavior being measured, and (3) effects of toluene in humans may be estimated using the DEEs from rat studies despite differences in the amount of control exerted by the experimental regimen or differences in the behaviors under investigation.

(Ir)rational choices of humans, rhesus macaques, and capuchin monkeys in dynamic stochastic environments.

PubMed

Watzek, Julia; Brosnan, Sarah F

2018-05-28

Human and animal decision-making is known to violate rational expectations in a variety of contexts. Previous models suggest that statistical structures of real-world environments can favor such seemingly irrational behavior, but this has not been tested empirically. We tested 16 capuchin monkeys, seven rhesus monkeys, and 30 humans in a computerized experiment that implemented such stochastic environments. Subjects chose from among up to three options of different value that disappeared and became available again with different probabilities. All species overwhelmingly chose transitively (A > B > C) in the control condition, where doing so maximized overall gain. Most subjects also adhered to transitivity in the test condition, where it was suboptimal, but ultimately led to negligible losses compared to the optimal, non-transitive strategy. We used a modelling approach to show that differences in temporal discounting may account for this pattern of choices on a proximate level. Specifically, when short- and long-term goals are valued similarly, near-optimal decision rules can map onto rational choice principles. Such cognitive shortcuts have been argued to have evolved to preserve mental resources without sacrificing good decision-making, and here we provide evidence that these heuristics can provide almost identical outcomes even in situations in which they lead to suboptimal choices. Copyright © 2018 Elsevier B.V. All rights reserved.

Lose-Shift Responding in Humans Is Promoted by Increased Cognitive Load

PubMed Central

Ivan, Victorita E.; Banks, Parker J.; Goodfellow, Kris; Gruber, Aaron J.

2018-01-01

The propensity of animals to shift choices immediately after unexpectedly poor reinforcement outcomes is a pervasive strategy across species and tasks. We report here on the memory supporting such lose-shift responding in humans, assessed using a binary choice task in which random responding is the optimal strategy. Participants exhibited little lose-shift responding when fully attending to the task, but this increased by 30%–40% in participants that performed with additional cognitive load that is known to tax executive systems. Lose-shift responding in the cognitively loaded adults persisted throughout the testing session, despite being a sub-optimal strategy, but was less likely as the time increased between reinforcement and the subsequent choice. Furthermore, children (5–9 years old) without load performed similarly to the cognitively loaded adults. This effect disappeared in older children aged 11–13 years old. These data provide evidence supporting our hypothesis that lose-shift responding is a default and reflexive strategy in the mammalian brain, likely mediated by a decaying memory trace, and is normally suppressed by executive systems. Reducing the efficacy of executive control by cognitive load (adults) or underdevelopment (children) increases its prevalence. It may therefore be an important component to consider when interpreting choice data, and may serve as an objective behavioral assay of executive function in humans that is easy to measure. PMID:29568264

Behavioral economics

PubMed Central

Hursh, Steven R.

1984-01-01

Economics, like behavioral psychology, is a science of behavior, albeit highly organized human behavior. The value of economic concepts for behavioral psychology rests on (1) their empirical validity when tested in the laboratory with individual subjects and (2) their uniqueness when compared to established behavioral concepts. Several fundamental concepts are introduced and illustrated by reference to experimental data: open and closed economies, elastic and inelastic demand, and substitution versus complementarity. Changes in absolute response rate are analyzed in relation to elasticity and intensity of demand. The economic concepts of substitution and complementarity are related to traditional behavioral studies of choice and to the matching relation. The economic approach has many implications for the future of behavioral research and theory. In general, economic concepts are grounded on a dynamic view of reinforcement. The closed-economy methodology extends the generality of behavioral principles to situations in which response rate and obtained rate of reinforcement are interdependent. Analysis of results in terms of elasticity and intensity of demand promises to provide a more direct method for characterizing the effects of “motivational” variables. Future studies of choice should arrange heterogeneous reinforcers with varying elasticities, use closed economies, and modulate scarcity or income. The economic analysis can be extended to the study of performances that involve subtle discriminations or skilled movements that vary in accuracy or quality as opposed to rate or quantity, and thus permit examination of time/accuracy trade-offs. PMID:16812401

Dynamic Response-by-Response Models of Matching Behavior in Rhesus Monkeys

PubMed Central

Lau, Brian; Glimcher, Paul W

2005-01-01

We studied the choice behavior of 2 monkeys in a discrete-trial task with reinforcement contingencies similar to those Herrnstein (1961) used when he described the matching law. In each session, the monkeys experienced blocks of discrete trials at different relative-reinforcer frequencies or magnitudes with unsignalled transitions between the blocks. Steady-state data following adjustment to each transition were well characterized by the generalized matching law; response ratios undermatched reinforcer frequency ratios but matched reinforcer magnitude ratios. We modelled response-by-response behavior with linear models that used past reinforcers as well as past choices to predict the monkeys' choices on each trial. We found that more recently obtained reinforcers more strongly influenced choice behavior. Perhaps surprisingly, we also found that the monkeys' actions were influenced by the pattern of their own past choices. It was necessary to incorporate both past reinforcers and past choices in order to accurately capture steady-state behavior as well as the fluctuations during block transitions and the response-by-response patterns of behavior. Our results suggest that simple reinforcement learning models must account for the effects of past choices to accurately characterize behavior in this task, and that models with these properties provide a conceptual tool for studying how both past reinforcers and past choices are integrated by the neural systems that generate behavior. PMID:16596980

Choice Behavior Guided by Learned, But Not Innate, Taste Aversion Recruits the Orbitofrontal Cortex.

PubMed

Ramírez-Lugo, Leticia; Peñas-Rincón, Ana; Ángeles-Durán, Sandybel; Sotres-Bayon, Francisco

2016-10-12

The ability to select an appropriate behavioral response guided by previous emotional experiences is critical for survival. Although much is known about brain mechanisms underlying emotional associations, little is known about how these associations guide behavior when several choices are available. To address this, we performed local pharmacological inactivations of several cortical regions before retrieval of an aversive memory in choice-based versus no-choice-based conditioned taste aversion (CTA) tasks in rats. Interestingly, we found that inactivation of the orbitofrontal cortex (OFC), but not the dorsal or ventral medial prefrontal cortices, blocked retrieval of choice CTA. However, OFC inactivation left retrieval of no-choice CTA intact, suggesting its role in guiding choice, but not in retrieval of CTA memory. Consistently, OFC activity increased in the choice condition compared with no-choice, as measured with c-Fos immunolabeling. Notably, OFC inactivation did not affect choice behavior when it was guided by innate taste aversion. Consistent with an anterior insular cortex (AIC) involvement in storing taste memories, we found that AIC inactivation impaired retrieval of both choice and no-choice CTA. Therefore, this study provides evidence for OFC's role in guiding choice behavior and shows that this is dissociable from AIC-dependent taste aversion memory. Together, our results suggest that OFC is required and recruited to guide choice selection between options of taste associations relayed from AIC. Survival and mental health depend on being able to choose stimuli not associated with danger. This is particularly important when danger is associated with stimuli that we ingest. Although much is known about the brain mechanisms that underlie associations with dangerous taste stimuli, very little is known about how these stored emotional associations guide behavior when it involves choice. By combining pharmacological and immunohistochemistry tools with taste-guided tasks, our study provides evidence for the key role of orbitofrontal cortex activity in choice behavior and shows that this is dissociable from the adjacent insular cortex-dependent taste aversion memory. Understanding the brain mechanisms that underlie the impact that emotional associations have on survival choice behaviors may lead to better treatments for mental disorders characterized by emotional decision-making deficits. Copyright © 2016 the authors 0270-6474/16/3610574-10$15.00/0.

Individual differences in impulsive and risky choice: effects of environmental rearing conditions.

PubMed

Kirkpatrick, Kimberly; Marshall, Andrew T; Smith, Aaron P; Koci, Juraj; Park, Yoonseong

2014-08-01

The present experiment investigated early-rearing environment modulation of individual differences in impulsive and risky choice. Rats were reared in an isolated condition (IC; n=12), in which they lived alone without novel stimuli, or an enriched condition (EC; n=11), in which they lived among conspecifics with novel stimuli. The impulsive choice task involved choices between smaller-sooner (SS) versus larger-later (LL) rewards. The risky choice task involved choices between certain-smaller (C-S) versus uncertain-larger (U-L) rewards. Following choice testing, incentive motivation to work for food was measured using a progressive ratio task and correlated with choice behavior. HPLC analyses were conducted to determine how monoamine concentrations within the prefrontal cortex (PFC) and nucleus accumbens (NAC) related to behavior in different tasks. IC rats were more impulsive than EC rats, but they did not differ in risky choice behavior. However, choice behavior across tasks was significantly correlated (i.e., the more impulsive rats were also riskier). There were no group differences in monoamine levels, but noradrenergic and serotonergic concentrations were significantly correlated with impulsive and risky choice. Furthermore, serotonin and norepinephrine concentrations in the NAC significantly correlated with incentive motivation and the timing of the reward delays within the choice tasks. These results suggest a role for domain general processes in impulsive and risky choice and indicate the importance of the NAC and/or PFC in timing, reward processing, and choice behavior. Copyright © 2014 Elsevier B.V. All rights reserved.

Individual differences in impulsive and risky choice: Effects of environmental rearing conditions

PubMed Central

Kirkpatrick, Kimberly; Marshall, Andrew T.; Smith, Aaron P.; Koci, Juraj; Park, Yoonseong

2014-01-01

The present experiment investigated early-rearing environment modulation of individual differences in impulsive and risky choice. Rats were reared in an isolated condition (IC; n = 12), in which they lived alone without novel stimuli, or an enriched condition (EC; n = 12), in which they lived among conspecifics with novel stimuli. The impulsive choice task involved choices between smaller-sooner (SS) versus larger-later (LL) rewards. The risky choice task involved choices between certain-smaller (C-S) versus uncertain-larger (U-L) rewards. Following choice testing, incentive motivation to work for food was measured using a progressive ratio task and correlated with choice behavior. HPLC analyses were conducted to determine how monoamine concentrations within the prefrontal cortex (PFC) and nucleus accumbens (NAC) related to behavior in different tasks. IC rats were more impulsive than EC rats, but they did not differ in risky choice behavior. However, choice behavior across tasks was significantly correlated (i.e., the more impulsive rats were also riskier). There were no group differences in monoamine levels, but noradrenergic and serotonergic concentrations were significantly correlated with impulsive and risky choice. Furthermore, serotonin and norepinephrine concentrations in the NAC significantly correlated with incentive motivation and the timing of the reward delays within the choice tasks. These results suggest a role for domain general processes in impulsive and risky choice and indicate the importance of the NAC and/or PFC in timing, reward processing, and choice behavior. PMID:24769268

Sexual selection under parental choice: evidence from sixteen historical societies.

PubMed

Apostolou, Menelaos

2012-08-11

Asymmetrical fitness benefits between parents and offspring result in the ideal spouse not being the ideal in-law. This enables parents to attempt to control the mating behavior of their children, and when they succeed, parental choice becomes a primary sexual selection force. A number of studies indicate that parental choice is dominant in contemporary pre-industrial societies. This paper presents evidence from the historical record which indicates that parental choice was also dominant during the later stages of human evolution. More specifically, 40 variables have been coded for a sample of 16 historical societies. Consistent with the model of parental choice, it is found that mating is controlled by parents, male parents exercise more control over marriage arrangements than females, and more control is exercised over female than male offspring. Finally, the specific qualities that parents desire in an in-law and offspring desire in a spouse have also been identified. The implications of these findings are discussed.

Psychophysics of time perception and intertemporal choice models

NASA Astrophysics Data System (ADS)

Takahashi, Taiki; Oono, Hidemi; Radford, Mark H. B.

2008-03-01

Intertemporal choice and psychophysics of time perception have been attracting attention in econophysics and neuroeconomics. Several models have been proposed for intertemporal choice: exponential discounting, general hyperbolic discounting (exponential discounting with logarithmic time perception of the Weber-Fechner law, a q-exponential discount model based on Tsallis's statistics), simple hyperbolic discounting, and Stevens' power law-exponential discounting (exponential discounting with Stevens' power time perception). In order to examine the fitness of the models for behavioral data, we estimated the parameters and AICc (Akaike Information Criterion with small sample correction) of the intertemporal choice models by assessing the points of subjective equality (indifference points) at seven delays. Our results have shown that the orders of the goodness-of-fit for both group and individual data were [Weber-Fechner discounting (general hyperbola) > Stevens' power law discounting > Simple hyperbolic discounting > Exponential discounting], indicating that human time perception in intertemporal choice may follow the Weber-Fechner law. Indications of the results for neuropsychopharmacological treatments of addiction and biophysical processing underlying temporal discounting and time perception are discussed.

Social signals of safety and risk confer utility and have asymmetric effects on observers’ choices

PubMed Central

Chung, Dongil; Ball, Sheryl B; Chiu, Pearl H

2015-01-01

Individuals’ risk attitudes are known to guide choices about uncertain options. However, in the presence of others’ decisions, these choices can be swayed and manifest as riskier or safer behavior than one would express alone. To test the mechanisms underlying effective social ‘nudges’ in human decision-making, we used functional neuroimaging and a task in which participants made choices about gambles alone and after observing others’ selections. Against three alternative explanations, we found that observing others’ choices of gambles increased the subjective value (utility) of those gambles for the observer. This ‘other-conferred utility’ was encoded in ventromedial prefrontal cortex, and these neural signals predicted conformity. We further identified a parametric interaction with individual risk preferences in anterior cingulate cortex and insula. These data provide a neuromechanistic account of how information from others is integrated with individual preferences that may explain preference-congruent susceptibility to social signals of safety and risk. PMID:25984890

Nonlinear Socio-Ecological Dynamics and First Principles ofCollective Choice Behavior of ``Homo Socialis"

NASA Astrophysics Data System (ADS)

Sonis, M.

Socio-ecological dynamics emerged from the field of Mathematical SocialSciences and opened up avenues for re-examination of classical problems of collective behavior in Social and Spatial sciences. The ``engine" of this collective behavior is the subjective mental evaluation of level of utilities in the future, presenting sets of composite socio-economic-temporal-locational advantages. These dynamics present new laws of collective multi-population behavior which are the meso-level counterparts of the utility optimization individual behavior. The central core of the socio-ecological choice dynamics includes the following first principle of the collective choice behavior of ``Homo Socialis" based on the existence of ``collective consciousness": the choice behavior of ``Homo Socialis" is a collective meso-level choice behavior such that the relative changes in choice frequencies depend on the distribution of innovation alternatives between adopters of innovations. The mathematical basis of the Socio-Ecological Dynamics includes two complementary analytical approaches both based on the use of computer modeling as a theoretical and simulation tool. First approach is the ``continuous approach" --- the systems of ordinary and partial differential equations reflecting the continuous time Volterra ecological formalism in a form of antagonistic and/or cooperative collective hyper-games between different sub-sets of choice alternatives. Second approach is the ``discrete approach" --- systems of difference equations presenting a new branch of the non-linear discrete dynamics --- the Discrete Relative m-population/n-innovations Socio-Spatial Dynamics (Dendrinos and Sonis, 1990). The generalization of the Volterra formalism leads further to the meso-level variational principle of collective choice behavior determining the balance between the resulting cumulative social spatio-temporal interactions among the population of adopters susceptible to the choice alternatives and the cumulative equalization of the power of elites supporting different choice alternatives. This balance governs the dynamic innovation choice process and constitutes the dynamic meso-level counterpart of the micro-economic individual utility maximization principle.

Network-wide Impacts of Eco-routes and Route Choice Behavior/Evaluation of AERIS Applications

DOT National Transportation Integrated Search

2016-07-01

The study investigates the eco-routes and route choice behaviors under connected vehicle environment. In particular, the study demonstrates the various conceptual development for an ecorouting system which includes an individual route choice behavior...

Intentionality and "free-will" from a neurodevelopmental perspective.

PubMed

Leisman, Gerry; Machado, Calixto; Melillo, Robert; Mualem, Raed

2012-01-01

The nature of free-will as a subset of intentionality and probabilistic and deterministic function is explored with the indications being that human behavior is highly predictable which in turn, should compromise the notion of free-will. Data supports the notion that age relates to the ability to progressively effectively establish goals performed by fixed action patterns and that these FAPs produce outcomes that in turn modify choices (free-will) for which FAPs need to be employed. Early goals require behaviors that require greater automation in terms of FAPs that lead to goals being achieved or not; if not, then one can change behavior and that in turn is free-will. Goals change with age based on experience which is similar to the way in which movement functions. We hypothesize that human prefrontal cortex development was a natural expansion of the evolutionarily earlier developed areas of the frontal lobe and that goal-directed movements and behavior, including choice and free-will, provided for an expansion of those areas. The same regions of the human central nervous system that were already employed for better control, coordination, and timing of movements, expanded in parallel with the frontal cortex. The initial focus of the frontal lobes was the control of motor activity, but as the movements became more goal-directed, greater cognitive control over movement was necessitated leading to voluntary control of FAPs or free-will. The paper reviews the neurobiology, neurohistology, and electrophysiology of brain connectivities developmentally, along with the development of those brain functions linked to decision-making from a developmental viewpoint. The paper reviews the neurological development of the frontal lobes and inter-regional brain connectivities in the context of optimization of communication systems within the brain and nervous system and its relation to free-will.

Apomorphine-induced hypoattention in rats and reversal of the choice performance impairment by aniracetam.

PubMed

Nakamura, K; Kurasawa, M; Tanaka, Y

1998-01-26

Aging-, disease- and medication-related imbalance of central dopaminergic neurons causes functional impairment of cognition and neuropsychological delirium in humans. We attempted to develop a new delirium model using the direct dopamine agonist, apomorphine, and a choice reaction performance task performed by middle-aged rats. The psychological properties of the model were assessed by determining behavioral measures such as choice reaction time, % correct and % omission. Apomorphine (0.03-0.3 mg/kg s.c.) produced a dose-dependent impairment of task performance. The dose of 0.1 mg/kg prolonged choice reaction time, decreased % correct and increased % omission, indicating that rats had attentional deficits and a reduced arousal or vigilance but no motor deficits or reduced food motivation. This psychological and behavioral impairment of performance resembled that of clinically defined delirium. In this model, the cholinomimetic, aniracetam (10 mg/kg p.o.), reversed the performance impairment induced by apomorphine. Its two metabolites, 2-pyrrolidinone (10 and 30 mg/kg p.o.) and N-anisoyl-gamma-aminobutyric acid (GABA, 10 mg/kg p.o.), effectively reversed the performance impairment as the intact drug did. Another pyrrolidinone derivative, nefiracetam (10 and 30 mg/kg p.o.), tended to worsen the apomorphine effect. The cholinesterase inhibitor, tacrine (10 mg/kg p.o.), markedly worsened all of the behavioral measures. Neuroleptics, haloperidol (0.025 mg/kg s.c.), tiapride (30 mg/kg p.o.) and sulpiride (10 and 30 mg/kg p.o.), antagonized the apomorphine effect. The present results suggest that apomorphine-induced behavioral disturbances in the choice reaction performance task seems to be a useful delirium model and aniracetam may improve delirium through the action of 2-pyrrolidinone and N-anisoyl-GABA, presumably by facilitating dopamine release in the striatum by acting as an AMPA or metabotropic glutamate receptor agonist.

Vertical T-maze Choice Assay for Arthropod Response to Odorants

PubMed Central

Stelinski, Lukasz; Tiwari, Siddharth

2013-01-01

Given the economic importance of insects and arachnids as pests of agricultural crops, urban environments or as vectors of plant and human diseases, various technologies are being developed as control tools. A subset of these tools focuses on modifying the behavior of arthropods by attraction or repulsion. Therefore, arthropods are often the focus of behavioral investigations. Various tools have been developed to measure arthropod behavior, including wind tunnels, flight mills, servospheres, and various types of olfactometers. The purpose of these tools is to measure insect or arachnid response to visual or more often olfactory cues. The vertical T-maze oflactometer described here measures choices performed by insects in response to attractants or repellents. It is a high throughput assay device that takes advantage of the positive phototaxis (attraction to light) and negative geotaxis (tendency to walk or fly upward) exhibited by many arthropods. The olfactometer consists of a 30 cm glass tube that is divided in half with a Teflon strip forming a T-maze. Each half serves as an arm of the olfactometer enabling the test subjects to make a choice between two potential odor fields in assays involving attractants. In assays involving repellents, lack of normal response to known attractants can also be measured as a third variable. PMID:23439130

Decision making in cancer primary prevention and chemoprevention.

PubMed

Gorin, Sherri Sheinfeld; Wang, Catharine; Raich, Peter; Bowen, Deborah J; Hay, Jennifer

2006-12-01

We know very little about how individuals decide to undertake, maintain, or discontinue cancer primary prevention or chemoprevention. The aims of this article are to (a) examine whether and, if so, how traditional health behavior change models are relevant for decision making in this area; (b) review the application of decision aids to forming specific, personal choices between options; and (c) identify the challenges of evaluating these decision processes to suggest areas for future research. Theoretical models and frameworks derived from the health behavior change and decision-making fields were applied to cancer primary prevention choices. Decision aids for the human papillomavirus (HPV) vaccine, Hormone Replacement Therapy (HRT), and tamoxifen were systematically examined. Traditional concepts such as decisional balance and cues to action are relevant to understanding cancer primary prevention choices; Motivational Interviewing, Self-Determination Theory, and the Preventive Health Model may also explain the facilitators of decision making. There are no well-tested HPV vaccine decision aids, although there have been some studies on aids for HPV testing. There are several effective decision aids for HRT and tamoxifen; evidence-based decision aid components have also been identified. Additional theory-based empirical research on decision making in cancer primary prevention and chemoprevention, particularly at the interface of psychology and behavioral economics, is suggested.

Decision-Making under Ambiguity Is Modulated by Visual Framing, but Not by Motor vs. Non-Motor Context. Experiments and an Information-Theoretic Ambiguity Model

PubMed Central

Grau-Moya, Jordi; Ortega, Pedro A.; Braun, Daniel A.

2016-01-01

A number of recent studies have investigated differences in human choice behavior depending on task framing, especially comparing economic decision-making to choice behavior in equivalent sensorimotor tasks. Here we test whether decision-making under ambiguity exhibits effects of task framing in motor vs. non-motor context. In a first experiment, we designed an experience-based urn task with varying degrees of ambiguity and an equivalent motor task where subjects chose between hitting partially occluded targets. In a second experiment, we controlled for the different stimulus design in the two tasks by introducing an urn task with bar stimuli matching those in the motor task. We found ambiguity attitudes to be mainly influenced by stimulus design. In particular, we found that the same subjects tended to be ambiguity-preferring when choosing between ambiguous bar stimuli, but ambiguity-avoiding when choosing between ambiguous urn sample stimuli. In contrast, subjects’ choice pattern was not affected by changing from a target hitting task to a non-motor context when keeping the stimulus design unchanged. In both tasks subjects’ choice behavior was continuously modulated by the degree of ambiguity. We show that this modulation of behavior can be explained by an information-theoretic model of ambiguity that generalizes Bayes-optimal decision-making by combining Bayesian inference with robust decision-making under model uncertainty. Our results demonstrate the benefits of information-theoretic models of decision-making under varying degrees of ambiguity for a given context, but also demonstrate the sensitivity of ambiguity attitudes across contexts that theoretical models struggle to explain. PMID:27124723

Decision-Making under Ambiguity Is Modulated by Visual Framing, but Not by Motor vs. Non-Motor Context. Experiments and an Information-Theoretic Ambiguity Model.

PubMed

Grau-Moya, Jordi; Ortega, Pedro A; Braun, Daniel A

2016-01-01

A number of recent studies have investigated differences in human choice behavior depending on task framing, especially comparing economic decision-making to choice behavior in equivalent sensorimotor tasks. Here we test whether decision-making under ambiguity exhibits effects of task framing in motor vs. non-motor context. In a first experiment, we designed an experience-based urn task with varying degrees of ambiguity and an equivalent motor task where subjects chose between hitting partially occluded targets. In a second experiment, we controlled for the different stimulus design in the two tasks by introducing an urn task with bar stimuli matching those in the motor task. We found ambiguity attitudes to be mainly influenced by stimulus design. In particular, we found that the same subjects tended to be ambiguity-preferring when choosing between ambiguous bar stimuli, but ambiguity-avoiding when choosing between ambiguous urn sample stimuli. In contrast, subjects' choice pattern was not affected by changing from a target hitting task to a non-motor context when keeping the stimulus design unchanged. In both tasks subjects' choice behavior was continuously modulated by the degree of ambiguity. We show that this modulation of behavior can be explained by an information-theoretic model of ambiguity that generalizes Bayes-optimal decision-making by combining Bayesian inference with robust decision-making under model uncertainty. Our results demonstrate the benefits of information-theoretic models of decision-making under varying degrees of ambiguity for a given context, but also demonstrate the sensitivity of ambiguity attitudes across contexts that theoretical models struggle to explain.

Behavioral and Neural Signatures of Reduced Updating of Alternative Options in Alcohol-Dependent Patients during Flexible Decision-Making.

PubMed

Reiter, Andrea M F; Deserno, Lorenz; Kallert, Thomas; Heinze, Hans-Jochen; Heinz, Andreas; Schlagenhauf, Florian

2016-10-26

Addicted individuals continue substance use despite the knowledge of harmful consequences and often report having no choice but to consume. Computational psychiatry accounts have linked this clinical observation to difficulties in making flexible and goal-directed decisions in dynamic environments via consideration of potential alternative choices. To probe this in alcohol-dependent patients (n = 43) versus healthy volunteers (n = 35), human participants performed an anticorrelated decision-making task during functional neuroimaging. Via computational modeling, we investigated behavioral and neural signatures of inference regarding the alternative option. While healthy control subjects exploited the anticorrelated structure of the task to guide decision-making, alcohol-dependent patients were relatively better explained by a model-free strategy due to reduced inference on the alternative option after punishment. Whereas model-free prediction error signals were preserved, alcohol-dependent patients exhibited blunted medial prefrontal signatures of inference on the alternative option. This reduction was associated with patients' behavioral deficit in updating the alternative choice option and their obsessive-compulsive drinking habits. All results remained significant when adjusting for potential confounders (e.g., neuropsychological measures and gray matter density). A disturbed integration of alternative choice options implemented by the medial prefrontal cortex appears to be one important explanation for the puzzling question of why addicted individuals continue drug consumption despite negative consequences. In addiction, patients maintain substance use despite devastating consequences and often report having no choice but to consume. These clinical observations have been theoretically linked to disturbed mechanisms of inference, for example, to difficulties when learning statistical regularities of the environmental structure to guide decisions. Using computational modeling, we demonstrate disturbed inference on alternative choice options in alcohol addiction. Patients neglecting "what might have happened" was accompanied by blunted coding of inference regarding alternative choice options in the medial prefrontal cortex. An impaired integration of alternative choice options implemented by the medial prefrontal cortex might contribute to ongoing drug consumption in the face of evident negative consequences. Copyright © 2016 the authors 0270-6474/16/3610935-14$15.00/0.

Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action

PubMed Central

Balleine, Bernard W; O'Doherty, John P

2010-01-01

Recent behavioral studies in both humans and rodents have found evidence that performance in decision-making tasks depends on two different learning processes; one encoding the relationship between actions and their consequences and a second involving the formation of stimulus–response associations. These learning processes are thought to govern goal-directed and habitual actions, respectively, and have been found to depend on homologous corticostriatal networks in these species. Thus, recent research using comparable behavioral tasks in both humans and rats has implicated homologous regions of cortex (medial prefrontal cortex/medial orbital cortex in humans and prelimbic cortex in rats) and of dorsal striatum (anterior caudate in humans and dorsomedial striatum in rats) in goal-directed action and in the control of habitual actions (posterior lateral putamen in humans and dorsolateral striatum in rats). These learning processes have been argued to be antagonistic or competing because their control over performance appears to be all or none. Nevertheless, evidence has started to accumulate suggesting that they may at times compete and at others cooperate in the selection and subsequent evaluation of actions necessary for normal choice performance. It appears likely that cooperation or competition between these sources of action control depends not only on local interactions in dorsal striatum but also on the cortico-basal ganglia network within which the striatum is embedded and that mediates the integration of learning with basic motivational and emotional processes. The neural basis of the integration of learning and motivation in choice and decision-making is still controversial and we review some recent hypotheses relating to this issue. PMID:19776734

Education for Self-Responsibility III: Prevention of HIV/AIDS and Other Communicable Diseases. Curriculum Guide. Grades 4-6.

ERIC Educational Resources Information Center

Texas Education Agency, Austin.

This curriculum guide encourages students to learn behaviors that will reduce the potential for HIV infection when confronted with choices at a later age. The curriculum is designed for integration within a comprehensive program of school health education (lessons on communicable disease, including Human Immunodeficiency Virus (HIV), can be…

What Drives Parents? A Case Sensitive Inquiry into Parents' Mode Preferences for the Journey to School

ERIC Educational Resources Information Center

Zuniga, Kelly Draper

2010-01-01

This dissertation uses a case-sensitive approach to examine an active travel intervention's diverse target population. It builds on a series of travel choice models, and draws key conceptual themes from Chapin's (1974) human activity model, which highlights opportunity-related and propensity-related factors associated with behaviors. The research…

The Effects of a Concurrent Task on Human Optimization and Self Control

ERIC Educational Resources Information Center

Reed, Phil; Thompson, Caitlin; Osborne, Lisa A.; McHugh, Louise

2011-01-01

Memory deficits have been shown to hamper decision making in a number of populations. In two experiments, participants were required to select one of three alternatives that varied in reinforcer amount and delay, and the effect of a concurrent task on a behavioral choice task that involved making either an impulsive, self-controlled, or optimal…

A Conceptual Framework Examining the Antecedents of Career Decisiveness Using Motivation Systems Theory

ERIC Educational Resources Information Center

Chatterjee, Srabasti

2013-01-01

An extensive body of vocational research has been dedicated to the topic of career-decision making behavior. Work is integral to human functioning, and all psychologists need to understand the role of work in people's lives. Understanding factors influencing work choices and helping individuals effectively make career decisions is the focus of…

Cross-cultural validity of the theory of planned behavior for predicting healthy food choice in secondary school students of Inner Mongolia.

PubMed

Shimazaki, Takashi; Bao, Hugejiletu; Deli, Geer; Uechi, Hiroaki; Lee, Ying-Hua; Miura, Kayo; Takenaka, Koji

2017-11-01

Unhealthy eating behavior is a serious health concern among secondary school students in Inner Mongolia. To predict their healthy food choices and devise methods of correcting unhealthy choices, we sought to confirm the cross-cultural validity of the theory of planned behavior among Inner Mongolian students. A cross-sectional study, conducted between November and December 2014. Overall, 3047 students were enrolled. We devised a questionnaire based on the theory of planned behavior to measure its components (intentions, attitudes, subjective norms, and perceived behavioral control) in relation to healthy food choices; we also assessed their current engagement in healthy food choices. A principal component analysis revealed high contribution rates for the components (69.32%-88.77%). A confirmatory factor analysis indicated that the components of the questionnaire had adequate model fit (goodness of fit index=0.997, adjusted goodness of fit index=0.984, comparative fit index=0.998, and root mean square error of approximation=0.049). Notably, data from participants within the suburbs did not support the theory of planned behavior construction. Several paths did not predict the hypothesis variables. However, attitudes toward healthy food choices strongly predicted behavioral intention (path coefficients 0.49-0.77, p<0.01), regardless of demographic characteristics. Our results support that the theory of planned behavior can apply to secondary school students in urban areas. Furthermore, attitudes towards healthy food choices were the best predictor of behavioral intentions to engage in such choices in Inner Mongolian students. Copyright © 2017 Diabetes India. Published by Elsevier Ltd. All rights reserved.

Conditional cooperation and confusion in public-goods experiments

PubMed Central

Burton-Chellew, Maxwell N.; El Mouden, Claire; West, Stuart A.

2016-01-01

Economic experiments are often used to study if humans altruistically value the welfare of others. A canonical result from public-good games is that humans vary in how they value the welfare of others, dividing into fair-minded conditional cooperators, who match the cooperation of others, and selfish noncooperators. However, an alternative explanation for the data are that individuals vary in their understanding of how to maximize income, with misunderstanding leading to the appearance of cooperation. We show that (i) individuals divide into the same behavioral types when playing with computers, whom they cannot be concerned with the welfare of; (ii) behavior across games with computers and humans is correlated and can be explained by variation in understanding of how to maximize income; (iii) misunderstanding correlates with higher levels of cooperation; and (iv) standard control questions do not guarantee understanding. These results cast doubt on certain experimental methods and demonstrate that a common assumption in behavioral economics experiments, that choices reveal motivations, will not necessarily hold. PMID:26787890

Conditional cooperation and confusion in public-goods experiments.

PubMed

Burton-Chellew, Maxwell N; El Mouden, Claire; West, Stuart A

2016-02-02

Economic experiments are often used to study if humans altruistically value the welfare of others. A canonical result from public-good games is that humans vary in how they value the welfare of others, dividing into fair-minded conditional cooperators, who match the cooperation of others, and selfish noncooperators. However, an alternative explanation for the data are that individuals vary in their understanding of how to maximize income, with misunderstanding leading to the appearance of cooperation. We show that (i) individuals divide into the same behavioral types when playing with computers, whom they cannot be concerned with the welfare of; (ii) behavior across games with computers and humans is correlated and can be explained by variation in understanding of how to maximize income; (iii) misunderstanding correlates with higher levels of cooperation; and (iv) standard control questions do not guarantee understanding. These results cast doubt on certain experimental methods and demonstrate that a common assumption in behavioral economics experiments, that choices reveal motivations, will not necessarily hold.

Effects of alternative reinforcer and craving on the choice to smoke cigarettes in the laboratory.

PubMed

Bisaga, Adam; Padilla, Margarita; Garawi, Fatima; Sullivan, Maria A; Haney, Margaret

2007-01-01

We examined to what extent craving for cigarettes and the magnitude of an alternative monetary reinforcer were predictors of the choice to smoke in the human laboratory. Twelve non-treatment-seeking nicotine-dependent volunteers participated in a series of outpatient sessions during which they had repeated opportunities to select between three puffs of a cigarette and a variety of monetary alternatives ($0.50-3), responding under a progressive-ratio schedule. Level of cigarette craving was measured at baseline and between each choice opportunity. The probability of choosing a cigarette decreased significantly with the increase in the magnitude of the alternative reinforcer. Baseline level of craving did not significantly alter the probability of choosing a cigarette, but a craving component related to the anticipation of positive effects from smoking, assessed repeatedly between choice opportunities, was predictive of the choice to smoke. These results demonstrate that the cigarette puff self-administration procedure is sensitive to environmental manipulations and cigarette puff choice can be modified by the availability of an alternative reinforcer. This paradigm models the motivational component associated with choice to smoke and could be used to evaluate the effects of pharmacological and behavioral interventions to decrease cigarette smoking.

Cortical thickness of the dorsolateral prefrontal cortex predicts strategic choices in economic games.

PubMed

Yamagishi, Toshio; Takagishi, Haruto; Fermin, Alan de Souza Rodrigues; Kanai, Ryota; Li, Yang; Matsumoto, Yoshie

2016-05-17

Human prosociality has been traditionally explained in the social sciences in terms of internalized social norms. Recent neuroscientific studies extended this traditional view of human prosociality by providing evidence that prosocial choices in economic games require cognitive control of the impulsive pursuit of self-interest. However, this view is challenged by an intuitive prosociality view emphasizing the spontaneous and heuristic basis of prosocial choices in economic games. We assessed the brain structure of 411 players of an ultimatum game (UG) and a dictator game (DG) and measured the strategic reasoning ability of 386. According to the reflective norm-enforcement view of prosociality, only those capable of strategically controlling their selfish impulses give a fair share in the UG, but cognitive control capability should not affect behavior in the DG. Conversely, we support the intuitive prosociality view by showing for the first time, to our knowledge, that strategic reasoning and cortical thickness of the dorsolateral prefrontal cortex were not related to giving in the UG but were negatively related to giving in the DG. This implies that the uncontrolled choice in the DG is prosocial rather than selfish, and those who have a thicker dorsolateral prefrontal cortex and are capable of strategic reasoning (goal-directed use of the theory of mind) control this intuitive drive for prosociality as a means to maximize reward when there are no future implications of choices.

Cortical thickness of the dorsolateral prefrontal cortex predicts strategic choices in economic games

PubMed Central

Yamagishi, Toshio; Takagishi, Haruto; Fermin, Alan de Souza Rodrigues; Kanai, Ryota; Li, Yang; Matsumoto, Yoshie

2016-01-01

Human prosociality has been traditionally explained in the social sciences in terms of internalized social norms. Recent neuroscientific studies extended this traditional view of human prosociality by providing evidence that prosocial choices in economic games require cognitive control of the impulsive pursuit of self-interest. However, this view is challenged by an intuitive prosociality view emphasizing the spontaneous and heuristic basis of prosocial choices in economic games. We assessed the brain structure of 411 players of an ultimatum game (UG) and a dictator game (DG) and measured the strategic reasoning ability of 386. According to the reflective norm-enforcement view of prosociality, only those capable of strategically controlling their selfish impulses give a fair share in the UG, but cognitive control capability should not affect behavior in the DG. Conversely, we support the intuitive prosociality view by showing for the first time, to our knowledge, that strategic reasoning and cortical thickness of the dorsolateral prefrontal cortex were not related to giving in the UG but were negatively related to giving in the DG. This implies that the uncontrolled choice in the DG is prosocial rather than selfish, and those who have a thicker dorsolateral prefrontal cortex and are capable of strategic reasoning (goal-directed use of the theory of mind) control this intuitive drive for prosociality as a means to maximize reward when there are no future implications of choices. PMID:27140622

Interneuronal Mechanism for Tinbergen’s Hierarchical Model of Behavioral Choice

PubMed Central

Pirger, Zsolt; Crossley, Michael; László, Zita; Naskar, Souvik; Kemenes, György; O’Shea, Michael; Benjamin, Paul R.; Kemenes, Ildikó

2014-01-01

Summary Recent studies of behavioral choice support the notion that the decision to carry out one behavior rather than another depends on the reconfiguration of shared interneuronal networks [1]. We investigated another decision-making strategy, derived from the classical ethological literature [2, 3], which proposes that behavioral choice depends on competition between autonomous networks. According to this model, behavioral choice depends on inhibitory interactions between incompatible hierarchically organized behaviors. We provide evidence for this by investigating the interneuronal mechanisms mediating behavioral choice between two autonomous circuits that underlie whole-body withdrawal [4, 5] and feeding [6] in the pond snail Lymnaea. Whole-body withdrawal is a defensive reflex that is initiated by tactile contact with predators. As predicted by the hierarchical model, tactile stimuli that evoke whole-body withdrawal responses also inhibit ongoing feeding in the presence of feeding stimuli. By recording neurons from the feeding and withdrawal networks, we found no direct synaptic connections between the interneuronal and motoneuronal elements that generate the two behaviors. Instead, we discovered that behavioral choice depends on the interaction between two unique types of interneurons with asymmetrical synaptic connectivity that allows withdrawal to override feeding. One type of interneuron, the Pleuro-Buccal (PlB), is an extrinsic modulatory neuron of the feeding network that completely inhibits feeding when excited by touch-induced monosynaptic input from the second type of interneuron, Pedal-Dorsal12 (PeD12). PeD12 plays a critical role in behavioral choice by providing a synaptic pathway joining the two behavioral networks that underlies the competitive dominance of whole-body withdrawal over feeding. PMID:25155505

Feeling global, acting ethically: global identification and fairtrade consumption.

PubMed

Reese, Gerhard; Kohlmann, Fabienne

2015-01-01

Global identification has become a popular construct in recent psychological debate as it relates to harmonious intergroup relations and a caring for all humanity. Based on social identity theorizing, the current research tests whether global identification can also predict consumer choices, at the expense of lower personal benefit. Importantly, we assumed that concerns about global injustice represent a crucial component of that relation. We predicted that participants who identified strongly with all humanity would rather choose a Fairtrade product alternative over a conventional one, compared with low identifiers. In addition, we assumed that this effect be mediated by perceived global injustice. Both predictions were confirmed in a consumer choice study (N = 68). Overall, global identification and globally relevant consumer behavior seem meaningfully interconnected, and we discuss these findings with regard to recent theoretical developments in Fairtrade consumption research.

Identity-Specific Reward Representations in Orbitofrontal Cortex Are Modulated by Selective Devaluation

PubMed Central

Howard, James D.

2017-01-01

Goal-directed behavior is sensitive to the current value of expected outcomes. This requires independent representations of specific rewards, which have been linked to orbitofrontal cortex (OFC) function. However, the mechanisms by which the human brain updates specific goals on the fly, and translates those updates into choices, have remained unknown. Here we implemented selective devaluation of appetizing food odors in combination with pattern-based neuroimaging and a decision-making task. We found that in a hungry state, participants chose to smell high-intensity versions of two value-matched food odor rewards. After eating a meal corresponding to one of the two odors, participants switched choices toward the low intensity of the sated odor but continued to choose the high intensity of the nonsated odor. This sensory-specific behavioral effect was mirrored by pattern-based changes in fMRI signal in lateral posterior OFC, where specific reward identity representations were altered after the meal for the sated food odor but retained for the nonsated counterpart. In addition, changes in functional connectivity between the OFC and general value coding in ventromedial prefrontal cortex (vmPFC) predicted individual differences in satiety-related choice behavior. These findings demonstrate how flexible representations of specific rewards in the OFC are updated by devaluation, and how functional connections to vmPFC reflect the current value of outcomes and guide goal-directed behavior. SIGNIFICANCE STATEMENT The orbitofrontal cortex (OFC) is critical for goal-directed behavior. A recent proposal is that OFC fulfills this function by representing a variety of state and task variables (“cognitive maps”), including a conjunction of expected reward identity and value. Here we tested how identity-specific representations of food odor reward are updated by satiety. We found that fMRI pattern-based signatures of reward identity in lateral posterior OFC were modulated after selective devaluation, and that connectivity between this region and general value coding ventromedial prefrontal cortex (vmPFC) predicted choice behavior. These results provide evidence for a mechanism by which devaluation modulates a cognitive map of expected reward in OFC and thereby alters general value signals in vmPFC to guide goal-directed behavior. PMID:28159906

Dynamics of memory-guided choice behavior in Drosophila

PubMed Central

ICHINOSE, Toshiharu; TANIMOTO, Hiromu

2016-01-01

Memory retrieval requires both accuracy and speed. Olfactory learning of the fruit fly Drosophila melanogaster serves as a powerful model system to identify molecular and neuronal substrates of memory and memory-guided behavior. The behavioral expression of olfactory memory has traditionally been tested as a conditioned odor response in a simple T-maze, which measures the result, but not the speed, of odor choice. Here, we developed multiplexed T-mazes that allow video recording of the choice behavior. Automatic fly counting in each arm of the maze visualizes choice dynamics. Using this setup, we show that the transient blockade of serotonergic neurons slows down the choice, while leaving the eventual choice intact. In contrast, activation of the same neurons impairs the eventual performance leaving the choice speed unchanged. Our new apparatus contributes to elucidating how the speed and the accuracy of memory retrieval are implemented in the fly brain. PMID:27725473

Common Visual Preference for Curved Contours in Humans and Great Apes.

PubMed

Munar, Enric; Gómez-Puerto, Gerardo; Call, Josep; Nadal, Marcos

2015-01-01

Among the visual preferences that guide many everyday activities and decisions, from consumer choices to social judgment, preference for curved over sharp-angled contours is commonly thought to have played an adaptive role throughout human evolution, favoring the avoidance of potentially harmful objects. However, because nonhuman primates also exhibit preferences for certain visual qualities, it is conceivable that humans' preference for curved contours is grounded on perceptual and cognitive mechanisms shared with extant nonhuman primate species. Here we aimed to determine whether nonhuman great apes and humans share a visual preference for curved over sharp-angled contours using a 2-alternative forced choice experimental paradigm under comparable conditions. Our results revealed that the human group and the great ape group indeed share a common preference for curved over sharp-angled contours, but that they differ in the manner and magnitude with which this preference is expressed behaviorally. These results suggest that humans' visual preference for curved objects evolved from earlier primate species' visual preferences, and that during this process it became stronger, but also more susceptible to the influence of higher cognitive processes and preference for other visual features.

Economic Thinking for Strategic Leaders

DTIC Science & Technology

2011-03-24

unprepared to analyze certain complex, ambiguous issues and craft informed decisions. 15. SUBJECT TERMS Behavioral Economics, Public Choice Theory ...COUNT: 7,668 PAGES: 38 KEY TERMS: Behavioral Economics, Public Choice Theory , Army Profession CLASSIFICATION: Unclassified Military senior...various economic fields, including Identity Economics, Neoclassical Economics, Behavioral Economics, and Public Choice Economics. Finally, it

Pramipexole-induced disruption of behavioral processes fundamental to intertemporal choice.

PubMed

Johnson, Patrick S; Stein, Jeffrey S; Smits, Rochelle R; Madden, Gregory J

2013-05-01

Evaluating the effects of presession drug administration on intertemporal choice in nonhumans is a useful approach for identifying compounds that promote impulsive behavior in clinical populations, such as those prescribed the dopamine agonist pramipexole (PPX). Based on the results of previous studies, it is unclear whether PPX increases rats' impulsive choice or attenuates aspects of stimulus control. The present study was designed to experimentally isolate behavioral processes fundamental to intertemporal choice and challenge them pharmacologically with PPX administration. In Experiment 1, the hypothesis that PPX increases impulsive choice as a result of enhanced sensitivity to reinforcer delays was tested and disconfirmed. That is, acute PPX diminished delay sensitivity in a manner consistent with disruption of stimulus control whereas repeated PPX had no effect on delay sensitivity. Experiments 2 and 3 elaborated upon this finding by examining the effects of repeated PPX on rats' discrimination of response-reinforcer contingencies and reinforcer amounts, respectively. Accuracy of both discriminations was reduced by PPX. Collectively these results provide no support for past studies that have suggested PPX increases impulsive choice. Instead, PPX impairs stimulus control over choice behavior. The behavioral approach adopted herein could be profitably integrated with genetic and other biobehavioral models to advance our understanding of impulsive behavior associated with drug administration. © Society for the Experimental Analysis of Behavior.

Mindset switching increases the use of 'want-based' over 'should-based' behaviors

PubMed Central

Zhang, Nan-Nan; Xu, Dai-Xuan

2018-01-01

This study examines the consequences of mindset switching on behavioral choices in want/should conflicts. Building on the insights of the ego depletion literature, we propose that mindset switching depletes individuals’ self-control resources and therefore prompts the choice of want behavior, which provides immediate pleasure, over should behavior, which provides long-term utility. Four laboratory experiments with university students that stimulated individuals to switch mindsets were conducted to test our hypotheses. Experiment 1 demonstrated that switching between individualist and collectivist mindsets increased the subjects’ tendency to prefer popular magazines over scientific journals. Experiment 2 replicated the results by testing the relationship between an abstract/concrete mindset-switching task and want/should online behavioral choices. The mediating effect of ego depletion was also supported. Experiment 3 retested the main effect of language-switching on reading choices, and the mediating effect of ego-depletion. Experiment 3 also tested the moderating effect of the Need for Cognition, and eliminated the alternative explanation of cognitive fatigue. In Experiment 4, actual food choices were used as the direct measure of want/should behaviors to test the robustness of our findings. The results consistently supported our hypotheses that mindset switching has significant effects on behavioral choices in terms of overindulgence, such as increasing want behavior and thus foregoing should behavior. PMID:29709003

Reward and decision processes in the brains of humans and nonhuman primates.

PubMed

Sirigu, Angela; Duhamel, Jean-René

2016-03-01

Choice behavior requires weighing multiple decision variables, such as utility, uncertainty, delay, or effort, that combine to define a subjective value for each considered option or course of action. This capacity is based on prior learning about potential rewards (and punishments) that result from prior actions. When made in a social context, decisions can involve strategic thinking about the intentions of others and about the impact of others' behavior on one's own outcome. Valuation is also influenced by different emotions that serve to adaptively regulate our choices in order to, for example, stay away from excessively risky gambles, prevent future regrets, or avoid personal rejection or conflicts. Drawing on economic theory and on advances in the study of neuronal mechanisms, we review relevant recent experiments in nonhuman primates and clinical observations made in neurologically impaired patients suffering from impaired decision-making capacities.

Reward and decision processes in the brains of humans and nonhuman primates

PubMed Central

Sirigu, Angela; Duhamel, Jean-René

2016-01-01

Choice behavior requires weighing multiple decision variables, such as utility, uncertainty, delay, or effort, that combine to define a subjective value for each considered option or course of action. This capacity is based on prior learning about potential rewards (and punishments) that result from prior actions. When made in a social context, decisions can involve strategic thinking about the intentions of others and about the impact of others' behavior on one's own outcome. Valuation is also influenced by different emotions that serve to adaptively regulate our choices in order to, for example, stay away from excessively risky gambles, prevent future regrets, or avoid personal rejection or conflicts. Drawing on economic theory and on advances in the study of neuronal mechanisms, we review relevant recent experiments in nonhuman primates and clinical observations made in neurologically impaired patients suffering from impaired decision-making capacities. PMID:27069379

Reduced Sensitivity to Sooner Reward During Intertemporal Decision-Making Following Insula Damage in Humans

PubMed Central

Sellitto, Manuela; Ciaramelli, Elisa; Mattioli, Flavia; di Pellegrino, Giuseppe

2016-01-01

During intertemporal choice, humans tend to prefer small-sooner rewards over larger-delayed rewards, reflecting temporal discounting (TD) of delayed outcomes. Functional neuroimaging (fMRI) evidence has implicated the insular cortex in time-sensitive decisions, yet it is not clear whether activity in this brain region is crucial for, or merely associated with, TD behavior. Here, patients with damage to the insula (Insular patients), control patients with lesions outside the insula, and healthy individuals chose between smaller-sooner and larger-later monetary rewards. Insular patients were less sensitive to sooner rewards than were the control groups, exhibiting reduced TD. A Voxel-based Lesion-Symptom Mapping (VLSM) analysis confirmed a statistically significant association between insular damage and reduced TD. These results indicate that the insular cortex is crucial for intertemporal choice. We suggest that he insula may be necessary to anticipate the bodily/emotional effects of receiving rewards at different delays, influencing the computation of their incentive value. Devoid of such input, insular patients’ choices would be governed by a heuristic of quantity, allowing patients to wait for larger options. PMID:26793084

Encoding of marginal utility across time in the human brain.

PubMed

Pine, Alex; Seymour, Ben; Roiser, Jonathan P; Bossaerts, Peter; Friston, Karl J; Curran, H Valerie; Dolan, Raymond J

2009-07-29

Marginal utility theory prescribes the relationship between the objective property of the magnitude of rewards and their subjective value. Despite its pervasive influence, however, there is remarkably little direct empirical evidence for such a theory of value, let alone of its neurobiological basis. We show that human preferences in an intertemporal choice task are best described by a model that integrates marginally diminishing utility with temporal discounting. Using functional magnetic resonance imaging, we show that activity in the dorsal striatum encodes both the marginal utility of rewards, over and above that which can be described by their magnitude alone, and the discounting associated with increasing time. In addition, our data show that dorsal striatum may be involved in integrating subjective valuation systems inherent to time and magnitude, thereby providing an overall metric of value used to guide choice behavior. Furthermore, during choice, we show that anterior cingulate activity correlates with the degree of difficulty associated with dissonance between value and time. Our data support an integrative architecture for decision making, revealing the neural representation of distinct subcomponents of value that may contribute to impulsivity and decisiveness.

AdChoices? Compliance with Online Behavioral Advertising Notice and Choice Requirements. Revised Version

DTIC Science & Technology

2011-10-07

further information and a means of opting out. Revised October 7, 2011. Keywords: Online behavioral advertising ; privacy; consumer choice; notice... consumers ’ activities online to target advertising .”1 The FTC has been examining ways to reduce the privacy concerns associated with OBA for over a decade...behavioral advertising practices that would foster transparency, knowledge and choice for consumers . As the FTC determines what to do next, it is

Adult neurobehavioral alterations in male and female mice following developmental exposure to paracetamol (acetaminophen): characterization of a critical period.

PubMed

Philippot, Gaëtan; Gordh, Torsten; Fredriksson, Anders; Viberg, Henrik

2017-10-01

Paracetamol (acetaminophen) is a widely used non-prescription drug with analgesic and antipyretic properties. Among pregnant women and young children, paracetamol is one of the most frequently used drugs and is considered the first-choice treatment for pain and/or fever. Recent findings in both human and animal studies have shown associations between paracetamol intake during brain development and adverse behavioral outcomes later in life. The present study was undertaken to investigate if the induction of these effects depend on when the exposure occurs during a critical period of brain development and if male and female mice are equally affected. Mice of both sexes were exposed to two doses of paracetamol (30 + 30 mg kg -1 , 4 h apart) on postnatal days (PND) 3, 10 or 19. Spontaneous behavior, when introduced to a new home environment, was observed at the age of 2 months. We show that adverse effects on adult behavior and cognitive function occurred in both male and female mice exposed to paracetamol on PND 3 and 10, but not when exposed on PND 19. These neurodevelopmental time points in mice correspond to the beginning of the third trimester of pregnancy and the time around birth in humans, supporting existing human data. Considering that paracetamol is the first choice treatment for pain and/or fever during pregnancy and early life, these results may be of great importance for future research and, ultimately, for clinical practice. Copyright © 2017 John Wiley & Sons, Ltd. Copyright © 2017 John Wiley & Sons, Ltd.

Developing Cognitive Models for Social Simulation from Survey Data

NASA Astrophysics Data System (ADS)

Alt, Jonathan K.; Lieberman, Stephen

The representation of human behavior and cognition continues to challenge the modeling and simulation community. The use of survey and polling instruments to inform belief states, issue stances and action choice models provides a compelling means of developing models and simulations with empirical data. Using these types of data to population social simulations can greatly enhance the feasibility of validation efforts, the reusability of social and behavioral modeling frameworks, and the testable reliability of simulations. We provide a case study demonstrating these effects, document the use of survey data to develop cognitive models, and suggest future paths forward for social and behavioral modeling.

Effects of Environmental Manipulations and Treatment with Bupropion and Risperidone on Choice between Methamphetamine and Food in Rhesus Monkeys

PubMed Central

Banks, Matthew L; Blough, Bruce E

2015-01-01

Preclinical and human laboratory choice procedures have been invaluable in improving our knowledge of the neurobiological mechanisms of drug reinforcement and in the drug development process for candidate medications to treat drug addiction. However, little is known about the neuropharmacological mechanisms of methamphetamine vs food choice. The aims of this study were to develop a methamphetamine vs food choice procedure and determine treatment effects with two clinically relevant compounds: the monoamine uptake inhibitor bupropion and the dopamine antagonist risperidone. Rhesus monkeys (n=6) responded under a concurrent schedule of food delivery (1-g pellets, fixed-ratio (FR) 100 schedule) and intravenous methamphetamine injections (0–0.32 mg/kg/injection, FR10 schedule) during 7-day bupropion (0.32–1.8 mg/kg/h) and risperidone (0.001–0.0056 mg/kg/h) treatment periods. For comparison, effects of removing food pellets or methamphetamine injections and FR response requirement manipulations were also examined. Under saline treatment conditions, food was preferred over no methamphetamine or small unit methamphetamine doses (0.01–0.032 mg/kg/injection). Larger methamphetamine doses resulted in greater methamphetamine preference and 0.32 mg/kg/injection methamphetamine maintained near exclusive preference. Removing food availability increased methamphetamine choice, whereas removing methamphetamine availability decreased methamphetamine choice. Methamphetamine choice was not significantly altered when the FR response requirements for food and drug were the same (FR100:FR100 or FR10:FR10). Risperidone treatment increased methamphetamine choice, whereas bupropion treatment did not alter methamphetamine choice up to doses that decreased rates of operant behavior. Overall, these negative results with bupropion and risperidone are concordant with previous human laboratory and clinical trials and support the potential validity of this preclinical methamphetamine vs food choice model. PMID:25742872

Reason's Enemy Is Not Emotion: Engagement of Cognitive Control Networks Explains Biases in Gain/Loss Framing

PubMed Central

2017-01-01

In the classic gain/loss framing effect, describing a gamble as a potential gain or loss biases people to make risk-averse or risk-seeking decisions, respectively. The canonical explanation for this effect is that frames differentially modulate emotional processes, which in turn leads to irrational choice behavior. Here, we evaluate the source of framing biases by integrating functional magnetic resonance imaging data from 143 human participants performing a gain/loss framing task with meta-analytic data from >8000 neuroimaging studies. We found that activation during choices consistent with the framing effect were most correlated with activation associated with the resting or default brain, while activation during choices inconsistent with the framing effect was most correlated with the task-engaged brain. Our findings argue against the common interpretation of gain/loss framing as a competition between emotion and control. Instead, our study indicates that this effect results from differential cognitive engagement across decision frames. SIGNIFICANCE STATEMENT The biases frequently exhibited by human decision makers have often been attributed to the presence of emotion. Using a large fMRI sample and analysis of whole-brain networks defined with the meta-analytic tool Neurosynth, we find that neural activity during frame-biased decisions was more significantly associated with default behaviors (and the absence of executive control) than with emotion. These findings point to a role for neuroscience in shaping long-standing psychological theories in decision science. PMID:28264981

Reason's Enemy Is Not Emotion: Engagement of Cognitive Control Networks Explains Biases in Gain/Loss Framing.

PubMed

Li, Rosa; Smith, David V; Clithero, John A; Venkatraman, Vinod; Carter, R McKell; Huettel, Scott A

2017-03-29

In the classic gain/loss framing effect, describing a gamble as a potential gain or loss biases people to make risk-averse or risk-seeking decisions, respectively. The canonical explanation for this effect is that frames differentially modulate emotional processes, which in turn leads to irrational choice behavior. Here, we evaluate the source of framing biases by integrating functional magnetic resonance imaging data from 143 human participants performing a gain/loss framing task with meta-analytic data from >8000 neuroimaging studies. We found that activation during choices consistent with the framing effect were most correlated with activation associated with the resting or default brain, while activation during choices inconsistent with the framing effect was most correlated with the task-engaged brain. Our findings argue against the common interpretation of gain/loss framing as a competition between emotion and control. Instead, our study indicates that this effect results from differential cognitive engagement across decision frames. SIGNIFICANCE STATEMENT The biases frequently exhibited by human decision makers have often been attributed to the presence of emotion. Using a large fMRI sample and analysis of whole-brain networks defined with the meta-analytic tool Neurosynth, we find that neural activity during frame-biased decisions was more significantly associated with default behaviors (and the absence of executive control) than with emotion. These findings point to a role for neuroscience in shaping long-standing psychological theories in decision science. Copyright © 2017 the authors 0270-6474/17/373588-11$15.00/0.

The Neural Basis of Social Influence in a Dictator Decision

PubMed Central

Wei, Zhenyu; Zhao, Zhiying; Zheng, Yong

2017-01-01

Humans tend to reduce inequitable distributions. Previous neuroimaging studies have shown that inequitable decisions are related to brain regions that associated with negative emotion and signaling conflict. In the highly complex human social environment, our opinions and behaviors can be affected by social information. In current study, we used a modified dictator game to investigate the effect of social influence on making an equitable decision. We found that the choices of participants in present task was influenced by the choices of peers. However, participants’ decisions were influenced by equitable rather than inequitable group choices. fMRI results showed that brain regions that related to norm violation and social conflict were related to the inequitable social influence. The neural responses in the dorsomedial prefrontal cortex, rostral cingulate zone, and insula predicted subsequent conforming behavior in individuals. Additionally, psychophysiological interaction analysis revealed that the interconnectivity between the dorsal striatum and insula was elevated in advantageous inequity influence versus no-social influence conditions. We found decreased functional connectivity between the medial prefrontal cortex and insula, supplementary motor area, posterior cingulate gyrus and dorsal anterior cingulate cortex in the disadvantageous inequity influence versus no-social influence conditions. This suggests that a disadvantageous inequity influence may decrease the functional connectivity among brain regions that are related to reward processes. Thus, the neural mechanisms underlying social influence in an equitable decision may be similar to those implicated in social norms and reward processing. PMID:29375412

Inhaled oxytocin amplifies both vicarious reinforcement and self reinforcement in rhesus macaques (Macaca mulatta)

PubMed Central

Chang, Steve W. C.; Barter, Joseph W.; Ebitz, R. Becket; Watson, Karli K.; Platt, Michael L.

2012-01-01

People attend not only to their own experiences, but also to the experiences of those around them. Such social awareness profoundly influences human behavior by enabling observational learning, as well as by motivating cooperation, charity, empathy, and spite. Oxytocin (OT), a neurosecretory hormone synthesized by hypothalamic neurons in the mammalian brain, can enhance affiliation or boost exclusion in different species in distinct contexts, belying any simple mechanistic neural model. Here we show that inhaled OT penetrates the CNS and subsequently enhances the sensitivity of rhesus macaques to rewards occurring to others as well as themselves. Roughly 2 h after inhaling OT, monkeys increased the frequency of prosocial choices associated with reward to another monkey when the alternative was to reward no one. OT also increased attention to the recipient monkey as well as the time it took to render such a decision. In contrast, within the first 2 h following inhalation, OT increased selfish choices associated with delivery of reward to self over a reward to the other monkey, without affecting attention or decision latency. Despite the differences in species typical social behavior, exogenous, inhaled OT causally promotes social donation behavior in rhesus monkeys, as it does in more egalitarian and monogamous ones, like prairie voles and humans, when there is no perceived cost to self. These findings potentially implicate shared neural mechanisms. PMID:22215593

Understanding the dynamics of sustainable social-ecological systems: human behavior, institutions, and regulatory feedback networks.

PubMed

Anderies, John M

2015-02-01

I present a general mathematical modeling framework that can provide a foundation for the study of sustainability in social- ecological systems (SESs). Using basic principles from feedback control and a sequence of specific models from bioeconomics and economic growth, I outline several mathematical and empirical challenges associated with the study of sustainability of SESs. These challenges are categorized into three classes: (1) the social choice of performance measures, (2) uncertainty, and (3) collective action. Finally, I present some opportunities for combining stylized dynamical systems models with empirical data on human behavior and biophysical systems to address practical challenges for the design of effective governance regimes (policy feedbacks) for highly uncertain natural resource systems.

The origin of bounded rationality and intelligence.

PubMed

Lo, Andrew W

2013-09-01

Rational economic behavior in which individuals maximize their own self-interest is only one of many possible types of behavior that arise from natural selection. Given an initial population of individuals, each assigned a purely arbitrary behavior with respect to a binary choice problem, and assuming that offspring behave identically to their parents, only those behaviors linked to reproductive success will survive, and less successful behaviors will disappear exponentially fast. This framework yields a single evolutionary explanation for the origin of several behaviors that have been observed in organisms ranging from bacteria to humans, including risk-sensitive foraging, risk aversion, loss aversion, probability matching, randomization, and diversification. The key to understanding which types of behavior are more likely to survive is how behavior affects reproductive success in a given population's environment. From this perspective, intelligence is naturally defined as behavior that increases the likelihood of reproductive success, and bounds on rationality are determined by physiological and environmental constraints.

Institutional Constraints on the Development of Curricular Policy Alternatives. ASHE Annual Meeting Paper.

ERIC Educational Resources Information Center

Arnold, Gordon B.

A study of the college curriculum decision-making process examined the generation of options or alternatives considered as part of a general education curriculum revision in the late 1980s at a major church-affiliated university. This process was examined in the framework of the rational-choice model of human behavior. Data were gathered from a…

The power and value of green in promoting sustainable transport behavior

NASA Astrophysics Data System (ADS)

Gaker, David; Vautin, David; Vij, Akshay; Walker, Joan L.

2011-07-01

While it is increasingly popular to broadcast information regarding environmental impact, little is known regarding the effects that this information has on human behavior. This research aims to provide insight into whether, and to what extent, presenting environmental attributes of transport alternatives influences individual transport decisions. We designed and conducted three experiments in which subjects (UC Berkeley undergraduates) were presented with hypothetical scenarios of transport decisions, including auto purchase choice, mode choice, and route choice. We analyzed their decisions via a choice model to determine how they value reducing their emissions relative to other attributes. We found that our subjects are willing to adjust their behavior to reduce emissions, exhibiting an average willingness to pay for emissions reduction, or value of green (VoG), of 15 cents per pound of CO2 saved. Despite concern that people cannot meaningfully process quantities of CO2, we found evidence to the contrary in our subject pool in that the estimated VoG was consistent across context (the wide range of transport decisions that we presented) and presentation (e.g., whether the information was presented in tons or pounds, or whether a social reference point of the emissions of an average person was provided). We also found significant heterogeneity in VoG, with most of the respondents valuing green somewhere between 0 and 70 cents per pound and with women, on average, willing to pay 7 cents more per saved pound than men. While the findings are encouraging, further work is required to determine whether they hold outside of a lab environment and with a more representative pool of subjects.

The role of anthropic, ecological, and social factors in sleeping site choice by long-tailed macaques (Macaca fascicularis).

PubMed

Brotcorne, Fany; Maslarov, Cindy; Wandia, I Nengah; Fuentes, Agustin; Beudels-Jamar, Roseline C; Huynen, Marie-Claude

2014-12-01

When choosing their sleeping sites, primates make adaptive trade-offs between various biotic and abiotic constraints. In human-modified environments, anthropic factors may play a role. We assessed the influence of ecological (predation), social (intergroup competition), and anthropic (proximity to human settlements) factors in sleeping site choice by long-tailed macaques (Macaca fascicularis) occupying a habitat at the interface of natural forests and human-modified zones in Bali Barat National Park, Indonesia. Over the course of 56 nights, we collected data relating to physical features of sleeping trees, patterns of the use of sleeping sites within the home range, pre-sleep behavior, diurnal ranging patterns and availability of natural and human food. Overall, the macaques used 17 sleeping sites with 37 sleeping trees. When the monkeys slept in forest zones, they selected sleeping trees that had larger trunks but were not significantly taller than surrounding trees. Though the macaques rarely re-used sleeping sites on consecutive nights, they frequently re-used four sites over the study period. The group favored sleeping within the core area of its home range, despite the occurrence of frequent agonistic intergroup encounters there. Macaques preferentially selected sleeping trees located within or near human-modified zones, especially when human food was abundant and natural food was scarce. These results partially support the hypothesis that long-tailed macaques choose their sleeping sites to avoid predation; proximity to human settlements appears to be the primary factor influencing sleeping site choice in this primate species. Our results reflect the strong influence that anthropic factors have on primates, which subsist in increasingly human-dominated landscapes. © 2014 Wiley Periodicals, Inc.

Nudging and Boosting: Steering or Empowering Good Decisions.

PubMed

Hertwig, Ralph; Grüne-Yanoff, Till

2017-11-01

In recent years, policy makers worldwide have begun to acknowledge the potential value of insights from psychology and behavioral economics into how people make decisions. These insights can inform the design of nonregulatory and nonmonetary policy interventions-as well as more traditional fiscal and coercive measures. To date, much of the discussion of behaviorally informed approaches has emphasized "nudges," that is, interventions designed to steer people in a particular direction while preserving their freedom of choice. Yet behavioral science also provides support for a distinct kind of nonfiscal and noncoercive intervention, namely, "boosts." The objective of boosts is to foster people's competence to make their own choices-that is, to exercise their own agency. Building on this distinction, we further elaborate on how boosts are conceptually distinct from nudges: The two kinds of interventions differ with respect to (a) their immediate intervention targets, (b) their roots in different research programs, (c) the causal pathways through which they affect behavior, (d) their assumptions about human cognitive architecture, (e) the reversibility of their effects, (f) their programmatic ambitions, and (g) their normative implications. We discuss each of these dimensions, provide an initial taxonomy of boosts, and address some possible misconceptions.

A Personal Value-Based Model of College Students' Aptitudes and Expected Choice Behavior Regarding Retailing Careers.

ERIC Educational Resources Information Center

Shim, Soyeon; Warrington, Patti; Goldsberry, Ellen

1999-01-01

A study of 754 retail management students developed a value-based model of career attitude and expected choice behavior. Findings indicate that personal values had an influence on all aspects of retail career attitudes, which then had a direct effect on expected choice behavior. (Contains 55 references.) (Author/JOW)

Phenotypic plasticity in female mate choice behavior is mediated by an interaction of direct and indirect genetic effects in Drosophila melanogaster.

PubMed

Filice, David C S; Long, Tristan A F

2017-05-01

Female mate choice is a complex decision-making process that involves many context-dependent factors. In Drosophila melanogaster , a model species for the study of sexual selection, indirect genetic effects (IGEs) of general social interactions can influence female mate choice behaviors, but the potential impacts of IGEs associated with mating experiences are poorly understood. Here, we examined whether the IGEs associated with a previous mating experience had an effect on subsequent female mate choice behaviors and quantified the degree of additive genetic variation associated with this effect. Females from 21 different genetic backgrounds were housed with males from one of two distinct genetic backgrounds for either a short (3 hr) or long (48 hr) exposure period and their subsequent mate choice behaviors were scored. We found that the genetic identity of a previous mate significantly influenced a female's subsequent interest in males and preference of males. Additionally, a hemiclonal analysis revealed significant additive genetic variation associated with experience-dependent mate choice behaviors, indicating a genotype-by-environment interaction for both of these parameters. We discuss the significance of these results with regard to the evolution of plasticity in female mate choice behaviors and the maintenance of variation in harmful male traits.

Modeling choice and reaction time during arbitrary visuomotor learning through the coordination of adaptive working memory and reinforcement learning

PubMed Central

Viejo, Guillaume; Khamassi, Mehdi; Brovelli, Andrea; Girard, Benoît

2015-01-01

Current learning theory provides a comprehensive description of how humans and other animals learn, and places behavioral flexibility and automaticity at heart of adaptive behaviors. However, the computations supporting the interactions between goal-directed and habitual decision-making systems are still poorly understood. Previous functional magnetic resonance imaging (fMRI) results suggest that the brain hosts complementary computations that may differentially support goal-directed and habitual processes in the form of a dynamical interplay rather than a serial recruitment of strategies. To better elucidate the computations underlying flexible behavior, we develop a dual-system computational model that can predict both performance (i.e., participants' choices) and modulations in reaction times during learning of a stimulus–response association task. The habitual system is modeled with a simple Q-Learning algorithm (QL). For the goal-directed system, we propose a new Bayesian Working Memory (BWM) model that searches for information in the history of previous trials in order to minimize Shannon entropy. We propose a model for QL and BWM coordination such that the expensive memory manipulation is under control of, among others, the level of convergence of the habitual learning. We test the ability of QL or BWM alone to explain human behavior, and compare them with the performance of model combinations, to highlight the need for such combinations to explain behavior. Two of the tested combination models are derived from the literature, and the latter being our new proposal. In conclusion, all subjects were better explained by model combinations, and the majority of them are explained by our new coordination proposal. PMID:26379518

A new consequence of Simpson's paradox: stable cooperation in one-shot prisoner's dilemma from populations of individualistic learners.

PubMed

Chater, Nick; Vlaev, Ivo; Grinberg, Maurice

2008-08-01

Theories of choice in economics typically assume that interacting agents act individualistically and maximize their own utility. Specifically, game theory proposes that rational players should defect in one-shot prisoners' dilemmas (PD). Defection also appears to be the inevitable outcome for agents who learn by reinforcement of past choices, because whatever the other player does, defection leads to greater reinforcement on each trial. In a computer simulation and 4 experiments, the authors show that, apparently paradoxically, when players' choices are correlated by an exogenous factor (here, the cooperativeness of the specific PD chosen), people obtain greater average reinforcement for cooperating, which can sustain cooperation. This effect arises from a well-known statistical paradox, Simpson's paradox. The authors speculate that this effect may be relevant to aspects of real-world human cooperative behavior.

Diets and Health: How Food Decisions Are Shaped by Biology, Economics, Geography, and Social Interactions.

PubMed

Drewnowski, Adam; Kawachi, Ichiro

2015-09-01

Health is shaped by both personal choices and features of the food environment. Food-choice decisions depend on complex interactions between biology and behavior, and are further modulated by the built environment and community structure. That lower-income families have lower-quality diets is well established. Yet, diet quality also varies across small geographic neighborhoods and can be influenced by transportation, retail, and ease of access to healthy foods, as well as by attitudes, beliefs, and social interactions. The learnings from the Seattle Obesity Study (SOS II) can be usefully applied to the much larger, more complex, and far more socially and ethnically diverse urban environment of New York City. The Kavli HUMAN Project (KHP) is ideally positioned to advance the understanding of health disparities by exploring the multiple underpinnings of food decision making. By combining geo-localized food shopping and consumption data with health behaviors, diet quality measures, and biomarkers, also coded by geographic location, the KHP will create the first-of-its-kind bio-behavioral, economic, and cultural atlas of diet quality and health for New York City.

Aberrant Food Choices after Satiation in Human Orexin-Deficient Narcolepsy Type 1.

PubMed

van Holst, Ruth Janke; van der Cruijsen, Lisa; van Mierlo, Petra; Lammers, Gert Jan; Cools, Roshan; Overeem, Sebastiaan; Aarts, Esther

2016-11-01

Besides influencing vigilance, orexin neurotransmission serves a variety of functions, including reward, motivation, and appetite regulation. As obesity is an important symptom in orexin-deficient narcolepsy, we explored the effects of satiety on food-related choices and spontaneous snack intake in patients with narcolepsy type 1 (n = 24) compared with healthy matched controls (n = 19). In additional analyses, we also included patients with idiopathic hypersomnia (n = 14) to assess sleepiness-related influences. Participants were first trained on a choice task to earn salty and sweet snacks. Next, one of the snack outcomes was devalued by having participants consume it until satiation (i.e., sensory-specific satiety). We then measured the selective reduction in choices for the devalued snack outcome. Finally, we assessed the number of calories that participants consumed spontaneously from ad libitum available snacks afterwards. After satiety, all participants reported reduced hunger and less wanting for the devalued snack. However, while controls and idiopathic hypersomnia patients chose the devalued snack less often in the choice task, patients with narcolepsy still chose the devalued snack as often as before satiety. Subsequently, narcolepsy patients spontaneously consumed almost 4 times more calories during ad libitum snack intake. We show that the manipulation of food-specific satiety has reduced effects on food choices and caloric intake in narcolepsy type 1 patients. These mechanisms may contribute to their obesity, and suggest an important functional role for orexin in human eating behavior. Study registered at Netherlands Trial Register. URL: www.trialregister.nl. Trial ID: NTR4508. © 2016 Associated Professional Sleep Societies, LLC.

Foundations to the unified psycho-cognitive engine.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bernard, Michael Lewis; Bier, Asmeret Brooke; Backus, George A.

This document outlines the key features of the SNL psychological engine. The engine is designed to be a generic presentation of cognitive entities interacting among themselves and with the external world. The engine combines the most accepted theories of behavioral psychology with those of behavioral economics to produce a unified simulation of human response from stimuli through executed behavior. The engine explicitly recognizes emotive and reasoned contributions to behavior and simulates the dynamics associated with cue processing, learning, and choice selection. Most importantly, the model parameterization can come from available media or survey information, as well subject-matter-expert information. The frameworkmore » design allows the use of uncertainty quantification and sensitivity analysis to manage confidence in using the analysis results for intervention decisions.« less

Sex-related variation in human behavior and the brain

PubMed Central

Hines, Melissa

2010-01-01

Male and female fetuses differ in testosterone concentrations beginning as early as week 8 of gestation. This early hormone difference exerts permanent influences on brain development and behavior. Contemporary research shows that hormones are particularly important for the development of sex-typical childhood behavior, including toy choices, which until recently were thought to result solely from sociocultural influences. Prenatal testosterone exposure also appears to influence sexual orientation and gender identity, as well as some, but not all, sex-related cognitive, motor and personality characteristics. Neural mechanisms responsible for these hormone-induced behavioral outcomes are beginning to be identified, and current evidence suggests involvement of the hypothalamus and amygdala, as well as interhemispheric connectivity, and cortical areas involved in visual processing. PMID:20724210

Within- and across-trial dynamics of human EEG reveal cooperative interplay between reinforcement learning and working memory.

PubMed

Collins, Anne G E; Frank, Michael J

2018-03-06

Learning from rewards and punishments is essential to survival and facilitates flexible human behavior. It is widely appreciated that multiple cognitive and reinforcement learning systems contribute to decision-making, but the nature of their interactions is elusive. Here, we leverage methods for extracting trial-by-trial indices of reinforcement learning (RL) and working memory (WM) in human electro-encephalography to reveal single-trial computations beyond that afforded by behavior alone. Neural dynamics confirmed that increases in neural expectation were predictive of reduced neural surprise in the following feedback period, supporting central tenets of RL models. Within- and cross-trial dynamics revealed a cooperative interplay between systems for learning, in which WM contributes expectations to guide RL, despite competition between systems during choice. Together, these results provide a deeper understanding of how multiple neural systems interact for learning and decision-making and facilitate analysis of their disruption in clinical populations.

A neural circuit encoding sexual preference in humans

PubMed Central

Poeppl, Timm B.; Langguth, Berthold; Rupprecht, Rainer; Laird, Angela R; Eickhoff, Simon B.

2016-01-01

Sexual preference determines mate choice for reproduction and hence guarantees conservation of species in mammals. Despite this fundamental role in human behavior, current knowledge on its target-specific neurofunctional substrate is based on lesion studies and therefore limited. We used meta-analytic remodeling of neuroimaging data from 364 human subjects with diverse sexual interests during sexual stimulation to quantify neural regions associated with sexual preference manipulations. We found that sexual preference is encoded by four phylogenetically old, subcortical brain structures. More specifically, sexual preference is controlled by the anterior and preoptic area of the hypothalamus, the anterior and mediodorsal thalamus, the septal area, and the perirhinal parahippocampus including the dentate gyrus. In contrast, sexual non-preference is regulated by the substantia innominata. We anticipate the identification of a core neural circuit for sexual preferences to be a starting point for further sophisticated investigations into the neural principles of sexual behavior and particularly of its aberrations. PMID:27339689

Arbitration between controlled and impulsive choices

PubMed Central

Economides, M.; Guitart-Masip, M.; Kurth-Nelson, Z.; Dolan, R.J.

2015-01-01

The impulse to act for immediate reward often conflicts with more deliberate evaluations that support long-term benefit. The neural architecture that negotiates this conflict remains unclear. One account proposes a single neural circuit that evaluates both immediate and delayed outcomes, while another outlines separate impulsive and patient systems that compete for behavioral control. Here we designed a task in which a complex payout structure divorces the immediate value of acting from the overall long-term value, within the same outcome modality. Using model-based fMRI in humans, we demonstrate separate neural representations of immediate and long-term values, with the former tracked in the anterior caudate (AC) and the latter in the ventromedial prefrontal cortex (vmPFC). Crucially, when subjects' choices were compatible with long-run consequences, value signals in AC were down-weighted and those in vmPFC were enhanced, while the opposite occurred when choice was impulsive. Thus, our data implicate a trade-off in value representation between AC and vmPFC as underlying controlled versus impulsive choice. PMID:25573670

Stochastic Matching and the Voluntary Nature of Choice

PubMed Central

Neuringer, Allen; Jensen, Greg; Piff, Paul

2007-01-01

Attempts to characterize voluntary behavior have been ongoing for thousands of years. We provide experimental evidence that judgments of volition are based upon distributions of responses in relation to obtained rewards. Participants watched as responses, said to be made by “actors,” appeared on a computer screen. The participant's task was to estimate how well each actor represented the voluntary choices emitted by a real person. In actuality, all actors' responses were generated by algorithms based on Baum's (1979) generalized matching function. We systematically varied the exponent values (sensitivity parameter) of these algorithms: some actors matched response proportions to received reinforcer proportions, others overmatched (predominantly chose the highest-valued alternative), and yet others undermatched (chose relatively equally among the alternatives). In each of five experiments, we found that the matching actor's responses were judged most closely to approximate voluntary choice. We found also that judgments of high volition depended upon stochastic (or probabilistic) generation. Thus, stochastic responses that match reinforcer proportions best represent voluntary human choice. PMID:17725049

How prior preferences determine decision-making frames and biases in the human brain

PubMed Central

Lopez-Persem, Alizée; Domenech, Philippe; Pessiglione, Mathias

2016-01-01

Understanding how option values are compared when making a choice is a key objective for decision neuroscience. In natural situations, agents may have a priori on their preferences that create default policies and shape the neural comparison process. We asked participants to make choices between items belonging to different categories (e.g., jazz vs. rock music). Behavioral data confirmed that the items taken from the preferred category were chosen more often and more rapidly, which qualified them as default options. FMRI data showed that baseline activity in classical brain valuation regions, such as the ventromedial Prefrontal Cortex (vmPFC), reflected the strength of prior preferences. In addition, evoked activity in the same regions scaled with the default option value, irrespective of the eventual choice. We therefore suggest that in the brain valuation system, choices are framed as comparisons between default and alternative options, which might save some resource but induce a decision bias. DOI: http://dx.doi.org/10.7554/eLife.20317.001 PMID:27864918

Decision-Making in the Ventral Premotor Cortex Harbinger of Action

PubMed Central

Pardo-Vazquez, Jose L.; Padron, Isabel; Fernandez-Rey, Jose; Acuña, Carlos

2011-01-01

Although the premotor (PM) cortex was once viewed as the substrate of pure motor functions, soon it was realized that it was involved in higher brain functions. By this it is meant that the PM cortex functions would better be explained as motor set, preparation for limb movement, or sensory guidance of movement rather than solely by a fixed link to motor performance. These findings, together with a better knowledge of the PM cortex histology and hodology in human and non-human primates prompted quantitative studies of this area combining behavioral tasks with electrophysiological recordings. In addition, the exploration of the PM cortex neurons with qualitative methods also suggested its participation in higher functions. Behavioral choices frequently depend on temporal cues, which together with knowledge of previous outcomes and expectancies are combined to decide and choose a behavioral action. In decision-making the knowledge about the consequences of decisions, either correct or incorrect, is fundamental because they can be used to adapt future behavior. The neuronal correlates of a decision process have been described in several cortical areas of primates. Among them, there is evidence that the monkey ventral premotor (PMv) cortex, an anatomical and physiological well-differentiated area of the PM cortex, supports both perceptual decisions and performance monitoring. Here we review the evidence that the steps in a decision-making process are encoded in the firing rate of the PMv neurons. This provides compelling evidence suggesting that the PMv is involved in the use of recent and long-term sensory memory to decide, execute, and evaluate the outcomes of the subjects’ choices. PMID:21991249

When pain meets … pain-related choice behavior and pain perception in different goal conflict situations.

PubMed

Schrooten, Martien G S; Wiech, Katja; Vlaeyen, Johan W S

2014-11-01

Individuals in pain often face the choice between avoiding pain and pursuing other equally valued goals. However, little is known about pain-related choice behavior and pain perception in goal conflict situations. Seventy-eight healthy volunteers performed a computerized task requiring repeated choices between incompatible options, differing in their effect on probability to receive painful stimulation and money. Depending on group assignment, participants chose between increased pain probability versus decreased money probability (avoidance-avoidance conflict situation); decreased pain probability versus increased money probability (approach-approach conflict situation); or decrease versus increase in both probabilities (double approach/avoidance conflict situation). During the choice task, participants rated painfulness, unpleasantness, threat, and fearfulness associated with the painful stimulation and how they felt. Longer choice latency and more choice switching were associated with higher retrospective ratings of conflict and of decision difficulty, and more equal importance placed on pain avoidance and earning money. Groups did not differ in choice behavior, pain stimulus ratings, or affect. Across groups, longer choice latencies were nonsignificantly associated with higher pain, unpleasantness, threat, and fearfulness. In the avoidance-avoidance group, more choice switching was associated with higher pain-related threat and fearfulness, and with more negative affect. These results of this study suggest that associations between choice behaviors, pain perception, and affect depend on conflict situation. We present a first experimental demonstration of the relationship between pain-related choice behaviors, pain, and affect in different goal conflict situations. This experimental approach allows us to examine these relationships in a controlled fashion. Better understanding of pain-related goal conflicts and their resolution may lead to more effective pain treatment. Copyright © 2014 American Pain Society. Published by Elsevier Inc. All rights reserved.

Dopamine Modulates Egalitarian Behavior In Humans

PubMed Central

Sáez, Ignacio; Zhu, Lusha; Set, Eric; Kayser, Andrew; Hsu, Ming

2015-01-01

SUMMARY Egalitarian motives form a powerful force in promoting prosocial behavior and enabling large-scale cooperation in the human species [1]. At the neural level, there is substantial, albeit correlational, evidence suggesting a link between dopamine and such behavior [2, 3]. However, important questions remain about the specific role of dopamine in setting or modulating behavioral sensitivity to prosocial concerns. Here, using a combination of pharmacological tools and economic games, we provide critical evidence for a causal involvement of dopamine in human egalitarian tendencies. Specifically, using the brain-penetrant catechol-O-methyl transferase (COMT) inhibitor tolcapone [4, 5], we investigated the causal relationship between dopaminergic mechanisms and two prosocial concerns at the core of a number of widely used economic games: (i) the extent to which individuals directly value the material payoffs of others, i.e., generosity, and (ii) the extent to which they are averse to differences between their own payoffs and those of others, i.e., inequity. We found that dopaminergic augmentation via COMT inhibition increased egalitarian tendencies in participants who played an extended version of the dictator game [6]. Strikingly, computational modeling of choice behavior [7] revealed that tolcapone exerted selective effects on inequity aversion, and not on other computational components such as the extent to which individuals directly value the material payoffs of others. Together, these data shed light on the causal relationship between neurochemical systems and human prosocial behavior, and have potential implications for our understanding of the complex array of social impairments accompanying neuropsychiatric disorders involving dopaminergic dysregulation. PMID:25802148

Goal- and signal-directed incentive: conditioned approach, seeking, and consumption established with unsweetened alcohol in rats.

PubMed

Krank, Marvin D; O'Neill, Susan; Squarey, Kyna; Jacob, Jackie

2008-02-01

Many theories of addictive behavior propose that cues signaling drug administration influence the likelihood of drug-taking and drug-seeking behavior. We investigated the behavioral impact of cues associated with unsweetened ethanol and their interaction with responding maintained by ethanol self-administration. Our goal was to establish the influence of such cues on ethanol seeking. The experiment used a matching contingency and saccharin-fading procedure to establish equal levels of responding to two spatially distinct levers using unsweetened 10% ethanol solution. After ethanol self-administration was established, a brief cue light located alternately over each lever location was either paired or unpaired (control) with the opportunity to consume the same ethanol solution. Finally, self-administration was re-established, and the effect of the cue was measured in a transfer design. The reaction to lights paired with the opportunity to ingest unsweetened ethanol had three main effects: (1) induction of operant behavior reinforced by ethanol, (2) stimulation of ethanol-seeking behavior (drinker entries), and (3) cue-directed approach and contact behavior (i.e. autoshaping or sign-tracking). Cue-directed behavior to the light interacted with choice behavior in a manner predicted by the location of the cue light, enhancing responding only when the approach response did not interfere with the operant response. These findings replicate and extend the effects of Pavlovian conditioning on ethanol-seeking and support-conditioned incentive theories of addictive behavior. Signals for ethanol influence spatial choice behavior and may be relevant to attentional bias shown to alcohol-associated stimuli in humans.

GABAergic modulation of human social interaction in a prisoner's dilemma model by acute administration of alprazolam.

PubMed

Lane, Scott D; Gowin, Joshua L

2009-10-01

Recent work in neuroeconomics has used game theory paradigms to examine neural systems that subserve human social interaction and decision making. Attempts to modify social interaction through pharmacological manipulation have been less common. Here we show dose-dependent modification of human social behavior in a prisoner's dilemma model after acute administration of the γ-aminobutyric acid (GABA)-A modulating benzodiazepine alprazolam. Nine healthy adults received doses of placebo, 0.5, 1.0, and 2.0 mg alprazolam in a counterbalanced within-subject design, while completing multiple test blocks per day on an iterated prisoner's dilemma game. During test blocks in which peak subjective effects of alprazolam were reported, cooperative choices were significantly decreased as a function of dose. Consistent with previous reports showing that high acute doses of GABA-modulating drugs are associated with violence and other antisocial behavior, our data suggest that at sufficiently high doses, alprazolam can decrease cooperation. These behavioral changes may be facilitated by changes in inhibitory control facilitated by GABA. Game theory paradigms may prove useful in behavioral pharmacology studies seeking to measure social interaction, and may help inform the emerging field of neuroeconomics.

GABAergic modulation of human social interaction in a prisoner’s dilemma model via acute administration of alprazolam

PubMed Central

Lane, Scott D.; Gowin, Joshua L.

2010-01-01

Recent work in neuroeconomics has utilized game theory paradigms to examine neural systems that subserve human social interaction and decision making. Attempts to modify social interaction through pharmacological manipulation have been less common. Here we show dose-dependent modification of human social behavior in a prisoner’s dilemma (PD) model following acute administration of the GABA-A modulating benzodiazepine alprazolam. Nine healthy adults received doses of placebo, 0.5, 1.0, and 2.0 mg alprazolam in a counterbalanced within-subject design, while completing multiple test blocks per day on an iterated PD game. During test blocks in which peak subjective effects of alprazolam were reported, cooperative choices were significantly decreased as a function of dose. Consistent with previous reports showing that high acute doses of GABA-modulating drugs are associated with violence and other antisocial behavior, our data suggest that at sufficiently high doses, alprazolam can decrease cooperation. These behavioral changes may be facilitated by changes in inhibitory control facilitated by GABA. Game theory paradigms may prove useful in behavioral pharmacology studies seeking to measure social interaction, and may help inform the emerging field of neuroeconomics. PMID:19667972

Cannabinoid CB1 Receptor Activation Mediates the Opposing Effects of Amphetamine on Impulsive Action and Impulsive Choice

PubMed Central

Wiskerke, Joost; Stoop, Nicky; Schetters, Dustin; Schoffelmeer, Anton N. M.; Pattij, Tommy

2011-01-01

It is well known that acute challenges with psychostimulants such as amphetamine affect impulsive behavior. We here studied the pharmacology underlying the effects of amphetamine in two rat models of impulsivity, the 5-choice serial reaction time task (5-CSRTT) and the delayed reward task (DRT), providing measures of inhibitory control, an aspect of impulsive action, and impulsive choice, respectively. We focused on the role of cannabinoid CB1 receptor activation in amphetamine-induced impulsivity as there is evidence that acute challenges with psychostimulants activate the endogenous cannabinoid system, and CB1 receptor activity modulates impulsivity in both rodents and humans. Results showed that pretreatment with either the CB1 receptor antagonist/inverse agonist SR141716A or the neutral CB1 receptor antagonist O-2050 dose-dependently improved baseline inhibitory control in the 5-CSRTT. Moreover, both compounds similarly attenuated amphetamine-induced inhibitory control deficits, suggesting that CB1 receptor activation by endogenously released cannabinoids mediates this aspect of impulsive action. Direct CB1 receptor activation by Δ9-Tetrahydrocannabinol (Δ9-THC) did, however, not affect inhibitory control. Although neither SR141716A nor O-2050 affected baseline impulsive choice in the DRT, both ligands completely prevented amphetamine-induced reductions in impulsive decision making, indicating that CB1 receptor activity may decrease this form of impulsivity. Indeed, acute Δ9-THC was found to reduce impulsive choice in a CB1 receptor-dependent way. Together, these results indicate an important, though complex role for cannabinoid CB1 receptor activity in the regulation of impulsive action and impulsive choice as well as the opposite effects amphetamine has on both forms of impulsive behavior. PMID:22016780

Decision dynamics of departure times: Experiments and modeling

NASA Astrophysics Data System (ADS)

Sun, Xiaoyan; Han, Xiao; Bao, Jian-Zhang; Jiang, Rui; Jia, Bin; Yan, Xiaoyong; Zhang, Boyu; Wang, Wen-Xu; Gao, Zi-You

2017-10-01

A fundamental problem in traffic science is to understand user-choice behaviors that account for the emergence of complex traffic phenomena. Despite much effort devoted to theoretically exploring departure time choice behaviors, relatively large-scale and systematic experimental tests of theoretical predictions are still lacking. In this paper, we aim to offer a more comprehensive understanding of departure time choice behaviors in terms of a series of laboratory experiments under different traffic conditions and feedback information provided to commuters. In the experiment, the number of recruited players is much larger than the number of choices to better mimic the real scenario, in which a large number of commuters will depart simultaneously in a relatively small time window. Sufficient numbers of rounds are conducted to ensure the convergence of collective behavior. Experimental results demonstrate that collective behavior is close to the user equilibrium, regardless of different scales and traffic conditions. Moreover, the amount of feedback information has a negligible influence on collective behavior but has a relatively stronger effect on individual choice behaviors. Reinforcement learning and Fermi learning models are built to reproduce the experimental results and uncover the underlying mechanism. Simulation results are in good agreement with the experimentally observed collective behaviors.

Reframing Organizations: Artistry, Choice, and Leadership. Jossey-Bass Management Series, Social and Behavioral Science Series, and Higher and Adult Education Series.

ERIC Educational Resources Information Center

Bolman, Lee G.; Deal, Terrence E.

This book shows how educators can become more versatile managers and more artistic leaders. In part 1, chapter 1 shows why reframing--the use of multiple lenses--is vital to effective leadership and management. It introduces the four basic lenses for organizational analysis--the structural, human resource, political, and symbolic frames--and show…

Keeping up with the Joneses: Interpersonal Prediction Errors and the Correlation of Behavior in a Tandem Sequential Choice Task

PubMed Central

Apple, Nathan; Montague, P. Read

2013-01-01

In many settings, copying, learning from or assigning value to group behavior is rational because such behavior can often act as a proxy for valuable returns. However, such herd behavior can also be pathologically misleading by coaxing individuals into behaviors that are otherwise irrational and it may be one source of the irrational behaviors underlying market bubbles and crashes. Using a two-person tandem investment game, we sought to examine the neural and behavioral responses of herd instincts in situations stripped of the incentive to be influenced by the choices of one's partner. We show that the investments of the two subjects correlate over time if they are made aware of their partner's choices even though these choices have no impact on either player's earnings. We computed an “interpersonal prediction error”, the difference between the investment decisions of the two subjects after each choice. BOLD responses in the striatum, implicated in valuation and action selection, were highly correlated with this interpersonal prediction error. The revelation of the partner's investment occurred after all useful information about the market had already been revealed. This effect was confirmed in two separate experiments where the impact of the time of revelation of the partner's choice was tested at 2 seconds and 6 seconds after a subject's choice; however, the effect was absent in a control condition with a computer partner. These findings strongly support the existence of mechanisms that drive correlated behavior even in contexts where there is no explicit advantage to do so. PMID:24204226

Adenylyl cyclase-5 in the dorsal striatum function as a molecular switch for the generation of behavioral preferences for cue-directed food choices.

PubMed

Kim, Hannah; Kim, Tae-Kyung; Kim, Ji-Eun; Park, Jin-Young; Lee, Yunjin; Kang, Minkyung; Kim, Kyoung-Shim; Han, Pyung-Lim

2014-11-07

Behavioral choices in habits and innate behaviors occur automatically in the absence of conscious selection. These behaviors are not easily modified by learning. Similar types of behaviors also occur in various mental illnesses including drug addiction, obsessive-compulsive disorder, schizophrenia, and autism. However, underlying mechanisms are not clearly understood. In the present study, we investigated the molecular mechanisms regulating unconditioned preferred behaviors in food-choices. Mice lacking adenylyl cyclase-5 (AC5 KO mice), which is preferentially expressed in the dorsal striatum, consumed food pellets nearly one after another in cages. AC5 KO mice showed aversive behaviors to bitter tasting quinine, but they compulsively chose quinine-containing AC5 KO-pellets over fresh pellets. The unusual food-choice behaviors in AC5 KO mice were due to the gain of behavioral preferences for food pellets containing an olfactory cue, which wild-type mice normally ignored. Such food-choice behaviors in AC5 KO mice disappeared when whiskers were trimmed. Conversely, whisker trimming in wildtype mice induced behavioral preferences for AC5 KO food pellets, indicating that preferred food-choices were not learned through prior experience. Both AC5 KO mice and wildtype mice with trimmed whiskers had increased glutamatergic input from the barrel cortex into the dorsal striatum, resulting in an increase in the mGluR1-dependent signaling cascade. The siRNA-mediated inhibition of mGluR1 in the dorsal striatum in AC5 KO mice and wildtype mice with trimmed whiskers abolished preferred choices for AC5 KO food pellets, whereas siRNA-mediated inhibition of mGluR3 glutamate receptors in the dorsal striatum in wildtype mice induced behavioral preferences for AC5 KO food pellets, thus mimicking AC5 KO phenotypes. Our results show that the gain and loss of behavioral preferences for a specific cue-directed option were regulated by specific cellular factors in the dorsal striatum, such that the preferred food choices were switched on when either the mGluR3-AC5 pathway was inactive or the mGluR1 pathway was active, whereas the preferred food-choices were switched off when mGluR1 or its downstream pathway was suppressed. These results identify the AC5 and mGluR system in the dorsal striatum as molecular on/off switches to direct decisions on behavioral preferences for cue-oriented options.

GluN2B in corticostriatal circuits governs choice learning and choice shifting

PubMed Central

Brigman, Jonathan L.; Daut, Rachel; Wright, Tara; Gunduz-Cinar, Ozge; Graybeal, Carolyn; Davis, Margaret I.; Jiang, Zhihong; Saksida, Lisa; Jinde, Seiichiro; Pease, Matthew; Bussey, Timothy J.; Lovinger, David M.; Nakazawa, Kazu; Holmes, Andrew

2013-01-01

A choice that reliably produces a preferred outcome can be automated to liberate cognitive resources for other tasks. Should an outcome become less desirable, behavior must adapt in parallel or become perseverative. Corticostriatal systems are known to mediate choice learning and flexibility, but the molecular mechanisms subserving the instantiation of these processes are not well understood. We integrated mouse behavioral, immunocytochemical, in vivo electrophysiological, genetic, and pharmacological approaches to study choice. We found that the dorsal striatum (DS) was increasingly activated with choice learning, whereas reversal of learned choice engaged prefrontal regions. In vivo, DS neurons showed activity associated with reward anticipation and receipt that emerged with learning and relearning. Corticostriatal or striatal GluN2B gene deletion, or DS-restricted GluN2B antagonism, impaired choice learning, whereas cortical GluN2B deletion or OFC GluN2B antagonism impaired shifting. Our convergent data demonstrate how corticostriatal GluN2B circuits govern the ability to learn and shift choice behavior. PMID:23831965

The Attraction Effect Modulates Reward Prediction Errors and Intertemporal Choices.

PubMed

Gluth, Sebastian; Hotaling, Jared M; Rieskamp, Jörg

2017-01-11

Classical economic theory contends that the utility of a choice option should be independent of other options. This view is challenged by the attraction effect, in which the relative preference between two options is altered by the addition of a third, asymmetrically dominated option. Here, we leveraged the attraction effect in the context of intertemporal choices to test whether both decisions and reward prediction errors (RPE) in the absence of choice violate the independence of irrelevant alternatives principle. We first demonstrate that intertemporal decision making is prone to the attraction effect in humans. In an independent group of participants, we then investigated how this affects the neural and behavioral valuation of outcomes using a novel intertemporal lottery task and fMRI. Participants' behavioral responses (i.e., satisfaction ratings) were modulated systematically by the attraction effect and this modulation was correlated across participants with the respective change of the RPE signal in the nucleus accumbens. Furthermore, we show that, because exponential and hyperbolic discounting models are unable to account for the attraction effect, recently proposed sequential sampling models might be more appropriate to describe intertemporal choices. Our findings demonstrate for the first time that the attraction effect modulates subjective valuation even in the absence of choice. The findings also challenge the prospect of using neuroscientific methods to measure utility in a context-free manner and have important implications for theories of reinforcement learning and delay discounting. Many theories of value-based decision making assume that people first assess the attractiveness of each option independently of each other and then pick the option with the highest subjective value. The attraction effect, however, shows that adding a new option to a choice set can change the relative value of the existing options, which is a violation of the independence principle. Using an intertemporal choice framework, we tested whether such violations also occur when the brain encodes the difference between expected and received rewards (i.e., the reward prediction error). Our results suggest that neither intertemporal choice nor valuation without choice adhere to the independence principle. Copyright © 2017 the authors 0270-6474/17/370371-12$15.00/0.

A Study of Driver's Route Choice Behavior Based on Evolutionary Game Theory

PubMed Central

Jiang, Xiaowei; Ji, Yanjie; Deng, Wei

2014-01-01

This paper proposes a route choice analytic method that embeds cumulative prospect theory in evolutionary game theory to analyze how the drivers adjust their route choice behaviors under the influence of the traffic information. A simulated network with two alternative routes and one variable message sign is built to illustrate the analytic method. We assume that the drivers in the transportation system are bounded rational, and the traffic information they receive is incomplete. An evolutionary game model is constructed to describe the evolutionary process of the drivers' route choice decision-making behaviors. Here we conclude that the traffic information plays an important role in the route choice behavior. The driver's route decision-making process develops towards different evolutionary stable states in accordance with different transportation situations. The analysis results also demonstrate that employing cumulative prospect theory and evolutionary game theory to study the driver's route choice behavior is effective. This analytic method provides an academic support and suggestion for the traffic guidance system, and may optimize the travel efficiency to a certain extent. PMID:25610455

A study of driver's route choice behavior based on evolutionary game theory.

PubMed

Jiang, Xiaowei; Ji, Yanjie; Du, Muqing; Deng, Wei

2014-01-01

This paper proposes a route choice analytic method that embeds cumulative prospect theory in evolutionary game theory to analyze how the drivers adjust their route choice behaviors under the influence of the traffic information. A simulated network with two alternative routes and one variable message sign is built to illustrate the analytic method. We assume that the drivers in the transportation system are bounded rational, and the traffic information they receive is incomplete. An evolutionary game model is constructed to describe the evolutionary process of the drivers' route choice decision-making behaviors. Here we conclude that the traffic information plays an important role in the route choice behavior. The driver's route decision-making process develops towards different evolutionary stable states in accordance with different transportation situations. The analysis results also demonstrate that employing cumulative prospect theory and evolutionary game theory to study the driver's route choice behavior is effective. This analytic method provides an academic support and suggestion for the traffic guidance system, and may optimize the travel efficiency to a certain extent.

Mapping collective behavior in the big-data era.

PubMed

Bentley, R Alexander; O'Brien, Michael J; Brock, William A

2014-02-01

The behavioral sciences have flourished by studying how traditional and/or rational behavior has been governed throughout most of human history by relatively well-informed individual and social learning. In the online age, however, social phenomena can occur with unprecedented scale and unpredictability, and individuals have access to social connections never before possible. Similarly, behavioral scientists now have access to "big data" sets - those from Twitter and Facebook, for example - that did not exist a few years ago. Studies of human dynamics based on these data sets are novel and exciting but, if not placed in context, can foster the misconception that mass-scale online behavior is all we need to understand, for example, how humans make decisions. To overcome that misconception, we draw on the field of discrete-choice theory to create a multiscale comparative "map" that, like a principal-components representation, captures the essence of decision making along two axes: (1) an east-west dimension that represents the degree to which an agent makes a decision independently versus one that is socially influenced, and (2) a north-south dimension that represents the degree to which there is transparency in the payoffs and risks associated with the decisions agents make. We divide the map into quadrants, each of which features a signature behavioral pattern. When taken together, the map and its signatures provide an easily understood empirical framework for evaluating how modern collective behavior may be changing in the digital age, including whether behavior is becoming more individualistic, as people seek out exactly what they want, or more social, as people become more inextricably linked, even "herdlike," in their decision making. We believe the map will lead to many new testable hypotheses concerning human behavior as well as to similar applications throughout the social sciences.

Global Environmental Change: Modifying Human Contributions Through Education

NASA Astrophysics Data System (ADS)

Carter, Lynne M.

1998-12-01

The 1995 Intergovernmental Panel on Climate Change (IPCC, 1996) Science report concludes that evidence now available "points toward a discernible human influence on global climate" (p. 439). Reductions in emissions will require changes in human behavior. This study assessed whether gains in global environmental change knowledge would lead to changes in human behaviors that could be deemed environmentally responsible. The study assessed the impact on participant behavior of a two-and-one-half day National Informal Educators Workshop and Videoconference held November 14-16, 1994. The workshops were located in seven down-link sites around the continental U.S. and Hawaii. The program utilized a variety of pedagogical techniques during five hours of satellite programming with national expertise on global change topics (natural variability, greenhouse effect, ozone depletion, ecosystem response, and population and resource distribution) and applications of that information with local experts in regional workshops. Participants implemented many personal and professional behavior changes after participation in this program. Six behavior change scales were created from assessment of survey responses (four coefficient alphas were above .7, one was .68, and one was .58). Personal behavior changes grouped into three categories: Use of Fewer Resources (acts of everyday life generally under volitional control), Purchasing Choices/Options (less frequent acts, not under total volitional control, with significant environmental effect over the lifetime of the decision, e.g., an automobile) and Increased Awareness and Discussion (indicating changes in "habits of mind"). The professional behavior changes also grouped into three categories: Curriculum Development (developing/revising curricula including new knowledge); Networking (with colleagues from the program); and Office Procedures (reflecting environmentally responsible behavior). The statistically significant behavior changes implemented correspond with increases in content knowledge, confidence, a developing national network, regional applications, and satisfaction with the program.

Thirst-dependent risk preferences in monkeys identify a primitive form of wealth.

PubMed

Yamada, Hiroshi; Tymula, Agnieszka; Louie, Kenway; Glimcher, Paul W

2013-09-24

Experimental economic techniques have been widely used to evaluate human risk attitudes, but how these measured attitudes relate to overall individual wealth levels is unclear. Previous noneconomic work has addressed this uncertainty in animals by asking the following: (i) Do our close evolutionary relatives share both our risk attitudes and our degree of economic rationality? And (ii) how does the amount of food or water one holds (a nonpecuniary form of "wealth") alter risk attitudes in these choosers? Unfortunately, existing noneconomic studies have provided conflicting insights from an economic point of view. We therefore used standard techniques from human experimental economics to measure monkey risk attitudes for water rewards as a function of blood osmolality (an objective measure of how much water the subjects possess). Early in training, monkeys behaved randomly, consistently violating first-order stochastic dominance and monotonicity. After training, they behaved like human choosers--technically consistent in their choices and weakly risk averse (i.e., risk averse or risk neutral on average)--suggesting that well-trained monkeys can serve as a model for human choice behavior. As with attitudes about money in humans, these risk attitudes were strongly wealth dependent; as the animals became "poorer," risk aversion increased, a finding incompatible with some models of wealth and risk in human decision making.

Differences of acute versus chronic ethanol exposure on anxiety-like behavioral responses in zebrafish.

PubMed

Mathur, Priya; Guo, Su

2011-06-01

Zebrafish, a vertebrate model organism amenable to high throughput screening, is an attractive system to model and study the mechanisms underlying human diseases. Alcoholism and alcoholic medical disorders are among the most debilitating diseases, yet the mechanisms by which ethanol inflicts the disease states are not well understood. In recent years zebrafish behavior assays have been used to study learning and memory, fear and anxiety, and social behavior. It is important to characterize the effects of ethanol on zebrafish behavioral repertoires in order to successfully harvest the strength of zebrafish for alcohol research. One prominent effect of alcohol in humans is its effect on anxiety, with acute intermediate doses relieving anxiety and withdrawal from chronic exposure increasing anxiety, both of which have significant contributions to alcohol dependence. In this study, we assess the effects of both acute and chronic ethanol exposure on anxiety-like behaviors in zebrafish, using two behavioral paradigms, the Novel Tank Diving Test and the Light/Dark Choice Assay. Acute ethanol exposure exerted significant dose-dependent anxiolytic effects. However, withdrawal from repeated intermittent ethanol exposure disabled recovery from heightened anxiety. These results demonstrate that zebrafish exhibit different anxiety-like behavioral responses to acute and chronic ethanol exposure, which are remarkably similar to these effects of alcohol in humans. Because of the accessibility of zebrafish to high throughput screening, our results suggest that genes and small molecules identified in zebrafish will be of relevance to understand how acute versus chronic alcohol exposure have opposing effects on the state of anxiety in humans. Copyright © 2011 Elsevier B.V. All rights reserved.

Genetic and Modeling Approaches Reveal Distinct Components of Impulsive Behavior

PubMed Central

Nautiyal, Katherine M; Wall, Melanie M; Wang, Shuai; Magalong, Valerie M; Ahmari, Susanne E; Balsam, Peter D; Blanco, Carlos; Hen, René

2017-01-01

Impulsivity is an endophenotype found in many psychiatric disorders including substance use disorders, pathological gambling, and attention deficit hyperactivity disorder. Two behavioral features often considered in impulsive behavior are behavioral inhibition (impulsive action) and delayed gratification (impulsive choice). However, the extent to which these behavioral constructs represent distinct facets of behavior with discrete biological bases is unclear. To test the hypothesis that impulsive action and impulsive choice represent statistically independent behavioral constructs in mice, we collected behavioral measures of impulsivity in a single cohort of mice using well-validated operant behavioral paradigms. Mice with manipulation of serotonin 1B receptor (5-HT1BR) expression were included as a model of disordered impulsivity. A factor analysis was used to characterize correlations between the measures of impulsivity and to identify covariates. Using two approaches, we dissociated impulsive action from impulsive choice. First, the absence of 5-HT1BRs caused increased impulsive action, but not impulsive choice. Second, based on an exploratory factor analysis, a two-factor model described the data well, with measures of impulsive action and choice separating into two independent factors. A multiple-indicator multiple-causes analysis showed that 5-HT1BR expression and sex were significant covariates of impulsivity. Males displayed increased impulsivity in both dimensions, whereas 5-HT1BR expression was a predictor of increased impulsive action only. These data support the conclusion that impulsive action and impulsive choice are distinct behavioral phenotypes with dissociable biological influences that can be modeled in mice. Our work may help inform better classification, diagnosis, and treatment of psychiatric disorders, which present with disordered impulsivity. PMID:27976680

Trait impulsive choice predicts resistance to extinction and propensity to relapse to cocaine seeking: a bidirectional investigation.

PubMed

Broos, Nienke; Diergaarde, Leontien; Schoffelmeer, Anton Nm; Pattij, Tommy; De Vries, Taco J

2012-05-01

Despite the strong association between impulsivity and addiction in humans, it is still a matter of debate whether impulsive choice predisposes to, or results from, drug dependence. Furthermore, it is unknown whether treating impulsivity can protect against relapse propensity. Therefore, this study explored the bidirectional relationship between impulsive choice and cocaine taking and seeking in rat behavioral models. In experiment 1, to determine whether impulsive choice predisposes to cocaine taking or seeking, rats were selected based on trait impulsivity in a delayed reward task and subsequently compared on various stages of cocaine self-administration (SA). To examine the consequence of cocaine intake on impulsive choice, impulsivity was monitored once a week throughout various stages of cocaine SA. To determine whether treating impulsive choice can protect against relapse propensity, in experiment 2, impulsive choice was manipulated by pharmacological interventions and cocaine-associated contextual cues. Trait impulsive choice as determined in experiment 1 predicted high extinction resistance and enhanced propensity to context-induced relapse in the cocaine SA model, whereas cocaine intake did not alter impulsive choice. Furthermore, acute changes in impulsive choice were not related to rates of context-induced relapse. Taken together, the current data indicate that trait impulsive choice predicts persistent cocaine seeking during extinction and enhanced propensity to relapse, whereas acute manipulations of impulsive choice had no favorable outcomes on relapse measures. These observations suggest that trait impulsivity can be used as a predictive factor for addiction liability, but treating this impulsivity does not necessarily protect against relapse.

Reversing the Use of Hobson's Choice: Culturally Relevant Assessment and Treatment Practices for Culturally and Linguistically Diverse Learners with Problem Behaviors

ERIC Educational Resources Information Center

Obiakor, Festus E.; Gibson, Lenwood

2015-01-01

Hobson's Choice is a psychological philosophy that prescribes a "take-it-or-leave-it" approach when addressing the problematic behaviors of students. Logically, this choice provides a traditional order in the classroom and gives teachers and service providers the sole power and authority to manage problem behaviors. For many students…

Human turnover dynamics during sleep: statistical behavior and its modeling.

PubMed

Yoneyama, Mitsuru; Okuma, Yasuyuki; Utsumi, Hiroya; Terashi, Hiroo; Mitoma, Hiroshi

2014-03-01

Turnover is a typical intermittent body movement while asleep. Exploring its behavior may provide insights into the mechanisms and management of sleep. However, little is understood about the dynamic nature of turnover in healthy humans and how it can be modified in disease. Here we present a detailed analysis of turnover signals that are collected by accelerometry from healthy elderly subjects and age-matched patients with neurodegenerative disorders such as Parkinson's disease. In healthy subjects, the time intervals between consecutive turnover events exhibit a well-separated bimodal distribution with one mode at ⩽10 s and the other at ⩾100 s, whereas such bimodality tends to disappear in neurodegenerative patients. The discovery of bimodality and fine temporal structures (⩽10 s) is a contribution that is not revealed by conventional sleep recordings with less time resolution (≈30 s). Moreover, we estimate the scaling exponent of the interval fluctuations, which also shows a clear difference between healthy subjects and patients. We incorporate these experimental results into a computational model of human decision making. A decision is to be made at each simulation step between two choices: to keep on sleeping or to make a turnover, the selection of which is determined dynamically by comparing a pair of random numbers assigned to each choice. This decision is weighted by a single parameter that reflects the depth of sleep. The resulting simulated behavior accurately replicates many aspects of observed turnover patterns, including the appearance or disappearance of bimodality and leads to several predictions, suggesting that the depth parameter may be useful as a quantitative measure for differentiating between normal and pathological sleep. These findings have significant clinical implications and may pave the way for the development of practical sleep assessment technologies.

Human turnover dynamics during sleep: Statistical behavior and its modeling

NASA Astrophysics Data System (ADS)

Yoneyama, Mitsuru; Okuma, Yasuyuki; Utsumi, Hiroya; Terashi, Hiroo; Mitoma, Hiroshi

2014-03-01

Turnover is a typical intermittent body movement while asleep. Exploring its behavior may provide insights into the mechanisms and management of sleep. However, little is understood about the dynamic nature of turnover in healthy humans and how it can be modified in disease. Here we present a detailed analysis of turnover signals that are collected by accelerometry from healthy elderly subjects and age-matched patients with neurodegenerative disorders such as Parkinson's disease. In healthy subjects, the time intervals between consecutive turnover events exhibit a well-separated bimodal distribution with one mode at ⩽10 s and the other at ⩾100 s, whereas such bimodality tends to disappear in neurodegenerative patients. The discovery of bimodality and fine temporal structures (⩽10 s) is a contribution that is not revealed by conventional sleep recordings with less time resolution (≈30 s). Moreover, we estimate the scaling exponent of the interval fluctuations, which also shows a clear difference between healthy subjects and patients. We incorporate these experimental results into a computational model of human decision making. A decision is to be made at each simulation step between two choices: to keep on sleeping or to make a turnover, the selection of which is determined dynamically by comparing a pair of random numbers assigned to each choice. This decision is weighted by a single parameter that reflects the depth of sleep. The resulting simulated behavior accurately replicates many aspects of observed turnover patterns, including the appearance or disappearance of bimodality and leads to several predictions, suggesting that the depth parameter may be useful as a quantitative measure for differentiating between normal and pathological sleep. These findings have significant clinical implications and may pave the way for the development of practical sleep assessment technologies.

Presenting quality data to vulnerable groups: charts, summaries or behavioral economic nudges?

PubMed

Elbel, Brian; Gillespie, Colleen; Raven, Maria C

2014-07-01

Despite the increased focus on health care consumers' active choice, not enough is known about how to best facilitate the choice process. We sought to assess methods of improving this process for vulnerable consumers in the United States by testing alternatives that emphasize insights from behavioral economics, or 'nudges'. We performed a hypothetical choice experiment where subjects were randomized to one of five experimental conditions and asked to choose a health center (location where they would receive all their care). The conditions presented the same information about health centers in different ways, including graphically as a chart, via written summary and using behavioral economics, 'nudging' consumers toward particular choices. We hypothesized that these 'nudges' might help simplify the choice process. Our primary outcomes focused on the health center chosen and whether consumers were willing to accept 'nudges'. We found that consumer choice was influenced by the method of presentation and the majority of consumers accepted the health center they were 'nudged' towards. Consumers were accepting of choices grounded in insights from behavioral economics and further consideration should be given to their role in patient choice. © The Author(s) 2014 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav.

Prospect theory based estimation of drivers' risk attitudes in route choice behaviors.

PubMed

Zhou, Lizhen; Zhong, Shiquan; Ma, Shoufeng; Jia, Ning

2014-12-01

This paper applied prospect theory (PT) to describe drivers' route choice behavior under Variable Message Sign (VMS), which presented visual traffic information to assist them to make route choice decisions. A quite rich empirical data from questionnaire and field spot was used to estimate parameters of PT. In order to make the parameters more realistic with drivers' attitudes, they were classified into different types by significant factors influencing their behaviors. Based on the travel time distribution of alternative routes and route choice results from questionnaire, the parameterized value function of each category was figured out, which represented drivers' risk attitudes and choice characteristics. The empirical verification showed that the estimates were acceptable and effective. The result showed drivers' risk attitudes and route choice characteristics could be captured by PT under real-time information shown on VMS. For practical application, once drivers' route choice characteristics and parameters were identified, their route choice behavior under different road conditions could be predicted accurately, which was the basis of traffic guidance measures formulation and implementation for targeted traffic management. Moreover, the heterogeneous risk attitudes among drivers should be considered when releasing traffic information and regulating traffic flow. Copyright © 2014 Elsevier Ltd. All rights reserved.

Parallel basal ganglia circuits for decision making.

PubMed

Hikosaka, Okihide; Ghazizadeh, Ali; Griggs, Whitney; Amita, Hidetoshi

2018-03-01

The basal ganglia control body movements, mainly, based on their values. Critical for this mechanism is dopamine neurons, which sends unpredicted value signals, mainly, to the striatum. This mechanism enables animals to change their behaviors flexibly, eventually choosing a valuable behavior. However, this may not be the best behavior, because the flexible choice is focused on recent, and, therefore, limited, experiences (i.e., short-term memories). Our old and recent studies suggest that the basal ganglia contain separate circuits that process value signals in a completely different manner. They are insensitive to recent changes in value, yet gradually accumulate the value of each behavior (i.e., movement or object choice). These stable circuits eventually encode values of many behaviors and then retain the value signals for a long time (i.e., long-term memories). They are innervated by a separate group of dopamine neurons that retain value signals, even when no reward is predicted. Importantly, the stable circuits can control motor behaviors (e.g., hand or eye) quickly and precisely, which allows animals to automatically acquire valuable outcomes based on historical life experiences. These behaviors would be called 'skills', which are crucial for survival. The stable circuits are localized in the posterior part of the basal ganglia, separately from the flexible circuits located in the anterior part. To summarize, the flexible and stable circuits in the basal ganglia, working together but independently, enable animals (and humans) to reach valuable goals in various contexts.

Preferential Representation of Past Outcome Information and Future Choice Behavior by Putative Inhibitory Interneurons Rather Than Putative Pyramidal Neurons in the Primate Dorsal Anterior Cingulate Cortex.

PubMed

Kawai, Takashi; Yamada, Hiroshi; Sato, Nobuya; Takada, Masahiko; Matsumoto, Masayuki

2018-05-02

The dorsal anterior cingulate cortex (dACC) plays crucial roles in monitoring the outcome of a choice and adjusting a subsequent choice behavior based on the outcome information. In the present study, we investigated how different types of dACC neurons, that is, putative pyramidal neurons and putative inhibitory interneurons, contribute to these processes. We analyzed single-unit database obtained from the dACC in monkeys performing a reversal learning task. The monkey was required to adjust choice behavior from past outcome experiences. Depending on their action potential waveforms, the recorded neurons were classified into putative pyramidal neurons and putative inhibitory interneurons. We found that these neurons do not equally contribute to outcome monitoring and behavioral adjustment. Although both neuron types evenly responded to the current outcome, a larger proportion of putative inhibitory interneurons than putative pyramidal neurons stored the information about the past outcome. The putative inhibitory interneurons further represented choice-related signals more frequently, such as whether the monkey would shift the last choice to an alternative at the next choice opportunity. Our findings suggest that putative inhibitory interneurons, which are thought not to project to brain areas outside the dACC, preferentially transmit signals that would adjust choice behavior based on past outcome experiences.

Risk preferences impose a hidden distortion on measures of choice impulsivity

PubMed Central

Konova, Anna B.; Louie, Kenway; Glimcher, Paul W.

2018-01-01

Measuring temporal discounting through the use of intertemporal choice tasks is now the gold standard method for quantifying human choice impulsivity (impatience) in neuroscience, psychology, behavioral economics, public health and computational psychiatry. A recent area of growing interest is individual differences in discounting levels, as these may predispose to (or protect from) mental health disorders, addictive behaviors, and other diseases. At the same time, more and more studies have been dedicated to the quantification of individual attitudes towards risk, which have been measured in many clinical and non-clinical populations using closely related techniques. Economists have pointed to interactions between measurements of time preferences and risk preferences that may distort estimations of the discount rate. However, although becoming standard practice in economics, discount rates and risk preferences are rarely measured simultaneously in the same subjects in other fields, and the magnitude of the imposed distortion is unknown in the assessment of individual differences. Here, we show that standard models of temporal discounting —such as a hyperbolic discounting model widely present in the literature which fails to account for risk attitudes in the estimation of discount rates— result in a large and systematic pattern of bias in estimated discounting parameters. This can lead to the spurious attribution of differences in impulsivity between individuals when in fact differences in risk attitudes account for observed behavioral differences. We advance a model which, when applied to standard choice tasks typically used in psychology and neuroscience, provides both a better fit to the data and successfully de-correlates risk and impulsivity parameters. This results in measures that are more accurate and thus of greater utility to the many fields interested in individual differences in impulsivity. PMID:29373590

Risk preferences impose a hidden distortion on measures of choice impulsivity.

PubMed

Lopez-Guzman, Silvia; Konova, Anna B; Louie, Kenway; Glimcher, Paul W

2018-01-01

Measuring temporal discounting through the use of intertemporal choice tasks is now the gold standard method for quantifying human choice impulsivity (impatience) in neuroscience, psychology, behavioral economics, public health and computational psychiatry. A recent area of growing interest is individual differences in discounting levels, as these may predispose to (or protect from) mental health disorders, addictive behaviors, and other diseases. At the same time, more and more studies have been dedicated to the quantification of individual attitudes towards risk, which have been measured in many clinical and non-clinical populations using closely related techniques. Economists have pointed to interactions between measurements of time preferences and risk preferences that may distort estimations of the discount rate. However, although becoming standard practice in economics, discount rates and risk preferences are rarely measured simultaneously in the same subjects in other fields, and the magnitude of the imposed distortion is unknown in the assessment of individual differences. Here, we show that standard models of temporal discounting -such as a hyperbolic discounting model widely present in the literature which fails to account for risk attitudes in the estimation of discount rates- result in a large and systematic pattern of bias in estimated discounting parameters. This can lead to the spurious attribution of differences in impulsivity between individuals when in fact differences in risk attitudes account for observed behavioral differences. We advance a model which, when applied to standard choice tasks typically used in psychology and neuroscience, provides both a better fit to the data and successfully de-correlates risk and impulsivity parameters. This results in measures that are more accurate and thus of greater utility to the many fields interested in individual differences in impulsivity.

Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game

PubMed Central

Seo, Hyojung; Lee, Daeyeol

2008-01-01

The process of decision making in humans and other animals is adaptive and can be tuned through experience so as to optimize the outcomes of their choices in a dynamic environment. Previous studies have demonstrated that the anterior cingulate cortex plays an important role in updating the animal’s behavioral strategies when the action-outcome contingencies change. Moreover, neurons in the anterior cingulate cortex often encode the signals related to expected or actual reward. We investigated whether reward-related activity in the anterior cingulate cortex is affected by the animal’s previous reward history. This was tested in rhesus monkeys trained to make binary choices in a computer-simulated competitive zero-sum game. The animal’s choice behavior was relatively close to the optimal strategy, but also revealed small but systematic biases that are consistent with the use of a reinforcement learning algorithm. In addition, the activity of neurons in the dorsal anterior cingulate cortex that was related to the reward received by the animal in a given trial was often modulated by the rewards in the previous trials. Some of these neurons encoded the rate of rewards in previous trials, whereas others displayed activity modulations more closely related to the reward prediction errors. By contrast, signals related to the animal’s choices were only weakly represented in this cortical area. These results suggest that neurons in the dorsal anterior cingulate cortex might be involved in the subjective evaluation of choice outcomes based on the animal’s reward history. PMID:17670983

Anticipatory anxiety disrupts neural valuation during risky choice.

PubMed

Engelmann, Jan B; Meyer, Friederike; Fehr, Ernst; Ruff, Christian C

2015-02-18

Incidental negative emotions unrelated to the current task, such as background anxiety, can strongly influence decisions. This is most evident in psychiatric disorders associated with generalized emotional disturbances. However, the neural mechanisms by which incidental emotions may affect choices remain poorly understood. Here we study the effects of incidental anxiety on human risky decision making, focusing on both behavioral preferences and their underlying neural processes. Although observable choices remained stable across affective contexts with high and low incidental anxiety, we found a clear change in neural valuation signals: during high incidental anxiety, activity in ventromedial prefrontal cortex and ventral striatum showed a marked reduction in (1) neural coding of the expected subjective value (ESV) of risky options, (2) prediction of observed choices, (3) functional coupling with other areas of the valuation system, and (4) baseline activity. At the same time, activity in the anterior insula showed an increase in coding the negative ESV of risky lotteries, and this neural activity predicted whether the risky lotteries would be rejected. This pattern of results suggests that incidental anxiety can shift the focus of neural valuation from possible positive consequences to anticipated negative consequences of choice options. Moreover, our findings show that these changes in neural value coding can occur in the absence of changes in overt behavior. This suggest a possible pathway by which background anxiety may lead to the development of chronic reward desensitization and a maladaptive focus on negative cognitions, as prevalent in affective and anxiety disorders. Copyright © 2015 the authors 0270-6474/15/353085-15$15.00/0.

On the Concept of Culture Goods Sales

NASA Astrophysics Data System (ADS)

Luo, Xiao-Rong

The article on the consumer psychology, consumer behavior, cultural concepts of the market so their products relating to the concept of corporate culture and business aspects of the image was further explained that the merchandise sold is a commercial act, a cultural transmission consumers to make consumption choices in the same time, he believed that the use of such products with their values and way of life is consistent, for the maintenance of their social status and self-recognition of the need for a sales role in the cultural concept of human group psychology, and affect people's consumption behavior.

Relationship between Adolescent Risk Preferences on a Laboratory Task and Behavioral Measures of Risk-taking

PubMed Central

Rao, Uma; Sidhartha, Tanuj; Harker, Karen R.; Bidesi, Anup S.; Chen, Li-Ann; Ernst, Monique

2010-01-01

Purpose The goal of the study was to assess individual differences in risk-taking behavior among adolescents in the laboratory. A second aim was to evaluate whether the laboratory-based risk-taking behavior is associated with other behavioral and psychological measures associated with risk-taking behavior. Methods Eighty-two adolescents with no personal history of psychiatric disorder completed a computerized decision-making task, the Wheel of Fortune (WOF). By offering choices between clearly defined probabilities and real monetary outcomes, this task assesses risk preferences when participants are confronted with potential rewards and losses. The participants also completed a variety of behavioral and psychological measures associated with risk-taking behavior. Results Performance on the task varied based on the probability and anticipated outcomes. In the winning sub-task, participants selected low probability-high magnitude reward (high-risk choice) less frequently than high probability-low magnitude reward (low-risk choice). In the losing sub-task, participants selected low probability-high magnitude loss more often than high probability-low magnitude loss. On average, the selection of probabilistic rewards was optimal and similar to performance in adults. There were, however, individual differences in performance, and one-third of the adolescents made high-risk choice more frequently than low-risk choice while selecting a reward. After controlling for sociodemographic and psychological variables, high-risk choice on the winning task predicted “real-world” risk-taking behavior and substance-related problems. Conclusions These findings highlight individual differences in risk-taking behavior. Preliminary data on face validity of the WOF task suggest that it might be a valuable laboratory tool for studying behavioral and neurobiological processes associated with risk-taking behavior in adolescents. PMID:21257113

Substitution in recreation choice behavior

Treesearch

George L. Peterson; Daniel J. Stynes; Donald H. Rosenthal; John F. Dwyer

1985-01-01

This review discusses concepts and theories of substitution in recreation choice. It brings together the literature of recreation research, psychology, geography, economics, and transportation. Parallel and complementary developments need integration into an improved theory of substitution. Recreation decision behavior is characterized as a nested or sequential choice...

Nucleus accumbens shell moderates preference bias during voluntary choice behavior.

PubMed

Jang, Hyeran; Jung, Kanghoon; Jeong, Jaehoon; Park, Sang Ki; Kralik, Jerald D; Jeong, Jaeseung

2017-09-01

The nucleus accumbens (NAc) shell lies anatomically at a critical intersection within the brain's reward system circuitry, however, its role in voluntary choice behavior remains unclear. Rats with electrolytic lesions in the NAc shell were tested in a novel foraging paradigm. Over a continuous two-week period they freely chose among four nutritionally identical but differently flavored food pellets by pressing corresponding levers. We examined the lesion's effects on three behavioral dynamics components: motivation (when to eat), preference bias (what to choose) and persistence (how long to repeat the same choice). The lesion led to a marked increase in the preference bias: i.e., increased selection of the most-preferred choice option, and decreased selection of the others. We found no effects on any other behavioral measures, suggesting no effect on motivation or choice persistence. The results implicate the NAc shell in moderating the instrumental valuation process by inhibiting excessive bias toward preferred choice options. © The Author (2017). Published by Oxford University Press.

Nucleus accumbens shell moderates preference bias during voluntary choice behavior

PubMed Central

Jang, Hyeran; Jung, Kanghoon; Jeong, Jaehoon; Park, Sang Ki; Kralik, Jerald D.

2017-01-01

Abstract The nucleus accumbens (NAc) shell lies anatomically at a critical intersection within the brain’s reward system circuitry, however, its role in voluntary choice behavior remains unclear. Rats with electrolytic lesions in the NAc shell were tested in a novel foraging paradigm. Over a continuous two-week period they freely chose among four nutritionally identical but differently flavored food pellets by pressing corresponding levers. We examined the lesion’s effects on three behavioral dynamics components: motivation (when to eat), preference bias (what to choose) and persistence (how long to repeat the same choice). The lesion led to a marked increase in the preference bias: i.e., increased selection of the most-preferred choice option, and decreased selection of the others. We found no effects on any other behavioral measures, suggesting no effect on motivation or choice persistence. The results implicate the NAc shell in moderating the instrumental valuation process by inhibiting excessive bias toward preferred choice options. PMID:28992274

Identity-Specific Reward Representations in Orbitofrontal Cortex Are Modulated by Selective Devaluation.

PubMed

Howard, James D; Kahnt, Thorsten

2017-03-08

Goal-directed behavior is sensitive to the current value of expected outcomes. This requires independent representations of specific rewards, which have been linked to orbitofrontal cortex (OFC) function. However, the mechanisms by which the human brain updates specific goals on the fly, and translates those updates into choices, have remained unknown. Here we implemented selective devaluation of appetizing food odors in combination with pattern-based neuroimaging and a decision-making task. We found that in a hungry state, participants chose to smell high-intensity versions of two value-matched food odor rewards. After eating a meal corresponding to one of the two odors, participants switched choices toward the low intensity of the sated odor but continued to choose the high intensity of the nonsated odor. This sensory-specific behavioral effect was mirrored by pattern-based changes in fMRI signal in lateral posterior OFC, where specific reward identity representations were altered after the meal for the sated food odor but retained for the nonsated counterpart. In addition, changes in functional connectivity between the OFC and general value coding in ventromedial prefrontal cortex (vmPFC) predicted individual differences in satiety-related choice behavior. These findings demonstrate how flexible representations of specific rewards in the OFC are updated by devaluation, and how functional connections to vmPFC reflect the current value of outcomes and guide goal-directed behavior. SIGNIFICANCE STATEMENT The orbitofrontal cortex (OFC) is critical for goal-directed behavior. A recent proposal is that OFC fulfills this function by representing a variety of state and task variables ("cognitive maps"), including a conjunction of expected reward identity and value. Here we tested how identity-specific representations of food odor reward are updated by satiety. We found that fMRI pattern-based signatures of reward identity in lateral posterior OFC were modulated after selective devaluation, and that connectivity between this region and general value coding ventromedial prefrontal cortex (vmPFC) predicted choice behavior. These results provide evidence for a mechanism by which devaluation modulates a cognitive map of expected reward in OFC and thereby alters general value signals in vmPFC to guide goal-directed behavior. Copyright © 2017 the authors 0270-6474/17/372627-12$15.00/0.

An information processing view of framing effects: the role of causal schemas in decision making.

PubMed

Jou, J; Shanteau, J; Harris, R J

1996-01-01

People prefer a sure gain to a probable larger gain when the two choices are presented from a gain perspective, but a probable larger loss to a sure loss when the objectively identical choices are presented from a loss perspective. Such reversals of preference due to the context of the problem are known as framing effects. In the present study, schema activation and subjects' interpretations of the problems were examined as sources of the framing effects. Results showed that such effects could be eliminated by introducing into a problem a causal schema that provided a rationale for the reciprocal relationship between the gains and the losses. Moreover, when subjects were freed from framing they were consistently risk seeking in decisions about human life, but risk averse in decisions about property. Irrationality in choice behaviors and the ecological implication of framing effects are discussed.

Salience driven value integration explains decision biases and preference reversal

PubMed Central

Tsetsos, Konstantinos; Chater, Nick; Usher, Marius

2012-01-01

Human choice behavior exhibits many paradoxical and challenging patterns. Traditional explanations focus on how values are represented, but little is known about how values are integrated. Here we outline a psychophysical task for value integration that can be used as a window on high-level, multiattribute decisions. Participants choose between alternative rapidly presented streams of numerical values. By controlling the temporal distribution of the values, we demonstrate that this process underlies many puzzling choice paradoxes, such as temporal, risk, and framing biases, as well as preference reversals. These phenomena can be explained by a simple mechanism based on the integration of values, weighted by their salience. The salience of a sampled value depends on its temporal order and momentary rank in the decision context, whereas the direction of the weighting is determined by the task framing. We show that many known choice anomalies may arise from the microstructure of the value integration process. PMID:22635271

Regret and its avoidance: a neuroimaging study of choice behavior.

PubMed

Coricelli, Giorgio; Critchley, Hugo D; Joffily, Mateus; O'Doherty, John P; Sirigu, Angela; Dolan, Raymond J

2005-09-01

Human decisions can be shaped by predictions of emotions that ensue after choosing advantageously or disadvantageously. Indeed, anticipating regret is a powerful predictor of future choices. We measured brain activity using functional magnetic resonance imaging (fMRI) while subjects selected between two gambles wherein regret was induced by providing information about the outcome of the unchosen gamble. Increasing regret enhanced activity in the medial orbitofrontal region, the anterior cingulate cortex and the hippocampus. Notably, across the experiment, subjects became increasingly regret-aversive, a cumulative effect reflected in enhanced activity within medial orbitofrontal cortex and amygdala. This pattern of activity reoccurred just before making a choice, suggesting that the same neural circuitry mediates direct experience of regret and its anticipation. These results demonstrate that medial orbitofrontal cortex modulates the gain of adaptive emotions in a manner that may provide a substrate for the influence of high-level emotions on decision making.

Network Configurations in the Human Brain Reflect Choice Bias during Rapid Face Processing.

PubMed

Tu, Tao; Schneck, Noam; Muraskin, Jordan; Sajda, Paul

2017-12-13

Network interactions are likely to be instrumental in processes underlying rapid perception and cognition. Specifically, high-level and perceptual regions must interact to balance pre-existing models of the environment with new incoming stimuli. Simultaneous electroencephalography (EEG) and fMRI (EEG/fMRI) enables temporal characterization of brain-network interactions combined with improved anatomical localization of regional activity. In this paper, we use simultaneous EEG/fMRI and multivariate dynamical systems (MDS) analysis to characterize network relationships between constitute brain areas that reflect a subject's choice for a face versus nonface categorization task. Our simultaneous EEG and fMRI analysis on 21 human subjects (12 males, 9 females) identifies early perceptual and late frontal subsystems that are selective to the categorical choice of faces versus nonfaces. We analyze the interactions between these subsystems using an MDS in the space of the BOLD signal. Our main findings show that differences between face-choice and house-choice networks are seen in the network interactions between the early and late subsystems, and that the magnitude of the difference in network interaction positively correlates with the behavioral false-positive rate of face choices. We interpret this to reflect the role of saliency and expectations likely encoded in frontal "late" regions on perceptual processes occurring in "early" perceptual regions. SIGNIFICANCE STATEMENT Our choices are affected by our biases. In visual perception and cognition such biases can be commonplace and quite curious-e.g., we see a human face when staring up at a cloud formation or down at a piece of toast at the breakfast table. Here we use multimodal neuroimaging and dynamical systems analysis to measure whole-brain spatiotemporal dynamics while subjects make decisions regarding the type of object they see in rapidly flashed images. We find that the degree of interaction in these networks accounts for a substantial fraction of our bias to see faces. In general, our findings illustrate how the properties of spatiotemporal networks yield insight into the mechanisms of how we form decisions. Copyright © 2017 the authors 0270-6474/17/3712226-12$15.00/0.

Network Configurations in the Human Brain Reflect Choice Bias during Rapid Face Processing

PubMed Central

Schneck, Noam

2017-01-01

Network interactions are likely to be instrumental in processes underlying rapid perception and cognition. Specifically, high-level and perceptual regions must interact to balance pre-existing models of the environment with new incoming stimuli. Simultaneous electroencephalography (EEG) and fMRI (EEG/fMRI) enables temporal characterization of brain–network interactions combined with improved anatomical localization of regional activity. In this paper, we use simultaneous EEG/fMRI and multivariate dynamical systems (MDS) analysis to characterize network relationships between constitute brain areas that reflect a subject's choice for a face versus nonface categorization task. Our simultaneous EEG and fMRI analysis on 21 human subjects (12 males, 9 females) identifies early perceptual and late frontal subsystems that are selective to the categorical choice of faces versus nonfaces. We analyze the interactions between these subsystems using an MDS in the space of the BOLD signal. Our main findings show that differences between face-choice and house-choice networks are seen in the network interactions between the early and late subsystems, and that the magnitude of the difference in network interaction positively correlates with the behavioral false-positive rate of face choices. We interpret this to reflect the role of saliency and expectations likely encoded in frontal “late” regions on perceptual processes occurring in “early” perceptual regions. SIGNIFICANCE STATEMENT Our choices are affected by our biases. In visual perception and cognition such biases can be commonplace and quite curious—e.g., we see a human face when staring up at a cloud formation or down at a piece of toast at the breakfast table. Here we use multimodal neuroimaging and dynamical systems analysis to measure whole-brain spatiotemporal dynamics while subjects make decisions regarding the type of object they see in rapidly flashed images. We find that the degree of interaction in these networks accounts for a substantial fraction of our bias to see faces. In general, our findings illustrate how the properties of spatiotemporal networks yield insight into the mechanisms of how we form decisions. PMID:29118108

Impulsive Choice in Mice Lacking Paternal Expression of Grb10 Suggests Intragenomic Conflict in Behavior

PubMed Central

Dent, Claire L.; Humby, Trevor; Lewis, Katie; Ward, Andrew; Fischer-Colbrie, Reiner; Wilkinson, Lawrence S.; Wilkins, Jon F.; Isles, Anthony R.

2018-01-01

Imprinted genes are expressed from one parental allele only as a consequence of epigenetic events that take place in the mammalian germ line and are thought to have evolved through intragenomic conflict between parental alleles. We demonstrate, for the first time, oppositional effects of imprinted genes on brain and behavior. Specifically, we show that mice lacking paternal Grb10 make fewer impulsive choices, with no dissociable effects on a separate measure of impulsive action. Taken together with previous work showing that mice lacking maternal Nesp55 make more impulsive choices, this suggests that impulsive choice behavior is a substrate for the action of genomic imprinting. Moreover, the contrasting effect of these two genes suggests that impulsive choices are subject to intragenomic conflict and that maternal and paternal interests pull this behavior in opposite directions. Finally, these data may also indicate that an imbalance in expression of imprinted genes contributes to pathological conditions such as gambling and drug addiction, where impulsive behavior becomes maladaptive. PMID:29563147

Time discounting and time preference in animals: A critical review.

PubMed

Hayden, Benjamin Y

2016-02-01

Animals are an important model for studies of impulsivity and self-control. Many studies have made use of the intertemporal choice task, which pits small rewards available sooner against larger rewards available later (typically several seconds), repeated over many trials. Preference for the sooner reward is often taken to indicate impulsivity and/or a failure of self-control. This review shows that very little evidence supports this assumption; on the contrary, ostensible discounting behavior may reflect a boundedly rational but not necessarily impulsive reward-maximizing strategy. Specifically, animals may discount weakly, or even adopt a long-term rate-maximizing strategy, but fail to fully incorporate postreward delays into their choices. This failure may reflect learning biases. Consequently, tasks that measure animal discounting may greatly overestimate the true discounting and may be confounded by processes unrelated to time preferences. If so, animals may be much more patient than is widely believed; human and animal intertemporal choices may reflect unrelated mental operations; and the shared hyperbolic shape of the human and animal discount curves, which is used to justify cross-species comparisons, may be coincidental. The discussion concludes with a consideration of alternative ways to measure self-control in animals.

Procedures for Behavioral Experiments in Head-Fixed Mice

PubMed Central

Guo, Zengcai V.; Hires, S. Andrew; Li, Nuo; O'Connor, Daniel H.; Komiyama, Takaki; Ophir, Eran; Huber, Daniel; Bonardi, Claudia; Morandell, Karin; Gutnisky, Diego; Peron, Simon; Xu, Ning-long; Cox, James; Svoboda, Karel

2014-01-01

The mouse is an increasingly prominent model for the analysis of mammalian neuronal circuits. Neural circuits ultimately have to be probed during behaviors that engage the circuits. Linking circuit dynamics to behavior requires precise control of sensory stimuli and measurement of body movements. Head-fixation has been used for behavioral research, particularly in non-human primates, to facilitate precise stimulus control, behavioral monitoring and neural recording. However, choice-based, perceptual decision tasks by head-fixed mice have only recently been introduced. Training mice relies on motivating mice using water restriction. Here we describe procedures for head-fixation, water restriction and behavioral training for head-fixed mice, with a focus on active, whisker-based tactile behaviors. In these experiments mice had restricted access to water (typically 1 ml/day). After ten days of water restriction, body weight stabilized at approximately 80% of initial weight. At that point mice were trained to discriminate sensory stimuli using operant conditioning. Head-fixed mice reported stimuli by licking in go/no-go tasks and also using a forced choice paradigm using a dual lickport. In some cases mice learned to discriminate sensory stimuli in a few trials within the first behavioral session. Delay epochs lasting a second or more were used to separate sensation (e.g. tactile exploration) and action (i.e. licking). Mice performed a variety of perceptual decision tasks with high performance for hundreds of trials per behavioral session. Up to four months of continuous water restriction showed no adverse health effects. Behavioral performance correlated with the degree of water restriction, supporting the importance of controlling access to water. These behavioral paradigms can be combined with cellular resolution imaging, random access photostimulation, and whole cell recordings. PMID:24520413

Matching, Demand, Maximization, and Consumer Choice

ERIC Educational Resources Information Center

Wells, Victoria K.; Foxall, Gordon R.

2013-01-01

The use of behavioral economics and behavioral psychology in consumer choice has been limited. The current study extends the study of consumer behavior analysis, a synthesis between behavioral psychology, economics, and marketing, to a larger data set. This article presents the current work and results from the early analysis of the data. We…

Can Neglected Tropical Diseases Compromise Human Wellbeing in Sex-, Age-, and Trait-Specific Ways?

PubMed Central

Geary, David C.

2016-01-01

Traits that facilitate competition for reproductive resources or that influence mate choice have evolved to signal resilience to infectious disease and other stressors. As a result, the dynamics of competition and choice can, in theory, be used to generate predictions about sex-, age-, and trait-specific vulnerabilities for any sexually reproducing species, including humans. These dynamics and associated vulnerabilities are reviewed for nonhuman species, focusing on traits that are compromised by exposure to parasites. Using the same approach, sex-, age-, and trait-specific vulnerabilities to parasitic disease are illustrated for children’s and adolescent’s physical growth and fitness. Suggestions are then provided for widening the assessment of human vulnerabilities to include age-appropriate measures of behavioral (e.g., children’s play) and cognitive (e.g., language fluency) traits. These are traits that are likely to be compromised by infection in age- and sex-specific ways. Inclusion of these types of measures in studies of neglected tropic diseases has the potential to provide a more nuanced understanding of how these diseases undermine human wellbeing and may provide a useful means to study the efficacy of associated treatments. PMID:27077746

Sexual size dimorphism, canine dimorphism, and male-male competition in primates: where do humans fit in?

PubMed

Plavcan, J Michael

2012-03-01

Sexual size dimorphism is generally associated with sexual selection via agonistic male competition in nonhuman primates. These primate models play an important role in understanding the origins and evolution of human behavior. Human size dimorphism is often hypothesized to be associated with high rates of male violence and polygyny. This raises the question of whether human dimorphism and patterns of male violence are inherited from a common ancestor with chimpanzees or are uniquely derived. Here I review patterns of, and causal models for, dimorphism in humans and other primates. While dimorphism in primates is associated with agonistic male mate competition, a variety of factors can affect male and female size, and thereby dimorphism. The causes of human sexual size dimorphism are uncertain, and could involve several non-mutually-exclusive mechanisms, such as mate competition, resource competition, intergroup violence, and female choice. A phylogenetic reconstruction of the evolution of dimorphism, including fossil hominins, indicates that the modern human condition is derived. This suggests that at least some behavioral similarities with Pan associated with dimorphism may have arisen independently, and not directly from a common ancestor.

Breed differences in dogs sensitivity to human points: a meta-analysis.

PubMed

Dorey, Nicole R; Udell, Monique A R; Wynne, Clive D L

2009-07-01

The last decade has seen a substantial increase in research on the behavioral and cognitive abilities of pet dogs, Canis familiaris. The most commonly used experimental paradigm is the object-choice task in which a dog is given a choice of two containers and guided to the reinforced object by human pointing gestures. We review here studies of this type and attempt a meta-analysis of the available data. In the meta-analysis breeds of dogs were grouped into the eight categories of the American Kennel Club, and into four clusters identified by Parker and Ostrander [Parker, H.G., Ostrander, E.A., 2005. Canine genomics and genetics: running with the pack. PLoS Genet. 1, 507-513] on the basis of a genetic analysis. No differences in performance between breeds categorized in either fashion were identified. Rather, all dog breeds appear to be similarly and highly successful in following human points to locate desired food. We suggest this result could be due to the paucity of data available in published studies, and the restricted range of breeds tested.

Separate encoding of model-based and model-free valuations in the human brain.

PubMed

Beierholm, Ulrik R; Anen, Cedric; Quartz, Steven; Bossaerts, Peter

2011-10-01

Behavioral studies have long shown that humans solve problems in two ways, one intuitive and fast (System 1, model-free), and the other reflective and slow (System 2, model-based). The neurobiological basis of dual process problem solving remains unknown due to challenges of separating activation in concurrent systems. We present a novel neuroeconomic task that predicts distinct subjective valuation and updating signals corresponding to these two systems. We found two concurrent value signals in human prefrontal cortex: a System 1 model-free reinforcement signal and a System 2 model-based Bayesian signal. We also found a System 1 updating signal in striatal areas and a System 2 updating signal in lateral prefrontal cortex. Further, signals in prefrontal cortex preceded choices that are optimal according to either updating principle, while signals in anterior cingulate cortex and globus pallidus preceded deviations from optimal choice for reinforcement learning. These deviations tended to occur when uncertainty regarding optimal values was highest, suggesting that disagreement between dual systems is mediated by uncertainty rather than conflict, confirming recent theoretical proposals. Copyright © 2011 Elsevier Inc. All rights reserved.

Evolutionary institutionalism.

PubMed

Fürstenberg, Dr Kai

Institutions are hard to define and hard to study. Long prominent in political science have been two theories: Rational Choice Institutionalism (RCI) and Historical Institutionalism (HI). Arising from the life sciences is now a third: Evolutionary Institutionalism (EI). Comparative strengths and weaknesses of these three theories warrant review, and the value-to-be-added by expanding the third beyond Darwinian evolutionary theory deserves consideration. Should evolutionary institutionalism expand to accommodate new understanding in ecology, such as might apply to the emergence of stability, and in genetics, such as might apply to political behavior? Core arguments are reviewed for each theory with more detailed exposition of the third, EI. Particular attention is paid to EI's gene-institution analogy; to variation, selection, and retention of institutional traits; to endogeneity and exogeneity; to agency and structure; and to ecosystem effects, institutional stability, and empirical limitations in behavioral genetics. RCI, HI, and EI are distinct but complementary. Institutional change, while amenable to rational-choice analysis and, retrospectively, to criticaljuncture and path-dependency analysis, is also, and importantly, ecological. Stability, like change, is an emergent property of institutions, which tend to stabilize after change in a manner analogous to allopatric speciation. EI is more than metaphorically biological in that institutional behaviors are driven by human behaviors whose evolution long preceded the appearance of institutions themselves.

Spontaneous prosocial choice by captive bottlenose dolphins, Tursiops truncatus.

PubMed

Nakahara, Fumio; Komaba, Masayuki; Sato, Ryoichi; Ikeda, Hisako; Komaba, Kumiko; Kawakubo, Akihiro

2017-02-01

Dolphins exhibit prosocial behavior across several different contexts. However, only a few experimental studies have investigated the psychological mechanisms underlying this behavior. In this study, we investigated the mechanisms underlying prosociality in bottlenose dolphins (Tursiops truncatus). In the experiments, water shower devices, developed as environmental enrichment items, were used. Two paradigms were used to measure prosociality. The first was the prosocial choice task, involving the subject typically being offered one choice between two options. The first option provided a reward (take a shower) to both the subject and partner (prosocial choice). The second option provided a reward only to the subject (selfish choice). The second paradigm was the giving assistance task, involving the subject being provided a choice between providing instrumental help to the partner (prosocial choice) or doing nothing. It was observed that the subjects chose the prosocial choices in both paradigms. In these experiments, prosocial choices were spontaneously taken without requests from the partners. These results indicated that the dolphins show preference for other-regarding behavior. Copyright © 2016 Elsevier B.V. All rights reserved.

The role for public funding of faith-based organizations delivering behavioral health services: guideposts for monitoring and evaluation.

PubMed

Kramer, Fredrica D

2010-12-01

The paper reviews policies promoting faith-based organizations' (FBO) participation in publicly-funded programs since the Charitable Choice statute was enacted during the Clinton administration and then additional faith-based initiatives were implemented by the Bush administration. The paper focuses on research findings on FBO participation in publicly-funded human service programs under these policies. It then proposes a framework for evaluation to assess the appropriateness of public funding for behavioral health services delivered by FBOs, in order to address: (1) the programmatic and systemic effects resulting from the infusion of new players from the faith community, and the consequences to the profile of services and who gets served; and (2) the content and effectiveness of faith-infused services as a basis for identifying interventions appropriate for public funding. The analysis considers classification issues, theoretical bases of measured effects of faith-infused services, and the transferability of faith-based interventions across religious and secular applications in order to satisfy constitutional issues and client choice.

Reward value-based gain control: divisive normalization in parietal cortex.

PubMed

Louie, Kenway; Grattan, Lauren E; Glimcher, Paul W

2011-07-20

The representation of value is a critical component of decision making. Rational choice theory assumes that options are assigned absolute values, independent of the value or existence of other alternatives. However, context-dependent choice behavior in both animals and humans violates this assumption, suggesting that biological decision processes rely on comparative evaluation. Here we show that neurons in the monkey lateral intraparietal cortex encode a relative form of saccadic value, explicitly dependent on the values of the other available alternatives. Analogous to extra-classical receptive field effects in visual cortex, this relative representation incorporates target values outside the response field and is observed in both stimulus-driven activity and baseline firing rates. This context-dependent modulation is precisely described by divisive normalization, indicating that this standard form of sensory gain control may be a general mechanism of cortical computation. Such normalization in decision circuits effectively implements an adaptive gain control for value coding and provides a possible mechanistic basis for behavioral context-dependent violations of rationality.

Preventing relapse after incentivized choice treatment: A laboratory model.

PubMed

Bouton, Mark E; Thrailkill, Eric A; Bergeria, Cecilia L; Davis, Danielle R

2017-08-01

Two experiments with rats examined relapse of an operant behavior that occurred after the behavior was suppressed by reinforcing (incentivizing) an alternative behavior. In the first phase, a target response (R1) was reinforced. In a treatment phase, R1 was still reinforced, but a new response (R2) was introduced and associated with a larger reinforcer. As in human contingency management treatments, incentivizing R2 this way was effective at suppressing R1. However, when R2's reinforcement was discontinued, there was a robust and immediate relapse to R1. Experiment 1 found that the strength of R1 during relapse testing was not different from that seen in a no treatment control. Experiment 2 found that relapse could nevertheless be reduced by presenting reinforcers not contingent on responding during the test. Either the reinforcer for R1 or the reinforcer for R2 (which were qualitatively different types of food pellets) were effective. The experiments introduce a laboratory method for studying relapse and how to prevent it after contingency management treatments, and suggest at least one treatment that discourages relapse. The incentivized choice paradigm differs from other models of relapse of operant behavior (e.g., resurgence, renewal, reinstatement) in that it does not focus on the return of behaviors that are inhibited by extinction. Copyright © 2017 Elsevier B.V. All rights reserved.

An analysis of choice making in the assessment of young children with severe behavior problems.

PubMed

Harding, J W; Wacker, D P; Berg, W K; Cooper, L J; Asmus, J; Mlela, K; Muller, J

1999-01-01

We examined how positive and negative reinforcement influenced time allocation, occurrence of problem behavior, and completion of parent instructions during a concurrent choice assessment with 2 preschool-aged children who displayed severe problem behavior in their homes. The children were given a series of concurrent choice options that varied availability of parent attention, access to preferred toys, and presentation of parent instructions. The results showed that both children consistently allocated their time to choice areas that included parent attention when no instructions were presented. When parent attention choice areas included the presentation of instructions, the children displayed differential patterns of behavior that appeared to be influenced by the presence or absence of preferred toys. The results extended previous applications of reinforcer assessment procedures by analyzing the relative influence of both positive and negative reinforcement within a concurrent-operants paradigm.

Lateral Orbitofrontal Inactivation Dissociates Devaluation-Sensitive Behavior and Economic Choice.

PubMed

Gardner, Matthew P H; Conroy, Jessica S; Shaham, Michael H; Styer, Clay V; Schoenbaum, Geoffrey

2017-12-06

How do we choose between goods that have different subjective values, like apples and oranges? Neuroeconomics proposes that this is done by reducing complex goods to a single unitary value to allow comparison. This value is computed "on the fly" from the underlying model of the goods space, allowing decisions to meet current needs. This is termed "model-based" behavior to distinguish it from pre-determined, habitual, or "model-free" behavior. The lateral orbitofrontal cortex (OFC) supports model-based behavior in rats and primates, but whether the OFC is necessary for economic choice is less clear. Here we tested this question by optogenetically inactivating the lateral OFC in rats in a classic model-based task and during economic choice. Contrary to predictions, inactivation disrupted model-based behavior without affecting economic choice. Published by Elsevier Inc.

Individual behavioral and neurochemical markers of unadapted decision-making processes in healthy inbred mice.

PubMed

Pittaras, Elsa; Callebert, Jacques; Chennaoui, Mounir; Rabat, Arnaud; Granon, Sylvie

2016-12-01

One of the hallmarks of decision-making processes is the inter-individual variability between healthy subjects. These behavioral patterns could constitute risk factors for the development of psychiatric disorders. Therefore, finding predictive markers of safe or risky decision-making is an important challenge for psychiatry research. We set up a mouse gambling task (MGT)-adapted from the human Iowa gambling task with uncertain contingencies between response and outcome that furthermore enables the emergence of inter-individual differences. Mice (n = 54) were further individually characterized for locomotive, emotional and cognitive behavior. Individual basal rates of monoamines and brain activation after the MGT were assessed in brain regions related to reward, emotion or cognition. In a large healthy mice population, 44 % showed a balanced strategy with limited risk-taking and flexible choices, 29 % showed a safe but rigid strategy, while 27 % adopted risky behavior. Risky mice took also more risks in other apparatus behavioral devices and were less sensitive to reward. No difference existed between groups regarding anxiety, working memory, locomotion and impulsivity. Safe/rigid mice exhibited a hypoactivation of prefrontal subareas, a high level of serotonin in the orbitofrontal cortex combined with a low level of dopamine in the putamen that predicted the emergence of rigid behavior. By contrast, high levels of dopamine, serotonin and noradrenalin in the hippocampus predicted the emergence of more exploratory and risky behaviors. The coping of C57bl/6J mice in MGT enables the determination of extreme patterns of choices either safe/rigid or risky/flexible, related to specific neurochemical and behavioral markers.

Economic concepts for the analysis of behavior

PubMed Central

Hursh, Steven R.

1980-01-01

A review of the relationship between schedule of reinforcement, response rate, and choice suggests that certain unifying concepts from economics can contribute to a more complete science of behavior. Four points are made: 1) a behavioral experiment is an economic system and its characteristics—open or closed—can strongly determine the results; 2) reinforcers can be distinguished by a functional property called elasticity; 3) reinforcers may interact as complements as well as substitutes; 4) no simple choice rule, such as strict matching, can account for all choice behavior. PMID:16812188

Adolescents' AIDS Risk Taking: A Rational Choice Perspective.

ERIC Educational Resources Information Center

Gardner, William; Herman, Janna

1990-01-01

Discounts the belief in adolescents' irrational behavior, and proposes a rational choice decision-making theory of adolescent risk-taking behavior. Suggests that social ecology affects risk-taking choices. Proposals for AIDS education concern delayed initiation of sexual activity, promotion of condom use, and counseling of high-risk adolescents.…

Effects of Staff Implementation of a Choice Program on Challenging Behaviors in Persons with Developmental Disabilities.

ERIC Educational Resources Information Center

Ip, Sau M. V.; And Others

1994-01-01

Describes quasiexperimental investigation constructed to examine effects of staff implementation of choice program on reduction of challenging behaviors of people with developmental disabilities residing in supported community residences. Results suggest that choice program implementation produced significant decreases in frequency and severity of…

Differences in Behavior and Brain Activity during Hypothetical and Real Choices.

PubMed

Camerer, Colin; Mobbs, Dean

2017-01-01

Real behaviors are binding consequential commitments to a course of action, such as harming another person, buying an Apple watch, or fleeing from danger. Cognitive scientists are generally interested in the psychological and neural processes that cause such real behavior. However, for practical reasons, many scientific studies measure behavior using only hypothetical or imagined stimuli. Generalizing from such studies to real behavior implicitly assumes that the processes underlying the two types of behavior are similar. We review evidence of similarity and differences in hypothetical and real mental processes. In many cases, hypothetical choice tasks give an incomplete picture of brain circuitry that is active during real choice. Copyright © 2016. Published by Elsevier Ltd.

Human place and response learning: navigation strategy selection, pupil size and gaze behavior.

PubMed

de Condappa, Olivier; Wiener, Jan M

2016-01-01

In this study, we examined the cognitive processes and ocular behavior associated with on-going navigation strategy choice using a route learning paradigm that distinguishes between three different wayfinding strategies: an allocentric place strategy, and the egocentric associative cue and beacon response strategies. Participants approached intersections of a known route from a variety of directions, and were asked to indicate the direction in which the original route continued. Their responses in a subset of these test trials allowed the assessment of strategy choice over the course of six experimental blocks. The behavioral data revealed an initial maladaptive bias for a beacon response strategy, with shifts in favor of the optimal configuration place strategy occurring over the course of the experiment. Response time analysis suggests that the configuration strategy relied on spatial transformations applied to a viewpoint-dependent spatial representation, rather than direct access to an allocentric representation. Furthermore, pupillary measures reflected the employment of place and response strategies throughout the experiment, with increasing use of the more cognitively demanding configuration strategy associated with increases in pupil dilation. During test trials in which known intersections were approached from different directions, visual attention was directed to the landmark encoded during learning as well as the intended movement direction. Interestingly, the encoded landmark did not differ between the three navigation strategies, which is discussed in the context of initial strategy choice and the parallel acquisition of place and response knowledge.

Generalization of value in reinforcement learning by humans

PubMed Central

Wimmer, G. Elliott; Daw, Nathaniel D.; Shohamy, Daphna

2012-01-01

Research in decision making has focused on the role of dopamine and its striatal targets in guiding choices via learned stimulus-reward or stimulus-response associations, behavior that is well-described by reinforcement learning (RL) theories. However, basic RL is relatively limited in scope and does not explain how learning about stimulus regularities or relations may guide decision making. A candidate mechanism for this type of learning comes from the domain of memory, which has highlighted a role for the hippocampus in learning of stimulus-stimulus relations, typically dissociated from the role of the striatum in stimulus-response learning. Here, we used fMRI and computational model-based analyses to examine the joint contributions of these mechanisms to RL. Humans performed an RL task with added relational structure, modeled after tasks used to isolate hippocampal contributions to memory. On each trial participants chose one of four options, but the reward probabilities for pairs of options were correlated across trials. This (uninstructed) relationship between pairs of options potentially enabled an observer to learn about options’ values based on experience with the other options and to generalize across them. We observed BOLD activity related to learning in the striatum and also in the hippocampus. By comparing a basic RL model to one augmented to allow feedback to generalize between correlated options, we tested whether choice behavior and BOLD activity were influenced by the opportunity to generalize across correlated options. Although such generalization goes beyond standard computational accounts of RL and striatal BOLD, both choices and striatal BOLD were better explained by the augmented model. Consistent with the hypothesized role for the hippocampus in this generalization, functional connectivity between the ventral striatum and hippocampus was modulated, across participants, by the ability of the augmented model to capture participants’ choice. Our results thus point toward an interactive model in which striatal RL systems may employ relational representations typically associated with the hippocampus. PMID:22487039

Increasing the Value of an Alternative Monetary Reinforcer Reduces Cigarette Choice in Adolescents

PubMed Central

Tidey, Jennifer W.; Kahler, Christopher W.; Wray, Tyler B.; Colby, Suzanne M.

2015-01-01

Introduction: Smoking can be conceptualized as an operant behavior maintained by the reinforcing effects of cigarettes. Changing the magnitude and availability of alternative reinforcers should shift behavior away from smoking. Adults’ smoking behavior is sensitive to the magnitude and availability of alternative reinforcers; however, the extent to which the same is true for adolescents has not yet been shown in the laboratory. Methods: To test the sensitivity of adolescent smoking behavior to changes in the magnitude of alternative reinforcement, we gave adolescents who abstained overnight the opportunity to make 20 choices between receiving two puffs of their usual-brand cigarette or money. The magnitude of the monetary reinforcer was varied across sessions in counterbalanced order ($0.00, $0.10, and $0.50). Results: Results indicated that adolescents’ choices for puffs decreased as a function of increasing monetary reinforcer magnitude, while money choices increased. This effect was moderated by baseline smoking level and by gender, such that heavier-smoking participants and males made more cigarette choices when the alternative monetary value was zero, and decreased their choices more steeply in response to increasing monetary value. Conclusions: The current study validates a laboratory choice procedure for studying smoking in adolescents, and demonstrates that adolescent smoking behavior is sensitive to changes in the magnitude of concurrently available monetary reinforcers. The current paradigm can be adapted and applied to explore the effects of other variables that may affect cigarette choice in adolescents. PMID:25666814

Stimulus similarity determines the prevalence of behavioral laterality in a visual discrimination task for mice

PubMed Central

Treviño, Mario

2014-01-01

Animal choices depend on direct sensory information, but also on the dynamic changes in the magnitude of reward. In visual discrimination tasks, the emergence of lateral biases in the choice record from animals is often described as a behavioral artifact, because these are highly correlated with error rates affecting psychophysical measurements. Here, we hypothesized that biased choices could constitute a robust behavioral strategy to solve discrimination tasks of graded difficulty. We trained mice to swim in a two-alterative visual discrimination task with escape from water as the reward. Their prevalence of making lateral choices increased with stimulus similarity and was present in conditions of high discriminability. While lateralization occurred at the individual level, it was absent, on average, at the population level. Biased choice sequences obeyed the generalized matching law and increased task efficiency when stimulus similarity was high. A mathematical analysis revealed that strongly-biased mice used information from past rewards but not past choices to make their current choices. We also found that the amount of lateralized choices made during the first day of training predicted individual differences in the average learning behavior. This framework provides useful analysis tools to study individualized visual-learning trajectories in mice. PMID:25524257

Dopamine modulates egalitarian behavior in humans.

PubMed

Sáez, Ignacio; Zhu, Lusha; Set, Eric; Kayser, Andrew; Hsu, Ming

2015-03-30

Egalitarian motives form a powerful force in promoting prosocial behavior and enabling large-scale cooperation in the human species [1]. At the neural level, there is substantial, albeit correlational, evidence suggesting a link between dopamine and such behavior [2, 3]. However, important questions remain about the specific role of dopamine in setting or modulating behavioral sensitivity to prosocial concerns. Here, using a combination of pharmacological tools and economic games, we provide critical evidence for a causal involvement of dopamine in human egalitarian tendencies. Specifically, using the brain penetrant catechol-O-methyl transferase (COMT) inhibitor tolcapone [4, 5], we investigated the causal relationship between dopaminergic mechanisms and two prosocial concerns at the core of a number of widely used economic games: (1) the extent to which individuals directly value the material payoffs of others, i.e., generosity, and (2) the extent to which they are averse to differences between their own payoffs and those of others, i.e., inequity. We found that dopaminergic augmentation via COMT inhibition increased egalitarian tendencies in participants who played an extended version of the dictator game [6]. Strikingly, computational modeling of choice behavior [7] revealed that tolcapone exerted selective effects on inequity aversion, and not on other computational components such as the extent to which individuals directly value the material payoffs of others. Together, these data shed light on the causal relationship between neurochemical systems and human prosocial behavior and have potential implications for our understanding of the complex array of social impairments accompanying neuropsychiatric disorders involving dopaminergic dysregulation. Copyright © 2015 Elsevier Ltd. All rights reserved.

Auditory Gap-in-Noise Detection Behavior in Ferrets and Humans

PubMed Central

2015-01-01

The precise encoding of temporal features of auditory stimuli by the mammalian auditory system is critical to the perception of biologically important sounds, including vocalizations, speech, and music. In this study, auditory gap-detection behavior was evaluated in adult pigmented ferrets (Mustelid putorius furo) using bandpassed stimuli designed to widely sample the ferret’s behavioral and physiological audiogram. Animals were tested under positive operant conditioning, with psychometric functions constructed in response to gap-in-noise lengths ranging from 3 to 270 ms. Using a modified version of this gap-detection task, with the same stimulus frequency parameters, we also tested a cohort of normal-hearing human subjects. Gap-detection thresholds were computed from psychometric curves transformed according to signal detection theory, revealing that for both ferrets and humans, detection sensitivity was worse for silent gaps embedded within low-frequency noise compared with high-frequency or broadband stimuli. Additional psychometric function analysis of ferret behavior indicated effects of stimulus spectral content on aspects of behavioral performance related to decision-making processes, with animals displaying improved sensitivity for broadband gap-in-noise detection. Reaction times derived from unconditioned head-orienting data and the time from stimulus onset to reward spout activation varied with the stimulus frequency content and gap length, as well as the approach-to-target choice and reward location. The present study represents a comprehensive evaluation of gap-detection behavior in ferrets, while similarities in performance with our human subjects confirm the use of the ferret as an appropriate model of temporal processing. PMID:26052794

Valence of emotions and moral decision-making: increased pleasantness to pleasant images and decreased unpleasantness to unpleasant images are associated with utilitarian choices in healthy adults.

PubMed

Carmona-Perera, Martina; Martí-García, Celia; Pérez-García, Miguel; Verdejo-García, Antonio

2013-01-01

Moral decision-making is a key asset for humans' integration in social contexts, and the way we decide about moral issues seems to be strongly influenced by emotions. For example, individuals with deficits in emotional processing tend to deliver more utilitarian choices (accepting an emotionally aversive action in favor of communitarian well-being). However, little is known about the association between emotional experience and moral-related patterns of choice. We investigated whether subjective reactivity to emotional stimuli, in terms of valence, arousal, and dominance, is associated with moral decision-making in 95 healthy adults. They answered to a set of moral and non-moral dilemmas and assessed emotional experience in valence, arousal and dominance dimensions in response to neutral, pleasant, unpleasant non-moral, and unpleasant moral pictures. Results showed significant correlations between less unpleasantness to negative stimuli, more pleasantness to positive stimuli and higher proportion of utilitarian choices. We also found a positive association between higher arousal ratings to negative moral laden pictures and more utilitarian choices. Low dominance was associated with greater perceived difficulty over moral judgment. These behavioral results are in fitting with the proposed role of emotional experience in moral choice.

Loss of lateral prefrontal cortex control in food-directed attention and goal-directed food choice in obesity.

PubMed

Janssen, Lieneke K; Duif, Iris; van Loon, Ilke; Wegman, Joost; de Vries, Jeanne H M; Cools, Roshan; Aarts, Esther

2017-02-01

Loss of lateral prefrontal cortex (lPFC)-mediated attentional control may explain the automatic tendency to eat in the face of food. Here, we investigate the neurocognitive mechanism underlying attentional bias to food words and its association with obesity using a food Stroop task. We tested 76 healthy human subjects with a wide body mass index (BMI) range (19-35kg/m 2 ) using fMRI. As a measure of obesity we calculated individual obesity scores based on BMI, waist circumference and waist-to-hip ratio using principal component analyses. To investigate the automatic tendency to overeat directly, the same subjects performed a separate behavioral outcome devaluation task measuring the degree of goal-directed versus automatic food choices. We observed that increased obesity scores were associated with diminished lPFC responses during food attentional bias. This was accompanied by decreased goal-directed control of food choices following outcome devaluation. Together these findings suggest that deficient control of both food-directed attention and choice may contribute to obesity, particularly given our obesogenic environment with food cues everywhere, and the choice to ignore or indulge despite satiety. Copyright © 2016 Elsevier Inc. All rights reserved.

A Conceptual Model of Leisure-Time Choice Behavior.

ERIC Educational Resources Information Center

Bergier, Michel J.

1981-01-01

Methods of studying the gap between predisposition and actual behavior of consumers of spectator sports is discussed. A model is drawn from the areas of behavioral sciences, consumer behavior, and leisure research. The model is constructed around the premise that choice is primarily a function of personal, product, and environmental factors. (JN)

Cognitive control predicts use of model-based reinforcement learning.

PubMed

Otto, A Ross; Skatova, Anya; Madlon-Kay, Seth; Daw, Nathaniel D

2015-02-01

Accounts of decision-making and its neural substrates have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental work suggest that this classic distinction between behaviorally and neurally dissociable systems for habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning (RL), called model-free and model-based RL, but the cognitive or computational processes by which one system may dominate over the other in the control of behavior is a matter of ongoing investigation. To elucidate this question, we leverage the theoretical framework of cognitive control, demonstrating that individual differences in utilization of goal-related contextual information--in the service of overcoming habitual, stimulus-driven responses--in established cognitive control paradigms predict model-based behavior in a separate, sequential choice task. The behavioral correspondence between cognitive control and model-based RL compellingly suggests that a common set of processes may underpin the two behaviors. In particular, computational mechanisms originally proposed to underlie controlled behavior may be applicable to understanding the interactions between model-based and model-free choice behavior.

Promoting behavior change: making healthy choices in wellness and healing choices in illness - use of self-determination theory in nursing practice.

PubMed

Johnson, Vicki D

2007-06-01

This article explores more efficacious strategies for holistic nurses to promote healthy behavior choices in their clients. It presents an overview of self-determination theory (SDT) and describes research evidence that supports the application of SDT to promoting healthy behavior change in clients. When nurses act in ways that support clients' innate needs for autonomy, competence, and relatedness, clients may be more successful at internalizing self-regulation and more inclined to adopt and maintain lifelong behavioral changes. Some examples of nursing interventions to motivate behavior change are outlined in this article.

Gaze-Following and Reaction to an Aversive Social Interaction Have Corresponding Associations with Variation in the OXTR Gene in Dogs but Not in Human Infants.

PubMed

Oláh, Katalin; Topál, József; Kovács, Krisztina; Kis, Anna; Koller, Dóra; Young Park, Soon; Virányi, Zsófia

2017-01-01

It has been suggested that dogs' remarkable capacity to use human communicative signals lies in their comparable social cognitive skills; however, this view has been questioned recently. The present study investigated associations between oxytocin receptor gene (OXTR) polymorphisms and social behavior in human infants and dogs with the aim to unravel potentially differential mechanisms behind their responsiveness to human gaze. Sixteen-month-old human infants ( N = 99) and adult Border Collie dogs ( N = 71) participated in two tasks designed to test (1) their use of gaze-direction as a cue to locate a hidden object, and (2) their reactions to an aversive social interaction (using the still face task for children and a threatening approach task for dogs). Moreover, we obtained DNA samples to analyze associations between single nucleotide polymorphisms (SNP) in the OXTR (dogs: -213AG, -94TC, -74CG, rs8679682, children: rs53576, rs1042778, rs2254298) and behavior. We found that OXTR genotype was significantly associated with reactions to an aversive social interaction both in dogs and children, confirming the anxiolytic effect of oxytocin in both species. In dogs, the genotypes linked to less fearful behavior were associated also with a higher willingness to follow gaze whereas in children, OXTR gene polymorphisms did not affect gaze following success. This pattern of gene-behavior associations suggests that for dogs the two situations are more alike (potentially fear-inducing or competitive) than for human children. This raises the possibility that, in contrast to former studies proposing human-like cooperativeness in dogs, dogs may perceive human gaze in an object-choice task in a more antagonistic manner than children.

Mate choice, sexual selection, and endocrine-disrupting chemicals.

PubMed

Gore, Andrea C; Holley, Amanda M; Crews, David

2018-05-01

Humans have disproportionately affected the habitat and survival of species through environmental contamination. Important among these anthropogenic influences is the proliferation of organic chemicals, some of which perturb hormone systems, the latter referred to as endocrine-disrupting chemicals (EDCs). EDCs are widespread in the environment and affect all levels of reproduction, including development of reproductive organs, hormone release and regulation through the life cycle, the development of secondary sexual characteristics, and the maturation and maintenance of adult physiology and behavior. However, what is not well-known is how the confluence of EDC actions on the manifestation of morphological and behavioral sexual traits influences mate choice, a process that requires the reciprocal evaluation of and/or acceptance of a sexual partner. Moreover, the outcomes of EDC-induced perturbations are likely to influence sexual selection; yet this has rarely been directly tested. Here, we provide background on the development and manifestation of sexual traits, reproductive competence, and the neurobiology of sexual behavior, and evidence for their perturbation by EDCs. Selection acts on individuals, with the consequences manifest in populations, and we discuss the implications for EDC contamination of these processes, and the future of species. Copyright © 2017 Elsevier Inc. All rights reserved.

Impulsive social influence increases impulsive choices on a temporal discounting task in young adults.

PubMed

Gilman, Jodi M; Curran, Max T; Calderon, Vanessa; Stoeckel, Luke E; Evins, A Eden

2014-01-01

Adolescents and young adults who affiliate with friends who engage in impulsive behavior are more likely to engage in impulsive behaviors themselves, and those who associate with prosocial (i.e. more prudent, future oriented) peers are more likely to engage in prosocial behavior. However, it is difficult to disentangle the contribution of peer influence vs. peer selection (i.e., whether individuals choose friends with similar traits) when interpreting social behaviors. In this study, we combined a novel social manipulation with a well-validated delay discounting task assessing impulsive behavior to create a social influence delay discounting task, in which participants were exposed to both impulsive (smaller, sooner or SS payment) and non-impulsive (larger, later or LL payment) choices from their peers. Young adults in this sample, n = 51, aged 18-25 had a higher rate of SS choices after exposure to impulsive peer influence than after exposure to non-impulsive peer influence. Interestingly, in highly susceptible individuals, the rate of non-impulsive choices did not increase after exposure to non-impulsive influence. There was a positive correlation between self-reported suggestibility and degree of peer influence on SS choices. These results suggest that, in young adults, SS choices appear to be influenced by the choices of same-aged peers, especially for individuals who are highly susceptible to influence.

Impulsive Social Influence Increases Impulsive Choices on a Temporal Discounting Task in Young Adults

PubMed Central

Gilman, Jodi M.; Curran, Max T.; Calderon, Vanessa; Stoeckel, Luke E.; Evins, A. Eden

2014-01-01

Adolescents and young adults who affiliate with friends who engage in impulsive behavior are more likely to engage in impulsive behaviors themselves, and those who associate with prosocial (i.e. more prudent, future oriented) peers are more likely to engage in prosocial behavior. However, it is difficult to disentangle the contribution of peer influence vs. peer selection (i.e., whether individuals choose friends with similar traits) when interpreting social behaviors. In this study, we combined a novel social manipulation with a well-validated delay discounting task assessing impulsive behavior to create a social influence delay discounting task, in which participants were exposed to both impulsive (smaller, sooner or SS payment) and non-impulsive (larger, later or LL payment) choices from their peers. Young adults in this sample, n = 51, aged 18–25 had a higher rate of SS choices after exposure to impulsive peer influence than after exposure to non-impulsive peer influence. Interestingly, in highly susceptible individuals, the rate of non-impulsive choices did not increase after exposure to non-impulsive influence. There was a positive correlation between self-reported suggestibility and degree of peer influence on SS choices. These results suggest that, in young adults, SS choices appear to be influenced by the choices of same-aged peers, especially for individuals who are highly susceptible to influence. PMID:24988440

Contagious yawning, social cognition, and arousal: an investigation of the processes underlying shelter dogs' responses to human yawns.

PubMed

Buttner, Alicia Phillips; Strasser, Rosemary

2014-01-01

Studies of contagious yawning have reported inconsistent findings regarding whether dogs exhibit this behavior and whether it is mediated by social-cognitive processes or the result of physiological arousal. We investigated why some dogs yawn in response to human yawns; particularly, whether these dogs are exceptional in their ability to understand human social cues or whether they were more physiologically aroused. Sixty shelter dogs were exposed to yawning and nonyawning control stimuli demonstrated by an unfamiliar human. We took salivary cortisol samples before and after testing to determine the role of arousal in yawn contagion. Dogs were tested on the object-choice task to assess their sensitivity for interpreting human social cues. We found that 12 dogs yawned only in response to human yawns (i.e., appeared to exhibit yawn contagion), though contagious yawning at the population level was not observed. Dogs that exhibited yawn contagion did not perform better on the object-choice task than other dogs, but their cortisol levels remained elevated after exposure to human yawning, whereas other dogs had reduced cortisol levels following yawning stimuli relative to their baseline levels. We interpret these findings as showing that human yawning, when presented in a stressful context, can further influence arousal in dogs, which then causes some to yawn. Although the precise social-cognitive mechanisms that underlie contagious yawning in dogs are still unclear, yawning between humans and dogs may involve some communicative function that is modulated by context and arousal.

Decision-making based on emotional images.

PubMed

Katahira, Kentaro; Fujimura, Tomomi; Okanoya, Kazuo; Okada, Masato

2011-01-01

The emotional outcome of a choice affects subsequent decision making. While the relationship between decision making and emotion has attracted attention, studies on emotion and decision making have been independently developed. In this study, we investigated how the emotional valence of pictures, which was stochastically contingent on participants' choices, influenced subsequent decision making. In contrast to traditional value-based decision-making studies that used money or food as a reward, the "reward value" of the decision outcome, which guided the update of value for each choice, is unknown beforehand. To estimate the reward value of emotional pictures from participants' choice data, we used reinforcement learning models that have successfully been used in previous studies for modeling value-based decision making. Consequently, we found that the estimated reward value was asymmetric between positive and negative pictures. The negative reward value of negative pictures (relative to neutral pictures) was larger in magnitude than the positive reward value of positive pictures. This asymmetry was not observed in valence for an individual picture, which was rated by the participants regarding the emotion experienced upon viewing it. These results suggest that there may be a difference between experienced emotion and the effect of the experienced emotion on subsequent behavior. Our experimental and computational paradigm provides a novel way for quantifying how and what aspects of emotional events affect human behavior. The present study is a first step toward relating a large amount of knowledge in emotion science and in taking computational approaches to value-based decision making.

A behavioural and neural evaluation of prospective decision-making under risk

PubMed Central

Symmonds, Mkael; Bossaerts, Peter; Dolan, Raymond J.

2010-01-01

Making the best choice when faced with a chain of decisions requires a person to judge both anticipated outcomes and future actions. Although economic decision-making models account for both risk and reward in single choice contexts there is a dearth of similar knowledge about sequential choice. Classical utility-based models assume that decision-makers select and follow an optimal pre-determined strategy, irrespective of the particular order in which options are presented. An alternative model involves continuously re-evaluating decision utilities, without prescribing a specific future set of choices. Here, using behavioral and functional magnetic resonance imaging (fMRI) data, we studied human subjects in a sequential choice task and use these data to compare alternative decision models of valuation and strategy selection. We provide evidence that subjects adopt a model of re-evaluating decision utilities, where available strategies are continuously updated and combined in assessing action values. We validate this model by using simultaneously-acquired fMRI data to show that sequential choice evokes a pattern of neural response consistent with a tracking of anticipated distribution of future reward, as expected in such a model. Thus, brain activity evoked at each decision point reflects the expected mean, variance and skewness of possible payoffs, consistent with the idea that sequential choice evokes a prospective evaluation of both available strategies and possible outcomes. PMID:20980595

Sexual Health Knowledge, Self-Efficacy and Behavioral Intentions Following a Health Fair for Adolescents.

PubMed

Kulik, Noel L; McNeill, Cynthera; Murphy, Angela R; Iovan, Samantha

2016-01-01

High rates of human immunodeficiency virus (HIV) exist among urban African American youth. There is a need to provide HIV information to youth prior to the onset of sexual activity. The Stomping Out HIV intervention combines a health fair and step show to increase awareness and healthy behaviors among this population. Questionnaires were administered to youth and parents before and after Stomping Out, and focused on health knowledge, satisfaction with Stomping Out, intended behavior changes and self-efficacy to make healthier choices related to HIV and STI prevention. Youth and adults reported increased knowledge and self-efficacy after Stomping Out. These findings suggest that health initiatives focusing on sociocultural issues can greatly impact adults and youth.

Autoshaped choice in artificial neural networks: implications for behavioral economics and neuroeconomics.

PubMed

Burgos, José E; García-Leal, Óscar

2015-05-01

An existing neural network model of conditioning was used to simulate autoshaped choice. In this phenomenon, pigeons first receive an autoshaping procedure with two keylight stimuli X and Y separately paired with food in a forward-delay manner, intermittently for X and continuously for Y. Then pigeons receive unreinforced choice test trials of X and Y concurrently present. Most pigeons choose Y. This preference for a more valuable response alternative is a form of economic behavior that makes the phenomenon relevant to behavioral economics. The phenomenon also suggests a role for Pavlovian contingencies in economic behavior. The model used, in contrast to others, predicts autoshaping and automaintenance, so it is uniquely positioned to predict autoshaped choice. The model also contemplates neural substrates of economic behavior in neuroeconomics, such as dopaminergic and hippocampal systems. A feedforward neural network architecture was designed to simulate a neuroanatomical differentiation between two environment-behavior relations X-R1 and Y-R2, [corrected] where R1 and R2 denote two different emitted responses (not unconditionally elicited by the reward). Networks with this architecture received a training protocol that simulated an autoshaped-choice procedure. Most networks simulated the phenomenon. Implications for behavioral economics and neuroeconomics, limitations, and the issue of model appraisal are discussed. Copyright © 2015 Elsevier B.V. All rights reserved.

A Healthy Eating Identity is Associated with Healthier Food Choice Behaviors Among U.S. Army Soldiers.

PubMed

Jayne, Julianna M; Frongillo, Edward A; Torres-McGehee, Toni M; Emerson, Dawn M; Glover, Saundra H; Blake, Christine E

2018-04-04

Promoting healthy eating among Soldiers is a priority to the Army due to the link between nutrition and performance. The Army typically uses nutrition education to encourage Soldiers to make healthier food choices with low emphasis on other psychosocial determinants of food choice behaviors. Drill Sergeant Candidates (n = 575) completed surveys assessing nutrition knowledge, eating identity type, and food choice behaviors including fruit and vegetable intake, skipping meals, and eating out frequency. In multiple linear regression models using full-information maximum likelihood estimation while controlling for race/ethnicity, education, and marital status, we examined relationships between nutrition knowledge, a healthy eating identity, and Soldiers' food choice behaviors. The study was approved by the Department of Defense and University of South Carolina's Institutional Review Boards. A healthy eating identity was positively associated with greater fruit and vegetable consumption (p < 0.05), and negatively associated with skipping meals and eating out frequency (p < 0.05). Nutrition knowledge was negatively associated with skipping meals (p < 0.05). Findings suggest that fostering a healthy eating identity may be more effective for promoting healthy food choice behaviors than nutrition education alone. Determining if various points in a Soldier's career could be leveraged to influence a healthy eating identity and behaviors could be an important strategy to improve compliance with health promotion programs.

Systemic administration of guanfacine improves food-motivated impulsive choice behavior primarily via direct stimulation of postsynaptic α2A-adrenergic receptors in rats.

PubMed

Nishitomi, Kouhei; Yano, Koji; Kobayashi, Mika; Jino, Kohei; Kano, Takuya; Horiguchi, Naotaka; Shinohara, Shunji; Hasegawa, Minoru

2018-06-01

Impulsive choice behavior, which can be assessed using the delay discounting task, is a characteristic of various psychiatric disorders, including attention-deficit/hyperactivity disorder (ADHD). Guanfacine is a selective α 2A -adrenergic receptor agonist that is clinically effective in treating ADHD. However, there is no clear evidence that systemic guanfacine administration reduces impulsive choice behavior in the delay discounting task in rats. In the present study, we examined the effect of systemic guanfacine administration on food-motivated impulsive choice behavior in rats and the neuronal mechanism underlying this effect. Repeated administration of either guanfacine, methylphenidate, or atomoxetine significantly enhanced impulse control, increasing the number of times the rats chose a large but delayed reward in a dose-dependent manner. The effect of guanfacine was significantly blocked by pretreatment with an α 2A -adrenergic receptor antagonist. Furthermore, the effect of guanfacine remained unaffected in rats pretreated with a selective noradrenergic neurotoxin, consistent with a post-synaptic action. In contrast, the effect of atomoxetine on impulsive choice behavior was attenuated by pretreatment with the noradrenergic neurotoxin. These results provide the first evidence that systemically administered guanfacine reduces impulsive choice behavior in rats and that direct stimulation of postsynaptic, rather than presynaptic, α 2A -adrenergic receptors is involved in this effect. Copyright © 2018 Elsevier B.V. All rights reserved.

On Adaptation, Maximization, and Reinforcement Learning among Cognitive Strategies

ERIC Educational Resources Information Center

Erev, Ido; Barron, Greg

2005-01-01

Analysis of binary choice behavior in iterated tasks with immediate feedback reveals robust deviations from maximization that can be described as indications of 3 effects: (a) a payoff variability effect, in which high payoff variability seems to move choice behavior toward random choice; (b) underweighting of rare events, in which alternatives…

From Recurrent Choice to Skill Learning: A Reinforcement-Learning Model

ERIC Educational Resources Information Center

Fu, Wai-Tat; Anderson, John R.

2006-01-01

The authors propose a reinforcement-learning mechanism as a model for recurrent choice and extend it to account for skill learning. The model was inspired by recent research in neurophysiological studies of the basal ganglia and provides an integrated explanation of recurrent choice behavior and skill learning. The behavior includes effects of…

Initial Validation of the Activity Choice Index among Overweight Women

ERIC Educational Resources Information Center

Mullen, Sean P.; Silva, Marlene N.; Sardinha, Luís B.; Teixeira, Pedro J.

2016-01-01

Purpose: This prospective study was designed to evaluate psychometric properties of the Activity Choice Index (ACI), a measure for assessing one's choice to engage in more effortful, physically active behaviors in the course of daily routines over less-demanding, sedentary behaviors, in a sample of overweight women. Method: The sample included 192…

Are ADHD Symptoms Associated with Delay Aversion or Choice Impulsivity? A General Population Study

ERIC Educational Resources Information Center

Paloyelis, Yannis; Asherson, Philip; Kuntsi, Jonna

2009-01-01

The relationship of attention-deficit/hyperactivity disorder (ADHD) with choice impulsivity is examined. Findings were found to indicate that primary constitutional processes that underlie choice impulsivity and their potential role in behavioral inattention are important. It was also found that behavioral and brain processes that underlie choice…

Learning and choosing in an uncertain world: An investigation of the explore-exploit dilemma in static and dynamic environments.

PubMed

Navarro, Daniel J; Newell, Ben R; Schulze, Christin

2016-03-01

How do people solve the explore-exploit trade-off in a changing environment? In this paper we present experimental evidence from an "observe or bet" task, in which people have to determine when to engage in information-seeking behavior and when to switch to reward-taking actions. In particular we focus on the comparison between people's behavior in a changing environment and their behavior in an unchanging one. Our experimental work is motivated by rational analysis of the problem that makes strong predictions about information search and reward seeking in static and changeable environments. Our results show a striking agreement between human behavior and the optimal policy, but also highlight a number of systematic differences. In particular, we find that while people often employ suboptimal strategies the first time they encounter the learning problem, most people are able to approximate the correct strategy after minimal experience. In order to describe both the manner in which people's choices are similar to but slightly different from an optimal standard, we introduce four process models for the observe or bet task and evaluate them as potential theories of human behavior. Copyright © 2016 Elsevier Inc. All rights reserved.

The Potential Impact of Labor Choices on the Efficacy of Marine Conservation Strategies

PubMed Central

Hughes, Zachary D.; Fenichel, Eli P.; Gerber, Leah R.

2011-01-01

Conservation of marine resources is critical to the wellbeing of human communities. Coastal artisanal fishing communities are particularly reliant on marine resources for food and for their livelihoods. Management actions aimed at marine conservation may lead to unanticipated changes in human behavior that influence the ability of conservation programs to achieve their goals. We examine how marine conservation strategies may impact labor decisions that influence both the ecosystem and human livelihoods using simulation modeling. We consider two conservation strategies in the model: direct action through fisheries regulation enforcement, and indirect action through land conservation. Our results indicate that both strategies can increase the abundance of fish, and thus contribute to the maintenance of marine resources. However, our results also show that marine fisheries enforcement may negatively impact the livelihoods of human communities. Land conservation, on the other hand, potentially enhances the livelihood of the human populations. Thus, depending on management objectives, indirect or a combination of direct and indirect conservation strategies may be effective at achieving conservation and sustainability goals. These results highlight the importance of accounting for changes in human behavior resulting from management actions in conservation and management. PMID:21887306

Impulsive Choice in Mice Lacking Paternal Expression of Grb10 Suggests Intragenomic Conflict in Behavior.

PubMed

Dent, Claire L; Humby, Trevor; Lewis, Katie; Ward, Andrew; Fischer-Colbrie, Reiner; Wilkinson, Lawrence S; Wilkins, Jon F; Isles, Anthony R

2018-05-01

Imprinted genes are expressed from one parental allele only as a consequence of epigenetic events that take place in the mammalian germ line and are thought to have evolved through intragenomic conflict between parental alleles. We demonstrate, for the first time, oppositional effects of imprinted genes on brain and behavior. Specifically, we show that mice lacking paternal Grb10 make fewer impulsive choices, with no dissociable effects on a separate measure of impulsive action. Taken together with previous work showing that mice lacking maternal Nesp55 make more impulsive choices, this suggests that impulsive choice behavior is a substrate for the action of genomic imprinting. Moreover, the contrasting effect of these two genes suggests that impulsive choices are subject to intragenomic conflict and that maternal and paternal interests pull this behavior in opposite directions. Finally, these data may also indicate that an imbalance in expression of imprinted genes contributes to pathological conditions such as gambling and drug addiction, where impulsive behavior becomes maladaptive. Copyright © 2018 Dent et al.

Stress-induced changes in human decision-making are reversible.

PubMed

Soares, J M; Sampaio, A; Ferreira, L M; Santos, N C; Marques, F; Palha, J A; Cerqueira, J J; Sousa, N

2012-07-03

Appropriate decision-making relies on the ability to shift between different behavioral strategies according to the context in which decisions are made. A cohort of subjects exposed to prolonged stress, and respective gender- and age-matched controls, performed an instrumental behavioral task to assess their decision-making strategies. The stressed cohort was reevaluated after a 6-week stress-free period. The behavioral analysis was complemented by a functional magnetic resonance imaging (fMRI) study to detect the patterns of activation in corticostriatal networks ruling goal-directed and habitual actions. Using structural MRI, the volumes of the main cortical and subcortical regions implicated in instrumental behavior were determined. Here we show that chronic stress biases decision-making strategies in humans toward habits, as choices of stressed subjects become insensitive to changes in outcome value. Using functional imaging techniques, we demonstrate that prolonged exposure to stress in humans causes an imbalanced activation of the networks that govern decision processes, shifting activation from the associative to the sensorimotor circuits. These functional changes are paralleled by atrophy of the medial prefrontal cortex and the caudate, and by an increase in the volume of the putamina. Importantly, a longitudinal assessment of the stressed individuals showed that both the structural and functional changes triggered by stress are reversible and that decisions become again goal-directed.

Behavioral Economics and the Supplemental Nutrition Assistance Program:: Making the Healthy Choice the Easy Choice.

PubMed

Ammerman, Alice S; Hartman, Terry; DeMarco, Molly M

2017-02-01

The Supplemental Nutrition Assistance Program (SNAP) serves as an important nutritional safety net program for many Americans. Given its aim to use traditional economic levers to provide access to food, the SNAP program includes minimal nutritional requirements and restrictions. As food choices are influenced by more than just economic constraints, behavioral economics may offer insights and tools for altering food purchases for SNAP users. This manuscript outlines behavioral economics strategies that have potential to encourage healthier food choices within the SNAP program. Copyright © 2016 American Journal of Preventive Medicine. Published by Elsevier Inc. All rights reserved.

Believing Is Doing: Emotion Regulation Beliefs Are Associated With Emotion Regulation Behavioral Choices and Subjective Well-Being

PubMed Central

Ortner, Catherine Nicole Marie; Briner, Esther Lydia; Marjanovic, Zdravko

2017-01-01

Research in emotion regulation has begun to examine various predictors of emotion regulation choices, including individual differences and contextual variables. However, scant attention has been paid to the extent to which people’s beliefs about the specific consequences of emotion regulation strategies for the components of an emotional response and long-term well-being predict their behavioral regulatory choices and, in turn, their subjective well-being. Participants completed measures to assess their beliefs about the consequences of functional and dysfunctional strategies, behavioral choices of emotion regulation strategies in negative scenarios, and subjective well-being. The model that fit the data indicated partial mediation whereby beliefs were associated with approximately 9% of the variance in choices. Emotion regulation choices were related to subjective well-being, with an additional direct effect between beliefs and well-being. This suggests beliefs play a role in people’s regulatory choices. Future research should explore how beliefs interact with individual differences and contextual variables to better understand why people regulate their emotions in different ways and, ultimately, to help individuals make healthy emotion regulation choices. PMID:28344675

Believing Is Doing: Emotion Regulation Beliefs Are Associated With Emotion Regulation Behavioral Choices and Subjective Well-Being.

PubMed

Ortner, Catherine Nicole Marie; Briner, Esther Lydia; Marjanovic, Zdravko

2017-03-01

Research in emotion regulation has begun to examine various predictors of emotion regulation choices, including individual differences and contextual variables. However, scant attention has been paid to the extent to which people's beliefs about the specific consequences of emotion regulation strategies for the components of an emotional response and long-term well-being predict their behavioral regulatory choices and, in turn, their subjective well-being. Participants completed measures to assess their beliefs about the consequences of functional and dysfunctional strategies, behavioral choices of emotion regulation strategies in negative scenarios, and subjective well-being. The model that fit the data indicated partial mediation whereby beliefs were associated with approximately 9% of the variance in choices. Emotion regulation choices were related to subjective well-being, with an additional direct effect between beliefs and well-being. This suggests beliefs play a role in people's regulatory choices. Future research should explore how beliefs interact with individual differences and contextual variables to better understand why people regulate their emotions in different ways and, ultimately, to help individuals make healthy emotion regulation choices.

Emotion, decision making, and the amygdala.

PubMed

Seymour, Ben; Dolan, Ray

2008-06-12

Emotion plays a critical role in many contemporary accounts of decision making, but exactly what underlies its influence and how this is mediated in the brain remain far from clear. Here, we review behavioral studies that suggest that Pavlovian processes can exert an important influence over choice and may account for many effects that have traditionally been attributed to emotion. We illustrate how recent experiments cast light on the underlying structure of Pavlovian control and argue that generally this influence makes good computational sense. Corresponding neuroscientific data from both animals and humans implicate a central role for the amygdala through interactions with other brain areas. This yields a neurobiological account of emotion in which it may operate, often covertly, to optimize rather than corrupt economic choice.

Competing dopamine neurons drive oviposition choice for ethanol in Drosophila.

PubMed

Azanchi, Reza; Kaun, Karla R; Heberlein, Ulrike

2013-12-24

The neural circuits that mediate behavioral choice evaluate and integrate information from the environment with internal demands and then initiate a behavioral response. Even circuits that support simple decisions remain poorly understood. In Drosophila melanogaster, oviposition on a substrate containing ethanol enhances fitness; however, little is known about the neural mechanisms mediating this important choice behavior. Here, we characterize the neural modulation of this simple choice and show that distinct subsets of dopaminergic neurons compete to either enhance or inhibit egg-laying preference for ethanol-containing food. Moreover, activity in α'β' neurons of the mushroom body and a subset of ellipsoid body ring neurons (R2) is required for this choice. We propose a model where competing dopaminergic systems modulate oviposition preference to adjust to changes in natural oviposition substrates.

Self-Regulation as an Aid to Human Effectiveness and Biocybernetics Technology and Behavior

DTIC Science & Technology

1976-01-01

feedback and two measures of information-processing capacity: short-term memory for digits and choice-reaction times. In this study, Beatty selected...Kamiya, like Beatty, found EEG activity unrelated to both memory for words and a simple reaction-time test. In another study, Kamiya (1972...creative intelligence, visual memory , mental arithmetic, digit memory span, and i,une tracking. The results were negative. Kamiya concluded that the self

Neural Mechanisms of Cognitive Dissonance (Revised): An EEG Study.

PubMed

Colosio, Marco; Shestakova, Anna; Nikulin, Vadim V; Blagovechtchenski, Evgeny; Klucharev, Vasily

2017-05-17

Cognitive dissonance theory suggests that our preferences are modulated by the mere act of choosing. A choice between two similarly valued alternatives creates psychological tension (cognitive dissonance) that is reduced by a postdecisional reevaluation of the alternatives. We measured EEG of human subjects during rest and free-choice paradigm. Our study demonstrates that choices associated with stronger cognitive dissonance trigger a larger negative frontocentral evoked response similar to error-related negativity, which has in turn been implicated in general performance monitoring. Furthermore, the amplitude of the evoked response is correlated with the reevaluation of the alternatives. We also found a link between individual neural dynamics (long-range temporal correlations) of the frontocentral cortices during rest and follow-up neural and behavioral effects of cognitive dissonance. Individuals with stronger resting-state long-range temporal correlations demonstrated a greater postdecisional reevaluation of the alternatives and larger evoked brain responses associated with stronger cognitive dissonance. Thus, our results suggest that cognitive dissonance is reflected in both resting-state and choice-related activity of the prefrontal cortex as part of the general performance-monitoring circuitry. SIGNIFICANCE STATEMENT Contrary to traditional decision theory, behavioral studies repeatedly demonstrate that our preferences are modulated by the mere act of choosing. Difficult choices generate psychological (cognitive) dissonance, which is reduced by the postdecisional devaluation of unchosen options. We found that decisions associated with a higher level of cognitive dissonance elicited a stronger negative frontocentral deflection that peaked ∼60 ms after the response. This activity shares similar spatial and temporal features as error-related negativity, the electrophysiological correlate of performance monitoring. Furthermore, the frontocentral resting-state activity predicted the individual magnitude of preference change and the strength of cognitive dissonance-related neural activity. Copyright © 2017 Colosio et al.

Neural Mechanisms of Cognitive Dissonance (Revised): An EEG Study

PubMed Central

Nikulin, Vadim V.; Blagovechtchenski, Evgeny

2017-01-01

Cognitive dissonance theory suggests that our preferences are modulated by the mere act of choosing. A choice between two similarly valued alternatives creates psychological tension (cognitive dissonance) that is reduced by a postdecisional reevaluation of the alternatives. We measured EEG of human subjects during rest and free-choice paradigm. Our study demonstrates that choices associated with stronger cognitive dissonance trigger a larger negative frontocentral evoked response similar to error-related negativity, which has in turn been implicated in general performance monitoring. Furthermore, the amplitude of the evoked response is correlated with the reevaluation of the alternatives. We also found a link between individual neural dynamics (long-range temporal correlations) of the frontocentral cortices during rest and follow-up neural and behavioral effects of cognitive dissonance. Individuals with stronger resting-state long-range temporal correlations demonstrated a greater postdecisional reevaluation of the alternatives and larger evoked brain responses associated with stronger cognitive dissonance. Thus, our results suggest that cognitive dissonance is reflected in both resting-state and choice-related activity of the prefrontal cortex as part of the general performance-monitoring circuitry. SIGNIFICANCE STATEMENT Contrary to traditional decision theory, behavioral studies repeatedly demonstrate that our preferences are modulated by the mere act of choosing. Difficult choices generate psychological (cognitive) dissonance, which is reduced by the postdecisional devaluation of unchosen options. We found that decisions associated with a higher level of cognitive dissonance elicited a stronger negative frontocentral deflection that peaked ∼60 ms after the response. This activity shares similar spatial and temporal features as error-related negativity, the electrophysiological correlate of performance monitoring. Furthermore, the frontocentral resting-state activity predicted the individual magnitude of preference change and the strength of cognitive dissonance-related neural activity. PMID:28438968

Changes in corticostriatal connectivity during reinforcement learning in humans.

PubMed

Horga, Guillermo; Maia, Tiago V; Marsh, Rachel; Hao, Xuejun; Xu, Dongrong; Duan, Yunsuo; Tau, Gregory Z; Graniello, Barbara; Wang, Zhishun; Kangarlu, Alayar; Martinez, Diana; Packard, Mark G; Peterson, Bradley S

2015-02-01

Many computational models assume that reinforcement learning relies on changes in synaptic efficacy between cortical regions representing stimuli and striatal regions involved in response selection, but this assumption has thus far lacked empirical support in humans. We recorded hemodynamic signals with fMRI while participants navigated a virtual maze to find hidden rewards. We fitted a reinforcement-learning algorithm to participants' choice behavior and evaluated the neural activity and the changes in functional connectivity related to trial-by-trial learning variables. Activity in the posterior putamen during choice periods increased progressively during learning. Furthermore, the functional connections between the sensorimotor cortex and the posterior putamen strengthened progressively as participants learned the task. These changes in corticostriatal connectivity differentiated participants who learned the task from those who did not. These findings provide a direct link between changes in corticostriatal connectivity and learning, thereby supporting a central assumption common to several computational models of reinforcement learning. © 2014 Wiley Periodicals, Inc.

Neural mechanisms of cue-approach training

PubMed Central

Bakkour, Akram; Lewis-Peacock, Jarrod A.; Poldrack, Russell A.; Schonberg, Tom

2016-01-01

Biasing choices may prove a useful way to implement behavior change. Previous work has shown that a simple training task (the cue-approach task), which does not rely on external reinforcement, can robustly influence choice behavior by biasing choice toward items that were targeted during training. In the current study, we replicate previous behavioral findings and explore the neural mechanisms underlying the shift in preferences following cue-approach training. Given recent successes in the development and application of machine learning techniques to task-based fMRI data, which have advanced understanding of the neural substrates of cognition, we sought to leverage the power of these techniques to better understand neural changes during cue-approach training that subsequently led to a shift in choice behavior. Contrary to our expectations, we found that machine learning techniques applied to fMRI data during non-reinforced training were unsuccessful in elucidating the neural mechanism underlying the behavioral effect. However, univariate analyses during training revealed that the relationship between BOLD and choices for Go items increases as training progresses compared to choices of NoGo items primarily in lateral prefrontal cortical areas. This new imaging finding suggests that preferences are shifted via differential engagement of task control networks that interact with value networks during cue-approach training. PMID:27677231

Identification of a brain center whose activity discriminates a choice behavior in zebrafish

PubMed Central

Lau, Billy Y. B.; Mathur, Priya; Gould, Georgianna G.; Guo, Su

2011-01-01

The ability to make choices and carry out appropriate actions is critical for individual survival and well-being. Choice behaviors, from hard-wired to experience-dependent, have been observed across the animal kingdom. Although differential engagement of sensory neuronal pathways is a known mechanism, neurobiological substrates in the brain that underlie choice making downstream of sensory perception are not well understood. Here, we report a behavioral paradigm in zebrafish in which a half-light/half-dark visual image evokes an innate choice behavior, light avoidance. Neuronal activity mapping using the immediate early gene c-fos reveals the engagement of distinct brain regions, including the medial zone of the dorsal telencephalic region (Dm) and the dorsal nucleus of the ventral telencephalic area (Vd), the teleost anatomical homologs of the mammalian amygdala and striatum, respectively. In animals that were subjected to the identical sensory stimulus but displayed little or no avoidance, strikingly, the Dm and Vd were not engaged, despite similar levels of activation in the brain nuclei involved in visual processing. Based on these findings and previous connectivity data, we propose a neural circuitry model in which the Dm serves as a brain center, the activity of which predicates this choice behavior in zebrafish. PMID:21262817

Thirst-dependent risk preferences in monkeys identify a primitive form of wealth

PubMed Central

Yamada, Hiroshi; Tymula, Agnieszka; Louie, Kenway; Glimcher, Paul W.

2013-01-01

Experimental economic techniques have been widely used to evaluate human risk attitudes, but how these measured attitudes relate to overall individual wealth levels is unclear. Previous noneconomic work has addressed this uncertainty in animals by asking the following: (i) Do our close evolutionary relatives share both our risk attitudes and our degree of economic rationality? And (ii) how does the amount of food or water one holds (a nonpecuniary form of “wealth”) alter risk attitudes in these choosers? Unfortunately, existing noneconomic studies have provided conflicting insights from an economic point of view. We therefore used standard techniques from human experimental economics to measure monkey risk attitudes for water rewards as a function of blood osmolality (an objective measure of how much water the subjects possess). Early in training, monkeys behaved randomly, consistently violating first-order stochastic dominance and monotonicity. After training, they behaved like human choosers—technically consistent in their choices and weakly risk averse (i.e., risk averse or risk neutral on average)—suggesting that well-trained monkeys can serve as a model for human choice behavior. As with attitudes about money in humans, these risk attitudes were strongly wealth dependent; as the animals became “poorer,” risk aversion increased, a finding incompatible with some models of wealth and risk in human decision making. PMID:24019461

Orangutans (Pongo spp.) do not spontaneously share benefits with familiar conspecifics in a choice paradigm.

PubMed

Kim, Yena; Martinez, Laura; Choe, Jae Chun; Lee, Dal-Ju; Tomonaga, Masaki

2015-04-01

Humans are thought to be unique in their ability to help others voluntarily even though it may sometimes incur substantial costs. However, there are a growing number of studies showing that prosocial behaviors can be observed, not only in humans, but also among nonhuman primates that live in complex social groups. Prosociality has often been described as a major factor that facilitates group living. Nonetheless, it has seldom been explored whether solitary living primates, such as orangutans, share this propensity. In the present study, we tested four captive orangutans (Pongo abelii × pigmaeus, Pongo pigmaeus) in a simple food-delivering task. They had a choice, incurring the same cost, between getting a food reward for themselves and providing an additional food reward to a conspecific recipient passively sitting in an adjacent booth. Two orangutans played the actor's role, and two orangutans participated as recipients. The results showed that the actors did not choose to deliver food to the recipients more often than expected by chance (51.3 % on average). The control condition demonstrated that this tendency was independent of the actor's understanding of the task. These findings suggest that orangutans do not spontaneously share benefits with other conspecifics, even when the prosocial choice does not disadvantage them. This study gives the first experimental evidence that socially housed captive orangutans do not behave prosocially in a choice paradigm experiment. Further studies using a different experimental paradigm should be conducted to examine whether this tendency is consistent with previous findings hypothesizing that the enhanced prosocial propensity shown in humans and other group living primates is an evolutionary outcome of living in complex social environments.

Model for understanding consumer textural food choice

PubMed Central

Jeltema, Melissa; Beckley, Jacqueline; Vahalik, Jennifer

2015-01-01

The current paradigm for developing products that will match the marketing messaging is flawed because the drivers of product choice and satisfaction based on texture are misunderstood. Qualitative research across 10 years has led to the thesis explored in this research that individuals have a preferred way to manipulate food in their mouths (i.e., mouth behavior) and that this behavior is a major driver of food choice, satisfaction, and the desire to repurchase. Texture, which is currently thought to be a major driver of product choice, is a secondary factor, and is important only in that it supports the primary driver—mouth behavior. A model for mouth behavior is proposed and the qualitative research supporting the identification of different mouth behaviors is presented. The development of a trademarked typing tool for characterizing mouth behavior is described along with quantitative substantiation of the tool's ability to group individuals by mouth behavior. The use of these four groups to understand textural preferences and the implications for a variety of areas including product design and weight management are explored. PMID:25987995

Model for understanding consumer textural food choice.

PubMed

Jeltema, Melissa; Beckley, Jacqueline; Vahalik, Jennifer

2015-05-01

The current paradigm for developing products that will match the marketing messaging is flawed because the drivers of product choice and satisfaction based on texture are misunderstood. Qualitative research across 10 years has led to the thesis explored in this research that individuals have a preferred way to manipulate food in their mouths (i.e., mouth behavior) and that this behavior is a major driver of food choice, satisfaction, and the desire to repurchase. Texture, which is currently thought to be a major driver of product choice, is a secondary factor, and is important only in that it supports the primary driver-mouth behavior. A model for mouth behavior is proposed and the qualitative research supporting the identification of different mouth behaviors is presented. The development of a trademarked typing tool for characterizing mouth behavior is described along with quantitative substantiation of the tool's ability to group individuals by mouth behavior. The use of these four groups to understand textural preferences and the implications for a variety of areas including product design and weight management are explored.

Supermarket Choice, Shopping Behavior, Socioeconomic Status, and Food Purchases

PubMed Central

Pechey, Rachel; Monsivais, Pablo

2015-01-01

Introduction Both SES and supermarket choice have been associated with diet quality. This study aimed to assess the contributions of supermarket choice and shopping behaviors to the healthfulness of purchases and social patterning in purchases. Methods Observational panel data on purchases of fruit and vegetables and less-healthy foods/beverages from 2010 were obtained for 24,879 households, stratified by occupational social class (analyzed in 2014). Households’ supermarket choice was determined by whether they ever visited market-defined high- or low-price supermarkets. Analyses also explored extent of use within supermarket choice groups. Shopping behaviors included trip frequency, trip size, and number of store chains visited. Results Households using low-price (and not high-price) supermarkets purchased significantly lower percentages of energy from fruit and vegetables and higher percentages of energy from less-healthy foods/beverages than households using high-price (and not low-price) supermarkets. When controlling for SES and shopping behaviors, the effect of supermarket choice was reduced but remained significant for both fruit and vegetables and less-healthy foods/beverages. The extent of use of low- or high-price supermarkets had limited effects on outcomes. More-frequent trips and fewer small trips were associated with healthier purchasing for both outcomes; visiting more store chains was associated with higher percentages of energy from fruit and vegetables. Conclusions Although both supermarket choice and shopping behaviors are associated with healthfulness of purchases, neither appears to contribute to socioeconomic differences. Moreover, differences between supermarket environments may not be primary drivers of the relationship between supermarket choice and healthfulness of purchases. PMID:26163172

Increasing the Value of an Alternative Monetary Reinforcer Reduces Cigarette Choice in Adolescents.

PubMed

Cassidy, Rachel N; Tidey, Jennifer W; Kahler, Christopher W; Wray, Tyler B; Colby, Suzanne M

2015-12-01

Smoking can be conceptualized as an operant behavior maintained by the reinforcing effects of cigarettes. Changing the magnitude and availability of alternative reinforcers should shift behavior away from smoking. Adults' smoking behavior is sensitive to the magnitude and availability of alternative reinforcers; however, the extent to which the same is true for adolescents has not yet been shown in the laboratory. To test the sensitivity of adolescent smoking behavior to changes in the magnitude of alternative reinforcement, we gave adolescents who abstained overnight the opportunity to make 20 choices between receiving two puffs of their usual-brand cigarette or money. The magnitude of the monetary reinforcer was varied across sessions in counterbalanced order ($0.00, $0.10, and $0.50). Results indicated that adolescents' choices for puffs decreased as a function of increasing monetary reinforcer magnitude, while money choices increased. This effect was moderated by baseline smoking level and by gender, such that heavier-smoking participants and males made more cigarette choices when the alternative monetary value was zero, and decreased their choices more steeply in response to increasing monetary value. The current study validates a laboratory choice procedure for studying smoking in adolescents, and demonstrates that adolescent smoking behavior is sensitive to changes in the magnitude of concurrently available monetary reinforcers. The current paradigm can be adapted and applied to explore the effects of other variables that may affect cigarette choice in adolescents. © The Author 2015. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Supermarket Choice, Shopping Behavior, Socioeconomic Status, and Food Purchases.

PubMed

Pechey, Rachel; Monsivais, Pablo

2015-12-01

Both SES and supermarket choice have been associated with diet quality. This study aimed to assess the contributions of supermarket choice and shopping behaviors to the healthfulness of purchases and social patterning in purchases. Observational panel data on purchases of fruit and vegetables and less-healthy foods/beverages from 2010 were obtained for 24,879 households, stratified by occupational social class (analyzed in 2014). Households' supermarket choice was determined by whether they ever visited market-defined high- or low-price supermarkets. Analyses also explored extent of use within supermarket choice groups. Shopping behaviors included trip frequency, trip size, and number of store chains visited. Households using low-price (and not high-price) supermarkets purchased significantly lower percentages of energy from fruit and vegetables and higher percentages of energy from less-healthy foods/beverages than households using high-price (and not low-price) supermarkets. When controlling for SES and shopping behaviors, the effect of supermarket choice was reduced but remained significant for both fruit and vegetables and less-healthy foods/beverages. The extent of use of low- or high-price supermarkets had limited effects on outcomes. More-frequent trips and fewer small trips were associated with healthier purchasing for both outcomes; visiting more store chains was associated with higher percentages of energy from fruit and vegetables. Although both supermarket choice and shopping behaviors are associated with healthfulness of purchases, neither appears to contribute to socioeconomic differences. Moreover, differences between supermarket environments may not be primary drivers of the relationship between supermarket choice and healthfulness of purchases. Copyright © 2015 American Journal of Preventive Medicine. Published by Elsevier Inc. All rights reserved.

Disruptive Behavior: An Empirical Evaluation of School Misconduct and Market Accountability. School Choice Issues in Depth

ERIC Educational Resources Information Center

Forster, Greg; Carr, Matthew

2007-01-01

Opponents of school choice argue that private schools are not "accountable" because they are not subject to detailed oversight by a regulatory bureaucracy. They claim private school employees can be expected to engage in abusive and criminal behavior more frequently. School choice supporters respond that parents hold private schools…

Multi-Stage Mental Process for Economic Choice in Capuchins

ERIC Educational Resources Information Center

Padoa-Schioppa, Camillo; Jandolo, Lucia; Visalberghi, Elisabetta

2006-01-01

We studied economic choice behavior in capuchin monkeys by offering them to choose between two different foods available in variable amounts. When monkeys selected between familiar foods, their choice patterns were well-described in terms of relative value of the two foods. A leading view in economics and biology is that such behavior results from…

The Role of Post-Visit Action Resources in Facilitating Meaningful Free-Choice Learning after a Zoo Visit

ERIC Educational Resources Information Center

Bueddefeld, Jill N. H.; Van Winkle, Christine M.

2018-01-01

Places like zoos, where free-choice learning is encouraged, are important for conveying climate change and sustainability issues to the public. Free-choice learning that targets environmentally focused sustainable behavior changes must be meaningful in order to encourage actual behavior change post-visit. However, visitors often fail to translate…

Neuroendocrine-Immune Circuits, Phenotypes, and Interactions

PubMed Central

Ashley, Noah T.; Demas, Gregory E.

2016-01-01

Multidirectional interactions among the immune, endocrine, and nervous systems have been demonstrated in humans and non-human animal models for many decades by the biomedical community, but ecological and evolutionary perspectives are lacking. Neuroendocrine-immune interactions can be conceptualized using a series of feedback loops, which culminate into distinct neuroendocrine-immune phenotypes. Behavior can exert profound influences on these phenotypes, which can in turn reciprocally modulate behavior. For example, the behavioral aspects of reproduction, including courtship, aggression, mate selection and parental behaviors can impinge upon neuroendocrine-immune interactions. One classic example is the immunocompetence handicap hypothesis (ICHH), which proposes that steroid hormones act as mediators of traits important for female choice while suppressing the immune system. Reciprocally, neuroendocrine-immune pathways can promote the development of altered behavioral states, such as sickness behavior. Understanding the energetic signals that mediate neuroendocrine-immune crosstalk is an active area of research. Although the field of psychoneuroimmunology (PNI) has begun to explore this crosstalk from a biomedical standpoint, the neuroendocrine-immune-behavior nexus has been relatively underappreciated in comparative species. The field of ecoimmunology, while traditionally emphasizing the study of non-model systems from an ecological evolutionary perspective, often under natural conditions, has focused less on the physiological mechanisms underlying behavioral responses. This review summarizes neuroendocrine-immune interactions using a comparative framework to understand the ecological and evolutionary forces that shape these complex physiological interactions. PMID:27765499

Neuroendocrine-immune circuits, phenotypes, and interactions.

PubMed

Ashley, Noah T; Demas, Gregory E

2017-01-01

Multidirectional interactions among the immune, endocrine, and nervous systems have been demonstrated in humans and non-human animal models for many decades by the biomedical community, but ecological and evolutionary perspectives are lacking. Neuroendocrine-immune interactions can be conceptualized using a series of feedback loops, which culminate into distinct neuroendocrine-immune phenotypes. Behavior can exert profound influences on these phenotypes, which can in turn reciprocally modulate behavior. For example, the behavioral aspects of reproduction, including courtship, aggression, mate selection and parental behaviors can impinge upon neuroendocrine-immune interactions. One classic example is the immunocompetence handicap hypothesis (ICHH), which proposes that steroid hormones act as mediators of traits important for female choice while suppressing the immune system. Reciprocally, neuroendocrine-immune pathways can promote the development of altered behavioral states, such as sickness behavior. Understanding the energetic signals that mediate neuroendocrine-immune crosstalk is an active area of research. Although the field of psychoneuroimmunology (PNI) has begun to explore this crosstalk from a biomedical standpoint, the neuroendocrine-immune-behavior nexus has been relatively underappreciated in comparative species. The field of ecoimmunology, while traditionally emphasizing the study of non-model systems from an ecological evolutionary perspective, often under natural conditions, has focused less on the physiological mechanisms underlying behavioral responses. This review summarizes neuroendocrine-immune interactions using a comparative framework to understand the ecological and evolutionary forces that shape these complex physiological interactions. Copyright © 2016 Elsevier Inc. All rights reserved.

Rethinking Reinforcement: Allocation, Induction, and Contingency

ERIC Educational Resources Information Center

Baum, William M.

2012-01-01

The concept of reinforcement is at least incomplete and almost certainly incorrect. An alternative way of organizing our understanding of behavior may be built around three concepts: "allocation," "induction," and "correlation." Allocation is the measure of behavior and captures the centrality of choice: All behavior entails choice and consists of…

Cognitive Control Predicts Use of Model-Based Reinforcement-Learning

PubMed Central

Otto, A. Ross; Skatova, Anya; Madlon-Kay, Seth; Daw, Nathaniel D.

2015-01-01

Accounts of decision-making and its neural substrates have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental work suggest that this classic distinction between behaviorally and neurally dissociable systems for habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning (RL), called model-free and model-based RL, but the cognitive or computational processes by which one system may dominate over the other in the control of behavior is a matter of ongoing investigation. To elucidate this question, we leverage the theoretical framework of cognitive control, demonstrating that individual differences in utilization of goal-related contextual information—in the service of overcoming habitual, stimulus-driven responses—in established cognitive control paradigms predict model-based behavior in a separate, sequential choice task. The behavioral correspondence between cognitive control and model-based RL compellingly suggests that a common set of processes may underpin the two behaviors. In particular, computational mechanisms originally proposed to underlie controlled behavior may be applicable to understanding the interactions between model-based and model-free choice behavior. PMID:25170791

A cluster randomized controlled trial of strategies to increase adolescents' physical activity and motivation in physical education: results of the Motivating Active Learning in Physical Education (MALP) trial.

PubMed

Lonsdale, Chris; Rosenkranz, Richard R; Sanders, Taren; Peralta, Louisa R; Bennie, Andrew; Jackson, Ben; Taylor, Ian M; Lubans, David R

2013-11-01

Physical education (PE) programs aim to promote physical activity (PA) and reach most school-aged youth. However, PA levels within PE lessons are often low. In this cluster-randomized controlled trial, we examined the effects of three self-determination theory-based motivational strategies on PA and sedentary behavior, as well as their hypothesized antecedents during PE lessons. Data were collected in Sydney, Australia (October-December 2011). After baseline testing, teachers (n=16) and their classes (n=288 students; M=13.6 years, 50.4% male) were randomly assigned to one of four teaching strategy conditions: (1) explaining relevance; (2) providing choice; (3) complete free choice; or (4) usual practice. Teachers then delivered the assigned strategy. Primary outcomes were accelerometer-assessed PA and student motivation during lessons. Secondary outcomes included sedentary behavior, perceptions of teachers' support and psychological needs satisfaction. The 'free choice' intervention increased PA (p<.05). 'Providing choice' and 'free choice' interventions decreased sedentary behavior (p<.05). The interventions did not influence motivation, but students' autonomy increased during both choice-based interventions (p<.05). Promoting choice can produce short-term increases in PA and decreases in sedentary behavior, as well as increased perceived autonomy during PE lessons. © 2013.

Economic rationality in choosing between short-term bad-health choices and longer-term good-health choices.

PubMed

Campbell, David

2013-11-08

Non-contagious, chronic disease has been identified as a global health risk. Poor lifestyle choices, such as smoking, alcohol, drug and solvent abuse, physical inactivity, and unhealthy diet have been identified as important factors affecting the increasing incidence of chronic disease. The following focuses on the circumstance affecting the lifestyle or behavioral choices of Aboriginal and Torres Strait Islander peoples in remote-/very remote Australia. Poor behavioral choices are the result of endogenous characteristics that are influenced by a range of stressful exogenous variables making up the psychosocial determinants including social disenfranchisement, cultural loss, insurmountable tasks, the loss of volitional control and resource constraints. It is shown that poor behavioral choices can be economically rational; especially under highly stressful conditions. Stressful circumstances erode individual capacity to commit to long-term positive health alternatives such as self-investment in education. Policies directed at removing the impediments and providing incentives to behaviors involving better health choices can lead to reductions in smoking and alcohol consumption and improved health outcomes. Multijurisdictional culturally acceptable policies directed at distal variables relating to the psychosocial determinants of health and personal mastery and control can be cost effective. While the content of this paper is focused on the conditions of colonized peoples, it has broader relevance.

Importance of the habitat choice behavior assumed when modeling the effects of food and temperature on fish populations

USGS Publications Warehouse

Wildhaber, Mark L.; Lamberson, Peter J.

2004-01-01

Various mechanisms of habitat choice in fishes based on food and/or temperature have been proposed: optimal foraging for food alone; behavioral thermoregulation for temperature alone; and behavioral energetics and discounted matching for food and temperature combined. Along with development of habitat choice mechanisms, there has been a major push to develop and apply to fish populations individual-based models that incorporate various forms of these mechanisms. However, it is not known how the wide variation in observed and hypothesized mechanisms of fish habitat choice could alter fish population predictions (e.g. growth, size distributions, etc.). We used spatially explicit, individual-based modeling to compare predicted fish populations using different submodels of patch choice behavior under various food and temperature distributions. We compared predicted growth, temperature experience, food consumption, and final spatial distribution using the different models. Our results demonstrated that the habitat choice mechanism assumed in fish population modeling simulations was critical to predictions of fish distribution and growth rates. Hence, resource managers who use modeling results to predict fish population trends should be very aware of and understand the underlying patch choice mechanisms used in their models to assure that those mechanisms correctly represent the fish populations being modeled.

"Choice Set" for health behavior in choice-constrained settings to frame research and inform policy: examples of food consumption, obesity and food security.

PubMed

Dover, Robert V H; Lambert, Estelle V

2016-03-16

Using the nexus between food consumption, food security and obesity, this paper addresses the complexity of health behavior decision-making moments that reflect relational social dynamics in context-specific dialogues, often in choice-constrained conditions. A pragmatic review of literature regarding social determinants of health in relation to food consumption, food security and obesity was used to advance this theoretical model. We suggest that health choice, such as food consumption, is based on more than the capacity and volition of individuals to make "healthy" choices, but is dialogic and adaptive. In terms of food consumption, there will always be choice-constrained conditions, along a continuum representing factors over which the individual has little or no control, to those for which they have greater agency. These range from food store geographies and inventories and food availability, logistical considerations such as transportation, food distribution, the structure of equity in food systems, state and non-government food and nutrition programs, to factors where the individual exercises a greater degree of autonomy, such as sociocultural foodways, family and neighborhood shopping strategies, and personal and family food preferences. At any given food decision-making moment, many factors of the continuum are present consciously or unconsciously when the individual makes a decision. These health behavior decision-making moments are mutable, whether from an individual perspective, or within a broader social or policy context. We review the construct of "choice set", the confluence of factors that are temporally weighted by the differentiated and relationally-contextualized importance of certain factors over others in that moment. The choice transition represents an essential shift of the choice set based on the conscious and unconscious weighting of accumulated evidence, such that people can project certain outcomes. Policies and interventions should avoid dichotomies of "good and bad" food choices or health behaviors, but focus on those issues that contribute to the weightedness of factors influencing food choice behavior at a given decision-making moment and within a given choice set.

Moving beyond a knowledge deficit perspective to understand climate action by youth

NASA Astrophysics Data System (ADS)

Busch, K. C.

2016-12-01

This presentation reports on an experiment testing two framings of uncertainty on students' intent to take action to mitigate climate change. Additionally, to explore possible mechanisms involved in the choice of taking mitigating action, several factors highlighted within behavior theory literature were measured to create a theoretical model for youth's choice to take mitigating action. The factors explored were: knowledge, certainty, affect, efficacy, and social norms. The experiment was conducted with 453 middle and high school students within the Bay Area. Findings indicated that these students did hold a basic understanding of the causes and effects of climate change. They were worried and felt negatively about the topic. They felt somewhat efficacious about their personal ability to mitigate climate change. The students reported that they associated with people who were more likely to think climate change was real and caused by humans. Students also reported that they often take part in private pro-environmental behaviors such as using less electricity. When asked to respond freely to a question about what think about climate change, participants described the negative effects of human-caused climate change on Earth systems at the global scale and as a current phenomenon. The results of the experiment showed that while the text portraying climate change with high uncertainty did affect student's own certainty and their perception of scientists' certainty, it did not affect behavioral intention. This result can be explained through regression analysis. It was found that efficacy and social norms were direct determinants of pro-environmental behaviors. The cognitive variables - knowledge and certainty - and the psychological variable - affect - were not significant predictors of pro-environmental behavior. The implications for this study are that while students hold basic understanding of the causes and effects of climate change, this understanding lacks personal relevance. Another implication of this study is that if we wish to have action-taking as an outcome of climate change education efforts, then the learning activities should include components to address efficacy and social norms.

[Neurobiological determinism: questionable inferences on human freedom of choice and forensic criminal responsibility].

PubMed

Urbaniok, F; Hardegger, J; Rossegger, A; Endrass, J

2006-08-01

Several authors argue that criminal behavior is generally caused by neurobiological deficits. Based on this neurobiological perspective of assumed causality, the concept of free will is questioned, and the theory of neurobiological determinism of all human behavior is put forward, thus maintaining that human beings are not responsible for their actions, and consequently the principle of guilt should be given up in criminal law. In this context the controversial debate on determinism and indeterminism, which has been held for centuries, has flared up anew, especially within the science of criminal law. When critically examining the current state of research, it becomes apparent that the results do not support the existence of a universally valid neurobiological causality of criminal behavior, nor a theory of an absolute neurobiological determinism. Neither is complete determination of all phenomena in the universe--as maintained--the logical conclusion of the principle of causality, nor is it empirically confirmed. Analyzed methodically, it cannot be falsified, and thus, as a theory which cannot be empirically tested, it represents a dogma against which plausible objections can be made. The criticism of the concept of free will, and even more so of human accountability and criminal responsibility, is not put forward in a valid way. The principle of relative determinism--the evaluation of the degree of determinism of personality factors potentially reducing criminal responsibility, which includes concrete observations and analysis of behavior--thus remains a central and cogent approach to the assessment of criminal responsibility. To sum up, the theories proposed by some authors on the complete neurobiological determinism of human behavior, and the subsequent impossibility of individual responsibility and guilt, reveal both methodical misconception and a lack of empirical foundation.

Dissociation between Neural Signatures of Stimulus and Choice in Population Activity of Human V1 during Perceptual Decision-Making

PubMed Central

Choe, Kyoung Whan; Blake, Randolph

2014-01-01

Primary visual cortex (V1) forms the initial cortical representation of objects and events in our visual environment, and it distributes information about that representation to higher cortical areas within the visual hierarchy. Decades of work have established tight linkages between neural activity occurring in V1 and features comprising the retinal image, but it remains debatable how that activity relates to perceptual decisions. An actively debated question is the extent to which V1 responses determine, on a trial-by-trial basis, perceptual choices made by observers. By inspecting the population activity of V1 from human observers engaged in a difficult visual discrimination task, we tested one essential prediction of the deterministic view: choice-related activity, if it exists in V1, and stimulus-related activity should occur in the same neural ensemble of neurons at the same time. Our findings do not support this prediction: while cortical activity signifying the variability in choice behavior was indeed found in V1, that activity was dissociated from activity representing stimulus differences relevant to the task, being advanced in time and carried by a different neural ensemble. The spatiotemporal dynamics of population responses suggest that short-term priors, perhaps formed in higher cortical areas involved in perceptual inference, act to modulate V1 activity prior to stimulus onset without modifying subsequent activity that actually represents stimulus features within V1. PMID:24523561

Testing a bioenergetics-based habitat choice model: bluegill (Lepomis macrochirus) responses to food availability and temperature

USGS Publications Warehouse

2011-01-01

Using an automated shuttlebox system, we conducted patch choice experiments with 32, 8–12 g bluegill sunfish (Lepomis macrochirus) to test a behavioral energetics hypothesis of habitat choice. When patch temperature and food levels were held constant within patches but different between patches, we expected bluegill to choose patches that maximized growth based on the bioenergetic integration of food and temperature as predicted by a bioenergetics model. Alternative hypotheses were that bluegill may choose patches based only on food (optimal foraging) or temperature (behavioral thermoregulation). The behavioral energetics hypothesis was not a good predictor of short-term (from minutes to weeks) patch choice by bluegill; the behavioral thermoregulation hypothesis was the best predictor. In the short-term, food and temperature appeared to affect patch choice hierarchically; temperature was more important, although food can alter temperature preference during feeding periods. Over a 19-d experiment, mean temperatures occupied by fish offered low rations did decline as predicted by the behavioral energetics hypothesis, but the decline was less than 1.0 °C as opposed to a possible 5 °C decline. A short-term, bioenergetic response to food and temperature may be precluded by physiological costs of acclimation not considered explicitly in the behavioral energetics hypothesis.

An immersive virtual peer for studying social influences on child cyclists' road-crossing behavior.

PubMed

Babu, Sabarish V; Grechkin, Timofey Y; Chihak, Benjamin; Ziemer, Christine; Kearney, Joseph K; Cremer, James F; Plumert, Jodie M

2011-01-01

The goal of our work is to develop a programmatically controlled peer to bicycle with a human subject for the purpose of studying how social interactions influence road-crossing behavior. The peer is controlled through a combination of reactive controllers that determine the gross motion of the virtual bicycle, action-based controllers that animate the virtual bicyclist and generate verbal behaviors, and a keyboard interface that allows an experimenter to initiate the virtual bicyclist's actions during the course of an experiment. The virtual bicyclist's repertoire of behaviors includes road following, riding alongside the human rider, stopping at intersections, and crossing intersections through specified gaps in traffic. The virtual cyclist engages the human subject through gaze, gesture, and verbal interactions. We describe the structure of the behavior code and report the results of a study examining how 10- and 12-year-old children interact with a peer cyclist that makes either risky or safe choices in selecting gaps in traffic. Results of our study revealed that children who rode with a risky peer were more likely to cross intermediate-sized gaps than children who rode with a safe peer. In addition, children were significantly less likely to stop at the last six intersections after the experience of riding with the risky than the safe peer during the first six intersections. The results of the study and children's reactions to the virtual peer indicate that our virtual peer framework is a promising platform for future behavioral studies of peer influences on children's bicycle riding behavior. © 2011 IEEE Published by the IEEE Computer Society

Social Identity and Preferences*

PubMed Central

Benjamin, Daniel J.; Choi, James J.; Strickland, A. Joshua

2009-01-01

Social identities prescribe behaviors for people. We identify the marginal behavioral effect of these norms on discount rates and risk aversion by measuring how laboratory subjects’ choices change when an aspect of social identity is made salient. When we make ethnic identity salient to Asian-American subjects, they make more patient choices. When we make racial identity salient to black subjects, non-immigrant blacks (but not immigrant blacks) make more patient choices. Making gender identity salient has no effect on intertemporal or risk choices. PMID:20871741

Trajectory-adaptive route choice models : specification, choice set generation, and estimation.

DOT National Transportation Integrated Search

2013-03-01

The objective of the research is to investigate adaptive route choice behavior using individuallevel route choice data from GPS (Global Positioning System) observations in a real-life : network, where a traveler could revise the route choice based up...

The Effects of the Previous Outcome on Probabilistic Choice in Rats

PubMed Central

Marshall, Andrew T.; Kirkpatrick, Kimberly

2014-01-01

This study examined the effects of previous outcomes on subsequent choices in a probabilistic-choice task. Twenty-four rats were trained to choose between a certain outcome (1 or 3 pellets) versus an uncertain outcome (3 or 9 pellets), delivered with a probability of .1, .33, .67, and .9 in different phases. Uncertain outcome choices increased with the probability of uncertain food. Additionally, uncertain choices increased with the probability of uncertain food following both certain-choice outcomes and unrewarded uncertain choices. However, following uncertain-choice food outcomes, there was a tendency to choose the uncertain outcome in all cases, indicating that the rats continued to “gamble” after successful uncertain choices, regardless of the overall probability or magnitude of food. A subsequent manipulation, in which the probability of uncertain food varied within each session as a function of the previous uncertain outcome, examined how the previous outcome and probability of uncertain food affected choice in a dynamic environment. Uncertain-choice behavior increased with the probability of uncertain food. The rats exhibited increased sensitivity to probability changes and a greater degree of win–stay/lose–shift behavior than in the static phase. Simulations of two sequential choice models were performed to explore the possible mechanisms of reward value computations. The simulation results supported an exponentially decaying value function that updated as a function of trial (rather than time). These results emphasize the importance of analyzing global and local factors in choice behavior and suggest avenues for the future development of sequential-choice models. PMID:23205915

Prosocial Choice in Rats Depends on Food-Seeking Behavior Displayed by Recipients.

PubMed

Márquez, Cristina; Rennie, Scott M; Costa, Diana F; Moita, Marta A

2015-06-29

Animals often are prosocial, displaying behaviors that result in a benefit to one another [1-15] even in the absence of self-benefit [16-21] (but see [22-25]). Several factors have been proposed to modulate these behaviors, namely familiarity [6, 13, 18, 20] or display of seeking behavior [16, 21]. Rats have been recently shown to be prosocial under distress [17, 18] (but see [26-29]); however, what drives prosociality in these animals remains unclear. To address this issue, we developed a two-choice task in which prosocial behavior did not yield a benefit or a cost to the focal rat. We used a double T-maze in which only the focal rat controlled access to the food-baited arms of its own and the recipient rat's maze. In this task, the focal rat could choose between one side of the maze, which yielded food only to itself (selfish choice), and the opposite side, which yielded food to itself and the recipient rat (prosocial choice). Rats showed a high proportion of prosocial choices. By manipulating reward delivery to the recipient and its ability to display a preference for the baited arm, we found that the display of food-seeking behavior leading to reward was necessary to drive prosocial choices. In addition, we found that there was more social investigation between rats in selfish trials than in prosocial trials, which may have influenced the focals' choices. This study shows that rats provide access to food to others in the absence of added direct self-benefit, bringing new insights into the factors that drive prosociality. Copyright © 2015 Elsevier Ltd. All rights reserved.

Impulsive choice behavior in four strains of rats: Evaluation of possible models of Attention Deficit/Hyperactivity Disorder

PubMed Central

Garcia, Ana; Kirkpatrick, Kimberly

2012-01-01

Several studies have examined impulsive choice behavior in spontaneously hypertensive rats (SHRs) as a possible pre-clinical model for Attention-Deficit/Hyperactivity Disorder (ADHD). However, this strain was not specifically selected for the traits of ADHD and as a result their appropriateness as a model has been questioned. The present study investigated whether SHRs would exhibit impulsive behavior in comparison to their control strain, Wistar Kyoto (WKY) rats. In addition, we evaluated a strain that has previously shown high levels of impulsive choice, the Lewis (LEW) rats and compared them with their source strain, Wistar (WIS) rats. In the first phase, rats could choose between a Smaller-sooner (SS) reward of 1 pellet after 10 s and a Larger-later (LL) reward of 2 pellets after 30 s. Subsequently, the rats were exposed to increases in LL reward magnitude and SS delay. These manipulations were designed to assess sensitivity to magnitude and delay within the choice task to parse out possible differences in using the strains as models of specific deficits associated with ADHD. The SHR and WKY strains did not differ in their choice behavior under either delay or magnitude manipulations. In comparison to WIS, LEW showed deficits in choice behavior in the delay manipulation, and to a lesser extent in the magnitude manipulation. An examination of individual differences indicated that the SHR strain may not be sufficiently homogeneous in their impulsive choice behavior to be considered as a viable model for impulse control disorders such as ADHD. The LEW strain may be worthy of further consideration for their suitability as an animal model. PMID:23085479

Can I Choose to Have Grit? Non-Cognitive Skills, Behavior, and School Choice

ERIC Educational Resources Information Center

Nichols, Malachi

2017-01-01

With the introduction of school choice as a viable option of school reform, researchers have begun to look beyond academic achievement to the effects of choice on alternative outcomes. Recently, non-cognitive skills and behavior stand at the front of those alternative outcomes. From the most up to date relevant literature it appears that school…

Quantitative prediction of perceptual decisions during near-threshold fear detection

NASA Astrophysics Data System (ADS)

Pessoa, Luiz; Padmala, Srikanth

2005-04-01

A fundamental goal of cognitive neuroscience is to explain how mental decisions originate from basic neural mechanisms. The goal of the present study was to investigate the neural correlates of perceptual decisions in the context of emotional perception. To probe this question, we investigated how fluctuations in functional MRI (fMRI) signals were correlated with behavioral choice during a near-threshold fear detection task. fMRI signals predicted behavioral choice independently of stimulus properties and task accuracy in a network of brain regions linked to emotional processing: posterior cingulate cortex, medial prefrontal cortex, right inferior frontal gyrus, and left insula. We quantified the link between fMRI signals and behavioral choice in a whole-brain analysis by determining choice probabilities by means of signal-detection theory methods. Our results demonstrate that voxel-wise fMRI signals can reliably predict behavioral choice in a quantitative fashion (choice probabilities ranged from 0.63 to 0.78) at levels comparable to neuronal data. We suggest that the conscious decision that a fearful face has been seen is represented across a network of interconnected brain regions that prepare the organism to appropriately handle emotionally challenging stimuli and that regulate the associated emotional response. decision making | emotion | functional MRI

Distinguishing the affective and cognitive bases of implicit attitudes to improve prediction of food choices.

PubMed

Trendel, Olivier; Werle, Carolina O C

2016-09-01

Eating behaviors largely result from automatic processes. Yet, in existing research, automatic or implicit attitudes toward food often fail to predict eating behaviors. Applying findings in cognitive neuroscience research, we propose and find that a central reason why implicit attitudes toward food are not good predictors of eating behaviors is that implicit attitudes are driven by two distinct constructs that often have diverging evaluative consequences: the automatic affective reactions to food (e.g., tastiness; the affective basis of implicit attitudes) and the automatic cognitive reactions to food (e.g., healthiness; the cognitive basis of implicit attitudes). More importantly, we find that the affective and cognitive bases of implicit attitudes directly and uniquely influence actual food choices under different conditions. While the affective basis of implicit attitude is the main driver of food choices, it is the only driver when cognitive resources during choice are limited. The cognitive basis of implicit attitudes uniquely influences food choices when cognitive resources during choice are plentiful but only for participants low in impulsivity. Researchers interested in automatic processes in eating behaviors could thus benefit by distinguishing between the affective and cognitive bases of implicit attitudes. Copyright © 2015 Elsevier Ltd. All rights reserved.

Global spatio-temporal patterns in human migration: a complex network perspective.

PubMed

Davis, Kyle F; D'Odorico, Paolo; Laio, Francesco; Ridolfi, Luca

2013-01-01

Migration is a powerful adaptive strategy for humans to navigate hardship and pursue a better quality of life. As a universal vehicle facilitating exchanges of ideas, culture, money and goods, international migration is a major contributor to globalization. Consisting of countries linked by multiple connections of human movements, global migration constitutes a network. Despite the important role of human migration in connecting various communities in different parts of the world, the topology and behavior of the international migration network and its changes through time remain poorly understood. Here we show that the global human migration network became more interconnected during the latter half of the twentieth century and that migrant destination choice partly reflects colonial and postcolonial histories, language, religion, and distances. From 1960 to 2000 we found a steady increase in network transitivity (i.e. connectivity between nodes connected to the same node), a decrease in average path length and an upward shift in degree distribution, all of which strengthened the 'small-world' behavior of the migration network. Furthermore, we found that distinct groups of countries preferentially interact to form migration communities based largely on historical, cultural and economic factors.

Lithium, but not Valproate, Reduces Impulsive Choice in the Delay-Discounting Task in Mice

PubMed Central

Halcomb, Meredith E; Gould, Todd D; Grahame, Nicholas J

2013-01-01

Both lithium and valproate are well-established treatments for bipolar disorder. Studies have also found that lithium is effective at reducing suicidal behaviors in patients with mood disorders. Impulsivity is a validated endophenotype of both bipolar disorder and suicidal behavior. We assessed effects of treatment with lithium or valproate on cognitive impulsivity in selectively bred mice previously shown to manifest relatively high levels of cognitive impulsivity. Mice were trained in the delay-discounting paradigm, a measure of cognitive impulsivity reflecting a behavioral bias towards immediacy, and then treated with lithium, valproate, or control chow. After 3 weeks of drug treatment, mice were tested at various delays to a large, delayed reward. Drug treatment continued during this time. Lithium reduced impulsivity, whereas valproate had no effect on choice behavior. Both drugs increased the number of choice trials and reinforcer intake, but effects on choice behavior did not depend on these motivational changes. To our knowledge, this is the first study demonstrating lithium's effects to reduce cognitive impulsivity. Future studies may focus on the ability of putative pharmacotherapies for patients at risk for bipolar disorder or suicide to modify the impulsive choice dimension of this diseases. PMID:23584261

Distributions of observed death tolls govern sensitivity to human fatalities

PubMed Central

Olivola, Christopher Y.; Sagara, Namika

2009-01-01

How we react to humanitarian crises, epidemics, and other tragic events involving the loss of human lives depends largely on the extent to which we are moved by the size of their associated death tolls. Many studies have demonstrated that people generally exhibit a diminishing sensitivity to the number of human fatalities and, equivalently, a preference for risky (vs. sure) alternatives in decisions under risk involving human losses. However, the reason for this tendency remains unknown. Here we show that the distributions of event-related death tolls that people observe govern their evaluations of, and risk preferences concerning, human fatalities. In particular, we show that our diminishing sensitivity to human fatalities follows from the fact that these death tolls are approximately power-law distributed. We further show that, by manipulating the distribution of mortality-related events that people observe, we can alter their risk preferences in decisions involving fatalities. Finally, we show that the tendency to be risk-seeking in mortality-related decisions is lower in countries in which high-mortality events are more frequently observed. Our results support a model of magnitude evaluation based on memory sampling and relative judgment. This model departs from the utility-based approaches typically encountered in psychology and economics in that it does not rely on stable, underlying value representations to explain valuation and choice, or on choice behavior to derive value functions. Instead, preferences concerning human fatalities emerge spontaneously from the distributions of sampled events and the relative nature of the evaluation process. PMID:20018778

A role for the striatum in regret-related choice repetition

PubMed Central

Nicolle, Antoinette; Bach, Dominik R.; Driver, Jon; Dolan, Raymond J.

2011-01-01

‘Regret aversion’ is proposed to explain a tendency to avoid future choices that have induced past regret. However, regret might also motivate us to repeat previous regret-related choices to make up for their previous selection, a behavior resembling ‘chasing’ in the context of gambling. In the current experiment we acquired fMRI brain data while participants placed monetary bets on repeated gambles. Behaviorally, participants showed a tendency to repeat previously regret-related choices (operationalized as those leading to an outcome worse than what might have been), an effect restricted to early runs of the task. At gamble outcome, we show a reduction in ventral striatal activity for regret-related, relative to relief-related, outcomes. Critically, this modulation was only seen when subjects were responsible for the bet choice. Activity in dorsal striatum was associated with an influence of previous regret on participants’ subsequent choices, evident in increased activity when regret-related choices were repeated, relative to avoided, on the next trial. Our findings indicate that regret can lead to choice repetition as if seeking to make up for our mistakes and in so doing may lead to subsequent chasing behavior. PMID:20433245

Reward-Guided Learning with and without Causal Attribution

PubMed Central

Jocham, Gerhard; Brodersen, Kay H.; Constantinescu, Alexandra O.; Kahn, Martin C.; Ianni, Angela M.; Walton, Mark E.; Rushworth, Matthew F.S.; Behrens, Timothy E.J.

2016-01-01

Summary When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that humans deploy separable learning mechanisms that operate in parallel. While behavior was dominated by precise contingent learning, it also revealed hallmarks of noncontingent learning strategies. These learning mechanisms were separable behaviorally and neurally. Lateral orbitofrontal cortex supported contingent learning and reflected contingencies between outcomes and their causal choices. Amygdala responses around reward times related to statistical patterns of learning. Time-based heuristic mechanisms were related to activity in sensorimotor corticostriatal circuitry. Our data point to the existence of several learning mechanisms in the human brain, of which only one relies on applying known rules about the causal structure of the task. PMID:26971947

Using the Multiple Choice Procedure to Measure College Student Gambling

ERIC Educational Resources Information Center

Butler, Leon Harvey

2010-01-01

Research suggests that gambling is similar to addictive behaviors such as substance use. In the current study, gambling was investigated from a behavioral economics perspective. The Multiple Choice Procedure (MCP) with gambling as the target behavior was used to assess for relative reinforcing value, the effect of alternative reinforcers, and…

Pedestrian Choice Behavior at Shopping Mall Intersections in China and the United States

ERIC Educational Resources Information Center

Bitgood, Stephen; Davey, Gareth; Huang, Xiaoyi; Fung, Holly

2013-01-01

Pedestrian navigation through public spaces reflects the nature of interaction between behavior and environment. This study compared pedestrian choice behavior at shopping mall intersections in China and the United States. The study found that in both countries (a) pedestrians chose movement patterns that involved the fewest steps and (b) there…

Correlating Glasser's Choice Theory to the Behavioral Requirements of IDEA 97.

ERIC Educational Resources Information Center

Mishler, James A.; Cherry, Scott

This paper connects the philosophical basis of Glasser's Choice Theory/Reality Therapy to the Functional Assessments of Behavior (FAB) required by the Individuals with Disabilities Education Act (IDEA). The 1997 reauthorization of IDEA states that before a school can place a student with emotional or behavioral difficulties into an alternative…

Neural Basis of Empathy and Its Dysfunction in Autism Spectrum Disorders (ASD)

DTIC Science & Technology

2012-08-01

donation behavior in rhesus monkeys when there is no perceived cost to self. These findings potentially implicate shared neural mechanisms and validate the...egalitarian and monogamous ones, like prairie voles and humans, when there is no perceived cost to self. These findings potentially implicate shared neural...maximally self-regarding in this context in the absence of OT. Thus, OT robustly enhanced prosocial choices when there was no potential cost to self, but

A Model of Human Cognitive Behavior in Writing Code for Computer Programs. Volume 1

DTIC Science & Technology

1975-05-01

nearly all programming languages, each line of code actually involves a great many decisions - basic statement types, variable and expression choices...labels, etc. - and any heuristic which evaluates code on the basis of a single decision is not likely to have sufficient power. Only the use of plans...recalculated in the following line because It was needed again. The second reason is that there are some decisions about the structure of a program

Modeling Mode Choice Behavior Incorporating Household and Individual Sociodemographics and Travel Attributes Based on Rough Sets Theory

PubMed Central

Chen, Xuewu; Wei, Ming; Wu, Jingxian; Hou, Xianyao

2014-01-01

Most traditional mode choice models are based on the principle of random utility maximization derived from econometric theory. Alternatively, mode choice modeling can be regarded as a pattern recognition problem reflected from the explanatory variables of determining the choices between alternatives. The paper applies the knowledge discovery technique of rough sets theory to model travel mode choices incorporating household and individual sociodemographics and travel information, and to identify the significance of each attribute. The study uses the detailed travel diary survey data of Changxing county which contains information on both household and individual travel behaviors for model estimation and evaluation. The knowledge is presented in the form of easily understood IF-THEN statements or rules which reveal how each attribute influences mode choice behavior. These rules are then used to predict travel mode choices from information held about previously unseen individuals and the classification performance is assessed. The rough sets model shows high robustness and good predictive ability. The most significant condition attributes identified to determine travel mode choices are gender, distance, household annual income, and occupation. Comparative evaluation with the MNL model also proves that the rough sets model gives superior prediction accuracy and coverage on travel mode choice modeling. PMID:25431585

To Punish or to Leave: Distinct Cognitive Processes Underlie Partner Control and Partner Choice Behaviors

PubMed Central

Martin, Justin W.; Cushman, Fiery

2015-01-01

When a cooperative partner defects, at least two types of response are available: Punishment, aimed at modifying behavior, and ostracism, aimed at avoiding further social interaction with the partner. These options, termed partner control and partner choice, have been distinguished at behavioral and evolutionary levels. However, little work has compared their cognitive bases. Do these disparate behaviors depend on common processes of moral evaluation? Specifically, we assess whether they show identical patterns of dependence on two key dimensions of moral evaluation: A person’s intentions, and the outcomes that they cause. We address this issue in a “trembling hand” economic game. In this game, an allocator divides a monetary stake between themselves and a responder based on a stochastic mechanism. This allows for dissociations between the allocator’s intent and the actual outcome. Responders were either given the opportunity to punish or reward the allocator (partner control) or to switch to a different partner for a subsequent round of play (partner choice). Our results suggest that partner control and partner choice behaviors are supported by distinct underlying cognitive processes: Partner control exhibits greater sensitivity to the outcomes a partner causes, while partner choice is influenced almost exclusively by a partner’s intentions. This cognitive dissociation can be understood in light of the unique adaptive functions of partner control and partner choice. PMID:25915550

Dopamine, Effort-Based Choice, and Behavioral Economics: Basic and Translational Research

PubMed Central

Salamone, John D.; Correa, Merce; Yang, Jen-Hau; Rotolo, Renee; Presby, Rose

2018-01-01

Operant behavior is not only regulated by factors related to the quality or quantity of reinforcement, but also by the work requirements inherent in performing instrumental actions. Moreover, organisms often make effort-related decisions involving economic choices such as cost/benefit analyses. Effort-based decision making is studied using behavioral procedures that offer choices between high-effort options leading to relatively preferred reinforcers vs. low effort/low reward choices. Several neural systems, including the mesolimbic dopamine (DA) system and other brain circuits, are involved in regulating effort-related aspects of motivation. Considerable evidence indicates that mesolimbic DA transmission exerts a bi-directional control over exertion of effort on instrumental behavior tasks. Interference with DA transmission produces a low-effort bias in animals tested on effort-based choice tasks, while increasing DA transmission with drugs such as DA transport blockers tends to enhance selection of high-effort options. The results from these pharmacology studies are corroborated by the findings from recent articles using optogenetic, chemogenetic and physiological techniques. In addition to providing important information about the neural regulation of motivated behavior, effort-based choice tasks are useful for developing animal models of some of the motivational symptoms that are seen in people with various psychiatric and neurological disorders (e.g., depression, schizophrenia, Parkinson’s disease). Studies of effort-based decision making may ultimately contribute to the development of novel drug treatments for motivational dysfunction. PMID:29628879

Dopamine, Effort-Based Choice, and Behavioral Economics: Basic and Translational Research.

PubMed

Salamone, John D; Correa, Merce; Yang, Jen-Hau; Rotolo, Renee; Presby, Rose

2018-01-01

Operant behavior is not only regulated by factors related to the quality or quantity of reinforcement, but also by the work requirements inherent in performing instrumental actions. Moreover, organisms often make effort-related decisions involving economic choices such as cost/benefit analyses. Effort-based decision making is studied using behavioral procedures that offer choices between high-effort options leading to relatively preferred reinforcers vs. low effort/low reward choices. Several neural systems, including the mesolimbic dopamine (DA) system and other brain circuits, are involved in regulating effort-related aspects of motivation. Considerable evidence indicates that mesolimbic DA transmission exerts a bi-directional control over exertion of effort on instrumental behavior tasks. Interference with DA transmission produces a low-effort bias in animals tested on effort-based choice tasks, while increasing DA transmission with drugs such as DA transport blockers tends to enhance selection of high-effort options. The results from these pharmacology studies are corroborated by the findings from recent articles using optogenetic, chemogenetic and physiological techniques. In addition to providing important information about the neural regulation of motivated behavior, effort-based choice tasks are useful for developing animal models of some of the motivational symptoms that are seen in people with various psychiatric and neurological disorders (e.g., depression, schizophrenia, Parkinson's disease). Studies of effort-based decision making may ultimately contribute to the development of novel drug treatments for motivational dysfunction.

To Pass or Not to Pass: Modeling the Movement and Affordance Dynamics of a Pick and Place Task

PubMed Central

Lamb, Maurice; Kallen, Rachel W.; Harrison, Steven J.; Di Bernardo, Mario; Minai, Ali; Richardson, Michael J.

2017-01-01

Humans commonly engage in tasks that require or are made more efficient by coordinating with other humans. In this paper we introduce a task dynamics approach for modeling multi-agent interaction and decision making in a pick and place task where an agent must move an object from one location to another and decide whether to act alone or with a partner. Our aims were to identify and model (1) the affordance related dynamics that define an actor's choice to move an object alone or to pass it to their co-actor and (2) the trajectory dynamics of an actor's hand movements when moving to grasp, relocate, or pass the object. Using a virtual reality pick and place task, we demonstrate that both the decision to pass or not pass an object and the movement trajectories of the participants can be characterized in terms of a behavioral dynamics model. Simulations suggest that the proposed behavioral dynamics model exhibits features observed in human participants including hysteresis in decision making, non-straight line trajectories, and non-constant velocity profiles. The proposed model highlights how the same low-dimensional behavioral dynamics can operate to constrain multiple (and often nested) levels of human activity and suggests that knowledge of what, when, where and how to move or act during pick and place behavior may be defined by these low dimensional task dynamics and, thus, can emerge spontaneously and in real-time with little a priori planning. PMID:28701975

Fast and accurate Monte Carlo sampling of first-passage times from Wiener diffusion models.

PubMed

Drugowitsch, Jan

2016-02-11

We present a new, fast approach for drawing boundary crossing samples from Wiener diffusion models. Diffusion models are widely applied to model choices and reaction times in two-choice decisions. Samples from these models can be used to simulate the choices and reaction times they predict. These samples, in turn, can be utilized to adjust the models' parameters to match observed behavior from humans and other animals. Usually, such samples are drawn by simulating a stochastic differential equation in discrete time steps, which is slow and leads to biases in the reaction time estimates. Our method, instead, facilitates known expressions for first-passage time densities, which results in unbiased, exact samples and a hundred to thousand-fold speed increase in typical situations. In its most basic form it is restricted to diffusion models with symmetric boundaries and non-leaky accumulation, but our approach can be extended to also handle asymmetric boundaries or to approximate leaky accumulation.

Effect of Light and Melatonin and other Melatonin Receptor Agonists on Human Circadian Physiology

PubMed Central

Emens, Jonathan S.

2015-01-01

Synopsis Circadian (body clock) timing has a profound influence on mental health, physical health, and health behaviors. This review focuses on how light, melatonin and other melatonin receptor agonist drugs can be used to shift circadian timing in patients with misaligned circadian rhythms. A brief overview of the human circadian system is provided, followed by a discussion of patient characteristics and safety considerations that can influence the treatment of choice. The important features of light treatment, light avoidance, exogenous melatonin and other melatonin receptor agonists are reviewed, along with some of the practical aspects of light and melatonin treatment. PMID:26568121

Cool cuisine-feed your body, mind, and planet.

PubMed

Stec, Laura

2012-03-01

This paper combines information from the book, Cool Cuisine-Taking the Bite Out of Global Warming (Gibbs Smith, 2008) with notes from the World of Healthy Flavors Conference (Culinary Institute of America, St. Helena, CA, USA, 2011). Cool Cuisine reports on connections between food choices and global warming, (what we termed the Global Warming Diet), both from a culinary and science point of view. World of Healthy Flavors brought food industry professionals together to discuss ways the industry can collaborate on solutions to some of the most pressing health problems in the USA. Science now supports the fact that dietary choices that adversely effect human health have an equally detrimental effect on the health of the environment and our livestock. Therefore, eating a more diverse, plant-based, whole grain, and sodium-reduced diet not only improves human health, but also the health of the environment. What is good for humans to eat is the same food that is best for the environment to grow and manufacture. Understanding and then teaching the connection between the two is one more tool toward effective behavior change, especially in children. Easy suggestions on ways to cook healthfully and "fight the global warming diet with a cool cuisine" close out this work.

Interaction between behavioral and pharmacological treatment strategies to decrease cocaine choice in rhesus monkeys.

PubMed

Banks, Matthew L; Blough, Bruce E; Negus, S Stevens

2013-02-01

Behavioral and pharmacotherapeutic approaches constitute two prominent strategies for treating cocaine dependence. This study investigated interactions between behavioral and pharmacological strategies in a preclinical model of cocaine vs food choice. Six rhesus monkeys, implanted with a chronic indwelling double-lumen venous catheter, initially responded under a concurrent schedule of food delivery (1-g pellets, fixed-ratio (FR) 100 schedule) and cocaine injections (0-0.1 mg/kg/injection, FR 10 schedule) during continuous 7-day treatment periods with saline or the agonist medication phenmetrazine (0.032-0.1 mg/kg/h). Subsequently, the FR response requirement for cocaine or food was varied (food, FR 100; cocaine, FR 1-100; cocaine, FR 10; food, FR 10-300), and effects of phenmetrazine on cocaine vs food choice were redetermined. Decreases in the cocaine FR or increases in the food FR resulted in leftward shifts in the cocaine choice dose-effect curve, whereas increases in the cocaine FR or decreases in the food FR resulted in rightward shifts in the cocaine choice dose-effect curve. The efficacy of phenmetrazine to decrease cocaine choice varied systematically as a function of the prevailing response requirements, such that phenmetrazine efficacy was greatest when cocaine choice was maintained by relatively low unit cocaine doses. These results suggest that efficacy of pharmacotherapies to modulate cocaine use can be influenced by behavioral contingencies of cocaine availability. Agonist medications may be most effective under contingencies that engender choice of relatively low cocaine doses.

The application of defaults to optimize parents' health-based choices for children.

PubMed

Loeb, Katharine L; Radnitz, Cynthia; Keller, Kathleen; Schwartz, Marlene B; Marcus, Sue; Pierson, Richard N; Shannon, Michael; DeLaurentis, Danielle

2017-06-01

Optimal defaults is a compelling model from behavioral economics and the psychology of human decision-making, designed to shape or "nudge" choices in a positive direction without fundamentally restricting options. The current study aimed to test the effectiveness of optimal (less obesogenic) defaults and parent empowerment priming on health-based decisions with parent-child (ages 3-8) dyads in a community-based setting. Two proof-of-concept experiments (one on breakfast food selections and one on activity choice) were conducted comparing the main and interactive effects of optimal versus suboptimal defaults, and parent empowerment priming versus neutral priming, on parents' health-related choices for their children. We hypothesized that in each experiment, making the default option more optimal will lead to more frequent health-oriented choices, and that priming parents to be the ultimate decision-makers on behalf of their child's health will potentiate this effect. Results show that in both studies, default condition, but not priming condition or the interaction between default and priming, significantly predicted choice (healthier vs. less healthy option). There was also a significant main effect for default condition (and no effect for priming condition or the interaction term) on the quantity of healthier food children consumed in the breakfast experiment. These pilot studies demonstrate that optimal defaults can be practicably implemented to improve parents' food and activity choices for young children. Results can inform policies and practices pertaining to obesogenic environmental factors in school, restaurant, and home environments. Copyright © 2017 Elsevier Ltd. All rights reserved.

Nucleus accumbens core lesions induce sub-optimal choice and reduce sensitivity to magnitude and delay in impulsive choice tasks

PubMed Central

Steele, Catherine C.; Peterson, Jennifer R.; Marshall, Andrew T.; Stuebing, Sarah L.; Kirkpatrick, Kimberly

2017-01-01

The nucleus accumbens core (NAc) has long been recognized as an important contributor to the computation of reward value that is critical for impulsive choice behavior. Impulsive choice refers to choosing a smaller-sooner (SS) over a larger-later (LL) reward when the LL is more optimal in terms of the rate of reward delivery. Two experiments examined the role of the NAc in impulsive choice and its component processes of delay and magnitude processing. Experiment 1 delivered an impulsive choice task with manipulations of LL reward magnitude, followed by a reward magnitude discrimination task. Experiment 2 tested impulsive choice under manipulations of LL delay, followed by temporal bisection and progressive interval tasks. NAc lesions, in comparison to sham control lesions, produced suboptimal preferences that resulted in lower reward earning rates, and led to reduced sensitivity to magnitude and delay within the impulsive choice task. The secondary tasks revealed intact reward magnitude and delay discrimination abilities, but the lesion rats persisted in responding more as the progressive interval increased during the session. The results suggest that the NAc is most critical for demonstrating good sensitivity to magnitude and delay, and adjusting behavior accordingly. Ultimately, the NAc lesions induced suboptimal choice behavior rather than simply promoting impulsive choice, suggesting that an intact NAc is necessary for optimal decision making. PMID:29146281

Unfolding the Spatial and Temporal Neural Processing of Making Dishonest Choices

PubMed Central

Wang, Zhaoxin; Chan, Chetwyn C. H.

2016-01-01

To understand the neural processing that underpins dishonest behavior in an economic exchange game task, this study employed both functional magnetic resonance imaging (fMRI) and event-related potential (ERP) methodologies to examine the neural conditions of 25 participants while they were making either dishonest or honest choices. It was discovered that dishonest choices, contrary to honest choices, elicited stronger fMRI activations in bilateral striatum and anterior insula. It also induced fluctuations in ERP amplitudes within two time windows, which are 270–30 milliseconds before and 110–290 milliseconds after the response, respectively. Importantly, when making either dishonest or honest choices, human and computer counterparts were associated with distinct fMRI activations in the left insula and different ERP amplitudes at medial and right central sites from 80 milliseconds before to 250 milliseconds after the response. These results support the hypothesis that there would be distinct neural processing during making dishonest decisions, especially when the subject considers the interests of the counterpart. Furthermore, the fMRI and ERP findings, together with ERP source reconstruction, clearly delineate the temporal sequence of the neural processes of a dishonest decision: the striatum is activated before response, then the left insula is involved around the time of response, and finally the thalamus is activated after response. PMID:27096474

Human choices and environmental constraints: deciphering the variability of large game procurement from Mousterian to Aurignacian times (MIS 5-3) in southwestern France

NASA Astrophysics Data System (ADS)

Discamps, Emmanuel; Jaubert, Jacques; Bachellerie, François

2011-09-01

The evolution in the selection of prey made by past humans, especially the Neandertals and the first anatomically modern humans, has been widely debated. Between Marine Isotope Stages (MIS) 5 and 3, the accuracy of absolute dating is still insufficient to precisely correlate paleoclimatic and archaeological data. It is often difficult, therefore, to estimate to what extent changes in species procurement are correlated with either climate fluctuations or deliberate cultural choices in terms of subsistence behavior. Here, the full development of archeostratigraphy and Bayesian statistical analysis of absolute dates allows the archeological and paleoclimatic chronologies to be compared. The variability in hunted fauna is investigated using multivariate statistical analysis of quantitative faunal lists of 148 assemblages from 39 archeological sequences from MIS 5 through MIS 3. Despite significant intra-technocomplex variability, it is possible to identify major shifts in the human diet during these stages. The integration of archeological data, paleoclimatic proxies and the ecological characteristics of the different species of prey shows that the shifts in large game hunting can be explained by an adaptation of the human groups to climatic fluctuations. However, even if Middle and Early Upper Paleolithic men adapted to changes in their environment and to contrasting landscapes, they ultimately belonged to the ecosystems of the past and were limited by environmental constraints.

Adolescents' perspectives and food choice behaviors in terms of the environmental impacts of food production practices: application of a psychosocial model.

PubMed

Bissonnette, M M; Contento, I R

2001-01-01

The objective of this study was to investigate adolescents' perspectives about the environmental impacts of food production practices and whether these perspectives are related to their food choice. Food choice was operationalized as consumption and purchase of organic foods and locally grown foods. A survey questionnaire was administered to a convenience sample of adolescents and analyzed for descriptive information and relationships among variables. Subjects were 651 ethnically diverse, urban and suburban high school senior students in a major metropolitan area. Variables of an Expanded Theory of Planned Behavior were measured including beliefs, attitudes, perceived social influences, motivation to comply, perceived behavioral control, self-identity, perceived responsibility, behavioral intention, and behavior. Descriptive statistics, Pearson correlation coefficients, and stepwise multiple regression analyses were used. Surveyed adolescents did not have strong or consistent beliefs or attitudes about the environmental impact of food production practices. Cognitive-motivational processes were at work, however, since their perspectives were significantly correlated with behavioral intentions and food choice behaviors. Behavioral intention was best accounted for by attitudes and perceived social influences (and perceived responsibility for organic food), and behavior was best accounted for by behavioral intentions, beliefs, and perceived social influences (and self-identity for local food). There is a need to make salient to adolescents the environmental impact of food production practices through both cognitive and experiential approaches.

Learning the opportunity cost of time in a patch-foraging task

PubMed Central

Constantino, Sara; Daw, Nathaniel D.

2015-01-01

Although most decision research concerns choice between simultaneously presented options, in many situations options are encountered serially and the decision is whether to exploit an option or search for a better one. Such problems have a rich history in animal foraging but we know little about the psychological processes involved. In particular, it is unknown whether learning in these problems is supported by the well studied neurocomputational mechanisms involved in more conventional tasks. We investigated how humans learn in a foraging task, which requires deciding whether to harvest a depleting resource or switch to a replenished one. The optimal choice (given by the Marginal Value Theorem; MVT) requires comparing the immediate return from harvesting to the opportunity cost of time, which is given by the long-run average reward. In two experiments, we varied opportunity cost across blocks. Subjects adjusted their behavior to blockwise changes in environmental characteristics. We examined how subjects learned their choice strategies by comparing choice adjustments to a learning rule suggested by the MVT (where the opportunity cost threshold is estimated as an average over previous rewards) and to the predominant incremental learning theory in neuroscience, temporal-difference learning (TD). Trial-by-trial decisions were better explained by the MVT threshold learning rule. These findings expand on the foraging literature, which has focused on steady-state behavior, by elucidating a computational mechanism for learning in switching tasks that is distinct from those used in traditional tasks, and suggest connections to research on average reward rates in other domains of neuroscience. PMID:25917000

Choice between delayed food and immediate oxycodone in rats.

PubMed

Secci, Maria E; Factor, Julie A; Schindler, Charles W; Panlilio, Leigh V

2016-12-01

The choice to seek immediate drug effects instead of more meaningful but delayed rewards is a defining feature of addiction. To develop a rodent model of this behavior, we allowed rats to choose between immediate intravenous delivery of the prescription opioid oxycodone (50 μg/kg) and delayed delivery of palatable food pellets. Rats preferred food at delays up to 30 s, but they chose oxycodone and food equally at 60-s delay and preferred oxycodone over food at 120-s delay. Comparison of food-drug choice, food-only, and drug-only conditions indicated that food availability decreased drug intake, but drug availability increased food intake. In the food-only condition, food was effective as a reinforcer even when delayed by 120 s. Pre-session feeding with chow slowed acquisition of food and drug self-administration, but did not affect choice. To establish procedures for testing potential anti-addiction medications, noncontingent pre-treatment with oxycodone or naltrexone (analogous to substitution and antagonist therapies, respectively) were tested on a baseline in which oxycodone was preferred over delayed food. Naltrexone pre-treatment decreased drug intake and increased food intake. Oxycodone pre-treatment decreased drug intake, but also produced extended periods with no food or drug responding. These findings show that the contingencies that induce preference for drugs over more meaningful but less immediate rewards in humans can be modeled in rodents, and they suggest that the model could be useful for assessing the therapeutic potential of treatments and exploring the underlying behavioral and neural mechanisms involved in addiction.

Choice between delayed food and immediate oxycodone in rats

PubMed Central

Secci, Maria E.; Factor, Julie A.; Schindler, Charles W.; Panlilio, Leigh V.

2016-01-01

Rationale The choice to seek immediate drug effects instead of more meaningful but delayed rewards is a defining feature of addiction. Objectives To develop a rodent model of this behavior, we allowed rats to choose between immediate intravenous delivery of the prescription opioid oxycodone (50 μg/kg) and delayed delivery of palatable food pellets. Results Rats preferred food at delays up to 30 s, but they chose oxycodone and food equally at 60-s delay and preferred oxycodone over food at 120-s delay. Comparison of food-drug choice, food-only, and drug-only conditions indicated that food availability decreased drug intake, but drug availability increased food intake. In the food-only condition, food was effective as a reinforcer even when delayed by 120 s. Pre-session feeding with chow slowed acquisition of food and drug self-administration, but did not affect choice. To establish procedures for testing potential anti-addiction medications, noncontingent pretreatment with oxycodone or naltrexone (analogous to substitution and antagonist therapies, respectively) were tested on a baseline in which oxycodone was preferred over delayed food. Naltrexone pretreatment decreased drug intake and increased food intake. Oxycodone pretreatment decreased drug intake, but also produced extended periods with no food or drug responding. Conclusions These findings show that the contingencies that induce preference for drugs over more meaningful but less immediate rewards in humans can be modeled in rodents, and they suggest that the model could be useful for assessing the therapeutic potential of treatments and exploring the underlying behavioral and neural mechanisms involved in addiction. PMID:27678551

Selectively bred crossed high-alcohol-preferring mice drink to intoxication and develop functional tolerance, but not locomotor sensitization during free-choice ethanol access.

PubMed

Matson, Liana M; Kasten, Chelsea R; Boehm, Stephen L; Grahame, Nicholas J

2014-01-01

Crossed high-alcohol-preferring (cHAP) mice were selectively bred from a cross of the HAP1 × HAP2 replicate lines and demonstrate blood ethanol concentrations (BECs) during free-choice drinking reminiscent of those observed in alcohol-dependent humans. In this report, we investigated the relationship between free-choice drinking, intoxication, tolerance, and sensitization in cHAP mice. We hypothesized that initially mice would become ataxic after drinking alcohol, but that increased drinking over days would be accompanied by increasing tolerance to the ataxic effects of ethanol (EtOH). Male and female cHAP mice had free-choice access to 10% EtOH and water (E), while Water mice (W) had access to water alone. In experiment 1, the first drinking experience was monitored during the dark portion of the cycle. Once E mice reached an average intake rate of ≥1.5 g/kg/h, they, along with W mice, were tested for footslips on a balance beam, and BECs were assessed. In experiments 2, 3, and 4, after varying durations of free-choice 10% EtOH access (0, 3, 14, or 21 days), mice were challenged with 20% EtOH and tested for number of footslips on a balance beam or locomotor stimulant response. Blood was sampled for BEC determination. We found that cHAP mice rapidly acquire alcohol intakes that lead to ataxia. Over time, cHAP mice developed behavioral tolerance to the ataxic effects of alcohol, paralleled by escalating alcohol consumption. However, locomotor sensitization did not develop following 14 days of free-choice EtOH access. Overall, we observed increases in free-choice drinking with extended alcohol access paralleled by increases in functional tolerance, but not locomotor sensitization. These data support our hypothesis that escalating free-choice drinking over days in cHAP mice is driven by tolerance to alcohol's behavioral effects. These data are the first to demonstrate that escalating free-choice consumption is accompanied by increasing alcohol tolerance. In addition to buttressing the hypothesized importance of tolerance in drinking, our findings suggest that cHAP mice may be a unique, translational resource for studying tolerance as a contributor to and consequence of chronic, excessive EtOH consumption. Copyright © 2013 by the Research Society on Alcoholism.

Behavioral Economics and the Public Acceptance of Synthetic Biology.

PubMed

Oliver, Adam

2018-01-01

Different applications of synthetic biology are alike in that their possible negative consequences are highly uncertain, potentially catastrophic, and perhaps irreversible; therefore, they are also alike in that public attitudes about them are fertile ground for behavioral economic phenomena. Findings from behavioral economics suggest that people may not respond to such applications according to the normal rules of economic evaluation, by which the value of an outcome is multiplied by the mathematical probability that the outcome will occur. Possibly, then, synthetic biology applications challenge the normative postulates of the standard approach, too. I want to first consider how some of the phenomena described by behavioral economists-and behavioral scientists more broadly-might affect people's perceptions of the uncertainties associated with synthetic biology. My analysis will be far from complete, however, because behavioral economics is essentially the study of human behavior, and thus its reach is potentially vast and its development longstanding and ongoing. Nonetheless, I hope to give an indicative perspective on how some aspects of behavioral economics might affect the assessment and perceived acceptability of synthetic biology. I will then consider the issue of agency. Should policy-makers respect people's reactions to synthetic biology when those reactions are known to be driven by behavioral economic phenomena rather than following the normative postulates of rational choice theory? Or should policy-makers dismiss these reactions as inherently biased? I will argue that the normative force of these human reactions (probably) depends on phenomenon and context. © 2018 The Hastings Center.

Effects of monetary reserves and rate of gain on human risky choice under budget constraints.

PubMed

Pietras, Cynthia J; Searcy, Gabriel D; Huitema, Brad E; Brandt, Andrew E

2008-07-01

The energy-budget rule is an optimal foraging model that predicts that choice should be risk averse when net gains plus reserves meet energy requirements (positive energy-budget conditions) and risk prone when net gains plus reserves fall below requirements (negative energy-budget conditions). Studies have shown that the energy-budget rule provides a good description of risky choice in humans when choice is studied under economic conditions (i.e., earnings budgets) that simulate positive and negative energy budgets. In previous human studies, earnings budgets were manipulated by varying earnings requirements, but in most nonhuman studies, energy budgets have been manipulated by varying reserves and/or mean rates of reinforcement. The present study therefore investigated choice in humans between certain and variable monetary outcomes when earnings budgets were manipulated by varying monetary reserves and mean rates of monetary gain. Consistent with the energy-budget rule, choice tended to be risk averse under positive-budget conditions and risk neutral or risk prone under negative-budget conditions. Sequential choices were also well described by a dynamic optimization model, especially when expected earnings for optimal choices were high. These results replicate and extend the results of prior experiments in showing that humans' choices are generally consistent with the predictions of the energy-budget rule when studied under conditions analogous to those used in nonhuman energy-budget studies, and that choice patterns tend to maximize reinforcement.

Fitness Benefits of Mate Choice for Compatibility in a Socially Monogamous Species

PubMed Central

Ihle, Malika; Kempenaers, Bart; Forstmeier, Wolfgang

2015-01-01

Research on mate choice has primarily focused on preferences for quality indicators, assuming that all individuals show consensus about who is the most attractive. However, in some species, mating preferences seem largely individual-specific, suggesting that they might target genetic or behavioral compatibility. Few studies have quantified the fitness consequences of allowing versus preventing such idiosyncratic mate choice. Here, we report on an experiment that controls for variation in overall partner quality and show that zebra finch (Taeniopygia guttata) pairs that resulted from free mate choice achieved a 37% higher reproductive success than pairs that were forced to mate. Cross-fostering of freshly laid eggs showed that embryo mortality (before hatching) primarily depended on the identity of the genetic parents, whereas offspring mortality during the rearing period depended on foster-parent identity. Therefore, preventing mate choice should lead to an increase in embryo mortality if mate choice targets genetic compatibility (for embryo viability), and to an increase in offspring mortality if mate choice targets behavioral compatibility (for better rearing). We found that pairs from both treatments showed equal rates of embryo mortality, but chosen pairs were better at raising offspring. These results thus support the behavioral, but not the genetic, compatibility hypothesis. Further exploratory analyses reveal several differences in behavior and fitness components between “free-choice” and “forced” pairs. PMID:26366558

Neural correlates of strategic reasoning during competitive games.

PubMed

Seo, Hyojung; Cai, Xinying; Donahue, Christopher H; Lee, Daeyeol

2014-10-17

Although human and animal behaviors are largely shaped by reinforcement and punishment, choices in social settings are also influenced by information about the knowledge and experience of other decision-makers. During competitive games, monkeys increased their payoffs by systematically deviating from a simple heuristic learning algorithm and thereby countering the predictable exploitation by their computer opponent. Neurons in the dorsomedial prefrontal cortex (dmPFC) signaled the animal's recent choice and reward history that reflected the computer's exploitative strategy. The strength of switching signals in the dmPFC also correlated with the animal's tendency to deviate from the heuristic learning algorithm. Therefore, the dmPFC might provide control signals for overriding simple heuristic learning algorithms based on the inferred strategies of the opponent. Copyright © 2014, American Association for the Advancement of Science.

Choosing Under the Influence: A Drug-Specific Mechanism by Which the Setting Controls Drug Choices in Rats.

PubMed

Vandaele, Youna; Cantin, Lauriane; Serre, Fuschia; Vouillac-Mendoza, Caroline; Ahmed, Serge H

2016-01-01

Ample evidence shows that the setting can control drug choices in both humans and animals. Here we reveal in rats that a major mechanism of this control involves a regulation of the drug influence on other competing options at the time of choice. Briefly, rats were offered a choice between a drug dose (cocaine or heroin) and a brief access to water sweetened with saccharin in two different settings. In one setting, choosing under the influence was not possible and rats largely preferred saccharin over either cocaine or heroin. In contrast, when the same rats were shifted to a setting where choosing under the influence was possible, they chose the drug either nonexclusively or exclusively depending on whether the drug enhanced or suppressed sweet reward, respectively. Thus, when rats were under the orexigenic influence of heroin at the time of choice, they more frequently chose saccharin in alternation with heroin. In contrast, when rats were under the anorexic influence of cocaine, they stopped choosing saccharin and continued taking cocaine exclusively. These setting- and drug-specific changes in preference were rapid and reversible, and could be induced by passively administering cocaine or heroin before choice. Finally, rats behaved as if they were oblivious to the drug influence on their choices. This behavior could explain why rats are vulnerable to harm themselves, sometimes to the point of death, in settings where choices are made under the drug influence, notably if this influence excludes other important options or, conversely, enhances harmful ones.

Choosing Under the Influence: A Drug-Specific Mechanism by Which the Setting Controls Drug Choices in Rats

PubMed Central

Vandaele, Youna; Cantin, Lauriane; Serre, Fuschia; Vouillac-Mendoza, Caroline; Ahmed, Serge H

2016-01-01

Ample evidence shows that the setting can control drug choices in both humans and animals. Here we reveal in rats that a major mechanism of this control involves a regulation of the drug influence on other competing options at the time of choice. Briefly, rats were offered a choice between a drug dose (cocaine or heroin) and a brief access to water sweetened with saccharin in two different settings. In one setting, choosing under the influence was not possible and rats largely preferred saccharin over either cocaine or heroin. In contrast, when the same rats were shifted to a setting where choosing under the influence was possible, they chose the drug either nonexclusively or exclusively depending on whether the drug enhanced or suppressed sweet reward, respectively. Thus, when rats were under the orexigenic influence of heroin at the time of choice, they more frequently chose saccharin in alternation with heroin. In contrast, when rats were under the anorexic influence of cocaine, they stopped choosing saccharin and continued taking cocaine exclusively. These setting- and drug-specific changes in preference were rapid and reversible, and could be induced by passively administering cocaine or heroin before choice. Finally, rats behaved as if they were oblivious to the drug influence on their choices. This behavior could explain why rats are vulnerable to harm themselves, sometimes to the point of death, in settings where choices are made under the drug influence, notably if this influence excludes other important options or, conversely, enhances harmful ones. PMID:26129679

Evaluating psychological markers for human nicotine dependence: tobacco choice, extinction, and Pavlovian-to-instrumental transfer.

PubMed

Hogarth, Lee; Chase, Henry W

2012-06-01

Individual differences in drug dependence may be mediated by several abnormalities in associative learning, including perseveration of drug-seeking following contingency change, greater control over drug-seeking by Pavlovian stimuli, or greater sensitivity to drug reinforcement establishing higher rates of drug-seeking. To evaluate these three candidate markers for nicotine dependence, Experiment 1 contrasted daily (N = 22) and nondaily smoker groups (N = 22) on a novel instrumental learning task, where one S+ was first trained as a predictor of tobacco reward before being extinguished. Experiment 2 compared daily (N = 18) and nondaily smoker groups (N = 18) on a concurrent-choice task for tobacco and chocolate reward before an extinction test in which the tobacco response was extinguished, followed by a Pavlovian-to-instrumental transfer test, wherein the impact of tobacco and chocolate cues on concurrent choice was measured (gender was balanced within each smoker group). The results showed no group difference in sensitivity to extinction of either the stimulus-drug or response-drug contingency in Experiments 1 and 2, respectively, nor did groups show a difference in Pavlovian-to-instrumental transfer of control over tobacco choice. By contrast, nicotine-dependence status was marked by a higher frequency of tobacco choice in the concurrent-choice procedure, and this choice preference was associated with subjective craving (gender did not affect any behavioral measure). These results favor the view that nicotine dependence in this sample is not determined by individual predilection for perseveration or stimulus-control over drug-seeking, but by greater sensitivity to reinforcement of instrumental drug choice. Value-based decision theories of dependence are discussed.

Spatial gradient in value representation along the medial prefrontal cortex reflects individual differences in prosociality

PubMed Central

Sul, Sunhae; Tobler, Philippe N.; Hein, Grit; Leiberg, Susanne; Jung, Daehyun; Fehr, Ernst; Kim, Hackjin

2015-01-01

Despite the importance of valuing another person’s welfare for prosocial behavior, currently we have only a limited understanding of how these values are represented in the brain and, more importantly, how they give rise to individual variability in prosociality. In the present study, participants underwent functional magnetic resonance imaging while performing a prosocial learning task in which they could choose to benefit themselves and/or another person. Choice behavior indicated that participants valued the welfare of another person, although less so than they valued their own welfare. Neural data revealed a spatial gradient in activity within the medial prefrontal cortex (MPFC), such that ventral parts predominantly represented self-regarding values and dorsal parts predominantly represented other-regarding values. Importantly, compared with selfish individuals, prosocial individuals showed a more gradual transition from self-regarding to other-regarding value signals in the MPFC and stronger MPFC–striatum coupling when they made choices for another person rather than for themselves. The present study provides evidence of neural markers reflecting individual differences in human prosociality. PMID:26056280

The substitutability of reinforcers.

PubMed

Green, Leonard; Freed, Debra E

1993-07-01

Substitutability is a construct borrowed from microeconomics that describes a continuum of possible interactions among the reinforcers in a given situation. Highly substitutable reinforcers, which occupy one end of the continuum, are readily traded for each other due to their functional similarity. Complementary reinforcers, at the other end of the continuum, tend to be consumed jointly in fairly rigid proportion, and therefore cannot be traded for one another except to achieve that proportion. At the center of the continuum are reinforcers that are independent with respect to each other; consumption of one has no influence on consumption of another. Psychological research and analyses in terms of substitutability employ standard operant conditioning paradigms in which humans and nonhumans choose between alternative reinforcers. The range of reinforcer interactions found in these studies is more readily accommodated and predicted when behavior-analytic models of choice consider issues of substitutability. New insights are gained into such areas as eating and drinking, electrical brain stimulation, temporal separation of choice alternatives, behavior therapy, drug use, and addictions. Moreover, the generalized matching law (Baum, 1974) gains greater explanatory power and comprehensiveness when measures of substitutability are included.

The substitutability of reinforcers

PubMed Central

Green, Leonard; Freed, Debra E.

1993-01-01

Substitutability is a construct borrowed from microeconomics that describes a continuum of possible interactions among the reinforcers in a given situation. Highly substitutable reinforcers, which occupy one end of the continuum, are readily traded for each other due to their functional similarity. Complementary reinforcers, at the other end of the continuum, tend to be consumed jointly in fairly rigid proportion, and therefore cannot be traded for one another except to achieve that proportion. At the center of the continuum are reinforcers that are independent with respect to each other; consumption of one has no influence on consumption of another. Psychological research and analyses in terms of substitutability employ standard operant conditioning paradigms in which humans and nonhumans choose between alternative reinforcers. The range of reinforcer interactions found in these studies is more readily accommodated and predicted when behavior-analytic models of choice consider issues of substitutability. New insights are gained into such areas as eating and drinking, electrical brain stimulation, temporal separation of choice alternatives, behavior therapy, drug use, and addictions. Moreover, the generalized matching law (Baum, 1974) gains greater explanatory power and comprehensiveness when measures of substitutability are included. PMID:16812696

Using aversive images to enhance healthy food choices and implicit attitudes: An experimental test of evaluative conditioning.

PubMed

Hollands, Gareth J; Prestwich, Andrew; Marteau, Theresa M

2011-03-01

To examine the effect of communicating images of energy-dense snack foods paired with aversive images of the potential health consequences of unhealthy eating, on implicit and explicit attitudes and food choice behavior. Participants were randomly allocated to either an evaluative conditioning (EC) procedure that paired images of snack foods with images of potential adverse health consequences or a control condition that featured images of snack foods alone. Implicit attitudes were assessed pre- and post-intervention. Explicit attitudes and food choice behavior were assessed post-intervention. The conditioning intervention made implicit attitudes toward energy-dense snacks more negative, with this effect greatest in those with relatively more favorable implicit attitudes toward these snacks at baseline. Participants in the conditioning intervention were more likely to choose fruit rather than snacks in a behavioral choice task, a relationship mediated by changes in implicit attitudes. Presenting aversive images of potential health consequences with those of specific foodstuffs can change implicit attitudes, which impacts on subsequent food choice behavior. (c) 2011 APA, all rights reserved

Behavioral variability of choices versus structural inconsistency of preferences.

PubMed

Regenwetter, Michel; Davis-Stober, Clintin P

2012-04-01

Theories of rational choice often make the structural consistency assumption that every decision maker's binary strict preference among choice alternatives forms a strict weak order. Likewise, the very concept of a utility function over lotteries in normative, prescriptive, and descriptive theory is mathematically equivalent to strict weak order preferences over those lotteries, while intransitive heuristic models violate such weak orders. Using new quantitative interdisciplinary methodologies, we dissociate the variability of choices from the structural inconsistency of preferences. We show that laboratory choice behavior among stimuli of a classical "intransitivity" paradigm is, in fact, consistent with variable strict weak order preferences. We find that decision makers act in accordance with a restrictive mathematical model that, for the behavioral sciences, is extraordinarily parsimonious. Our findings suggest that the best place to invest future behavioral decision research is not in the development of new intransitive decision models but rather in the specification of parsimonious models consistent with strict weak order(s), as well as heuristics and other process models that explain why preferences appear to be weakly ordered.

The monoamine-oxidase B inhibitor deprenyl increases selection of high-effort activity in rats tested on a progressive ratio/chow feeding choice procedure: Implications for treating motivational dysfunctions.

PubMed

Yohn, Samantha E; Reynolds, Shanika; Tripodi, Giuseppe; Correa, Merce; Salamone, John D

2018-04-16

Motivated behaviors often are characterized by a high degree of behavioral activation and work output, and organisms frequently make effort-related decisions based upon cost/benefit analyses. Moreover, people with depression and other disorders frequently show effort-related motivational symptoms, such as anergia, psychomotor retardation, and fatigue. Tasks measuring effort-related choice are being used as animal models of these motivational symptoms. The present studies characterized the ability of the monoamine oxidase -B (MAO-B) inhibitor deprenyl (selegiline) to enhance selection of high-effort lever pressing in rats tested on a concurrent progressive ratio (PROG)/chow feeding choice task. Deprenyl is widely used as an antiparkinsonian drug, but it also has been shown to have antidepressant effects in humans, and to induce antidepressant-like effects in traditional rodent models of depression. Systemic administration of deprenyl (1.5-12.0 mg/kg IP) shifted choice behavior, significantly increasing markers of PROG lever pressing at a moderate dose (6.0 mg/kg), and decreasing chow intake at 6.0 and 12.0 mg/kg. Intracranial injections of deprenyl into nucleus accumbens (2.0 and 4.0 μg) also increased PROG lever pressing and decreased chow intake. Microdialysis studies showed that the dose of deprenyl that was effective at increasing PROG lever pressing (6.0 mg/kg) also significantly elevated extracellular dopamine in nucleus accumbens. Thus, similar to the well-known antidepressant bupropion, deprenyl is capable of increasing selection of high-effort PROG lever pressing at doses that increase extracellular dopamine in nucleus accumbens. These studies have implications for the potential use of MAO-B inhibitors as treatments for the motivational symptoms of depression and Parkinsonism. Copyright © 2018 Elsevier B.V. All rights reserved.

The “voice” has it: screen reader adoption and switching behavior among vision impaired persons in India

PubMed Central

Pal, Joyojeet; Cutrell, Edward

2013-01-01

We present results from a mixed methods study of screen reader use and switching behavior among people with vision impairments in India. We examine loyalty and experimentation with screen readers and find that the main drivers of adoption for early users differ significantly from the factors that drive continued use by advanced users. We discuss the factor that emerges as one of the strongest stated drivers of early adoption, TTS “voice” quality, particularly a “human-sounding voice” as one of the key features differentiating free/open source (FOSS) products from more expensive proprietary products. While the initial preferences are driven by voice quality, application support becomes more important over time as users speed up their sound settings and become more comfortable with the resultant non-human-sounding speech. We discuss these findings from two theoretical perspectives – first, through the application of the economics of behavior switching, and second, vis-à-vis novice and expert approaches toward new product adoption. We argue that these findings further our understanding of initial user comfort related to assistive technology adoption, and the impact of early technology choices on long-term technology switching behavior. PMID:24620705

The construct-behavior gap in behavioral decision research: A challenge beyond replicability.

PubMed

Regenwetter, Michel; Robinson, Maria M

2017-10-01

Behavioral decision research compares theoretical constructs like preferences to behavior such as observed choices. Three fairly common links from constructs to behavior are (1) to tally, across participants and decision problems, the number of choices consistent with one predicted pattern of pairwise preferences; (2) to compare what most people choose in each decision problem against a predicted preference pattern; or (3) to enumerate the decision problems in which two experimental conditions generate a 1-sided significant difference in choice frequency 'consistent' with the theory. Although simple, these theoretical links are heuristics. They are subject to well-known reasoning fallacies, most notably the fallacy of sweeping generalization and the fallacy of composition. No amount of replication can alleviate these fallacies. On the contrary, reiterating logically inconsistent theoretical reasoning over and again across studies obfuscates science. As a case in point, we consider pairwise choices among simple lotteries and the hypotheses of overweighting or underweighting of small probabilities, as well as the description-experience gap. We discuss ways to avoid reasoning fallacies in bridging the conceptual gap between hypothetical constructs, such as, for example, "overweighting" to observable pairwise choice data. Although replication is invaluable, successful replication of hard-to-interpret results is not. Behavioral decision research stands to gain much theoretical and empirical clarity by spelling out precise and formally explicit theories of how hypothetical constructs translate into observable behavior. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Sophisticated Approval Voting, Ignorance Priors, and Plurality Heuristics: A Behavioral Social Choice Analysis in a Thurstonian Framework

ERIC Educational Resources Information Center

Regenwetter, Michel; Ho, Moon-Ho R.; Tsetlin, Ilia

2007-01-01

This project reconciles historically distinct paradigms at the interface between individual and social choice theory, as well as between rational and behavioral decision theory. The authors combine a utility-maximizing prescriptive rule for sophisticated approval voting with the ignorance prior heuristic from behavioral decision research and two…

The nonlinear, complex sequential organization of behavior in schizophrenic patients: neurocognitive strategies and clinical correlations.

PubMed

Paulus, M P; Perry, W; Braff, D L

1999-09-01

Thought disorder is a hallmark of schizophrenia and can be inferred from disorganized behavior. Measures of the sequential organization of behavior are important because they reflect the cognitive processes of the selection and sequencing of behavioral elements, which generate observable and analyzable behavioral patterns. In this context, sequences of choices generated by schizophrenic patients in a two-choice guessing task fluctuate significantly, which reflects an "oscillating dysregulation" between highly predictable and highly unpredictable subsequences within a single test session. In this study, we aimed to clarify the significance of dysregulation by seeing whether demographic, clinical, neuropsychological, and psychological measures predict the degree of dysregulation observed on this two-choice task. Thirty schizophrenic patients repeatedly performed a LEFT or RIGHT key press that was followed by a stimulus, which occurred randomly on the left or right side of the computer screen. Thus, the stimulus location had nothing to do with the key press behavior. The range of key press sequence predictabilities as measured by the dynamical entropy was used to quantify the dysregulation of response sequences and reflects the range of fixity and randomness of the responses. A factor analysis was performed and step-wise multiple regression analyses were used to relate the factor scores to demographic, clinical, symptomatic, Wisconsin Card Sorting Test (WCST), and Rorschach variables. The LEFT/RIGHT key press sequences were determined by three factors: 1) the degree of win-stay/lose-shift strategy; 2) the degree of contextual influence on the current choice; and 3) the degree of dysregulation on the choice task. Demographic and clinical variables did not predict any of the three response patterns on the choice task. In contrast, the WCST and Rorschach test predicted performance on various factors of choice task response patterns. Schizophrenic patients employ several rules, i.e., "win-stay/lose-shift" and "decide according to the previous choice," that fluctuate significantly when generating sequences on this task, confirming that a basic behavioral dysregulation occurs in a single schizophrenic subject across a single test session. The organization or the "temporal architecture" of the behavioral sequences is not related to symptoms per se, but is related to deficits in executive functioning, problem solving, and perceptual organizational abilities.

Red Color and Risk-Taking Behavior in Online Environments.

PubMed

Gnambs, Timo; Appel, Markus; Oeberst, Aileen

2015-01-01

In many situations red is associated with hazard and danger. As a consequence, it was expected that task-irrelevant color cues in online environments would affect risk-taking behaviors. This assumption was tested in two web-based experiments. The first study (N = 383) demonstrated that in risky choice dilemmas respondents preferred the less risky option when the displayed university logo was in red (versus gray); but only when both choice alternatives were at least moderately risky. The second study (N = 144) replicated these results with a behavioral outcome: Respondents showed more cautious behavior in a web-based game when the focal stimuli were colored red (versus blue). Together, these findings demonstrate that variations in the color design of a computerized environment affect risk taking: Red color leads to more conservative choices and behaviors.

Exogenous Testosterone Enhances the Reactivity to Social Provocation in Males

PubMed Central

Wagels, Lisa; Votinov, Mikhail; Kellermann, Thilo; Eisert, Albrecht; Beyer, Cordian; Habel, Ute

2018-01-01

Testosterone affects human social behavior in various ways. While testosterone effects are generally associated with muscular strength and aggressiveness, human studies also point towards enhanced status–seeking motives after testosterone administration. The current study tested the causal influence of exogenous testosterone on male behavior during a competitive provocation paradigm. In this double blind, randomized, placebo (PL)-controlled study, 103 males were assigned to a PL or testosterone group receiving a colorless PL or testosterone gel. To induce provocation, males played a rigged reaction time game against an ostensible opponent. When participants lost, the opponent subtracted money from the participant who in return could subtract money from the ostensible opponent. Participants subjectively indicated anger and self-estimated treatment affiliation (testosterone or PL administration). A trial-by-trial analysis demonstrated that provocation and success during the repeated games had a stronger influence on participants’ choice to reduce money from the opponent if they had received testosterone. Participants who believed to be in the testosterone group were angrier after the experiment and increased monetary reductions during the task course. In line with theories about mechanisms of testosterone in humans, provocation is shown to be necessary for the agency of exogenous testosterone. Thus, testosterone reinforces the conditional adjustment of aggressive behavior but not aggressive behavior per se. In contrast undirected frustration is not increased by testosterone but probably interferes with cognitive appraisals about biological mechanisms of testosterone. PMID:29551966

Exogenous Testosterone Enhances the Reactivity to Social Provocation in Males.

PubMed

Wagels, Lisa; Votinov, Mikhail; Kellermann, Thilo; Eisert, Albrecht; Beyer, Cordian; Habel, Ute

2018-01-01

Testosterone affects human social behavior in various ways. While testosterone effects are generally associated with muscular strength and aggressiveness, human studies also point towards enhanced status-seeking motives after testosterone administration. The current study tested the causal influence of exogenous testosterone on male behavior during a competitive provocation paradigm. In this double blind, randomized, placebo (PL)-controlled study, 103 males were assigned to a PL or testosterone group receiving a colorless PL or testosterone gel. To induce provocation, males played a rigged reaction time game against an ostensible opponent. When participants lost, the opponent subtracted money from the participant who in return could subtract money from the ostensible opponent. Participants subjectively indicated anger and self-estimated treatment affiliation (testosterone or PL administration). A trial-by-trial analysis demonstrated that provocation and success during the repeated games had a stronger influence on participants' choice to reduce money from the opponent if they had received testosterone. Participants who believed to be in the testosterone group were angrier after the experiment and increased monetary reductions during the task course. In line with theories about mechanisms of testosterone in humans, provocation is shown to be necessary for the agency of exogenous testosterone. Thus, testosterone reinforces the conditional adjustment of aggressive behavior but not aggressive behavior per se . In contrast undirected frustration is not increased by testosterone but probably interferes with cognitive appraisals about biological mechanisms of testosterone.

The Acetylcholinesterase Inhibitor Rivastigmine Does Not Alter Total Choices for Methamphetamine, but May Reduce Positive Subjective Effects, in a Laboratory Model of Intravenous Self-Administration in Human Volunteers

PubMed Central

De La Garza, R.; Mahoney, J.J.; Culbertson, C.; Shoptaw, S.; Newton, T. F.

2008-01-01

A human laboratory model of intravenous methamphetamine self-administration may facilitate study of putative treatments for methamphetamine addiction. We conducted a double-blind, placebo-controlled, between groups investigation of the acetylcholinesterase (AChE) inhibitor rivastigmine in non-treatment-seeking volunteers who met criteria for methamphetamine abuse or dependence. Safety and subjective effects data derived from days 1–10 of this protocol are described in a separate publication. In this report, we describe self-administration outcomes in participants randomized to treatment with rivastigmine (0 mg, N=7; 1.5 mg, N=6; 3 mg, N=9); data that were collected on days 11–15 of the inpatient protocol. On day 11, participants sampled two infusions of methamphetamine (0 and 30 mg, IV). On days 12–15, participants made ten choices each day to receive an infusion of either methamphetamine (3 mg, IV) or saline or a monetary alternative ($0.05 – $16). The study design allowed for evaluation of differences in behavior on days in which infusions were performed by the physician (experimenter-administered) versus by the participant using a PCA pump (self-administered), and when monetary alternatives were presented in either ascending or descending sequence. The data show that rivastigmine (1.5 and 3 mg), as compared to placebo, did not significantly alter total choices for methamphetamine (p=0.150). Importantly, the number of infusion choices was greater when methamphetamine was available then when saline was available (p<0.0001), and the number of money choices was greater when saline was available then when methamphetamine was available (p<0.0001). The total number of choices for methamphetamine was not altered as a function of a participant’s preferred route of methamphetamine use (p=0.57), and did not differ significantly whether they were experimenter-administered or self-administered (p=0.30). In addition, total choices for methamphetamine were similar made when money was available in an ascending versus descending sequence (p=0.49). The participants’ years of methamphetamine use, recent use of methamphetamine (in the past 30 days), or baseline craving (indexed here as “Desire”) on the day of the self-administration task was not predictive of number of choices for methamphetamine. In a subset of participants (N=8) for which data was available, individual does of methamphetamine (3×3 mg, IV) produced significant increases in positive subjective effects, and a preliminary analysis revealed that 3mg rivastigmine was associated with reductions in these responses, as compared to placebo. In summary, the current report indicates that there were no effects of rivastigmine on total choices for methamphetamine, that there were low levels of methamphetamine self-administration but these were 8 times greater than saline, and that choice behavior was insensitive to alternative reinforcers. In addition, we showed that rivastigmine may reduce the positive subjective effects produced by methamphetamine during self-administration. PMID:18207225

Bayesian deterministic decision making: a normative account of the operant matching law and heavy-tailed reward history dependency of choices.

PubMed

Saito, Hiroshi; Katahira, Kentaro; Okanoya, Kazuo; Okada, Masato

2014-01-01

The decision making behaviors of humans and animals adapt and then satisfy an "operant matching law" in certain type of tasks. This was first pointed out by Herrnstein in his foraging experiments on pigeons. The matching law has been one landmark for elucidating the underlying processes of decision making and its learning in the brain. An interesting question is whether decisions are made deterministically or probabilistically. Conventional learning models of the matching law are based on the latter idea; they assume that subjects learn choice probabilities of respective alternatives and decide stochastically with the probabilities. However, it is unknown whether the matching law can be accounted for by a deterministic strategy or not. To answer this question, we propose several deterministic Bayesian decision making models that have certain incorrect beliefs about an environment. We claim that a simple model produces behavior satisfying the matching law in static settings of a foraging task but not in dynamic settings. We found that the model that has a belief that the environment is volatile works well in the dynamic foraging task and exhibits undermatching, which is a slight deviation from the matching law observed in many experiments. This model also demonstrates the double-exponential reward history dependency of a choice and a heavier-tailed run-length distribution, as has recently been reported in experiments on monkeys.

Sexual information seeking on web search engines.

PubMed

Spink, Amanda; Koricich, Andrew; Jansen, B J; Cole, Charles

2004-02-01

Sexual information seeking is an important element within human information behavior. Seeking sexually related information on the Internet takes many forms and channels, including chat rooms discussions, accessing Websites or searching Web search engines for sexual materials. The study of sexual Web queries provides insight into sexually-related information-seeking behavior, of value to Web users and providers alike. We qualitatively analyzed queries from logs of 1,025,910 Alta Vista and AlltheWeb.com Web user queries from 2001. We compared the differences in sexually-related Web searching between Alta Vista and AlltheWeb.com users. Differences were found in session duration, query outcomes, and search term choices. Implications of the findings for sexual information seeking are discussed.

Transport, accessibility and distribution of activity centers in a modern city

NASA Astrophysics Data System (ADS)

Pavlova, Liya

2017-10-01

Labor connections define the life of the city, the distribution of the centers of gravity, and the functioning of its main subsystems, the leading one being the transport subsystem. A methodology based on the analyzed models was developed to address the problems of forecasting and estimating the location of urban development areas. It is based on the study of human (city population) behavior patterns and the underlying nature of the choice of destinations. This allowed establishing the reason for the said choice and, consequently, the formation and direction of the movement of people and traffic. The study is constructed to reveal the trend of settlement (by labor gravitation) based on the effect of the desired choice of workplace location in relation to residence location. The results of the sociological survey allowed establishing the trend of settlement on the basis of the effect of the desired choice. The study discovered a correlation between the values characterizing the topological structure of the plan: a distinctive “scale of settlement” (average shortest distances between the settlement variant and workplace locations) and the internal heterogeneity of the plan (uneven concentration of facilities and their connections). This allows drafting settlement curves for cities without empirical data.

Place your bets: psychophysiological correlates of decision-making under risk.

PubMed

Studer, Bettina; Clark, Luke

2011-06-01

Emotions and their psychophysiological correlates are thought to play an important role in decision-making under risk. We used a novel gambling task to measure psychophysiological responses during selection of explicitly presented risky options and feedback processing. Active-choice trials, in which the participant had to select the size of bet, were compared to fixed-bet, no-choice trials. We further tested how the chances of winning and bet size affected choice behavior and psychophysiological arousal. Individual differences in impulsive and risk-taking traits were assessed. The behavioral results showed sensitivity to the choice requirement and to the chances of winning: Participants were faster to make a response on no-choice trials and when the chances of winning were high. In active-choice trials, electrodermal activity (EDA) increased with bet size during both selection and processing of losses. Cardiac responses were sensitive to choice uncertainty: Stronger selection-related heart rate (HR) decelerations were observed in trials with lower chances of winning, particularly on active-choice trials. Finally, betting behavior and psychophysiological responsiveness were moderately correlated with self-reported impulsivity-related traits. In conclusion, we demonstrate that psychophysiological arousal covaries with risk-sensitive decision-making outside of a learning context. Our results further highlight the differential sensitivities of EDA and HR to psychological features of the decision scenario.

Sustainable food consumption. Product choice or curtailment?

PubMed

Verain, Muriel C D; Dagevos, Hans; Antonides, Gerrit

2015-08-01

Food consumption is an important factor in shaping the sustainability of our food supply. The present paper empirically explores different types of sustainable food behaviors. A distinction between sustainable product choices and curtailment behavior has been investigated empirically and predictors of the two types of behavior have been identified. Respondents were classified into four segments based on their sustainable food behaviors: unsustainers, curtailers, product-oriented consumers, and sustainers. Significant differences between the segments were found with regard to food choice motives, personal and social norms, food involvement, subjective knowledge on sustainable food, ability to judge how sustainably a product has been produced and socio-demographics. It is concluded that distinguishing between behavioral strategies toward sustainable food consumption is important as consumer segments can be identified that differ both in their level of sustainable food consumption and in the type of behavior they employ. Copyright © 2015 Elsevier Ltd. All rights reserved.

Self-choice enhances value in reward-seeking in primates.

PubMed

Setogawa, Tsuyoshi; Mizuhiki, Takashi; Matsumoto, Narihisa; Akizawa, Fumika; Shidara, Munetaka

2014-03-01

When an individual chooses one item from two or more alternatives, they compare the values of the expected outcomes. The outcome value can be determined by the associated reward amount, the probability of reward, and the workload required to earn the reward. Rational choice theory states that choices are made to maximize rewards over time, and that the same outcome values lead to an equal likelihood of choices. However, the theory does not distinguish between conditions with the same reward value, even when acquired under different circumstances, and does not always accurately describe real behavior. We have found that allowing a monkey to choose a reward schedule endows the schedule with extra value when compared to performance in an identical schedule that is chosen by another agent (a computer here). This behavior is not consistent with pure rational choice theory. Theoretical analysis using a modified temporal-difference learning model showed an enhanced schedule state value by self-choice. These results suggest that an increased reward value underlies the improved performances by self-choice during reward-seeking behavior. Copyright © 2014 Elsevier Ireland Ltd and the Japan Neuroscience Society. All rights reserved.

Do dogs follow behavioral cues from an unreliable human?

PubMed

Takaoka, Akiko; Maeda, Tomomi; Hori, Yusuke; Fujita, Kazuo

2015-03-01

Dogs are known to consistently follow human pointing gestures. In this study, we asked whether dogs "automatically" do this or whether they flexibly adjust their behavior depending upon the reliability of the pointer, demonstrated in an immediately preceding event. We tested pet dogs in a version of the object choice task in which a piece of food was hidden in one of the two containers. In Experiment 1, Phase 1, an experimenter pointed at the baited container; the second container was empty. In Phase 2, after showing the contents of both containers to the dogs, the experimenter pointed at the empty container. In Phase 3, the procedure was exactly as in Phase 1. We compared the dogs' responses to the experimenter's pointing gestures in Phases 1 and 3. Most dogs followed pointing in Phase 1, but many fewer did so in Phase 3. In Experiment 2, dogs followed a new experimenter's pointing in Phase 3 following replication of procedures of Phases 1 and 2 in Experiment 1. This ruled out the possibility that dogs simply lost motivation to participate in the task in later phases. These results suggest that not only dogs are highly skilled at understanding human pointing gestures, but also they make inferences about the reliability of a human who presents cues and consequently modify their behavior flexibly depending on the inference.

Computational Precision of Mental Inference as Critical Source of Human Choice Suboptimality.

PubMed

Drugowitsch, Jan; Wyart, Valentin; Devauchelle, Anne-Dominique; Koechlin, Etienne

2016-12-21

Making decisions in uncertain environments often requires combining multiple pieces of ambiguous information from external cues. In such conditions, human choices resemble optimal Bayesian inference, but typically show a large suboptimal variability whose origin remains poorly understood. In particular, this choice suboptimality might arise from imperfections in mental inference rather than in peripheral stages, such as sensory processing and response selection. Here, we dissociate these three sources of suboptimality in human choices based on combining multiple ambiguous cues. Using a novel quantitative approach for identifying the origin and structure of choice variability, we show that imperfections in inference alone cause a dominant fraction of suboptimal choices. Furthermore, two-thirds of this suboptimality appear to derive from the limited precision of neural computations implementing inference rather than from systematic deviations from Bayes-optimal inference. These findings set an upper bound on the accuracy and ultimate predictability of human choices in uncertain environments. Copyright © 2016 Elsevier Inc. All rights reserved.

Sample Design for Discrete Choice Analysis of Travel Behavior

DOT National Transportation Integrated Search

1978-07-01

Discrete choice models represent the choices of individuals among alternatives such as modes of travel, auto types and destinations. This paper presents a review of the state-of-the-art in designing samples for discrete choice analysis of traveller b...

[Single and Network Neuron Activity of Subthalamic Nucleus at Impulsive and Delayed (Self-Control) Reactions in Choice Behavior].

PubMed

Sidorina, V V; Gerasimova, Yu A; Kuleshova, E P; Merzhanova, G Kh

2015-01-01

During our experiments on cats was investigated the subthalamic neuron activity at different types of behavior in case of reinforcement choice depending on its value and availability. In chronic experiences the multiunit activity in subthalamic nucleus (STN) and orbitofrontal cortex (FC) has been recorded. Multiunit activity was analyzed over frequency and network properties of spikes. It was shown, that STN neurons reaction to different reinforcements and conditional stimulus at short- or long-delay reactions was represented by increasing or decreasing of frequency of single neurons. However the same STN neu- rons responded with increasing of frequency of single neuron during expectation of mix-bread-meat and decreasing--during the meat expectation. It has been revealed, that the number of STN interneuron interactions was authentic more at impulsive behavior than at self-control choice of behavior. The number of interactions between FC and STN neurons within intervals of 0-30 Ms was authentic more at display impulsive than during self-control behavior. These results suppose that FC and STN neurons participate in integration of reinforcement estimation; and distinctions in a choice of behavior are defined by the local and distributed interneuron interactions of STN and FC.

Generalization of value in reinforcement learning by humans.

PubMed

Wimmer, G Elliott; Daw, Nathaniel D; Shohamy, Daphna

2012-04-01

Research in decision-making has focused on the role of dopamine and its striatal targets in guiding choices via learned stimulus-reward or stimulus-response associations, behavior that is well described by reinforcement learning theories. However, basic reinforcement learning is relatively limited in scope and does not explain how learning about stimulus regularities or relations may guide decision-making. A candidate mechanism for this type of learning comes from the domain of memory, which has highlighted a role for the hippocampus in learning of stimulus-stimulus relations, typically dissociated from the role of the striatum in stimulus-response learning. Here, we used functional magnetic resonance imaging and computational model-based analyses to examine the joint contributions of these mechanisms to reinforcement learning. Humans performed a reinforcement learning task with added relational structure, modeled after tasks used to isolate hippocampal contributions to memory. On each trial participants chose one of four options, but the reward probabilities for pairs of options were correlated across trials. This (uninstructed) relationship between pairs of options potentially enabled an observer to learn about option values based on experience with the other options and to generalize across them. We observed blood oxygen level-dependent (BOLD) activity related to learning in the striatum and also in the hippocampus. By comparing a basic reinforcement learning model to one augmented to allow feedback to generalize between correlated options, we tested whether choice behavior and BOLD activity were influenced by the opportunity to generalize across correlated options. Although such generalization goes beyond standard computational accounts of reinforcement learning and striatal BOLD, both choices and striatal BOLD activity were better explained by the augmented model. Consistent with the hypothesized role for the hippocampus in this generalization, functional connectivity between the ventral striatum and hippocampus was modulated, across participants, by the ability of the augmented model to capture participants' choice. Our results thus point toward an interactive model in which striatal reinforcement learning systems may employ relational representations typically associated with the hippocampus. © 2012 The Authors. European Journal of Neuroscience © 2012 Federation of European Neuroscience Societies and Blackwell Publishing Ltd.

Domain-specific rationality in human choices: violations of utility axioms and social contexts.

PubMed

Wang, X T

1996-07-01

This study presents a domain-specific view of human decision rationality. It explores social and ecological domain-specific psychological mechanisms underlying choice biases and violations of utility axioms. Results from both the USA and China revealed a social group domain-specific choice pattern. The irrational preference reversal in a hypothetical life-death decision problem (a classical example of framing effects) was eliminated by providing a small group or family context in which most subjects favored a risky choice option regardless of the positive/negative framing of choice outcomes. The risk preference data also indicate that the subjective scope of small group domain is larger for Chinese subjects, suggesting that human choice mechanisms are sensitive to culturally specific features of group living. A further experiment provided evidence that perceived fairness might be one major factor regulating the choice preferences found in small group (kith-and-kin) contexts. Finally, the violation of the stochastic dominance axiom of the rational theory of choice was predicted and tested. The violations were found only when the "life-death" problem was presented in small group contexts; the strongest violation was found in a family context. These results suggest that human decisions and choices are regulated by domain-specific choice mechanisms designed to solve evolutionary recurrent and adaptively important problems.

Investigating Proenvironmental Behavior: The Case of Commuting Mode Choice

NASA Astrophysics Data System (ADS)

Trinh, Tu Anh; Phuong Linh Le, Thi

2018-04-01

The central aim of this article is to investigate mode choice behavior among commuters in Ho Chi Minh City using disaggregate mode choice model and norm activation theory. A better understanding of commuters’ choice of transport mode provide an opportunity to obtain valuable information on their travel behaviors which help to build a basic for proffering solutions stimulating commuters to switch to public transport, which in turn contribute to deal with traffic problems and environmental issues. Binary logistic regression was employed under disaggregate choice method. Key findings indicated that Demographic factors including Age (-0.308), Married (-9.089), Weather (-8.272); Trip factors including Travel cost (0.437), Travel distance (0.252), and Norm activation theory (Awareness of consequences: AC2 (-1.699), AC4 (2.951), AC6 (-3.523), AC7 (-2.092), AC9 (-3.045), AC11 (+ 2.939), and Personal norms: PN2 (-2.695)) had strong impact on the commuters’ mode choice. Although motorcycle was the major transport mode among commuters, they presented their willingness to switch to bus transport if it had less negative impacts on the environment and their daily living environment.

Need for Uniqueness Determines Reactions to Web-Based Personalized Advertising.

PubMed

Stiglbauer, Barbara; Kovacs, Carrie

2018-01-01

The presented empirical study among a sample of n = 256 participants addressed the relationship between consumers' need for uniqueness and their reactions to web-based personalized advertising. Drawing on regulatory focus theory, we argue that the consumers' need for uniqueness dimensions creative choice and similarity avoidance may relate to promotion and prevention regulatory orientations, respectively. Accordingly, we hypothesized that creative choice and similarity avoidance would differentially predict self-reported approach and avoidance behavior toward personalized advertising. These direct relationships were further expected to be mediated by subjective evaluations of personalized advertising (i.e., perceived value and irritation). In line with these hypotheses, we found that creative choice predicted approach behavior through increased web-based personalized advertising value, whereas similarity avoidance predicted avoidance behavior through increased irritation. Creative choice also predicted decreased irritation, which in turn was related to decreased approach behavior. In sum, the results suggest that the consumers' need for uniqueness dimensions should not be investigated as a composite, as they seem to reflect different regulatory orientations and are therefore likely to evoke different affective, cognitive, and behavioral responses.