Stochastic Frontier Estimation of Efficient Learning in Video Games

ERIC Educational Resources Information Center

Hamlen, Karla R.

2012-01-01

Stochastic Frontier Regression Analysis was used to investigate strategies and skills that are associated with the minimization of time required to achieve proficiency in video games among students in grades four and five. Students self-reported their video game play habits, including strategies and skills used to become good at the video games…

Mean Field Games for Stochastic Growth with Relative Utility

DOE Office of Scientific and Technical Information (OSTI.GOV)

Huang, Minyi, E-mail: mhuang@math.carleton.ca; Nguyen, Son Luu, E-mail: sonluu.nguyen@upr.edu

This paper considers continuous time stochastic growth-consumption optimization in a mean field game setting. The individual capital stock evolution is determined by a Cobb–Douglas production function, consumption and stochastic depreciation. The individual utility functional combines an own utility and a relative utility with respect to the population. The use of the relative utility reflects human psychology, leading to a natural pattern of mean field interaction. The fixed point equation of the mean field game is derived with the aid of some ordinary differential equations. Due to the relative utility interaction, our performance analysis depends on some ratio based approximation errormore » estimate.« less

Stochastic noncooperative and cooperative evolutionary game strategies of a population of biological networks under natural selection.

PubMed

Chen, Bor-Sen; Yeh, Chin-Hsun

2017-12-01

We review current static and dynamic evolutionary game strategies of biological networks and discuss the lack of random genetic variations and stochastic environmental disturbances in these models. To include these factors, a population of evolving biological networks is modeled as a nonlinear stochastic biological system with Poisson-driven genetic variations and random environmental fluctuations (stimuli). To gain insight into the evolutionary game theory of stochastic biological networks under natural selection, the phenotypic robustness and network evolvability of noncooperative and cooperative evolutionary game strategies are discussed from a stochastic Nash game perspective. The noncooperative strategy can be transformed into an equivalent multi-objective optimization problem and is shown to display significantly improved network robustness to tolerate genetic variations and buffer environmental disturbances, maintaining phenotypic traits for longer than the cooperative strategy. However, the noncooperative case requires greater effort and more compromises between partly conflicting players. Global linearization is used to simplify the problem of solving nonlinear stochastic evolutionary games. Finally, a simple stochastic evolutionary model of a metabolic pathway is simulated to illustrate the procedure of solving for two evolutionary game strategies and to confirm and compare their respective characteristics in the evolutionary process. Copyright © 2017 Elsevier B.V. All rights reserved.

The Stochastic Evolutionary Game for a Population of Biological Networks Under Natural Selection

PubMed Central

Chen, Bor-Sen; Ho, Shih-Ju

2014-01-01

In this study, a population of evolutionary biological networks is described by a stochastic dynamic system with intrinsic random parameter fluctuations due to genetic variations and external disturbances caused by environmental changes in the evolutionary process. Since information on environmental changes is unavailable and their occurrence is unpredictable, they can be considered as a game player with the potential to destroy phenotypic stability. The biological network needs to develop an evolutionary strategy to improve phenotypic stability as much as possible, so it can be considered as another game player in the evolutionary process, ie, a stochastic Nash game of minimizing the maximum network evolution level caused by the worst environmental disturbances. Based on the nonlinear stochastic evolutionary game strategy, we find that some genetic variations can be used in natural selection to construct negative feedback loops, efficiently improving network robustness. This provides larger genetic robustness as a buffer against neutral genetic variations, as well as larger environmental robustness to resist environmental disturbances and maintain a network phenotypic traits in the evolutionary process. In this situation, the robust phenotypic traits of stochastic biological networks can be more frequently selected by natural selection in evolution. However, if the harbored neutral genetic variations are accumulated to a sufficiently large degree, and environmental disturbances are strong enough that the network robustness can no longer confer enough genetic robustness and environmental robustness, then the phenotype robustness might break down. In this case, a network phenotypic trait may be pushed from one equilibrium point to another, changing the phenotypic trait and starting a new phase of network evolution through the hidden neutral genetic variations harbored in network robustness by adaptive evolution. Further, the proposed evolutionary game is extended to

A game-theoretic method for cross-layer stochastic resilient control design in CPS

NASA Astrophysics Data System (ADS)

Shen, Jiajun; Feng, Dongqin

2018-03-01

In this paper, the cross-layer security problem of cyber-physical system (CPS) is investigated from the game-theoretic perspective. Physical dynamics of plant is captured by stochastic differential game with cyber-physical influence being considered. The sufficient and necessary condition for the existence of state-feedback equilibrium strategies is given. The attack-defence cyber interactions are formulated by a Stackelberg game intertwined with stochastic differential game in physical layer. The condition such that the Stackelberg equilibrium being unique and the corresponding analytical solutions are both provided. An algorithm is proposed for obtaining hierarchical security strategy by solving coupled games, which ensures the operational normalcy and cyber security of CPS subject to uncertain disturbance and unexpected cyberattacks. Simulation results are given to show the effectiveness and performance of the proposed algorithm.

Age matters: The effect of onset age of video game play on task-switching abilities.

PubMed

Hartanto, Andree; Toh, Wei Xing; Yang, Hwajin

2016-05-01

Although prior research suggests that playing video games can improve cognitive abilities, recent empirical studies cast doubt on such findings (Unsworth et al., 2015). To reconcile these inconsistent findings, we focused on the link between video games and task switching. Furthermore, we conceptualized video-game expertise as the onset age of active video-game play rather than the frequency of recent gameplay, as it captures both how long a person has played video games and whether the individual began playing during periods of high cognitive plasticity. We found that the age of active onset better predicted switch and mixing costs than did frequency of recent gameplay; specifically, players who commenced playing video games at an earlier age reaped greater benefits in terms of task switching than did those who started at a later age. Moreover, improving switch costs required a more extensive period of video-game experience than did mixing costs; this finding suggests that certain cognitive abilities benefit from different amounts of video game experience.

New Results on a Stochastic Duel Game with Each Force Consisting of Heterogeneous Units

DTIC Science & Technology

2013-02-01

NAVAL POSTGRADUATE SCHOOL MONTEREY, CALIFORNIA NEW RESULTS ON A STOCHASTIC DUEL GAME WITH EACH FORCE CONSISTING OF...on a Stochastic Duel Game With Each Force Consisting of Heterogeneous Units 5a. CONTRACT NUMBER 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER...distribution is unlimited 13. SUPPLEMENTARY NOTES 14. ABSTRACT Two forces engage in a duel , with each force initially consisting of several

Robust synthetic biology design: stochastic game theory approach.

PubMed

Chen, Bor-Sen; Chang, Chia-Hung; Lee, Hsiao-Ching

2009-07-15

Synthetic biology is to engineer artificial biological systems to investigate natural biological phenomena and for a variety of applications. However, the development of synthetic gene networks is still difficult and most newly created gene networks are non-functioning due to uncertain initial conditions and disturbances of extra-cellular environments on the host cell. At present, how to design a robust synthetic gene network to work properly under these uncertain factors is the most important topic of synthetic biology. A robust regulation design is proposed for a stochastic synthetic gene network to achieve the prescribed steady states under these uncertain factors from the minimax regulation perspective. This minimax regulation design problem can be transformed to an equivalent stochastic game problem. Since it is not easy to solve the robust regulation design problem of synthetic gene networks by non-linear stochastic game method directly, the Takagi-Sugeno (T-S) fuzzy model is proposed to approximate the non-linear synthetic gene network via the linear matrix inequality (LMI) technique through the Robust Control Toolbox in Matlab. Finally, an in silico example is given to illustrate the design procedure and to confirm the efficiency and efficacy of the proposed robust gene design method. http://www.ee.nthu.edu.tw/bschen/SyntheticBioDesign_supplement.pdf.

A Pumping Algorithm for Ergodic Stochastic Mean Payoff Games with Perfect Information

NASA Astrophysics Data System (ADS)

Boros, Endre; Elbassioni, Khaled; Gurvich, Vladimir; Makino, Kazuhisa

In this paper, we consider two-person zero-sum stochastic mean payoff games with perfect information, or BWR-games, given by a digraph G = (V = V B ∪ V W ∪ V R , E), with local rewards r: E to { R}, and three types of vertices: black V B , white V W , and random V R . The game is played by two players, White and Black: When the play is at a white (black) vertex v, White (Black) selects an outgoing arc (v,u). When the play is at a random vertex v, a vertex u is picked with the given probability p(v,u). In all cases, Black pays White the value r(v,u). The play continues forever, and White aims to maximize (Black aims to minimize) the limiting mean (that is, average) payoff. It was recently shown in [7] that BWR-games are polynomially equivalent with the classical Gillette games, which include many well-known subclasses, such as cyclic games, simple stochastic games (SSG's), stochastic parity games, and Markov decision processes. In this paper, we give a new algorithm for solving BWR-games in the ergodic case, that is when the optimal values do not depend on the initial position. Our algorithm solves a BWR-game by reducing it, using a potential transformation, to a canonical form in which the optimal strategies of both players and the value for every initial position are obvious, since a locally optimal move in it is optimal in the whole game. We show that this algorithm is pseudo-polynomial when the number of random nodes is constant. We also provide an almost matching lower bound on its running time, and show that this bound holds for a wider class of algorithms. Let us add that the general (non-ergodic) case is at least as hard as SSG's, for which no pseudo-polynomial algorithm is known.

Adaptive Neural Tracking Control for Switched High-Order Stochastic Nonlinear Systems.

PubMed

Zhao, Xudong; Wang, Xinyong; Zong, Guangdeng; Zheng, Xiaolong

2017-10-01

This paper deals with adaptive neural tracking control design for a class of switched high-order stochastic nonlinear systems with unknown uncertainties and arbitrary deterministic switching. The considered issues are: 1) completely unknown uncertainties; 2) stochastic disturbances; and 3) high-order nonstrict-feedback system structure. The considered mathematical models can represent many practical systems in the actual engineering. By adopting the approximation ability of neural networks, common stochastic Lyapunov function method together with adding an improved power integrator technique, an adaptive state feedback controller with multiple adaptive laws is systematically designed for the systems. Subsequently, a controller with only two adaptive laws is proposed to solve the problem of over parameterization. Under the designed controllers, all the signals in the closed-loop system are bounded-input bounded-output stable in probability, and the system output can almost surely track the target trajectory within a specified bounded error. Finally, simulation results are presented to show the effectiveness of the proposed approaches.

Persistence and extinction of a stochastic single-species model under regime switching in a polluted environment II.

PubMed

Liu, Meng; Wang, Ke

2010-12-07

This is a continuation of our paper [Liu, M., Wang, K., 2010. Persistence and extinction of a stochastic single-species model under regime switching in a polluted environment, J. Theor. Biol. 264, 934-944]. Taking both white noise and colored noise into account, a stochastic single-species model under regime switching in a polluted environment is studied. Sufficient conditions for extinction, stochastic nonpersistence in the mean, stochastic weak persistence and stochastic permanence are established. The threshold between stochastic weak persistence and extinction is obtained. The results show that a different type of noise has a different effect on the survival results. Copyright © 2010 Elsevier Ltd. All rights reserved.

Stochastic differential game formulation on the reinsurance and investment problem

NASA Astrophysics Data System (ADS)

Li, Danping; Rong, Ximin; Zhao, Hui

2015-09-01

This paper focuses on a stochastic differential game between two insurance companies, a big one and a small one. The big company has sufficient asset to invest in a risk-free asset and a risky asset and is allowed to purchase proportional reinsurance or acquire new business, and the small company can transfer part of the risk to a reinsurer via proportional reinsurance. The game studied here is zero-sum, where the big company is trying to maximise the expected exponential utility of the difference between two insurance companies' surpluses at the terminal time to keep its advantage on surplus, while simultaneously the small company is trying to minimise the same quantity to reduce its disadvantage. Particularly, the relationships between the surplus processes and the price process of the risky asset are considered. By applying stochastic control theory, we provide and prove the verification theorem and obtain the Nash equilibrium strategy of the game, explicitly. Furthermore, numerical simulations are presented to illustrate the effects of parameters on the equilibrium strategy as well as the economic meanings behind.

Output regulation control for switched stochastic delay systems with dissipative property under error-dependent switching

NASA Astrophysics Data System (ADS)

Li, L. L.; Jin, C. L.; Ge, X.

2018-01-01

In this paper, the output regulation problem with dissipative property for a class of switched stochastic delay systems is investigated, based on an error-dependent switching law. Under the assumption that none subsystem is solvable for the problem, a sufficient condition is derived by structuring multiple Lyapunov-Krasovskii functionals with respect to multiple supply rates, via designing error feedback regulators. The condition is also established when dissipative property reduces to passive property. Finally, two numerical examples are given to demonstrate the feasibility and efficiency of the present method.

Correlated noise-based switches and stochastic resonance in a bistable genetic regulation system

NASA Astrophysics Data System (ADS)

Wang, Can-Jun; Yang, Ke-Li

2016-07-01

The correlated noise-based switches and stochastic resonance are investigated in a bistable single gene switching system driven by an additive noise (environmental fluctuations), a multiplicative noise (fluctuations of the degradation rate). The correlation between the two noise sources originates from on the lysis-lysogeny pathway system of the λ phage. The steady state probability distribution is obtained by solving the time-independent Fokker-Planck equation, and the effects of noises are analyzed. The effects of noises on the switching time between the two stable states (mean first passage time) is investigated by the numerical simulation. The stochastic resonance phenomenon is analyzed by the power amplification factor. The results show that the multiplicative noise can induce the switching from "on" → "off" of the protein production, while the additive noise and the correlation between the noise sources can induce the inverse switching "off" → "on". A nonmonotonic behaviour of the average switching time versus the multiplicative noise intensity, for different cross-correlation and additive noise intensities, is observed in the genetic system. There exist optimal values of the additive noise, multiplicative noise and cross-correlation intensities for which the weak signal can be optimal amplified.

Stochastic Local Search for Core Membership Checking in Hedonic Games

NASA Astrophysics Data System (ADS)

Keinänen, Helena

Hedonic games have emerged as an important tool in economics and show promise as a useful formalism to model multi-agent coalition formation in AI as well as group formation in social networks. We consider a coNP-complete problem of core membership checking in hedonic coalition formation games. No previous algorithms to tackle the problem have been presented. In this work, we overcome this by developing two stochastic local search algorithms for core membership checking in hedonic games. We demonstrate the usefulness of the algorithms by showing experimentally that they find solutions efficiently, particularly for large agent societies.

Impact of deterministic and stochastic updates on network reciprocity in the prisoner's dilemma game

NASA Astrophysics Data System (ADS)

Tanimoto, Jun

2014-08-01

In 2 × 2 prisoner's dilemma games, network reciprocity is one mechanism for adding social viscosity, which leads to cooperative equilibrium. This study introduced an intriguing framework for the strategy update rule that allows any combination of a purely deterministic method, imitation max (IM), and a purely probabilistic one, pairwise Fermi (Fermi-PW). A series of simulations covering the whole range from IM to Fermi-PW reveals that, as a general tendency, the larger fractions of stochastic updating reduce network reciprocity, so long as the underlying lattice contains no noise in the degree of distribution. However, a small amount of stochastic flavor added to an otherwise perfectly deterministic update rule was actually found to enhance network reciprocity. This occurs because a subtle stochastic effect in the update rule improves the evolutionary trail in games having more stag-hunt-type dilemmas, although the same stochastic effect degenerates evolutionary trails in games having more chicken-type dilemmas. We explain these effects by dividing evolutionary trails into the enduring and expanding periods defined by Shigaki et al. [Phys. Rev. E 86, 031141 (2012), 10.1103/PhysRevE.86.031141].

Fixation of strategies driven by switching probabilities in evolutionary games

NASA Astrophysics Data System (ADS)

Xu, Zimin; Zhang, Jianlei; Zhang, Chunyan; Chen, Zengqiang

2016-12-01

We study the evolutionary dynamics of strategies in finite populations which are homogeneous and well mixed by means of the pairwise comparison process, the core of which is the proposed switching probability. Previous studies about this subject are usually based on the known payoff comparison of the related players, which is an ideal assumption. In real social systems, acquiring the accurate payoffs of partners at each round of interaction may be not easy. So we bypass the need of explicit knowledge of payoffs, and encode the payoffs into the willingness of any individual shift from her current strategy to the competing one, and the switching probabilities are wholly independent of payoffs. Along this way, the strategy updating can be performed when game models are fixed and payoffs are unclear, expected to extend ideal assumptions to be more realistic one. We explore the impact of the switching probability on the fixation probability and derive a simple formula which determines the fixation probability. Moreover we find that cooperation dominates defection if the probability of cooperation replacing defection is always larger than the probability of defection replacing cooperation in finite populations. Last, we investigate the influences of model parameters on the fixation of strategies in the framework of three concrete game models: prisoner's dilemma, snowdrift game and stag-hunt game, which effectively portray the characteristics of cooperative dilemmas in real social systems.

Evolutionary prisoner's dilemma games on the network with punishment and opportunistic partner switching

NASA Astrophysics Data System (ADS)

Takesue, H.

2018-02-01

Punishment and partner switching are two well-studied mechanisms that support the evolution of cooperation. Observation of human behaviour suggests that the extent to which punishment is adopted depends on the usage of alternative mechanisms, including partner switching. In this study, we investigate the combined effect of punishment and partner switching in evolutionary prisoner's dilemma games conducted on a network. In the model, agents are located on the network and participate in the prisoner's dilemma games with punishment. In addition, they can opportunistically switch interaction partners to improve their payoff. Our Monte Carlo simulation showed that a large frequency of punishers is required to suppress defectors when the frequency of partner switching is low. In contrast, cooperation is the most abundant strategy when the frequency of partner switching is high regardless of the strength of punishment. Interestingly, cooperators become abundant not because they avoid the cost of inflicting punishment and earn a larger average payoff per game but rather because they have more numerous opportunities to be referred to as a role agent by defectors. Our results imply that the fluidity of social relationships has a profound effect on the adopted strategy in maintaining cooperation.

Stochastic evolutionary voluntary public goods game with punishment in a Quasi-birth-and-death process.

PubMed

Quan, Ji; Liu, Wei; Chu, Yuqing; Wang, Xianjia

2017-11-23

Traditional replication dynamic model and the corresponding concept of evolutionary stable strategy (ESS) only takes into account whether the system can return to the equilibrium after being subjected to a small disturbance. In the real world, due to continuous noise, the ESS of the system may not be stochastically stable. In this paper, a model of voluntary public goods game with punishment is studied in a stochastic situation. Unlike the existing model, we describe the evolutionary process of strategies in the population as a generalized quasi-birth-and-death process. And we investigate the stochastic stable equilibrium (SSE) instead. By numerical experiments, we get all possible SSEs of the system for any combination of parameters, and investigate the influence of parameters on the probabilities of the system to select different equilibriums. It is found that in the stochastic situation, the introduction of the punishment and non-participation strategies can change the evolutionary dynamics of the system and equilibrium of the game. There is a large range of parameters that the system selects the cooperative states as its SSE with a high probability. This result provides us an insight and control method for the evolution of cooperation in the public goods game in stochastic situations.

Switching of bound vector solitons for the coupled nonlinear Schrödinger equations with nonhomogenously stochastic perturbations

NASA Astrophysics Data System (ADS)

Sun, Zhi-Yuan; Gao, Yi-Tian; Yu, Xin; Liu, Ying

2012-12-01

We investigate the dynamics of the bound vector solitons (BVSs) for the coupled nonlinear Schrödinger equations with the nonhomogenously stochastic perturbations added on their dispersion terms. Soliton switching (besides soliton breakup) can be observed between the two components of the BVSs. Rate of the maximum switched energy (absolute values) within the fixed propagation distance (about 10 periods of the BVSs) enhances in the sense of statistics when the amplitudes of stochastic perturbations increase. Additionally, it is revealed that the BVSs with enhanced coherence are more robust against the perturbations with nonhomogenous stochasticity. Diagram describing the approximate borders of the splitting and non-splitting areas is also given. Our results might be helpful in dynamics of the BVSs with stochastic noises in nonlinear optical fibers or with stochastic quantum fluctuations in Bose-Einstein condensates.

Switching of bound vector solitons for the coupled nonlinear Schrödinger equations with nonhomogenously stochastic perturbations.

PubMed

Sun, Zhi-Yuan; Gao, Yi-Tian; Yu, Xin; Liu, Ying

2012-12-01

We investigate the dynamics of the bound vector solitons (BVSs) for the coupled nonlinear Schrödinger equations with the nonhomogenously stochastic perturbations added on their dispersion terms. Soliton switching (besides soliton breakup) can be observed between the two components of the BVSs. Rate of the maximum switched energy (absolute values) within the fixed propagation distance (about 10 periods of the BVSs) enhances in the sense of statistics when the amplitudes of stochastic perturbations increase. Additionally, it is revealed that the BVSs with enhanced coherence are more robust against the perturbations with nonhomogenous stochasticity. Diagram describing the approximate borders of the splitting and non-splitting areas is also given. Our results might be helpful in dynamics of the BVSs with stochastic noises in nonlinear optical fibers or with stochastic quantum fluctuations in Bose-Einstein condensates.

Modeling and Computation of Transboundary Industrial Pollution with Emission Permits Trading by Stochastic Differential Game

PubMed Central

2015-01-01

Transboundary industrial pollution requires international actions to control its formation and effects. In this paper, we present a stochastic differential game to model the transboundary industrial pollution problems with emission permits trading. More generally, the process of emission permits price is assumed to be stochastic and to follow a geometric Brownian motion (GBM). We make use of stochastic optimal control theory to derive the system of Hamilton-Jacobi-Bellman (HJB) equations satisfied by the value functions for the cooperative and the noncooperative games, respectively, and then propose a so-called fitted finite volume method to solve it. The efficiency and the usefulness of this method are illustrated by the numerical experiments. The two regions’ cooperative and noncooperative optimal emission paths, which maximize the regions’ discounted streams of the net revenues, together with the value functions, are obtained. Additionally, we can also obtain the threshold conditions for the two regions to decide whether they cooperate or not in different cases. The effects of parameters in the established model on the results have been also examined. All the results demonstrate that the stochastic emission permits prices can motivate the players to make more flexible strategic decisions in the games. PMID:26402322

Modeling and Computation of Transboundary Industrial Pollution with Emission Permits Trading by Stochastic Differential Game.

PubMed

Chang, Shuhua; Wang, Xinyu; Wang, Zheng

2015-01-01

Transboundary industrial pollution requires international actions to control its formation and effects. In this paper, we present a stochastic differential game to model the transboundary industrial pollution problems with emission permits trading. More generally, the process of emission permits price is assumed to be stochastic and to follow a geometric Brownian motion (GBM). We make use of stochastic optimal control theory to derive the system of Hamilton-Jacobi-Bellman (HJB) equations satisfied by the value functions for the cooperative and the noncooperative games, respectively, and then propose a so-called fitted finite volume method to solve it. The efficiency and the usefulness of this method are illustrated by the numerical experiments. The two regions' cooperative and noncooperative optimal emission paths, which maximize the regions' discounted streams of the net revenues, together with the value functions, are obtained. Additionally, we can also obtain the threshold conditions for the two regions to decide whether they cooperate or not in different cases. The effects of parameters in the established model on the results have been also examined. All the results demonstrate that the stochastic emission permits prices can motivate the players to make more flexible strategic decisions in the games.

Stochastic Evolution Dynamic of the Rock-Scissors-Paper Game Based on a Quasi Birth and Death Process

NASA Astrophysics Data System (ADS)

Yu, Qian; Fang, Debin; Zhang, Xiaoling; Jin, Chen; Ren, Qiyu

2016-06-01

Stochasticity plays an important role in the evolutionary dynamic of cyclic dominance within a finite population. To investigate the stochastic evolution process of the behaviour of bounded rational individuals, we model the Rock-Scissors-Paper (RSP) game as a finite, state dependent Quasi Birth and Death (QBD) process. We assume that bounded rational players can adjust their strategies by imitating the successful strategy according to the payoffs of the last round of the game, and then analyse the limiting distribution of the QBD process for the game stochastic evolutionary dynamic. The numerical experiments results are exhibited as pseudo colour ternary heat maps. Comparisons of these diagrams shows that the convergence property of long run equilibrium of the RSP game in populations depends on population size and the parameter of the payoff matrix and noise factor. The long run equilibrium is asymptotically stable, neutrally stable and unstable respectively according to the normalised parameters in the payoff matrix. Moreover, the results show that the distribution probability becomes more concentrated with a larger population size. This indicates that increasing the population size also increases the convergence speed of the stochastic evolution process while simultaneously reducing the influence of the noise factor.

Stochastic Evolution Dynamic of the Rock-Scissors-Paper Game Based on a Quasi Birth and Death Process.

PubMed

Yu, Qian; Fang, Debin; Zhang, Xiaoling; Jin, Chen; Ren, Qiyu

2016-06-27

Stochasticity plays an important role in the evolutionary dynamic of cyclic dominance within a finite population. To investigate the stochastic evolution process of the behaviour of bounded rational individuals, we model the Rock-Scissors-Paper (RSP) game as a finite, state dependent Quasi Birth and Death (QBD) process. We assume that bounded rational players can adjust their strategies by imitating the successful strategy according to the payoffs of the last round of the game, and then analyse the limiting distribution of the QBD process for the game stochastic evolutionary dynamic. The numerical experiments results are exhibited as pseudo colour ternary heat maps. Comparisons of these diagrams shows that the convergence property of long run equilibrium of the RSP game in populations depends on population size and the parameter of the payoff matrix and noise factor. The long run equilibrium is asymptotically stable, neutrally stable and unstable respectively according to the normalised parameters in the payoff matrix. Moreover, the results show that the distribution probability becomes more concentrated with a larger population size. This indicates that increasing the population size also increases the convergence speed of the stochastic evolution process while simultaneously reducing the influence of the noise factor.

Confinement and diffusion modulate bistability and stochastic switching in a reaction network with positive feedback

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mlynarczyk, Paul J.; Pullen, Robert H.; Abel, Steven M., E-mail: abel@utk.edu

2016-01-07

Positive feedback is a common feature in signal transduction networks and can lead to phenomena such as bistability and signal propagation by domain growth. Physical features of the cellular environment, such as spatial confinement and the mobility of proteins, play important but inadequately understood roles in shaping the behavior of signaling networks. Here, we use stochastic, spatially resolved kinetic Monte Carlo simulations to explore a positive feedback network as a function of system size, system shape, and mobility of molecules. We show that these physical properties can markedly alter characteristics of bistability and stochastic switching when compared with well-mixed simulations.more » Notably, systems of equal volume but different shapes can exhibit qualitatively different behaviors under otherwise identical conditions. We show that stochastic switching to a state maintained by positive feedback occurs by cluster formation and growth. Additionally, the frequency at which switching occurs depends nontrivially on the diffusion coefficient, which can promote or suppress switching relative to the well-mixed limit. Taken together, the results provide a framework for understanding how confinement and protein mobility influence emergent features of the positive feedback network by modulating molecular concentrations, diffusion-influenced rate parameters, and spatiotemporal correlations between molecules.« less

Task switching in video game players: Benefits of selective attention but not resistance to proactive interference.

PubMed

Karle, James W; Watter, Scott; Shedden, Judith M

2010-05-01

Research into the perceptual and cognitive effects of playing video games is an area of increasing interest for many investigators. Over the past decade, expert video game players (VGPs) have been shown to display superior performance compared to non-video game players (nVGPs) on a range of visuospatial and attentional tasks. A benefit of video game expertise has recently been shown for task switching, suggesting that VGPs also have superior cognitive control abilities compared to nVGPs. In two experiments, we examined which aspects of task switching performance this VGP benefit may be localized to. With minimal trial-to-trial interference from minimally overlapping task set rules, VGPs demonstrated a task switching benefit compared to nVGPs. However, this benefit disappeared when proactive interference between tasks was increased, with substantial stimulus and response overlap in task set rules. We suggest that VGPs have no generalized benefit in task switching-related cognitive control processes compared to nVGPs, with switch cost reductions due instead to a specific benefit in controlling selective attention. Copyright 2009 Elsevier B.V. All rights reserved.

Stochastic dynamics and stable equilibrium of evolutionary optional public goods game in finite populations

NASA Astrophysics Data System (ADS)

Quan, Ji; Liu, Wei; Chu, Yuqing; Wang, Xianjia

2018-07-01

Continuous noise caused by mutation is widely present in evolutionary systems. Considering the noise effects and under the optional participation mechanism, a stochastic model for evolutionary public goods game in a finite size population is established. The evolutionary process of strategies in the population is described as a multidimensional ergodic and continuous time Markov process. The stochastic stable state of the system is analyzed by the limit distribution of the stochastic process. By numerical experiments, the influences of the fixed income coefficient for non-participants and the investment income coefficient of the public goods on the stochastic stable equilibrium of the system are analyzed. Through the numerical calculation results, we found that the optional participation mechanism can change the evolutionary dynamics and the equilibrium of the public goods game, and there is a range of parameters which can effectively promote the evolution of cooperation. Further, we obtain the accurate quantitative relationship between the parameters and the probabilities for the system to choose different stable equilibriums, which can be used to realize the control of cooperation.

Adaptive output-feedback control for switched stochastic uncertain nonlinear systems with time-varying delay.

PubMed

Song, Zhibao; Zhai, Junyong

2018-04-01

This paper addresses the problem of adaptive output-feedback control for a class of switched stochastic time-delay nonlinear systems with uncertain output function, where both the control coefficients and time-varying delay are unknown. The drift and diffusion terms are subject to unknown homogeneous growth condition. By virtue of adding a power integrator technique, an adaptive output-feedback controller is designed to render that the closed-loop system is bounded in probability, and the state of switched stochastic nonlinear system can be globally regulated to the origin almost surely. A numerical example is provided to demonstrate the validity of the proposed control method. Copyright © 2018 ISA. Published by Elsevier Ltd. All rights reserved.

Persistence and ergodicity of a stochastic single species model with Allee effect under regime switching

NASA Astrophysics Data System (ADS)

Yu, Xingwang; Yuan, Sanling; Zhang, Tonghua

2018-06-01

Allee effect can interact with environment stochasticity and is active when population numbers are small. Our goal of this paper is to investigate such effect on population dynamics. More precisely, we develop and investigate a stochastic single species model with Allee effect under regime switching. We first prove the existence of global positive solution of the model. Then, we perform the survival analysis to seek sufficient conditions for the extinction, non-persistence in mean, persistence in mean and stochastic permanence. By constructing a suitable Lyapunov function, we show that the model is positive recurrent and ergodic. Our results indicate that the regime switching can suppress the extinction of the species. Finally, numerical simulations are carried out to illustrate the obtained theoretical results, where a real-life example is also discussed showing the inclusion of Allee effect in the model provides a better match to the data.

Adaptive role switching promotes fairness in networked ultimatum game.

PubMed

Wu, Te; Fu, Feng; Zhang, Yanling; Wang, Long

2013-01-01

In recent years, mechanisms favoring fair split in the ultimatum game have attracted growing interests because of its practical implications for international bargains. In this game, two players are randomly assigned two different roles respectively to split an offer: the proposer suggests how to split and the responder decides whether or not to accept it. Only when both agree is the offer successfully split; otherwise both get nothing. It is of importance and interest to break the symmetry in role assignment especially when the game is repeatedly played in a heterogeneous population. Here we consider an adaptive role assignment: whenever the split fails, the two players switch their roles probabilistically. The results show that this simple feedback mechanism proves much more effective at promoting fairness than other alternatives (where, for example, the role assignment is based on the number of neighbors).

Permanence and asymptotic behaviors of stochastic predator-prey system with Markovian switching and Lévy noise

NASA Astrophysics Data System (ADS)

Wang, Sheng; Wang, Linshan; Wei, Tengda

2018-04-01

This paper concerns the dynamics of a stochastic predator-prey system with Markovian switching and Lévy noise. First, the existence and uniqueness of global positive solution to the system is proved. Then, by combining stochastic analytical techniques with M-matrix analysis, sufficient conditions of stochastic permanence and extinction are obtained. Furthermore, for the stochastic permanence case, by means of four constants related to the stationary probability distribution of the Markov chain and the parameters of the subsystems, both the superior limit and the inferior limit of the average in time of the sample path of the solution are estimated. Finally, our conclusions are illustrated through an example.

Dissociable effects of game elements on motivation and cognition in a task-switching training in middle childhood

PubMed Central

Dörrenbächer, Sandra; Müller, Philipp M.; Tröger, Johannes; Kray, Jutta

2014-01-01

Although motivational reinforcers are often used to enhance the attractiveness of trainings of cognitive control in children, little is known about how such motivational manipulations of the setting contribute to separate gains in motivation and cognitive-control performance. Here we provide a framework for systematically investigating the impact of a motivational video-game setting on the training motivation, the task performance, and the transfer success in a task-switching training in middle-aged children (8–11 years of age). We manipulated both the type of training (low-demanding/single-task training vs. high-demanding/task-switching training) as well as the motivational setting (low-motivational/without video-game elements vs. high-motivational/with video-game elements) separately from another. The results indicated that the addition of game elements to a training setting enhanced the intrinsic interest in task practice, independently of the cognitive demands placed by the training type. In the task-switching group, the high-motivational training setting led to an additional enhancement of task and switching performance during the training phase right from the outset. These motivation-induced benefits projected onto the switching performance in a switching situation different from the trained one (near-transfer measurement). However, in structurally dissimilar cognitive tasks (far-transfer measurement), the motivational gains only transferred to the response dynamics (speed of processing). Hence, the motivational setting clearly had a positive impact on the training motivation and on the paradigm-specific task-switching abilities; it did not, however, consistently generalize on broad cognitive processes. These findings shed new light on the conflation of motivation and cognition in childhood and may help to refine guidelines for designing adequate training interventions. PMID:25431564

Neural Mechanism for Stochastic Behavior During a Competitive Game

PubMed Central

Soltani, Alireza; Lee, Daeyeol; Wang, Xiao-Jing

2006-01-01

Previous studies have shown that non-human primates can generate highly stochastic choice behavior, especially when this is required during a competitive interaction with another agent. To understand the neural mechanism of such dynamic choice behavior, we propose a biologically plausible model of decision making endowed with synaptic plasticity that follows a reward-dependent stochastic Hebbian learning rule. This model constitutes a biophysical implementation of reinforcement learning, and it reproduces salient features of behavioral data from an experiment with monkeys playing a matching pennies game. Due to interaction with an opponent and learning dynamics, the model generates quasi-random behavior robustly in spite of intrinsic biases. Furthermore, non-random choice behavior can also emerge when the model plays against a non-interactive opponent, as observed in the monkey experiment. Finally, when combined with a meta-learning algorithm, our model accounts for the slow drift in the animal’s strategy based on a process of reward maximization. PMID:17015181

Stochastic gradient ascent outperforms gamers in the Quantum Moves game

NASA Astrophysics Data System (ADS)

Sels, Dries

2018-04-01

In a recent work on quantum state preparation, Sørensen and co-workers [Nature (London) 532, 210 (2016), 10.1038/nature17620] explore the possibility of using video games to help design quantum control protocols. The authors present a game called "Quantum Moves" (https://www.scienceathome.org/games/quantum-moves/) in which gamers have to move an atom from A to B by means of optical tweezers. They report that, "players succeed where purely numerical optimization fails." Moreover, by harnessing the player strategies, they can "outperform the most prominent established numerical methods." The aim of this Rapid Communication is to analyze the problem in detail and show that those claims are untenable. In fact, without any prior knowledge and starting from a random initial seed, a simple stochastic local optimization method finds near-optimal solutions which outperform all players. Counterdiabatic driving can even be used to generate protocols without resorting to numeric optimization. The analysis results in an accurate analytic estimate of the quantum speed limit which, apart from zero-point motion, is shown to be entirely classical in nature. The latter might explain why gamers are reasonably good at the game. A simple modification of the BringHomeWater challenge is proposed to test this hypothesis.

Stochastic Spiking Neural Networks Enabled by Magnetic Tunnel Junctions: From Nontelegraphic to Telegraphic Switching Regimes

NASA Astrophysics Data System (ADS)

Liyanagedera, Chamika M.; Sengupta, Abhronil; Jaiswal, Akhilesh; Roy, Kaushik

2017-12-01

Stochastic spiking neural networks based on nanoelectronic spin devices can be a possible pathway to achieving "brainlike" compact and energy-efficient cognitive intelligence. The computational model attempt to exploit the intrinsic device stochasticity of nanoelectronic synaptic or neural components to perform learning or inference. However, there has been limited analysis on the scaling effect of stochastic spin devices and its impact on the operation of such stochastic networks at the system level. This work attempts to explore the design space and analyze the performance of nanomagnet-based stochastic neuromorphic computing architectures for magnets with different barrier heights. We illustrate how the underlying network architecture must be modified to account for the random telegraphic switching behavior displayed by magnets with low barrier heights as they are scaled into the superparamagnetic regime. We perform a device-to-system-level analysis on a deep neural-network architecture for a digit-recognition problem on the MNIST data set.

Finite-time synchronization of stochastic coupled neural networks subject to Markovian switching and input saturation.

PubMed

Selvaraj, P; Sakthivel, R; Kwon, O M

2018-06-07

This paper addresses the problem of finite-time synchronization of stochastic coupled neural networks (SCNNs) subject to Markovian switching, mixed time delay, and actuator saturation. In addition, coupling strengths of the SCNNs are characterized by mutually independent random variables. By utilizing a simple linear transformation, the problem of stochastic finite-time synchronization of SCNNs is converted into a mean-square finite-time stabilization problem of an error system. By choosing a suitable mode dependent switched Lyapunov-Krasovskii functional, a new set of sufficient conditions is derived to guarantee the finite-time stability of the error system. Subsequently, with the help of anti-windup control scheme, the actuator saturation risks could be mitigated. Moreover, the derived conditions help to optimize estimation of the domain of attraction by enlarging the contractively invariant set. Furthermore, simulations are conducted to exhibit the efficiency of proposed control scheme. Copyright © 2018 Elsevier Ltd. All rights reserved.

Stochastic Stability in Internet Router Congestion Games

NASA Astrophysics Data System (ADS)

Chung, Christine; Pyrga, Evangelia

Congestion control at bottleneck routers on the internet is a long standing problem. Many policies have been proposed for effective ways to drop packets from the queues of these routers so that network endpoints will be inclined to share router capacity fairly and minimize the overflow of packets trying to enter the queues. We study just how effective some of these queuing policies are when each network endpoint is a self-interested player with no information about the other players’ actions or preferences. By employing the adaptive learning model of evolutionary game theory, we study policies such as Droptail, RED, and the greedy-flow-punishing policy proposed by Gao et al. [10] to find the stochastically stable states: the states of the system that will be reached in the long run.

Adaptive tracking control for a class of stochastic switched systems

NASA Astrophysics Data System (ADS)

Zhang, Hui; Xia, Yuanqing

2018-02-01

The problem of adaptive tracking is considered for a class of stochastic switched systems, in this paper. As preliminaries, the criterion of global asymptotical practical stability in probability is first presented by the aid of common Lyapunov function method. Based on the Lyapunov stability criterion, adaptive backstepping controllers are designed to guarantee that the closed-loop system has a unique global solution, which is globally asymptotically practically stable in probability, and the tracking error in the fourth moment converges to an arbitrarily small neighbourhood of zero. Simulation examples are given to demonstrate the efficiency of the proposed schemes.

Game-based training of flexibility and attention improves task-switch performance: near and far transfer of cognitive training in an EEG study.

PubMed

Olfers, Kerwin J F; Band, Guido P H

2018-01-01

There is a demand for ways to enhance cognitive flexibility, as it can be a limiting factor for performance in daily life. Video game training has been linked to advantages in cognitive functioning, raising the question if training with video games can promote cognitive flexibility. In the current study, we investigated if game-based computerized cognitive training (GCCT) could enhance cognitive flexibility in a healthy young adult sample (N = 72), as measured by task-switch performance. Three GCCT schedules were contrasted, which targeted: (1) cognitive flexibility and task switching, (2) attention and working memory, or (3) an active control involving basic math games, in twenty 45-min sessions across 4-6 weeks. Performance on an alternating-runs task-switch paradigm during pretest and posttest sessions indicated greater overall reaction time improvements after both flexibility and attention training as compared to control, although not related to local switch cost. Flexibility training enhanced performance in the presence of distractor-related interference. In contrast, attention training was beneficial when low task difficulty undermined sustained selective attention. Furthermore, flexibility training improved response selection as indicated by a larger N2 amplitude after training as compared to control, and more efficient conflict monitoring as indicated by reduced Nc/CRN and larger Pe amplitude after training. These results provide tentative support for the efficacy of GCCT and suggest that an ideal training might include both task switching and attention components, with maximal task diversity both within and between training games.

A novel adaptive switching function on fault tolerable sliding mode control for uncertain stochastic systems.

PubMed

Zahiripour, Seyed Ali; Jalali, Ali Akbar

2014-09-01

A novel switching function based on an optimization strategy for the sliding mode control (SMC) method has been provided for uncertain stochastic systems subject to actuator degradation such that the closed-loop system is globally asymptotically stable with probability one. In the previous researches the focus on sliding surface has been on proportional or proportional-integral function of states. In this research, from a degree of freedom that depends on designer choice is used to meet certain objectives. In the design of the switching function, there is a parameter which the designer can regulate for specified objectives. A sliding-mode controller is synthesized to ensure the reachability of the specified switching surface, despite actuator degradation and uncertainties. Finally, the simulation results demonstrate the effectiveness of the proposed method. Copyright © 2014 ISA. Published by Elsevier Ltd. All rights reserved.

Mapping of the stochastic Lotka-Volterra model to models of population genetics and game theory

NASA Astrophysics Data System (ADS)

Constable, George W. A.; McKane, Alan J.

2017-08-01

The relationship between the M -species stochastic Lotka-Volterra competition (SLVC) model and the M -allele Moran model of population genetics is explored via timescale separation arguments. When selection for species is weak and the population size is large but finite, precise conditions are determined for the stochastic dynamics of the SLVC model to be mappable to the neutral Moran model, the Moran model with frequency-independent selection, and the Moran model with frequency-dependent selection (equivalently a game-theoretic formulation of the Moran model). We demonstrate how these mappings can be used to calculate extinction probabilities and the times until a species' extinction in the SLVC model.

Relatively slow stochastic gene-state switching in the presence of positive feedback significantly broadens the region of bimodality through stabilizing the uninduced phenotypic state.

PubMed

Ge, Hao; Wu, Pingping; Qian, Hong; Xie, Xiaoliang Sunney

2018-03-01

Within an isogenic population, even in the same extracellular environment, individual cells can exhibit various phenotypic states. The exact role of stochastic gene-state switching regulating the transition among these phenotypic states in a single cell is not fully understood, especially in the presence of positive feedback. Recent high-precision single-cell measurements showed that, at least in bacteria, switching in gene states is slow relative to the typical rates of active transcription and translation. Hence using the lac operon as an archetype, in such a region of operon-state switching, we present a fluctuating-rate model for this classical gene regulation module, incorporating the more realistic operon-state switching mechanism that was recently elucidated. We found that the positive feedback mechanism induces bistability (referred to as deterministic bistability), and that the parameter range for its occurrence is significantly broadened by stochastic operon-state switching. We further show that in the absence of positive feedback, operon-state switching must be extremely slow to trigger bistability by itself. However, in the presence of positive feedback, which stabilizes the induced state, the relatively slow operon-state switching kinetics within the physiological region are sufficient to stabilize the uninduced state, together generating a broadened parameter region of bistability (referred to as stochastic bistability). We illustrate the opposite phenotype-transition rate dependence upon the operon-state switching rates in the two types of bistability, with the aid of a recently proposed rate formula for fluctuating-rate models. The rate formula also predicts a maximal transition rate in the intermediate region of operon-state switching, which is validated by numerical simulations in our model. Overall, our findings suggest a biological function of transcriptional "variations" among genetically identical cells, for the emergence of bistability and

Video game practice optimizes executive control skills in dual-task and task switching situations.

PubMed

Strobach, Tilo; Frensch, Peter A; Schubert, Torsten

2012-05-01

We examined the relation of action video game practice and the optimization of executive control skills that are needed to coordinate two different tasks. As action video games are similar to real life situations and complex in nature, and include numerous concurrent actions, they may generate an ideal environment for practicing these skills (Green & Bavelier, 2008). For two types of experimental paradigms, dual-task and task switching respectively; we obtained performance advantages for experienced video gamers compared to non-gamers in situations in which two different tasks were processed simultaneously or sequentially. This advantage was absent in single-task situations. These findings indicate optimized executive control skills in video gamers. Similar findings in non-gamers after 15 h of action video game practice when compared to non-gamers with practice on a puzzle game clarified the causal relation between video game practice and the optimization of executive control skills. Copyright © 2012 Elsevier B.V. All rights reserved.

The coevolution of partner switching and strategy updating in non-excludable public goods game

NASA Astrophysics Data System (ADS)

Li, Yixiao; Shen, Bin

2013-10-01

Spatial public goods game is a popular metaphor to model the dilemma of collective cooperation on graphs, yet the non-excludable property of public goods has seldom been considered in previous models. Based upon a coevolutionary model where agents play public goods games and adjust their partnerships, the present model incorporates the non-excludable property of public goods: agents are able to adjust their participation in the games hosted by others, whereas they cannot exclude others from their own games. In the coevolution, a directed and dynamical network which represents partnerships among autonomous agents is evolved. We find that non-excludable property counteracts the positive effect of partner switching, i.e., the equilibrium level of cooperation is lower than that in the situation of excludable public goods game. Therefore, we study the effect of individual punishment that cooperative agents pay a personal cost to decrease benefits of those defective neighbors who participate in their hosted games. It is found that the cooperation level in the whole population is heightened in the presence of such a costly behavior.

Inertia in strategy switching transforms the strategy evolution.

PubMed

Zhang, Yanling; Fu, Feng; Wu, Te; Xie, Guangming; Wang, Long

2011-12-01

A recent experimental study [Traulsen et al., Proc. Natl. Acad. Sci. 107, 2962 (2010)] shows that human strategy updating involves both direct payoff comparison and the cost of switching strategy, which is equivalent to inertia. However, it remains largely unclear how such a predisposed inertia affects 2 × 2 games in a well-mixed population of finite size. To address this issue, the "inertia bonus" (strategy switching cost) is added to the learner payoff in the Fermi process. We find how inertia quantitatively shapes the stationary distribution and that stochastic stability under inertia exhibits three regimes, with each covering seven regions in the plane spanned by two inertia parameters. We also obtain the extended "1/3" rule with inertia and the speed criterion with inertia; these two findings hold for a population above two. We illustrate the above results in the framework of the Prisoner's Dilemma game. As inertia varies, two intriguing stationary distributions emerge: the probability of coexistence state is maximized, or those of two full states are simultaneously peaked. Our results may provide useful insights into how the inertia of changing status quo acts on the strategy evolution and, in particular, the evolution of cooperation.

Nonlinear Markov Control Processes and Games

DTIC Science & Technology

2012-11-15

the analysis of a new class of stochastic games , nonlinear Markov games , as they arise as a ( competitive ) controlled version of nonlinear Markov... competitive interests) a nonlinear Markov game that we are investigating. I 0. :::tUt::JJt:.l.. I I t:t11VI;:, nonlinear Markov game , nonlinear Markov...corresponding stochastic game Γ+(T, h). In a slightly different setting one can assume that changes in a competitive control process occur as a

A framework for learning and planning against switching strategies in repeated games

NASA Astrophysics Data System (ADS)

Hernandez-Leal, Pablo; Munoz de Cote, Enrique; Sucar, L. Enrique

2014-04-01

Intelligent agents, human or artificial, often change their behaviour as they interact with other agents. For an agent to optimise its performance when interacting with such agents, it must be capable of detecting and adapting according to such changes. This work presents an approach on how to effectively deal with non-stationary switching opponents in a repeated game context. Our main contribution is a framework for online learning and planning against opponents that switch strategies. We present how two opponent modelling techniques work within the framework and prove the usefulness of the approach experimentally in the iterated prisoner's dilemma, when the opponent is modelled as an agent that switches between different strategies (e.g. TFT, Pavlov and Bully). The results of both models were compared against each other and against a state-of-the-art non-stationary reinforcement learning technique. Results reflect that our approach obtains competitive results without needing an offline training phase, as opposed to the state-of-the-art techniques.

Population density approach for discrete mRNA distributions in generalized switching models for stochastic gene expression.

PubMed

Stinchcombe, Adam R; Peskin, Charles S; Tranchina, Daniel

2012-06-01

We present a generalization of a population density approach for modeling and analysis of stochastic gene expression. In the model, the gene of interest fluctuates stochastically between an inactive state, in which transcription cannot occur, and an active state, in which discrete transcription events occur; and the individual mRNA molecules are degraded stochastically in an independent manner. This sort of model in simplest form with exponential dwell times has been used to explain experimental estimates of the discrete distribution of random mRNA copy number. In our generalization, the random dwell times in the inactive and active states, T_{0} and T_{1}, respectively, are independent random variables drawn from any specified distributions. Consequently, the probability per unit time of switching out of a state depends on the time since entering that state. Our method exploits a connection between the fully discrete random process and a related continuous process. We present numerical methods for computing steady-state mRNA distributions and an analytical derivation of the mRNA autocovariance function. We find that empirical estimates of the steady-state mRNA probability mass function from Monte Carlo simulations of laboratory data do not allow one to distinguish between underlying models with exponential and nonexponential dwell times in some relevant parameter regimes. However, in these parameter regimes and where the autocovariance function has negative lobes, the autocovariance function disambiguates the two types of models. Our results strongly suggest that temporal data beyond the autocovariance function is required in general to characterize gene switching.

Eliminating fast reactions in stochastic simulations of biochemical networks: A bistable genetic switch

NASA Astrophysics Data System (ADS)

Morelli, Marco J.; Allen, Rosalind J.; Tǎnase-Nicola, Sorin; ten Wolde, Pieter Rein

2008-01-01

In many stochastic simulations of biochemical reaction networks, it is desirable to "coarse grain" the reaction set, removing fast reactions while retaining the correct system dynamics. Various coarse-graining methods have been proposed, but it remains unclear which methods are reliable and which reactions can safely be eliminated. We address these issues for a model gene regulatory network that is particularly sensitive to dynamical fluctuations: a bistable genetic switch. We remove protein-DNA and/or protein-protein association-dissociation reactions from the reaction set using various coarse-graining strategies. We determine the effects on the steady-state probability distribution function and on the rate of fluctuation-driven switch flipping transitions. We find that protein-protein interactions may be safely eliminated from the reaction set, but protein-DNA interactions may not. We also find that it is important to use the chemical master equation rather than macroscopic rate equations to compute effective propensity functions for the coarse-grained reactions.

Mean-Field-Game Model for Botnet Defense in Cyber-Security

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kolokoltsov, V. N., E-mail: v.kolokoltsov@warwick.ac.uk; Bensoussan, A.

We initiate the analysis of the response of computer owners to various offers of defence systems against a cyber-hacker (for instance, a botnet attack), as a stochastic game of a large number of interacting agents. We introduce a simple mean-field game that models their behavior. It takes into account both the random process of the propagation of the infection (controlled by the botner herder) and the decision making process of customers. Its stationary version turns out to be exactly solvable (but not at all trivial) under an additional natural assumption that the execution time of the decisions of the customersmore » (say, switch on or out the defence system) is much faster that the infection rates.« less

Differential games.

NASA Technical Reports Server (NTRS)

Varaiya, P. P.

1972-01-01

General discussion of the theory of differential games with two players and zero sum. Games starting at a fixed initial state and ending at a fixed final time are analyzed. Strategies for the games are defined. The existence of saddle values and saddle points is considered. A stochastic version of a differential game is used to examine the synthesis problem.

Perspective: Stochastic magnetic devices for cognitive computing

NASA Astrophysics Data System (ADS)

Roy, Kaushik; Sengupta, Abhronil; Shim, Yong

2018-06-01

Stochastic switching of nanomagnets can potentially enable probabilistic cognitive hardware consisting of noisy neural and synaptic components. Furthermore, computational paradigms inspired from the Ising computing model require stochasticity for achieving near-optimality in solutions to various types of combinatorial optimization problems such as the Graph Coloring Problem or the Travelling Salesman Problem. Achieving optimal solutions in such problems are computationally exhaustive and requires natural annealing to arrive at the near-optimal solutions. Stochastic switching of devices also finds use in applications involving Deep Belief Networks and Bayesian Inference. In this article, we provide a multi-disciplinary perspective across the stack of devices, circuits, and algorithms to illustrate how the stochastic switching dynamics of spintronic devices in the presence of thermal noise can provide a direct mapping to the computational units of such probabilistic intelligent systems.

Fixation, transient landscape, and diffusion dilemma in stochastic evolutionary game dynamics

NASA Astrophysics Data System (ADS)

Zhou, Da; Qian, Hong

2011-09-01

Agent-based stochastic models for finite populations have recently received much attention in the game theory of evolutionary dynamics. Both the ultimate fixation and the pre-fixation transient behavior are important to a full understanding of the dynamics. In this paper, we study the transient dynamics of the well-mixed Moran process through constructing a landscape function. It is shown that the landscape playing a central theoretical “device” that integrates several lines of inquiries: the stable behavior of the replicator dynamics, the long-time fixation, and continuous diffusion approximation associated with asymptotically large population. Several issues relating to the transient dynamics are discussed: (i) multiple time scales phenomenon associated with intra- and inter-attractoral dynamics; (ii) discontinuous transition in stochastically stationary process akin to Maxwell construction in equilibrium statistical physics; and (iii) the dilemma diffusion approximation facing as a continuous approximation of the discrete evolutionary dynamics. It is found that rare events with exponentially small probabilities, corresponding to the uphill movements and barrier crossing in the landscape with multiple wells that are made possible by strong nonlinear dynamics, plays an important role in understanding the origin of the complexity in evolutionary, nonlinear biological systems.

Switching neuronal state: optimal stimuli revealed using a stochastically-seeded gradient algorithm.

PubMed

Chang, Joshua; Paydarfar, David

2014-12-01

Inducing a switch in neuronal state using energy optimal stimuli is relevant to a variety of problems in neuroscience. Analytical techniques from optimal control theory can identify such stimuli; however, solutions to the optimization problem using indirect variational approaches can be elusive in models that describe neuronal behavior. Here we develop and apply a direct gradient-based optimization algorithm to find stimulus waveforms that elicit a change in neuronal state while minimizing energy usage. We analyze standard models of neuronal behavior, the Hodgkin-Huxley and FitzHugh-Nagumo models, to show that the gradient-based algorithm: (1) enables automated exploration of a wide solution space, using stochastically generated initial waveforms that converge to multiple locally optimal solutions; and (2) finds optimal stimulus waveforms that achieve a physiological outcome condition, without a priori knowledge of the optimal terminal condition of all state variables. Analysis of biological systems using stochastically-seeded gradient methods can reveal salient dynamical mechanisms underlying the optimal control of system behavior. The gradient algorithm may also have practical applications in future work, for example, finding energy optimal waveforms for therapeutic neural stimulation that minimizes power usage and diminishes off-target effects and damage to neighboring tissue.

Stochastic Game Approach to Guidance Design

DTIC Science & Technology

1988-09-09

maneuverable aircraft, which can employ also electronic counter measures, is formulated as an imper- fect information zero-sum pursuit-evasion game played...on Differential Game Applications [36]. However, some other examples which included " electronic jinking", indicated that in an ECM environment a mixed...radius, b) missile/target maneuver ratio, c) nonlinear maneuver similarity parameter (aE T2 max d) normalized end- game duration, e ) ini’tial end- game

Mean-Potential Law in Evolutionary Games

NASA Astrophysics Data System (ADS)

Nałecz-Jawecki, Paweł; Miekisz, Jacek

2018-01-01

The Letter presents a novel way to connect random walks, stochastic differential equations, and evolutionary game theory. We introduce a new concept of a potential function for discrete-space stochastic systems. It is based on a correspondence between one-dimensional stochastic differential equations and random walks, which may be exact not only in the continuous limit but also in finite-state spaces. Our method is useful for computation of fixation probabilities in discrete stochastic dynamical systems with two absorbing states. We apply it to evolutionary games, formulating two simple and intuitive criteria for evolutionary stability of pure Nash equilibria in finite populations. In particular, we show that the 1 /3 law of evolutionary games, introduced by Nowak et al. [Nature, 2004], follows from a more general mean-potential law.

Mean-Potential Law in Evolutionary Games.

PubMed

Nałęcz-Jawecki, Paweł; Miękisz, Jacek

2018-01-12

The Letter presents a novel way to connect random walks, stochastic differential equations, and evolutionary game theory. We introduce a new concept of a potential function for discrete-space stochastic systems. It is based on a correspondence between one-dimensional stochastic differential equations and random walks, which may be exact not only in the continuous limit but also in finite-state spaces. Our method is useful for computation of fixation probabilities in discrete stochastic dynamical systems with two absorbing states. We apply it to evolutionary games, formulating two simple and intuitive criteria for evolutionary stability of pure Nash equilibria in finite populations. In particular, we show that the 1/3 law of evolutionary games, introduced by Nowak et al. [Nature, 2004], follows from a more general mean-potential law.

Stability of Zero-Sum Games in Evolutionary Game Theory

NASA Astrophysics Data System (ADS)

Knebel, Johannes; Krueger, Torben; Weber, Markus F.; Frey, Erwin

2014-03-01

Evolutionary game theory has evolved into a successful theoretical concept to study mechanisms that govern the evolution of ecological communities. On a mathematical level, this theory was formalized in the framework of the celebrated replicator equations (REs) and its stochastic generalizations. In our work, we analyze the long-time behavior of the REs for zero-sum games with arbitrarily many strategies, which are generalized versions of the children's game Rock-Paper-Scissors.[1] We demonstrate how to determine the strategies that survive and those that become extinct in the long run. Our results show that extinction of strategies is exponentially fast in generic setups, and that conditions for the survival can be formulated in terms of the Pfaffian of the REs' antisymmetric payoff matrix. Consequences for the stochastic dynamics, which arise in finite populations, are reflected by a generalized scaling law for the extinction time in the vicinity of critical reaction rates. Our findings underline the relevance of zero-sum games as a reference for the analysis of other models in evolutionary game theory.

Experimental evidence for stochastic switching of supercooled phases in NdNiO3 nanostructures

NASA Astrophysics Data System (ADS)

Kumar, Devendra; Rajeev, K. P.; Alonso, J. A.

2018-03-01

A first-order phase transition is a dynamic phenomenon. In a multi-domain system, the presence of multiple domains of coexisting phases averages out the dynamical effects, making it nearly impossible to predict the exact nature of phase transition dynamics. Here, we report the metal-insulator transition in samples of sub-micrometer size NdNiO3 where the effect of averaging is minimized by restricting the number of domains under study. We observe the presence of supercooled metallic phases with supercooling of 40 K or more. The transformation from the supercooled metallic to the insulating state is a stochastic process that happens at different temperatures and times in different experimental runs. The experimental results are understood without incorporating material specific properties, suggesting that the behavior is of universal nature. The size of the sample needed to observe individual switching of supercooled domains, the degree of supercooling, and the time-temperature window of switching are expected to depend on the parameters such as quenched disorder, strain, and magnetic field.

Probabilistic switching circuits in DNA

PubMed Central

Wilhelm, Daniel; Bruck, Jehoshua

2018-01-01

A natural feature of molecular systems is their inherent stochastic behavior. A fundamental challenge related to the programming of molecular information processing systems is to develop a circuit architecture that controls the stochastic states of individual molecular events. Here we present a systematic implementation of probabilistic switching circuits, using DNA strand displacement reactions. Exploiting the intrinsic stochasticity of molecular interactions, we developed a simple, unbiased DNA switch: An input signal strand binds to the switch and releases an output signal strand with probability one-half. Using this unbiased switch as a molecular building block, we designed DNA circuits that convert an input signal to an output signal with any desired probability. Further, this probability can be switched between 2n different values by simply varying the presence or absence of n distinct DNA molecules. We demonstrated several DNA circuits that have multiple layers and feedback, including a circuit that converts an input strand to an output strand with eight different probabilities, controlled by the combination of three DNA molecules. These circuits combine the advantages of digital and analog computation: They allow a small number of distinct input molecules to control a diverse signal range of output molecules, while keeping the inputs robust to noise and the outputs at precise values. Moreover, arbitrarily complex circuit behaviors can be implemented with just a single type of molecular building block. PMID:29339484

Effect of reaction-step-size noise on the switching dynamics of stochastic populations

NASA Astrophysics Data System (ADS)

Be'er, Shay; Heller-Algazi, Metar; Assaf, Michael

2016-05-01

In genetic circuits, when the messenger RNA lifetime is short compared to the cell cycle, proteins are produced in geometrically distributed bursts, which greatly affects the cellular switching dynamics between different metastable phenotypic states. Motivated by this scenario, we study a general problem of switching or escape in stochastic populations, where influx of particles occurs in groups or bursts, sampled from an arbitrary distribution. The fact that the step size of the influx reaction is a priori unknown and, in general, may fluctuate in time with a given correlation time and statistics, introduces an additional nondemographic reaction-step-size noise into the system. Employing the probability-generating function technique in conjunction with Hamiltonian formulation, we are able to map the problem in the leading order onto solving a stationary Hamilton-Jacobi equation. We show that compared to the "usual case" of single-step influx, bursty influx exponentially decreases the population's mean escape time from its long-lived metastable state. In particular, close to bifurcation we find a simple analytical expression for the mean escape time which solely depends on the mean and variance of the burst-size distribution. Our results are demonstrated on several realistic distributions and compare well with numerical Monte Carlo simulations.

Evolutionary stability concepts in a stochastic environment

NASA Astrophysics Data System (ADS)

Zheng, Xiu-Deng; Li, Cong; Lessard, Sabin; Tao, Yi

2017-09-01

Over the past 30 years, evolutionary game theory and the concept of an evolutionarily stable strategy have been not only extensively developed and successfully applied to explain the evolution of animal behaviors, but also widely used in economics and social sciences. Nonetheless, the stochastic dynamical properties of evolutionary games in randomly fluctuating environments are still unclear. In this study, we investigate conditions for stochastic local stability of fixation states and constant interior equilibria in a two-phenotype model with random payoffs following pairwise interactions. Based on this model, we develop the concepts of stochastic evolutionary stability (SES) and stochastic convergence stability (SCS). We show that the condition for a pure strategy to be SES and SCS is more stringent than in a constant environment, while the condition for a constant mixed strategy to be SES is less stringent than the condition to be SCS, which is less stringent than the condition in a constant environment.

Analytical pricing formulas for hybrid variance swaps with regime-switching

NASA Astrophysics Data System (ADS)

Roslan, Teh Raihana Nazirah; Cao, Jiling; Zhang, Wenjun

2017-11-01

The problem of pricing discretely-sampled variance swaps under stochastic volatility, stochastic interest rate and regime-switching is being considered in this paper. An extension of the Heston stochastic volatility model structure is done by adding the Cox-Ingersoll-Ross (CIR) stochastic interest rate model. In addition, the parameters of the model are permitted to have transitions following a Markov chain process which is continuous and discoverable. This hybrid model can be used to illustrate certain macroeconomic conditions, for example the changing phases of business stages. The outcome of our regime-switching hybrid model is presented in terms of analytical pricing formulas for variance swaps.

Stationary Anonymous Sequential Games with Undiscounted Rewards.

PubMed

Więcek, Piotr; Altman, Eitan

Stationary anonymous sequential games with undiscounted rewards are a special class of games that combine features from both population games (infinitely many players) with stochastic games. We extend the theory for these games to the cases of total expected reward as well as to the expected average reward. We show that in the anonymous sequential game equilibria correspond to the limits of those of related finite population games as the number of players grows to infinity. We provide examples to illustrate our results.

Stochastic evolutionary dynamics in minimum-effort coordination games

NASA Astrophysics Data System (ADS)

Li, Kun; Cong, Rui; Wang, Long

2016-08-01

The minimum-effort coordination game draws recently more attention for the fact that human behavior in this social dilemma is often inconsistent with the predictions of classical game theory. Here, we combine evolutionary game theory and coalescence theory to investigate this game in finite populations. Both analytic results and individual-based simulations show that effort costs play a key role in the evolution of contribution levels, which is in good agreement with those observed experimentally. Besides well-mixed populations, set structured populations have also been taken into consideration. Therein we find that large number of sets and moderate migration rate greatly promote effort levels, especially for high effort costs.

Denoising of genetic switches based on Parrondo's paradox

NASA Astrophysics Data System (ADS)

Fotoohinasab, Atiyeh; Fatemizadeh, Emad; Pezeshk, Hamid; Sadeghi, Mehdi

2018-03-01

Random decision making in genetic switches can be modeled as tossing a biased coin. In other word, each genetic switch can be considered as a game in which the reactive elements compete with each other to increase their molecular concentrations. The existence of a very small number of reactive element molecules has caused the neglect of effects of noise to be inevitable. Noise can lead to undesirable cell fate in cellular differentiation processes. In this paper, we study the robustness to noise in genetic switches by considering another switch to have a new gene regulatory network (GRN) in which both switches have been affected by the same noise and for this purpose, we will use Parrondo's paradox. We introduce two networks of games based on possible regulatory relations between genes. Our results show that the robustness to noise can increase by combining these noisy switches. We also describe how one of the switches in network II can model lysis/lysogeny decision making of bacteriophage lambda in Escherichia coli and we change its fate by another switch.

A Model for the Epigenetic Switch Linking Inflammation to Cell Transformation: Deterministic and Stochastic Approaches

PubMed Central

Gérard, Claude; Gonze, Didier; Lemaigre, Frédéric; Novák, Béla

2014-01-01

Recently, a molecular pathway linking inflammation to cell transformation has been discovered. This molecular pathway rests on a positive inflammatory feedback loop between NF-κB, Lin28, Let-7 microRNA and IL6, which leads to an epigenetic switch allowing cell transformation. A transient activation of an inflammatory signal, mediated by the oncoprotein Src, activates NF-κB, which elicits the expression of Lin28. Lin28 decreases the expression of Let-7 microRNA, which results in higher level of IL6 than achieved directly by NF-κB. In turn, IL6 can promote NF-κB activation. Finally, IL6 also elicits the synthesis of STAT3, which is a crucial activator for cell transformation. Here, we propose a computational model to account for the dynamical behavior of this positive inflammatory feedback loop. By means of a deterministic model, we show that an irreversible bistable switch between a transformed and a non-transformed state of the cell is at the core of the dynamical behavior of the positive feedback loop linking inflammation to cell transformation. The model indicates that inhibitors (tumor suppressors) or activators (oncogenes) of this positive feedback loop regulate the occurrence of the epigenetic switch by modulating the threshold of inflammatory signal (Src) needed to promote cell transformation. Both stochastic simulations and deterministic simulations of a heterogeneous cell population suggest that random fluctuations (due to molecular noise or cell-to-cell variability) are able to trigger cell transformation. Moreover, the model predicts that oncogenes/tumor suppressors respectively decrease/increase the robustness of the non-transformed state of the cell towards random fluctuations. Finally, the model accounts for the potential effect of competing endogenous RNAs, ceRNAs, on the dynamics of the epigenetic switch. Depending on their microRNA targets, the model predicts that ceRNAs could act as oncogenes or tumor suppressors by regulating the occurrence of

Some Classes of Imperfect Information Finite State-Space Stochastic Games with Finite-Dimensional Solutions

DOE Office of Scientific and Technical Information (OSTI.GOV)

McEneaney, William M.

2004-08-15

Stochastic games under imperfect information are typically computationally intractable even in the discrete-time/discrete-state case considered here. We consider a problem where one player has perfect information.A function of a conditional probability distribution is proposed as an information state.In the problem form here, the payoff is only a function of the terminal state of the system,and the initial information state is either linear ora sum of max-plus delta functions.When the initial information state belongs to these classes, its propagation is finite-dimensional.The state feedback value function is also finite-dimensional,and obtained via dynamic programming,but has a nonstandard form due to the necessity ofmore » an expanded state variable.Under a saddle point assumption,Certainty Equivalence is obtained and the proposed function is indeed an information state.« less

The effect of switch control site on computer skills of infants and toddlers.

PubMed

Glickman, L; Deitz, J; Anson, D; Stewart, K

1996-01-01

The purpose of this study was to determine whether switch control site (hand vs. head) affects the age at which children can successfully activate a computer to play a cause-and-effect game. The sample consisted of 72 participants randomly divided into two groups (head switch and hand switch), with stratification for gender and age (9-11 months, 12-14 months, 15-17 months). All participants were typically developing. After a maximum of 5 min of training, each participant was given five opportunities to activate a Jelly Bean switch to play a computer game. Competency was defined as four to five successful switch activations. Most participants in the 9-month to 11-month age group could successfully use a hand switch to activate a computer, and for the 15-month to 17-month age group, 100% of the participants met with success. By contrast, in the head switch condition, approximately one third of the participants in each of the three age ranges were successful in activating the computer to play a cause-and-effect game. The findings from this study provide developmental guidelines for using switches (head vs. hand) to activate computers to play cause-and-effect games and suggest that the clinician may consider introducing basic computer and switch skills to children as young as 9 months of age. However, the clinician is cautioned that the head switch may be more difficult to master than the hand switch and that additional research involving children with motor impairments is needed.

Stochastic and Boltzmann-like models for behavioral changes, and their relation to game theory

NASA Astrophysics Data System (ADS)

Helbing, Dirk

1993-03-01

In the last decade, stochastic models have shown to be very useful for quantitative modelling of social processes. Here, a configurational master equation for the description of behavioral changes by pair interactions of individuals is developed. Three kinds of social pair interactions are distinguished: Avoidance processes, compromising processes, and imitative processes. Computational results are presented for a special case of imitative processes: the competition of two equivalent strategies. They show a phase transition that describes the self-organization of a behavioral convention. This phase transition is further analyzed by examining the equations for the most probable behavioral distribution, which are Boltzmann-like equations. Special cases of Boltzmann-like equations do not obey the H-theorem and have oscillatory or even chaotic solutions. A suitable Taylor approximation leads to the so-called game dynamical equations (also known as selection-mutation equations in the theory of evolution).

Stochastic effects in a seasonally forced epidemic model

NASA Astrophysics Data System (ADS)

Rozhnova, G.; Nunes, A.

2010-10-01

The interplay of seasonality, the system’s nonlinearities and intrinsic stochasticity, is studied for a seasonally forced susceptible-exposed-infective-recovered stochastic model. The model is explored in the parameter region that corresponds to childhood infectious diseases such as measles. The power spectrum of the stochastic fluctuations around the attractors of the deterministic system that describes the model in the thermodynamic limit is computed analytically and validated by stochastic simulations for large system sizes. Size effects are studied through additional simulations. Other effects such as switching between coexisting attractors induced by stochasticity often mentioned in the literature as playing an important role in the dynamics of childhood infectious diseases are also investigated. The main conclusion is that stochastic amplification, rather than these effects, is the key ingredient to understand the observed incidence patterns.

Memristor-based neural networks: Synaptic versus neuronal stochasticity

NASA Astrophysics Data System (ADS)

Naous, Rawan; AlShedivat, Maruan; Neftci, Emre; Cauwenberghs, Gert; Salama, Khaled Nabil

2016-11-01

In neuromorphic circuits, stochasticity in the cortex can be mapped into the synaptic or neuronal components. The hardware emulation of these stochastic neural networks are currently being extensively studied using resistive memories or memristors. The ionic process involved in the underlying switching behavior of the memristive elements is considered as the main source of stochasticity of its operation. Building on its inherent variability, the memristor is incorporated into abstract models of stochastic neurons and synapses. Two approaches of stochastic neural networks are investigated. Aside from the size and area perspective, the impact on the system performance, in terms of accuracy, recognition rates, and learning, among these two approaches and where the memristor would fall into place are the main comparison points to be considered.

Polymorphic Evolutionary Games.

PubMed

Fishman, Michael A

2016-06-07

In this paper, I present an analytical framework for polymorphic evolutionary games suitable for explicitly modeling evolutionary processes in diploid populations with sexual reproduction. The principal aspect of the proposed approach is adding diploid genetics cum sexual recombination to a traditional evolutionary game, and switching from phenotypes to haplotypes as the new game׳s pure strategies. Here, the relevant pure strategy׳s payoffs derived by summing the payoffs of all the phenotypes capable of producing gametes containing that particular haplotype weighted by the pertinent probabilities. The resulting game is structurally identical to the familiar Evolutionary Games with non-linear pure strategy payoffs (Hofbauer and Sigmund, 1998. Cambridge University Press), and can be analyzed in terms of an established analytical framework for such games. And these results can be translated into the terms of genotypic, and whence, phenotypic evolutionary stability pertinent to the original game. Copyright © 2016 Elsevier Ltd. All rights reserved.

Dynamics of phenotypic switching of bacterial cells with temporal fluctuations in pressure

NASA Astrophysics Data System (ADS)

Nepal, Sudip; Kumar, Pradeep

2018-05-01

Phenotypic switching is one of the mechanisms by which bacteria thrive in ever changing environmental conditions around them. Earlier studies have shown that the application of steady high hydrostatic pressure leads to stochastic switching of mesophilic bacteria from a cellular phenotype having a normal cell cycle to another phenotype lacking cell division. Here, we have studied the dynamics of this phenotypic switching with fluctuating periodic pressure using a set of experiments and a theoretical model. Our results suggest that the phenotypic switching rate from high-pressure phenotype to low-pressure phenotype in the reversible regime is larger as compared to the switching rate from low-pressure phenotype to high-pressure phenotype. Furthermore, we find that even though the cell division and elongation are presumably regulated by a large number of genes the underlying physics of the dynamics of stochastic switching at high pressure is captured reasonably well by a simple two-state model.

Stochastic predation events and population persistence in bighorn sheep

PubMed Central

Festa-Bianchet, Marco; Coulson, Tim; Gaillard, Jean-Michel; Hogg, John T; Pelletier, Fanie

2006-01-01

Many studies have reported temporal changes in the relative importance of density-dependence and environmental stochasticity in affecting population growth rates, but they typically assume that the predominant factor limiting growth remains constant over long periods of time. Stochastic switches in limiting factors that persist for multiple time-steps have received little attention, but most wild populations may periodically experience such switches. Here, we consider the dynamics of three populations of individually marked bighorn sheep (Ovis canadensis) monitored for 24–28 years. Each population experienced one or two distinct cougar (Puma concolor) predation events leading to population declines. The onset and duration of predation events were stochastic and consistent with predation by specialist individuals. A realistic Markov chain model confirms that predation by specialist cougars can cause extinction of isolated populations. We suggest that such processes may be common. In such cases, predator–prey equilibria may only occur at large geographical and temporal scales, and are unlikely with increasing habitat fragmentation. PMID:16777749

Feynman-Kac formula for stochastic hybrid systems.

PubMed

Bressloff, Paul C

2017-01-01

We derive a Feynman-Kac formula for functionals of a stochastic hybrid system evolving according to a piecewise deterministic Markov process. We first derive a stochastic Liouville equation for the moment generator of the stochastic functional, given a particular realization of the underlying discrete Markov process; the latter generates transitions between different dynamical equations for the continuous process. We then analyze the stochastic Liouville equation using methods recently developed for diffusion processes in randomly switching environments. In particular, we obtain dynamical equations for the moment generating function, averaged with respect to realizations of the discrete Markov process. The resulting Feynman-Kac formula takes the form of a differential Chapman-Kolmogorov equation. We illustrate the theory by calculating the occupation time for a one-dimensional velocity jump process on the infinite or semi-infinite real line. Finally, we present an alternative derivation of the Feynman-Kac formula based on a recent path-integral formulation of stochastic hybrid systems.

A finite state, finite memory minimum principle, part 2. [a discussion of game theory, signaling, stochastic processes, and control theory

NASA Technical Reports Server (NTRS)

Sandell, N. R., Jr.; Athans, M.

1975-01-01

The development of the theory of the finite - state, finite - memory (FSFM) stochastic control problem is discussed. The sufficiency of the FSFM minimum principle (which is in general only a necessary condition) was investigated. By introducing the notion of a signaling strategy as defined in the literature on games, conditions under which the FSFM minimum principle is sufficient were determined. This result explicitly interconnects the information structure of the FSFM problem with its optimality conditions. The min-H algorithm for the FSFM problem was studied. It is demonstrated that a version of the algorithm always converges to a particular type of local minimum termed a person - by - person extremal.

Active Learning with Monty Hall in a Game Theory Class

ERIC Educational Resources Information Center

Brokaw, Alan J.; Merz, Thomas E.

2004-01-01

The authors describe a game that students can play on the first day of a game theory class. The game introduces the 4 essential elements of any game and is designed so that its sequel, also played on the first day of class, has students playing the well-known Monty Hall game, which raises the question: Should you switch doors? By implementing a…

Using Nonlinear Stochastic Evolutionary Game Strategy to Model an Evolutionary Biological Network of Organ Carcinogenesis Under a Natural Selection Scheme

PubMed Central

Chen, Bor-Sen; Tsai, Kun-Wei; Li, Cheng-Wei

2015-01-01

Molecular biologists have long recognized carcinogenesis as an evolutionary process that involves natural selection. Cancer is driven by the somatic evolution of cell lineages. In this study, the evolution of somatic cancer cell lineages during carcinogenesis was modeled as an equilibrium point (ie, phenotype of attractor) shifting, the process of a nonlinear stochastic evolutionary biological network. This process is subject to intrinsic random fluctuations because of somatic genetic and epigenetic variations, as well as extrinsic disturbances because of carcinogens and stressors. In order to maintain the normal function (ie, phenotype) of an evolutionary biological network subjected to random intrinsic fluctuations and extrinsic disturbances, a network robustness scheme that incorporates natural selection needs to be developed. This can be accomplished by selecting certain genetic and epigenetic variations to modify the network structure to attenuate intrinsic fluctuations efficiently and to resist extrinsic disturbances in order to maintain the phenotype of the evolutionary biological network at an equilibrium point (attractor). However, during carcinogenesis, the remaining (or neutral) genetic and epigenetic variations accumulate, and the extrinsic disturbances become too large to maintain the normal phenotype at the desired equilibrium point for the nonlinear evolutionary biological network. Thus, the network is shifted to a cancer phenotype at a new equilibrium point that begins a new evolutionary process. In this study, the natural selection scheme of an evolutionary biological network of carcinogenesis was derived from a robust negative feedback scheme based on the nonlinear stochastic Nash game strategy. The evolvability and phenotypic robustness criteria of the evolutionary cancer network were also estimated by solving a Hamilton–Jacobi inequality – constrained optimization problem. The simulation revealed that the phenotypic shift of the lung cancer

Continuous-Time Public Good Contribution Under Uncertainty: A Stochastic Control Approach

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ferrari, Giorgio, E-mail: giorgio.ferrari@uni-bielefeld.de; Riedel, Frank, E-mail: frank.riedel@uni-bielefeld.de; Steg, Jan-Henrik, E-mail: jsteg@uni-bielefeld.de

In this paper we study continuous-time stochastic control problems with both monotone and classical controls motivated by the so-called public good contribution problem. That is the problem of n economic agents aiming to maximize their expected utility allocating initial wealth over a given time period between private consumption and irreversible contributions to increase the level of some public good. We investigate the corresponding social planner problem and the case of strategic interaction between the agents, i.e. the public good contribution game. We show existence and uniqueness of the social planner’s optimal policy, we characterize it by necessary and sufficient stochasticmore » Kuhn–Tucker conditions and we provide its expression in terms of the unique optional solution of a stochastic backward equation. Similar stochastic first order conditions prove to be very useful for studying any Nash equilibria of the public good contribution game. In the symmetric case they allow us to prove (qualitative) uniqueness of the Nash equilibrium, which we again construct as the unique optional solution of a stochastic backward equation. We finally also provide a detailed analysis of the so-called free rider effect.« less

Population dynamical behavior of Lotka-Volterra system under regime switching

NASA Astrophysics Data System (ADS)

Li, Xiaoyue; Jiang, Daqing; Mao, Xuerong

2009-10-01

In this paper, we investigate a Lotka-Volterra system under regime switching where B(t) is a standard Brownian motion. The aim here is to find out what happens under regime switching. We first obtain the sufficient conditions for the existence of global positive solutions, stochastic permanence and extinction. We find out that both stochastic permanence and extinction have close relationships with the stationary probability distribution of the Markov chain. The limit of the average in time of the sample path of the solution is then estimated by two constants related to the stationary distribution and the coefficients. Finally, the main results are illustrated by several examples.

A Probabilistic-Numerical Approximation for an Obstacle Problem Arising in Game Theory

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gruen, Christine, E-mail: christine.gruen@univ-brest.fr

We investigate a two-player zero-sum stochastic differential game in which one of the players has more information on the game than his opponent. We show how to construct numerical schemes for the value function of this game, which is given by the solution of a quasilinear partial differential equation with obstacle.

A single promoter inversion switches Photorhabdus between pathogenic and mutualistic states.

PubMed

Somvanshi, Vishal S; Sloup, Rudolph E; Crawford, Jason M; Martin, Alexander R; Heidt, Anthony J; Kim, Kwi-suk; Clardy, Jon; Ciche, Todd A

2012-07-06

Microbial populations stochastically generate variants with strikingly different properties, such as virulence or avirulence and antibiotic tolerance or sensitivity. Photorhabdus luminescens bacteria have a variable life history in which they alternate between pathogens to a wide variety of insects and mutualists to their specific host nematodes. Here, we show that the P. luminescens pathogenic variant (P form) switches to a smaller-cell variant (M form) to initiate mutualism in host nematode intestines. A stochastic promoter inversion causes the switch between the two distinct forms. M-form cells are much smaller (one-seventh the volume), slower growing, and less bioluminescent than P-form cells; they are also avirulent and produce fewer secondary metabolites. Observations of form switching by individual cells in nematodes revealed that the M form persisted in maternal nematode intestines, were the first cells to colonize infective juvenile (IJ) offspring, and then switched to P form in the IJ intestine, which armed these nematodes for the next cycle of insect infection.

Stochastic modeling and experimental analysis of phenotypic switching and survival of cancer cells under stress

NASA Astrophysics Data System (ADS)

Zamani Dahaj, Seyed Alireza; Kumar, Niraj; Sundaram, Bala; Celli, Jonathan; Kulkarni, Rahul

The phenotypic heterogeneity of cancer cells is critical to their survival under stress. A significant contribution to heterogeneity of cancer calls derives from the epithelial-mesenchymal transition (EMT), a conserved cellular program that is crucial for embryonic development. Several studies have investigated the role of EMT in growth of early stage tumors into invasive malignancies. Also, EMT has been closely associated with the acquisition of chemoresistance properties in cancer cells. Motivated by these studies, we analyze multi-phenotype stochastic models of the evolution of cancers cell populations under stress. We derive analytical results for time-dependent probability distributions that provide insights into the competing rates underlying phenotypic switching (e.g. during EMT) and the corresponding survival of cancer cells. Experimentally, we evaluate these model-based predictions by imaging human pancreatic cancer cell lines grown with and without cytotoxic agents and measure growth kinetics, survival, morphological changes and (terminal evaluation of) biomarkers with associated epithelial and mesenchymal phenotypes. The results derived suggest approaches for distinguishing between adaptation and selection scenarios for survival in the presence of external stresses.

Stochastically gated local and occupation times of a Brownian particle

NASA Astrophysics Data System (ADS)

Bressloff, Paul C.

2017-01-01

We generalize the Feynman-Kac formula to analyze the local and occupation times of a Brownian particle moving in a stochastically gated one-dimensional domain. (i) The gated local time is defined as the amount of time spent by the particle in the neighborhood of a point in space where there is some target that only receives resources from (or detects) the particle when the gate is open; the target does not interfere with the motion of the Brownian particle. (ii) The gated occupation time is defined as the amount of time spent by the particle in the positive half of the real line, given that it can only cross the origin when a gate placed at the origin is open; in the closed state the particle is reflected. In both scenarios, the gate randomly switches between the open and closed states according to a two-state Markov process. We derive a stochastic, backward Fokker-Planck equation (FPE) for the moment-generating function of the two types of gated Brownian functional, given a particular realization of the stochastic gate, and analyze the resulting stochastic FPE using a moments method recently developed for diffusion processes in randomly switching environments. In particular, we obtain dynamical equations for the moment-generating function, averaged with respect to realizations of the stochastic gate.

Stochastic game theory: for playing games, not just for doing theory.

PubMed

Goeree, J K; Holt, C A

1999-09-14

Recent theoretical advances have dramatically increased the relevance of game theory for predicting human behavior in interactive situations. By relaxing the classical assumptions of perfect rationality and perfect foresight, we obtain much improved explanations of initial decisions, dynamic patterns of learning and adjustment, and equilibrium steady-state distributions.

Intrinsic optimization using stochastic nanomagnets

PubMed Central

Sutton, Brian; Camsari, Kerem Yunus; Behin-Aein, Behtash; Datta, Supriyo

2017-01-01

This paper draws attention to a hardware system which can be engineered so that its intrinsic physics is described by the generalized Ising model and can encode the solution to many important NP-hard problems as its ground state. The basic constituents are stochastic nanomagnets which switch randomly between the ±1 Ising states and can be monitored continuously with standard electronics. Their mutual interactions can be short or long range, and their strengths can be reconfigured as needed to solve specific problems and to anneal the system at room temperature. The natural laws of statistical mechanics guide the network of stochastic nanomagnets at GHz speeds through the collective states with an emphasis on the low energy states that represent optimal solutions. As proof-of-concept, we present simulation results for standard NP-complete examples including a 16-city traveling salesman problem using experimentally benchmarked models for spin-transfer torque driven stochastic nanomagnets. PMID:28295053

Intrinsic optimization using stochastic nanomagnets

NASA Astrophysics Data System (ADS)

Sutton, Brian; Camsari, Kerem Yunus; Behin-Aein, Behtash; Datta, Supriyo

2017-03-01

This paper draws attention to a hardware system which can be engineered so that its intrinsic physics is described by the generalized Ising model and can encode the solution to many important NP-hard problems as its ground state. The basic constituents are stochastic nanomagnets which switch randomly between the ±1 Ising states and can be monitored continuously with standard electronics. Their mutual interactions can be short or long range, and their strengths can be reconfigured as needed to solve specific problems and to anneal the system at room temperature. The natural laws of statistical mechanics guide the network of stochastic nanomagnets at GHz speeds through the collective states with an emphasis on the low energy states that represent optimal solutions. As proof-of-concept, we present simulation results for standard NP-complete examples including a 16-city traveling salesman problem using experimentally benchmarked models for spin-transfer torque driven stochastic nanomagnets.

A variational method for analyzing limit cycle oscillations in stochastic hybrid systems

NASA Astrophysics Data System (ADS)

Bressloff, Paul C.; MacLaurin, James

2018-06-01

Many systems in biology can be modeled through ordinary differential equations, which are piece-wise continuous, and switch between different states according to a Markov jump process known as a stochastic hybrid system or piecewise deterministic Markov process (PDMP). In the fast switching limit, the dynamics converges to a deterministic ODE. In this paper, we develop a phase reduction method for stochastic hybrid systems that support a stable limit cycle in the deterministic limit. A classic example is the Morris-Lecar model of a neuron, where the switching Markov process is the number of open ion channels and the continuous process is the membrane voltage. We outline a variational principle for the phase reduction, yielding an exact analytic expression for the resulting phase dynamics. We demonstrate that this decomposition is accurate over timescales that are exponential in the switching rate ɛ-1 . That is, we show that for a constant C, the probability that the expected time to leave an O(a) neighborhood of the limit cycle is less than T scales as T exp (-C a /ɛ ) .

Games of multicellularity.

PubMed

Kaveh, Kamran; Veller, Carl; Nowak, Martin A

2016-08-21

Evolutionary game dynamics are often studied in the context of different population structures. Here we propose a new population structure that is inspired by simple multicellular life forms. In our model, cells reproduce but can stay together after reproduction. They reach complexes of a certain size, n, before producing single cells again. The cells within a complex derive payoff from an evolutionary game by interacting with each other. The reproductive rate of cells is proportional to their payoff. We consider all two-strategy games. We study deterministic evolutionary dynamics with mutations, and derive exact conditions for selection to favor one strategy over another. Our main result has the same symmetry as the well-known sigma condition, which has been proven for stochastic game dynamics and weak selection. For a maximum complex size of n=2 our result holds for any intensity of selection. For n≥3 it holds for weak selection. As specific examples we study the prisoner's dilemma and hawk-dove games. Our model advances theoretical work on multicellularity by allowing for frequency-dependent interactions within groups. Copyright © 2016 Elsevier Ltd. All rights reserved.

Stackelberg Game Model of Wind Farm and Electric Vehicle Battery Switch Station

NASA Astrophysics Data System (ADS)

Jiang, Zhe; Li, Zhimin; Li, Wenbo; Wang, Mingqiang; Wang, Mengxia

2017-05-01

In this paper, a cooperation method between wind farm and Electric vehicle battery switch station (EVBSS) was proposed. In the pursuit of maximizing their own benefits, the cooperation between wind farm and EVBSS was formulated as a Stackelberg game model by treating them as decision makers in different status. As the leader, wind farm will determine the charging/discharging price to induce the charging and discharging behavior of EVBSS reasonably. Through peak load shifting, wind farm could increase its profits by selling more wind power to the power grid during time interval with a higher purchase price. As the follower, EVBSS will charge or discharge according to the price determined by wind farm. Through optimizing the charging /discharging strategy, EVBSS will try to charge with a lower price and discharge with a higher price in order to increase its profits. Since the possible charging /discharging strategy of EVBSS is known, the wind farm will take the strategy into consideration while deciding the charging /discharging price, and will adjust the price accordingly to increase its profits. The case study proved that the proposed cooperation method and model were feasible and effective.

Tuning stochastic transition rates in a bistable genetic network.

NASA Astrophysics Data System (ADS)

Chickarmane, Vijay; Peterson, Carsten

2009-03-01

We investigate the stochastic dynamics of a simple genetic network, a toggle switch, in which the system makes transitions between the two alternative states. Our interest is in exploring whether such stochastic transitions, which occur due to the intrinsic noise such as transcriptional and degradation events, can be slowed down/speeded up, without changing the mean expression levels of the two genes, which comprise the toggle network. Such tuning is achieved by linking a signaling network to the toggle switch. The signaling network comprises of a protein, which can exist either in an active (phosphorylated) or inactive (dephosphorylated) form, and where its state is determined by one of the genetic network components. The active form of the protein in turn feeds back on the dynamics of the genetic network. We find that the rate of stochastic transitions from one state to the other, is determined essentially by the speed of phosphorylation, and hence the rate can be modulated by varying the phosphatase levels. We hypothesize that such a network architecture can be implemented as a general mechanism for controlling transition rates and discuss applications in population studies of two differentiated cell lineages, ex: the myeloid/erythroid lineage in hematopoiesis.

Stochastic evolution in populations of ideas

NASA Astrophysics Data System (ADS)

Nicole, Robin; Sollich, Peter; Galla, Tobias

2017-01-01

It is known that learning of players who interact in a repeated game can be interpreted as an evolutionary process in a population of ideas. These analogies have so far mostly been established in deterministic models, and memory loss in learning has been seen to act similarly to mutation in evolution. We here propose a representation of reinforcement learning as a stochastic process in finite ‘populations of ideas’. The resulting birth-death dynamics has absorbing states and allows for the extinction or fixation of ideas, marking a key difference to mutation-selection processes in finite populations. We characterize the outcome of evolution in populations of ideas for several classes of symmetric and asymmetric games.

Stochastic evolution in populations of ideas

PubMed Central

Nicole, Robin; Sollich, Peter; Galla, Tobias

2017-01-01

It is known that learning of players who interact in a repeated game can be interpreted as an evolutionary process in a population of ideas. These analogies have so far mostly been established in deterministic models, and memory loss in learning has been seen to act similarly to mutation in evolution. We here propose a representation of reinforcement learning as a stochastic process in finite ‘populations of ideas’. The resulting birth-death dynamics has absorbing states and allows for the extinction or fixation of ideas, marking a key difference to mutation-selection processes in finite populations. We characterize the outcome of evolution in populations of ideas for several classes of symmetric and asymmetric games. PMID:28098244

Finite-time robust passive control for a class of switched reaction-diffusion stochastic complex dynamical networks with coupling delays and impulsive control

NASA Astrophysics Data System (ADS)

Syed Ali, M.; Yogambigai, J.; Kwon, O. M.

2018-03-01

Finite-time boundedness and finite-time passivity for a class of switched stochastic complex dynamical networks (CDNs) with coupling delays, parameter uncertainties, reaction-diffusion term and impulsive control are studied. Novel finite-time synchronisation criteria are derived based on passivity theory. This paper proposes a CDN consisting of N linearly and diffusively coupled identical reaction- diffusion neural networks. By constructing of a suitable Lyapunov-Krasovskii's functional and utilisation of Jensen's inequality and Wirtinger's inequality, new finite-time passivity criteria for the networks are established in terms of linear matrix inequalities (LMIs), which can be checked numerically using the effective LMI toolbox in MATLAB. Finally, two interesting numerical examples are given to show the effectiveness of the theoretical results.

Exact solution of a model DNA-inversion genetic switch with orientational control.

PubMed

Visco, Paolo; Allen, Rosalind J; Evans, Martin R

2008-09-12

DNA inversion is an important mechanism by which bacteria and bacteriophage switch reversibly between phenotypic states. In such switches, the orientation of a short DNA element is flipped by a site-specific recombinase enzyme. We propose a simple model for a DNA-inversion switch in which recombinase production is dependent on the switch state (orientational control). Our model is inspired by the fim switch in E. coli. We present an exact analytical solution of the chemical master equation for the model switch, as well as stochastic simulations. Orientational control causes the switch to deviate from Poissonian behavior: the distribution of times in the on state shows a peak and successive flip times are correlated.

Persistence and extinction of a stochastic single-specie model under regime switching in a polluted environment.

PubMed

Liu, Meng; Wang, Ke

2010-06-07

A new single-species model disturbed by both white noise and colored noise in a polluted environment is developed and analyzed. Sufficient criteria for extinction, stochastic nonpersistence in the mean, stochastic weak persistence in the mean, stochastic strong persistence in the mean and stochastic permanence of the species are established. The threshold between stochastic weak persistence in the mean and extinction is obtained. The results show that both white and colored environmental noises have sufficient effect to the survival results. Copyright (c) 2010 Elsevier Ltd. All rights reserved.

How input fluctuations reshape the dynamics of a biological switching system

NASA Astrophysics Data System (ADS)

Hu, Bo; Kessler, David A.; Rappel, Wouter-Jan; Levine, Herbert

2012-12-01

An important task in quantitative biology is to understand the role of stochasticity in biochemical regulation. Here, as an extension of our recent work [Phys. Rev. Lett.PRLTAO0031-900710.1103/PhysRevLett.107.148101 107, 148101 (2011)], we study how input fluctuations affect the stochastic dynamics of a simple biological switch. In our model, the on transition rate of the switch is directly regulated by a noisy input signal, which is described as a non-negative mean-reverting diffusion process. This continuous process can be a good approximation of the discrete birth-death process and is much more analytically tractable. Within this setup, we apply the Feynman-Kac theorem to investigate the statistical features of the output switching dynamics. Consistent with our previous findings, the input noise is found to effectively suppress the input-dependent transitions. We show analytically that this effect becomes significant when the input signal fluctuates greatly in amplitude and reverts slowly to its mean.

The role of noise in the spatial public goods game

NASA Astrophysics Data System (ADS)

Javarone, Marco Alberto; Battiston, Federico

2016-07-01

In this work we aim to analyze the role of noise in the spatial public goods game, one of the most famous games in evolutionary game theory. The dynamics of this game is affected by a number of parameters and processes, namely the topology of interactions among the agents, the synergy factor, and the strategy revision phase. The latter is a process that allows agents to change their strategy. Notably, rational agents tend to imitate richer neighbors, in order to increase the probability to maximize their payoff. By implementing a stochastic revision process, it is possible to control the level of noise in the system, so that even irrational updates may occur. In particular, in this work we study the effect of noise on the macroscopic behavior of a finite structured population playing the public goods game. We consider both the case of a homogeneous population, where the noise in the system is controlled by tuning a parameter representing the level of stochasticity in the strategy revision phase, and a heterogeneous population composed of a variable proportion of rational and irrational agents. In both cases numerical investigations show that the public goods game has a very rich behavior which strongly depends on the amount of noise in the system and on the value of the synergy factor. To conclude, our study sheds a new light on the relations between the microscopic dynamics of the public goods game and its macroscopic behavior, strengthening the link between the field of evolutionary game theory and statistical physics.

Model reduction for slow–fast stochastic systems with metastable behaviour

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bruna, Maria, E-mail: bruna@maths.ox.ac.uk; Computational Science Laboratory, Microsoft Research, Cambridge CB1 2FB; Chapman, S. Jonathan

2014-05-07

The quasi-steady-state approximation (or stochastic averaging principle) is a useful tool in the study of multiscale stochastic systems, giving a practical method by which to reduce the number of degrees of freedom in a model. The method is extended here to slow–fast systems in which the fast variables exhibit metastable behaviour. The key parameter that determines the form of the reduced model is the ratio of the timescale for the switching of the fast variables between metastable states to the timescale for the evolution of the slow variables. The method is illustrated with two examples: one from biochemistry (a fast-species-mediatedmore » chemical switch coupled to a slower varying species), and one from ecology (a predator–prey system). Numerical simulations of each model reduction are compared with those of the full system.« less

Evolution of fairness and coalition formation in three-person ultimatum games.

PubMed

Nishimura, Takeshi; Okada, Akira; Shirata, Yasuhiro

2017-05-07

We consider the evolution of fairness and coalition formation in a three-person ultimatum game in which the coalition value depends on its size. Traditional game theory, which assumes selfish and rational players, predicts the largest and efficient coalition with a proposer exploiting most of the total value. In a stochastic evolutionary model (the frequency-dependent Moran process with mutations) where players make errors in estimating the payoffs and strategies of others, evolutionary selection favors the formation of a two-person subcoalition under weak selection and in the low mutation limit if and only if its coalition value exceeds a high proportion (0.7) of that of the largest coalition. Proposers offer 30-35% of the subcoalition value to a coalition member, excluding a non-member. Multilateral bargaining is critically different from the bilateral one. Coalition-forming behavior may cause economic inefficiency and social exclusion. Stochastic evolutionary game theory thus provides theoretical support to explain the behavior of human subjects in economic experiments of a three-person ultimatum game. Copyright © 2017 Elsevier Ltd. All rights reserved.

Quantum Prisoner’s Dilemma game on hypergraph networks

NASA Astrophysics Data System (ADS)

Pawela, Łukasz; Sładkowski, Jan

2013-02-01

We study the possible advantages of adopting quantum strategies in multi-player evolutionary games. We base our study on the three-player Prisoner’s Dilemma (PD) game. In order to model the simultaneous interaction between three agents we use hypergraphs and hypergraph networks. In particular, we study two types of networks: a random network and a SF-like network. The obtained results show that in the case of a three-player game on a hypergraph network, quantum strategies are not necessarily stochastically stable strategies. In some cases, the defection strategy can be as good as a quantum one.

Beating Cheaters at Their Own Game

NASA Astrophysics Data System (ADS)

Rauch, Joseph; Kondev, Jane; Sanchez, Alvaro

2014-03-01

Public goods games occur over many different scales in nature, from microbial biofilms to the human commons. On each scale stable populations of cooperators (members who invest into producing some good shared by the entire population) and cheaters (members who make no investment yet still share the common goods) has been observed. This observation raises interesting questions, like how do cooperators maintain their presence in a game that seems to heavily favor cheaters, and what strategies for cooperation could populations employ to increase their success? We propose a model of a public goods game with two different player populations, S and D, which employ two different strategies: the D population always cheats and the S population makes a stochastic decision whether to cooperate or not. We find that stochastic cooperation improves the success of the S population over the competing D population, but at a price. As the probability of cheating by the S players increases they outcompete the D players but the total population becomes more ecologically unstable (i.e., the likelihood of its extinction grows). We investigate this trade off between evolutionary success and ecological stability and propose experiments using populations of yeast cells to test our predictions.

Characterising switching behaviour in perceptual multi-stability.

PubMed

Denham, Susan; Bendixen, Alexandra; Mill, Robert; Tóth, Dénes; Wennekers, Thomas; Coath, Martin; Bőhm, Tamás; Szalardy, Orsolya; Winkler, István

2012-09-15

When people experience an unchanging sensory input for a long period of time, their perception tends to switch stochastically and unavoidably between alternative interpretations of the sensation; a phenomenon known as perceptual bi-stability or multi-stability. The huge variability in the experimental data obtained in such paradigms makes it difficult to distinguish typical patterns of behaviour, or to identify differences between switching patterns. Here we propose a new approach to characterising switching behaviour based upon the extraction of transition matrices from the data, which provide a compact representation that is well-understood mathematically. On the basis of this representation we can characterise patterns of perceptual switching, visualise and simulate typical switching patterns, and calculate the likelihood of observing a particular switching pattern. The proposed method can support comparisons between different observers, experimental conditions and even experiments. We demonstrate the insights offered by this approach using examples from our experiments investigating multi-stability in auditory streaming. However, the methodology is generic and thus widely applicable in studies of multi-stability in any domain. Copyright © 2012 Elsevier B.V. All rights reserved.

Stochastic simulation of enzyme-catalyzed reactions with disparate timescales.

PubMed

Barik, Debashis; Paul, Mark R; Baumann, William T; Cao, Yang; Tyson, John J

2008-10-01

Many physiological characteristics of living cells are regulated by protein interaction networks. Because the total numbers of these protein species can be small, molecular noise can have significant effects on the dynamical properties of a regulatory network. Computing these stochastic effects is made difficult by the large timescale separations typical of protein interactions (e.g., complex formation may occur in fractions of a second, whereas catalytic conversions may take minutes). Exact stochastic simulation may be very inefficient under these circumstances, and methods for speeding up the simulation without sacrificing accuracy have been widely studied. We show that the "total quasi-steady-state approximation" for enzyme-catalyzed reactions provides a useful framework for efficient and accurate stochastic simulations. The method is applied to three examples: a simple enzyme-catalyzed reaction where enzyme and substrate have comparable abundances, a Goldbeter-Koshland switch, where a kinase and phosphatase regulate the phosphorylation state of a common substrate, and coupled Goldbeter-Koshland switches that exhibit bistability. Simulations based on the total quasi-steady-state approximation accurately capture the steady-state probability distributions of all components of these reaction networks. In many respects, the approximation also faithfully reproduces time-dependent aspects of the fluctuations. The method is accurate even under conditions of poor timescale separation.

Game-theoretic cooperativity in networks of self-interested units

NASA Astrophysics Data System (ADS)

Barto, Andrew G.

1986-08-01

The behavior of theoretical neural networks is often described in terms of competition and cooperation. I present an approach to network learning that is related to game and team problems in which competition and cooperation have more technical meanings. I briefly describe the application of stochastic learning automata to game and team problems and then present an adaptive element that is a synthesis of aspects of stochastic learning automata and typical neuron-like adaptive elements. These elements act as self-interested agents that work toward improving their performance with respect to their individual preference orderings. Networks of these elements can solve a variety of team decision problems, some of which take the form of layered networks in which the ``hidden units'' become appropriate functional components as they attempt to improve their own payoffs.

Multiobjective optimization in structural design with uncertain parameters and stochastic processes

NASA Technical Reports Server (NTRS)

Rao, S. S.

1984-01-01

The application of multiobjective optimization techniques to structural design problems involving uncertain parameters and random processes is studied. The design of a cantilever beam with a tip mass subjected to a stochastic base excitation is considered for illustration. Several of the problem parameters are assumed to be random variables and the structural mass, fatigue damage, and negative of natural frequency of vibration are considered for minimization. The solution of this three-criteria design problem is found by using global criterion, utility function, game theory, goal programming, goal attainment, bounded objective function, and lexicographic methods. It is observed that the game theory approach is superior in finding a better optimum solution, assuming the proper balance of the various objective functions. The procedures used in the present investigation are expected to be useful in the design of general dynamic systems involving uncertain parameters, stochastic process, and multiple objectives.

An Element of Determinism in a Stochastic Flagellar Motor Switch

PubMed Central

Xie, Li; Altindal, Tuba; Wu, Xiao-Lun

2015-01-01

Marine bacterium Vibrio alginolyticus uses a single polar flagellum to navigate in an aqueous environment. Similar to Escherichia coli cells, the polar flagellar motor has two states; when the motor is counter-clockwise, the cell swims forward and when the motor is clockwise, the cell swims backward. V. alginolyticus also incorporates a direction randomization step at the start of the forward swimming interval by flicking its flagellum. To gain an understanding on how the polar flagellar motor switch is regulated, distributions of the forward Δf and backward Δb intervals are investigated herein. We found that the steady-state probability density functions, P(Δf) and P(Δb), of freely swimming bacteria are strongly peaked at a finite time, suggesting that the motor switch is not Poissonian. The short-time inhibition is sufficiently strong and long lasting, i.e., several hundred milliseconds for both intervals, which is readily observed and characterized. Treating motor reversal dynamics as a first-passage problem, which results from conformation fluctuations of the motor switch, we calculated P(Δf) and P(Δb) and found good agreement with the measurements. PMID:26554590

An Element of Determinism in a Stochastic Flagellar Motor Switch.

PubMed

Xie, Li; Altindal, Tuba; Wu, Xiao-Lun

2015-01-01

Marine bacterium Vibrio alginolyticus uses a single polar flagellum to navigate in an aqueous environment. Similar to Escherichia coli cells, the polar flagellar motor has two states; when the motor is counter-clockwise, the cell swims forward and when the motor is clockwise, the cell swims backward. V. alginolyticus also incorporates a direction randomization step at the start of the forward swimming interval by flicking its flagellum. To gain an understanding on how the polar flagellar motor switch is regulated, distributions of the forward Δf and backward Δb intervals are investigated herein. We found that the steady-state probability density functions, P(Δf) and P(Δb), of freely swimming bacteria are strongly peaked at a finite time, suggesting that the motor switch is not Poissonian. The short-time inhibition is sufficiently strong and long lasting, i.e., several hundred milliseconds for both intervals, which is readily observed and characterized. Treating motor reversal dynamics as a first-passage problem, which results from conformation fluctuations of the motor switch, we calculated P(Δf) and P(Δb) and found good agreement with the measurements.

WKB theory of large deviations in stochastic populations

NASA Astrophysics Data System (ADS)

Assaf, Michael; Meerson, Baruch

2017-06-01

Stochasticity can play an important role in the dynamics of biologically relevant populations. These span a broad range of scales: from intra-cellular populations of molecules to population of cells and then to groups of plants, animals and people. Large deviations in stochastic population dynamics—such as those determining population extinction, fixation or switching between different states—are presently in a focus of attention of statistical physicists. We review recent progress in applying different variants of dissipative WKB approximation (after Wentzel, Kramers and Brillouin) to this class of problems. The WKB approximation allows one to evaluate the mean time and/or probability of population extinction, fixation and switches resulting from either intrinsic (demographic) noise, or a combination of the demographic noise and environmental variations, deterministic or random. We mostly cover well-mixed populations, single and multiple, but also briefly consider populations on heterogeneous networks and spatial populations. The spatial setting also allows one to study large fluctuations of the speed of biological invasions. Finally, we briefly discuss possible directions of future work.

Distinguishing humans from computers in the game of go: A complex network approach

NASA Astrophysics Data System (ADS)

Coquidé, C.; Georgeot, B.; Giraud, O.

2017-08-01

We compare complex networks built from the game of go and obtained from databases of human-played games with those obtained from computer-played games. Our investigations show that statistical features of the human-based networks and the computer-based networks differ, and that these differences can be statistically significant on a relatively small number of games using specific estimators. We show that the deterministic or stochastic nature of the computer algorithm playing the game can also be distinguished from these quantities. This can be seen as a tool to implement a Turing-like test for go simulators.

Diffusive transport in the presence of stochastically gated absorption

NASA Astrophysics Data System (ADS)

Bressloff, Paul C.; Karamched, Bhargav R.; Lawley, Sean D.; Levien, Ethan

2017-08-01

We analyze a population of Brownian particles moving in a spatially uniform environment with stochastically gated absorption. The state of the environment at time t is represented by a discrete stochastic variable k (t )∈{0 ,1 } such that the rate of absorption is γ [1 -k (t )] , with γ a positive constant. The variable k (t ) evolves according to a two-state Markov chain. We focus on how stochastic gating affects the attenuation of particle absorption with distance from a localized source in a one-dimensional domain. In the static case (no gating), the steady-state attenuation is given by an exponential with length constant √{D /γ }, where D is the diffusivity. We show that gating leads to slower, nonexponential attenuation. We also explore statistical correlations between particles due to the fact that they all diffuse in the same switching environment. Such correlations can be determined in terms of moments of the solution to a corresponding stochastic Fokker-Planck equation.

Isolating intrinsic noise sources in a stochastic genetic switch.

PubMed

Newby, Jay M

2012-01-01

The stochastic mutual repressor model is analysed using perturbation methods. This simple model of a gene circuit consists of two genes and three promotor states. Either of the two protein products can dimerize, forming a repressor molecule that binds to the promotor of the other gene. When the repressor is bound to a promotor, the corresponding gene is not transcribed and no protein is produced. Either one of the promotors can be repressed at any given time or both can be unrepressed, leaving three possible promotor states. This model is analysed in its bistable regime in which the deterministic limit exhibits two stable fixed points and an unstable saddle, and the case of small noise is considered. On small timescales, the stochastic process fluctuates near one of the stable fixed points, and on large timescales, a metastable transition can occur, where fluctuations drive the system past the unstable saddle to the other stable fixed point. To explore how different intrinsic noise sources affect these transitions, fluctuations in protein production and degradation are eliminated, leaving fluctuations in the promotor state as the only source of noise in the system. The process without protein noise is then compared to the process with weak protein noise using perturbation methods and Monte Carlo simulations. It is found that some significant differences in the random process emerge when the intrinsic noise source is removed.

Optional games on cycles and complete graphs.

PubMed

Jeong, Hyeong-Chai; Oh, Seung-Yoon; Allen, Benjamin; Nowak, Martin A

2014-09-07

We study stochastic evolution of optional games on simple graphs. There are two strategies, A and B, whose interaction is described by a general payoff matrix. In addition, there are one or several possibilities to opt out from the game by adopting loner strategies. Optional games lead to relaxed social dilemmas. Here we explore the interaction between spatial structure and optional games. We find that increasing the number of loner strategies (or equivalently increasing mutational bias toward loner strategies) facilitates evolution of cooperation both in well-mixed and in structured populations. We derive various limits for weak selection and large population size. For some cases we derive analytic results for strong selection. We also analyze strategy selection numerically for finite selection intensity and discuss combined effects of optionality and spatial structure. Copyright © 2014 Elsevier Ltd. All rights reserved.

The Evolution of Phenotypic Switching in Subdivided Populations

PubMed Central

Carja, Oana; Liberman, Uri; Feldman, Marcus W.

2014-01-01

Stochastic switching is an example of phenotypic bet hedging, where offspring can express a phenotype different from that of their parents. Phenotypic switching is well documented in viruses, yeast, and bacteria and has been extensively studied when the selection pressures vary through time. However, there has been little work on the evolution of phenotypic switching under both spatially and temporally fluctuating selection pressures. Here we use a population genetic model to explore the interaction of temporal and spatial variation in determining the evolutionary dynamics of phenotypic switching. We find that the stable switching rate is mainly determined by the rate of environmental change and the migration rate. This stable rate is also a decreasing function of the recombination rate, although this is a weaker effect than those of either the period of environmental change or the migration rate. This study highlights the interplay of spatial and temporal environmental variability, offering new insights into how migration can influence the evolution of phenotypic switching rates, mutation rates, or other sources of phenotypic variation. PMID:24496012

Markov switching of the electricity supply curve and power prices dynamics

NASA Astrophysics Data System (ADS)

Mari, Carlo; Cananà, Lucianna

2012-02-01

Regime-switching models seem to well capture the main features of power prices behavior in deregulated markets. In a recent paper, we have proposed an equilibrium methodology to derive electricity prices dynamics from the interplay between supply and demand in a stochastic environment. In particular, assuming that the supply function is described by a power law where the exponent is a two-state strictly positive Markov process, we derived a regime switching dynamics of power prices in which regime switches are induced by transitions between Markov states. In this paper, we provide a dynamical model to describe the random behavior of power prices where the only non-Brownian component of the motion is endogenously introduced by Markov transitions in the exponent of the electricity supply curve. In this context, the stochastic process driving the switching mechanism becomes observable, and we will show that the non-Brownian component of the dynamics induced by transitions from Markov states is responsible for jumps and spikes of very high magnitude. The empirical analysis performed on three Australian markets confirms that the proposed approach seems quite flexible and capable of incorporating the main features of power prices time-series, thus reproducing the first four moments of log-returns empirical distributions in a satisfactory way.

Automated design of genetic toggle switches with predetermined bistability.

PubMed

Chen, Shuobing; Zhang, Haoqian; Shi, Handuo; Ji, Weiyue; Feng, Jingchen; Gong, Yan; Yang, Zhenglin; Ouyang, Qi

2012-07-20

Synthetic biology aims to rationally construct biological devices with required functionalities. Methods that automate the design of genetic devices without post-hoc adjustment are therefore highly desired. Here we provide a method to predictably design genetic toggle switches with predetermined bistability. To accomplish this task, a biophysical model that links ribosome binding site (RBS) DNA sequence to toggle switch bistability was first developed by integrating a stochastic model with RBS design method. Then, to parametrize the model, a library of genetic toggle switch mutants was experimentally built, followed by establishing the equivalence between RBS DNA sequences and switch bistability. To test this equivalence, RBS nucleotide sequences for different specified bistabilities were in silico designed and experimentally verified. Results show that the deciphered equivalence is highly predictive for the toggle switch design with predetermined bistability. This method can be generalized to quantitative design of other probabilistic genetic devices in synthetic biology.

Hybrid colored noise process with space-dependent switching rates

NASA Astrophysics Data System (ADS)

Bressloff, Paul C.; Lawley, Sean D.

2017-07-01

A fundamental issue in the theory of continuous stochastic process is the interpretation of multiplicative white noise, which is often referred to as the Itô-Stratonovich dilemma. From a physical perspective, this reflects the need to introduce additional constraints in order to specify the nature of the noise, whereas from a mathematical perspective it reflects an ambiguity in the formulation of stochastic differential equations (SDEs). Recently, we have identified a mechanism for obtaining an Itô SDE based on a form of temporal disorder. Motivated by switching processes in molecular biology, we considered a Brownian particle that randomly switches between two distinct conformational states with different diffusivities. In each state, the particle undergoes normal diffusion (additive noise) so there is no ambiguity in the interpretation of the noise. However, if the switching rates depend on position, then in the fast switching limit one obtains Brownian motion with a space-dependent diffusivity of the Itô form. In this paper, we extend our theory to include colored additive noise. We show that the nature of the effective multiplicative noise process obtained by taking both the white-noise limit (κ →0 ) and fast switching limit (ɛ →0 ) depends on the order the two limits are taken. If the white-noise limit is taken first, then we obtain Itô, and if the fast switching limit is taken first, then we obtain Stratonovich. Moreover, the form of the effective diffusion coefficient differs in the two cases. The latter result holds even in the case of space-independent transition rates, where one obtains additive noise processes with different diffusion coefficients. Finally, we show that yet another form of multiplicative noise is obtained in the simultaneous limit ɛ ,κ →0 with ɛ /κ2 fixed.

Video game use and cognitive performance: does it vary with the presence of problematic video game use?

PubMed

Collins, Emily; Freeman, Jonathan

2014-03-01

Action video game players have been found to outperform nonplayers on a variety of cognitive tasks. However, several failures to replicate these video game player advantages have indicated that this relationship may not be straightforward. Moreover, despite the discovery that problematic video game players do not appear to demonstrate the same superior performance as nonproblematic video game players in relation to multiple object tracking paradigms, this has not been investigated for other tasks. Consequently, this study compared gamers and nongamers in task switching ability, visual short-term memory, mental rotation, enumeration, and flanker interference, as well as investigated the influence of self-reported problematic video game use. A total of 66 participants completed the experiment, 26 of whom played action video games, including 20 problematic players. The results revealed no significant effect of playing action video games, nor any influence of problematic video game play. This indicates that the previously reported cognitive advantages in video game players may be restricted to specific task features or samples. Furthermore, problematic video game play may not have a detrimental effect on cognitive performance, although this is difficult to ascertain considering the lack of video game player advantage. More research is therefore sorely needed.

Molecular engineering and measurements to test hypothesized mechanisms in single molecule conductance switching.

PubMed

Moore, Amanda M; Dameron, Arrelaine A; Mantooth, Brent A; Smith, Rachel K; Fuchs, Daniel J; Ciszek, Jacob W; Maya, Francisco; Yao, Yuxing; Tour, James M; Weiss, Paul S

2006-02-15

Six customized phenylene-ethynylene-based oligomers have been studied for their electronic properties using scanning tunneling microscopy to test hypothesized mechanisms of stochastic conductance switching. Previously suggested mechanisms include functional group reduction, functional group rotation, backbone ring rotation, neighboring molecule interactions, bond fluctuations, and hybridization changes. Here, we test these hypotheses experimentally by varying the molecular designs of the switches; the ability of the molecules to switch via each hypothetical mechanism is selectively engineered into or out of each molecule. We conclude that hybridization changes at the molecule-surface interface are responsible for the switching we observe.

Stochastic E2F activation and reconciliation of phenomenological cell-cycle models.

PubMed

Lee, Tae J; Yao, Guang; Bennett, Dorothy C; Nevins, Joseph R; You, Lingchong

2010-09-21

The transition of the mammalian cell from quiescence to proliferation is a highly variable process. Over the last four decades, two lines of apparently contradictory, phenomenological models have been proposed to account for such temporal variability. These include various forms of the transition probability (TP) model and the growth control (GC) model, which lack mechanistic details. The GC model was further proposed as an alternative explanation for the concept of the restriction point, which we recently demonstrated as being controlled by a bistable Rb-E2F switch. Here, through a combination of modeling and experiments, we show that these different lines of models in essence reflect different aspects of stochastic dynamics in cell cycle entry. In particular, we show that the variable activation of E2F can be described by stochastic activation of the bistable Rb-E2F switch, which in turn may account for the temporal variability in cell cycle entry. Moreover, we show that temporal dynamics of E2F activation can be recast into the frameworks of both the TP model and the GC model via parameter mapping. This mapping suggests that the two lines of phenomenological models can be reconciled through the stochastic dynamics of the Rb-E2F switch. It also suggests a potential utility of the TP or GC models in defining concise, quantitative phenotypes of cell physiology. This may have implications in classifying cell types or states.

Towards Stability Analysis of Jump Linear Systems with State-Dependent and Stochastic Switching

NASA Technical Reports Server (NTRS)

Tejada, Arturo; Gonzalez, Oscar R.; Gray, W. Steven

2004-01-01

This paper analyzes the stability of hierarchical jump linear systems where the supervisor is driven by a Markovian stochastic process and by the values of the supervised jump linear system s states. The stability framework for this class of systems is developed over infinite and finite time horizons. The framework is then used to derive sufficient stability conditions for a specific class of hybrid jump linear systems with performance supervision. New sufficient stochastic stability conditions for discrete-time jump linear systems are also presented.

A class of generalized Ginzburg-Landau equations with random switching

NASA Astrophysics Data System (ADS)

Wu, Zheng; Yin, George; Lei, Dongxia

2018-09-01

This paper focuses on a class of generalized Ginzburg-Landau equations with random switching. In our formulation, the nonlinear term is allowed to have higher polynomial growth rate than the usual cubic polynomials. The random switching is modeled by a continuous-time Markov chain with a finite state space. First, an explicit solution is obtained. Then properties such as stochastic-ultimate boundedness and permanence of the solution processes are investigated. Finally, two-time-scale models are examined leading to a reduction of complexity.

Evolutionary dynamics of public goods games with diverse contributions in finite populations

NASA Astrophysics Data System (ADS)

Wang, Jing; Wu, Bin; Chen, Xiaojie; Wang, Long

2010-05-01

The public goods game is a powerful metaphor for exploring the maintenance of social cooperative behavior in a group of interactional selfish players. Here we study the emergence of cooperation in the public goods games with diverse contributions in finite populations. The theory of stochastic process is innovatively adopted to investigate the evolutionary dynamics of the public goods games involving a diversity of contributions. In the limit of rare mutations, the general stationary distribution of this stochastic process can be analytically approximated by means of diffusion theory. Moreover, we demonstrate that increasing the diversity of contributions greatly reduces the probability of finding the population in a homogeneous state full of defectors. This increase also raises the expectation of the total contribution in the entire population and thus promotes social cooperation. Furthermore, by investigating the evolutionary dynamics of optional public goods games with diverse contributions, we find that nonparticipation can assist players who contribute more in resisting invasion and taking over individuals who contribute less. In addition, numerical simulations are performed to confirm our analytical results. Our results may provide insight into the effect of diverse contributions on cooperative behaviors in the real world.

Examining the Roles of Reasoning and Working Memory in Predicting Casual Game Performance across Extended Gameplay.

PubMed

Kranz, Michael B; Baniqued, Pauline L; Voss, Michelle W; Lee, Hyunkyu; Kramer, Arthur F

2017-01-01

The variety and availability of casual video games presents an exciting opportunity for applications such as cognitive training. Casual games have been associated with fluid abilities such as working memory (WM) and reasoning, but the importance of these cognitive constructs in predicting performance may change across extended gameplay and vary with game structure. The current investigation examined the relationship between cognitive abilities and casual game performance over time by analyzing first and final session performance over 4-5 weeks of game play. We focused on two groups of subjects who played different types of casual games previously shown to relate to WM and reasoning when played for a single session: (1) puzzle-based games played adaptively across sessions and (2) speeded switching games played non-adaptively across sessions. Reasoning uniquely predicted first session casual game scores for both groups and accounted for much of the relationship with WM. Furthermore, over time, WM became uniquely important for predicting casual game performance for the puzzle-based adaptive games but not for the speeded switching non-adaptive games. These results extend the burgeoning literature on cognitive abilities involved in video games by showing differential relationships of fluid abilities across different game types and extended play. More broadly, the current study illustrates the usefulness of using multiple cognitive measures in predicting performance, and provides potential directions for game-based cognitive training research.

Examining the Roles of Reasoning and Working Memory in Predicting Casual Game Performance across Extended Gameplay

PubMed Central

Kranz, Michael B.; Baniqued, Pauline L.; Voss, Michelle W.; Lee, Hyunkyu; Kramer, Arthur F.

2017-01-01

The variety and availability of casual video games presents an exciting opportunity for applications such as cognitive training. Casual games have been associated with fluid abilities such as working memory (WM) and reasoning, but the importance of these cognitive constructs in predicting performance may change across extended gameplay and vary with game structure. The current investigation examined the relationship between cognitive abilities and casual game performance over time by analyzing first and final session performance over 4–5 weeks of game play. We focused on two groups of subjects who played different types of casual games previously shown to relate to WM and reasoning when played for a single session: (1) puzzle-based games played adaptively across sessions and (2) speeded switching games played non-adaptively across sessions. Reasoning uniquely predicted first session casual game scores for both groups and accounted for much of the relationship with WM. Furthermore, over time, WM became uniquely important for predicting casual game performance for the puzzle-based adaptive games but not for the speeded switching non-adaptive games. These results extend the burgeoning literature on cognitive abilities involved in video games by showing differential relationships of fluid abilities across different game types and extended play. More broadly, the current study illustrates the usefulness of using multiple cognitive measures in predicting performance, and provides potential directions for game-based cognitive training research. PMID:28326042

Magnetic Tunnel Junction Mimics Stochastic Cortical Spiking Neurons

NASA Astrophysics Data System (ADS)

Sengupta, Abhronil; Panda, Priyadarshini; Wijesinghe, Parami; Kim, Yusung; Roy, Kaushik

2016-07-01

Brain-inspired computing architectures attempt to mimic the computations performed in the neurons and the synapses in the human brain in order to achieve its efficiency in learning and cognitive tasks. In this work, we demonstrate the mapping of the probabilistic spiking nature of pyramidal neurons in the cortex to the stochastic switching behavior of a Magnetic Tunnel Junction in presence of thermal noise. We present results to illustrate the efficiency of neuromorphic systems based on such probabilistic neurons for pattern recognition tasks in presence of lateral inhibition and homeostasis. Such stochastic MTJ neurons can also potentially provide a direct mapping to the probabilistic computing elements in Belief Networks for performing regenerative tasks.

Detecting and isolating abrupt changes in linear switching systems

NASA Astrophysics Data System (ADS)

Nazari, Sohail; Zhao, Qing; Huang, Biao

2015-04-01

In this paper, a novel fault detection and isolation (FDI) method for switching linear systems is developed. All input and output signals are assumed to be corrupted with measurement noises. In the proposed method, a 'lifted' linear model named as stochastic hybrid decoupling polynomial (SHDP) is introduced. The SHDP model governs the dynamics of the switching linear system with all different modes, and is independent of the switching sequence. The error-in-variable (EIV) representation of SHDP is derived, and is used for the fault residual generation and isolation following the well-adopted local approach. The proposed FDI method can detect and isolate the fault-induced abrupt changes in switching models' parameters without estimating the switching modes. Furthermore, in this paper, the analytical expressions of the gradient vector and Hessian matrix are obtained based on the EIV SHDP formulation, so that they can be used to implement the online fault detection scheme. The performance of the proposed method is then illustrated by simulation examples.

Environmental Noise Could Promote Stochastic Local Stability of Behavioral Diversity Evolution

NASA Astrophysics Data System (ADS)

Zheng, Xiu-Deng; Li, Cong; Lessard, Sabin; Tao, Yi

2018-05-01

In this Letter, we investigate stochastic stability in a two-phenotype evolutionary game model for an infinite, well-mixed population undergoing discrete, nonoverlapping generations. We assume that the fitness of a phenotype is an exponential function of its expected payoff following random pairwise interactions whose outcomes randomly fluctuate with time. We show that the stochastic local stability of a constant interior equilibrium can be promoted by the random environmental noise even if the system may display a complicated nonlinear dynamics. This result provides a new perspective for a better understanding of how environmental fluctuations may contribute to the evolution of behavioral diversity.

Effects of digital game-based learning on student engagement and academic achievement

NASA Astrophysics Data System (ADS)

Little, Timothy W.

This experimental study was designed to determine the effect of digital game-based learning on student engagement and academic achievement. The sample was comprised of 34 students enrolled in a secondary Biology class in a rural public school. The study utilized an experimental pretest-posttest design with switching replications. After random assignment, students participated in one of two supplemental learning activities: playing a digital game designed to review science concepts or participating in a lab to review the same concepts. Students subsequently switched activities. Student achievement data were collected on mastery of science concepts, and student engagement data were collected utilizing self- and teacher-reported measures. Data were analyzed using analysis of variance (ANOVA) with repeated measures. Results demonstrated that the digital game was as effective as the lab activity at increasing teacher-reported student engagement and academic achievement. These findings may be of interest to school administrators or directors of teacher preparation programs on the potential effectiveness of digital games as a learning tool.

Axon growth regulation by a bistable molecular switch.

PubMed

Padmanabhan, Pranesh; Goodhill, Geoffrey J

2018-04-25

For the brain to function properly, its neurons must make the right connections during neural development. A key aspect of this process is the tight regulation of axon growth as axons navigate towards their targets. Neuronal growth cones at the tips of developing axons switch between growth and paused states during axonal pathfinding, and this switching behaviour determines the heterogeneous axon growth rates observed during brain development. The mechanisms controlling this switching behaviour, however, remain largely unknown. Here, using mathematical modelling, we predict that the molecular interaction network involved in axon growth can exhibit bistability, with one state representing a fast-growing growth cone state and the other a paused growth cone state. Owing to stochastic effects, even in an unchanging environment, model growth cones reversibly switch between growth and paused states. Our model further predicts that environmental signals could regulate axon growth rate by controlling the rates of switching between the two states. Our study presents a new conceptual understanding of growth cone switching behaviour, and suggests that axon guidance may be controlled by both cell-extrinsic factors and cell-intrinsic growth regulatory mechanisms. © 2018 The Author(s).

Dynamic phase transition in the prisoner's dilemma on a lattice with stochastic modifications

NASA Astrophysics Data System (ADS)

Saif, M. Ali; Gade, Prashant M.

2010-03-01

We present a detailed study of the prisoner's dilemma game with stochastic modifications on a two-dimensional lattice, in the presence of evolutionary dynamics. By very nature of the rules, the cooperators have incentives to cheat and fear being cheated. They may cheat even when this is not dictated by the evolutionary dynamics. We consider two variants here. In each case, the agents mimic the action (cooperation or defection) in the previous time step of the most successful agent in the neighborhood. But over and above this, the fraction p of cooperators spontaneously change their strategy to pure defector at every time step in the first variant. In the second variant, there are no pure cooperators. All cooperators keep defecting with probability p at every time step. In both cases, the system switches from a coexistence state to an all-defector state for higher values of p. We show that the transition between these states unambiguously belongs to the directed percolation universality class in 2 + 1 dimensions. We also study the local persistence. The persistence exponents obtained are higher than the ones obtained in previous studies, underlining their dependence on details of the dynamics.

Constrained Stochastic Extended Redundancy Analysis.

PubMed

DeSarbo, Wayne S; Hwang, Heungsun; Stadler Blank, Ashley; Kappe, Eelco

2015-06-01

We devise a new statistical methodology called constrained stochastic extended redundancy analysis (CSERA) to examine the comparative impact of various conceptual factors, or drivers, as well as the specific predictor variables that contribute to each driver on designated dependent variable(s). The technical details of the proposed methodology, the maximum likelihood estimation algorithm, and model selection heuristics are discussed. A sports marketing consumer psychology application is provided in a Major League Baseball (MLB) context where the effects of six conceptual drivers of game attendance and their defining predictor variables are estimated. Results compare favorably to those obtained using traditional extended redundancy analysis (ERA).

Coherent signal amplification in bistable nanomechanical oscillators by stochastic resonance

NASA Astrophysics Data System (ADS)

Badzey, Robert L.; Mohanty, Pritiraj

2005-10-01

Stochastic resonance is a counterintuitive concept: the addition of noise to a noisy system induces coherent amplification of its response. First suggested as a mechanism for the cyclic recurrence of ice ages, stochastic resonance has been seen in a wide variety of macroscopic physical systems: bistable ring lasers, superconducting quantum interference devices (SQUIDs), magnetoelastic ribbons and neurophysiological systems such as the receptors in crickets and crayfish. Although fundamentally important as a mechanism of coherent signal amplification, stochastic resonance has yet to be observed in nanoscale systems. Here we report the observation of stochastic resonance in bistable nanomechanical silicon oscillators. Our nanomechanical systems consist of beams that are clamped at each end and driven into transverse oscillation with the use of a radiofrequency source. Modulation of the source induces controllable switching of the beams between two stable, distinct states. We observe that the addition of white noise causes a marked amplification of the signal strength. Stochastic resonance in nanomechanical systems could have a function in the realization of controllable high-speed nanomechanical memory cells, and paves the way for exploring macroscopic quantum coherence and tunnelling.

Information Security Analysis Using Game Theory and Simulation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Schlicher, Bob G; Abercrombie, Robert K

Information security analysis can be performed using game theory implemented in dynamic simulations of Agent Based Models (ABMs). Such simulations can be verified with the results from game theory analysis and further used to explore larger scale, real world scenarios involving multiple attackers, defenders, and information assets. Our approach addresses imperfect information and scalability that allows us to also address previous limitations of current stochastic game models. Such models only consider perfect information assuming that the defender is always able to detect attacks; assuming that the state transition probabilities are fixed before the game assuming that the players actions aremore » always synchronous; and that most models are not scalable with the size and complexity of systems under consideration. Our use of ABMs yields results of selected experiments that demonstrate our proposed approach and provides a quantitative measure for realistic information systems and their related security scenarios.« less

Effect of video-game experience and position of flight stick controller on simulated-flight performance.

PubMed

Cho, Bo-Keun; Aghazadeh, Fereydoun; Al-Qaisi, Saif

2012-01-01

The purpose of this study was to determine the effects of video-game experience and flight-stick position on flying performance. The study divided participants into 2 groups; center- and side-stick groups, which were further divided into high and low level of video-game experience subgroups. The experiment consisted of 7 sessions of simulated flying, and in the last session, the flight stick controller was switched to the other position. Flight performance was measured in terms of the deviation of heading, altitude, and airspeed from their respective requirements. Participants with high experience in video games performed significantly better (p < .001) than the low-experienced group. Also, participants performed significantly better (p < .001) with the center-stick than the side-stick. When the side-stick controller was switched to the center-stick position, performance scores continued to increase (0.78 %). However, after switching from a center- to a side-stick controller, performance scores decreased (4.8%).

Diffusive flux in a model of stochastically gated oxygen transport in insect respiration

DOE Office of Scientific and Technical Information (OSTI.GOV)

Berezhkovskii, Alexander M.; Shvartsman, Stanislav Y.

Oxygen delivery to insect tissues is controlled by transport through a branched tubular network that is connected to the atmosphere by valve-like gates, known as spiracles. In certain physiological regimes, the spiracles appear to be randomly switching between open and closed states. Quantitative analysis of this regime leads a reaction-diffusion problem with stochastically switching boundary condition. We derive an expression for the diffusive flux at long times in this problem. Our approach starts with the derivation of the passage probability for a single particle that diffuses between a stochastically gated boundary, which models the opening and closing spiracle, and themore » perfectly absorbing boundary, which models oxygen absorption by the tissue. This passage probability is then used to derive an expression giving the diffusive flux as a function of the geometric parameters of the tube and characteristic time scales of diffusion and gate dynamics.« less

Diffusive flux in a model of stochastically gated oxygen transport in insect respiration.

PubMed

Berezhkovskii, Alexander M; Shvartsman, Stanislav Y

2016-05-28

Oxygen delivery to insect tissues is controlled by transport through a branched tubular network that is connected to the atmosphere by valve-like gates, known as spiracles. In certain physiological regimes, the spiracles appear to be randomly switching between open and closed states. Quantitative analysis of this regime leads a reaction-diffusion problem with stochastically switching boundary condition. We derive an expression for the diffusive flux at long times in this problem. Our approach starts with the derivation of the passage probability for a single particle that diffuses between a stochastically gated boundary, which models the opening and closing spiracle, and the perfectly absorbing boundary, which models oxygen absorption by the tissue. This passage probability is then used to derive an expression giving the diffusive flux as a function of the geometric parameters of the tube and characteristic time scales of diffusion and gate dynamics.

Degree Distribution of Position-Dependent Ball-Passing Networks in Football Games

NASA Astrophysics Data System (ADS)

Narizuka, Takuma; Yamamoto, Ken; Yamazaki, Yoshihiro

2015-08-01

We propose a simple stochastic model describing the position-dependent ball-passing network in football (soccer) games. In this network, a player in a certain area in a divided field is a node, and a pass between two nodes corresponds to an edge. Our stochastic process model is characterized by the consecutive choice of a node depending on its intrinsic fitness. We derive an explicit expression for the degree distribution and find that the derived distribution reproduces that for actual data reasonably well.

Linear System Control Using Stochastic Learning Automata

NASA Technical Reports Server (NTRS)

Ziyad, Nigel; Cox, E. Lucien; Chouikha, Mohamed F.

1998-01-01

This paper explains the use of a Stochastic Learning Automata (SLA) to control switching between three systems to produce the desired output response. The SLA learns the optimal choice of the damping ratio for each system to achieve a desired result. We show that the SLA can learn these states for the control of an unknown system with the proper choice of the error criteria. The results of using a single automaton are compared to using multiple automata.

Gene regulation and noise reduction by coupling of stochastic processes

NASA Astrophysics Data System (ADS)

Ramos, Alexandre F.; Hornos, José Eduardo M.; Reinitz, John

2015-02-01

Here we characterize the low-noise regime of a stochastic model for a negative self-regulating binary gene. The model has two stochastic variables, the protein number and the state of the gene. Each state of the gene behaves as a protein source governed by a Poisson process. The coupling between the two gene states depends on protein number. This fact has a very important implication: There exist protein production regimes characterized by sub-Poissonian noise because of negative covariance between the two stochastic variables of the model. Hence the protein numbers obey a probability distribution that has a peak that is sharper than those of the two coupled Poisson processes that are combined to produce it. Biochemically, the noise reduction in protein number occurs when the switching of the genetic state is more rapid than protein synthesis or degradation. We consider the chemical reaction rates necessary for Poisson and sub-Poisson processes in prokaryotes and eucaryotes. Our results suggest that the coupling of multiple stochastic processes in a negative covariance regime might be a widespread mechanism for noise reduction.

Gene regulation and noise reduction by coupling of stochastic processes

PubMed Central

Hornos, José Eduardo M.; Reinitz, John

2015-01-01

Here we characterize the low noise regime of a stochastic model for a negative self-regulating binary gene. The model has two stochastic variables, the protein number and the state of the gene. Each state of the gene behaves as a protein source governed by a Poisson process. The coupling between the the two gene states depends on protein number. This fact has a very important implication: there exist protein production regimes characterized by sub-Poissonian noise because of negative covariance between the two stochastic variables of the model. Hence the protein numbers obey a probability distribution that has a peak that is sharper than those of the two coupled Poisson processes that are combined to produce it. Biochemically, the noise reduction in protein number occurs when the switching of genetic state is more rapid than protein synthesis or degradation. We consider the chemical reaction rates necessary for Poisson and sub-Poisson processes in prokaryotes and eucaryotes. Our results suggest that the coupling of multiple stochastic processes in a negative covariance regime might be a widespread mechanism for noise reduction. PMID:25768447

Gene regulation and noise reduction by coupling of stochastic processes.

PubMed

Ramos, Alexandre F; Hornos, José Eduardo M; Reinitz, John

2015-02-01

Here we characterize the low-noise regime of a stochastic model for a negative self-regulating binary gene. The model has two stochastic variables, the protein number and the state of the gene. Each state of the gene behaves as a protein source governed by a Poisson process. The coupling between the two gene states depends on protein number. This fact has a very important implication: There exist protein production regimes characterized by sub-Poissonian noise because of negative covariance between the two stochastic variables of the model. Hence the protein numbers obey a probability distribution that has a peak that is sharper than those of the two coupled Poisson processes that are combined to produce it. Biochemically, the noise reduction in protein number occurs when the switching of the genetic state is more rapid than protein synthesis or degradation. We consider the chemical reaction rates necessary for Poisson and sub-Poisson processes in prokaryotes and eucaryotes. Our results suggest that the coupling of multiple stochastic processes in a negative covariance regime might be a widespread mechanism for noise reduction.

Leading the Game, Losing the Competition: Identifying Leaders and Followers in a Repeated Game

PubMed Central

Seip, Knut Lehre; Grøn, Øyvind

2016-01-01

We explore a new method for identifying leaders and followers, LF, in repeated games by analyzing an experimental, repeated (50 rounds) game where Row player shifts the payoff between small and large values–a type of “investor” and Column player determines who gets the payoff–a type of “manager”. We found that i) the Investor (Row) most often is a leading player and the manager (Column) a follower. The longer the Investor leads the game, the higher is both player’s payoff. Surprisingly however, it is always the Manager that achieves the largest payoff. ii) The game has an efficient cooperative strategy where the players alternate in receiving a high payoff, but the players never identify, or accept, that strategy. iii) Under the assumption that the information used by the players is closely associated with the leader- follower sequence, and that information is available before the player’s decisions are made, the players switched LF- strategy primarily as a function of information on the Investor’s investment and moves and secondly as a function of the Manager’s payoff. PMID:26968032

Clustering promotes switching dynamics in networks of noisy neurons

NASA Astrophysics Data System (ADS)

Franović, Igor; Klinshov, Vladimir

2018-02-01

Macroscopic variability is an emergent property of neural networks, typically manifested in spontaneous switching between the episodes of elevated neuronal activity and the quiescent episodes. We investigate the conditions that facilitate switching dynamics, focusing on the interplay between the different sources of noise and heterogeneity of the network topology. We consider clustered networks of rate-based neurons subjected to external and intrinsic noise and derive an effective model where the network dynamics is described by a set of coupled second-order stochastic mean-field systems representing each of the clusters. The model provides an insight into the different contributions to effective macroscopic noise and qualitatively indicates the parameter domains where switching dynamics may occur. By analyzing the mean-field model in the thermodynamic limit, we demonstrate that clustering promotes multistability, which gives rise to switching dynamics in a considerably wider parameter region compared to the case of a non-clustered network with sparse random connection topology.

Stochastic population dynamics in spatially extended predator-prey systems

NASA Astrophysics Data System (ADS)

Dobramysl, Ulrich; Mobilia, Mauro; Pleimling, Michel; Täuber, Uwe C.

2018-02-01

Spatially extended population dynamics models that incorporate demographic noise serve as case studies for the crucial role of fluctuations and correlations in biological systems. Numerical and analytic tools from non-equilibrium statistical physics capture the stochastic kinetics of these complex interacting many-particle systems beyond rate equation approximations. Including spatial structure and stochastic noise in models for predator-prey competition invalidates the neutral Lotka-Volterra population cycles. Stochastic models yield long-lived erratic oscillations stemming from a resonant amplification mechanism. Spatially extended predator-prey systems display noise-stabilized activity fronts that generate persistent correlations. Fluctuation-induced renormalizations of the oscillation parameters can be analyzed perturbatively via a Doi-Peliti field theory mapping of the master equation; related tools allow detailed characterization of extinction pathways. The critical steady-state and non-equilibrium relaxation dynamics at the predator extinction threshold are governed by the directed percolation universality class. Spatial predation rate variability results in more localized clusters, enhancing both competing species’ population densities. Affixing variable interaction rates to individual particles and allowing for trait inheritance subject to mutations induces fast evolutionary dynamics for the rate distributions. Stochastic spatial variants of three-species competition with ‘rock-paper-scissors’ interactions metaphorically describe cyclic dominance. These models illustrate intimate connections between population dynamics and evolutionary game theory, underscore the role of fluctuations to drive populations toward extinction, and demonstrate how space can support species diversity. Two-dimensional cyclic three-species May-Leonard models are characterized by the emergence of spiraling patterns whose properties are elucidated by a mapping onto a complex

Evolutionary Games with Randomly Changing Payoff Matrices

NASA Astrophysics Data System (ADS)

Yakushkina, Tatiana; Saakian, David B.; Bratus, Alexander; Hu, Chin-Kun

2015-06-01

Evolutionary games are used in various fields stretching from economics to biology. In most of these games a constant payoff matrix is assumed, although some works also consider dynamic payoff matrices. In this article we assume a possibility of switching the system between two regimes with different sets of payoff matrices. Potentially such a model can qualitatively describe the development of bacterial or cancer cells with a mutator gene present. A finite population evolutionary game is studied. The model describes the simplest version of annealed disorder in the payoff matrix and is exactly solvable at the large population limit. We analyze the dynamics of the model, and derive the equations for both the maximum and the variance of the distribution using the Hamilton-Jacobi equation formalism.

Finite-size effects and switching times for Moran process with mutation.

PubMed

DeVille, Lee; Galiardi, Meghan

2017-04-01

We consider the Moran process with two populations competing under an iterated Prisoner's Dilemma in the presence of mutation, and concentrate on the case where there are multiple evolutionarily stable strategies. We perform a complete bifurcation analysis of the deterministic system which arises in the infinite population size. We also study the Master equation and obtain asymptotics for the invariant distribution and metastable switching times for the stochastic process in the case of large but finite population. We also show that the stochastic system has asymmetries in the form of a skew for parameter values where the deterministic limit is symmetric.

Dynamics in atomic signaling games.

PubMed

Fox, Michael J; Touri, Behrouz; Shamma, Jeff S

2015-07-07

We study an atomic signaling game under stochastic evolutionary dynamics. There are a finite number of players who repeatedly update from a finite number of available languages/signaling strategies. Players imitate the most fit agents with high probability or mutate with low probability. We analyze the long-run distribution of states and show that, for sufficiently small mutation probability, its support is limited to efficient communication systems. We find that this behavior is insensitive to the particular choice of evolutionary dynamic, a property that is due to the game having a potential structure with a potential function corresponding to average fitness. Consequently, the model supports conclusions similar to those found in the literature on language competition. That is, we show that efficient languages eventually predominate the society while reproducing the empirical phenomenon of linguistic drift. The emergence of efficiency in the atomic case can be contrasted with results for non-atomic signaling games that establish the non-negligible possibility of convergence, under replicator dynamics, to states of unbounded efficiency loss. Copyright © 2015 Elsevier Ltd. All rights reserved.

The evolution of reputation-based partner-switching behaviors with a cost

PubMed Central

Li, Yixiao

2014-01-01

Humans constantly adjust their social relationships and choose new partners of good reputations, thereby promoting the evolution of cooperation. Individuals have to pay a cost to build a reputation, obtain others' information and then make partnership adjustments, yet the conditions under which such costly behaviors are able to evolve remain to be explored. In this model, I assume that individuals have to pay a cost to adjust their partnerships. Furthermore, whether an individual can adjust his partnership based on reputation is determined by his strategic preference, which is updated via coevolution. Using the metaphor of a public goods game where the collective benefit is shared among all members of a group, the coupling dynamics of cooperation and partnership adjustment were numerically simulated. Partner-switching behavior cannot evolve in a public goods game with a low amplification factor. However, such an effect can be exempted by raising the productivity of public goods or the frequency of partnership adjustment. Moreover, costly partner-switching behavior is remarkably promoted by the condition that the mechanism of reputation evaluation considers its prosociality. A mechanism of reputation evaluation that praises both cooperative and partner-switching behaviors allows them to coevolve. PMID:25091006

The evolution of reputation-based partner-switching behaviors with a cost

NASA Astrophysics Data System (ADS)

Li, Yixiao

2014-08-01

Humans constantly adjust their social relationships and choose new partners of good reputations, thereby promoting the evolution of cooperation. Individuals have to pay a cost to build a reputation, obtain others' information and then make partnership adjustments, yet the conditions under which such costly behaviors are able to evolve remain to be explored. In this model, I assume that individuals have to pay a cost to adjust their partnerships. Furthermore, whether an individual can adjust his partnership based on reputation is determined by his strategic preference, which is updated via coevolution. Using the metaphor of a public goods game where the collective benefit is shared among all members of a group, the coupling dynamics of cooperation and partnership adjustment were numerically simulated. Partner-switching behavior cannot evolve in a public goods game with a low amplification factor. However, such an effect can be exempted by raising the productivity of public goods or the frequency of partnership adjustment. Moreover, costly partner-switching behavior is remarkably promoted by the condition that the mechanism of reputation evaluation considers its prosociality. A mechanism of reputation evaluation that praises both cooperative and partner-switching behaviors allows them to coevolve.

Disease dynamics in a stochastic network game: a little empathy goes a long way in averting outbreaks

PubMed Central

Eksin, Ceyhun; Shamma, Jeff S.; Weitz, Joshua S.

2017-01-01

Individuals change their behavior during an epidemic in response to whether they and/or those they interact with are healthy or sick. Healthy individuals may utilize protective measures to avoid contracting a disease. Sick individuals may utilize preemptive measures to avoid spreading a disease. Yet, in practice both protective and preemptive changes in behavior come with costs. This paper proposes a stochastic network disease game model that captures the self-interests of individuals during the spread of a susceptible-infected-susceptible disease. In this model, individuals strategically modify their behavior based on current disease conditions. These reactions influence disease spread. We show that there is a critical level of concern, i.e., empathy, by the sick individuals above which disease is eradicated rapidly. Furthermore, we find that risk averse behavior by the healthy individuals cannot eradicate the disease without the preemptive measures of the sick individuals. Empathy is more effective than risk-aversion because when infectious individuals change behavior, they reduce all of their potential infections, whereas when healthy individuals change behavior, they reduce only a small portion of potential infections. This imbalance in the role played by the response of the infected versus the susceptible individuals on disease eradication affords critical policy insights. PMID:28290504

Dynamical predictors of an imminent phenotypic switch in bacteria

NASA Astrophysics Data System (ADS)

Wang, Huijing; Ray, J. Christian J.

2017-08-01

Single cells can stochastically switch across thresholds imposed by regulatory networks. Such thresholds can act as a tipping point, drastically changing global phenotypic states. In ecology and economics, imminent transitions across such tipping points can be predicted using dynamical early warning indicators. A typical example is ‘flickering’ of a fast variable, predicting a longer-lasting switch from a low to a high state or vice versa. Considering the different timescales between metabolite and protein fluctuations in bacteria, we hypothesized that metabolic early warning indicators predict imminent transitions across a network threshold caused by enzyme saturation. We used stochastic simulations to determine if flickering predicts phenotypic transitions, accounting for a variety of molecular physiological parameters, including enzyme affinity, burstiness of enzyme gene expression, homeostatic feedback, and rates of metabolic precursor influx. In most cases, we found that metabolic flickering rates are robustly peaked near the enzyme saturation threshold. The degree of fluctuation was amplified by product inhibition of the enzyme. We conclude that sensitivity to flickering in fast variables may be a possible natural or synthetic strategy to prepare physiological states for an imminent transition.

Motivational Correlations of Strategy Choices in the Prisoner's Dilemma Game

NASA Technical Reports Server (NTRS)

Williams, Carl D.; Steele, Matthew W.; Tedeschi, James T.

1969-01-01

The purpose of the present study was to investigate the relationship between the motivational dimensions assessed by the Motivation Analysis Test and prisoner's dilemma game behavior as measured both by the number of competitive strategy choices and the two-stage stochastic variables labelled trustworthiness, forgiveness, repentance, and trust by Rapoport.

Dynamic Oligopolistic Games Under Uncertainty: A Stochastic Programming Approach

DTIC Science & Technology

2005-09-03

and Algeria) compete in several gas markets (France, Italy, Netherlands, UK, FRGer, BelLux). This data set has also been used by Gurkan, Ozge and...observe that 3 the approach of Gurkan, Ozge and Robinson (1999) is primarily intended for single (rather than multi) period games. At the...the British electricity spot market. Journal of Political Economy 100. Gurkan, G., Ozge , A.Y., Robinson, S.M., 1999. Sample-path solution of

Life-Game, with Glass Beads and Molecules, on the Principles of the Origin of Life

ERIC Educational Resources Information Center

Eigen, Manfred; Haglund, Herman

1976-01-01

Discusses a theoretical model that uses a game as a base for studying processes of a stochastic nature, which involve chemical reactions, molecular systems, biological processes, cells, or people in a population. (MLH)

HackAttack: Game-Theoretic Analysis of Realistic Cyber Conflicts

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ferragut, Erik M; Brady, Andrew C; Brady, Ethan J

Game theory is appropriate for studying cyber conflict because it allows for an intelligent and goal-driven adversary. Applications of game theory have led to a number of results regarding optimal attack and defense strategies. However, the overwhelming majority of applications explore overly simplistic games, often ones in which each participant s actions are visible to every other participant. These simplifications strip away the fundamental properties of real cyber conflicts: probabilistic alerting, hidden actions, unknown opponent capabilities. In this paper, we demonstrate that it is possible to analyze a more realistic game, one in which different resources have different weaknesses, playersmore » have different exploits, and moves occur in secrecy, but they can be detected. Certainly, more advanced and complex games are possible, but the game presented here is more realistic than any other game we know of in the scientific literature. While optimal strategies can be found for simpler games using calculus, case-by-case analysis, or, for stochastic games, Q-learning, our more complex game is more naturally analyzed using the same methods used to study other complex games, such as checkers and chess. We define a simple evaluation function and employ multi-step searches to create strategies. We show that such scenarios can be analyzed, and find that in cases of extreme uncertainty, it is often better to ignore one s opponent s possible moves. Furthermore, we show that a simple evaluation function in a complex game can lead to interesting and nuanced strategies.« less

Quantifying stochasticity in the dynamics of delay-coupled semiconductor lasers via forbidden patterns.

PubMed

Tiana-Alsina, Jordi; Buldú, Javier M; Torrent, M C; García-Ojalvo, Jordi

2010-01-28

We quantify the level of stochasticity in the dynamics of two mutually coupled semiconductor lasers. Specifically, we concentrate on a regime in which the lasers synchronize their dynamics with a non-zero lag time, and the leader and laggard roles alternate irregularly between the lasers. We analyse this switching dynamics in terms of the number of forbidden patterns of the alternate time series. The results reveal that the system operates in a stochastic regime, with the level of stochasticity decreasing as the lasers are pumped further away from their lasing threshold. This behaviour is similar to that exhibited by a single semiconductor laser subject to external optical feedback, as its dynamics shifts from the regime of low-frequency fluctuations to coherence collapse. This journal is © 2010 The Royal Society

Winning in sequential Parrondo games by players with short-term memory

NASA Astrophysics Data System (ADS)

Cheung, K. W.; Ma, H. F.; Wu, D.; Lui, G. C.; Szeto, K. Y.

2016-05-01

The original Parrondo game, denoted as AB3, contains two independent games: A and B. The winning or losing of games A and B is defined by the change of one unit of capital. Game A is a losing game if played continuously, with winning probability p=0.5-ɛ , where ɛ =0.003 . Game B is also losing and has two coins: a good coin with winning probability {{p}\\text{g}}=0.75-ɛ is used if the player’s capital is not divisible by 3, otherwise a bad coin with winning probability {{p}\\text{b}}=0.1-ɛ is used. The Parrondo paradox refers to the situation where the mixture of games A and B in a sequence leads to winning in the long run. The paradox can be resolved using Markov chain analysis. We extend this setting of the Parrondo game to involve players with one-step memory. The player can win by switching his choice of A or B game in a Parrondo game sequence. If the player knows the identity of the game he plays and the state of his capital, then the player can win maximally. On the other hand, if the player does not know the nature of the game, then he is playing a (C, D) game, where either (C  =  A, D  =  B), or (C  =  B, D  =  A). For a player with one-step memory playing the AB3 game, he can achieve the highest expected gain with switching probability equal to 3/4 in the (C, D) game sequence. This result has been found first numerically and then proven analytically. Generalization to an AB mod(M) Parrondo game for other integers M has been made for the general domain of parameters {{p}\\text{b}}\\text{A}}<{{p}\\text{g}} . We find that for odd M the Parrondo effect does exist. However, for even M, there is no Parrondo effect for two cases: the initial game is A and the initial capital is even, or the initial game is B and the initial capital is odd. There is still a possibility of the Parrondo effect for the other two cases when M is even: the initial game is A and the initial capital is odd, or the initial game is B and the initial

Binomial tree method for pricing a regime-switching volatility stock loans

NASA Astrophysics Data System (ADS)

Putri, Endah R. M.; Zamani, Muhammad S.; Utomo, Daryono B.

2018-03-01

Binomial model with regime switching may represents the price of stock loan which follows the stochastic process. Stock loan is one of alternative that appeal investors to get the liquidity without selling the stock. The stock loan mechanism resembles that of American call option when someone can exercise any time during the contract period. From the resembles both of mechanism, determination price of stock loan can be interpreted from the model of American call option. The simulation result shows the behavior of the price of stock loan under a regime-switching with respect to various interest rate and maturity.

Game theoretic sensor management for target tracking

NASA Astrophysics Data System (ADS)

Shen, Dan; Chen, Genshe; Blasch, Erik; Pham, Khanh; Douville, Philip; Yang, Chun; Kadar, Ivan

2010-04-01

This paper develops and evaluates a game-theoretic approach to distributed sensor-network management for target tracking via sensor-based negotiation. We present a distributed sensor-based negotiation game model for sensor management for multi-sensor multi-target tacking situations. In our negotiation framework, each negotiation agent represents a sensor and each sensor maximizes their utility using a game approach. The greediness of each sensor is limited by the fact that the sensor-to-target assignment efficiency will decrease if too many sensor resources are assigned to a same target. It is similar to the market concept in real world, such as agreements between buyers and sellers in an auction market. Sensors are willing to switch targets so that they can obtain their highest utility and the most efficient way of applying their resources. Our sub-game perfect equilibrium-based negotiation strategies dynamically and distributedly assign sensors to targets. Numerical simulations are performed to demonstrate our sensor-based negotiation approach for distributed sensor management.

The Hamming distance in the minority game

NASA Astrophysics Data System (ADS)

D'hulst, R.; Rodgers, G. J.

1999-08-01

We investigate different versions of the minority game, a toy model for agents buying and selling a commodity. The Hamming distance between the strategies used by agents to make decisions is introduced as an analytical tool to determine several properties of these models. The success rate of the agents in an adaptive version of the game is compared with the rate from a stochastic version. It is shown numerically and analytically that the adaptive process is inefficient, increasing the success rate of the unused strategies while decreasing the success rate of the strategies used by the agents. The agents do not do as well as if they were forced to use only one strategy permanently. A version of the game in which the agents strategies evolve is also analysed using the notion of distance. The agents evolve into a state in which they are all using one strategy, which is again the state that yields the maximum success rate.

Real-time strategy game training: emergence of a cognitive flexibility trait.

PubMed

Glass, Brian D; Maddox, W Todd; Love, Bradley C

2013-01-01

Training in action video games can increase the speed of perceptual processing. However, it is unknown whether video-game training can lead to broad-based changes in higher-level competencies such as cognitive flexibility, a core and neurally distributed component of cognition. To determine whether video gaming can enhance cognitive flexibility and, if so, why these changes occur, the current study compares two versions of a real-time strategy (RTS) game. Using a meta-analytic Bayes factor approach, we found that the gaming condition that emphasized maintenance and rapid switching between multiple information and action sources led to a large increase in cognitive flexibility as measured by a wide array of non-video gaming tasks. Theoretically, the results suggest that the distributed brain networks supporting cognitive flexibility can be tuned by engrossing video game experience that stresses maintenance and rapid manipulation of multiple information sources. Practically, these results suggest avenues for increasing cognitive function.

Real-Time Strategy Game Training: Emergence of a Cognitive Flexibility Trait

PubMed Central

Glass, Brian D.; Maddox, W. Todd; Love, Bradley C.

2013-01-01

Training in action video games can increase the speed of perceptual processing. However, it is unknown whether video-game training can lead to broad-based changes in higher-level competencies such as cognitive flexibility, a core and neurally distributed component of cognition. To determine whether video gaming can enhance cognitive flexibility and, if so, why these changes occur, the current study compares two versions of a real-time strategy (RTS) game. Using a meta-analytic Bayes factor approach, we found that the gaming condition that emphasized maintenance and rapid switching between multiple information and action sources led to a large increase in cognitive flexibility as measured by a wide array of non-video gaming tasks. Theoretically, the results suggest that the distributed brain networks supporting cognitive flexibility can be tuned by engrossing video game experience that stresses maintenance and rapid manipulation of multiple information sources. Practically, these results suggest avenues for increasing cognitive function. PMID:23950921

Research on user behavior authentication model based on stochastic Petri nets

NASA Astrophysics Data System (ADS)

Zhang, Chengyuan; Xu, Haishui

2017-08-01

A behavioural authentication model based on stochastic Petri net is proposed to meet the randomness, uncertainty and concurrency characteristics of user behaviour. The use of random models in the location, changes, arc and logo to describe the characteristics of a variety of authentication and game relationships, so as to effectively implement the graphical user behaviour authentication model analysis method, according to the corresponding proof to verify the model is valuable.

Distributed fault detection over sensor networks with Markovian switching topologies

NASA Astrophysics Data System (ADS)

Ge, Xiaohua; Han, Qing-Long

2014-05-01

This paper deals with the distributed fault detection for discrete-time Markov jump linear systems over sensor networks with Markovian switching topologies. The sensors are scatteredly deployed in the sensor field and the fault detectors are physically distributed via a communication network. The system dynamics changes and sensing topology variations are modeled by a discrete-time Markov chain with incomplete mode transition probabilities. Each of these sensor nodes firstly collects measurement outputs from its all underlying neighboring nodes, processes these data in accordance with the Markovian switching topologies, and then transmits the processed data to the remote fault detector node. Network-induced delays and accumulated data packet dropouts are incorporated in the data transmission between the sensor nodes and the distributed fault detector nodes through the communication network. To generate localized residual signals, mode-independent distributed fault detection filters are proposed. By means of the stochastic Lyapunov functional approach, the residual system performance analysis is carried out such that the overall residual system is stochastically stable and the error between each residual signal and the fault signal is made as small as possible. Furthermore, a sufficient condition on the existence of the mode-independent distributed fault detection filters is derived in the simultaneous presence of incomplete mode transition probabilities, Markovian switching topologies, network-induced delays, and accumulated data packed dropouts. Finally, a stirred-tank reactor system is given to show the effectiveness of the developed theoretical results.

Mutation-selection equilibrium in games with multiple strategies.

PubMed

Antal, Tibor; Traulsen, Arne; Ohtsuki, Hisashi; Tarnita, Corina E; Nowak, Martin A

2009-06-21

In evolutionary games the fitness of individuals is not constant but depends on the relative abundance of the various strategies in the population. Here we study general games among n strategies in populations of large but finite size. We explore stochastic evolutionary dynamics under weak selection, but for any mutation rate. We analyze the frequency dependent Moran process in well-mixed populations, but almost identical results are found for the Wright-Fisher and Pairwise Comparison processes. Surprisingly simple conditions specify whether a strategy is more abundant on average than 1/n, or than another strategy, in the mutation-selection equilibrium. We find one condition that holds for low mutation rate and another condition that holds for high mutation rate. A linear combination of these two conditions holds for any mutation rate. Our results allow a complete characterization of nxn games in the limit of weak selection.

Study of selected phenotype switching strategies in time varying environment

NASA Astrophysics Data System (ADS)

Horvath, Denis; Brutovsky, Branislav

2016-03-01

Population heterogeneity plays an important role across many research, as well as the real-world, problems. The population heterogeneity relates to the ability of a population to cope with an environment change (or uncertainty) preventing its extinction. However, this ability is not always desirable as can be exemplified by an intratumor heterogeneity which positively correlates with the development of resistance to therapy. Causation of population heterogeneity is therefore in biology and medicine an intensively studied topic. In this paper the evolution of a specific strategy of population diversification, the phenotype switching, is studied at a conceptual level. The presented simulation model studies evolution of a large population of asexual organisms in a time-varying environment represented by a stochastic Markov process. Each organism disposes with a stochastic or nonlinear deterministic switching strategy realized by discrete-time models with evolvable parameters. We demonstrate that under rapidly varying exogenous conditions organisms operate in the vicinity of the bet-hedging strategy, while the deterministic patterns become relevant as the environmental variations are less frequent. Statistical characterization of the steady state regimes of the populations is done using the Hellinger and Kullback-Leibler functional distances and the Hamming distance.

Can training in a real-time strategy video game attenuate cognitive decline in older adults?

PubMed

Basak, Chandramallika; Boot, Walter R; Voss, Michelle W; Kramer, Arthur F

2008-12-01

Declines in various cognitive abilities, particularly executive control functions, are observed in older adults. An important goal of cognitive training is to slow or reverse these age-related declines. However, opinion is divided in the literature regarding whether cognitive training can engender transfer to a variety of cognitive skills in older adults. In the current study, the authors trained older adults in a real-time strategy video game for 23.5 hr in an effort to improve their executive functions. A battery of cognitive tasks, including tasks of executive control and visuospatial skills, were assessed before, during, and after video-game training. The trainees improved significantly in the measures of game performance. They also improved significantly more than the control participants in executive control functions, such as task switching, working memory, visual short-term memory, and reasoning. Individual differences in changes in game performance were correlated with improvements in task switching. The study has implications for the enhancement of executive control processes of older adults. Copyright (c) 2009 APA, all rights reserved.

Auditory Multi-Stability: Idiosyncratic Perceptual Switching Patterns, Executive Functions and Personality Traits

PubMed Central

Farkas, Dávid; Denham, Susan L.; Bendixen, Alexandra; Tóth, Dénes; Kondo, Hirohito M.; Winkler, István

2016-01-01

Multi-stability refers to the phenomenon of perception stochastically switching between possible interpretations of an unchanging stimulus. Despite considerable variability, individuals show stable idiosyncratic patterns of switching between alternative perceptions in the auditory streaming paradigm. We explored correlates of the individual switching patterns with executive functions, personality traits, and creativity. The main dimensions on which individual switching patterns differed from each other were identified using multidimensional scaling. Individuals with high scores on the dimension explaining the largest portion of the inter-individual variance switched more often between the alternative perceptions than those with low scores. They also perceived the most unusual interpretation more often, and experienced all perceptual alternatives with a shorter delay from stimulus onset. The ego-resiliency personality trait, which reflects a tendency for adaptive flexibility and experience seeking, was significantly positively related to this dimension. Taking these results together we suggest that this dimension may reflect the individual’s tendency for exploring the auditory environment. Executive functions were significantly related to some of the variables describing global properties of the switching patterns, such as the average number of switches. Thus individual patterns of perceptual switching in the auditory streaming paradigm are related to some personality traits and executive functions. PMID:27135945

On Social Optima of Non-Cooperative Mean Field Games

DOE Office of Scientific and Technical Information (OSTI.GOV)

Li, Sen; Zhang, Wei; Zhao, Lin

This paper studies the social optima in noncooperative mean-field games for a large population of agents with heterogeneous stochastic dynamic systems. Each agent seeks to maximize an individual utility functional, and utility functionals of different agents are coupled through a mean field term that depends on the mean of the population states/controls. The paper has the following contributions. First, we derive a set of control strategies for the agents that possess *-Nash equilibrium property, and converge to the mean-field Nash equilibrium as the population size goes to infinity. Second, we study the social optimal in the mean field game. Wemore » derive the conditions, termed the socially optimal conditions, under which the *-Nash equilibrium of the mean field game maximizes the social welfare. Third, a primal-dual algorithm is proposed to compute the *-Nash equilibrium of the mean field game. Since the *-Nash equilibrium of the mean field game is socially optimal, we can compute the equilibrium by solving the social welfare maximization problem, which can be addressed by a decentralized primal-dual algorithm. Numerical simulations are presented to demonstrate the effectiveness of the proposed approach.« less

Second-chance signal transduction explains cooperative flagellar switching.

PubMed

Zot, Henry G; Hasbun, Javier E; Minh, Nguyen Van

2012-01-01

The reversal of flagellar motion (switching) results from the interaction between a switch complex of the flagellar rotor and a torque-generating stationary unit, or stator (motor unit). To explain the steeply cooperative ligand-induced switching, present models propose allosteric interactions between subunits of the rotor, but do not address the possibility of a reaction that stimulates a bidirectional motor unit to reverse direction of torque. During flagellar motion, the binding of a ligand-bound switch complex at the dwell site could excite a motor unit. The probability that another switch complex of the rotor, moving according to steady-state rotation, will reach the same dwell site before that motor unit returns to ground state will be determined by the independent decay rate of the excited-state motor unit. Here, we derive an analytical expression for the energy coupling between a switch complex and a motor unit of the stator complex of a flagellum, and demonstrate that this model accounts for the cooperative switching response without the need for allosteric interactions. The analytical result can be reproduced by simulation when (1) the motion of the rotor delivers a subsequent ligand-bound switch to the excited motor unit, thereby providing the excited motor unit with a second chance to remain excited, and (2) the outputs from multiple independent motor units are constrained to a single all-or-none event. In this proposed model, a motor unit and switch complex represent the components of a mathematically defined signal transduction mechanism in which energy coupling is driven by steady-state and is regulated by stochastic ligand binding. Mathematical derivation of the model shows the analytical function to be a general form of the Hill equation (Hill AV (1910) The possible effects of the aggregation of the molecules of haemoglobin on its dissociation curves. J Physiol 40: iv-vii).

Entanglement guarantees emergence of cooperation in quantum prisoner's dilemma games on networks.

PubMed

Li, Angsheng; Yong, Xi

2014-09-05

It was known that cooperation of evolutionary prisoner's dilemma games fails to emerge in homogenous networks such as random graphs. Here we proposed a quantum prisoner's dilemma game. The game consists of two players, in which each player has three choices of strategy: cooperator (C), defector (D) and super cooperator (denoted by Q). We found that quantum entanglement guarantees emergence of a new cooperation, the super cooperation of the quantum prisoner's dilemma games, and that entanglement is the mechanism of guaranteed emergence of cooperation of evolutionary prisoner's dilemma games on networks. We showed that for a game with temptation b, there exists a threshold arccos √b/b for a measurement of entanglement, beyond which, (super) cooperation of evolutionary quantum prisoner's dilemma games is guaranteed to quickly emerge, giving rise to stochastic convergence of the cooperations, that if the entanglement degree γ is less than the threshold arccos √b/b, then the equilibrium frequency of cooperations of the games is positively correlated to the entanglement degree γ, and that if γ is less than arccos √b/b and b is beyond some boundary, then the equilibrium frequency of cooperations of the games on random graphs decreases as the average degree of the graphs increases.

Effects of adaptive dynamical linking in networked games

NASA Astrophysics Data System (ADS)

Yang, Zhihu; Li, Zhi; Wu, Te; Wang, Long

2013-10-01

The role of dynamical topologies in the evolution of cooperation has received considerable attention, as some studies have demonstrated that dynamical networks are much better than static networks in terms of boosting cooperation. Here we study a dynamical model of evolution of cooperation on stochastic dynamical networks in which there are no permanent partners to each agent. Whenever a new link is created, its duration is randomly assigned without any bias or preference. We allow the agent to adaptively adjust the duration of each link during the evolution in accordance with the feedback from game interactions. By Monte Carlo simulations, we find that cooperation can be remarkably promoted by this adaptive dynamical linking mechanism both for the game of pairwise interactions, such as the Prisoner's Dilemma game (PDG), and for the game of group interactions, illustrated by the public goods game (PGG). And the faster the adjusting rate, the more successful the evolution of cooperation. We also show that in this context weak selection favors cooperation much more than strong selection does. What is particularly meaningful is that the prosperity of cooperation in this study indicates that the rationality and selfishness of a single agent in adjusting social ties can lead to the progress of altruism of the whole population.

Load Balancing in Stochastic Networks: Algorithms, Analysis, and Game Theory

DTIC Science & Technology

2014-04-16

SECURITY CLASSIFICATION OF: The classic randomized load balancing model is the so-called supermarket model, which describes a system in which...P.O. Box 12211 Research Triangle Park, NC 27709-2211 mean-field limits, supermarket model, thresholds, game, randomized load balancing REPORT...balancing model is the so-called supermarket model, which describes a system in which customers arrive to a service center with n parallel servers according

Examining Spillovers between Long and Short Repeated Prisoner's Dilemma Games Played in the Laboratory.

PubMed

Arechar, Antonio A; Kouchaki, Maryam; Rand, David G

2018-03-01

We had participants play two sets of repeated Prisoner's Dilemma (RPD) games, one with a large continuation probability and the other with a small continuation probability, as well as Dictator Games (DGs) before and after the RPDs. We find that, regardless of which is RPD set is played first, participants typically cooperate when the continuation probability is large and defect when the continuation probability is small. However, there is an asymmetry in behavior when transitioning from one continuation probability to the other. When switching from large to small, transient higher levels of cooperation are observed in the early games of the small continuation set. Conversely, when switching from small to large, cooperation is immediately high in the first game of the large continuation set. We also observe that response times increase when transitioning between sets of RPDs, except for altruistic participants transitioning into the set of RPDs with long continuation probabilities. These asymmetries suggest a bias in favor of cooperation. Finally, we examine the link between altruism and RPD play. We find that small continuation probability RPD play is correlated with giving in DGs played before and after the RPDs, whereas high continuation probability RPD play is not.

Mean Field Games with a Dominating Player

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bensoussan, A., E-mail: axb046100@utdallas.edu; Chau, M. H. M., E-mail: michaelchaumanho@gmail.com; Yam, S. C. P., E-mail: scpyam@sta.cuhk.edu.hk

In this article, we consider mean field games between a dominating player and a group of representative agents, each of which acts similarly and also interacts with each other through a mean field term being substantially influenced by the dominating player. We first provide the general theory and discuss the necessary condition for the optimal controls and equilibrium condition by adopting adjoint equation approach. We then present a special case in the context of linear-quadratic framework, in which a necessary and sufficient condition can be asserted by stochastic maximum principle; we finally establish the sufficient condition that guarantees the uniquemore » existence of the equilibrium control. The proof of the convergence result of finite player game to mean field counterpart is provided in Appendix.« less

A Markov game theoretic data fusion approach for cyber situational awareness

NASA Astrophysics Data System (ADS)

Shen, Dan; Chen, Genshe; Cruz, Jose B., Jr.; Haynes, Leonard; Kruger, Martin; Blasch, Erik

2007-04-01

This paper proposes an innovative data-fusion/ data-mining game theoretic situation awareness and impact assessment approach for cyber network defense. Alerts generated by Intrusion Detection Sensors (IDSs) or Intrusion Prevention Sensors (IPSs) are fed into the data refinement (Level 0) and object assessment (L1) data fusion components. High-level situation/threat assessment (L2/L3) data fusion based on Markov game model and Hierarchical Entity Aggregation (HEA) are proposed to refine the primitive prediction generated by adaptive feature/pattern recognition and capture new unknown features. A Markov (Stochastic) game method is used to estimate the belief of each possible cyber attack pattern. Game theory captures the nature of cyber conflicts: determination of the attacking-force strategies is tightly coupled to determination of the defense-force strategies and vice versa. Also, Markov game theory deals with uncertainty and incompleteness of available information. A software tool is developed to demonstrate the performance of the high level information fusion for cyber network defense situation and a simulation example shows the enhanced understating of cyber-network defense.

Stochastic dynamics and non-equilibrium thermodynamics of a bistable chemical system: the Schlögl model revisited.

PubMed

Vellela, Melissa; Qian, Hong

2009-10-06

Schlögl's model is the canonical example of a chemical reaction system that exhibits bistability. Because the biological examples of bistability and switching behaviour are increasingly numerous, this paper presents an integrated deterministic, stochastic and thermodynamic analysis of the model. After a brief review of the deterministic and stochastic modelling frameworks, the concepts of chemical and mathematical detailed balances are discussed and non-equilibrium conditions are shown to be necessary for bistability. Thermodynamic quantities such as the flux, chemical potential and entropy production rate are defined and compared across the two models. In the bistable region, the stochastic model exhibits an exchange of the global stability between the two stable states under changes in the pump parameters and volume size. The stochastic entropy production rate shows a sharp transition that mirrors this exchange. A new hybrid model that includes continuous diffusion and discrete jumps is suggested to deal with the multiscale dynamics of the bistable system. Accurate approximations of the exponentially small eigenvalue associated with the time scale of this switching and the full time-dependent solution are calculated using Matlab. A breakdown of previously known asymptotic approximations on small volume scales is observed through comparison with these and Monte Carlo results. Finally, in the appendix section is an illustration of how the diffusion approximation of the chemical master equation can fail to represent correctly the mesoscopically interesting steady-state behaviour of the system.

Stochastic dynamics and mechanosensitivity of myosin II minifilaments

NASA Astrophysics Data System (ADS)

Albert, Philipp J.; Erdmann, Thorsten; Schwarz, Ulrich S.

2014-09-01

Tissue cells are in a state of permanent mechanical tension that is maintained mainly by myosin II minifilaments, which are bipolar assemblies of tens of myosin II molecular motors contracting actin networks and bundles. Here we introduce a stochastic model for myosin II minifilaments as two small myosin II motor ensembles engaging in a stochastic tug-of-war. Each of the two ensembles is described by the parallel cluster model that allows us to use exact stochastic simulations and at the same time to keep important molecular details of the myosin II cross-bridge cycle. Our simulation and analytical results reveal a strong dependence of myosin II minifilament dynamics on environmental stiffness that is reminiscent of the cellular response to substrate stiffness. For small stiffness, minifilaments form transient crosslinks exerting short spikes of force with negligible mean. For large stiffness, minifilaments form near permanent crosslinks exerting a mean force which hardly depends on environmental elasticity. This functional switch arises because dissociation after the power stroke is suppressed by force (catch bonding) and because ensembles can no longer perform the power stroke at large forces. Symmetric myosin II minifilaments perform a random walk with an effective diffusion constant which decreases with increasing ensemble size, as demonstrated for rigid substrates with an analytical treatment.

Taming stochastic bifurcations in fractional-order systems via noise and delayed feedback

NASA Astrophysics Data System (ADS)

Sun, Zhongkui; Zhang, Jintian; Yang, Xiaoli; Xu, Wei

2017-08-01

The dynamics in fractional-order systems have been widely studied during the past decade due to the potential applications in new materials and anomalous diffusions, but the investigations have been so far restricted to a fractional-order system without time delay(s). In this paper, we report the first study of random responses of fractional-order system coupled with noise and delayed feedback. Stochastic averaging method has been utilized to determine the stationary probability density functions (PDFs) by means of the principle of minimum mean-square error, based on which stochastic bifurcations could be identified through recognizing the shape of the PDFs. It has been found that by changing the fractional order the shape of the PDFs can switch from unimodal distribution to bimodal one, or from bimodal distribution to unimodal one, thus announcing the onset of stochastic bifurcation. Further, we have demonstrated that by merely modulating the time delay, the feedback strengths, or the noise intensity, the shapes of PDFs can transit between a single peak and a double peak. Therefore, it provides an efficient candidate to control, say, induce or suppress, the stochastic bifurcations in fractional-order systems.

Measurement of resistance switching dynamics in copper sulfide memristor structures

NASA Astrophysics Data System (ADS)

McCreery, Kaitlin; Olson, Matthew; Teitsworth, Stephen

Resistance switching materials are the subject of current research in large part for their potential to enable novel computing devices and architectures such as resistance random access memories and neuromorphic chips. A common feature of memristive structures is the hysteretic switching between high and low resistance states which is induced by the application of a sufficiently large electric field. Here, we describe a relatively simple wet chemistry process to fabricate Cu2 S / Cu memristive structures with Cu2 S film thickness ranging up to 150 micron. In this case, resistance switching is believed to be mediated by electromigration of Cu ions from the Cu substrate into the Cu2 S film. Hysteretic current-voltage curves are measured and reveal switching voltages of about 0.8 Volts with a relatively large variance and independent of film thickness. In order to gain insight into the dynamics and variability of the switching process, we have measured the time-dependent current response to voltage pulses of varying height and duration with a time resolution of 1 ns. The transient response consists of a deterministic RC component as well as stochastically varying abrupt current steps that occur within a few microseconds of the pulse application.

Attacker-defender game from a network science perspective

NASA Astrophysics Data System (ADS)

Li, Ya-Peng; Tan, Suo-Yi; Deng, Ye; Wu, Jun

2018-05-01

Dealing with the protection of critical infrastructures, many game-theoretic methods have been developed to study the strategic interactions between defenders and attackers. However, most game models ignore the interrelationship between different components within a certain system. In this paper, we propose a simultaneous-move attacker-defender game model, which is a two-player zero-sum static game with complete information. The strategies and payoffs of this game are defined on the basis of the topology structure of the infrastructure system, which is represented by a complex network. Due to the complexity of strategies, the attack and defense strategies are confined by two typical strategies, namely, targeted strategy and random strategy. The simulation results indicate that in a scale-free network, the attacker virtually always attacks randomly in the Nash equilibrium. With a small cost-sensitive parameter, representing the degree to which costs increase with the importance of a target, the defender protects the hub targets with large degrees preferentially. When the cost-sensitive parameter exceeds a threshold, the defender switches to protecting nodes randomly. Our work provides a new theoretical framework to analyze the confrontations between the attacker and the defender on critical infrastructures and deserves further study.

The timing and probability of treatment switch under cost uncertainty: an application to patients with gastrointestinal stromal tumor.

PubMed

de Mello-Sampayo, Felipa

2014-03-01

Cost fluctuations render the outcome of any treatment switch uncertain, so that decision makers might have to wait for more information before optimally switching treatments, especially when the incremental cost per quality-adjusted life year (QALY) gained cannot be fully recovered later on. To analyze the timing of treatment switch under cost uncertainty. A dynamic stochastic model for the optimal timing of a treatment switch is developed and applied to a problem in medical decision taking, i.e. to patients with unresectable gastrointestinal stromal tumour (GIST). The theoretical model suggests that cost uncertainty reduces expected net benefit. In addition, cost volatility discourages switching treatments. The stochastic model also illustrates that as technologies become less cost competitive, the cost uncertainty becomes more dominant. With limited substitutability, higher quality of technologies will increase the demand for those technologies disregarding the cost uncertainty. The results of the empirical application suggest that the first-line treatment may be the better choice when considering lifetime welfare. Under uncertainty and irreversibility, low-risk patients must begin the second-line treatment as soon as possible, which is precisely when the second-line treatment is least valuable. As the costs of reversing current treatment impacts fall, it becomes more feasible to provide the option-preserving treatment to these low-risk individuals later on. Copyright © 2014 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Fixation of strategies with the Moran and Fermi processes in evolutionary games

NASA Astrophysics Data System (ADS)

Liu, Xuesong; He, Mingfeng; Kang, Yibin; Pan, Qiuhui

2017-10-01

A model of stochastic evolutionary game dynamics with finite population was built. It combines the standard Moran and Fermi rules with two strategies cooperation and defection. We obtain the expressions of fixation probabilities and fixation times. The one-third rule which has been found in the frequency dependent Moran process also holds for our model. We obtain the conditions of strategy being an evolutionarily stable strategy in our model, and then make a comparison with the standard Moran process. Besides, the analytical results show that compared with the standard Moran process, fixation occurs with higher probabilities under a prisoner's dilemma game and coordination game, but with lower probabilities under a coexistence game. The simulation result shows that the fixation time in our mixed process is lower than that in the standard Fermi process. In comparison with the standard Moran process, fixation always takes more time on average in spatial populations, regardless of the game. In addition, the fixation time decreases with the growth of the number of neighbors.

A Game-Theoretic Response Strategy for Coordinator Attack in Wireless Sensor Networks

PubMed Central

Liu, Jianhua; Yue, Guangxue; Shang, Huiliang; Li, Hongjie

2014-01-01

The coordinator is a specific node that controls the whole network and has a significant impact on the performance in cooperative multihop ZigBee wireless sensor networks (ZWSNs). However, the malicious node attacks coordinator nodes in an effort to waste the resources and disrupt the operation of the network. Attacking leads to a failure of one round of communication between the source nodes and destination nodes. Coordinator selection is a technique that can considerably defend against attack and reduce the data delivery delay, and increase network performance of cooperative communications. In this paper, we propose an adaptive coordinator selection algorithm using game and fuzzy logic aiming at both minimizing the average number of hops and maximizing network lifetime. The proposed game model consists of two interrelated formulations: a stochastic game for dynamic defense and a best response policy using evolutionary game formulation for coordinator selection. The stable equilibrium best policy to response defense is obtained from this game model. It is shown that the proposed scheme can improve reliability and save energy during the network lifetime with respect to security. PMID:25105171

A game-theoretic response strategy for coordinator attack in wireless sensor networks.

PubMed

Liu, Jianhua; Yue, Guangxue; Shen, Shigen; Shang, Huiliang; Li, Hongjie

2014-01-01

The coordinator is a specific node that controls the whole network and has a significant impact on the performance in cooperative multihop ZigBee wireless sensor networks (ZWSNs). However, the malicious node attacks coordinator nodes in an effort to waste the resources and disrupt the operation of the network. Attacking leads to a failure of one round of communication between the source nodes and destination nodes. Coordinator selection is a technique that can considerably defend against attack and reduce the data delivery delay, and increase network performance of cooperative communications. In this paper, we propose an adaptive coordinator selection algorithm using game and fuzzy logic aiming at both minimizing the average number of hops and maximizing network lifetime. The proposed game model consists of two interrelated formulations: a stochastic game for dynamic defense and a best response policy using evolutionary game formulation for coordinator selection. The stable equilibrium best policy to response defense is obtained from this game model. It is shown that the proposed scheme can improve reliability and save energy during the network lifetime with respect to security.

Extended Parrondo's game and Brownian ratchets: strong and weak Parrondo effect.

PubMed

Wu, Degang; Szeto, Kwok Yip

2014-02-01

Inspired by the flashing ratchet, Parrondo's game presents an apparently paradoxical situation. Parrondo's game consists of two individual games, game A and game B. Game A is a slightly losing coin-tossing game. Game B has two coins, with an integer parameter M. If the current cumulative capital (in discrete unit) is a multiple of M, an unfavorable coin p(b) is used, otherwise a favorable p(g) coin is used. Paradoxically, a combination of game A and game B could lead to a winning game, which is the Parrondo effect. We extend the original Parrondo's game to include the possibility of M being either M(1) or M(2). Also, we distinguish between strong Parrondo effect, i.e., two losing games combine to form a winning game, and weak Parrondo effect, i.e., two games combine to form a better-performing game. We find that when M(2) is not a multiple of M(1), the combination of B(M(1)) and B(M(2)) has strong and weak Parrondo effect for some subsets in the parameter space (p(b),p(g)), while there is neither strong nor weak effect when M(2) is a multiple of M(1). Furthermore, when M(2) is not a multiple of M(1), a stochastic mixture of game A may cancel the strong and weak Parrondo effect. Following a discretization scheme in the literature of Parrondo's game, we establish a link between our extended Parrondo's game with the analysis of discrete Brownian ratchet. We find a relation between the Parrondo effect of our extended model to the macroscopic bias in a discrete ratchet. The slope of a ratchet potential can be mapped to the fair game condition in the extended model, so that under some conditions, the macroscopic bias in a discrete ratchet can provide a good predictor for the game performance of the extended model. On the other hand, our extended model suggests a design of a ratchet in which the potential is a mixture of two periodic potentials.

Parallel replica dynamics method for bistable stochastic reaction networks: Simulation and sensitivity analysis

NASA Astrophysics Data System (ADS)

Wang, Ting; Plecháč, Petr

2017-12-01

Stochastic reaction networks that exhibit bistable behavior are common in systems biology, materials science, and catalysis. Sampling of stationary distributions is crucial for understanding and characterizing the long-time dynamics of bistable stochastic dynamical systems. However, simulations are often hindered by the insufficient sampling of rare transitions between the two metastable regions. In this paper, we apply the parallel replica method for a continuous time Markov chain in order to improve sampling of the stationary distribution in bistable stochastic reaction networks. The proposed method uses parallel computing to accelerate the sampling of rare transitions. Furthermore, it can be combined with the path-space information bounds for parametric sensitivity analysis. With the proposed methodology, we study three bistable biological networks: the Schlögl model, the genetic switch network, and the enzymatic futile cycle network. We demonstrate the algorithmic speedup achieved in these numerical benchmarks. More significant acceleration is expected when multi-core or graphics processing unit computer architectures and programming tools such as CUDA are employed.

Semi-stochastic full configuration interaction quantum Monte Carlo

NASA Astrophysics Data System (ADS)

Holmes, Adam; Petruzielo, Frank; Khadilkar, Mihir; Changlani, Hitesh; Nightingale, M. P.; Umrigar, C. J.

2012-02-01

In the recently proposed full configuration interaction quantum Monte Carlo (FCIQMC) [1,2], the ground state is projected out stochastically, using a population of walkers each of which represents a basis state in the Hilbert space spanned by Slater determinants. The infamous fermion sign problem manifests itself in the fact that walkers of either sign can be spawned on a given determinant. We propose an improvement on this method in the form of a hybrid stochastic/deterministic technique, which we expect will improve the efficiency of the algorithm by ameliorating the sign problem. We test the method on atoms and molecules, e.g., carbon, carbon dimer, N2 molecule, and stretched N2. [4pt] [1] Fermion Monte Carlo without fixed nodes: a Game of Life, death and annihilation in Slater Determinant space. George Booth, Alex Thom, Ali Alavi. J Chem Phys 131, 050106, (2009).[0pt] [2] Survival of the fittest: Accelerating convergence in full configuration-interaction quantum Monte Carlo. Deidre Cleland, George Booth, and Ali Alavi. J Chem Phys 132, 041103 (2010).

Use of Business Simulations and Games in Higher Education.

ERIC Educational Resources Information Center

Lloyd, John W.

Simulation and business games can meet the need to teach decision making in that they offer a dynamic context in which the results of a decision has to be lived with. This view was reached after a switch from business to higher education prompted a search for teaching methods more suitable and effective for business education than the lecture…

On the efficacy of stochastic collocation, stochastic Galerkin, and stochastic reduced order models for solving stochastic problems

DOE PAGES

Richard V. Field, Jr.; Emery, John M.; Grigoriu, Mircea Dan

2015-05-19

The stochastic collocation (SC) and stochastic Galerkin (SG) methods are two well-established and successful approaches for solving general stochastic problems. A recently developed method based on stochastic reduced order models (SROMs) can also be used. Herein we provide a comparison of the three methods for some numerical examples; our evaluation only holds for the examples considered in the paper. The purpose of the comparisons is not to criticize the SC or SG methods, which have proven very useful for a broad range of applications, nor is it to provide overall ratings of these methods as compared to the SROM method.more » Furthermore, our objectives are to present the SROM method as an alternative approach to solving stochastic problems and provide information on the computational effort required by the implementation of each method, while simultaneously assessing their performance for a collection of specific problems.« less

The Influence of Vacuum Circuit Breakers and Different Motor Models on Switching Overvoltages in Motor Circuits

NASA Astrophysics Data System (ADS)

Wong, Cat S. M.; Snider, L. A.; Lo, Edward W. C.; Chung, T. S.

Switching of induction motors with vacuum circuit breakers continues to be a concern. In this paper the influence on statistical overvoltages of the stochastic characteristics of vacuum circuit breakers, high frequency models of motors and transformers, and network characteristics, including cable lengths and network topology are evaluated and a general view of the overvoltages phenomena is presented. Finally, a real case study on the statistical voltage levels and risk-of-failure resulting from switching of a vacuum circuit breaker in an industrial installation in Hong Kong is presented.

Stochastic switching of TiO2-based memristive devices with identical initial memory states

PubMed Central

2014-01-01

In this work, we show that identical TiO2-based memristive devices that possess the same initial resistive states are only phenomenologically similar as their internal structures may vary significantly, which could render quite dissimilar switching dynamics. We experimentally demonstrated that the resistive switching of practical devices with similar initial states could occur at different programming stimuli cycles. We argue that similar memory states can be transcribed via numerous distinct active core states through the dissimilar reduced TiO2-x filamentary distributions. Our hypothesis was finally verified via simulated results of the memory state evolution, by taking into account dissimilar initial filamentary distribution. PMID:24994953

Mutation-selection equilibrium in games with mixed strategies.

PubMed

Tarnita, Corina E; Antal, Tibor; Nowak, Martin A

2009-11-07

We develop a new method for studying stochastic evolutionary game dynamics of mixed strategies. We consider the general situation: there are n pure strategies whose interactions are described by an nxn payoff matrix. Players can use mixed strategies, which are given by the vector (p(1),...,p(n)). Each entry specifies the probability to use the corresponding pure strategy. The sum over all entries is one. Therefore, a mixed strategy is a point in the simplex S(n). We study evolutionary dynamics in a well-mixed population of finite size. Individuals reproduce proportional to payoff. We consider the case of weak selection, which means the payoff from the game is only a small contribution to overall fitness. Reproduction can be subject to mutation; a mutant adopts a randomly chosen mixed strategy. We calculate the average abundance of every mixed strategy in the stationary distribution of the mutation-selection process. We find the crucial conditions that specify if a strategy is favored or opposed by selection. One condition holds for low mutation rate, another for high mutation rate. The result for any mutation rate is a linear combination of those two. As a specific example we study the Hawk-Dove game. We prove general statements about the relationship between games with pure and with mixed strategies.

Sliding mode control-based linear functional observers for discrete-time stochastic systems

NASA Astrophysics Data System (ADS)

Singh, Satnesh; Janardhanan, Sivaramakrishnan

2017-11-01

Sliding mode control (SMC) is one of the most popular techniques to stabilise linear discrete-time stochastic systems. However, application of SMC becomes difficult when the system states are not available for feedback. This paper presents a new approach to design a SMC-based functional observer for discrete-time stochastic systems. The functional observer is based on the Kronecker product approach. Existence conditions and stability analysis of the proposed observer are given. The control input is estimated by a novel linear functional observer. This approach leads to a non-switching type of control, thereby eliminating the fundamental cause of chatter. Furthermore, the functional observer is designed in such a way that the effect of process and measurement noise is minimised. Simulation example is given to illustrate and validate the proposed design method.

Stochastic resonance in attention control

NASA Astrophysics Data System (ADS)

Kitajo, K.; Yamanaka, K.; Ward, L. M.; Yamamoto, Y.

2006-12-01

We investigated the beneficial role of noise in a human higher brain function, namely visual attention control. We asked subjects to detect a weak gray-level target inside a marker box either in the left or the right visual field. Signal detection performance was optimized by presenting a low level of randomly flickering gray-level noise between and outside the two possible target locations. Further, we found that an increase in eye movement (saccade) rate helped to compensate for the usual deterioration in detection performance at higher noise levels. To our knowledge, this is the first experimental evidence that noise can optimize a higher brain function which involves distinct brain regions above the level of primary sensory systems -- switching behavior between multi-stable attention states -- via the mechanism of stochastic resonance.

ID201202961, DOE S-124,539, Information Security Analysis Using Game Theory and Simulation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Abercrombie, Robert K; Schlicher, Bob G

Information security analysis can be performed using game theory implemented in dynamic simulations of Agent Based Models (ABMs). Such simulations can be verified with the results from game theory analysis and further used to explore larger scale, real world scenarios involving multiple attackers, defenders, and information assets. Our approach addresses imperfect information and scalability that allows us to also address previous limitations of current stochastic game models. Such models only consider perfect information assuming that the defender is always able to detect attacks; assuming that the state transition probabilities are fixed before the game assuming that the players actions aremore » always synchronous; and that most models are not scalable with the size and complexity of systems under consideration. Our use of ABMs yields results of selected experiments that demonstrate our proposed approach and provides a quantitative measure for realistic information systems and their related security scenarios.« less

Examining Spillovers between Long and Short Repeated Prisoner’s Dilemma Games Played in the Laboratory

PubMed Central

Arechar, Antonio A.; Kouchaki, Maryam; Rand, David G.

2018-01-01

We had participants play two sets of repeated Prisoner’s Dilemma (RPD) games, one with a large continuation probability and the other with a small continuation probability, as well as Dictator Games (DGs) before and after the RPDs. We find that, regardless of which is RPD set is played first, participants typically cooperate when the continuation probability is large and defect when the continuation probability is small. However, there is an asymmetry in behavior when transitioning from one continuation probability to the other. When switching from large to small, transient higher levels of cooperation are observed in the early games of the small continuation set. Conversely, when switching from small to large, cooperation is immediately high in the first game of the large continuation set. We also observe that response times increase when transitioning between sets of RPDs, except for altruistic participants transitioning into the set of RPDs with long continuation probabilities. These asymmetries suggest a bias in favor of cooperation. Finally, we examine the link between altruism and RPD play. We find that small continuation probability RPD play is correlated with giving in DGs played before and after the RPDs, whereas high continuation probability RPD play is not. PMID:29809199

A Monte-Carlo game theoretic approach for Multi-Criteria Decision Making under uncertainty

NASA Astrophysics Data System (ADS)

Madani, Kaveh; Lund, Jay R.

2011-05-01

Game theory provides a useful framework for studying Multi-Criteria Decision Making problems. This paper suggests modeling Multi-Criteria Decision Making problems as strategic games and solving them using non-cooperative game theory concepts. The suggested method can be used to prescribe non-dominated solutions and also can be used as a method to predict the outcome of a decision making problem. Non-cooperative stability definitions for solving the games allow consideration of non-cooperative behaviors, often neglected by other methods which assume perfect cooperation among decision makers. To deal with the uncertainty in input variables a Monte-Carlo Game Theory (MCGT) approach is suggested which maps the stochastic problem into many deterministic strategic games. The games are solved using non-cooperative stability definitions and the results include possible effects of uncertainty in input variables on outcomes. The method can handle multi-criteria multi-decision-maker problems with uncertainty. The suggested method does not require criteria weighting, developing a compound decision objective, and accurate quantitative (cardinal) information as it simplifies the decision analysis by solving problems based on qualitative (ordinal) information, reducing the computational burden substantially. The MCGT method is applied to analyze California's Sacramento-San Joaquin Delta problem. The suggested method provides insights, identifies non-dominated alternatives, and predicts likely decision outcomes.

Stochastic approximation methods-Powerful tools for simulation and optimization: A survey of some recent work on multi-agent systems and cyber-physical systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yin, George; Wang, Le Yi; Zhang, Hongwei

2014-12-10

Stochastic approximation methods have found extensive and diversified applications. Recent emergence of networked systems and cyber-physical systems has generated renewed interest in advancing stochastic approximation into a general framework to support algorithm development for information processing and decisions in such systems. This paper presents a survey on some recent developments in stochastic approximation methods and their applications. Using connected vehicles in platoon formation and coordination as a platform, we highlight some traditional and new methodologies of stochastic approximation algorithms and explain how they can be used to capture essential features in networked systems. Distinct features of networked systems with randomlymore » switching topologies, dynamically evolving parameters, and unknown delays are presented, and control strategies are provided.« less

A hybrid fuzzy logic/constraint satisfaction problem approach to automatic decision making in simulation game models.

PubMed

Braathen, Sverre; Sendstad, Ole Jakob

2004-08-01

Possible techniques for representing automatic decision-making behavior approximating human experts in complex simulation model experiments are of interest. Here, fuzzy logic (FL) and constraint satisfaction problem (CSP) methods are applied in a hybrid design of automatic decision making in simulation game models. The decision processes of a military headquarters are used as a model for the FL/CSP decision agents choice of variables and rulebases. The hybrid decision agent design is applied in two different types of simulation games to test the general applicability of the design. The first application is a two-sided zero-sum sequential resource allocation game with imperfect information interpreted as an air campaign game. The second example is a network flow stochastic board game designed to capture important aspects of land manoeuvre operations. The proposed design is shown to perform well also in this complex game with a very large (billionsize) action set. Training of the automatic FL/CSP decision agents against selected performance measures is also shown and results are presented together with directions for future research.

Time series analysis for minority game simulations of financial markets

NASA Astrophysics Data System (ADS)

Ferreira, Fernando F.; Francisco, Gerson; Machado, Birajara S.; Muruganandam, Paulsamy

2003-04-01

The minority game (MG) model introduced recently provides promising insights into the understanding of the evolution of prices, indices and rates in the financial markets. In this paper we perform a time series analysis of the model employing tools from statistics, dynamical systems theory and stochastic processes. Using benchmark systems and a financial index for comparison, several conclusions are obtained about the generating mechanism for this kind of evolution. The motion is deterministic, driven by occasional random external perturbation. When the interval between two successive perturbations is sufficiently large, one can find low dimensional chaos in this regime. However, the full motion of the MG model is found to be similar to that of the first differences of the SP500 index: stochastic, nonlinear and (unit root) stationary.

Hybrid deterministic/stochastic simulation of complex biochemical systems.

PubMed

Lecca, Paola; Bagagiolo, Fabio; Scarpa, Marina

2017-11-21

In a biological cell, cellular functions and the genetic regulatory apparatus are implemented and controlled by complex networks of chemical reactions involving genes, proteins, and enzymes. Accurate computational models are indispensable means for understanding the mechanisms behind the evolution of a complex system, not always explored with wet lab experiments. To serve their purpose, computational models, however, should be able to describe and simulate the complexity of a biological system in many of its aspects. Moreover, it should be implemented by efficient algorithms requiring the shortest possible execution time, to avoid enlarging excessively the time elapsing between data analysis and any subsequent experiment. Besides the features of their topological structure, the complexity of biological networks also refers to their dynamics, that is often non-linear and stiff. The stiffness is due to the presence of molecular species whose abundance fluctuates by many orders of magnitude. A fully stochastic simulation of a stiff system is computationally time-expensive. On the other hand, continuous models are less costly, but they fail to capture the stochastic behaviour of small populations of molecular species. We introduce a new efficient hybrid stochastic-deterministic computational model and the software tool MoBioS (MOlecular Biology Simulator) implementing it. The mathematical model of MoBioS uses continuous differential equations to describe the deterministic reactions and a Gillespie-like algorithm to describe the stochastic ones. Unlike the majority of current hybrid methods, the MoBioS algorithm divides the reactions' set into fast reactions, moderate reactions, and slow reactions and implements a hysteresis switching between the stochastic model and the deterministic model. Fast reactions are approximated as continuous-deterministic processes and modelled by deterministic rate equations. Moderate reactions are those whose reaction waiting time is

Evolutionary games with self-questioning adaptive mechanism and the Ising model

NASA Astrophysics Data System (ADS)

Liu, J.; Xu, C.; Hui, P. M.

2017-09-01

A class of evolutionary games using a self-questioning strategy switching mechanism played in a population of connected agents is shown to behave as an Ising model Hamiltonian of spins connected in the same way. The payoff parameters combine to give the coupling between spins and an external magnetic field. The mapping covers the prisoner's dilemma, snowdrift and stag hunt games in structured populations. A well-mixed system is used to illustrate the equivalence. In a chain of agents/spins, the mapping to Ising model leads to an exact solution to the games effortlessly. The accuracy of standard approximations on the games can then be quantified. The site approximation is found to show varied accuracies depending on the payoff parameters, and the link approximation is shown to give the exact result in a chain but not in a closed form. The mapping established here connects two research areas, with each having much to offer to the other.

A game theoretic algorithm to detect overlapping community structure in networks

NASA Astrophysics Data System (ADS)

Zhou, Xu; Zhao, Xiaohui; Liu, Yanheng; Sun, Geng

2018-04-01

Community detection can be used as an important technique for product and personalized service recommendation. A game theory based approach to detect overlapping community structure is introduced in this paper. The process of the community formation is converted into a game, when all agents (nodes) cannot improve their own utility, the game process will be terminated. The utility function is composed of a gain and a loss function and we present a new gain function in this paper. In addition, different from choosing action randomly among join, quit and switch for each agent to get new label, two new strategies for each agent to update its label are designed during the game, and the strategies are also evaluated and compared for each agent in order to find its best result. The overlapping community structure is naturally presented when the stop criterion is satisfied. The experimental results demonstrate that the proposed algorithm outperforms other similar algorithms for detecting overlapping communities in networks.

Seasonally forced disease dynamics explored as switching between attractors

NASA Astrophysics Data System (ADS)

Keeling, Matt J.; Rohani, Pejman; Grenfell, Bryan T.

2001-01-01

Biological phenomena offer a rich diversity of problems that can be understood using mathematical techniques. Three key features common to many biological systems are temporal forcing, stochasticity and nonlinearity. Here, using simple disease models compared to data, we examine how these three factors interact to produce a range of complicated dynamics. The study of disease dynamics has been amongst the most theoretically developed areas of mathematical biology; simple models have been highly successful in explaining the dynamics of a wide variety of diseases. Models of childhood diseases incorporate seasonal variation in contact rates due to the increased mixing during school terms compared to school holidays. This ‘binary’ nature of the seasonal forcing results in dynamics that can be explained as switching between two nonlinear spiral sinks. Finally, we consider the stability of the attractors to understand the interaction between the deterministic dynamics and demographic and environmental stochasticity. Throughout attention is focused on the behaviour of measles, whooping cough and rubella.

Spatial prisoner's dilemma game with volunteering in Newman-Watts small-world networks

NASA Astrophysics Data System (ADS)

Wu, Zhi-Xi; Xu, Xin-Jian; Chen, Yong; Wang, Ying-Hai

2005-03-01

A modified spatial prisoner’s dilemma game with voluntary participation in Newman-Watts small-world networks is studied. Some reasonable ingredients are introduced to the game evolutionary dynamics: each agent in the network is a pure strategist and can only take one of three strategies (cooperator, defector, and loner); its strategical transformation is associated with both the number of strategical states and the magnitude of average profits, which are adopted and acquired by its coplayers in the previous round of play; a stochastic strategy mutation is applied when it gets into the trouble of local commons that the agent and its neighbors are in the same state and get the same average payoffs. In the case of very low temptation to defect, it is found that agents are willing to participate in the game in typical small-world region and intensive collective oscillations arise in more random region.

A diffusion-based approach to stochastic individual growth and energy budget, with consequences to life-history optimization and population dynamics.

PubMed

Filin, I

2009-06-01

Using diffusion processes, I model stochastic individual growth, given exogenous hazards and starvation risk. By maximizing survival to final size, optimal life histories (e.g. switching size for habitat/dietary shift) are determined by two ratios: mean growth rate over growth variance (diffusion coefficient) and mortality rate over mean growth rate; all are size dependent. For example, switching size decreases with either ratio, if both are positive. I provide examples and compare with previous work on risk-sensitive foraging and the energy-predation trade-off. I then decompose individual size into reversibly and irreversibly growing components, e.g. reserves and structure. I provide a general expression for optimal structural growth, when reserves grow stochastically. I conclude that increased growth variance of reserves delays structural growth (raises threshold size for its commencement) but may eventually lead to larger structures. The effect depends on whether the structural trait is related to foraging or defence. Implications for population dynamics are discussed.

Polymer thick-film conductors and dielectrics for membrane switches and flexible circuitry

NASA Technical Reports Server (NTRS)

Nazarenko, N.

1983-01-01

The fabrication and operation of membrane switches are discussed. The membrane switch functions as a normally open, momentary contact, low-voltage pressure-sensitive device. Its design is a three-layer sandwich usually constructed of polyester film. Conductive patterns are deposited onto the inner side of top and bottom sheets by silk screening. The center spacer is then placed between the two circuit layers to form a sandwich, generally held together by an adhesive. When pressure is applied to the top layer, it flexes through the punched openings of the spacer to establish electrical contact between conductive pads of the upper and lower sheets, momentarily closing the circuit. Upon release of force the top sheet springs back to its normal open position. The membrane touch switch is being used in a rapidly expanding range of applications, including instrumentation, appliances, electronic games and keyboards. Its board acceptance results from its low cost, durability, ease of manufacture, cosmetic appeal and design flexibility. The principal electronic components in the membrane switch are the conductor and dielectric.

Linear game non-contextuality and Bell inequalities—a graph-theoretic approach

NASA Astrophysics Data System (ADS)

Rosicka, M.; Ramanathan, R.; Gnaciński, P.; Horodecki, K.; Horodecki, M.; Horodecki, P.; Severini, S.

2016-04-01

We study the classical and quantum values of a class of one- and two-party unique games, that generalizes the well-known XOR games to the case of non-binary outcomes. In the bipartite case the generalized XOR (XOR-d) games we study are a subclass of the well-known linear games. We introduce a ‘constraint graph’ associated to such a game, with the constraints defining the game represented by an edge-coloring of the graph. We use the graph-theoretic characterization to relate the task of finding equivalent games to the notion of signed graphs and switching equivalence from graph theory. We relate the problem of computing the classical value of single-party anti-correlation XOR games to finding the edge bipartization number of a graph, which is known to be MaxSNP hard, and connect the computation of the classical value of XOR-d games to the identification of specific cycles in the graph. We construct an orthogonality graph of the game from the constraint graph and study its Lovász theta number as a general upper bound on the quantum value even in the case of single-party contextual XOR-d games. XOR-d games possess appealing properties for use in device-independent applications such as randomness of the local correlated outcomes in the optimal quantum strategy. We study the possibility of obtaining quantum algebraic violation of these games, and show that no finite XOR-d game possesses the property of pseudo-telepathy leaving the frequently used chained Bell inequalities as the natural candidates for such applications. We also show this lack of pseudo-telepathy for multi-party XOR-type inequalities involving two-body correlation functions.

The effects of video game playing on attention, memory, and executive control.

PubMed

Boot, Walter R; Kramer, Arthur F; Simons, Daniel J; Fabiani, Monica; Gratton, Gabriele

2008-11-01

Expert video game players often outperform non-players on measures of basic attention and performance. Such differences might result from exposure to video games or they might reflect other group differences between those people who do or do not play video games. Recent research has suggested a causal relationship between playing action video games and improvements in a variety of visual and attentional skills (e.g., [Green, C. S., & Bavelier, D. (2003). Action video game modifies visual selective attention. Nature, 423, 534-537]). The current research sought to replicate and extend these results by examining both expert/non-gamer differences and the effects of video game playing on tasks tapping a wider range of cognitive abilities, including attention, memory, and executive control. Non-gamers played 20+ h of an action video game, a puzzle game, or a real-time strategy game. Expert gamers and non-gamers differed on a number of basic cognitive skills: experts could track objects moving at greater speeds, better detected changes to objects stored in visual short-term memory, switched more quickly from one task to another, and mentally rotated objects more efficiently. Strikingly, extensive video game practice did not substantially enhance performance for non-gamers on most cognitive tasks, although they did improve somewhat in mental rotation performance. Our results suggest that at least some differences between video game experts and non-gamers in basic cognitive performance result either from far more extensive video game experience or from pre-existing group differences in abilities that result in a self-selection effect.

Stochastic stability

NASA Technical Reports Server (NTRS)

Kushner, H. J.

1972-01-01

The field of stochastic stability is surveyed, with emphasis on the invariance theorems and their potential application to systems with randomly varying coefficients. Some of the basic ideas are reviewed, which underlie the stochastic Liapunov function approach to stochastic stability. The invariance theorems are discussed in detail.

Stability and Multiattractor Dynamics of a Toggle Switch Based on a Two-Stage Model of Stochastic Gene Expression

PubMed Central

Strasser, Michael; Theis, Fabian J.; Marr, Carsten

2012-01-01

A toggle switch consists of two genes that mutually repress each other. This regulatory motif is active during cell differentiation and is thought to act as a memory device, being able to choose and maintain cell fate decisions. Commonly, this switch has been modeled in a deterministic framework where transcription and translation are lumped together. In this description, bistability occurs for transcription factor cooperativity, whereas autoactivation leads to a tristable system with an additional undecided state. In this contribution, we study the stability and dynamics of a two-stage gene expression switch within a probabilistic framework inspired by the properties of the Pu/Gata toggle switch in myeloid progenitor cells. We focus on low mRNA numbers, high protein abundance, and monomeric transcription-factor binding. Contrary to the expectation from a deterministic description, this switch shows complex multiattractor dynamics without autoactivation and cooperativity. Most importantly, the four attractors of the system, which only emerge in a probabilistic two-stage description, can be identified with committed and primed states in cell differentiation. To begin, we study the dynamics of the system and infer the mechanisms that move the system between attractors using both the quasipotential and the probability flux of the system. Next, we show that the residence times of the system in one of the committed attractors are geometrically distributed. We derive an analytical expression for the parameter of the geometric distribution, therefore completely describing the statistics of the switching process and elucidate the influence of the system parameters on the residence time. Moreover, we find that the mean residence time increases linearly with the mean protein level. This scaling also holds for a one-stage scenario and for autoactivation. Finally, we study the implications of this distribution for the stability of a switch and discuss the influence of the

Spectral changes in stochastic anisotropic electromagnetic beams propagating through turbulent ocean

NASA Astrophysics Data System (ADS)

Tang, Miaomiao; Zhao, Daomu

2014-02-01

Based on the extended Huygens-Fresnel principle and the unified theory of coherence and polarization of light, the spectral changes of stochastic anisotropic electromagnetic beams propagating through oceanic turbulence are revealed. As an example, some numerical calculations are illustrated for an anisotropic electromagnetic Gaussian Schell-model beam propagating in a homogeneous and isotropic turbulent ocean. It is shown that, under the influence of oceanic turbulence, the on-axis spectrum is always blue-shifted along with the propagation distance, however, for the off-axis positions, red-blue spectral switch can be found.

Designing a stochastic genetic switch by coupling chaos and bistability.

PubMed

Zhao, Xiang; Ouyang, Qi; Wang, Hongli

2015-11-01

In stem cell differentiation, a pluripotent stem cell becomes progressively specialized and generates specific cell types through a series of epigenetic processes. How cells can precisely determine their fate in a fluctuating environment is a currently unsolved problem. In this paper, we suggest an abstract gene regulatory network to describe mathematically the differentiation phenomenon featuring stochasticity, divergent cell fates, and robustness. The network consists of three functional motifs: an upstream chaotic motif, a buffering motif of incoherent feed forward loop capable of generating a pulse, and a downstream motif which is bistable. The dynamic behavior is typically a transient chaos with fractal basin boundaries. The trajectories take transiently chaotic journeys before divergently settling down to the bistable states. The ratio of the probability that the high state is achieved to the probability that the low state is reached can maintain a constant in a population of cells with varied molecular fluctuations. The ratio can be turned up or down when proper parameters are adjusted. The model suggests a possible mechanism for the robustness against fluctuations that is prominently featured in pluripotent cell differentiations and developmental phenomena.

Game-Theoretical Design of an Adaptive Distributed Dissemination Protocol for VANETs.

PubMed

Iza-Paredes, Cristhian; Mezher, Ahmad Mohamad; Aguilar Igartua, Mónica; Forné, Jordi

2018-01-19

Road safety applications envisaged for Vehicular Ad Hoc Networks (VANETs) depend largely on the dissemination of warning messages to deliver information to concerned vehicles. The intended applications, as well as some inherent VANET characteristics, make data dissemination an essential service and a challenging task in this kind of networks. This work lays out a decentralized stochastic solution for the data dissemination problem through two game-theoretical mechanisms. Given the non-stationarity induced by a highly dynamic topology, diverse network densities, and intermittent connectivity, a solution for the formulated game requires an adaptive procedure able to exploit the environment changes. Extensive simulations reveal that our proposal excels in terms of number of transmissions, lower end-to-end delay and reduced overhead while maintaining high delivery ratio, compared to other proposals.

Game-Theoretical Design of an Adaptive Distributed Dissemination Protocol for VANETs

PubMed Central

Mezher, Ahmad Mohamad; Aguilar Igartua, Mónica

2018-01-01

Road safety applications envisaged for Vehicular Ad Hoc Networks (VANETs) depend largely on the dissemination of warning messages to deliver information to concerned vehicles. The intended applications, as well as some inherent VANET characteristics, make data dissemination an essential service and a challenging task in this kind of networks. This work lays out a decentralized stochastic solution for the data dissemination problem through two game-theoretical mechanisms. Given the non-stationarity induced by a highly dynamic topology, diverse network densities, and intermittent connectivity, a solution for the formulated game requires an adaptive procedure able to exploit the environment changes. Extensive simulations reveal that our proposal excels in terms of number of transmissions, lower end-to-end delay and reduced overhead while maintaining high delivery ratio, compared to other proposals. PMID:29351255

Linear Quadratic Mean Field Type Control and Mean Field Games with Common Noise, with Application to Production of an Exhaustible Resource

DOE Office of Scientific and Technical Information (OSTI.GOV)

Graber, P. Jameson, E-mail: jameson-graber@baylor.edu

We study a general linear quadratic mean field type control problem and connect it to mean field games of a similar type. The solution is given both in terms of a forward/backward system of stochastic differential equations and by a pair of Riccati equations. In certain cases, the solution to the mean field type control is also the equilibrium strategy for a class of mean field games. We use this fact to study an economic model of production of exhaustible resources.

A Locust Phase Change Model with Multiple Switching States and Random Perturbation

NASA Astrophysics Data System (ADS)

Xiang, Changcheng; Tang, Sanyi; Cheke, Robert A.; Qin, Wenjie

2016-12-01

generations for the same stochastic processes. However, the switching frequency and outbreak patterns can be significantly affected by the intensity of noise and the intrinsic growth rate of the locust population.

DNA-Binding Kinetics Determines the Mechanism of Noise-Induced Switching in Gene Networks

PubMed Central

Tse, Margaret J.; Chu, Brian K.; Roy, Mahua; Read, Elizabeth L.

2015-01-01

Gene regulatory networks are multistable dynamical systems in which attractor states represent cell phenotypes. Spontaneous, noise-induced transitions between these states are thought to underlie critical cellular processes, including cell developmental fate decisions, phenotypic plasticity in fluctuating environments, and carcinogenesis. As such, there is increasing interest in the development of theoretical and computational approaches that can shed light on the dynamics of these stochastic state transitions in multistable gene networks. We applied a numerical rare-event sampling algorithm to study transition paths of spontaneous noise-induced switching for a ubiquitous gene regulatory network motif, the bistable toggle switch, in which two mutually repressive genes compete for dominant expression. We find that the method can efficiently uncover detailed switching mechanisms that involve fluctuations both in occupancies of DNA regulatory sites and copy numbers of protein products. In addition, we show that the rate parameters governing binding and unbinding of regulatory proteins to DNA strongly influence the switching mechanism. In a regime of slow DNA-binding/unbinding kinetics, spontaneous switching occurs relatively frequently and is driven primarily by fluctuations in DNA-site occupancies. In contrast, in a regime of fast DNA-binding/unbinding kinetics, switching occurs rarely and is driven by fluctuations in levels of expressed protein. Our results demonstrate how spontaneous cell phenotype transitions involve collective behavior of both regulatory proteins and DNA. Computational approaches capable of simulating dynamics over many system variables are thus well suited to exploring dynamic mechanisms in gene networks. PMID:26488666

Stochastic modeling and simulation of reaction-diffusion system with Hill function dynamics.

PubMed

Chen, Minghan; Li, Fei; Wang, Shuo; Cao, Young

2017-03-14

Stochastic simulation of reaction-diffusion systems presents great challenges for spatiotemporal biological modeling and simulation. One widely used framework for stochastic simulation of reaction-diffusion systems is reaction diffusion master equation (RDME). Previous studies have discovered that for the RDME, when discretization size approaches zero, reaction time for bimolecular reactions in high dimensional domains tends to infinity. In this paper, we demonstrate that in the 1D domain, highly nonlinear reaction dynamics given by Hill function may also have dramatic change when discretization size is smaller than a critical value. Moreover, we discuss methods to avoid this problem: smoothing over space, fixed length smoothing over space and a hybrid method. Our analysis reveals that the switch-like Hill dynamics reduces to a linear function of discretization size when the discretization size is small enough. The three proposed methods could correctly (under certain precision) simulate Hill function dynamics in the microscopic RDME system.

A stochastic and dynamical view of pluripotency in mouse embryonic stem cells

PubMed Central

Lee, Esther J.

2018-01-01

Pluripotent embryonic stem cells are of paramount importance for biomedical sciences because of their innate ability for self-renewal and differentiation into all major cell lines. The fateful decision to exit or remain in the pluripotent state is regulated by complex genetic regulatory networks. The rapid growth of single-cell sequencing data has greatly stimulated applications of statistical and machine learning methods for inferring topologies of pluripotency regulating genetic networks. The inferred network topologies, however, often only encode Boolean information while remaining silent about the roles of dynamics and molecular stochasticity inherent in gene expression. Herein we develop a framework for systematically extending Boolean-level network topologies into higher resolution models of networks which explicitly account for the promoter architectures and gene state switching dynamics. We show the framework to be useful for disentangling the various contributions that gene switching, external signaling, and network topology make to the global heterogeneity and dynamics of transcription factor populations. We find the pluripotent state of the network to be a steady state which is robust to global variations of gene switching rates which we argue are a good proxy for epigenetic states of individual promoters. The temporal dynamics of exiting the pluripotent state, on the other hand, is significantly influenced by the rates of genetic switching which makes cells more responsive to changes in extracellular signals. PMID:29451874

Noise effects in bacterial motor switch

NASA Astrophysics Data System (ADS)

Tu, Yuhai

2006-03-01

The clockwise (CW) or counter clockwise (CCW) spinning of bacterial flagellar motors is controlled by the concentration of a phosphorylated protein CheY-P. In this talk, we represent the stochastic switching behavior of a bacterial flagellar motor by a dynamical two-state (CW and CCW) model, with the energy levels of the two states fluctuating in time according to the variation of the CheY-P concentration in the cell. We show that with a generic normal distribution and a modest amplitude for CheY-P concentration fluctuations, the dynamical two-state model is capable of generating a power-law distribution (as opposed to an exponential Poisson-like distribution) for the durations of the CCW states, in agreement with recent experimental observations of Korobkova et al (Nature, 428, 574(2004)). In addition, we show that the power spectrum for the flagellar motor switching time series is not determined solely by the power-law duration distribution, but also by the temporal correlation between the duration times of different CCW intervals. We point out the intrinsic connection between anomalously large fluctuations of the motor output and the overall high gain of the bacterial chemotaxis system. Suggestions for experimental verification of the dynamical two-state model will also be discussed.

Stochastic differential equations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sobczyk, K.

1990-01-01

This book provides a unified treatment of both regular (or random) and Ito stochastic differential equations. It focuses on solution methods, including some developed only recently. Applications are discussed, in particular an insight is given into both the mathematical structure, and the most efficient solution methods (analytical as well as numerical). Starting from basic notions and results of the theory of stochastic processes and stochastic calculus (including Ito's stochastic integral), many principal mathematical problems and results related to stochastic differential equations are expounded here for the first time. Applications treated include those relating to road vehicles, earthquake excitations and offshoremore » structures.« less

Asynchronous State Estimation for Discrete-Time Switched Complex Networks With Communication Constraints.

PubMed

Zhang, Dan; Wang, Qing-Guo; Srinivasan, Dipti; Li, Hongyi; Yu, Li

2018-05-01

This paper is concerned with the asynchronous state estimation for a class of discrete-time switched complex networks with communication constraints. An asynchronous estimator is designed to overcome the difficulty that each node cannot access to the topology/coupling information. Also, the event-based communication, signal quantization, and the random packet dropout problems are studied due to the limited communication resource. With the help of switched system theory and by resorting to some stochastic system analysis method, a sufficient condition is proposed to guarantee the exponential stability of estimation error system in the mean-square sense and a prescribed performance level is also ensured. The characterization of the desired estimator gains is derived in terms of the solution to a convex optimization problem. Finally, the effectiveness of the proposed design approach is demonstrated by a simulation example.

Stochasticity Favoring the Effects of the R&D Strategies of the Firms

NASA Astrophysics Data System (ADS)

Pinto, Alberto A.; Oliveira, Bruno M. P. M.; Ferreira, Fernanda A.; Ferreira, Flávio

We present stochastic dynamics on the production costs of Cournot competitions, based on perfect Nash equilibria of nonlinear R&D investment strategies to reduce the production costs of the firms at every period of the game. We analyse the effects that the R&D investment strategies can have in the profits of the firms along the time. We observe that, in certain cases, the uncertainty can improve the effects of the R&D strategies in the profits of the firms due to the non-linearity of the profit functions and also of the R&D parameters.

Stochastic first passage time accelerated with CUDA

NASA Astrophysics Data System (ADS)

Pierro, Vincenzo; Troiano, Luigi; Mejuto, Elena; Filatrella, Giovanni

2018-05-01

The numerical integration of stochastic trajectories to estimate the time to pass a threshold is an interesting physical quantity, for instance in Josephson junctions and atomic force microscopy, where the full trajectory is not accessible. We propose an algorithm suitable for efficient implementation on graphical processing unit in CUDA environment. The proposed approach for well balanced loads achieves almost perfect scaling with the number of available threads and processors, and allows an acceleration of about 400× with a GPU GTX980 respect to standard multicore CPU. This method allows with off the shell GPU to challenge problems that are otherwise prohibitive, as thermal activation in slowly tilted potentials. In particular, we demonstrate that it is possible to simulate the switching currents distributions of Josephson junctions in the timescale of actual experiments.

Self-concept in fairness and rule establishment during a competitive game: a computational approach

PubMed Central

Lee, Sang Ho; Kim, Sung-Phil; Cho, Yang Seok

2015-01-01

People consider fairness as well as their own interest when making decisions in economic games. The present study proposes a model that encompasses the self-concept determined by one's own kindness as a factor of fairness. To observe behavioral patterns that reflect self-concept and fairness, a chicken game experiment was conducted. Behavioral data demonstrates four distinct patterns; “switching,” “mutual rush,” “mutual avoidance,” and “unfair” patterns. Model estimation of chicken game data shows that a model with self-concept predicts those behaviors better than previous models of fairness, suggesting that self-concept indeed affects human behavior in competitive economic games. Moreover, a non-stationary parameter analysis revealed the process of reaching consensus between the players in a game. When the models were fitted to a continuous time window, the parameters of the players in a pair with “switching” and “mutual avoidance” patterns became similar as the game proceeded, suggesting that the players gradually formed a shared rule during the game. In contrast, the difference of parameters between the players in the “unfair” and “mutual rush” patterns did not become stable. The outcomes of the present study showed that people are likely to change their strategy until they reach a mutually beneficial status. PMID:26441707

Emergence of dynamic cooperativity in the stochastic kinetics of fluctuating enzymes

NASA Astrophysics Data System (ADS)

Kumar, Ashutosh; Chatterjee, Sambarta; Nandi, Mintu; Dua, Arti

2016-08-01

Dynamic co-operativity in monomeric enzymes is characterized in terms of a non-Michaelis-Menten kinetic behaviour. The latter is believed to be associated with mechanisms that include multiple reaction pathways due to enzymatic conformational fluctuations. Recent advances in single-molecule fluorescence spectroscopy have provided new fundamental insights on the possible mechanisms underlying reactions catalyzed by fluctuating enzymes. Here, we present a bottom-up approach to understand enzyme turnover kinetics at physiologically relevant mesoscopic concentrations informed by mechanisms extracted from single-molecule stochastic trajectories. The stochastic approach, presented here, shows the emergence of dynamic co-operativity in terms of a slowing down of the Michaelis-Menten (MM) kinetics resulting in negative co-operativity. For fewer enzymes, dynamic co-operativity emerges due to the combined effects of enzymatic conformational fluctuations and molecular discreteness. The increase in the number of enzymes, however, suppresses the effect of enzymatic conformational fluctuations such that dynamic co-operativity emerges solely due to the discrete changes in the number of reacting species. These results confirm that the turnover kinetics of fluctuating enzyme based on the parallel-pathway MM mechanism switches over to the single-pathway MM mechanism with the increase in the number of enzymes. For large enzyme numbers, convergence to the exact MM equation occurs in the limit of very high substrate concentration as the stochastic kinetics approaches the deterministic behaviour.

Emergence of dynamic cooperativity in the stochastic kinetics of fluctuating enzymes.

PubMed

Kumar, Ashutosh; Chatterjee, Sambarta; Nandi, Mintu; Dua, Arti

2016-08-28

Dynamic co-operativity in monomeric enzymes is characterized in terms of a non-Michaelis-Menten kinetic behaviour. The latter is believed to be associated with mechanisms that include multiple reaction pathways due to enzymatic conformational fluctuations. Recent advances in single-molecule fluorescence spectroscopy have provided new fundamental insights on the possible mechanisms underlying reactions catalyzed by fluctuating enzymes. Here, we present a bottom-up approach to understand enzyme turnover kinetics at physiologically relevant mesoscopic concentrations informed by mechanisms extracted from single-molecule stochastic trajectories. The stochastic approach, presented here, shows the emergence of dynamic co-operativity in terms of a slowing down of the Michaelis-Menten (MM) kinetics resulting in negative co-operativity. For fewer enzymes, dynamic co-operativity emerges due to the combined effects of enzymatic conformational fluctuations and molecular discreteness. The increase in the number of enzymes, however, suppresses the effect of enzymatic conformational fluctuations such that dynamic co-operativity emerges solely due to the discrete changes in the number of reacting species. These results confirm that the turnover kinetics of fluctuating enzyme based on the parallel-pathway MM mechanism switches over to the single-pathway MM mechanism with the increase in the number of enzymes. For large enzyme numbers, convergence to the exact MM equation occurs in the limit of very high substrate concentration as the stochastic kinetics approaches the deterministic behaviour.

Emergence of dynamic cooperativity in the stochastic kinetics of fluctuating enzymes

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kumar, Ashutosh; Chatterjee, Sambarta; Nandi, Mintu

Dynamic co-operativity in monomeric enzymes is characterized in terms of a non-Michaelis-Menten kinetic behaviour. The latter is believed to be associated with mechanisms that include multiple reaction pathways due to enzymatic conformational fluctuations. Recent advances in single-molecule fluorescence spectroscopy have provided new fundamental insights on the possible mechanisms underlying reactions catalyzed by fluctuating enzymes. Here, we present a bottom-up approach to understand enzyme turnover kinetics at physiologically relevant mesoscopic concentrations informed by mechanisms extracted from single-molecule stochastic trajectories. The stochastic approach, presented here, shows the emergence of dynamic co-operativity in terms of a slowing down of the Michaelis-Menten (MM) kineticsmore » resulting in negative co-operativity. For fewer enzymes, dynamic co-operativity emerges due to the combined effects of enzymatic conformational fluctuations and molecular discreteness. The increase in the number of enzymes, however, suppresses the effect of enzymatic conformational fluctuations such that dynamic co-operativity emerges solely due to the discrete changes in the number of reacting species. These results confirm that the turnover kinetics of fluctuating enzyme based on the parallel-pathway MM mechanism switches over to the single-pathway MM mechanism with the increase in the number of enzymes. For large enzyme numbers, convergence to the exact MM equation occurs in the limit of very high substrate concentration as the stochastic kinetics approaches the deterministic behaviour.« less

Evolution with Stochastic Fitness and Stochastic Migration

PubMed Central

Rice, Sean H.; Papadopoulos, Anthony

2009-01-01

Background Migration between local populations plays an important role in evolution - influencing local adaptation, speciation, extinction, and the maintenance of genetic variation. Like other evolutionary mechanisms, migration is a stochastic process, involving both random and deterministic elements. Many models of evolution have incorporated migration, but these have all been based on simplifying assumptions, such as low migration rate, weak selection, or large population size. We thus have no truly general and exact mathematical description of evolution that incorporates migration. Methodology/Principal Findings We derive an exact equation for directional evolution, essentially a stochastic Price equation with migration, that encompasses all processes, both deterministic and stochastic, contributing to directional change in an open population. Using this result, we show that increasing the variance in migration rates reduces the impact of migration relative to selection. This means that models that treat migration as a single parameter tend to be biassed - overestimating the relative impact of immigration. We further show that selection and migration interact in complex ways, one result being that a strategy for which fitness is negatively correlated with migration rates (high fitness when migration is low) will tend to increase in frequency, even if it has lower mean fitness than do other strategies. Finally, we derive an equation for the effective migration rate, which allows some of the complex stochastic processes that we identify to be incorporated into models with a single migration parameter. Conclusions/Significance As has previously been shown with selection, the role of migration in evolution is determined by the entire distributions of immigration and emigration rates, not just by the mean values. The interactions of stochastic migration with stochastic selection produce evolutionary processes that are invisible to deterministic evolutionary theory

Bowl Inversion and Electronic Switching of Buckybowls on Gold.

PubMed

Fujii, Shintaro; Ziatdinov, Maxim; Higashibayashi, Shuhei; Sakurai, Hidehiro; Kiguchi, Manabu

2016-09-21

Bowl-shaped π-conjugated compounds, or buckybowls, are a novel class of sp(2)-hybridized nanocarbon materials. In contrast to tubular carbon nanotubes and ball-shaped fullerenes, the buckybowls feature structural flexibility. Bowl-to-bowl structural inversion is one of the unique properties of the buckybowls in solutions. Bowl inversion on a surface modifies the metal-molecule interactions through bistable switching between bowl-up and bowl-down states on the surface, which makes surface-adsorbed buckybowls a relevant model system for elucidation of the mechano-electronic properties of nanocarbon materials. Here, we report a combination of scanning tunneling microscopy (STM) measurements and ab initio atomistic simulations to identify the adlayer structure of the sumanene buckybowl on Au(111) and reveal its unique bowl inversion behavior. We demonstrate that the bowl inversion can be induced by approaching the STM tip toward the molecule. By tuning the local metal-molecule interaction using the STM tip, the sumanene buckybowl exhibits structural bistability with a switching rate that is two orders of magnitude faster than that of the stochastic inversion process.

Biochemical simulations: stochastic, approximate stochastic and hybrid approaches.

PubMed

Pahle, Jürgen

2009-01-01

Computer simulations have become an invaluable tool to study the sometimes counterintuitive temporal dynamics of (bio-)chemical systems. In particular, stochastic simulation methods have attracted increasing interest recently. In contrast to the well-known deterministic approach based on ordinary differential equations, they can capture effects that occur due to the underlying discreteness of the systems and random fluctuations in molecular numbers. Numerous stochastic, approximate stochastic and hybrid simulation methods have been proposed in the literature. In this article, they are systematically reviewed in order to guide the researcher and help her find the appropriate method for a specific problem.

Biochemical simulations: stochastic, approximate stochastic and hybrid approaches

PubMed Central

2009-01-01

Computer simulations have become an invaluable tool to study the sometimes counterintuitive temporal dynamics of (bio-)chemical systems. In particular, stochastic simulation methods have attracted increasing interest recently. In contrast to the well-known deterministic approach based on ordinary differential equations, they can capture effects that occur due to the underlying discreteness of the systems and random fluctuations in molecular numbers. Numerous stochastic, approximate stochastic and hybrid simulation methods have been proposed in the literature. In this article, they are systematically reviewed in order to guide the researcher and help her find the appropriate method for a specific problem. PMID:19151097

Robust lane detection and tracking using multiple visual cues under stochastic lane shape conditions

NASA Astrophysics Data System (ADS)

Huang, Zhi; Fan, Baozheng; Song, Xiaolin

2018-03-01

As one of the essential components of environment perception techniques for an intelligent vehicle, lane detection is confronted with challenges including robustness against the complicated disturbance and illumination, also adaptability to stochastic lane shapes. To overcome these issues, we proposed a robust lane detection method named classification-generation-growth-based (CGG) operator to the detected lines, whereby the linear lane markings are identified by synergizing multiple visual cues with the a priori knowledge and spatial-temporal information. According to the quality of linear lane fitting, the linear and linear-parabolic models are dynamically switched to describe the actual lane. The Kalman filter with adaptive noise covariance and the region of interests (ROI) tracking are applied to improve the robustness and efficiency. Experiments were conducted with images covering various challenging scenarios. The experimental results evaluate the effectiveness of the presented method for complicated disturbances, illumination, and stochastic lane shapes.

Survival behavior in the cyclic Lotka-Volterra model with a randomly switching reaction rate

NASA Astrophysics Data System (ADS)

West, Robert; Mobilia, Mauro; Rucklidge, Alastair M.

2018-02-01

We study the influence of a randomly switching reproduction-predation rate on the survival behavior of the nonspatial cyclic Lotka-Volterra model, also known as the zero-sum rock-paper-scissors game, used to metaphorically describe the cyclic competition between three species. In large and finite populations, demographic fluctuations (internal noise) drive two species to extinction in a finite time, while the species with the smallest reproduction-predation rate is the most likely to be the surviving one (law of the weakest). Here we model environmental (external) noise by assuming that the reproduction-predation rate of the strongest species (the fastest to reproduce and predate) in a given static environment randomly switches between two values corresponding to more and less favorable external conditions. We study the joint effect of environmental and demographic noise on the species survival probabilities and on the mean extinction time. In particular, we investigate whether the survival probabilities follow the law of the weakest and analyze their dependence on the external noise intensity and switching rate. Remarkably, when, on average, there is a finite number of switches prior to extinction, the survival probability of the predator of the species whose reaction rate switches typically varies nonmonotonically with the external noise intensity (with optimal survival about a critical noise strength). We also outline the relationship with the case where all reaction rates switch on markedly different time scales.

Optical switches and switching methods

DOEpatents

Doty, Michael

2008-03-04

A device and method for collecting subject responses, particularly during magnetic imaging experiments and testing using a method such as functional MRI. The device comprises a non-metallic input device which is coupled via fiber optic cables to a computer or other data collection device. One or more optical switches transmit the subject's responses. The input device keeps the subject's fingers comfortably aligned with the switches by partially immobilizing the forearm, wrist, and/or hand of the subject. Also a robust nonmetallic switch, particularly for use with the input device and methods for optical switching.

Stochastic Dynamics Underlying Cognitive Stability and Flexibility

PubMed Central

Ueltzhöffer, Kai; Armbruster-Genç, Diana J. N.; Fiebach, Christian J.

2015-01-01

Cognitive stability and flexibility are core functions in the successful pursuit of behavioral goals. While there is evidence for a common frontoparietal network underlying both functions and for a key role of dopamine in the modulation of flexible versus stable behavior, the exact neurocomputational mechanisms underlying those executive functions and their adaptation to environmental demands are still unclear. In this work we study the neurocomputational mechanisms underlying cue based task switching (flexibility) and distractor inhibition (stability) in a paradigm specifically designed to probe both functions. We develop a physiologically plausible, explicit model of neural networks that maintain the currently active task rule in working memory and implement the decision process. We simplify the four-choice decision network to a nonlinear drift-diffusion process that we canonically derive from a generic winner-take-all network model. By fitting our model to the behavioral data of individual subjects, we can reproduce their full behavior in terms of decisions and reaction time distributions in baseline as well as distractor inhibition and switch conditions. Furthermore, we predict the individual hemodynamic response timecourse of the rule-representing network and localize it to a frontoparietal network including the inferior frontal junction area and the intraparietal sulcus, using functional magnetic resonance imaging. This refines the understanding of task-switch-related frontoparietal brain activity as reflecting attractor-like working memory representations of task rules. Finally, we estimate the subject-specific stability of the rule-representing attractor states in terms of the minimal action associated with a transition between different rule states in the phase-space of the fitted models. This stability measure correlates with switching-specific thalamocorticostriatal activation, i.e., with a system associated with flexible working memory updating and

Stochastic simulation of multiscale complex systems with PISKaS: A rule-based approach.

PubMed

Perez-Acle, Tomas; Fuenzalida, Ignacio; Martin, Alberto J M; Santibañez, Rodrigo; Avaria, Rodrigo; Bernardin, Alejandro; Bustos, Alvaro M; Garrido, Daniel; Dushoff, Jonathan; Liu, James H

2018-03-29

Computational simulation is a widely employed methodology to study the dynamic behavior of complex systems. Although common approaches are based either on ordinary differential equations or stochastic differential equations, these techniques make several assumptions which, when it comes to biological processes, could often lead to unrealistic models. Among others, model approaches based on differential equations entangle kinetics and causality, failing when complexity increases, separating knowledge from models, and assuming that the average behavior of the population encompasses any individual deviation. To overcome these limitations, simulations based on the Stochastic Simulation Algorithm (SSA) appear as a suitable approach to model complex biological systems. In this work, we review three different models executed in PISKaS: a rule-based framework to produce multiscale stochastic simulations of complex systems. These models span multiple time and spatial scales ranging from gene regulation up to Game Theory. In the first example, we describe a model of the core regulatory network of gene expression in Escherichia coli highlighting the continuous model improvement capacities of PISKaS. The second example describes a hypothetical outbreak of the Ebola virus occurring in a compartmentalized environment resembling cities and highways. Finally, in the last example, we illustrate a stochastic model for the prisoner's dilemma; a common approach from social sciences describing complex interactions involving trust within human populations. As whole, these models demonstrate the capabilities of PISKaS providing fertile scenarios where to explore the dynamics of complex systems. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Switch wear leveling

DOEpatents

Wu, Hunter; Sealy, Kylee; Gilchrist, Aaron

2015-09-01

An apparatus for switch wear leveling includes a switching module that controls switching for two or more pairs of switches in a switching power converter. The switching module controls switches based on a duty cycle control technique and closes and opens each switch in a switching sequence. The pairs of switches connect to a positive and negative terminal of a DC voltage source. For a first switching sequence a first switch of a pair of switches has a higher switching power loss than a second switch of the pair of switches. The apparatus includes a switch rotation module that changes the switching sequence of the two or more pairs of switches from the first switching sequence to a second switching sequence. The second switch of a pair of switches has a higher switching power loss than the first switch of the pair of switches during the second switching sequence.

Recognizing and engineering digital-like logic gates and switches in gene regulatory networks.

PubMed

Bradley, Robert W; Buck, Martin; Wang, Baojun

2016-10-01

A central aim of synthetic biology is to build organisms that can perform useful activities in response to specified conditions. The digital computing paradigm which has proved so successful in electrical engineering is being mapped to synthetic biological systems to allow them to make such decisions. However, stochastic molecular processes have graded input-output functions, thus, bioengineers must select those with desirable characteristics and refine their transfer functions to build logic gates with digital-like switching behaviour. Recent efforts in genome mining and the development of programmable RNA-based switches, especially CRISPRi, have greatly increased the number of parts available to synthetic biologists. Improvements to the digital characteristics of these parts are required to enable robust predictable design of deeply layered logic circuits. Copyright © 2016 The Author(s). Published by Elsevier Ltd.. All rights reserved.

Switch Transcripts in Immunoglobulin Class Switching

NASA Astrophysics Data System (ADS)

Lorenz, Matthias; Jung, Steffen; Radbruch, Andreas

1995-03-01

B cells can exchange gene segments for the constant region of the immunoglobulin heavy chain, altering the class and effector function of the antibodies that they produce. Class switching is directed to distinct classes by cytokines, which induce transcription of the targeted DNA sequences. These transcripts are processed, resulting in spliced "switch" transcripts. Switch recombination can be directed to immunoglobulin G1 (IgG1) by the heterologous human metallothionein II_A promoter in mutant mice. Induction of the structurally conserved, spliced switch transcripts is sufficient to target switch recombination to IgG1, whereas transcription alone is not.

Effects of automation and task load on task switching during human supervision of multiple semi-autonomous robots in a dynamic environment.

PubMed

Squire, P N; Parasuraman, R

2010-08-01

The present study assessed the impact of task load and level of automation (LOA) on task switching in participants supervising a team of four or eight semi-autonomous robots in a simulated 'capture the flag' game. Participants were faster to perform the same task than when they chose to switch between different task actions. They also took longer to switch between different tasks when supervising the robots at a high compared to a low LOA. Task load, as manipulated by the number of robots to be supervised, did not influence switch costs. The results suggest that the design of future unmanned vehicle (UV) systems should take into account not simply how many UVs an operator can supervise, but also the impact of LOA and task operations on task switching during supervision of multiple UVs. The findings of this study are relevant for the ergonomics practice of UV systems. This research extends the cognitive theory of task switching to inform the design of UV systems and results show that switching between UVs is an important factor to consider.

Numerical investigation into the injection-locking phenomena of gain switched lasers for optical frequency comb generation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ó Dúill, Sean P., E-mail: sean.oduill@dcu.ie; Anandarajah, Prince M.; Zhou, Rui

2015-05-25

We present detailed numerical simulations of the laser dynamics that describe optical frequency comb formation by injection-locking a gain-switched laser. The typical rate equations for semiconductor lasers including stochastic carrier recombination and spontaneous emission suffice to show the injection-locking behavior of gain switched lasers, and we show how the optical frequency comb evolves starting from the free-running state, right through the final injection-locked state. Unlike the locking of continuous wave lasers, we show that the locking range for gain switched lasers is considerably greater because injection locking can be achieved by injecting at frequencies close to one of the combmore » lines. The quality of the comb lines is formally assessed by calculating the frequency modulation (FM)-noise spectral density and we show that under injection-locking conditions the FM-noise spectral density of the comb lines tend to that of the maser laser.« less

The Uses of Teaching Games in Game Theory Classes and Some Experimental Games.

ERIC Educational Resources Information Center

Shubik, Martin

2002-01-01

Discusses the use of lightly controlled games, primarily in classes in game theory. Considers the value of such games from the viewpoint of both teaching and experimentation and discusses context; control; pros and cons of games in teaching; experimental games; and games in class, including cooperative game theory. (Author/LRW)

A robust bi-orthogonal/dynamically-orthogonal method using the covariance pseudo-inverse with application to stochastic flow problems

NASA Astrophysics Data System (ADS)

Babaee, Hessam; Choi, Minseok; Sapsis, Themistoklis P.; Karniadakis, George Em

2017-09-01

We develop a new robust methodology for the stochastic Navier-Stokes equations based on the dynamically-orthogonal (DO) and bi-orthogonal (BO) methods [1-3]. Both approaches are variants of a generalized Karhunen-Loève (KL) expansion in which both the stochastic coefficients and the spatial basis evolve according to system dynamics, hence, capturing the low-dimensional structure of the solution. The DO and BO formulations are mathematically equivalent [3], but they exhibit computationally complimentary properties. Specifically, the BO formulation may fail due to crossing of the eigenvalues of the covariance matrix, while both BO and DO become unstable when there is a high condition number of the covariance matrix or zero eigenvalues. To this end, we combine the two methods into a robust hybrid framework and in addition we employ a pseudo-inverse technique to invert the covariance matrix. The robustness of the proposed method stems from addressing the following issues in the DO/BO formulation: (i) eigenvalue crossing: we resolve the issue of eigenvalue crossing in the BO formulation by switching to the DO near eigenvalue crossing using the equivalence theorem and switching back to BO when the distance between eigenvalues is larger than a threshold value; (ii) ill-conditioned covariance matrix: we utilize a pseudo-inverse strategy to invert the covariance matrix; (iii) adaptivity: we utilize an adaptive strategy to add/remove modes to resolve the covariance matrix up to a threshold value. In particular, we introduce a soft-threshold criterion to allow the system to adapt to the newly added/removed mode and therefore avoid repetitive and unnecessary mode addition/removal. When the total variance approaches zero, we show that the DO/BO formulation becomes equivalent to the evolution equation of the Optimally Time-Dependent modes [4]. We demonstrate the capability of the proposed methodology with several numerical examples, namely (i) stochastic Burgers equation: we

Chaotic evolution of prisoner's dilemma game with volunteering on interdependent networks

NASA Astrophysics Data System (ADS)

Luo, Chao; Zhang, Xiaolin; Zheng, YuanJie

2017-06-01

In this article, the evolution of prisoner's dilemma game with volunteering on interdependent networks is investigated. Different from the traditional two-strategy game, voluntary participation as an additional strategy is involved in repeated game, that can introduce more complex evolutionary dynamics. And, interdependent networks provide a more generalized network architecture to study the intricate variability of dynamics. We have showed that voluntary participation could effectively promote the density of co-operation, that is also greatly affected by interdependent strength between two coupled networks. We further discussed the influence of interdependent strength on the densities of different strategies and found that an intermediate interdependence would play a bigger role on the evolution of dynamics. Subsequently, the critical values of the defection temptation for phase transitions under different conditions have been studied. Moreover, the global oscillations induced by the circle of dominance of three strategies on interdependent networks have been quantitatively investigated. Counter-intuitively, the oscillations of strategy densities are not periodic or stochastic, but have rich dynamical behaviors. By means of various analysis tools, we have demonstrated the global oscillations of strategy densities possessed chaotic characteristics.

Time varying moments, regime switch, and crisis warning: The birth-death process with changing transition probability

NASA Astrophysics Data System (ADS)

Tang, Yinan; Chen, Ping

2014-06-01

The sub-prime crisis in the U.S. reveals the limitation of diversification strategy based on mean-variance analysis. A regime switch and a turning point can be observed using a high moment representation and time-dependent transition probability. Up-down price movements are induced by interactions among agents, which can be described by the birth-death (BD) process. Financial instability is visible by dramatically increasing 3rd to 5th moments one-quarter before and during the crisis. The sudden rising high moments provide effective warning signals of a regime-switch or a coming crisis. The critical condition of a market breakdown can be identified from nonlinear stochastic dynamics. The master equation approach of population dynamics provides a unified theory of a calm and turbulent market.

N-state random switching based on quantum tunnelling

NASA Astrophysics Data System (ADS)

Bernardo Gavito, Ramón; Jiménez Urbanos, Fernando; Roberts, Jonathan; Sexton, James; Astbury, Benjamin; Shokeir, Hamzah; McGrath, Thomas; Noori, Yasir J.; Woodhead, Christopher S.; Missous, Mohamed; Roedig, Utz; Young, Robert J.

2017-08-01

In this work, we show how the hysteretic behaviour of resonant tunnelling diodes (RTDs) can be exploited for new functionalities. In particular, the RTDs exhibit a stochastic 2-state switching mechanism that could be useful for random number generation and cryptographic applications. This behaviour can be scaled to N-bit switching, by connecting various RTDs in series. The InGaAs/AlAs RTDs used in our experiments display very sharp negative differential resistance (NDR) peaks at room temperature which show hysteresis cycles that, rather than having a fixed switching threshold, show a probability distribution about a central value. We propose to use this intrinsic uncertainty emerging from the quantum nature of the RTDs as a source of randomness. We show that a combination of two RTDs in series results in devices with three-state outputs and discuss the possibility of scaling to N-state devices by subsequent series connections of RTDs, which we demonstrate for the up to the 4-state case. In this work, we suggest using that the intrinsic uncertainty in the conduction paths of resonant tunnelling diodes can behave as a source of randomness that can be integrated into current electronics to produce on-chip true random number generators. The N-shaped I-V characteristic of RTDs results in a two-level random voltage output when driven with current pulse trains. Electrical characterisation and randomness testing of the devices was conducted in order to determine the validity of the true randomness assumption. Based on the results obtained for the single RTD case, we suggest the possibility of using multi-well devices to generate N-state random switching devices for their use in random number generation or multi-valued logic devices.

Partner switching promotes cooperation among myopic agents on a geographical plane

NASA Astrophysics Data System (ADS)

Li, Yixiao; Min, Yong; Zhu, Xiaodong; Cao, Jie

2013-02-01

We study the coupling dynamics between the evolution of cooperation and the evolution of partnership network on a geographical plane. While agents play networked prisoner’s dilemma games, they can dynamically adjust their partnerships based on local information about reputation. We incorporate geographical features into the process of the agent’s partner switching and investigate the corresponding effects. At each time step of the coevolution, a random agent can either update his strategy by imitation or adjust his partnership by switching from the lowest reputation partner to the highest reputation one among his neighbors. We differentiate two types of neighbors: geographical neighbors (i.e., the set of agents who are close to the focal agent in terms of geographical distance) and connectivity neighbors (i.e., the set of agents who are close to the focal agent in the partnership network in terms of geodesic distance). We find that switching to either geographical neighbors or connectivity neighbors enhances cooperation greatly in a wide parameter range. Cooperation can be favored in a much stricter condition when agents switch to connectivity neighbors more frequently. However, an increasing tendency of reconnecting to geographical neighbors shortens the geographical distance between a pair of partners on average. When agents consider the cost of geographical distance in adjusting the partnership, they are prone to reconnect to geographical neighbors.

Switching Dynamics Between Two Movement Patterns Varies According to Time Interval

NASA Astrophysics Data System (ADS)

Hirakawa, Takehito; Suzuki, Hiroo; Okumura, Motoki; Gohara, Kazutoshi; Yamamoto, Yuji

This study investigated the regularity that characterizes the behavior of dissipative dynamical systems excited by external temporal inputs for pointing movements. Right-handed healthy male participants were asked to continuously point their right index finger at two light-emitting diodes (LEDs) located in the oblique left and right directions in front of them. These movements were performed under two conditions: one in which the direction was repeated and one in which the directions were switched on a stochastic basis. These conditions consisted of 12 tempos (30, 36, 42, 48, 51, 54, 57, 60, 63, 66, 69, and 72 beats per minute). Data from the conditions under which the input pattern was repeated revealed two different trajectories in hyper-cylindrical state space ℳ, whereas the conditions under which the inputs were switched induced transitions between the two trajectories, which were considered to be excited attractors. The transitions between the two excited attractors were characterized by a self-similar structure. Moreover, the correlation dimensions increased as the tempos increased. These results suggest a relationship of D ∝ 1/T (T is the switching-time length; i.e. the condition) between temporal input and pointing behavior and that continuous pointing movements are regular rather than random noise.

Stochastic thermodynamics

NASA Astrophysics Data System (ADS)

Eichhorn, Ralf; Aurell, Erik

2014-04-01

'Stochastic thermodynamics as a conceptual framework combines the stochastic energetics approach introduced a decade ago by Sekimoto [1] with the idea that entropy can consistently be assigned to a single fluctuating trajectory [2]'. This quote, taken from Udo Seifert's [3] 2008 review, nicely summarizes the basic ideas behind stochastic thermodynamics: for small systems, driven by external forces and in contact with a heat bath at a well-defined temperature, stochastic energetics [4] defines the exchanged work and heat along a single fluctuating trajectory and connects them to changes in the internal (system) energy by an energy balance analogous to the first law of thermodynamics. Additionally, providing a consistent definition of trajectory-wise entropy production gives rise to second-law-like relations and forms the basis for a 'stochastic thermodynamics' along individual fluctuating trajectories. In order to construct meaningful concepts of work, heat and entropy production for single trajectories, their definitions are based on the stochastic equations of motion modeling the physical system of interest. Because of this, they are valid even for systems that are prevented from equilibrating with the thermal environment by external driving forces (or other sources of non-equilibrium). In that way, the central notions of equilibrium thermodynamics, such as heat, work and entropy, are consistently extended to the non-equilibrium realm. In the (non-equilibrium) ensemble, the trajectory-wise quantities acquire distributions. General statements derived within stochastic thermodynamics typically refer to properties of these distributions, and are valid in the non-equilibrium regime even beyond the linear response. The extension of statistical mechanics and of exact thermodynamic statements to the non-equilibrium realm has been discussed from the early days of statistical mechanics more than 100 years ago. This debate culminated in the development of linear response

Portfolio Optimization with Stochastic Dividends and Stochastic Volatility

ERIC Educational Resources Information Center

Varga, Katherine Yvonne

2015-01-01

We consider an optimal investment-consumption portfolio optimization model in which an investor receives stochastic dividends. As a first problem, we allow the drift of stock price to be a bounded function. Next, we consider a stochastic volatility model. In each problem, we use the dynamic programming method to derive the Hamilton-Jacobi-Bellman…

A Simple Mechanism for Cooperation in the Well-Mixed Prisoner's Dilemma Game

NASA Astrophysics Data System (ADS)

Perc, Matjaž

2008-11-01

I show that the addition of Gaussian noise to the payoffs is able to stabilize cooperation in well-mixed populations, where individuals play the prisoner's dilemma game. The impact of stochasticity on the evolutionary dynamics can be expressed deterministically via a simple small-noise expansion of multiplicative noisy terms. In particular, cooperation emerges as a stable noise-induced steady state in the replicator dynamics. Due to the generality of the employed theoretical framework, presented results should prove valuable in various scientific disciplines, ranging from economy to ecology.

Solid-state switch increases switching speed

NASA Technical Reports Server (NTRS)

Mcgowan, G. F.

1966-01-01

Solid state switch for commutating capacitors in an RC commutated network increases switching speed and extends the filtering or commutating frequency spectrum well into the kilocycle region. The switch is equivalent to the standard double- pole double-throw /DPDT/ relay and is driven from digital micrologic circuits.

Stochastic dynamics of genetic broadcasting networks

NASA Astrophysics Data System (ADS)

Potoyan, Davit; Wolynes, Peter

The complex genetic programs of eukaryotic cells are often regulated by key transcription factors occupying or clearing out of a large number of genomic locations. Orchestrating the residence times of these factors is therefore important for the well organized functioning of a large network. The classic models of genetic switches sidestep this timing issue by assuming the binding of transcription factors to be governed entirely by thermodynamic protein-DNA affinities. Here we show that relying on passive thermodynamics and random release times can lead to a ''time-scale crisis'' of master genes that broadcast their signals to large number of binding sites. We demonstrate that this ''time-scale crisis'' can be resolved by actively regulating residence times through molecular stripping. We illustrate these ideas by studying the stochastic dynamics of the genetic network of the central eukaryotic master regulator NFκB which broadcasts its signals to many downstream genes that regulate immune response, apoptosis etc.

Stochastic dynamics of genetic broadcasting networks

NASA Astrophysics Data System (ADS)

Potoyan, Davit A.; Wolynes, Peter G.

2017-11-01

The complex genetic programs of eukaryotic cells are often regulated by key transcription factors occupying or clearing out of a large number of genomic locations. Orchestrating the residence times of these factors is therefore important for the well organized functioning of a large network. The classic models of genetic switches sidestep this timing issue by assuming the binding of transcription factors to be governed entirely by thermodynamic protein-DNA affinities. Here we show that relying on passive thermodynamics and random release times can lead to a "time-scale crisis" for master genes that broadcast their signals to a large number of binding sites. We demonstrate that this time-scale crisis for clearance in a large broadcasting network can be resolved by actively regulating residence times through molecular stripping. We illustrate these ideas by studying a model of the stochastic dynamics of the genetic network of the central eukaryotic master regulator NFκ B which broadcasts its signals to many downstream genes that regulate immune response, apoptosis, etc.

Efficient analysis of stochastic gene dynamics in the non-adiabatic regime using piecewise deterministic Markov processes

PubMed Central

2018-01-01

Single-cell experiments show that gene expression is stochastic and bursty, a feature that can emerge from slow switching between promoter states with different activities. In addition to slow chromatin and/or DNA looping dynamics, one source of long-lived promoter states is the slow binding and unbinding kinetics of transcription factors to promoters, i.e. the non-adiabatic binding regime. Here, we introduce a simple analytical framework, known as a piecewise deterministic Markov process (PDMP), that accurately describes the stochastic dynamics of gene expression in the non-adiabatic regime. We illustrate the utility of the PDMP on a non-trivial dynamical system by analysing the properties of a titration-based oscillator in the non-adiabatic limit. We first show how to transform the underlying chemical master equation into a PDMP where the slow transitions between promoter states are stochastic, but whose rates depend upon the faster deterministic dynamics of the transcription factors regulated by these promoters. We show that the PDMP accurately describes the observed periods of stochastic cycles in activator and repressor-based titration oscillators. We then generalize our PDMP analysis to more complicated versions of titration-based oscillators to explain how multiple binding sites lengthen the period and improve coherence. Last, we show how noise-induced oscillation previously observed in a titration-based oscillator arises from non-adiabatic and discrete binding events at the promoter site. PMID:29386401

Extortion under uncertainty: Zero-determinant strategies in noisy games

NASA Astrophysics Data System (ADS)

Hao, Dong; Rong, Zhihai; Zhou, Tao

2015-05-01

Repeated game theory has been one of the most prevailing tools for understanding long-running relationships, which are the foundation in building human society. Recent works have revealed a new set of "zero-determinant" (ZD) strategies, which is an important advance in repeated games. A ZD strategy player can exert unilateral control on two players' payoffs. In particular, he can deterministically set the opponent's payoff or enforce an unfair linear relationship between the players' payoffs, thereby always seizing an advantageous share of payoffs. One of the limitations of the original ZD strategy, however, is that it does not capture the notion of robustness when the game is subjected to stochastic errors. In this paper, we propose a general model of ZD strategies for noisy repeated games and find that ZD strategies have high robustness against errors. We further derive the pinning strategy under noise, by which the ZD strategy player coercively sets the opponent's expected payoff to his desired level, although his payoff control ability declines with the increase of noise strength. Due to the uncertainty caused by noise, the ZD strategy player cannot ensure his payoff to be permanently higher than the opponent's, which implies dominant extortions do not exist even under low noise. While we show that the ZD strategy player can still establish a novel kind of extortions, named contingent extortions, where any increase of his own payoff always exceeds that of the opponent's by a fixed percentage, and the conditions under which the contingent extortions can be realized are more stringent as the noise becomes stronger.

Healthy Gaming - Video Game Design to promote Health.

PubMed

Brox, E; Fernandez-Luque, L; Tøllefsen, T

2011-01-01

There is an increasing interest in health games including simulation tools, games for specific conditions, persuasive games to promote a healthy life style or exergames where physical exercise is used to control the game. The objective of the article is to review current literature about available health games and the impact related to game design principles as well as some educational theory aspects. Literature from the big databases and known sites with games for health has been searched to find articles about games for health purposes. The focus has been on educational games, persuasive games and exergames as well as articles describing game design principles. The medical objectives can either be a part of the game theme (intrinsic) or be totally dispatched (extrinsic), and particularly persuasive games seem to use extrinsic game design. Peer support is important, but there is only limited research on multiplayer health games. Evaluation of health games can be both medical and technical, and the focus will depend on the game purpose. There is still not enough evidence to conclude which design principles work for what purposes since most of the literature in health serious games does not specify design methodologies, but it seems that extrinsic methods work in persuasion. However, when designing health care games it is important to define both the target group and main objective, and then design a game accordingly using sound game design principles, but also utilizing design elements to enhance learning and persuasion. A collaboration with health professionals from an early design stage is necessary both to ensure that the content is valid and to have the game validated from a clinical viewpoint. Patients need to be involved, especially to improve usability. More research should be done on social aspects in health games, both related to learning and persuasion.

Stochastic associative memory

NASA Astrophysics Data System (ADS)

Baumann, Erwin W.; Williams, David L.

1993-08-01

Artificial neural networks capable of learning and recalling stochastic associations between non-deterministic quantities have received relatively little attention to date. One potential application of such stochastic associative networks is the generation of sensory 'expectations' based on arbitrary subsets of sensor inputs to support anticipatory and investigate behavior in sensor-based robots. Another application of this type of associative memory is the prediction of how a scene will look in one spectral band, including noise, based upon its appearance in several other wavebands. This paper describes a semi-supervised neural network architecture composed of self-organizing maps associated through stochastic inter-layer connections. This 'Stochastic Associative Memory' (SAM) can learn and recall non-deterministic associations between multi-dimensional probability density functions. The stochastic nature of the network also enables it to represent noise distributions that are inherent in any true sensing process. The SAM architecture, training process, and initial application to sensor image prediction are described. Relationships to Fuzzy Associative Memory (FAM) are discussed.

Magnetic Tunnel Junction Based Long-Term Short-Term Stochastic Synapse for a Spiking Neural Network with On-Chip STDP Learning

NASA Astrophysics Data System (ADS)

Srinivasan, Gopalakrishnan; Sengupta, Abhronil; Roy, Kaushik

2016-07-01

Spiking Neural Networks (SNNs) have emerged as a powerful neuromorphic computing paradigm to carry out classification and recognition tasks. Nevertheless, the general purpose computing platforms and the custom hardware architectures implemented using standard CMOS technology, have been unable to rival the power efficiency of the human brain. Hence, there is a need for novel nanoelectronic devices that can efficiently model the neurons and synapses constituting an SNN. In this work, we propose a heterostructure composed of a Magnetic Tunnel Junction (MTJ) and a heavy metal as a stochastic binary synapse. Synaptic plasticity is achieved by the stochastic switching of the MTJ conductance states, based on the temporal correlation between the spiking activities of the interconnecting neurons. Additionally, we present a significance driven long-term short-term stochastic synapse comprising two unique binary synaptic elements, in order to improve the synaptic learning efficiency. We demonstrate the efficacy of the proposed synaptic configurations and the stochastic learning algorithm on an SNN trained to classify handwritten digits from the MNIST dataset, using a device to system-level simulation framework. The power efficiency of the proposed neuromorphic system stems from the ultra-low programming energy of the spintronic synapses.

Magnetic Tunnel Junction Based Long-Term Short-Term Stochastic Synapse for a Spiking Neural Network with On-Chip STDP Learning.

PubMed

Srinivasan, Gopalakrishnan; Sengupta, Abhronil; Roy, Kaushik

2016-07-13

Spiking Neural Networks (SNNs) have emerged as a powerful neuromorphic computing paradigm to carry out classification and recognition tasks. Nevertheless, the general purpose computing platforms and the custom hardware architectures implemented using standard CMOS technology, have been unable to rival the power efficiency of the human brain. Hence, there is a need for novel nanoelectronic devices that can efficiently model the neurons and synapses constituting an SNN. In this work, we propose a heterostructure composed of a Magnetic Tunnel Junction (MTJ) and a heavy metal as a stochastic binary synapse. Synaptic plasticity is achieved by the stochastic switching of the MTJ conductance states, based on the temporal correlation between the spiking activities of the interconnecting neurons. Additionally, we present a significance driven long-term short-term stochastic synapse comprising two unique binary synaptic elements, in order to improve the synaptic learning efficiency. We demonstrate the efficacy of the proposed synaptic configurations and the stochastic learning algorithm on an SNN trained to classify handwritten digits from the MNIST dataset, using a device to system-level simulation framework. The power efficiency of the proposed neuromorphic system stems from the ultra-low programming energy of the spintronic synapses.

Selfishness, fraternity, and other-regarding preference in spatial evolutionary games.

PubMed

Szabó, György; Szolnoki, Attila

2012-04-21

Spatial evolutionary games are studied with myopic players whose payoff interest, as a personal character, is tuned from selfishness to other-regarding preference via fraternity. The players are located on a square lattice and collect income from symmetric two-person two-strategy (called cooperation and defection) games with their nearest neighbors. During the elementary steps of evolution a randomly chosen player modifies her strategy in order to maximize stochastically her utility function composed from her own and the co-players' income with weight factors 1-Q and Q. These models are studied within a wide range of payoff parameters using Monte Carlo simulations for noisy strategy updates and by spatial stability analysis in the low noise limit. For fraternal players (Q=1/2) the system evolves into ordered arrangements of strategies in the low noise limit in a way providing optimum payoff for the whole society. Dominance of defectors, representing the "tragedy of the commons", is found within the regions of prisoner's dilemma and stag hunt game for selfish players (Q=0). Due to the symmetry in the effective utility function the system exhibits similar behavior even for Q=1 that can be interpreted as the "lovers' dilemma". Copyright © 2011 Elsevier Ltd. All rights reserved.

Slowly switching between environments facilitates reverse evolution in small populations.

PubMed

Tan, Longzhi; Gore, Jeff

2012-10-01

Natural populations must constantly adapt to ever-changing environmental conditions. A particularly interesting question is whether such adaptations can be reversed by returning the population to an ancestral environment. Such evolutionary reversals have been observed in both natural and laboratory populations. However, the factors that determine the reversibility of evolution are still under debate. The time scales of environmental change vary over a wide range, but little is known about how the rate of environmental change influences the reversibility of evolution. Here, we demonstrate computationally that slowly switching between environments increases the reversibility of evolution for small populations that are subject to only modest clonal interference. For small populations, slow switching reduces the mean number of mutations acquired in a new environment and also increases the probability of reverse evolution at each of these "genetic distances." As the population size increases, slow switching no longer reduces the genetic distance, thus decreasing the evolutionary reversibility. We confirm this effect using both a phenomenological model of clonal interference and also a Wright-Fisher stochastic simulation that incorporates genetic diversity. Our results suggest that the rate of environmental change is a key determinant of the reversibility of evolution, and provides testable hypotheses for experimental evolution. © 2012 The Author(s). Evolution© 2012 The Society for the Study of Evolution.

Addictive Online Games: Examining the Relationship Between Game Genres and Internet Gaming Disorder.

PubMed

Lemmens, Jeroen S; Hendriks, Stefan J F

2016-04-01

Internet gaming disorder (IGD) is the most recent term used to describe problematic or pathological involvement with computer or video games. This study examined whether this disorder is more likely to involve pathological involvement with online (i.e., Internet) games as opposed to offline games. We also explored the addictive potential of nine video game genres by examining the relationship between IGD and 2,720 games played by a sample of 13- to 40-year olds (N = 2,442). Although time spent playing both online and offline games was related to IGD, online games showed much stronger correlations. This tendency is also reflected within various genres. Disordered gamers spent more than four times as much time playing online role-playing games than nondisordered gamers and more than thrice as much time playing online shooters, whereas no significant differences for offline games from these genres were found. Results are discussed within the frame of social interaction and competition provided by online games.

Evolutionary prisoner's dilemma games coevolving on adaptive networks.

PubMed

Lee, Hsuan-Wei; Malik, Nishant; Mucha, Peter J

2018-02-01

We study a model for switching strategies in the Prisoner's Dilemma game on adaptive networks of player pairings that coevolve as players attempt to maximize their return. We use a node-based strategy model wherein each player follows one strategy at a time (cooperate or defect) across all of its neighbors, changing that strategy and possibly changing partners in response to local changes in the network of player pairing and in the strategies used by connected partners. We compare and contrast numerical simulations with existing pair approximation differential equations for describing this system, as well as more accurate equations developed here using the framework of approximate master equations. We explore the parameter space of the model, demonstrating the relatively high accuracy of the approximate master equations for describing the system observations made from simulations. We study two variations of this partner-switching model to investigate the system evolution, predict stationary states, and compare the total utilities and other qualitative differences between these two model variants.

The Effect of Power Asymmetries on Cooperation and Punishment in a Prisoner’s Dilemma Game

PubMed Central

Bone, Jonathan E.; Wallace, Brian; Bshary, Redouan; Raihani, Nichola J.

2015-01-01

Recent work has suggested that punishment is detrimental because punishment provokes retaliation, not cooperation, resulting in lower overall payoffs. These findings may stem from the unrealistic assumption that all players are equal: in reality individuals are expected to vary in the power with which they can punish defectors. Here, we allowed strong players to interact with weak players in an iterated prisoner's dilemma game with punishment. Defecting players were most likely to switch to cooperation if the partner cooperated: adding punishment yielded no additional benefit and, under some circumstances, increased the chance that the partner would both defect and retaliate against the punisher. Our findings show that, in a two-player game, cooperation begets cooperation and that punishment does not seem to yield any additional benefits. Further work should explore whether strong punishers might prevail in multi-player games. PMID:25629971

Toward the Darwinian transition: Switching between distributed and speciated states in a simple model of early life.

PubMed

Arnoldt, Hinrich; Strogatz, Steven H; Timme, Marc

2015-01-01

It has been hypothesized that in the era just before the last universal common ancestor emerged, life on earth was fundamentally collective. Ancient life forms shared their genetic material freely through massive horizontal gene transfer (HGT). At a certain point, however, life made a transition to the modern era of individuality and vertical descent. Here we present a minimal model for stochastic processes potentially contributing to this hypothesized "Darwinian transition." The model suggests that HGT-dominated dynamics may have been intermittently interrupted by selection-driven processes during which genotypes became fitter and decreased their inclination toward HGT. Stochastic switching in the population dynamics with three-point (hypernetwork) interactions may have destabilized the HGT-dominated collective state and essentially contributed to the emergence of vertical descent and the first well-defined species in early evolution. A systematic nonlinear analysis of the stochastic model dynamics covering key features of evolutionary processes (such as selection, mutation, drift and HGT) supports this view. Our findings thus suggest a viable direction out of early collective evolution, potentially enabling the start of individuality and vertical Darwinian evolution.

The effects of demand uncertainty on strategic gaming in the merit-order electricity pool market

NASA Astrophysics Data System (ADS)

Frem, Bassam

In a merit-order electricity pool market, generating companies (Gencos) game with their offered incremental cost to meet the electricity demand and earn bigger market shares and higher profits. However when the demand is treated as a random variable instead of as a known constant, these Genco gaming strategies become more complex. After a brief introduction of electricity markets and gaming, the effects of demand uncertainty on strategic gaming are studied in two parts: (1) Demand modelled as a discrete random variable (2) Demand modelled as a continuous random variable. In the first part, we proposed an algorithm, the discrete stochastic strategy (DSS) algorithm that generates a strategic set of offers from the perspective of the Gencos' profits. The DSS offers were tested and compared to the deterministic Nash equilibrium (NE) offers based on the predicted demand. This comparison, based on the expected Genco profits, showed the DSS to be a better strategy in a probabilistic sense than the deterministic NE. In the second part, we presented three gaming strategies: (1) Deterministic NE (2) No-Risk (3) Risk-Taking. The strategies were then tested and their profit performances were compared using two assessment tools: (a) Expected value and standard deviation (b) Inverse cumulative distribution. We concluded that despite yielding higher profit performance under the right conjectures, Risk-Taking strategies are very sensitive to incorrect conjectures on the competitors' gaming decisions. As such, despite its lower profit performance, the No-Risk strategy was deemed preferable.

The relationship between internet-gaming experience and executive functions measured by virtual environment compared with conventional laboratory multitasks.

PubMed

Chen, Yong-Quan; Hsieh, Shulan

2018-01-01

The aim of this study was to investigate if individuals with frequent internet gaming (IG) experience exhibited better or worse multitasking ability compared with those with infrequent IG experience. The individuals' multitasking abilities were measured using virtual environment multitasks, such as Edinburgh Virtual Errands Test (EVET), and conventional laboratory multitasks, such as the dual task and task switching. Seventy-two young healthy college students participated in this study. They were split into two groups based on the time spent on playing online games, as evaluated using the Internet Use Questionnaire. Each participant performed EVET, dual-task, and task-switching paradigms on a computer. The current results showed that the frequent IG group performed better on EVET compared with the infrequent IG group, but their performance on the dual-task and task-switching paradigms did not differ significantly. The results suggest that the frequent IG group exhibited better multitasking efficacy if measured using a more ecologically valid task, but not when measured using a conventional laboratory multitasking task. The differences in terms of the subcomponents of executive function measured by these task paradigms were discussed. The current results show the importance of the task effect while evaluating frequent internet gamers' multitasking ability.

The relationship between internet-gaming experience and executive functions measured by virtual environment compared with conventional laboratory multitasks

PubMed Central

Chen, Yong-Quan

2018-01-01

The aim of this study was to investigate if individuals with frequent internet gaming (IG) experience exhibited better or worse multitasking ability compared with those with infrequent IG experience. The individuals’ multitasking abilities were measured using virtual environment multitasks, such as Edinburgh Virtual Errands Test (EVET), and conventional laboratory multitasks, such as the dual task and task switching. Seventy-two young healthy college students participated in this study. They were split into two groups based on the time spent on playing online games, as evaluated using the Internet Use Questionnaire. Each participant performed EVET, dual-task, and task-switching paradigms on a computer. The current results showed that the frequent IG group performed better on EVET compared with the infrequent IG group, but their performance on the dual-task and task-switching paradigms did not differ significantly. The results suggest that the frequent IG group exhibited better multitasking efficacy if measured using a more ecologically valid task, but not when measured using a conventional laboratory multitasking task. The differences in terms of the subcomponents of executive function measured by these task paradigms were discussed. The current results show the importance of the task effect while evaluating frequent internet gamers’ multitasking ability. PMID:29879150

Role asymmetry and code transmission in signaling games: an experimental and computational investigation.

PubMed

Moreno, Maggie; Baggio, Giosuè

2015-07-01

In signaling games, a sender has private access to a state of affairs and uses a signal to inform a receiver about that state. If no common association of signals and states is initially available, sender and receiver must coordinate to develop one. How do players divide coordination labor? We show experimentally that, if players switch roles at each communication round, coordination labor is shared. However, in games with fixed roles, coordination labor is divided: Receivers adjust their mappings more frequently, whereas senders maintain the initial code, which is transmitted to receivers and becomes the common code. In a series of computer simulations, player and role asymmetry as observed experimentally were accounted for by a model in which the receiver in the first signaling round has a higher chance of adjusting its code than its partner. From this basic division of labor among players, certain properties of role asymmetry, in particular correlations with game complexity, are seen to follow. Copyright © 2014 Cognitive Science Society, Inc.

Cognitive biases toward Internet game-related pictures and executive deficits in individuals with an Internet game addiction.

PubMed

Zhou, Zhenhe; Yuan, Guozhen; Yao, Jianjun

2012-01-01

The cue-related go/no-go switching task provides an experimental approach to study individual's flexibility in changing situations. Because Internet addiction disorder (IAD) belongs to the compulsive-impulsive spectrum of disorders, it should present cognitive bias and executive functioning deficit characteristics of some of these types of disorders. Until now, no studies have been reported on cognitive bias and executive function involving mental flexibility and response inhibition in IAD. A total of 46 subjects who met the criteria of the modified Young's Diagnostic Questionnaire for Internet addiction (YDQ) were recruited as an Internet game addiction (IGA) group, along with 46 healthy control individuals. All participants performed the Internet game-shifting task. Using hit rate, RT, d' and C as the dependent measures, a three-way ANOVA (group × target × condition) was performed. For hit rate, a significant effect of group, type of target and condition were found. The group-target interaction effect was significant. For RT, significant effects were revealed for group and type of target. The group-target interaction effect was significant. Comparisons of the means revealed that the slowing down of IGA relative to NIA was more pronounced when the target stimuli were neutral as opposed to Internet game-related pictures. In addition, the group-condition interaction effect was significant. For d', significant effects of group, type of target and condition were found. The group-target interaction effect was significant. For C, the type of target produced a significant effect. There was a positive correlation between the length of the addiction (number of years) and the severity of the cognitive bias. IGA present cognitive biases towards information related to Internet gaming. These biases, as well as poor executive functioning skills (lower mental flexibility and response inhibition), might be responsible for Internet game addiction. The assessment of cognitive

Stochastic P-bifurcation and stochastic resonance in a noisy bistable fractional-order system

NASA Astrophysics Data System (ADS)

Yang, J. H.; Sanjuán, Miguel A. F.; Liu, H. G.; Litak, G.; Li, X.

2016-12-01

We investigate the stochastic response of a noisy bistable fractional-order system when the fractional-order lies in the interval (0, 2]. We focus mainly on the stochastic P-bifurcation and the phenomenon of the stochastic resonance. We compare the generalized Euler algorithm and the predictor-corrector approach which are commonly used for numerical calculations of fractional-order nonlinear equations. Based on the predictor-corrector approach, the stochastic P-bifurcation and the stochastic resonance are investigated. Both the fractional-order value and the noise intensity can induce an stochastic P-bifurcation. The fractional-order may lead the stationary probability density function to turn from a single-peak mode to a double-peak mode. However, the noise intensity may transform the stationary probability density function from a double-peak mode to a single-peak mode. The stochastic resonance is investigated thoroughly, according to the linear and the nonlinear response theory. In the linear response theory, the optimal stochastic resonance may occur when the value of the fractional-order is larger than one. In previous works, the fractional-order is usually limited to the interval (0, 1]. Moreover, the stochastic resonance at the subharmonic frequency and the superharmonic frequency are investigated respectively, by using the nonlinear response theory. When it occurs at the subharmonic frequency, the resonance may be strong and cannot be ignored. When it occurs at the superharmonic frequency, the resonance is weak. We believe that the results in this paper might be useful for the signal processing of nonlinear systems.

Gaming Device Usage Patterns Predict Internet Gaming Disorder: Comparison across Different Gaming Device Usage Patterns.

PubMed

Paik, Soo-Hyun; Cho, Hyun; Chun, Ji-Won; Jeong, Jo-Eun; Kim, Dai-Jin

2017-12-05

Gaming behaviors have been significantly influenced by smartphones. This study was designed to explore gaming behaviors and clinical characteristics across different gaming device usage patterns and the role of the patterns on Internet gaming disorder (IGD). Responders of an online survey regarding smartphone and online game usage were classified by different gaming device usage patterns: (1) individuals who played only computer games; (2) individuals who played computer games more than smartphone games; (3) individuals who played computer and smartphone games evenly; (4) individuals who played smartphone games more than computer games; (5) individuals who played only smartphone games. Data on demographics, gaming-related behaviors, and scales for Internet and smartphone addiction, depression, anxiety disorder, and substance use were collected. Combined users, especially those who played computer and smartphone games evenly, had higher prevalence of IGD, depression, anxiety disorder, and substance use disorder. These subjects were more prone to develop IGD than reference group (computer only gamers) (B = 0.457, odds ratio = 1.579). Smartphone only gamers had the lowest prevalence of IGD, spent the least time and money on gaming, and showed lowest scores of Internet and smartphone addiction. Our findings suggest that gaming device usage patterns may be associated with the occurrence, course, and prognosis of IGD.

Gaming Device Usage Patterns Predict Internet Gaming Disorder: Comparison across Different Gaming Device Usage Patterns

PubMed Central

Cho, Hyun; Chun, Ji-Won; Jeong, Jo-Eun; Kim, Dai-Jin

2017-01-01

Gaming behaviors have been significantly influenced by smartphones. This study was designed to explore gaming behaviors and clinical characteristics across different gaming device usage patterns and the role of the patterns on Internet gaming disorder (IGD). Responders of an online survey regarding smartphone and online game usage were classified by different gaming device usage patterns: (1) individuals who played only computer games; (2) individuals who played computer games more than smartphone games; (3) individuals who played computer and smartphone games evenly; (4) individuals who played smartphone games more than computer games; (5) individuals who played only smartphone games. Data on demographics, gaming-related behaviors, and scales for Internet and smartphone addiction, depression, anxiety disorder, and substance use were collected. Combined users, especially those who played computer and smartphone games evenly, had higher prevalence of IGD, depression, anxiety disorder, and substance use disorder. These subjects were more prone to develop IGD than reference group (computer only gamers) (B = 0.457, odds ratio = 1.579). Smartphone only gamers had the lowest prevalence of IGD, spent the least time and money on gaming, and showed lowest scores of Internet and smartphone addiction. Our findings suggest that gaming device usage patterns may be associated with the occurrence, course, and prognosis of IGD. PMID:29206183

Strategy evolution driven by switching probabilities in structured multi-agent systems

NASA Astrophysics Data System (ADS)

Zhang, Jianlei; Chen, Zengqiang; Li, Zhiqi

2017-10-01

Evolutionary mechanism driving the commonly seen cooperation among unrelated individuals is puzzling. Related models for evolutionary games on graphs traditionally assume that players imitate their successful neighbours with higher benefits. Notably, an implicit assumption here is that players are always able to acquire the required pay-off information. To relax this restrictive assumption, a contact-based model has been proposed, where switching probabilities between strategies drive the strategy evolution. However, the explicit and quantified relation between a player's switching probability for her strategies and the number of her neighbours remains unknown. This is especially a key point in heterogeneously structured system, where players may differ in the numbers of their neighbours. Focusing on this, here we present an augmented model by introducing an attenuation coefficient and evaluate its influence on the evolution dynamics. Results show that the individual influence on others is negatively correlated with the contact numbers specified by the network topologies. Results further provide the conditions under which the coexisting strategies can be calculated analytically.

Circuit-Host Coupling Induces Multifaceted Behavioral Modulations of a Gene Switch.

PubMed

Blanchard, Andrew E; Liao, Chen; Lu, Ting

2018-02-06

Quantitative modeling of gene circuits is fundamentally important to synthetic biology, as it offers the potential to transform circuit engineering from trial-and-error construction to rational design and, hence, facilitates the advance of the field. Currently, typical models regard gene circuits as isolated entities and focus only on the biochemical processes within the circuits. However, such a standard paradigm is getting challenged by increasing experimental evidence suggesting that circuits and their host are intimately connected, and their interactions can potentially impact circuit behaviors. Here we systematically examined the roles of circuit-host coupling in shaping circuit dynamics by using a self-activating gene switch as a model circuit. Through a combination of deterministic modeling, stochastic simulation, and Fokker-Planck equation formalism, we found that circuit-host coupling alters switch behaviors across multiple scales. At the single-cell level, it slows the switch dynamics in the high protein production regime and enlarges the difference between stable steady-state values. At the population level, it favors cells with low protein production through differential growth amplification. Together, the two-level coupling effects induce both quantitative and qualitative modulations of the switch, with the primary component of the effects determined by the circuit's architectural parameters. This study illustrates the complexity and importance of circuit-host coupling in modulating circuit behaviors, demonstrating the need for a new paradigm-integrated modeling of the circuit-host system-for quantitative understanding of engineered gene networks. Copyright © 2017 Biophysical Society. Published by Elsevier Inc. All rights reserved.

Temporal switching jitter in photoconductive switches

DOE Office of Scientific and Technical Information (OSTI.GOV)

GAUDET,JOHN A.; SKIPPER,MICHAEL C.; ABDALLA,MICHAEL D.

This paper reports on a recent comparison made between the Air Force Research Laboratory (AFRL) gallium arsenide, optically-triggered switch test configuration and the Sandia National Laboratories (SNL) gallium arsenide, optically-triggered switch test configuration. The purpose of these measurements was to compare the temporal switch jitter times. It is found that the optical trigger laser characteristics are dominant in determining the PCSS jitter.

On the long-term fitness of cells in periodically switching environments.

PubMed

Pang, Ning-Ning; Tzeng, Wen-Jer

2008-01-01

Because all the cell populations are capable of making switches between different genetic expression states in response to the environmental change, Thattai and van Oudenaarden (Genetics 167, 523-530, 2004) have raised a very interesting question: In a constantly fluctuating environment, which type of cell population (heterogeneous or homogeneous) is fitter in the long term? This problem is very important to development and evolution biology. We thus take an extensive analysis about how the cell population evolves in a periodically switching environment either with symmetrical time-span or asymmetrical time-span. A complete picture of the phase diagrams for both cases is obtained. Furthermore, we find that the systems with time-dependent cellular transitions all collapse to the same set of dynamical equations with the modified parameters. Furthermore, we also explain in detail how the fitness problem bears much resemblance to the phenomenon, stochastic resonance, in physical sciences. Our results could be helpful for the biologists to design artificial evolution experiments and unveil the mystery of development and evolution.

Healthy Gaming – Video Game Design to promote Health

PubMed Central

Brox, E.; Fernandez-Luque, L.; Tøllefsen, T.

2011-01-01

Background There is an increasing interest in health games including simulation tools, games for specific conditions, persuasive games to promote a healthy life style or exergames where physical exercise is used to control the game. Objective The objective of the article is to review current literature about available health games and the impact related to game design principles as well as some educational theory aspects. Methods Literature from the big databases and known sites with games for health has been searched to find articles about games for health purposes. The focus has been on educational games, persuasive games and exergames as well as articles describing game design principles. Results The medical objectives can either be a part of the game theme (intrinsic) or be totally dispatched (extrinsic), and particularly persuasive games seem to use extrinsic game design. Peer support is important, but there is only limited research on multiplayer health games. Evaluation of health games can be both medical and technical, and the focus will depend on the game purpose. Conclusion There is still not enough evidence to conclude which design principles work for what purposes since most of the literature in health serious games does not specify design methodologies, but it seems that extrinsic methods work in persuasion. However, when designing health care games it is important to define both the target group and main objective, and then design a game accordingly using sound game design principles, but also utilizing design elements to enhance learning and persuasion. A collaboration with health professionals from an early design stage is necessary both to ensure that the content is valid and to have the game validated from a clinical viewpoint. Patients need to be involved, especially to improve usability. More research should be done on social aspects in health games, both related to learning and persuasion. PMID:23616865

Serious Games: Video Games for Good?

ERIC Educational Resources Information Center

Sanford, Kathy; Starr, Lisa J.; Merkel, Liz; Bonsor Kurki, Sarah

2015-01-01

As video games become a ubiquitous part of today's culture internationally, as educators and parents we need to turn our attention to how video games are being understood and used in informal and formal settings. Serious games have developed as a genre of video games marketed for educating youth about a range of world issues. At face value this…

Towards sub-optimal stochastic control of partially observable stochastic systems

NASA Technical Reports Server (NTRS)

Ruzicka, G. J.

1980-01-01

A class of multidimensional stochastic control problems with noisy data and bounded controls encountered in aerospace design is examined. The emphasis is on suboptimal design, the optimality being taken in quadratic mean sense. To that effect the problem is viewed as a stochastic version of the Lurie problem known from nonlinear control theory. The main result is a separation theorem (involving a nonlinear Kalman-like filter) suitable for Lurie-type approximations. The theorem allows for discontinuous characteristics. As a byproduct the existence of strong solutions to a class of non-Lipschitzian stochastic differential equations in dimensions is proven.

Distributed Synchronization in Networks of Agent Systems With Nonlinearities and Random Switchings.

PubMed

Tang, Yang; Gao, Huijun; Zou, Wei; Kurths, Jürgen

2013-02-01

In this paper, the distributed synchronization problem of networks of agent systems with controllers and nonlinearities subject to Bernoulli switchings is investigated. Controllers and adaptive updating laws injected in each vertex of networks depend on the state information of its neighborhood. Three sets of Bernoulli stochastic variables are introduced to describe the occurrence probabilities of distributed adaptive controllers, updating laws and nonlinearities, respectively. By the Lyapunov functions method, we show that the distributed synchronization of networks composed of agent systems with multiple randomly occurring nonlinearities, multiple randomly occurring controllers, and multiple randomly occurring updating laws can be achieved in mean square under certain criteria. The conditions derived in this paper can be solved by semi-definite programming. Moreover, by mathematical analysis, we find that the coupling strength, the probabilities of the Bernoulli stochastic variables, and the form of nonlinearities have great impacts on the convergence speed and the terminal control strength. The synchronization criteria and the observed phenomena are demonstrated by several numerical simulation examples. In addition, the advantage of distributed adaptive controllers over conventional adaptive controllers is illustrated.

Evolution of fairness in the one-shot anonymous Ultimatum Game

PubMed Central

Rand, David G.; Tarnita, Corina E.; Ohtsuki, Hisashi; Nowak, Martin A.

2013-01-01

Classical economic models assume that people are fully rational and selfish, while experiments often point to different conclusions. A canonical example is the Ultimatum Game: one player proposes a division of a sum of money between herself and a second player, who either accepts or rejects. Based on rational self-interest, responders should accept any nonzero offer and proposers should offer the smallest possible amount. Traditional, deterministic models of evolutionary game theory agree: in the one-shot anonymous Ultimatum Game, natural selection favors low offers and demands. Experiments instead show a preference for fairness: often responders reject low offers and proposers make higher offers than needed to avoid rejection. Here we show that using stochastic evolutionary game theory, where agents make mistakes when judging the payoffs and strategies of others, natural selection favors fairness. Across a range of parameters, the average strategy matches the observed behavior: proposers offer between 30% and 50%, and responders demand between 25% and 40%. Rejecting low offers increases relative payoff in pairwise competition between two strategies and is favored when selection is sufficiently weak. Offering more than you demand increases payoff when many strategies are present simultaneously and is favored when mutation is sufficiently high. We also perform a behavioral experiment and find empirical support for these theoretical findings: uncertainty about the success of others is associated with higher demands and offers; and inconsistency in the behavior of others is associated with higher offers but not predictive of demands. In an uncertain world, fairness finishes first. PMID:23341593

Evolution of fairness in the one-shot anonymous Ultimatum Game.

PubMed

Rand, David G; Tarnita, Corina E; Ohtsuki, Hisashi; Nowak, Martin A

2013-02-12

Classical economic models assume that people are fully rational and selfish, while experiments often point to different conclusions. A canonical example is the Ultimatum Game: one player proposes a division of a sum of money between herself and a second player, who either accepts or rejects. Based on rational self-interest, responders should accept any nonzero offer and proposers should offer the smallest possible amount. Traditional, deterministic models of evolutionary game theory agree: in the one-shot anonymous Ultimatum Game, natural selection favors low offers and demands. Experiments instead show a preference for fairness: often responders reject low offers and proposers make higher offers than needed to avoid rejection. Here we show that using stochastic evolutionary game theory, where agents make mistakes when judging the payoffs and strategies of others, natural selection favors fairness. Across a range of parameters, the average strategy matches the observed behavior: proposers offer between 30% and 50%, and responders demand between 25% and 40%. Rejecting low offers increases relative payoff in pairwise competition between two strategies and is favored when selection is sufficiently weak. Offering more than you demand increases payoff when many strategies are present simultaneously and is favored when mutation is sufficiently high. We also perform a behavioral experiment and find empirical support for these theoretical findings: uncertainty about the success of others is associated with higher demands and offers; and inconsistency in the behavior of others is associated with higher offers but not predictive of demands. In an uncertain world, fairness finishes first.

Phenotypic switching in bacteria

NASA Astrophysics Data System (ADS)

Merrin, Jack

Living matter is a non-equilibrium system in which many components work in parallel to perpetuate themselves through a fluctuating environment. Physiological states or functionalities revealed by a particular environment are called phenotypes. Transitions between phenotypes may occur either spontaneously or via interaction with the environment. Even in the same environment, genetically identical bacteria can exhibit different phenotypes of a continuous or discrete nature. In this thesis, we pursued three lines of investigation into discrete phenotypic heterogeneity in bacterial populations: the quantitative characterization of the so-called bacterial persistence, a theoretical model of phenotypic switching based on those measurements, and the design of artificial genetic networks which implement this model. Persistence is the phenotype of a subpopulation of bacteria with a reduced sensitivity to antibiotics. We developed a microfluidic apparatus, which allowed us to monitor the growth rates of individual cells while applying repeated cycles of antibiotic treatments. We were able to identify distinct phenotypes (normal and persistent) and characterize the stochastic transitions between them. We also found that phenotypic heterogeneity was present prior to any environmental cue such as antibiotic exposure. Motivated by the experiments with persisters, we formulated a theoretical model describing the dynamic behavior of several discrete phenotypes in a periodically varying environment. This theoretical framework allowed us to quantitatively predict the fitness of dynamic populations and to compare survival strategies according to environmental time-symmetries. These calculations suggested that persistence is a strategy used by bacterial populations to adapt to fluctuating environments. Knowledge of the phenotypic transition rates for persistence may provide statistical information about the typical environments of bacteria. We also describe a design of artificial

A Multistate Toggle Switch Defines Fungal Cell Fates and Is Regulated by Synergistic Genetic Cues

PubMed Central

Anderson, Matthew Z.; Porman, Allison M.; Wang, Na; Mancera, Eugenio; Bennett, Richard J.

2016-01-01

Heritable epigenetic changes underlie the ability of cells to differentiate into distinct cell types. Here, we demonstrate that the fungal pathogen Candida tropicalis exhibits multipotency, undergoing stochastic and reversible switching between three cellular states. The three cell states exhibit unique cellular morphologies, growth rates, and global gene expression profiles. Genetic analysis identified six transcription factors that play key roles in regulating cell differentiation. In particular, we show that forced expression of Wor1 or Efg1 transcription factors can be used to manipulate transitions between all three cell states. A model for tristability is proposed in which Wor1 and Efg1 are self-activating but mutually antagonistic transcription factors, thereby forming a symmetrical self-activating toggle switch. We explicitly test this model and show that ectopic expression of WOR1 can induce white-to-hybrid-to-opaque switching, whereas ectopic expression of EFG1 drives switching in the opposite direction, from opaque-to-hybrid-to-white cell states. We also address the stability of induced cell states and demonstrate that stable differentiation events require ectopic gene expression in combination with chromatin-based cues. These studies therefore experimentally test a model of multistate stability and demonstrate that transcriptional circuits act synergistically with chromatin-based changes to drive cell state transitions. We also establish close mechanistic parallels between phenotypic switching in unicellular fungi and cell fate decisions during stem cell reprogramming. PMID:27711197

An analysis of switching and non-switching slot machine player behaviour.

PubMed

Coates, Ewan; Blaszczynski, Alex

2013-12-01

Learning theory predicts that, given the repeated choice to bet between two concurrently available slot machines, gamblers will learn to bet more money on the machine with higher expected return (payback percentage) or higher win probability per spin (volatility). The purpose of this study was to investigate whether this occurs when the two machines vary orthogonally on payback percentage and volatility. The sample comprised 52 first year psychology students (mean age = 20.3 years, 20 females, 32 males) who had played a gaming machine at least once in the previous 12 months. Participants were administered a battery of questionnaires designed to assess level of knowledge on the characteristics and operation of poker machines, frequency of poker machine play in the past 12 months, personality traits of impulsivity and capacity for cognitive reflection, and gambling beliefs. For the experimental task, participants were instructed to play on two PC-simulated electronic gaming machines (EGMs or slot machines) that differed on payback percentage and volatility, with the option of freely switching between EGMs after a practice phase. Results indicated that participants were able to easily discriminate between machines and manifested a preference to play machines offering higher payback or volatility. These findings diverged from previous findings of no preference for play on higher payback/volatility machines, potentially due to of the current study's absence of the option to make multi-line and multi-credit bets. It was concluded that return rate parameters like payback percentage and volatility strongly influenced slot machine preference in the absence of betting options like multi-line bets, though more research is needed to determine the effects of such betting options on player distribution of money between multiple EGMs.

Study of optoelectronic switch for satellite-switched time-division multiple access

NASA Technical Reports Server (NTRS)

Su, Shing-Fong; Jou, Liz; Lenart, Joe

1987-01-01

The use of optoelectronic switching for satellite switched time division multiple access will improve the isolation and reduce the crosstalk of an IF switch matrix. The results are presented of a study on optoelectronic switching. Tasks include literature search, system requirements study, candidate switching architecture analysis, and switch model optimization. The results show that the power divided and crossbar switching architectures are good candidates for an IF switch matrix.

Efficient analysis of stochastic gene dynamics in the non-adiabatic regime using piecewise deterministic Markov processes

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lin, Yen Ting; Buchler, Nicolas E.

Single-cell experiments show that gene expression is stochastic and bursty, a feature that can emerge from slow switching between promoter states with different activities. In addition to slow chromatin and/or DNA looping dynamics, one source of long-lived promoter states is the slow binding and unbinding kinetics of transcription factors to promoters, i.e. the non-adiabatic binding regime. Here, we introduce a simple analytical framework, known as a piecewise deterministic Markov process (PDMP), that accurately describes the stochastic dynamics of gene expression in the non-adiabatic regime. We illustrate the utility of the PDMP on a non-trivial dynamical system by analysing the propertiesmore » of a titration-based oscillator in the non-adiabatic limit. We first show how to transform the underlying chemical master equation into a PDMP where the slow transitions between promoter states are stochastic, but whose rates depend upon the faster deterministic dynamics of the transcription factors regulated by these promoters. We show that the PDMP accurately describes the observed periods of stochastic cycles in activator and repressor-based titration oscillators. We then generalize our PDMP analysis to more complicated versions of titration-based oscillators to explain how multiple binding sites lengthen the period and improve coherence. Finally, we show how noise-induced oscillation previously observed in a titration-based oscillator arises from non-adiabatic and discrete binding events at the promoter site.« less

Efficient analysis of stochastic gene dynamics in the non-adiabatic regime using piecewise deterministic Markov processes

DOE PAGES

Lin, Yen Ting; Buchler, Nicolas E.

2018-01-31

Single-cell experiments show that gene expression is stochastic and bursty, a feature that can emerge from slow switching between promoter states with different activities. In addition to slow chromatin and/or DNA looping dynamics, one source of long-lived promoter states is the slow binding and unbinding kinetics of transcription factors to promoters, i.e. the non-adiabatic binding regime. Here, we introduce a simple analytical framework, known as a piecewise deterministic Markov process (PDMP), that accurately describes the stochastic dynamics of gene expression in the non-adiabatic regime. We illustrate the utility of the PDMP on a non-trivial dynamical system by analysing the propertiesmore » of a titration-based oscillator in the non-adiabatic limit. We first show how to transform the underlying chemical master equation into a PDMP where the slow transitions between promoter states are stochastic, but whose rates depend upon the faster deterministic dynamics of the transcription factors regulated by these promoters. We show that the PDMP accurately describes the observed periods of stochastic cycles in activator and repressor-based titration oscillators. We then generalize our PDMP analysis to more complicated versions of titration-based oscillators to explain how multiple binding sites lengthen the period and improve coherence. Finally, we show how noise-induced oscillation previously observed in a titration-based oscillator arises from non-adiabatic and discrete binding events at the promoter site.« less

Defining and Leveraging Game Qualities for Serious Games

NASA Technical Reports Server (NTRS)

Martin, Michael W.; Shen, Yuzhong

2011-01-01

Serious games can and should leverage the unique qualities of video games to effectively deliver educational experiences for the learners. However, leveraging these qualities is incumbent upon understanding what these unique 'game' qualities are , and how they can facilitate the learning process. This paper presents an examination of the meaning of the term 'game' . as it applies to both serious games and digital entertainment games. Through the examination of counter examples, we derive three game characteristics; games are self contained, provide a variety of meaningful choices, and are intrinsically compelling. We also discuss the theoretical educational foundations which support the application of these 'game qualities' to educational endeavors. This paper concludes with a presentation of results achieved through the application of these qualities and the applicable educational theories to teach learners about the periodic table of elements via a serious game developed by the authors.

49 CFR 218.103 - Hand-operated switches, including crossover switches.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 49 Transportation 4 2013-10-01 2013-10-01 false Hand-operated switches, including crossover switches. 218.103 Section 218.103 Transportation Other Regulations Relating to Transportation (Continued... Equipment, Switches, and Fixed Derails § 218.103 Hand-operated switches, including crossover switches. (a)(1...

49 CFR 218.103 - Hand-operated switches, including crossover switches.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 49 Transportation 4 2012-10-01 2012-10-01 false Hand-operated switches, including crossover switches. 218.103 Section 218.103 Transportation Other Regulations Relating to Transportation (Continued... Equipment, Switches, and Fixed Derails § 218.103 Hand-operated switches, including crossover switches. (a)(1...

49 CFR 218.103 - Hand-operated switches, including crossover switches.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 49 Transportation 4 2014-10-01 2014-10-01 false Hand-operated switches, including crossover switches. 218.103 Section 218.103 Transportation Other Regulations Relating to Transportation (Continued... Equipment, Switches, and Fixed Derails § 218.103 Hand-operated switches, including crossover switches. (a)(1...

49 CFR 218.103 - Hand-operated switches, including crossover switches.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 49 Transportation 4 2011-10-01 2011-10-01 false Hand-operated switches, including crossover switches. 218.103 Section 218.103 Transportation Other Regulations Relating to Transportation (Continued... Equipment, Switches, and Fixed Derails § 218.103 Hand-operated switches, including crossover switches. (a)(1...

49 CFR 218.103 - Hand-operated switches, including crossover switches.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 49 Transportation 4 2010-10-01 2010-10-01 false Hand-operated switches, including crossover switches. 218.103 Section 218.103 Transportation Other Regulations Relating to Transportation (Continued... Equipment, Switches, and Fixed Derails § 218.103 Hand-operated switches, including crossover switches. (a)(1...

The Hawk-Dove game in phenotypically homogeneous and heterogeneous populations of finite dimension

NASA Astrophysics Data System (ADS)

Laruelle, Annick; da Silva Rocha, André Barreira; Escobedo, Ramón

2018-02-01

The Hawk-Dove game played between individuals in populations of finite dimension is analyzed by means of a stochastic model. We take into account both cases when all individuals in the population are either phenotypically homogeneous or heterogeneous. A strategy in the model is a gene representing the probability of playing the Hawk strategy. Individual interactions at the microscopic level are described by a genetic algorithm where evolution results from the interplay among selection, mutation, drift and cross-over of genes. We show that the behavioral patterns observed at the macroscopic level can be reproduced as the emergent result of individual interactions governed by the rules of the Hawk-Dove game at the microscopic level. We study how the results of the genetic algorithm compare with those obtained in evolutionary game theory, finding that, although genes continuously change both their presence and frequency in the population over time, the population average behavior always achieves stationarity and, when this happens, the final average strategy played in the population oscillates around the evolutionarily stable strategy in the homogeneous population case or the neutrally stable set in the heterogeneous population case.

Ultimate open pit stochastic optimization

NASA Astrophysics Data System (ADS)

Marcotte, Denis; Caron, Josiane

2013-02-01

Classical open pit optimization (maximum closure problem) is made on block estimates, without directly considering the block grades uncertainty. We propose an alternative approach of stochastic optimization. The stochastic optimization is taken as the optimal pit computed on the block expected profits, rather than expected grades, computed from a series of conditional simulations. The stochastic optimization generates, by construction, larger ore and waste tonnages than the classical optimization. Contrary to the classical approach, the stochastic optimization is conditionally unbiased for the realized profit given the predicted profit. A series of simulated deposits with different variograms are used to compare the stochastic approach, the classical approach and the simulated approach that maximizes expected profit among simulated designs. Profits obtained with the stochastic optimization are generally larger than the classical or simulated pit. The main factor controlling the relative gain of stochastic optimization compared to classical approach and simulated pit is shown to be the information level as measured by the boreholes spacing/range ratio. The relative gains of the stochastic approach over the classical approach increase with the treatment costs but decrease with mining costs. The relative gains of the stochastic approach over the simulated pit approach increase both with the treatment and mining costs. At early stages of an open pit project, when uncertainty is large, the stochastic optimization approach appears preferable to the classical approach or the simulated pit approach for fair comparison of the values of alternative projects and for the initial design and planning of the open pit.

Optically-switched submillimeter-wave oscillator and radiator having a switch-to-switch propagation delay

NASA Technical Reports Server (NTRS)

Spencer, Michael G. (Inventor); Maserjian, Joseph (Inventor)

1995-01-01

A submillimeter wave-generating integrated circuit includes an array of N photoconductive switches biased across a common voltage source and an optical path difference from a common optical pulse of repetition rate f sub 0 providing a different optical delay to each of the switches. In one embodiment, each incoming pulse is applied to successive ones of the N switches with successive delays. The N switches are spaced apart with a suitable switch-to-switch spacing so as to generate at the output load or antenna radiation of a submillimeter wave frequency f on the order of N f sub 0. Preferably, the optical pulse has a repetition rate of at least 10 GHz and N is of the order of 100, so that the circuit generates radiation of frequency of the order of or greater than 1 Terahertz.

Switching control of an R/C hovercraft: stabilization and smooth switching.

PubMed

Tanaka, K; Iwasaki, M; Wang, H O

2001-01-01

This paper presents stable switching control of an radio-controlled (R/C) hovercraft that is a nonholonomic (nonlinear) system. To exactly represent its nonlinear dynamics, more importantly, to maintain controllability of the system, we newly propose a switching fuzzy model that has locally Takagi-Sugeno (T-S) fuzzy models and switches them according to states, external variables, and/or time. A switching fuzzy controller is constructed by mirroring the rule structure of the switching fuzzy model of an R/C hovercraft. We derive linear matrix inequality (LMI) conditions for ensuring the stability of the closed-loop system consisting of a switching fuzzy model and controller. Furthermore, to guarantee smooth switching of control input at switching boundaries, we also derive a smooth switching condition represented in terms of LMIs. A stable switching fuzzy controller satisfying the smooth switching condition is designed by simultaneously solving both of the LMIs. The simulation and experimental results for the trajectory control of an R/C hovercraft show the validity of the switching fuzzy model and controller design, particularly, the smooth switching condition.

Sparse Zero-Sum Games as Stable Functional Feature Selection

PubMed Central

Sokolovska, Nataliya; Teytaud, Olivier; Rizkalla, Salwa; Clément, Karine; Zucker, Jean-Daniel

2015-01-01

In large-scale systems biology applications, features are structured in hidden functional categories whose predictive power is identical. Feature selection, therefore, can lead not only to a problem with a reduced dimensionality, but also reveal some knowledge on functional classes of variables. In this contribution, we propose a framework based on a sparse zero-sum game which performs a stable functional feature selection. In particular, the approach is based on feature subsets ranking by a thresholding stochastic bandit. We provide a theoretical analysis of the introduced algorithm. We illustrate by experiments on both synthetic and real complex data that the proposed method is competitive from the predictive and stability viewpoints. PMID:26325268

Stochastic computing with biomolecular automata

PubMed Central

Adar, Rivka; Benenson, Yaakov; Linshiz, Gregory; Rosner, Amit; Tishby, Naftali; Shapiro, Ehud

2004-01-01

Stochastic computing has a broad range of applications, yet electronic computers realize its basic step, stochastic choice between alternative computation paths, in a cumbersome way. Biomolecular computers use a different computational paradigm and hence afford novel designs. We constructed a stochastic molecular automaton in which stochastic choice is realized by means of competition between alternative biochemical pathways, and choice probabilities are programmed by the relative molar concentrations of the software molecules coding for the alternatives. Programmable and autonomous stochastic molecular automata have been shown to perform direct analysis of disease-related molecular indicators in vitro and may have the potential to provide in situ medical diagnosis and cure. PMID:15215499

Exploring Game Experiences and Game Leadership in Massively Multiplayer Online Role-Playing Games

ERIC Educational Resources Information Center

Jang, YeiBeech; Ryu, SeoungHo

2011-01-01

This study explored the in-game experiences of massively multiplayer online role-playing game (MMORPG) players focusing on game leadership and offline leadership. MMORPGs have enormous potential to provide gameplayers with rich social experiences through various interactions along with social activities such as joining a game community, team play…

Gaming Increases Craving to Gaming-Related Stimuli in Individuals With Internet Gaming Disorder.

PubMed

Dong, Guangheng; Wang, Lingxiao; Du, Xiaoxia; Potenza, Marc N

2017-07-01

Internet gaming disorder (IGD) has been proposed as a behavioral addiction warranting additional investigation. Craving is considered a core component of addictions. However, few studies to date have investigated craving in IGD. In the current study, we investigated how gaming was associated with changes in response to gaming-related stimuli in subjects with IGD and those with recreational game use (RGU). Behavioral and functional magnetic resonance imaging data were collected from 27 individuals with IGD and 43 individuals with RGU. Subjects' craving responses to gaming-related stimuli were measured before and after 30 minutes of gaming. The comparison between post- and pregaming measures showed that for IGD, gaming was associated with increased craving and increased brain activation of the lateral and prefrontal cortex, the striatum, and the precuneus when exposed to gaming-related stimuli. In individuals with RGU, no enhanced brain activity was observed. These results suggest that gaming behavior enhances craving responses in subjects with IGD but not in subjects with RGU, provide insight into potential mechanisms underlying IGD, and suggest behavioral and neurobiological targets for IGD-related interventions. Copyright © 2017 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Games in Geography.

ERIC Educational Resources Information Center

Walford, Rex

Six games designed for classroom use are described in this book: 1) Shopping Game; 2) Bus Service Game; 3) North Sea Gas Game; 4) Railway Pioneers Game; 5) Development Game; and 6) Export Drive Game. The description of each game comprises a separate chapter, and includes information about the general aims of the game, how the various game elements…

Inverse Proportional Relationship Between Switching-Time Length and Fractal-Like Structure for Continuous Tracking Movement

NASA Astrophysics Data System (ADS)

Hirakawa, Takehito; Suzuki, Hiroo; Gohara, Kazutoshi; Yamamoto, Yuji

We investigate the relationship between the switching-time length T and the fractal-like feature that characterizes the behavior of dissipative dynamical systems excited by external temporal inputs for tracking movement. Seven healthy right-handed male participants were asked to continuously track light-emitting diodes that were located on the right and left sides in front of them. These movements were performed under two conditions: when the same input pattern was repeated (the periodic-input condition) and when two different input patterns were switched stochastically (the switching-input condition). The repeated time lengths of input patterns during these conditions were 2.00, 1.00, 0.75, 0.50, 0.35, and 0.25s. The movements of a lever held between a participant’s thumb and index finger were measured by a motion-capture system and were analyzed with respect to position and velocity. The condition in which the same input was repeated revealed that two different stable trajectories existed in a cylindrical state space, while the condition in which the inputs were switched induced transitions between these two trajectories. These two different trajectories were considered as excited attractors. The transitions between the two excited attractors produced eight trajectories; they were then characterized by a fractal-like feature as a third-order sequence effect. Moreover, correlation dimensions, which are typically used to evaluate fractal-like features, calculated from the set on the Poincaré section increased as the switching-time length T decreased. These results suggest that an inverse proportional relationship exists between the switching-time length T and the fractal-like feature of human movement.

Resource Allocation Games: A Priming Game for a Series of Instructional Games (The POE Game).

ERIC Educational Resources Information Center

Allen, Layman E.

This paper describes in detail the paper-and-pencil POE (Pelham Odd 'R Even) game, in which units of space are the allocated resources. The game is designed to provide an introduction to the rule structure common to the games of EQUATIONS, WFF 'N PROOF, and ON-SENTS & NON-SENTS. Techniques of playing POE, including goals, solutions, moves, scoring…

Patterns of patterns of synchronization: Noise induced attractor switching in rings of coupled nonlinear oscillators

DOE Office of Scientific and Technical Information (OSTI.GOV)

Emenheiser, Jeffrey; Department of Physics, University of California, Davis, California 95616; Chapman, Airlie

Following the long-lived qualitative-dynamics tradition of explaining behavior in complex systems via the architecture of their attractors and basins, we investigate the patterns of switching between distinct trajectories in a network of synchronized oscillators. Our system, consisting of nonlinear amplitude-phase oscillators arranged in a ring topology with reactive nearest-neighbor coupling, is simple and connects directly to experimental realizations. We seek to understand how the multiple stable synchronized states connect to each other in state space by applying Gaussian white noise to each of the oscillators' phases. To do this, we first analytically identify a set of locally stable limit cyclesmore » at any given coupling strength. For each of these attracting states, we analyze the effect of weak noise via the covariance matrix of deviations around those attractors. We then explore the noise-induced attractor switching behavior via numerical investigations. For a ring of three oscillators, we find that an attractor-switching event is always accompanied by the crossing of two adjacent oscillators' phases. For larger numbers of oscillators, we find that the distribution of times required to stochastically leave a given state falls off exponentially, and we build an attractor switching network out of the destination states as a coarse-grained description of the high-dimensional attractor-basin architecture.« less

Learning to multitask: effects of video game practice on electrophysiological indices of attention and resource allocation.

PubMed

Maclin, Edward L; Mathewson, Kyle E; Low, Kathy A; Boot, Walter R; Kramer, Arthur F; Fabiani, Monica; Gratton, Gabriele

2011-09-01

Changes in attention allocation with complex task learning reflect processing automatization and more efficient control. We studied these changes using ERP and EEG spectral analyses in subjects playing Space Fortress, a complex video game comprising standard cognitive task components. We hypothesized that training would free up attentional resources for a secondary auditory oddball task. Both P3 and delta EEG showed a processing trade-off between game and oddball tasks, but only some game events showed reduced attention requirements with practice. Training magnified a transient increase in alpha power following both primary and secondary task events. This contrasted with alpha suppression observed when the oddball task was performed alone, suggesting that alpha may be related to attention switching. Hence, P3 and EEG spectral data are differentially sensitive to changes in attentional processing occurring with complex task training. Copyright © 2011 Society for Psychophysiological Research.

Melioration behaviour in the Harvard game is reduced by simplifying decision outcomes.

PubMed

Stillwell, David J; Tunney, Richard J

2009-11-01

Self-control experiments have previously been highlighted as examples of suboptimal decision making. In one such experiment, the Harvard game, participants make repeated choices between two alternatives. One alternative has a higher immediate pay-off than the other, but with repeated choices results in a lower overall pay-off. Preference for the alternative with the higher immediate pay-off seems to be impulsive and will result in a failure to maximize pay-offs. We report an experiment that modifies the Harvard game, dividing the pay-off from each choice into two separate consequences-the immediate and the historic components. Choosing the alternative with the higher immediate pay-off ends the session prematurely, leading to a loss of opportunities to earn further pay-offs and ultimately to a reduced overall pay-off. This makes it easier for participants to learn the outcomes of their actions. It also provides the opportunity for a further test of normative decision making by means of one of its most specific and paradoxical predictions-that the truly rational agent should switch from self-control to impulsivity toward the end of the experimental sessions. The finding that participants maximize their expected utility by both overcoming impulsivity and learning to switch implies that melioration behaviour is not due to the lure of impulsivity, but due to the difficulty of learning which components are included in the pay-off schedules.

2–stage stochastic Runge–Kutta for stochastic delay differential equations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rosli, Norhayati; Jusoh Awang, Rahimah; Bahar, Arifah

2015-05-15

This paper proposes a newly developed one-step derivative-free method, that is 2-stage stochastic Runge-Kutta (SRK2) to approximate the solution of stochastic delay differential equations (SDDEs) with a constant time lag, r > 0. General formulation of stochastic Runge-Kutta for SDDEs is introduced and Stratonovich Taylor series expansion for numerical solution of SRK2 is presented. Local truncation error of SRK2 is measured by comparing the Stratonovich Taylor expansion of the exact solution with the computed solution. Numerical experiment is performed to assure the validity of the method in simulating the strong solution of SDDEs.

Exciter switch

NASA Technical Reports Server (NTRS)

Mcpeak, W. L.

1975-01-01

A new exciter switch assembly has been installed at the three DSN 64-m deep space stations. This assembly provides for switching Block III and Block IV exciters to either the high-power or 20-kW transmitters in either dual-carrier or single-carrier mode. In the dual-carrier mode, it provides for balancing the two drive signals from a single control panel located in the transmitter local control and remote control consoles. In addition to the improved switching capabilities, extensive monitoring of both the exciter switch assembly and Transmitter Subsystem is provided by the exciter switch monitor and display assemblies.

Stochastic Convection Parameterizations

NASA Technical Reports Server (NTRS)

Teixeira, Joao; Reynolds, Carolyn; Suselj, Kay; Matheou, Georgios

2012-01-01

computational fluid dynamics, radiation, clouds, turbulence, convection, gravity waves, surface interaction, radiation interaction, cloud and aerosol microphysics, complexity (vegetation, biogeochemistry, radiation versus turbulence/convection stochastic approach, non-linearities, Monte Carlo, high resolutions, large-Eddy Simulations, cloud structure, plumes, saturation in tropics, forecasting, parameterizations, stochastic, radiation-clod interaction, hurricane forecasts

Gaming is related to enhanced working memory performance and task-related cortical activity.

PubMed

Moisala, M; Salmela, V; Hietajärvi, L; Carlson, S; Vuontela, V; Lonka, K; Hakkarainen, K; Salmela-Aro, K; Alho, K

2017-01-15

Gaming experience has been suggested to lead to performance enhancements in a wide variety of working memory tasks. Previous studies have, however, mostly focused on adult expert gamers and have not included measurements of both behavioral performance and brain activity. In the current study, 167 adolescents and young adults (aged 13-24 years) with different amounts of gaming experience performed an n-back working memory task with vowels, with the sensory modality of the vowel stream switching between audition and vision at random intervals. We studied the relationship between self-reported daily gaming activity, working memory (n-back) task performance and related brain activity measured using functional magnetic resonance imaging (fMRI). The results revealed that the extent of daily gaming activity was related to enhancements in both performance accuracy and speed during the most demanding (2-back) level of the working memory task. This improved working memory performance was accompanied by enhanced recruitment of a fronto-parietal cortical network, especially the dorsolateral prefrontal cortex. In contrast, during the less demanding (1-back) level of the task, gaming was associated with decreased activity in the same cortical regions. Our results suggest that a greater degree of daily gaming experience is associated with better working memory functioning and task difficulty-dependent modulation in fronto-parietal brain activity already in adolescence and even when non-expert gamers are studied. The direction of causality within this association cannot be inferred with certainty due to the correlational nature of the current study. Copyright © 2016 Elsevier B.V. All rights reserved.

Technology consumption and cognitive control: Contrasting action video game experience with media multitasking.

PubMed

Cardoso-Leite, Pedro; Kludt, Rachel; Vignola, Gianluca; Ma, Wei Ji; Green, C Shawn; Bavelier, Daphne

2016-01-01

Technology has the potential to impact cognition in many ways. Here we contrast two forms of technology usage: (1) media multitasking (i.e., the simultaneous consumption of multiple streams of media, such a texting while watching TV) and (2) playing action video games (a particular subtype of video games). Previous work has outlined an association between high levels of media multitasking and specific deficits in handling distracting information, whereas playing action video games has been associated with enhanced attentional control. Because these two factors are linked with reasonably opposing effects, failing to take them jointly into account may result in inappropriate conclusions as to the impacts of technology use on attention. Across four tasks (AX-continuous performance, N-back, task-switching, and filter tasks), testing different aspects of attention and cognition, we showed that heavy media multitaskers perform worse than light media multitaskers. Contrary to previous reports, though, the performance deficit was not specifically tied to distractors, but was instead more global in nature. Interestingly, participants with intermediate levels of media multitasking sometimes performed better than both light and heavy media multitaskers, suggesting that the effects of increasing media multitasking are not monotonic. Action video game players, as expected, outperformed non-video-game players on all tasks. However, surprisingly, this was true only for participants with intermediate levels of media multitasking, suggesting that playing action video games does not protect against the deleterious effect of heavy media multitasking. Taken together, these findings show that media consumption can have complex and counterintuitive effects on attentional control.

Technology consumption and cognitive control: Contrasting action video game experience with media multitasking

PubMed Central

Cardoso-Leite, Pedro; Kludt, Rachel; Vignola, Gianluca; Ma, Wei Ji; Green, C. Shawn; Bavelier, Daphne

2015-01-01

Technology has the potential to impact cognition in many ways. Here we contrast two forms of technology usage: 1) media multitasking (i.e., the simultaneous consumption of multiple streams of media, such a texting while watching TV) and 2) playing action video games (a particular sub-type of video game). Previous work has outlined an association between high levels of media multitasking and specific deficits in handling distracting information, while playing action video games has been associated with enhanced attentional control. As these two factors are linked with reasonably opposing effects, failing to take them jointly into account may result in inappropriate conclusions as to the impact of technology use on attention. Across four experiments (AX-CPT, N-back, Task-switching and Filter task), testing different aspects of attention and cognition, we show that heavy media multitaskers perform worse than light media multitaskers. Contrary to previous reports though, the performance deficit was not specifically tied to distractors, but was instead more global in nature. Interestingly, participants with intermediate levels of media multitasking occasionally performed better than both light and heavy media multitaskers suggesting that the effects of increasing media multitasking are not monotonic. Action video game players, as expected, outperformed non-video game players on all tasks. However, surprisingly this was true only for participants with intermediate levels of media multitasking, suggesting that playing action video games does not protect against the deleterious effect of heavy media multitasking. Taken together this study shows that media consumption can have complex and counter-intuitive effects on attentional control. PMID:26474982

Coordinating a Supply Chain with Price and Advertisement Dependent Stochastic Demand

PubMed Central

Li, Liying; Wang, Yong; Yan, Xiaoming

2013-01-01

This paper investigates pricing and ordering as well as advertising coordination issues in a single-manufacturer single-retailer supply chain, where the manufacturer sells a newsvendor-type product through the retailer who faces a stochastic demand depending on both retail price and advertising expenditure. Under the assumption that the market demand has a multiplicative functional form, the Stackelberg and cooperative game models are developed, and the closed form solution to each model is provided as well. Comparisons and insights are presented. We show that a properly designed revenue-cost-sharing contract can achieve supply chain coordination and lead to a Pareto improving win-win situation for channel members. We also discuss the allocation of the extra joint profit according to individual supply chain members' risk preferences and negotiating powers. PMID:24453832

Coordinating a supply chain with price and advertisement dependent stochastic demand.

PubMed

Li, Liying; Wang, Yong; Yan, Xiaoming

2013-01-01

This paper investigates pricing and ordering as well as advertising coordination issues in a single-manufacturer single-retailer supply chain, where the manufacturer sells a newsvendor-type product through the retailer who faces a stochastic demand depending on both retail price and advertising expenditure. Under the assumption that the market demand has a multiplicative functional form, the Stackelberg and cooperative game models are developed, and the closed form solution to each model is provided as well. Comparisons and insights are presented. We show that a properly designed revenue-cost-sharing contract can achieve supply chain coordination and lead to a Pareto improving win-win situation for channel members. We also discuss the allocation of the extra joint profit according to individual supply chain members' risk preferences and negotiating powers.

Navajo Games.

ERIC Educational Resources Information Center

Cliff, Janet M.

1990-01-01

Reviews 163 sources on Navajo games, play, and toys. Includes an annotated bibliography of those materials. Examines relationships between games and religion, origin myths, and ceremonies. Discusses attitudes toward games, gambling, and cheating; and the dichotomy between children's and adults' games. Describes specific toys, games, and play…

Stochastic cooperative advertising in a manufacturer-retailer decentralized supply channel

NASA Astrophysics Data System (ADS)

Ezimadu, Peter E.; Nwozo, Chukwuma R.

2017-03-01

This work considers cooperative advertising in a manufacturer-retailer supply chain. While the manufacturer is the Stackelberg leader, the retailer is the follower. Using Sethi model it models the dynamic effect of the manufacturer and retailer's advertising efforts on sale. It uses optimal control technique and stochastic differential game theory to obtain the players' advertising strategies and the long-run value of the awareness share. Further, it models the relationship between the payoffs of both players and the awareness share. The work shows that with the provision of subsidy the retail advertising effort increases while the manufacturer's advertising effort reduces. It further shows that the total channel payoff is higher for subsidised retail advertising. However, the subsidy can only be possible if the rate of growth of the manufacturer's payoff is twice higher than that of the retailer.

RES: Regularized Stochastic BFGS Algorithm

NASA Astrophysics Data System (ADS)

Mokhtari, Aryan; Ribeiro, Alejandro

2014-12-01

RES, a regularized stochastic version of the Broyden-Fletcher-Goldfarb-Shanno (BFGS) quasi-Newton method is proposed to solve convex optimization problems with stochastic objectives. The use of stochastic gradient descent algorithms is widespread, but the number of iterations required to approximate optimal arguments can be prohibitive in high dimensional problems. Application of second order methods, on the other hand, is impracticable because computation of objective function Hessian inverses incurs excessive computational cost. BFGS modifies gradient descent by introducing a Hessian approximation matrix computed from finite gradient differences. RES utilizes stochastic gradients in lieu of deterministic gradients for both, the determination of descent directions and the approximation of the objective function's curvature. Since stochastic gradients can be computed at manageable computational cost RES is realizable and retains the convergence rate advantages of its deterministic counterparts. Convergence results show that lower and upper bounds on the Hessian egeinvalues of the sample functions are sufficient to guarantee convergence to optimal arguments. Numerical experiments showcase reductions in convergence time relative to stochastic gradient descent algorithms and non-regularized stochastic versions of BFGS. An application of RES to the implementation of support vector machines is developed.

Space-time-modulated stochastic processes

NASA Astrophysics Data System (ADS)

Giona, Massimiliano

2017-10-01

Starting from the physical problem associated with the Lorentzian transformation of a Poisson-Kac process in inertial frames, the concept of space-time-modulated stochastic processes is introduced for processes possessing finite propagation velocity. This class of stochastic processes provides a two-way coupling between the stochastic perturbation acting on a physical observable and the evolution of the physical observable itself, which in turn influences the statistical properties of the stochastic perturbation during its evolution. The definition of space-time-modulated processes requires the introduction of two functions: a nonlinear amplitude modulation, controlling the intensity of the stochastic perturbation, and a time-horizon function, which modulates its statistical properties, providing irreducible feedback between the stochastic perturbation and the physical observable influenced by it. The latter property is the peculiar fingerprint of this class of models that makes them suitable for extension to generic curved-space times. Considering Poisson-Kac processes as prototypical examples of stochastic processes possessing finite propagation velocity, the balance equations for the probability density functions associated with their space-time modulations are derived. Several examples highlighting the peculiarities of space-time-modulated processes are thoroughly analyzed.

Video game play, attention, and learning: how to shape the development of attention and influence learning?

PubMed

Cardoso-Leite, Pedro; Bavelier, Daphne

2014-04-01

The notion that play may facilitate learning has long been touted. Here, we review how video game play may be leveraged for enhancing attentional control, allowing greater cognitive flexibility and learning and in turn new routes to better address developmental disorders. Video games, initially developed for entertainment, appear to enhance the behavior in domains as varied as perception, attention, task switching, or mental rotation. This surprisingly wide transfer may be mediated by enhanced attentional control, allowing increased signal-to-noise ratio and thus more informed decisions. The possibility of enhancing attentional control through targeted interventions, be it computerized training or self-regulation techniques, is now well established. Embedding such training in video game play is appealing, given the astounding amount of time spent by children and adults worldwide with this media. It holds the promise of increasing compliance in patients and motivation in school children, and of enhancing the use of positive impact games. Yet for all the promises, existing research indicates that not all games are created equal: a better understanding of the game play elements that foster attention and learning as well as of the strategies developed by the players is needed. Computational models from machine learning or developmental robotics provide a rich theoretical framework to develop this work further and address its impact on developmental disorders.

[Game addiction].

PubMed

Mori, Akio; Iwadate, Masako; Minakawa, Nahoko T; Kawashima, Satoshi

2015-09-01

The purpose of this article is to analyze the South Korea and China of computer game research, and the current state of research in Japan. Excessive game actions were analyzed by PET-MRI, MRI, fMRI, NIRS, EEG. These results showed that the prefrontal cortical activity decreased during game play. Also, game addiction causes damage to the prefrontal cortex. The NIRS-EEG and simultaneous recording, during game play correspond well with the decrease of β band and oxygen-hemoglobin. The α band did not change with game play. However, oxygen-hemoglobin decreased during game play. South Korea, game addiction measures have been analyzed since 2002, but in Japan the research is recent.

A Switch Is Not a Switch: Syntactically-Driven Bilingual Language Control

ERIC Educational Resources Information Center

Gollan, Tamar H.; Goldrick, Matthew

2018-01-01

The current study investigated the possibility that language switches could be relatively automatically triggered by context. "Single-word switches," in which bilinguals switched languages on a single word in midsentence and then immediately switched back, were contrasted with more complete "whole-language switches," in which…

Switching Phenomena in a System with No Switches

NASA Astrophysics Data System (ADS)

Preis, Tobias; Stanley, H. Eugene

2010-02-01

It is widely believed that switching phenomena require switches, but this is actually not true. For an intriguing variety of switching phenomena in nature, the underlying complex system abruptly changes from one state to another in a highly discontinuous fashion. For example, financial market fluctuations are characterized by many abrupt switchings creating increasing trends ("bubble formation") and decreasing trends ("financial collapse"). Such switching occurs on time scales ranging from macroscopic bubbles persisting for hundreds of days to microscopic bubbles persisting only for a few seconds. We analyze a database containing 13,991,275 German DAX Future transactions recorded with a time resolution of 10 msec. For comparison, a database providing 2,592,531 of all S&P500 daily closing prices is used. We ask whether these ubiquitous switching phenomena have quantifiable features independent of the time horizon studied. We find striking scale-free behavior of the volatility after each switching occurs. We interpret our findings as being consistent with time-dependent collective behavior of financial market participants. We test the possible universality of our result by performing a parallel analysis of fluctuations in transaction volume and time intervals between trades. We show that these financial market switching processes have properties similar to those of phase transitions. We suggest that the well-known catastrophic bubbles that occur on large time scales—such as the most recent financial crisis—are no outliers but single dramatic representatives caused by the switching between upward and downward trends on time scales varying over nine orders of magnitude from very large (≈102 days) down to very small (≈10 ms).

The influence of game genre on Internet gaming disorder

PubMed Central

Na, Euihyeon; Choi, Inyoung; Lee, Taek-Ho; Lee, Hyeseon; Rho, Mi Jung; Cho, Hyun; Jung, Dong Jin; Kim, Dai-Jin

2017-01-01

Background and aims Although Internet gaming disorder (IGD) has been investigated in detail, minimal research has been conducted regarding the influence of different game genres on IGD. The aim of this study is to compare the characteristics of members of game genre-specific groups with IGD and to identify factors associated with IGD status in each group in a large sample of adults. Methods Internet games were categorized into four genres: real-time strategy games, massive multiplayer online role-playing games (MMORPG), sport games, and first-person shooter (FPS) games. Participants (n = 2,923) who usually played one of these games completed an anonymous online survey that collected sociodemographic, game usage pattern, and psychopathological assessment data. Results MMORPG and FPS game players more frequently met the criteria for IGD than participants in the other two groups. Differences between the IGD-suspected gamers within the genre-specific groups were observed for a few items, such as average game-playing time and the subscales of the behavioral activation system; however, the factors that contributed to the development of IGD within each game genre-specific group were found to be considerably different. Discussion and conclusions The findings of this study suggest that IGD is a stable psychiatric diagnosis encompassing users of a broad range of game genres. In addition, the development of strategies for the prevention of and early intervention on individuals at high risk for developing IGD may require consideration of the distinct characteristics identified as effective predictors of IGD in users of each game genre. PMID:28658960

The influence of game genre on Internet gaming disorder.

PubMed

Na, Euihyeon; Choi, Inyoung; Lee, Taek-Ho; Lee, Hyeseon; Rho, Mi Jung; Cho, Hyun; Jung, Dong Jin; Kim, Dai-Jin

2017-06-29

Background and aims Although Internet gaming disorder (IGD) has been investigated in detail, minimal research has been conducted regarding the influence of different game genres on IGD. The aim of this study is to compare the characteristics of members of game genre-specific groups with IGD and to identify factors associated with IGD status in each group in a large sample of adults. Methods Internet games were categorized into four genres: real-time strategy games, massive multiplayer online role-playing games (MMORPG), sport games, and first-person shooter (FPS) games. Participants (n = 2,923) who usually played one of these games completed an anonymous online survey that collected sociodemographic, game usage pattern, and psychopathological assessment data. Results MMORPG and FPS game players more frequently met the criteria for IGD than participants in the other two groups. Differences between the IGD-suspected gamers within the genre-specific groups were observed for a few items, such as average game-playing time and the subscales of the behavioral activation system; however, the factors that contributed to the development of IGD within each game genre-specific group were found to be considerably different. Discussion and conclusions The findings of this study suggest that IGD is a stable psychiatric diagnosis encompassing users of a broad range of game genres. In addition, the development of strategies for the prevention of and early intervention on individuals at high risk for developing IGD may require consideration of the distinct characteristics identified as effective predictors of IGD in users of each game genre.

Video game addiction, ADHD symptomatology, and video game reinforcement.

PubMed

Mathews, Christine L; Morrell, Holly E R; Molle, Jon E

2018-06-06

Up to 23% of people who play video games report symptoms of addiction. Individuals with attention deficit hyperactivity disorder (ADHD) may be at increased risk for video game addiction, especially when playing games with more reinforcing properties. The current study tested whether level of video game reinforcement (type of game) places individuals with greater ADHD symptom severity at higher risk for developing video game addiction. Adult video game players (N = 2,801; Mean age = 22.43, SD = 4.70; 93.30% male; 82.80% Caucasian) completed an online survey. Hierarchical multiple linear regression analyses were used to test type of game, ADHD symptom severity, and the interaction between type of game and ADHD symptomatology as predictors of video game addiction severity, after controlling for age, gender, and weekly time spent playing video games. ADHD symptom severity was positively associated with increased addiction severity (b = .73 and .68, ps < 0.001). Type of game played or preferred the most was not associated with addiction severity, ps > .05. The relationship between ADHD symptom severity and addiction severity did not depend on the type of video game played or preferred most, ps > .05. Gamers who have greater ADHD symptom severity may be at greater risk for developing symptoms of video game addiction and its negative consequences, regardless of type of video game played or preferred most. Individuals who report ADHD symptomatology and also identify as gamers may benefit from psychoeducation about the potential risk for problematic play.

On Stochastic Dependence

ERIC Educational Resources Information Center

Meyer, Joerg M.

2018-01-01

The contrary of stochastic independence splits up into two cases: pairs of events being favourable or being unfavourable. Examples show that both notions have quite unexpected properties, some of them being opposite to intuition. For example, transitivity does not hold. Stochastic dependence is also useful to explain cases of Simpson's paradox.

Output Feedback Stabilization for a Class of Multi-Variable Bilinear Stochastic Systems with Stochastic Coupling Attenuation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zhang, Qichun; Zhou, Jinglin; Wang, Hong

In this paper, stochastic coupling attenuation is investigated for a class of multi-variable bilinear stochastic systems and a novel output feedback m-block backstepping controller with linear estimator is designed, where gradient descent optimization is used to tune the design parameters of the controller. It has been shown that the trajectories of the closed-loop stochastic systems are bounded in probability sense and the stochastic coupling of the system outputs can be effectively attenuated by the proposed control algorithm. Moreover, the stability of the stochastic systems is analyzed and the effectiveness of the proposed method has been demonstrated using a simulated example.

Variational principles for stochastic fluid dynamics

PubMed Central

Holm, Darryl D.

2015-01-01

This paper derives stochastic partial differential equations (SPDEs) for fluid dynamics from a stochastic variational principle (SVP). The paper proceeds by taking variations in the SVP to derive stochastic Stratonovich fluid equations; writing their Itô representation; and then investigating the properties of these stochastic fluid models in comparison with each other, and with the corresponding deterministic fluid models. The circulation properties of the stochastic Stratonovich fluid equations are found to closely mimic those of the deterministic ideal fluid models. As with deterministic ideal flows, motion along the stochastic Stratonovich paths also preserves the helicity of the vortex field lines in incompressible stochastic flows. However, these Stratonovich properties are not apparent in the equivalent Itô representation, because they are disguised by the quadratic covariation drift term arising in the Stratonovich to Itô transformation. This term is a geometric generalization of the quadratic covariation drift term already found for scalar densities in Stratonovich's famous 1966 paper. The paper also derives motion equations for two examples of stochastic geophysical fluid dynamics; namely, the Euler–Boussinesq and quasi-geostropic approximations. PMID:27547083

Novel Approaches to Obesity Prevention: Effects of Game Enjoyment and Game Type on Energy Expenditure in Active Video Games

PubMed Central

Lyons, Elizabeth J.; Tate, Deborah F.; Komoski, Stephanie E.; Carr, Philip M.; Ward, Dianne S.

2012-01-01

Background Some active video games have been found to promote physical activity adherence because of enjoyment. However, many active games are exercise themed, which may interfere with the distracting properties that make game-based exercise more enjoyable than traditional exercise. This study compared exercise-themed and game-themed active games to investigate differences in energy expenditure and enjoyment. Method Young adults (N = 100, 50 female, 55 overweight, aged 18–35 years) played two of four Wii Fit games (one aerobic game and one balance game per person) for 10 min each. Of the two aerobic games, one was exercise themed (jogging) and the other was game themed (hula hooping). Both balance games were game themed. Energy expenditure and enjoyment were measured. Results After adjustment for gender and weight, aerobic games produced 2.70 kcal/kg-1/h-1 (95% confidence interval 2.41, 3.00) greater energy expenditure than balance games (p < .001), but balance games were more enjoyable (p < .001). In aerobic games, jogging produced greater energy expenditure than hula hooping in normal-weight and male participants (p < .001); in overweight and female participants, no differences were found (p > .17). Hula hooping was enjoyed more than jogging (p = .008). Enjoyment predicted energy expenditure in aerobic games (B = 0.767, p = .010). Conclusions Aerobic games produced greater energy expenditure but lower enjoyment than balance games, and a game-themed aerobic game was found more enjoyable than an exercise-themed aerobic game. Integrating more strenuous activity into entertaining games instead of games that simply simulate exercise may be a fruitful avenue for active game development. PMID:22920810

Novel approaches to obesity prevention: effects of game enjoyment and game type on energy expenditure in active video games.

PubMed

Lyons, Elizabeth J; Tate, Deborah F; Komoski, Stephanie E; Carr, Philip M; Ward, Dianne S

2012-07-01

Some active video games have been found to promote physical activity adherence because of enjoyment. However, many active games are exercise themed, which may interfere with the distracting properties that make game-based exercise more enjoyable than traditional exercise. This study compared exercise-themed and game-themed active games to investigate differences in energy expenditure and enjoyment. Young adults (N = 100, 50 female, 55 overweight, aged 18-35 years) played two of four Wii Fit games (one aerobic game and one balance game per person) for 10 min each. Of the two aerobic games, one was exercise themed (jogging) and the other was game themed (hula hooping). Both balance games were game themed. Energy expenditure and enjoyment were measured. After adjustment for gender and weight, aerobic games produced 2.70 kcal/kg(-1)/h(-1) (95% confidence interval 2.41, 3.00) greater energy expenditure than balance games (p < .001), but balance games were more enjoyable (p < .001). In aerobic games, jogging produced greater energy expenditure than hula hooping in normal-weight and male participants (p < .001); in overweight and female participants, no differences were found (p > .17). Hula hooping was enjoyed more than jogging (p = .008). Enjoyment predicted energy expenditure in aerobic games (B = 0.767, p = .010). Aerobic games produced greater energy expenditure but lower enjoyment than balance games, and a game-themed aerobic game was found more enjoyable than an exercise-themed aerobic game. Integrating more strenuous activity into entertaining games instead of games that simply simulate exercise may be a fruitful avenue for active game development. © 2012 Diabetes Technology Society.

Computer and video game addiction-a comparison between game users and non-game users.

PubMed

Weinstein, Aviv Malkiel

2010-09-01

Computer game addiction is excessive or compulsive use of computer and video games that may interfere with daily life. It is not clear whether video game playing meets diagnostic criteria for Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV). First objective is to review the literature on computer and video game addiction over the topics of diagnosis, phenomenology, epidemiology, and treatment. Second objective is to describe a brain imaging study measuring dopamine release during computer game playing. Article search of 15 published articles between 2000 and 2009 in Medline and PubMed on computer and video game addiction. Nine abstinent "ecstasy" users and 8 control subjects were scanned at baseline and after performing on a motorbike riding computer game while imaging dopamine release in vivo with [123I] IBZM and single photon emission computed tomography (SPECT). Psycho-physiological mechanisms underlying computer game addiction are mainly stress coping mechanisms, emotional reactions, sensitization, and reward. Computer game playing may lead to long-term changes in the reward circuitry that resemble the effects of substance dependence. The brain imaging study showed that healthy control subjects had reduced dopamine D2 receptor occupancy of 10.5% in the caudate after playing a motorbike riding computer game compared with baseline levels of binding consistent with increased release and binding to its receptors. Ex-chronic "ecstasy" users showed no change in levels of dopamine D2 receptor occupancy after playing this game. This evidence supports the notion that psycho-stimulant users have decreased sensitivity to natural reward. Computer game addicts or gamblers may show reduced dopamine response to stimuli associated with their addiction presumably due to sensitization.

Tabletop Games: Platforms, Experimental Games and Design Recommendations

NASA Astrophysics Data System (ADS)

Haller, Michael; Forlines, Clifton; Koeffel, Christina; Leitner, Jakob; Shen, Chia

While the last decade has seen massive improvements in not only the rendering quality, but also the overall performance of console and desktop video games, these improvements have not necessarily led to a greater population of video game players. In addition to continuing these improvements, the video game industry is also constantly searching for new ways to convert non-players into dedicated gamers. Despite the growing popularity of computer-based video games, people still love to play traditional board games, such as Risk, Monopoly, and Trivial Pursuit. Both video and board games have their strengths and weaknesses, and an intriguing conclusion is to merge both worlds. We believe that a tabletop form-factor provides an ideal interface for digital board games. The design and implementation of tabletop games will be influenced by the hardware platforms, form factors, sensing technologies, as well as input techniques and devices that are available and chosen. This chapter is divided into three major sections. In the first section, we describe the most recent tabletop hardware technologies that have been used by tabletop researchers and practitioners. In the second section, we discuss a set of experimental tabletop games. The third section presents ten evaluation heuristics for tabletop game design.

49 CFR 236.6 - Hand-operated switch equipped with switch circuit controller.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 49 Transportation 4 2010-10-01 2010-10-01 false Hand-operated switch equipped with switch circuit..., AND APPLIANCES Rules and Instructions: All Systems General § 236.6 Hand-operated switch equipped with switch circuit controller. Hand-operated switch equipped with switch circuit controller connected to the...

49 CFR 236.6 - Hand-operated switch equipped with switch circuit controller.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 49 Transportation 4 2013-10-01 2013-10-01 false Hand-operated switch equipped with switch circuit..., AND APPLIANCES Rules and Instructions: All Systems General § 236.6 Hand-operated switch equipped with switch circuit controller. Hand-operated switch equipped with switch circuit controller connected to the...

49 CFR 236.6 - Hand-operated switch equipped with switch circuit controller.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 49 Transportation 4 2012-10-01 2012-10-01 false Hand-operated switch equipped with switch circuit..., AND APPLIANCES Rules and Instructions: All Systems General § 236.6 Hand-operated switch equipped with switch circuit controller. Hand-operated switch equipped with switch circuit controller connected to the...

49 CFR 236.6 - Hand-operated switch equipped with switch circuit controller.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 49 Transportation 4 2014-10-01 2014-10-01 false Hand-operated switch equipped with switch circuit..., AND APPLIANCES Rules and Instructions: All Systems General § 236.6 Hand-operated switch equipped with switch circuit controller. Hand-operated switch equipped with switch circuit controller connected to the...

49 CFR 236.6 - Hand-operated switch equipped with switch circuit controller.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 49 Transportation 4 2011-10-01 2011-10-01 false Hand-operated switch equipped with switch circuit..., AND APPLIANCES Rules and Instructions: All Systems General § 236.6 Hand-operated switch equipped with switch circuit controller. Hand-operated switch equipped with switch circuit controller connected to the...

Single-cell characterization of metabolic switching in the sugar phosphotransferase system of Escherichia coli.

PubMed

Westermayer, Sonja A; Fritz, Georg; Gutiérrez, Joaquín; Megerle, Judith A; Weißl, Mira P S; Schnetz, Karin; Gerland, Ulrich; Rädler, Joachim O

2016-05-01

The utilization of several sugars in Escherichia coli is regulated by the Phosphotransferase System (PTS), in which diverse sugar utilization modules compete for phosphoryl flux from the general PTS proteins. Existing theoretical work predicts a winner-take-all outcome when this flux limits carbon uptake. To date, no experimental work has interrogated competing PTS uptake modules with single-cell resolution. Using time-lapse microscopy in perfused microchannels, we analyzed the competition between N-acetyl-glucosamine and sorbitol, as representative PTS sugars, by measuring both the expression of their utilization systems and the concomitant impact of sugar utilization on growth rates. We find two distinct regimes: hierarchical usage of the carbohydrates, and co-expression of the genes for both systems. Simulations of a mathematical model incorporating asymmetric sugar quality reproduce our metabolic phase diagram, indicating that under conditions of nonlimiting phosphate flux, co-expression is due to uncoupling of both sugar utilization systems. Our model reproduces hierarchical winner-take-all behaviour and stochastic co-expression, and predicts the switching between both strategies as a function of available phosphate flux. Hence, experiments and theory both suggest that PTS sugar utilization involves not only switching between the sugars utilized but also switching of utilization strategies to accommodate prevailing environmental conditions. © 2016 John Wiley & Sons Ltd.

Social activities, self-efficacy, game attitudes, and game addiction.

PubMed

Jeong, Eui Jun; Kim, Doo Hwan

2011-04-01

This study examines whether social activities with parents, online and offline social self-efficacy, and attitudes toward gaming are associated with the degree of game addiction among adolescents. Using data from a survey of 600 middle- and high-school students in South Korea, we tested the relationships of personal characteristics (grade point average and time spent on gaming each day), social self-efficacy (both on- and offline), general social activities (with parents, friends, and teachers), gaming activities with parents, and attitudes toward gaming (those of self, parents, friends, and teachers) with the degree of game addiction. In addition, we conducted ANOVA tests to determine the differences among three groups: non-addicts (NA), possible (mild or moderate) addicts (PA), and Internet addicts (IA). The results show that social self-efficacy in the real world (offline) was negatively related with the degree of game addiction, whereas social self-efficacy in the virtual world (online) indicated a positive association. Social activities with parents are negatively associated with game addiction, although no relationship is found between gaming activities with parents and game addiction. Parental attitude toward gaming has a negative relationship with the addiction. Results and implications are discussed.

EDITORIAL: Molecular switches at surfaces Molecular switches at surfaces

NASA Astrophysics Data System (ADS)

Weinelt, Martin; von Oppen, Felix

2012-10-01

In nature, molecules exploit interaction with their environment to realize complex functionalities on the nanometer length scale. Physical, chemical and/or biological specificity is frequently achieved by the switching of molecules between microscopically different states. Paradigmatic examples are the energy production in proton pumps of bacteria or the signal conversion in human vision, which rely on switching molecules between different configurations or conformations by external stimuli. The remarkable reproducibility and unparalleled fatigue resistance of these natural processes makes it highly desirable to emulate nature and develop artificial systems with molecular functionalities. A promising avenue towards this goal is to anchor the molecular switches at surfaces, offering new pathways to control their functional properties, to apply electrical contacts, or to integrate switches into larger systems. Anchoring at surfaces allows one to access the full range from individual molecular switches to self-assembled monolayers of well-defined geometry and to customize the coupling between molecules and substrate or between adsorbed molecules. Progress in this field requires both synthesis and preparation of appropriate molecular systems and control over suitable external stimuli, such as light, heat, or electrical currents. To optimize switching and generate function, it is essential to unravel the geometric structure, the electronic properties and the dynamic interactions of the molecular switches on surfaces. This special section, Molecular Switches at Surfaces, collects 17 contributions describing different aspects of this research field. They analyze elementary processes, both in single molecules and in ensembles of molecules, which involve molecular switching and concomitant changes of optical, electronic, or magnetic properties. Two topical reviews summarize the current status, including both challenges and achievements in the field of molecular switches on

A Hybrid of the Chemical Master Equation and the Gillespie Algorithm for Efficient Stochastic Simulations of Sub-Networks.

PubMed

Albert, Jaroslav

2016-01-01

Modeling stochastic behavior of chemical reaction networks is an important endeavor in many aspects of chemistry and systems biology. The chemical master equation (CME) and the Gillespie algorithm (GA) are the two most fundamental approaches to such modeling; however, each of them has its own limitations: the GA may require long computing times, while the CME may demand unrealistic memory storage capacity. We propose a method that combines the CME and the GA that allows one to simulate stochastically a part of a reaction network. First, a reaction network is divided into two parts. The first part is simulated via the GA, while the solution of the CME for the second part is fed into the GA in order to update its propensities. The advantage of this method is that it avoids the need to solve the CME or stochastically simulate the entire network, which makes it highly efficient. One of its drawbacks, however, is that most of the information about the second part of the network is lost in the process. Therefore, this method is most useful when only partial information about a reaction network is needed. We tested this method against the GA on two systems of interest in biology--the gene switch and the Griffith model of a genetic oscillator--and have shown it to be highly accurate. Comparing this method to four different stochastic algorithms revealed it to be at least an order of magnitude faster than the fastest among them.

Stochastic amplification and signaling in enzymatic futile cycles through noise-induced bistability with oscillations

NASA Astrophysics Data System (ADS)

Samoilov, Michael; Plyasunov, Sergey; Arkin, Adam P.

2005-02-01

Stochastic effects in biomolecular systems have now been recognized as a major physiologically and evolutionarily important factor in the development and function of many living organisms. Nevertheless, they are often thought of as providing only moderate refinements to the behaviors otherwise predicted by the classical deterministic system description. In this work we show by using both analytical and numerical investigation that at least in one ubiquitous class of (bio)chemical-reaction mechanisms, enzymatic futile cycles, the external noise may induce a bistable oscillatory (dynamic switching) behavior that is both quantitatively and qualitatively different from what is predicted or possible deterministically. We further demonstrate that the noise required to produce these distinct properties can itself be caused by a set of auxiliary chemical reactions, making it feasible for biological systems of sufficient complexity to generate such behavior internally. This new stochastic dynamics then serves to confer additional functional modalities on the enzymatic futile cycle mechanism that include stochastic amplification and signaling, the characteristics of which could be controlled by both the type and parameters of the driving noise. Hence, such noise-induced phenomena may, among other roles, potentially offer a novel type of control mechanism in pathways that contain these cycles and the like units. In particular, observations of endogenous or externally driven noise-induced dynamics in regulatory networks may thus provide additional insight into their topology, structure, and kinetics. network motif | signal transduction | chemical reaction | synthetic biology | systems biology

Stochastic Estimation via Polynomial Chaos

DTIC Science & Technology

2015-10-01

AFRL-RW-EG-TR-2015-108 Stochastic Estimation via Polynomial Chaos Douglas V. Nance Air Force Research...COVERED (From - To) 20-04-2015 – 07-08-2015 4. TITLE AND SUBTITLE 5a. CONTRACT NUMBER Stochastic Estimation via Polynomial Chaos ...This expository report discusses fundamental aspects of the polynomial chaos method for representing the properties of second order stochastic

Coordinated phenotype switching with large-scale chromosome flip-flop inversion observed in bacteria.

PubMed

Cui, Longzhu; Neoh, Hui-min; Iwamoto, Akira; Hiramatsu, Keiichi

2012-06-19

Genome inversions are ubiquitous in organisms ranging from prokaryotes to eukaryotes. Typical examples can be identified by comparing the genomes of two or more closely related organisms, where genome inversion footprints are clearly visible. Although the evolutionary implications of this phenomenon are huge, little is known about the function and biological meaning of this process. Here, we report our findings on a bacterium that generates a reversible, large-scale inversion of its chromosome (about half of its total genome) at high frequencies of up to once every four generations. This inversion switches on or off bacterial phenotypes, including colony morphology, antibiotic susceptibility, hemolytic activity, and expression of dozens of genes. Quantitative measurements and mathematical analyses indicate that this reversible switching is stochastic but self-organized so as to maintain two forms of stable cell populations (i.e., small colony variant, normal colony variant) as a bet-hedging strategy. Thus, this heritable and reversible genome fluctuation seems to govern the bacterial life cycle; it has a profound impact on the course and outcomes of bacterial infections.

Stochastic Games for Continuous-Time Jump Processes Under Finite-Horizon Payoff Criterion

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wei, Qingda, E-mail: weiqd@hqu.edu.cn; Chen, Xian, E-mail: chenxian@amss.ac.cn

In this paper we study two-person nonzero-sum games for continuous-time jump processes with the randomized history-dependent strategies under the finite-horizon payoff criterion. The state space is countable, and the transition rates and payoff functions are allowed to be unbounded from above and from below. Under the suitable conditions, we introduce a new topology for the set of all randomized Markov multi-strategies and establish its compactness and metrizability. Then by constructing the approximating sequences of the transition rates and payoff functions, we show that the optimal value function for each player is a unique solution to the corresponding optimality equation andmore » obtain the existence of a randomized Markov Nash equilibrium. Furthermore, we illustrate the applications of our main results with a controlled birth and death system.« less

Emergence of cooperation as a non-equilibrium transition in noisy spatial games

NASA Astrophysics Data System (ADS)

Menon, Shakti N.; Sasidevan, V.; Sinha, Sitabhra

2018-04-01

The emergence of cooperation among selfish agents that have no incentive to cooperate is a non-trivial phenomenon that has long intrigued biologists, social scientists and physicists. The iterated Prisoner's Dilemma (IPD) game provides a natural framework for investigating this phenomenon. Here, agents repeatedly interact with their opponents, and their choice to either cooperate or defect is determined at each round by knowledge of the previous outcomes. The spatial version of IPD, where each agent interacts only with their nearest neighbors on a specified connection topology, has been used to study the evolution of cooperation under conditions of bounded rationality. In this paper we study how the collective behavior that arises from the simultaneous actions of the agents (implemented by synchronous update) is affected by (i) uncertainty, measured as noise intensity K, (ii) the payoff b, quantifying the temptation to defect and (iii) the nature of the underlying connection topology. In particular, we study the phase transitions between states characterized by distinct collective dynamics as the connection topology is gradually altered from a two-dimensional lattice to a random network. This is achieved by rewiring links between agents with a probability p following the small-world network construction paradigm. On crossing a specified threshold value of b, the game switches from being Prisoner's Dilemma, characterized by a unique equilibrium, to Stag Hunt, a well-known coordination game having multiple equilibria. We observe that the system can exhibit three collective states corresponding to a pair of absorbing states (viz., all agents cooperating or defecting) and a fluctuating state characterized by agents switching intermittently between cooperation and defection. As noise and temptation can be interpreted as temperature and an external field respectively, a strong analogy can be drawn between the phase diagrams of such games with that of interacting spin

Investigating the origins of high multilevel resistive switching in forming free Ti/TiO2-x-based memory devices through experiments and simulations

NASA Astrophysics Data System (ADS)

Bousoulas, P.; Giannopoulos, I.; Asenov, P.; Karageorgiou, I.; Tsoukalas, D.

2017-03-01

Although multilevel capability is probably the most important property of resistive random access memory (RRAM) technology, it is vulnerable to reliability issues due to the stochastic nature of conducting filament (CF) creation. As a result, the various resistance states cannot be clearly distinguished, which leads to memory capacity failure. In this work, due to the gradual resistance switching pattern of TiO2-x-based RRAM devices, we demonstrate at least six resistance states with distinct memory margin and promising temporal variability. It is shown that the formation of small CFs with high density of oxygen vacancies enhances the uniformity of the switching characteristics in spite of the random nature of the switching effect. Insight into the origin of the gradual resistance modulation mechanisms is gained by the application of a trap-assisted-tunneling model together with numerical simulations of the filament formation physical processes.

Transient-Switch-Signal Suppressor

NASA Technical Reports Server (NTRS)

Bozeman, Richard J., Jr.

1995-01-01

Circuit delays transmission of switch-opening or switch-closing signal until after preset suppression time. Used to prevent transmission of undesired momentary switch signal. Basic mode of operation simple. Beginning of switch signal initiates timing sequence. If switch signal persists after preset suppression time, circuit transmits switch signal to external circuitry. If switch signal no longer present after suppression time, switch signal deemed transient, and circuit does not pass signal on to external circuitry, as though no transient switch signal. Suppression time preset at value large enough to allow for damping of underlying pressure wave or other mechanical transient.

Chimera states in a network-organized public goods game with destructive agents

NASA Astrophysics Data System (ADS)

Kouvaris, Nikos E.; Requejo, Rubén J.; Hizanidis, Johanne; Díaz-Guilera, Albert

2016-12-01

We found that a network-organized metapopulation of cooperators, defectors, and destructive agents playing the public goods game with mutations can collectively reach global synchronization or chimera states. Global synchronization is accompanied by a collective periodic burst of cooperation, whereas chimera states reflect the tendency of the networked metapopulation to be fragmented in clusters of synchronous and incoherent bursts of cooperation. Numerical simulations have shown that the system's dynamics switches between these two steady states through a first order transition. Depending on the parameters determining the dynamical and topological properties, chimera states with different numbers of coherent and incoherent clusters are observed. Our results present the first systematic study of chimera states and their characterization in the context of evolutionary game theory. This provides a valuable insight into the details of their occurrence, extending the relevance of such states to natural and social systems.

Individual differences in motives, preferences, and pathology in video games: the gaming attitudes, motives, and experiences scales (GAMES)

PubMed Central

Hilgard, Joseph; Engelhardt, Christopher R.; Bartholow, Bruce D.

2013-01-01

A new measure of individual habits and preferences in video game use is developed in order to better study the risk factors of pathological game use (i.e., excessively frequent or prolonged use, sometimes called “game addiction”). This measure was distributed to internet message boards for game enthusiasts and to college undergraduates. An exploratory factor analysis identified 9 factors: Story, Violent Catharsis, Violent Reward, Social Interaction, Escapism, Loss-Sensitivity, Customization, Grinding, and Autonomy. These factors demonstrated excellent fit in a subsequent confirmatory factor analysis, and, importantly, were found to reliably discriminate between inter-individual game preferences (e.g., Super Mario Brothers as compared to Call of Duty). Moreover, three factors were significantly related to pathological game use: the use of games to escape daily life, the use of games as a social outlet, and positive attitudes toward the steady accumulation of in-game rewards. The current research identifies individual preferences and motives relevant to understanding video game players' evaluations of different games and risk factors for pathological video game use. PMID:24058355

Individual differences in motives, preferences, and pathology in video games: the gaming attitudes, motives, and experiences scales (GAMES).

PubMed

Hilgard, Joseph; Engelhardt, Christopher R; Bartholow, Bruce D

2013-01-01

A new measure of individual habits and preferences in video game use is developed in order to better study the risk factors of pathological game use (i.e., excessively frequent or prolonged use, sometimes called "game addiction"). This measure was distributed to internet message boards for game enthusiasts and to college undergraduates. An exploratory factor analysis identified 9 factors: Story, Violent Catharsis, Violent Reward, Social Interaction, Escapism, Loss-Sensitivity, Customization, Grinding, and Autonomy. These factors demonstrated excellent fit in a subsequent confirmatory factor analysis, and, importantly, were found to reliably discriminate between inter-individual game preferences (e.g., Super Mario Brothers as compared to Call of Duty). Moreover, three factors were significantly related to pathological game use: the use of games to escape daily life, the use of games as a social outlet, and positive attitudes toward the steady accumulation of in-game rewards. The current research identifies individual preferences and motives relevant to understanding video game players' evaluations of different games and risk factors for pathological video game use.

Phenomenology of stochastic exponential growth

NASA Astrophysics Data System (ADS)

Pirjol, Dan; Jafarpour, Farshid; Iyer-Biswas, Srividya

2017-06-01

Stochastic exponential growth is observed in a variety of contexts, including molecular autocatalysis, nuclear fission, population growth, inflation of the universe, viral social media posts, and financial markets. Yet literature on modeling the phenomenology of these stochastic dynamics has predominantly focused on one model, geometric Brownian motion (GBM), which can be described as the solution of a Langevin equation with linear drift and linear multiplicative noise. Using recent experimental results on stochastic exponential growth of individual bacterial cell sizes, we motivate the need for a more general class of phenomenological models of stochastic exponential growth, which are consistent with the observation that the mean-rescaled distributions are approximately stationary at long times. We show that this behavior is not consistent with GBM, instead it is consistent with power-law multiplicative noise with positive fractional powers. Therefore, we consider this general class of phenomenological models for stochastic exponential growth, provide analytical solutions, and identify the important dimensionless combination of model parameters, which determines the shape of the mean-rescaled distribution. We also provide a prescription for robustly inferring model parameters from experimentally observed stochastic growth trajectories.

Cognitive behavioral game design: a unified model for designing serious games

PubMed Central

Starks, Katryna

2014-01-01

Video games have a unique ability to engage, challenge, and motivate, which has led teachers, psychology specialists, political activists and health educators to find ways of using them to help people learn, grow and change. Serious games, as they are called, are defined as games that have a primary purpose other than entertainment. However, it is challenging to create games that both educate and entertain. While game designers have embraced some psychological concepts such as flow and mastery, understanding how these concepts work together within established psychological theory would assist them in creating effective serious games. Similarly, game design professionals have understood the propensity of video games to teach while lamenting that educators do not understand how to incorporate educational principles into game play in a way that preserves the entertainment. Bandura (2006) social cognitive theory (SCT) has been used successfully to create video games that create positive behavior outcomes, and teachers have successfully used Gardner’s (1983) theory of multiple intelligences (MIs) to create engaging, immersive learning experiences. Cognitive behavioral game design is a new framework that incorporates SCT and MI with game design principles to create a game design blueprint for serious games. PMID:24550858

Cognitive behavioral game design: a unified model for designing serious games.

PubMed

Starks, Katryna

2014-01-01

Video games have a unique ability to engage, challenge, and motivate, which has led teachers, psychology specialists, political activists and health educators to find ways of using them to help people learn, grow and change. Serious games, as they are called, are defined as games that have a primary purpose other than entertainment. However, it is challenging to create games that both educate and entertain. While game designers have embraced some psychological concepts such as flow and mastery, understanding how these concepts work together within established psychological theory would assist them in creating effective serious games. Similarly, game design professionals have understood the propensity of video games to teach while lamenting that educators do not understand how to incorporate educational principles into game play in a way that preserves the entertainment. Bandura (2006) social cognitive theory (SCT) has been used successfully to create video games that create positive behavior outcomes, and teachers have successfully used Gardner's (1983) theory of multiple intelligences (MIs) to create engaging, immersive learning experiences. Cognitive behavioral game design is a new framework that incorporates SCT and MI with game design principles to create a game design blueprint for serious games.

Combat games

NASA Technical Reports Server (NTRS)

Ardema, M. D.; Heymann, M.; Rajan, N.

1985-01-01

A mathematical formulation is proposed of a combat game between two opponents with offensive capabilities and offensive objective is proposed. Resolution of the combat involves solving two differential games with state constraints. Depending on the game dynamics and parameters, the combat can terminate in one of four ways: the first player wins; the second player wins; a draw (neither wins); or joint capture. In the first two cases, the optimal strategies of the two players are determined from suitable zero-sum games, whereas in the latter two the relevant games are nonzero-sum. Further, to avoid certain technical difficulties, the concept of a delta-combat game is introduced.

Optimal Control for Stochastic Delay Evolution Equations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Meng, Qingxin, E-mail: mqx@hutc.zj.cn; Shen, Yang, E-mail: skyshen87@gmail.com

2016-08-15

In this paper, we investigate a class of infinite-dimensional optimal control problems, where the state equation is given by a stochastic delay evolution equation with random coefficients, and the corresponding adjoint equation is given by an anticipated backward stochastic evolution equation. We first prove the continuous dependence theorems for stochastic delay evolution equations and anticipated backward stochastic evolution equations, and show the existence and uniqueness of solutions to anticipated backward stochastic evolution equations. Then we establish necessary and sufficient conditions for optimality of the control problem in the form of Pontryagin’s maximum principles. To illustrate the theoretical results, we applymore » stochastic maximum principles to study two examples, an infinite-dimensional linear-quadratic control problem with delay and an optimal control of a Dirichlet problem for a stochastic partial differential equation with delay. Further applications of the two examples to a Cauchy problem for a controlled linear stochastic partial differential equation and an optimal harvesting problem are also considered.« less

Stochastic Dominance and Analysis of ODI Batting Performance: the Indian Cricket Team, 1989-2005

PubMed Central

Damodaran, Uday

2006-01-01

Relative to other team games, the contribution of individual team members to the overall team performance is more easily quantifiable in cricket. Viewing players as securities and the team as a portfolio, cricket thus lends itself better to the use of analytical methods usually employed in the analysis of securities and portfolios. This paper demonstrates the use of stochastic dominance rules, normally used in investment management, to analyze the One Day International (ODI) batting performance of Indian cricketers. The data used span the years 1989 to 2005. In dealing with cricketing data the existence of ‘not out’ scores poses a problem while processing the data. In this paper, using a Bayesian approach, the ‘not-out’ scores are first replaced with a conditional average. The conditional average that is used represents an estimate of the score that the player would have gone on to score, if the ‘not out’ innings had been completed. The data thus treated are then used in the stochastic dominance analysis. To use stochastic dominance rules we need to characterize the ‘utility’ of a batsman. The first derivative of the utility function, with respect to runs scored, of an ODI batsman can safely be assumed to be positive (more runs scored are preferred to less). However, the second derivative needs not be negative (no diminishing marginal utility for runs scored). This means that we cannot clearly specify whether the value attached to an additional run scored is lesser at higher levels of scores. Because of this, only first-order stochastic dominance is used to analyze the performance of the players under consideration. While this has its limitation (specifically, we cannot arrive at a complete utility value for each batsman), the approach does well in describing player performance. Moreover, the results have intuitive appeal. Key Points The problem of dealing with ‘not out’ scores in cricket is tackled using a Bayesian approach. Stochastic

Stochastic Dominance and Analysis of ODI Batting Performance: the Indian Cricket Team, 1989-2005.

PubMed

Damodaran, Uday

2006-01-01

Relative to other team games, the contribution of individual team members to the overall team performance is more easily quantifiable in cricket. Viewing players as securities and the team as a portfolio, cricket thus lends itself better to the use of analytical methods usually employed in the analysis of securities and portfolios. This paper demonstrates the use of stochastic dominance rules, normally used in investment management, to analyze the One Day International (ODI) batting performance of Indian cricketers. The data used span the years 1989 to 2005. In dealing with cricketing data the existence of 'not out' scores poses a problem while processing the data. In this paper, using a Bayesian approach, the 'not-out' scores are first replaced with a conditional average. The conditional average that is used represents an estimate of the score that the player would have gone on to score, if the 'not out' innings had been completed. The data thus treated are then used in the stochastic dominance analysis. To use stochastic dominance rules we need to characterize the 'utility' of a batsman. The first derivative of the utility function, with respect to runs scored, of an ODI batsman can safely be assumed to be positive (more runs scored are preferred to less). However, the second derivative needs not be negative (no diminishing marginal utility for runs scored). This means that we cannot clearly specify whether the value attached to an additional run scored is lesser at higher levels of scores. Because of this, only first-order stochastic dominance is used to analyze the performance of the players under consideration. While this has its limitation (specifically, we cannot arrive at a complete utility value for each batsman), the approach does well in describing player performance. Moreover, the results have intuitive appeal. Key PointsThe problem of dealing with 'not out' scores in cricket is tackled using a Bayesian approach.Stochastic dominance rules are used to

Altered Brain Reactivity to Game Cues After Gaming Experience.

PubMed

Ahn, Hyeon Min; Chung, Hwan Jun; Kim, Sang Hee

2015-08-01

Individuals who play Internet games excessively show elevated brain reactivity to game-related cues. This study attempted to test whether this elevated cue reactivity observed in game players is a result of repeated exposure to Internet games. Healthy young adults without a history of excessively playing Internet games were recruited, and they were instructed to play an online Internet game for 2 hours/day for five consecutive weekdays. Two control groups were used: the drama group, which viewed a fantasy TV drama, and the no-exposure group, which received no systematic exposure. All participants performed a cue reactivity task with game, drama, and neutral cues in the brain scanner, both before and after the exposure sessions. The game group showed an increased reactivity to game cues in the right ventrolateral prefrontal cortex (VLPFC). The degree of VLPFC activation increase was positively correlated with the self-reported increase in desire for the game. The drama group showed an increased cue reactivity in response to the presentation of drama cues in the caudate, posterior cingulate, and precuneus. The results indicate that exposure to either Internet games or TV dramas elevates the reactivity to visual cues associated with the particular exposure. The exact elevation patterns, however, appear to differ depending on the type of media experienced. How changes in each of the regions contribute to the progression to pathological craving warrants a future longitudinal study.

Stochastic description of quantum Brownian dynamics

NASA Astrophysics Data System (ADS)

Yan, Yun-An; Shao, Jiushu

2016-08-01

Classical Brownian motion has well been investigated since the pioneering work of Einstein, which inspired mathematicians to lay the theoretical foundation of stochastic processes. A stochastic formulation for quantum dynamics of dissipative systems described by the system-plus-bath model has been developed and found many applications in chemical dynamics, spectroscopy, quantum transport, and other fields. This article provides a tutorial review of the stochastic formulation for quantum dissipative dynamics. The key idea is to decouple the interaction between the system and the bath by virtue of the Hubbard-Stratonovich transformation or Itô calculus so that the system and the bath are not directly entangled during evolution, rather they are correlated due to the complex white noises introduced. The influence of the bath on the system is thereby defined by an induced stochastic field, which leads to the stochastic Liouville equation for the system. The exact reduced density matrix can be calculated as the stochastic average in the presence of bath-induced fields. In general, the plain implementation of the stochastic formulation is only useful for short-time dynamics, but not efficient for long-time dynamics as the statistical errors go very fast. For linear and other specific systems, the stochastic Liouville equation is a good starting point to derive the master equation. For general systems with decomposable bath-induced processes, the hierarchical approach in the form of a set of deterministic equations of motion is derived based on the stochastic formulation and provides an effective means for simulating the dissipative dynamics. A combination of the stochastic simulation and the hierarchical approach is suggested to solve the zero-temperature dynamics of the spin-boson model. This scheme correctly describes the coherent-incoherent transition (Toulouse limit) at moderate dissipation and predicts a rate dynamics in the overdamped regime. Challenging problems

"The Academic Game" as a Frame Game.

ERIC Educational Resources Information Center

Bredemeier, Mary E.; And Others

1981-01-01

Describes a frame game which focuses on problems of sex, status, and organizational development. "The Academic Game" is a specific model of a generic game that has differential consequences for men and women, and is easily adaptable to other organizational settings, including public administration and industry. Six references are listed.…

Brain activities associated with gaming urge of online gaming addiction.

PubMed

Ko, Chih-Hung; Liu, Gin-Chung; Hsiao, Sigmund; Yen, Ju-Yu; Yang, Ming-Jen; Lin, Wei-Chen; Yen, Cheng-Fang; Chen, Cheng-Sheng

2009-04-01

The aim of this study was to identify the neural substrates of online gaming addiction through evaluation of the brain areas associated with the cue-induced gaming urge. Ten participants with online gaming addiction and 10 control subjects without online gaming addiction were tested. They were presented with gaming pictures and the paired mosaic pictures while undergoing functional magnetic resonance imaging (fMRI) scanning. The contrast in blood-oxygen-level dependent (BOLD) signals when viewing gaming pictures and when viewing mosaic pictures was calculated with the SPM2 software to evaluate the brain activations. Right orbitofrontal cortex, right nucleus accumbens, bilateral anterior cingulate and medial frontal cortex, right dorsolateral prefrontal cortex, and right caudate nucleus were activated in the addicted group in contrast to the control group. The activation of the region-of-interest (ROI) defined by the above brain areas was positively correlated with self-reported gaming urge and recalling of gaming experience provoked by the WOW pictures. The results demonstrate that the neural substrate of cue-induced gaming urge/craving in online gaming addiction is similar to that of the cue-induced craving in substance dependence. The above-mentioned brain regions have been reported to contribute to the craving in substance dependence, and here we show that the same areas were involved in online gaming urge/craving. Thus, the results suggest that the gaming urge/craving in online gaming addiction and craving in substance dependence might share the same neurobiological mechanism.

Game injuries in relation to game schedules in the National Basketball Association.

PubMed

Teramoto, Masaru; Cross, Chad L; Cushman, Daniel M; Maak, Travis G; Petron, David J; Willick, Stuart E

2017-03-01

Injury management is critical in the National Basketball Association (NBA), as players experience a wide variety of injuries. Recently, it has been suggested that game schedules, such as back-to-back games and four games in five days, increase the risk of injuries in the NBA. The aim of this study was to examine the association between game schedules and player injuries in the NBA. Descriptive epidemiology study. The present study analyzed game injuries and game schedules in the 2012-13 through 2014-15 regular seasons. Game injuries by game schedules and players' profiles were examined using an exact binomial test, the Fisher's exact test and the Mann-Whitney-Wilcoxon test. A Poisson regression analysis was performed to predict the number of game injuries sustained by each player from game schedules and injured players' profiles. There were a total of 681 cases of game injuries sustained by 280 different players during the three years (total N=1443 players). Playing back-to-back games or playing four games in five days alone was not associated with an increased rate of game injuries, whereas a significant positive association was found between game injuries and playing away from home (p<0.05). Playing back-to-back games and away games were significant predictors of frequent game injuries (p<0.05). Game schedules could be one factor that impacts the risk of game injuries in the NBA. The findings could be useful for designing optimal game schedules in the NBA as well as helping NBA teams make adjustments to minimize game injuries. Copyright © 2016 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Versatility and addiction in gaming: the number of video-game genres played is associated with pathological gaming in male adolescents.

PubMed

Donati, Maria Anna; Chiesi, Francesca; Ammannato, Giulio; Primi, Caterina

2015-02-01

This study tested the predictive power of gaming versatility (i.e., the number of video game genres engaged in) on game addiction in male adolescents, controlling for time spent on gaming. Participants were 701 male adolescents attending high school (Mage=15.6 years). Analyses showed that pathological gaming was predicted not only by higher time spent on gaming, but also by participation in a greater number of video game genres. Specifically, the wider the array of video game genres played, the higher were the negative consequences caused by gaming. Findings show that versatility can be considered as one of the behavioral risk factors related to gaming addiction, which may be characterized by a composite and diversified experience with video games. This study suggests that educational efforts designed to prevent gaming addiction among youth may also be focused on adolescents' engagement in different video games.

Constructionist Gaming: Understanding the Benefits of Making Games for Learning.

PubMed

Kafai, Yasmin B; Burke, Quinn

2015-10-02

There has been considerable interest in examining the educational potential of playing video games. One crucial element, however, has traditionally been left out of these discussions-namely, children's learning through making their own games. In this article, we review and synthesize 55 studies from the last decade on making games and learning. We found that the majority of studies focused on teaching coding and academic content through game making, and that few studies explicitly examined the roles of collaboration and identity in the game making process. We argue that future discussions of serious gaming ought to be more inclusive of constructionist approaches to realize the full potential of serious gaming. Making games, we contend, not only more genuinely introduces children to a range of technical skills but also better connects them to each other, addressing the persistent issues of access and diversity present in traditional digital gaming cultures.

Constructionist Gaming: Understanding the Benefits of Making Games for Learning

PubMed Central

Kafai, Yasmin B.; Burke, Quinn

2015-01-01

There has been considerable interest in examining the educational potential of playing video games. One crucial element, however, has traditionally been left out of these discussions—namely, children's learning through making their own games. In this article, we review and synthesize 55 studies from the last decade on making games and learning. We found that the majority of studies focused on teaching coding and academic content through game making, and that few studies explicitly examined the roles of collaboration and identity in the game making process. We argue that future discussions of serious gaming ought to be more inclusive of constructionist approaches to realize the full potential of serious gaming. Making games, we contend, not only more genuinely introduces children to a range of technical skills but also better connects them to each other, addressing the persistent issues of access and diversity present in traditional digital gaming cultures. PMID:27019536

Variance decomposition in stochastic simulators.

PubMed

Le Maître, O P; Knio, O M; Moraes, A

2015-06-28

This work aims at the development of a mathematical and computational approach that enables quantification of the inherent sources of stochasticity and of the corresponding sensitivities in stochastic simulations of chemical reaction networks. The approach is based on reformulating the system dynamics as being generated by independent standardized Poisson processes. This reformulation affords a straightforward identification of individual realizations for the stochastic dynamics of each reaction channel, and consequently a quantitative characterization of the inherent sources of stochasticity in the system. By relying on the Sobol-Hoeffding decomposition, the reformulation enables us to perform an orthogonal decomposition of the solution variance. Thus, by judiciously exploiting the inherent stochasticity of the system, one is able to quantify the variance-based sensitivities associated with individual reaction channels, as well as the importance of channel interactions. Implementation of the algorithms is illustrated in light of simulations of simplified systems, including the birth-death, Schlögl, and Michaelis-Menten models.

Variance decomposition in stochastic simulators

DOE Office of Scientific and Technical Information (OSTI.GOV)

Le Maître, O. P., E-mail: olm@limsi.fr; Knio, O. M., E-mail: knio@duke.edu; Moraes, A., E-mail: alvaro.moraesgutierrez@kaust.edu.sa

This work aims at the development of a mathematical and computational approach that enables quantification of the inherent sources of stochasticity and of the corresponding sensitivities in stochastic simulations of chemical reaction networks. The approach is based on reformulating the system dynamics as being generated by independent standardized Poisson processes. This reformulation affords a straightforward identification of individual realizations for the stochastic dynamics of each reaction channel, and consequently a quantitative characterization of the inherent sources of stochasticity in the system. By relying on the Sobol-Hoeffding decomposition, the reformulation enables us to perform an orthogonal decomposition of the solution variance.more » Thus, by judiciously exploiting the inherent stochasticity of the system, one is able to quantify the variance-based sensitivities associated with individual reaction channels, as well as the importance of channel interactions. Implementation of the algorithms is illustrated in light of simulations of simplified systems, including the birth-death, Schlögl, and Michaelis-Menten models.« less

Variance decomposition in stochastic simulators

NASA Astrophysics Data System (ADS)

Le Maître, O. P.; Knio, O. M.; Moraes, A.

2015-06-01

This work aims at the development of a mathematical and computational approach that enables quantification of the inherent sources of stochasticity and of the corresponding sensitivities in stochastic simulations of chemical reaction networks. The approach is based on reformulating the system dynamics as being generated by independent standardized Poisson processes. This reformulation affords a straightforward identification of individual realizations for the stochastic dynamics of each reaction channel, and consequently a quantitative characterization of the inherent sources of stochasticity in the system. By relying on the Sobol-Hoeffding decomposition, the reformulation enables us to perform an orthogonal decomposition of the solution variance. Thus, by judiciously exploiting the inherent stochasticity of the system, one is able to quantify the variance-based sensitivities associated with individual reaction channels, as well as the importance of channel interactions. Implementation of the algorithms is illustrated in light of simulations of simplified systems, including the birth-death, Schlögl, and Michaelis-Menten models.

Enhancing cognition with video games: a multiple game training study.

PubMed

Oei, Adam C; Patterson, Michael D

2013-01-01

Previous evidence points to a causal link between playing action video games and enhanced cognition and perception. However, benefits of playing other video games are under-investigated. We examined whether playing non-action games also improves cognition. Hence, we compared transfer effects of an action and other non-action types that required different cognitive demands. We instructed 5 groups of non-gamer participants to play one game each on a mobile device (iPhone/iPod Touch) for one hour a day/five days a week over four weeks (20 hours). Games included action, spatial memory, match-3, hidden- object, and an agent-based life simulation. Participants performed four behavioral tasks before and after video game training to assess for transfer effects. Tasks included an attentional blink task, a spatial memory and visual search dual task, a visual filter memory task to assess for multiple object tracking and cognitive control, as well as a complex verbal span task. Action game playing eliminated attentional blink and improved cognitive control and multiple-object tracking. Match-3, spatial memory and hidden object games improved visual search performance while the latter two also improved spatial working memory. Complex verbal span improved after match-3 and action game training. Cognitive improvements were not limited to action game training alone and different games enhanced different aspects of cognition. We conclude that training specific cognitive abilities frequently in a video game improves performance in tasks that share common underlying demands. Overall, these results suggest that many video game-related cognitive improvements may not be due to training of general broad cognitive systems such as executive attentional control, but instead due to frequent utilization of specific cognitive processes during game play. Thus, many video game training related improvements to cognition may be attributed to near-transfer effects.

Enhancing Cognition with Video Games: A Multiple Game Training Study

PubMed Central

Oei, Adam C.; Patterson, Michael D.

2013-01-01

Background Previous evidence points to a causal link between playing action video games and enhanced cognition and perception. However, benefits of playing other video games are under-investigated. We examined whether playing non-action games also improves cognition. Hence, we compared transfer effects of an action and other non-action types that required different cognitive demands. Methodology/Principal Findings We instructed 5 groups of non-gamer participants to play one game each on a mobile device (iPhone/iPod Touch) for one hour a day/five days a week over four weeks (20 hours). Games included action, spatial memory, match-3, hidden- object, and an agent-based life simulation. Participants performed four behavioral tasks before and after video game training to assess for transfer effects. Tasks included an attentional blink task, a spatial memory and visual search dual task, a visual filter memory task to assess for multiple object tracking and cognitive control, as well as a complex verbal span task. Action game playing eliminated attentional blink and improved cognitive control and multiple-object tracking. Match-3, spatial memory and hidden object games improved visual search performance while the latter two also improved spatial working memory. Complex verbal span improved after match-3 and action game training. Conclusion/Significance Cognitive improvements were not limited to action game training alone and different games enhanced different aspects of cognition. We conclude that training specific cognitive abilities frequently in a video game improves performance in tasks that share common underlying demands. Overall, these results suggest that many video game-related cognitive improvements may not be due to training of general broad cognitive systems such as executive attentional control, but instead due to frequent utilization of specific cognitive processes during game play. Thus, many video game training related improvements to cognition may be

Digital switched hydraulics

NASA Astrophysics Data System (ADS)

Pan, Min; Plummer, Andrew

2018-06-01

This paper reviews recent developments in digital switched hydraulics particularly the switched inertance hydraulic systems (SIHSs). The performance of SIHSs is presented in brief with a discussion of several possible configurations and control strategies. The soft switching technology and high-speed switching valve design techniques are discussed. Challenges and recommendations are given based on the current research achievements.

Ubiquitous Games for Learning (UbiqGames): Weatherlings, a Worked Example

ERIC Educational Resources Information Center

Klopfer, E.; Sheldon, J.; Perry, J.; Chen, V. H. -H.

2012-01-01

This paper provides a rationale for a class of mobile, casual, and educational games, which we call UbiqGames. The study is motivated by the desire to understand how students use educational games in light of additional distractions on their devices, and how game design can make those games appealing, educationally useful, and practical. In…

Enhancement of resistive switching properties in Al2O3 bilayer-based atomic switches: multilevel resistive switching.

PubMed

Vishwanath, Sujaya Kumar; Woo, Hyunsuk; Jeon, Sanghun

2018-06-08

Atomic switches are considered to be building blocks for future non-volatile data storage and internet of things. However, obtaining device structures capable of ultrahigh density data storage, high endurance, and long data retention, and more importantly, understanding the switching mechanisms are still a challenge for atomic switches. Here, we achieved improved resistive switching performance in a bilayer structure containing aluminum oxide, with an oxygen-deficient oxide as the top switching layer and stoichiometric oxide as the bottom switching layer, using atomic layer deposition. This bilayer device showed a high on/off ratio (10 5 ) with better endurance (∼2000 cycles) and longer data retention (10 4 s) than single-oxide layers. In addition, depending on the compliance current, the bilayer device could be operated in four different resistance states. Furthermore, the depth profiles of the hourglass-shaped conductive filament of the bilayer device was observed by conductive atomic force microscopy.

Enhancement of resistive switching properties in Al2O3 bilayer-based atomic switches: multilevel resistive switching

NASA Astrophysics Data System (ADS)

Vishwanath, Sujaya Kumar; Woo, Hyunsuk; Jeon, Sanghun

2018-06-01

Atomic switches are considered to be building blocks for future non-volatile data storage and internet of things. However, obtaining device structures capable of ultrahigh density data storage, high endurance, and long data retention, and more importantly, understanding the switching mechanisms are still a challenge for atomic switches. Here, we achieved improved resistive switching performance in a bilayer structure containing aluminum oxide, with an oxygen-deficient oxide as the top switching layer and stoichiometric oxide as the bottom switching layer, using atomic layer deposition. This bilayer device showed a high on/off ratio (105) with better endurance (∼2000 cycles) and longer data retention (104 s) than single-oxide layers. In addition, depending on the compliance current, the bilayer device could be operated in four different resistance states. Furthermore, the depth profiles of the hourglass-shaped conductive filament of the bilayer device was observed by conductive atomic force microscopy.

Stochastic Nature in Cellular Processes

NASA Astrophysics Data System (ADS)

Liu, Bo; Liu, Sheng-Jun; Wang, Qi; Yan, Shi-Wei; Geng, Yi-Zhao; Sakata, Fumihiko; Gao, Xing-Fa

2011-11-01

The importance of stochasticity in cellular processes is increasingly recognized in both theoretical and experimental studies. General features of stochasticity in gene regulation and expression are briefly reviewed in this article, which include the main experimental phenomena, classification, quantization and regulation of noises. The correlation and transmission of noise in cascade networks are analyzed further and the stochastic simulation methods that can capture effects of intrinsic and extrinsic noise are described.

Finite Ground Coplanar Waveguide Shunt MEMS Switches for Switched Line Phase Shifters

NASA Technical Reports Server (NTRS)

Ponchak, George E.; Simons, Rainee N.; Scardelletti, Maximillian; Varaljay, Nicholas C.

2000-01-01

Switches with low insertion loss and high isolation are required for switched line phase shifters and the transmit/receive switch at the front end of communication systems. A Finite Ground Coplanar (FGC) waveguide capacitive, shunt MEMS switch has been implemented on high resistivity Si. The switch has demonstrated an insertion loss of less than 0.3 dB and a return loss greater than 15 dB from 10 to 20, GHz. The switch design, fabrication, and characteristics are presented.

A moment-convergence method for stochastic analysis of biochemical reaction networks

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zhang, Jiajun; Nie, Qing; Zhou, Tianshou, E-mail: mcszhtsh@mail.sysu.edu.cn

Traditional moment-closure methods need to assume that high-order cumulants of a probability distribution approximate to zero. However, this strong assumption is not satisfied for many biochemical reaction networks. Here, we introduce convergent moments (defined in mathematics as the coefficients in the Taylor expansion of the probability-generating function at some point) to overcome this drawback of the moment-closure methods. As such, we develop a new analysis method for stochastic chemical kinetics. This method provides an accurate approximation for the master probability equation (MPE). In particular, the connection between low-order convergent moments and rate constants can be more easily derived in termsmore » of explicit and analytical forms, allowing insights that would be difficult to obtain through direct simulation or manipulation of the MPE. In addition, it provides an accurate and efficient way to compute steady-state or transient probability distribution, avoiding the algorithmic difficulty associated with stiffness of the MPE due to large differences in sizes of rate constants. Applications of the method to several systems reveal nontrivial stochastic mechanisms of gene expression dynamics, e.g., intrinsic fluctuations can induce transient bimodality and amplify transient signals, and slow switching between promoter states can increase fluctuations in spatially heterogeneous signals. The overall approach has broad applications in modeling, analysis, and computation of complex biochemical networks with intrinsic noise.« less

A moment-convergence method for stochastic analysis of biochemical reaction networks.

PubMed

Zhang, Jiajun; Nie, Qing; Zhou, Tianshou

2016-05-21

Traditional moment-closure methods need to assume that high-order cumulants of a probability distribution approximate to zero. However, this strong assumption is not satisfied for many biochemical reaction networks. Here, we introduce convergent moments (defined in mathematics as the coefficients in the Taylor expansion of the probability-generating function at some point) to overcome this drawback of the moment-closure methods. As such, we develop a new analysis method for stochastic chemical kinetics. This method provides an accurate approximation for the master probability equation (MPE). In particular, the connection between low-order convergent moments and rate constants can be more easily derived in terms of explicit and analytical forms, allowing insights that would be difficult to obtain through direct simulation or manipulation of the MPE. In addition, it provides an accurate and efficient way to compute steady-state or transient probability distribution, avoiding the algorithmic difficulty associated with stiffness of the MPE due to large differences in sizes of rate constants. Applications of the method to several systems reveal nontrivial stochastic mechanisms of gene expression dynamics, e.g., intrinsic fluctuations can induce transient bimodality and amplify transient signals, and slow switching between promoter states can increase fluctuations in spatially heterogeneous signals. The overall approach has broad applications in modeling, analysis, and computation of complex biochemical networks with intrinsic noise.

Intentional preparation of auditory attention-switches: Explicit cueing and sequential switch-predictability.

PubMed

Seibold, Julia C; Nolden, Sophie; Oberem, Josefa; Fels, Janina; Koch, Iring

2018-06-01

In an auditory attention-switching paradigm, participants heard two simultaneously spoken number-words, each presented to one ear, and decided whether the target number was smaller or larger than 5 by pressing a left or right key. An instructional cue in each trial indicated which feature had to be used to identify the target number (e.g., female voice). Auditory attention-switch costs were found when this feature changed compared to when it repeated in two consecutive trials. Earlier studies employing this paradigm showed mixed results when they examined whether such cued auditory attention-switches can be prepared actively during the cue-stimulus interval. This study systematically assessed which preconditions are necessary for the advance preparation of auditory attention-switches. Three experiments were conducted that controlled for cue-repetition benefits, modality switches between cue and stimuli, as well as for predictability of the switch-sequence. Only in the third experiment, in which predictability for an attention-switch was maximal due to a pre-instructed switch-sequence and predictable stimulus onsets, active switch-specific preparation was found. These results suggest that the cognitive system can prepare auditory attention-switches, and this preparation seems to be triggered primarily by the memorised switching-sequence and valid expectations about the time of target onset.

Energy cost and game flow of 5 exer-games in trained players.

PubMed

Bronner, Shaw; Pinsker, Russell; Noah, J Adam

2013-05-01

To determine energy expenditure and player experience in exer-games designed for novel platforms. Energy cost of 7 trained players was measured in 5 music-based exer-games. Participants answered a questionnaire about "game flow," experience of enjoyment, and immersion in game play. Energy expenditure during game play ranged from moderate to vigorous intensity (4 - 9 MET). Participant achieved highest MET levels and game flow while playing StepMania and lowest MET levels and game flow when playing Wii Just Dance 3(®) and Kinect Dance Central™. Game flow scores positively correlated with MET levels. Physiological measurement and game flow testing during game development may help to optimize exer-game player activity and experience.

Air-bridge and Vertical CNT Switches for High Performance Switching Applications

NASA Technical Reports Server (NTRS)

Kaul, Anupama B.; Wong, Eric W.; Epp, Larry; Bronikowski, Michael J.; Hunt, BBrian D.

2006-01-01

Carbon nanotubes are attractive for switching applications since electrostatically-actuated CNT switches have low actuation voltages and power requirements, while allowing GHz switching speeds that stem from the inherently high elastic modulus and low mass of the CNT.Our first NEM structure, the air-bridge switch, consists of suspended single-walled nanotubes (SWNTs) that lie above a sputtered Nb base electrode, where contact to the CNTs is made using evaporated Au/Ti. Electrical measurements of these air-bridge devices show well-defined ON and OFF states as a dc bias of a few volts is applied between the CNT and the Nb-base electrode. The CNT air-bridge switches were measured to have switching times down to a few nanoseconds. Our second NEM structure, the vertical CNT switch, consists of nanotubes grown perpendicular to the substrate. Vertical multi-walled nanotubes (MWNTs) are grown directly on a heavily doped Si substrate, from 200 - 300 nm wide, approximately 1 micrometer deep nano-pockets, with Nb metal electrodes to result in the formation of a vertical single-pole-double-throw switch architecture.

Precise estimates of gaming-related harm should guide regulation of gaming.

PubMed

Starcevic, Vladan; Billieux, Joël

2018-06-13

Regulation of gaming is largely based on the perception of gaming-related harm. This perception varies from one country to another and does not necessarily correspond to the real gaming-related harm. It is argued that there is a crucial need to define and assess domains of this harm in order to introduce policies that regulate gaming. Such policies would ideally be targeted at individuals at risk for problematic gaming and would be based more on educational efforts than on restrictive measures. The role of gaming industry in the regulation of gaming would depend on the more precise estimates of gaming-related harm.

Stochastic-field cavitation model

NASA Astrophysics Data System (ADS)

Dumond, J.; Magagnato, F.; Class, A.

2013-07-01

Nonlinear phenomena can often be well described using probability density functions (pdf) and pdf transport models. Traditionally, the simulation of pdf transport requires Monte-Carlo codes based on Lagrangian "particles" or prescribed pdf assumptions including binning techniques. Recently, in the field of combustion, a novel formulation called the stochastic-field method solving pdf transport based on Eulerian fields has been proposed which eliminates the necessity to mix Eulerian and Lagrangian techniques or prescribed pdf assumptions. In the present work, for the first time the stochastic-field method is applied to multi-phase flow and, in particular, to cavitating flow. To validate the proposed stochastic-field cavitation model, two applications are considered. First, sheet cavitation is simulated in a Venturi-type nozzle. The second application is an innovative fluidic diode which exhibits coolant flashing. Agreement with experimental results is obtained for both applications with a fixed set of model constants. The stochastic-field cavitation model captures the wide range of pdf shapes present at different locations.

Video games.

PubMed

Funk, Jeanne B

2005-06-01

The video game industry insists that it is doing everything possible to provide information about the content of games so that parents can make informed choices; however, surveys indicate that ratings may not reflect consumer views of the nature of the content. This article describes some of the currently popular video games, as well as developments that are on the horizon, and discusses the status of research on the positive and negative impacts of playing video games. Recommendations are made to help parents ensure that children play games that are consistent with their values.

Game theory.

PubMed

Dufwenberg, Martin

2011-03-01

Game theory is a toolkit for examining situations where decision makers influence each other. I discuss the nature of game-theoretic analysis, the history of game theory, why game theory is useful for understanding human psychology, and why game theory has played a key role in the recent explosion of interest in the field of behavioral economics. WIREs Cogni Sci 2011 2 167-173 DOI: 10.1002/wcs.119 For further resources related to this article, please visit the WIREs website. Copyright © 2010 John Wiley & Sons, Ltd.

Beyond game effectiveness. Part II, a qualitative study of multi-role experiential learning.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Willis, Matthew; Tucker, Eilish Marie; Raybourn, Elaine Marie

The present paper is the second in a series published at I/ITSEC that seeks to explain the efficacy of multirole experiential learning employed to create engaging game-based training methods transitioned to the U.S. Army, U.S. Army Special Forces, Civil Affairs, and Psychological Operations teams. The first publication (I/ITSEC 2009) summarized findings from a quantitative study that investigated experiential learning in the multi-player, PC-based game module transitioned to PEO-STRI, DARWARS Ambush! NK (non-kinetic). The 2009 publication reported that participants of multi-role (Player and Reflective Observer/Evaluator) game-based training reported statistically significant learning and engagement. Additionally when the means of the two groupsmore » (Player and Reflective Observer/Evaluator) were compared, they were not statistically significantly different from each other. That is to say that both playing as well as observing/evaluating were engaging learning modalities. The Observer/Evaluator role was designed to provide an opportunity for real-time reflection and meta-cognitive learning during game play. Results indicated that this role was an engaging way to learn about communication, that participants learned something about cultural awareness, and that the skills they learned were helpful in problem solving and decision-making. The present paper seeks to continue to understand what and how users of non-kinetic game-based missions learn by revisiting the 2009 quantitative study with further investigation such as stochastic player performance analysis using latent semantic analyses and graph visualizations to correlate against human coder ratings and pre- and post-test self-analysis. The results are applicable to First-Person game-based learning systems designed to enhance trainee intercultural communication, interpersonal skills, and adaptive thinking. In the full paper, we discuss results obtained from data collected from 78 research participants of

Alarm toe switch

DOEpatents

Ganyard, Floyd P.

1982-01-01

An alarm toe switch inserted within a shoe for energizing an alarm circuit n a covert manner includes an insole mounting pad into which a miniature reed switch is fixedly molded. An elongated slot perpendicular to the reed switch is formed in the bottom surface of the mounting pad. A permanent cylindrical magnet positioned in the forward portion of the slot with a diameter greater than the pad thickness causes a bump above the pad. A foam rubber block is also positioned in the slot rearwardly of the magnet and holds the magnet in normal inoperative relation. A non-magnetic support plate covers the slot and holds the magnet and foam rubber in the slot. The plate minimizes bending and frictional forces to improve movement of the magnet for reliable switch activation. The bump occupies the knuckle space beneath the big toe. When the big toe is scrunched rearwardly the magnet is moved within the slot relative to the reed switch, thus magnetically activating the switch. When toe pressure is released the foam rubber block forces the magnet back into normal inoperative position to deactivate the reed switch. The reed switch is hermetically sealed with the magnet acting through the wall so the switch assembly S is capable of reliable operation even in wet and corrosive environments.

Altered Heart Rate Variability During Gaming in Internet Gaming Disorder.

PubMed

Lee, Deokjong; Hong, Sung Jun; Jung, Young-Chul; Park, Jinsick; Kim, In Young; Namkoong, Kee

2018-04-01

Internet gaming disorder (IGD) is characterized by addiction to online gaming and reduced executive control, particularly when individuals are exposed to gaming-related cues. Executive control can be measured as vagally mediated heart rate variability (HRV), which corresponds to variability in the time interval between heart beats. In this study, we investigated whether individuals with IGD have altered HRV while playing online games. We hypothesized that while gaming, individuals with IGD would exhibit phasic suppression of vagally mediated HRV, which would reflect executive control dysfunction during game play. To test this, we measured the changes of HRV when young males with IGD were engaged in real-time online gaming. The changes of HRV were associated with the severity of IGD assessed by self-reports and prefrontal gray matter volume (GMV) calculated by voxel-based morphometry. We included 23 IGD subjects and 18 controls in our analyses. Changes in HRV were not statistically different between IGD subjects and controls. Within the IGD group, however, subjects showed significant decreases in high-frequency (HF) HRV during gaming. Furthermore, the degree of decrease correlated with IGD severity and prefrontal GMV. Importantly, this phasic suppression of HF-HRV in response to gaming did not occur in control subjects. In conclusion, young males with IGD showed an altered HRV response while playing an online game, reflecting their difficulties in executive control over gaming. The dynamics between executive control and reward seeking may be out of balance during game play in IGD.

Remote switch actuator

DOEpatents

Haas, Edwin Gerard; Beauman, Ronald; Palo, Jr., Stefan

2013-01-29

The invention provides a device and method for actuating electrical switches remotely. The device is removably attached to the switch and is actuated through the transfer of a user's force. The user is able to remain physically removed from the switch site obviating need for protective equipment. The device and method allow rapid, safe actuation of high-voltage or high-current carrying electrical switches or circuit breakers.

Extended non-local games and monogamy-of-entanglement games.

PubMed

Johnston, Nathaniel; Mittal, Rajat; Russo, Vincent; Watrous, John

2016-05-01

We study a generalization of non-local games-which we call extended non-local games -in which the players, Alice and Bob, initially share a tripartite quantum state with the referee. In such games, the winning conditions for Alice and Bob may depend on the outcomes of measurements made by the referee, on its part of the shared quantum state, in addition to Alice and Bob's answers to randomly selected questions. Our study of this class of games was inspired by the monogamy-of-entanglement games introduced by Tomamichel, Fehr, Kaniewski and Wehner, which they also generalize. We prove that a natural extension of the Navascués-Pironio-Acín hierarchy of semidefinite programmes converges to the optimal commuting measurement value of extended non-local games, and we prove two extensions of results of Tomamichel et al.  concerning monogamy-of-entanglement games.

Switching antipsychotic medications.

PubMed

Weiden, P J; Aquila, R; Dalheim, L; Standard, J M

1997-01-01

Compared with conventional antipsychotics, the so-called "atypical" antipsychotics promise improved side effect profiles and better control of the symptoms of schizophrenia. Therefore, most patients currently taking conventional antipsychotics could potentially benefit from a switch to an atypical antipsychotic. Often, the key issue in deciding whether to switch is the presence of countervailing factors that mitigate against the change. This paper discusses the indications and contraindications for switching antipsychotics, plus issues that require consideration before a switch is made. Also, the advantages and disadvantages of various switching techniques are discussed, with a particular focus on the newer antipsychotic olanzapine.

An acoustic switch.

PubMed

Vanhille, Christian; Campos-Pozuelo, Cleofé

2014-01-01

The benefits derived from the development of acoustic transistors which act as switches or amplifiers have been reported in the literature. Here we propose a model of acoustic switch. We theoretically demonstrate that the device works: the input signal is totally restored at the output when the switch is on whereas the output signal nulls when the switch is off. The switch, on or off, depends on a secondary acoustic field capable to manipulate the main acoustic field. The model relies on the attenuation effect of many oscillating bubbles on the main travelling wave in the liquid, as well as on the capacity of the secondary acoustic wave to move the bubbles. This model evidences the concept of acoustic switch (transistor) with 100% efficiency. Copyright © 2013 Elsevier B.V. All rights reserved.

Gamble While You Gamble: Electronic Games in Ontario Charitable Gaming Centres.

PubMed

Harrigan, Kevin; Brown, Dan; MacLaren, Vance

Electronic Bingo games have recently appeared in Ontario Charitable Gaming Centres. Here we summarize the characteristics of this novel form of electronic gambling, and give a detailed characterization of one game. We contend that these games have structural characteristics that make them similar to modern Electronic Gaming Machines (EGMs) that feature multiline slots games. These features include a fast and continuous gaming experience, with player adjustable win size and reinforcement rate, a high frequency of losses disguised as wins, and highly salient near misses. Some of these games also have bonus rounds and provide players with a list of recent wins. We conclude that provincial and state gaming authorities should be aware that the placement of Bingo EGMs in existing Bingo facilities may increase problem gambling among an already well-established community of Bingo enthusiasts.

The Two-On-One Stochastic Duel

DTIC Science & Technology

1983-12-01

ACN 67500 TRASANA-TR-43-83 (.0 (v THE TWO-ON-ONE STOCHASTIC DUEL I • Prepared By A.V. Gafarian C.J. Ancker, Jr. DECEMBER 19833D I°"’" " TIC ELECTE...83 M A IL / _ _ 4. TITLE (and Subtitle) TYPE OF REPORT & PERIOD CO\\,ERED The Two-On-One Stochastic Duel Final Report 6. PERFORMING ORG. REPORT NUMBER...Stochastic Duels , Stochastic Processed, and Attrition. 5-14cIa~c fal roLCS-e ss 120. ABSTRACT (C’ntfMte am reverse Ed& if necesemay and idemtitf by block

Coaxial Switch

DTIC Science & Technology

2014-04-23

0005] RF coaxial switches are typically used in environments that are prone to mechanical shocks and vibrations . For example, in military...withstand mechanical shocks and vibrations and to maintain an RF connection throughout a shock or a vibration event. Attorney Docket No. 102139...3 of 16 [0006] It has been found that shocks and vibrations on prior art rotary-type coaxial switches may cause the shaft in the coaxial switch

Fleet Arctic Operations Game: Game Report

DTIC Science & Technology

2011-09-01

By: Director: CDR Christopher Gray Designer : Prof. Leif Bergey Analyst: Prof. Walter A. Berbrick Report Documentation Page Form ApprovedOMB No...7 II. GAME DESIGN & RESEARCH...METHODOLOGY ......................................................................... 9 Discussion of Game Design

Learning by gaming - evaluation of an online game for children.

PubMed

Lazareck, Lisa J; Farrell, David; Kostkova, Patty; Lecky, Donna M; McNulty, Cliodna A M; Weerasinghe, Dasun

2010-01-01

Playing computer games is widely popular among children and teenagers as an entertainment activity; meanwhile, playing computer games also provides a learning opportunity. For example, the rules of the game have to be learned by the player in order to improve his/her performance. Based on that principle, the City eHealth Research Centre (CeRC) developed a web game for 13-15 year olds, whereby the player becomes an investigator who attends the scene of an incident that involves microbes. There are four missions in total, each involving a mystery that the player needs to solve and learning objectives that need to be taught - such as antibiotic resistance and the importance of hygiene. This paper presents the results from a game evaluation that took place between July of 2009, in four UK schools (Glasgow, Gloucester, London), with 129 students; whereby 98% of the students commented positively about playing the game. Subsequently, CeRC has improved the game and developed an interactive educational games portal (www.edugames4all.com) for different age groups of web game enthusiasts.

Rare events in stochastic populations under bursty reproduction

NASA Astrophysics Data System (ADS)

Be'er, Shay; Assaf, Michael

2016-11-01

Recently, a first step was made by the authors towards a systematic investigation of the effect of reaction-step-size noise—uncertainty in the step size of the reaction—on the dynamics of stochastic populations. This was done by investigating the effect of bursty influx on the switching dynamics of stochastic populations. Here we extend this formalism to account for bursty reproduction processes, and improve the accuracy of the formalism to include subleading-order corrections. Bursty reproduction appears in various contexts, where notable examples include bursty viral production from infected cells, and reproduction of mammals involving varying number of offspring. The main question we quantitatively address is how bursty reproduction affects the overall fate of the population. We consider two complementary scenarios: population extinction and population survival; in the former a population gets extinct after maintaining a long-lived metastable state, whereas in the latter a population proliferates despite undergoing a deterministic drift towards extinction. In both models reproduction occurs in bursts, sampled from an arbitrary distribution. Using the WKB approach, we show in the extinction problem that bursty reproduction broadens the quasi-stationary distribution of population sizes in the metastable state, which results in a drastic reduction of the mean time to extinction compared to the non-bursty case. In the survival problem, it is shown that bursty reproduction drastically increases the survival probability of the population. Close to the bifurcation limit our analytical results simplify considerably and are shown to depend solely on the mean and variance of the burst-size distribution. Our formalism is demonstrated on several realistic distributions which all compare well with numerical Monte-Carlo simulations.

Momentum Maps and Stochastic Clebsch Action Principles

NASA Astrophysics Data System (ADS)

Cruzeiro, Ana Bela; Holm, Darryl D.; Ratiu, Tudor S.

2018-01-01

We derive stochastic differential equations whose solutions follow the flow of a stochastic nonlinear Lie algebra operation on a configuration manifold. For this purpose, we develop a stochastic Clebsch action principle, in which the noise couples to the phase space variables through a momentum map. This special coupling simplifies the structure of the resulting stochastic Hamilton equations for the momentum map. In particular, these stochastic Hamilton equations collectivize for Hamiltonians that depend only on the momentum map variable. The Stratonovich equations are derived from the Clebsch variational principle and then converted into Itô form. In comparing the Stratonovich and Itô forms of the stochastic dynamical equations governing the components of the momentum map, we find that the Itô contraction term turns out to be a double Poisson bracket. Finally, we present the stochastic Hamiltonian formulation of the collectivized momentum map dynamics and derive the corresponding Kolmogorov forward and backward equations.

Games and Learning

ERIC Educational Resources Information Center

Oblinger, Diana G.

2006-01-01

From a very early age, people learn from games and play. Parents and preschool teachers use games to teach colors, numbers, names, and shapes; the process is drill and practice. Games engage everyone, capturing their attention. People willingly spend time on task. Although students in high school and college continue to play games, games rarely…

The Use of Computer Games as an Educational Tool: Identification of Appropriate Game Types and Game Elements.

ERIC Educational Resources Information Center

Amory, Alan; Naicker, Kevin; Vincent, Jacky; Adams, Claudia

1999-01-01

Describes research with college students that investigated commercial game types and game elements to determine what would be suitable for education. Students rated logic, memory, visualization, and problem solving as important game elements that are used to develop a model that links pedagogical issues with game elements. (Author/LRW)

Random transitions described by the stochastic Smoluchowski-Poisson system and by the stochastic Keller-Segel model.

PubMed

Chavanis, P H; Delfini, L

2014-03-01

We study random transitions between two metastable states that appear below a critical temperature in a one-dimensional self-gravitating Brownian gas with a modified Poisson equation experiencing a second order phase transition from a homogeneous phase to an inhomogeneous phase [P. H. Chavanis and L. Delfini, Phys. Rev. E 81, 051103 (2010)]. We numerically solve the N-body Langevin equations and the stochastic Smoluchowski-Poisson system, which takes fluctuations (finite N effects) into account. The system switches back and forth between the two metastable states (bistability) and the particles accumulate successively at the center or at the boundary of the domain. We explicitly show that these random transitions exhibit the phenomenology of the ordinary Kramers problem for a Brownian particle in a double-well potential. The distribution of the residence time is Poissonian and the average lifetime of a metastable state is given by the Arrhenius law; i.e., it is proportional to the exponential of the barrier of free energy ΔF divided by the energy of thermal excitation kBT. Since the free energy is proportional to the number of particles N for a system with long-range interactions, the lifetime of metastable states scales as eN and is considerable for N≫1. As a result, in many applications, metastable states of systems with long-range interactions can be considered as stable states. However, for moderate values of N, or close to a critical point, the lifetime of the metastable states is reduced since the barrier of free energy decreases. In that case, the fluctuations become important and the mean field approximation is no more valid. This is the situation considered in this paper. By an appropriate change of notations, our results also apply to bacterial populations experiencing chemotaxis in biology. Their dynamics can be described by a stochastic Keller-Segel model that takes fluctuations into account and goes beyond the usual mean field approximation.

Sport Education as a Curriculum Approach to Student Learning of Invasion Games: Effects on Game Performance and Game Involvement

PubMed Central

Farias, Cláudio; Valério, Carla; Mesquita, Isabel

2018-01-01

The teaching and learning of games and sport-based activities has historically been the dominant form of the physical education curricula. With an interest in providing to students meaningful and culturally situated sporting experiences, Sport Education is probably the most implemented and researched pedagogical model worldwide. However, although there is considerable evidence that the model as a curriculum approach can benefit the development of social goals and healthy sport behaviors, not a single study as to date examined students’ game-play development beyond participation in single and isolated teaching units. Therefore, the purpose of this study was to examine students’ development of Game Performance and Game Involvement during participation in three consecutive Sport Education seasons of invasion games. The participants were an experienced physical education teacher and one seventh-grade class totaling 26 students (10 girls and 16 boys). Using the Game Performance Assessment Instrument (Oslin et al., 1998), pre-test to post-tests measures of students’ Game Performance and Game Involvement were collected during their participation in basketball (20 lessons), handball (16 lessons), and football (18 lessons) units. Inter-group differences and pre-test to post-test improvements within each season were analyzed through 2 (time) x group (sport) repeated measures ANOVA tests. There were found significant pre-test to post-test improvements in Game Performance and Game Involvement in the second (handball) and third (football) seasons, but not in the first season (basketball). Students’ Game Performance and Involvement scores of handball and football were significantly higher than their scores while playing basketball. The opportunity for an extended engagement in game-play activities and prolonged membership of students in the same teams throughout three consecutive seasons of Sport Education were key to the outcomes found. The specific configurations of